Chocobozzz
c186a67f90
Support short uuid for scripts
2021-08-17 11:06:10 +02:00
Chocobozzz
66a7fc9473
Remove optimize old videos script
...
It is not compatible with HLS and I don't have time to maintain it
2021-08-17 10:33:36 +02:00
Jelle Besseling
0305db28c9
Add support for saving video files to object storage ( #4290 )
...
* Add support for saving video files to object storage
* Add support for custom url generation on s3 stored files
Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.
* Upload files to s3 concurrently and delete originals afterwards
* Only publish after move to object storage is complete
* Use base url instead of url template
* Fix mistyped config field
* Add rudenmentary way to download before transcode
* Implement Chocobozzz suggestions
https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478
The remarks in question:
Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs
* Import correct function
* Support multipart upload
* Remove import of node 15.0 module stream/promises
* Extend maximum upload job length
Using the same value as for redundancy downloading seems logical
* Use dynamic part size for really large uploads
Also adds very small part size for local testing
* Fix decreasePendingMove query
* Resolve various PR comments
* Move to object storage after optimize
* Make upload size configurable and increase default
* Prune webtorrent files that are stored in object storage
* Move files after transcoding jobs
* Fix federation
* Add video path manager
* Support move to external storage job in client
* Fix live object storage tests
Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-08-17 08:26:20 +02:00
Chocobozzz
de34551da3
Typo
2021-08-11 14:43:03 +02:00
Chocobozzz
eb8bd9ab1a
Try to fix openapi script
2021-08-11 14:38:07 +02:00
Chocobozzz
679c12e69c
Improve target bitrate calculation
2021-08-06 14:13:26 +02:00
Chocobozzz
15a7eafb89
Refactor video links builders
2021-07-26 15:04:37 +02:00
Chocobozzz
764b1a14fc
Use random names for VOD HLS playlists
2021-07-26 11:29:31 +02:00
Chocobozzz
13e1337791
Speed up plugin transcoding tests
2021-07-22 08:55:14 +02:00
Chocobozzz
a24bd1ed41
Merge branch 'next' into develop
2021-07-21 15:51:30 +02:00
Chocobozzz
2b9f672b58
Improve plugin constant tests
2021-07-21 15:44:28 +02:00
Chocobozzz
c63830f154
Rename captions commands
2021-07-21 13:58:35 +02:00
Chocobozzz
254d3579f5
Use an object to represent a server
2021-07-20 15:27:18 +02:00
Chocobozzz
89d241a79c
Shorter server command names
2021-07-20 15:27:18 +02:00
Chocobozzz
d23dd9fbfc
Introduce videos command
2021-07-20 15:27:18 +02:00
Chocobozzz
9293139fde
Introduce sql command
2021-07-20 15:27:18 +02:00
Chocobozzz
12edc1495a
Introduce comments command
2021-07-20 15:27:18 +02:00
Chocobozzz
a2470c9f4b
Introduce captions command
2021-07-20 15:27:17 +02:00
Chocobozzz
329619b345
Introduce CLI command
2021-07-20 15:27:16 +02:00
Chocobozzz
13c749c121
Fix angular builds
2021-07-05 15:19:23 +02:00
Chocobozzz
ed76401ecd
Add ms to parse log dates
2021-06-29 15:22:12 +02:00
Chocobozzz
8cbc40b2fe
Move to sass module
2021-06-28 10:54:02 +02:00
Chocobozzz
8cc6120118
Upgrade server dependencies
2021-06-25 17:39:27 +02:00
Chocobozzz
29b7426c67
Speedup CI
2021-06-17 10:43:34 +02:00
Chocobozzz
8ebf2a5d5d
Refactor live manager
2021-06-17 08:47:03 +02:00
Chocobozzz
51f636ad0f
Display locale date time in parse log
2021-06-15 10:40:06 +02:00
Chocobozzz
3d470a530c
Faster ci using compiled ts files
2021-06-15 08:21:12 +02:00
Chocobozzz
71d4af1efc
Use raw SQL for most of video queries
2021-06-11 14:09:52 +02:00
Chocobozzz
27bc958674
Bidi support
2021-06-07 18:14:05 +02:00
frankstrater
5ed25fb76e
Remove annoying superfluous slash
2021-06-02 16:51:23 +02:00
Chocobozzz
4d7ce9218a
Merge branch 'release/3.2.0' into develop
2021-05-28 15:54:48 +02:00
Chocobozzz
86dc0b9cc9
Fix upgrade script
2021-05-28 15:54:18 +02:00
Chocobozzz
5351a0584f
Replace local menu icon
2021-05-28 14:56:42 +02:00
Chocobozzz
662351e626
Update embed webpack config
2021-05-27 16:00:13 +02:00
Chocobozzz
5b1a6d45b5
Merge branch 'release/3.2.0' into develop
2021-05-14 14:18:13 +02:00
Chocobozzz
cb4bab61c1
Fix logger warning level
2021-05-14 14:17:53 +02:00
Chocobozzz
7d9ba5c089
Cleanup models directory organization
2021-05-11 11:32:31 +02:00
Chocobozzz
c07902b908
Move transcoding files in their own directory
2021-05-11 11:32:31 +02:00
Chocobozzz
d15aebf511
Run misc tests in parallel
2021-05-07 15:42:23 +02:00
Chocobozzz
a0e69167ae
Remove scripty
...
It breaks our tests with the latest npm release
2021-05-05 10:51:32 +02:00
Chocobozzz
a45050e09e
Add player mode to player stats
2021-04-28 09:07:57 +02:00
Chocobozzz
6b4e74c2b7
Add log to prune storage script
2021-04-28 09:05:53 +02:00
Chocobozzz
4e11d8f3ca
Cleanup stats for nerds
2021-04-28 09:05:44 +02:00
Chocobozzz
3e0e8d4afd
Revert "Fix context menu when watching a playlist"
...
This reverts commit e8bb5b6b3a
.
We'll refactor this error handler in hls.js v1 upgrade
2021-04-21 15:28:12 +02:00
Chocobozzz
e8bb5b6b3a
Fix context menu when watching a playlist
2021-04-21 15:18:22 +02:00
Chocobozzz
84531547bc
Add size info in db for actor images
2021-04-08 13:38:04 +02:00
Chocobozzz
a0eeb45f14
Update data in DB when regenerate thumbnails
2021-04-08 13:38:04 +02:00
Chocobozzz
f479685678
Agnostic actor image storage
2021-04-08 10:07:53 +02:00
Chocobozzz
47099aba46
Fix benchmark
2021-03-30 08:57:17 +02:00
Chocobozzz
6794d1005f
Add log to regenerate thumbnails
2021-03-29 17:25:11 +02:00
kontrollanten
f076d49f37
script/upgrade: use db.name config value
2021-03-29 09:19:11 +02:00
Chocobozzz
c2bd7a6fcf
Add regenrate thumbnails scripts
2021-03-24 18:18:41 +01:00
Chocobozzz
452b3bea08
Introduce tags to the logger
...
That could help to filter unneeded logs and/or select particular
components
2021-03-24 18:18:40 +01:00
Chocobozzz
c221d62a8b
Fix CI moderation tests
2021-03-09 15:45:37 +01:00
Chocobozzz
f45aa01a1b
Support sq
2021-03-09 11:34:46 +01:00
Lukas Winkler
a5ea2aeaf0
use .load instead of .safeLoad in js-yaml
2021-03-04 12:08:02 +01:00
Chocobozzz
cd2c3dcdc4
Remove unnecessary transcoding job error
2021-03-03 10:23:05 +01:00
Chocobozzz
0ce8d34ea0
Add other routes to benchmark
2021-02-25 16:23:30 +01:00
Chocobozzz
5ac593b7f7
Update credits
2021-02-24 13:59:41 +01:00
Chocobozzz
e3234c3b4c
Fix credit script link
2021-02-24 13:56:04 +01:00
Chocobozzz
4abbeff575
Add benchmark script
2021-02-22 15:54:15 +01:00
Chocobozzz
94d721efdc
Fix stats tests
2021-02-19 16:29:00 +01:00
Chocobozzz
8efc27bf14
Cleanup
2021-02-18 13:38:09 +01:00
Chocobozzz
90a8bd305d
Dissociate video file names and video uuid
2021-02-18 13:38:09 +01:00
Chocobozzz
a35a22797c
Remove previous thumbnail if needed
2021-02-16 10:36:44 +01:00
Chocobozzz
a8b1b40485
Generate a name for thumbnails
...
Allows aggressive caching
2021-02-16 10:36:44 +01:00
Chocobozzz
9aeef9aafa
Check video UUID in args scripts
2021-02-11 16:15:11 +01:00
Chocobozzz
20eb3a5be0
Fix create transcoding job script
...
Depending on the file and the webtorrent/hls config
2021-02-11 15:40:54 +01:00
Chocobozzz
cdce5af7fc
Provide sourcemaps in release
2021-02-11 14:02:54 +01:00
Chocobozzz
d93e43164a
Update stats format
2021-02-11 08:41:12 +01:00
Chocobozzz
99bb59fa77
Add client build stats script
2021-02-10 16:16:46 +01:00
Chocobozzz
9129b7694d
Allow to specify transcoding and import jobs concurrency
2021-02-08 15:38:45 +01:00
Chocobozzz
ba5a8d89bb
Update server dependencies
2021-02-03 09:45:08 +01:00
Chocobozzz
29f148a613
Add ability to build client with source maps
2021-02-02 15:37:18 +01:00
Chocobozzz
cb5c2abc99
Improve parse log with sql
2021-02-01 15:04:45 +01:00
Chocobozzz
529b37527c
Use a profile manager for transcoding
2021-01-28 15:55:39 +01:00
Chocobozzz
1e743faafe
Disable sql prettifier by default
...
It adds too much lines, leading to difficulties when reading dev logs
2021-01-26 09:54:32 +01:00
Chocobozzz
24516aa26a
Refactor transcoding job handlers
2021-01-21 15:58:17 +01:00
Chocobozzz
1d22d2514f
Fix service worker
2021-01-18 11:16:37 +01:00
Rigel Kent
0984960345
add script printing command to generate a resolution for a given file
2021-01-13 09:13:31 +01:00
kontrollanten
75dd1b641f
chore: add manifest in light build
2021-01-13 09:10:52 +01:00
kontrollanten
dfdd158a75
client: register service worker
...
closes #296
2021-01-13 09:10:52 +01:00
Chocobozzz
0f4f2ab007
Use more threads for xz release compression
2021-01-07 09:04:10 +01:00
Chocobozzz
2b6c55528d
Clearer error in parse log
2020-12-22 10:15:06 +01:00
Chocobozzz
c7444546e7
Add gl support
2020-12-16 11:45:12 +01:00
Chocobozzz
113d4a3f73
Only link to crowdfunding pages in credits
2020-12-14 16:08:15 +01:00
Chocobozzz
5d221dcda4
Fix deprecated i18n option
2020-12-14 09:26:21 +01:00
Chocobozzz
59fd824cf3
Fix tests timeout
2020-12-14 09:11:27 +01:00
Chocobozzz
34caef7fc0
Add joblog at the end of ci
2020-12-14 09:11:27 +01:00
Chocobozzz
17ae86e912
Display job log in ci
2020-12-14 09:11:27 +01:00
Chocobozzz
e078371807
Parse log script can take files as args
2020-12-14 09:11:27 +01:00
Chocobozzz
0d9c2cc0a2
Test with 3 parallel tests
2020-12-14 09:11:27 +01:00
Chocobozzz
5f8327c507
Update i18n with new player keys
2020-12-04 16:37:21 +01:00
Chocobozzz
12394e7e4b
Update contributors
2020-12-02 16:14:56 +01:00
Chocobozzz
6b88559bab
Fix local e2e tests
2020-11-30 09:11:12 +01:00
Chocobozzz
ae48a71d57
Remove unused i18n build
2020-11-26 11:30:18 +01:00
Chocobozzz
c5ce27f864
Regen translations
2020-11-25 16:54:59 +01:00
Chocobozzz
2245e3df8c
Update scripts to update translations
2020-11-25 16:52:02 +01:00
Chocobozzz
5a547f69d5
Support encoding profiles
2020-11-25 10:07:51 +01:00
Chocobozzz
daf6e48010
Split ffmpeg utils with ffprobe utils
2020-11-25 10:07:51 +01:00