Chocobozzz
5949eca71f
Increase old jobs to delete per hour
2022-11-28 15:16:15 +01:00
Chocobozzz
c3b21b68b5
Delete completed/failed jobs directly from bullmq
2022-11-23 17:13:01 +01:00
Chocobozzz
5800f354cc
Filter out invalid images from peertube
2022-11-23 16:23:22 +01:00
Florent
fbad149ff2
Fix DISABLE_LOCAL_SEARCH blocking request to local search API ( #5411 )
2022-11-23 15:50:34 +01:00
Chocobozzz
b1dbb9fefc
Merge branch 'release/4.3.0' into develop
2022-11-16 14:40:34 +01:00
Chocobozzz
f240fb4bea
Fix broadcasting in parallel views
2022-11-16 14:40:10 +01:00
Chocobozzz
99b757488c
Fix server lint
2022-11-15 15:00:23 +01:00
Chocobozzz
4638cd713d
Don't inject untrusted input
...
Even if it's already checked in middlewares
It's better to have safe modals too
2022-11-15 14:41:55 +01:00
Chocobozzz
31a9ed960f
Add configuration for prometheus exporter hostname
2022-11-15 13:56:04 +01:00
Chocobozzz
077600e037
Upgrade server dependencies
2022-11-15 13:48:51 +01:00
Chocobozzz
90dbc73132
Type result
2022-11-14 16:36:17 +01:00
kontrollanten
564b9b5597
refactor(server): redis > ioredis ( #5371 )
...
* refactor(server): redis > ioredis
* refactor(JobQueue): reuse redis connection builder
* fix(redisio)
* fix(redis): setValue
* feat(redis): showFriendlyErrorStack
* feat(redis): auto pipelining
308017a6b9/README.md (autopipelining)
* dont use autopipelining for bullmq
* ioredis events
2022-11-14 16:26:20 +01:00
Chocobozzz
ff91b644fb
Add ability to install alpha/beta/rc plugin
2022-11-14 16:21:59 +01:00
Chocobozzz
4efa5535cc
Fix infinite playlist import
...
Using an hard videos limit in config
2022-11-14 11:11:39 +01:00
Chocobozzz
f30ef8cf98
Fix retranscoding of odd resolution
2022-11-07 10:43:22 +01:00
Chocobozzz
c0a9de6652
Prevent uploadx too big log for config
2022-11-07 10:40:43 +01:00
Chocobozzz
a32bf8cd20
Fix running again transcoding on a video only file
2022-11-07 10:25:24 +01:00
Chocobozzz
5fc4a1825c
Fix preview generation for imports
2022-10-31 14:29:48 +01:00
Chocobozzz
6740b6428b
Fix transcoding failure when importing a video
2022-10-31 13:30:39 +01:00
Chocobozzz
91c72729d8
Prevent error in redundancy scheduler
2022-10-31 08:57:52 +01:00
Chocobozzz
eb8da03d1c
Prevent error in update scheduler
2022-10-31 08:51:52 +01:00
Chocobozzz
37ff5005b4
Add logger for uploadx
2022-10-28 10:47:06 +02:00
Chocobozzz
aa887096f9
Correctly delete live files from object storage
2022-10-25 14:18:59 +02:00
Chocobozzz
508c1b1e9f
Correctly cleanup files from object storage
2022-10-25 11:51:20 +02:00
Chocobozzz
849f0fd3b2
Lock files to generate torrents/move files
2022-10-25 11:50:44 +02:00
Chocobozzz
b3ce36069f
Prevent concurrency issues when sending m3u8 file
2022-10-24 14:48:24 +02:00
Chocobozzz
9ab330b90d
Use private ACL for private videos in s3
2022-10-24 14:48:24 +02:00
Chocobozzz
3545e72c68
Put private videos under a specific subdirectory
2022-10-24 14:48:24 +02:00
Chocobozzz
cea2fd90dd
Merge branch 'release/4.3.0' into develop
2022-10-11 13:30:51 +02:00
Chocobozzz
a6b26afc56
Fix channel follow with manually approved follower
2022-10-11 13:27:22 +02:00
Chocobozzz
9d4c60dccc
Add ability for plugins to register ws routes
2022-10-11 11:11:04 +02:00
kontrollanten
c43ed8e862
Expose PeerTube socket to plugins ( #5239 )
...
* server(pluginHelpers): add socket
* test(plugins): add socket cases
* fixes after review
* Update plugin-helpers.ts
* Update plugin-helpers.ts
2022-10-10 15:18:31 +02:00
Chocobozzz
a3e5f804ad
Encrypt OTP secret
2022-10-10 11:12:23 +02:00
Chocobozzz
56f4783075
Support two factor authentication in backend
2022-10-07 10:51:16 +02:00
Chocobozzz
e37ca6cbc7
Prevent error log
2022-10-04 11:17:37 +02:00
Chocobozzz
cfd57d2ca0
Live supports object storage
...
* Sync live files (segments, master playlist, resolution playlist,
segment sha file) into object storage
* Automatically delete them when the live ends
* Segment sha file is now a file on disk, and not stored in memory
anymore
2022-10-04 10:03:17 +02:00
Chocobozzz
e15bc9dcd5
Merge branch 'release/4.3.0' into develop
2022-09-28 10:32:42 +02:00
Chocobozzz
1ce4256a65
Correctly handle RTMP streams without audio
2022-09-28 10:26:28 +02:00
Chocobozzz
49aa917509
Merge branch 'release/4.3.0' into develop
2022-09-28 10:03:32 +02:00
Chocobozzz
690bad52e1
Prevent "Cannot use same state" error
2022-09-28 10:03:06 +02:00
Chocobozzz
97922ecf64
Handle sync failure in synchronizeChannel fn
2022-09-27 09:50:18 +02:00
Chocobozzz
4f38148087
Add akismet tests
2022-09-23 15:38:21 +02:00
Chocobozzz
b2a70e3ca2
Support refusing remote comments
2022-09-23 11:38:18 +02:00
Chocobozzz
e0bfb72ce0
Cleanup actor image without width
2022-09-16 14:56:12 +02:00
Chocobozzz
9a3a23a834
Fix onlyAfter comparison
2022-09-16 13:51:57 +02:00
Chocobozzz
3c4754a3a1
Wait transcoding by default when importing a video
2022-09-16 13:48:06 +02:00
Chocobozzz
3204f4d17d
Fix sync import of latest videos
2022-09-16 09:37:07 +02:00
Chocobozzz
910744fb08
Improve VideoChannelSyncLatestScheduler logs
2022-09-14 15:10:37 +02:00
Chocobozzz
4404a7c467
Prevent job queue to be started before plugins
2022-09-14 11:45:18 +02:00
Chocobozzz
d9dd51aec7
Try playlist rebuild transaction if needed
2022-09-09 12:05:57 +02:00
Chocobozzz
8409160821
Fix context
2022-09-09 11:33:06 +02:00
Chocobozzz
3d2e4f0371
Update server dependencies
2022-09-09 11:11:52 +02:00
Chocobozzz
e4fc3697ac
Fix saved live master playlist bandwidth
2022-09-09 09:21:42 +02:00
Chocobozzz
405c83f9af
Use worker thread to send HTTP requests
...
Compute HTTP signature could be CPU intensive
2022-09-08 12:27:22 +02:00
q_h
23c0b67d7b
fix: validate s3 response ( #5231 )
...
* refactor: remove `objectStoragePut`
this is already implemented in `lib-storage`
* fix: validate s3 response
* fix: enable built-in retries
* chore: add `leavePartsOnError` comment
* refactor: decrease partSize to speed up retries
* refactor: rethrow s3 errors
* refactor: reduce max_upload_part default to 100MB
* refactor: validate response
* chore: add link to explanation
2022-09-08 08:54:12 +02:00
Chocobozzz
e9fc9e03c1
Optimize fetching playlist urls
2022-09-08 08:41:48 +02:00
Chocobozzz
690bb8f9f3
Prefer using Object.values
2022-08-17 15:36:03 +02:00
Chocobozzz
2ec349aa85
Prefer using our pick function
2022-08-17 14:54:01 +02:00
Chocobozzz
0b684daa3d
Add videoUUID to playback metrics
2022-08-17 10:21:38 +02:00
Chocobozzz
fd3c2e8705
Add playback metric endpoint sent to OTEL
2022-08-16 10:33:27 +02:00
Chocobozzz
2a95b88477
Add spans for AP signature checkers
2022-08-11 14:10:18 +02:00
Chocobozzz
ab08ab4e28
Don't crash on redis connection error
2022-08-11 11:30:06 +02:00
Chocobozzz
4fd6dcfb44
Fix transcoding of quad audio channels
2022-08-10 16:05:38 +02:00
Chocobozzz
a3b472a12e
Add ability to list imports of a channel sync
2022-08-10 14:32:00 +02:00
Florent
2a491182e4
Channel sync ( #5135 )
...
* Add external channel URL for channel update / creation (#754 )
* Disallow synchronisation if user has no video quota (#754 )
* More constraints serverside (#754 )
* Disable sync if server configuration does not allow HTTP import (#754 )
* Working version synchronizing videos with a job (#754 )
TODO: refactoring, too much code duplication
* More logs and try/catch (#754 )
* Fix eslint error (#754 )
* WIP: support synchronization time change (#754 )
* New frontend #754
* WIP: Create sync front (#754 )
* Enhance UI, sync creation form (#754 )
* Warning message when HTTP upload is disallowed
* More consistent names (#754 )
* Binding Front with API (#754 )
* Add a /me API (#754 )
* Improve list UI (#754 )
* Implement creation and deletion routes (#754 )
* Lint (#754 )
* Lint again (#754 )
* WIP: UI for triggering import existing videos (#754 )
* Implement jobs for syncing and importing channels
* Don't sync videos before sync creation + avoid concurrency issue (#754 )
* Cleanup (#754 )
* Cleanup: OpenAPI + API rework (#754 )
* Remove dead code (#754 )
* Eslint (#754 )
* Revert the mess with whitespaces in constants.ts (#754 )
* Some fixes after rebase (#754 )
* Several fixes after PR remarks (#754 )
* Front + API: Rename video-channels-sync to video-channel-syncs (#754 )
* Allow enabling channel sync through UI (#754 )
* getChannelInfo (#754 )
* Minor fixes: openapi + model + sql (#754 )
* Simplified API validators (#754 )
* Rename MChannelSync to MChannelSyncChannel (#754 )
* Add command for VideoChannelSync (#754 )
* Use synchronization.enabled config (#754 )
* Check parameters test + some fixes (#754 )
* Fix conflict mistake (#754 )
* Restrict access to video channel sync list API (#754 )
* Start adding unit test for synchronization (#754 )
* Continue testing (#754 )
* Tests finished + convertion of job to scheduler (#754 )
* Add lastSyncAt field (#754 )
* Fix externalRemoteUrl sort + creation date not well formatted (#754 )
* Small fix (#754 )
* Factorize addYoutubeDLImport and buildVideo (#754 )
* Check duplicates on channel not on users (#754 )
* factorize thumbnail generation (#754 )
* Fetch error should return status 400 (#754 )
* Separate video-channel-import and video-channel-sync-latest (#754 )
* Bump DB migration version after rebase (#754 )
* Prettier states in UI table (#754 )
* Add DefaultScope in VideoChannelSyncModel (#754 )
* Fix audit logs (#754 )
* Ensure user can upload when importing channel + minor fixes (#754 )
* Mark synchronization as failed on exception + typos (#754 )
* Change REST API for importing videos into channel (#754 )
* Add option for fully synchronize a chnanel (#754 )
* Return a whole sync object on creation to avoid tricks in Front (#754 )
* Various remarks (#754 )
* Single quotes by default (#754 )
* Rename synchronization to video_channel_synchronization
* Add check.latest_videos_count and max_per_user options (#754 )
* Better channel rendering in list #754
* Allow sorting with channel name and state (#754 )
* Add missing tests for channel imports (#754 )
* Prefer using a parent job for channel sync
* Styling
* Client styling
Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-08-10 09:53:39 +02:00
Chocobozzz
7f529402d1
Fix live max rate
2022-08-09 13:59:51 +02:00
Chocobozzz
51335c72cf
Prevent job failure on concurrent HLS transcoding
2022-08-09 13:21:18 +02:00
Chocobozzz
e2b2c726b1
Fix job queue tests
2022-08-09 11:39:31 +02:00
Chocobozzz
b42c2c7e89
Avoid concurrency issue on transcoding
2022-08-09 09:32:17 +02:00
Chocobozzz
bd911b54b5
Use bullmq job dependency
2022-08-09 09:18:07 +02:00
Chocobozzz
5a921e7b74
Move to bullmq
2022-08-09 09:18:07 +02:00
Chocobozzz
5e2afe4290
Limit import depending on transcoding resolutions
2022-08-09 09:18:07 +02:00
Chocobozzz
64fd6158fd
Fix resolution to transcode hook name
2022-08-09 09:18:07 +02:00
Chocobozzz
84cae54e7a
Add option to not transcode original resolution
2022-08-09 09:18:07 +02:00
Florent
7e0f50d6e0
Use single quotes in server/ and update eslint rules
2022-08-08 08:25:36 +02:00
Florent
b37d80e3ce
Fix lint on hls.ts
2022-08-04 09:49:26 +02:00
Chocobozzz
c795e19663
Automatically rebuild native modules on ABI change
2022-08-03 15:08:36 +02:00
Chocobozzz
fd59208e8c
Fix lint
2022-08-03 11:54:08 +02:00
Chocobozzz
785f1897a4
Add notification plugin hook
2022-08-03 11:33:43 +02:00
Chocobozzz
0260dc8aca
Add channel server hooks
2022-08-03 11:24:42 +02:00
Chocobozzz
0b6f531653
Suffix external auth username on conflict
2022-08-03 10:10:26 +02:00
Chocobozzz
ebb9e53ada
Add plugin hook on transcoding resolutions building
2022-08-02 16:05:44 +02:00
Chocobozzz
22df69fdec
Add job queue hooks
2022-08-02 15:50:05 +02:00
Chocobozzz
7a9e420a02
Remove uneeded async
2022-08-02 14:41:44 +02:00
Chocobozzz
15eb9e5b8f
Fix typescript error
2022-08-01 15:27:49 +02:00
Chocobozzz
1bb4c9ab2e
Add ability to delete a specific video file
2022-08-01 14:55:10 +02:00
Chocobozzz
ce6b3765a2
Add more tracing
2022-07-28 10:56:05 +02:00
Chocobozzz
adc94cf09c
Add live and viewers otel metrics
2022-07-27 16:19:25 +02:00
Chocobozzz
50cc1ee48a
Fix process follow
2022-07-27 15:45:04 +02:00
Chocobozzz
073deef886
Handle rejected follows in client
...
Also add quick filters so it's easier to find pending follows
2022-07-27 13:52:13 +02:00
Chocobozzz
927fa4b11f
Add rejected state to follows
...
Prevent reprocessing already rejected follows
2022-07-27 13:52:13 +02:00
Chocobozzz
0f58b11f5c
Reduce joins need to generate AP url
2022-07-27 13:52:13 +02:00
Chocobozzz
9e2a4af3a0
Use unique AP id for accept/reject
2022-07-25 11:24:05 +02:00
Chocobozzz
7b6b445d91
Regenerate video filenames on transcoding
...
In particular when using manual transcoding, to invalidate potential
HTTP caches in front of peertube
2022-07-25 10:57:16 +02:00
Chocobozzz
c8fa571f32
Clearer live session
...
Get the save replay setting when the session started to prevent
inconsistent behaviour when the setting changed before the session was
processed by the live ending job
Display more information about the potential session replay in live
modal information
2022-07-22 15:22:21 +02:00
Chocobozzz
7fd28c99b9
Fix lint
2022-07-19 15:34:44 +02:00
Chocobozzz
cd1b8e9a40
Add node process metrics
2022-07-19 11:58:19 +02:00
Chocobozzz
0755cb89e7
Prevent logging error when saving delete live
2022-07-18 15:49:15 +02:00
Chocobozzz
1cc9774668
Fix incorrect error logs
2022-07-18 11:55:13 +02:00
Chocobozzz
654d4ede7f
Correctly handle actors without follow counters
2022-07-15 11:18:29 +02:00
Chocobozzz
2939925639
Fix live tests
2022-07-13 15:37:36 +02:00
Chocobozzz
ba2684cedd
Fix lint
2022-07-13 12:14:26 +02:00
Chocobozzz
c5cadb2859
Reduce unknown undo logging level
2022-07-13 11:07:01 +02:00
Chocobozzz
39d117a47d
Prevent error logs when aborting a stream
2022-07-13 10:57:04 +02:00
Chocobozzz
14f7ad399f
Add more error logs
2022-07-13 10:17:47 +02:00
Chocobozzz
3b0525106d
Prevent duplicated HLS playlist on transcoding
2022-07-13 10:15:41 +02:00
Chocobozzz
b0f4204266
Relax log level
...
401 is expected when the token has expired
federation issues are not very important
2022-07-13 10:04:22 +02:00
Chocobozzz
eaaf316fe1
Don't display errors when SMTP is not configured
...
info is enough
2022-07-12 16:32:05 +02:00
Chocobozzz
46f7cd6837
Fix handling broken lives
...
We want the latest session that may already be finished
2022-07-12 16:30:59 +02:00
Chocobozzz
4ddb53f65d
Auto retry video state db query on failure
2022-07-12 16:25:21 +02:00
Chocobozzz
a49407524f
Prevent invalid watch sections
2022-07-12 09:51:21 +02:00
Chocobozzz
9452d4fd33
/!\ Use a dedicated config file for development
...
It means you have to replace NODE_ENV=test to NODE_ENV=dev if you use it
npm run dev:* commands are already updated
2022-07-06 16:12:17 +02:00
Chocobozzz
630d0a1bf5
Introduce experimental telemetry
2022-07-06 15:13:55 +02:00
Chocobozzz
cd25344f74
Reduce lazy static error logs
2022-06-30 09:25:17 +02:00
Chocobozzz
031bbcd25d
Upgrade oauth2-server
2022-06-28 15:32:57 +02:00
Chocobozzz
4fae2b1f30
Rename video full loading
2022-06-28 15:06:15 +02:00
Chocobozzz
daa0226b0a
Lazy load piscina
2022-06-28 09:09:03 +02:00
Chocobozzz
ccd62a4502
Fix workers constants
2022-06-27 15:56:57 +02:00
Chocobozzz
3a54605d4e
Process images in a dedicated worker
2022-06-27 11:53:12 +02:00
Chocobozzz
c53853ca1b
Introduce worker threads to process remote images
2022-06-24 16:31:48 +02:00
Chocobozzz
92083e4228
Fix removed sha segments on fast restream
2022-06-24 09:57:55 +02:00
Chocobozzz
64324ac646
Merge branch 'release/4.2.0' into develop
2022-06-23 10:53:16 +02:00
Chocobozzz
53023be33a
Fix fast restream in saved permanent live
2022-06-23 10:30:48 +02:00
Chocobozzz
a91e9beb3f
Update server dependencies
2022-06-21 11:23:32 +02:00
Chocobozzz
714e33a742
Merge branch 'release/4.2.0' into develop
2022-06-20 10:23:19 +02:00
Chocobozzz
f53e1fcd99
Relax views federation
2022-06-20 10:04:52 +02:00
Chocobozzz
aa2ce188d1
Optimize view endpoint
2022-06-17 14:56:16 +02:00
Chocobozzz
fba911e2c8
Merge branch 'release/4.2.0' into develop
2022-06-17 14:17:06 +02:00
Chocobozzz
f27b7a750f
Send views in a dedicated queue
2022-06-17 14:08:13 +02:00
Chocobozzz
3396e65345
Optimize broadcast job creation
2022-06-17 11:55:03 +02:00
Chocobozzz
68d6e57870
Fix transaction when processing local viewer
2022-06-17 09:03:28 +02:00
Chocobozzz
3256771725
More robust move to object storage job failure
2022-06-16 14:29:53 +02:00
Chocobozzz
0c9a835466
Merge branch 'release/4.2.0' into develop
2022-06-16 14:11:31 +02:00
Chocobozzz
cdd838168d
Fix live ending job that breaks new live session
2022-06-16 13:39:57 +02:00
Chocobozzz
b89b0bfce9
Clearer video creation from API regarding rates
2022-06-08 15:42:09 +02:00
luz paz
7a4fd56ccd
Fix various typos
...
Found via `codespell -q 3 -S ./CREDITS.md,./CHANGELOG.md,./client/src/locale,./yarn.lock,./client/yarn.lock -L doubleclick,followings,nd,ot,ro,serie,splitted,tread,truthy`
2022-06-07 16:41:21 +02:00
Chocobozzz
6d9ed0b6cb
Merge branch 'release/4.2.0' into develop
2022-06-07 09:59:15 +02:00
Chocobozzz
4d52690134
Fix schema.org context
2022-06-07 08:47:41 +02:00
Chocobozzz
e815f566f3
Remove unused function
2022-06-03 16:28:20 +02:00
Chocobozzz
d3f4689bde
Add live autostart/messages in embed
2022-05-31 14:24:07 +02:00
Chocobozzz
ab623c0e0b
Merge branch 'release/4.2.0' into develop
2022-05-25 15:22:28 +02:00
Chocobozzz
c8fdfab0e3
More robust live ending job
2022-05-25 15:18:29 +02:00
Chocobozzz
5333788c08
Fix saving permanent live replay on quick restream
2022-05-25 14:54:16 +02:00
Chocobozzz
b34ee7fa5f
Cleanup muxing session method options
2022-05-25 11:08:12 +02:00
Chocobozzz
3eba7ab815
Add ability to set a custom video import timeout
2022-05-24 14:55:07 +02:00
Chocobozzz
3329325a64
Fix email action button label for reports
2022-05-24 09:19:03 +02:00
Chocobozzz
941d28cc7f
Reduce error logs
2022-05-18 12:01:02 +02:00
Chocobozzz
ca3d5912e1
Add use proxy for s3 ( #4973 )
...
* Fix object storage to be accessible via proxy
* fix lint
* Use hpagent
* Fix lint
* Fix PR
Co-authored-by: noellabo <noel.yoshiba@gmail.com>
2022-05-09 11:49:25 +02:00
Chocobozzz
f82ea670d8
Fix collection type
2022-05-09 09:51:11 +02:00
Chocobozzz
f40712abbb
Add ability to filter overall video stats by date
2022-05-06 14:23:02 +02:00