Commit Graph

1357 Commits

Author SHA1 Message Date
Chocobozzz 6a49056026 Add TMP persistent directory
To store files that must be preserved between peertube restarts
2023-05-09 08:57:34 +02:00
Chocobozzz 3a0c2a77b1 Enable external plugins to test the PR 2023-05-09 08:57:34 +02:00
Chocobozzz 9a3db678f5 Fix import video file lock 2023-05-09 08:57:34 +02:00
Chocobozzz cc2abbc320 Fix next video state after optimize/audio merge 2023-05-09 08:57:34 +02:00
Chocobozzz 0c9668f779 Implement remote runner jobs in server
Move ffmpeg functions to @shared
2023-05-09 08:57:34 +02:00
Chocobozzz 6bcb854cde
Fix unregister default value 2023-05-05 14:47:24 +02:00
Chocobozzz 841ddf8886
Don't call plugin register/unregister methods 2023-05-05 14:24:27 +02:00
Chocobozzz 82d1653d79
Prevent crash on plugin ws error 2023-04-17 09:51:18 +02:00
Chocobozzz 0cda019c1d
Remove invalid jsonld property 2023-04-11 14:06:46 +02:00
Wicklow b302c80dc0
feature/ability to disable video history by default (#5728)
* draft: ability to disable video history by default

* Update configuration and add tests

* Updated code based on review comments

* Add tests on registration and video quota

* Remove required video quotas in query

* Fix tests
2023-04-07 10:09:54 +02:00
Wicklow 05a60d8599
Feature/Add replay privacy (#5692)
* Add replay settings feature

* Fix replay settings behaviour

* Fix tests

* Fix tests

* Fix tests

* Update openapi doc and fix tests

* Add tests and fix code

* Models correction

* Add migration and update controller and middleware

* Add check params tests

* Fix video live middleware

* Updated code based on review comments
2023-03-31 09:12:21 +02:00
Chocobozzz d91ce83d39
Add filter:html.client.json-ld.result hook 2023-03-24 18:37:55 +01:00
Chocobozzz c3441b0320
Add video AP hooks 2023-03-16 10:36:33 +01:00
Chocobozzz 96d00a997b
Add test on AP hooks 2023-03-10 15:19:33 +01:00
Chocobozzz 866b5d3f52
Add ability for plugins to alter video jsonld 2023-03-10 14:42:18 +01:00
Chocobozzz 8d1f78044c
Add ability to disable http duration OTEL metrics 2023-02-27 13:53:54 +01:00
John Livingston 5471449f99 Fix #5614: do not log bearerToken. 2023-02-17 15:10:47 +01:00
Chocobozzz 82e3ae1523
Fix CI 2023-02-17 09:21:11 +01:00
Chocobozzz 182082f52d
Update bullmq
Requires redis >= 6.2
2023-02-16 14:10:11 +01:00
Chocobozzz e65ef81cf5
Update server dependencies 2023-02-16 11:56:58 +01:00
Chocobozzz 20321f2049
Reencode the video on cut
Unfortunately copying audio/video is not precise enough and could lead
to inconsistencies
2023-02-14 14:06:34 +01:00
Chocobozzz 4565774669
Fix retrying update on sql serialization conflict 2023-02-14 09:03:22 +01:00
Chocobozzz afb371d940
Refactor playlist creation for lives 2023-01-27 09:04:02 +01:00
Chocobozzz a2be43f570
Merge branch 'release/5.0.0' into develop 2023-01-27 08:34:16 +01:00
Chocobozzz 8059e050ef
Fix live with base url object storage 2023-01-27 08:30:56 +01:00
Chocobozzz e364e31e25 Implement signup approval in server 2023-01-19 13:53:40 +01:00
Chocobozzz 3f3530c3db
Merge branch 'release/5.0.0' into develop 2023-01-12 08:54:13 +01:00
Chocobozzz 8180f60477
Fix ACL incompatibility with some s3 providers
We'll move to another method in the future

See https://github.com/Chocobozzz/PeerTube/issues/5497
2023-01-12 08:41:16 +01:00
Chocobozzz 1c30b112b9
Fix lint 2023-01-09 14:42:52 +01:00
Chocobozzz 0a8a79552c
Merge branch 'feature/SO035' into develop 2023-01-09 09:44:00 +01:00
Chocobozzz cde3d90ded
Use raw sql for comments 2023-01-09 09:29:02 +01:00
Chocobozzz 5847724474
Add tracker opentelemtry metrics 2023-01-05 10:19:51 +01:00
Chocobozzz 60bab7b540
Implement getServerListeningConfig plugin helper 2023-01-04 11:52:54 +01:00
Chocobozzz 60b880acdf
External auth can update user on login 2023-01-04 11:41:29 +01:00
Chocobozzz 7e0c26066a
External auth can set more user fields
videoQuota, videoQuotaDaily, adminFlags
2023-01-04 11:41:29 +01:00
Chocobozzz b65f5367ba
Add ability to customize token lifetime 2023-01-04 11:41:29 +01:00
Chocobozzz 9972ace3a3
Merge branch 'release/5.0.0' into develop 2022-12-30 15:28:49 +01:00
Chocobozzz 54db8e3d5c
Fix P2P with object storage 2022-12-30 15:05:14 +01:00
Chocobozzz 7ce2eac8fc
Improve sync channel logging 2022-12-28 16:11:11 +01:00
Chocobozzz 1fed9cb8d3
Don't need to use redis to block tracker ips
There could be many of them, so reduce load by storing IPs directly
inside node memory
2022-12-23 13:40:42 +01:00
Chocobozzz 868314e8bf
Add ability to get user from file token 2022-12-20 09:15:49 +01:00
Chocobozzz 57e11a20f1
Forward 206 status code for object storage proxy 2022-12-19 16:08:00 +01:00
Chocobozzz 71e3e879c0
Support reinjecting token in private m3u8 playlist 2022-12-02 15:25:20 +01:00
Chocobozzz 5949eca71f
Increase old jobs to delete per hour 2022-11-28 15:16:15 +01:00
Chocobozzz c3b21b68b5
Delete completed/failed jobs directly from bullmq 2022-11-23 17:13:01 +01:00
Chocobozzz 5800f354cc
Filter out invalid images from peertube 2022-11-23 16:23:22 +01:00
Florent fbad149ff2
Fix DISABLE_LOCAL_SEARCH blocking request to local search API (#5411) 2022-11-23 15:50:34 +01:00
Chocobozzz b1dbb9fefc
Merge branch 'release/4.3.0' into develop 2022-11-16 14:40:34 +01:00
Chocobozzz f240fb4bea
Fix broadcasting in parallel views 2022-11-16 14:40:10 +01:00
Chocobozzz 99b757488c
Fix server lint 2022-11-15 15:00:23 +01:00
Chocobozzz 4638cd713d
Don't inject untrusted input
Even if it's already checked in middlewares
It's better to have safe modals too
2022-11-15 14:41:55 +01:00
Chocobozzz 31a9ed960f
Add configuration for prometheus exporter hostname 2022-11-15 13:56:04 +01:00
Chocobozzz 077600e037
Upgrade server dependencies 2022-11-15 13:48:51 +01:00
Chocobozzz 90dbc73132
Type result 2022-11-14 16:36:17 +01:00
kontrollanten 564b9b5597
refactor(server): redis > ioredis (#5371)
* refactor(server): redis > ioredis

* refactor(JobQueue): reuse redis connection builder

* fix(redisio)

* fix(redis): setValue

* feat(redis): showFriendlyErrorStack

* feat(redis): auto pipelining

308017a6b9/README.md (autopipelining)

* dont use autopipelining for bullmq

* ioredis events
2022-11-14 16:26:20 +01:00
Chocobozzz ff91b644fb
Add ability to install alpha/beta/rc plugin 2022-11-14 16:21:59 +01:00
Chocobozzz 4efa5535cc
Fix infinite playlist import
Using an hard videos limit in config
2022-11-14 11:11:39 +01:00
Chocobozzz f30ef8cf98
Fix retranscoding of odd resolution 2022-11-07 10:43:22 +01:00
Chocobozzz c0a9de6652
Prevent uploadx too big log for config 2022-11-07 10:40:43 +01:00
Chocobozzz a32bf8cd20
Fix running again transcoding on a video only file 2022-11-07 10:25:24 +01:00
Chocobozzz 5fc4a1825c
Fix preview generation for imports 2022-10-31 14:29:48 +01:00
Chocobozzz 6740b6428b
Fix transcoding failure when importing a video 2022-10-31 13:30:39 +01:00
Chocobozzz 91c72729d8
Prevent error in redundancy scheduler 2022-10-31 08:57:52 +01:00
Chocobozzz eb8da03d1c
Prevent error in update scheduler 2022-10-31 08:51:52 +01:00
Chocobozzz 37ff5005b4
Add logger for uploadx 2022-10-28 10:47:06 +02:00
Chocobozzz aa887096f9
Correctly delete live files from object storage 2022-10-25 14:18:59 +02:00
Chocobozzz 508c1b1e9f
Correctly cleanup files from object storage 2022-10-25 11:51:20 +02:00
Chocobozzz 849f0fd3b2
Lock files to generate torrents/move files 2022-10-25 11:50:44 +02:00
Chocobozzz b3ce36069f Prevent concurrency issues when sending m3u8 file 2022-10-24 14:48:24 +02:00
Chocobozzz 9ab330b90d Use private ACL for private videos in s3 2022-10-24 14:48:24 +02:00
Chocobozzz 3545e72c68 Put private videos under a specific subdirectory 2022-10-24 14:48:24 +02:00
Chocobozzz cea2fd90dd
Merge branch 'release/4.3.0' into develop 2022-10-11 13:30:51 +02:00
Chocobozzz a6b26afc56
Fix channel follow with manually approved follower 2022-10-11 13:27:22 +02:00
Chocobozzz 9d4c60dccc
Add ability for plugins to register ws routes 2022-10-11 11:11:04 +02:00
kontrollanten c43ed8e862
Expose PeerTube socket to plugins (#5239)
* server(pluginHelpers): add socket

* test(plugins): add socket cases

* fixes after review

* Update plugin-helpers.ts

* Update plugin-helpers.ts
2022-10-10 15:18:31 +02:00
Chocobozzz a3e5f804ad
Encrypt OTP secret 2022-10-10 11:12:23 +02:00
Chocobozzz 56f4783075
Support two factor authentication in backend 2022-10-07 10:51:16 +02:00
Chocobozzz e37ca6cbc7
Prevent error log 2022-10-04 11:17:37 +02:00
Chocobozzz cfd57d2ca0
Live supports object storage
* Sync live files (segments, master playlist, resolution playlist,
   segment sha file) into object storage
 * Automatically delete them when the live ends
 * Segment sha file is now a file on disk, and not stored in memory
   anymore
2022-10-04 10:03:17 +02:00
Chocobozzz e15bc9dcd5
Merge branch 'release/4.3.0' into develop 2022-09-28 10:32:42 +02:00
Chocobozzz 1ce4256a65
Correctly handle RTMP streams without audio 2022-09-28 10:26:28 +02:00
Chocobozzz 49aa917509
Merge branch 'release/4.3.0' into develop 2022-09-28 10:03:32 +02:00
Chocobozzz 690bad52e1
Prevent "Cannot use same state" error 2022-09-28 10:03:06 +02:00
Chocobozzz 97922ecf64
Handle sync failure in synchronizeChannel fn 2022-09-27 09:50:18 +02:00
Chocobozzz 4f38148087
Add akismet tests 2022-09-23 15:38:21 +02:00
Chocobozzz b2a70e3ca2
Support refusing remote comments 2022-09-23 11:38:18 +02:00
Chocobozzz e0bfb72ce0
Cleanup actor image without width 2022-09-16 14:56:12 +02:00
Chocobozzz 9a3a23a834
Fix onlyAfter comparison 2022-09-16 13:51:57 +02:00
Chocobozzz 3c4754a3a1
Wait transcoding by default when importing a video 2022-09-16 13:48:06 +02:00
Chocobozzz 3204f4d17d
Fix sync import of latest videos 2022-09-16 09:37:07 +02:00
Chocobozzz 910744fb08
Improve VideoChannelSyncLatestScheduler logs 2022-09-14 15:10:37 +02:00
Chocobozzz 4404a7c467
Prevent job queue to be started before plugins 2022-09-14 11:45:18 +02:00
Chocobozzz d9dd51aec7
Try playlist rebuild transaction if needed 2022-09-09 12:05:57 +02:00
Chocobozzz 8409160821
Fix context 2022-09-09 11:33:06 +02:00
Chocobozzz 3d2e4f0371
Update server dependencies 2022-09-09 11:11:52 +02:00
Chocobozzz e4fc3697ac
Fix saved live master playlist bandwidth 2022-09-09 09:21:42 +02:00
Chocobozzz 405c83f9af
Use worker thread to send HTTP requests
Compute HTTP signature could be CPU intensive
2022-09-08 12:27:22 +02:00
q_h 23c0b67d7b
fix: validate s3 response (#5231)
* refactor:  remove `objectStoragePut`

this is already implemented in `lib-storage`

* fix:  validate s3 response

* fix:  enable built-in retries

* chore: add `leavePartsOnError` comment

* refactor: decrease partSize to speed up retries

* refactor: rethrow s3 errors

* refactor: reduce max_upload_part  default to 100MB

* refactor: validate response

* chore: add link to explanation
2022-09-08 08:54:12 +02:00
Chocobozzz e9fc9e03c1
Optimize fetching playlist urls 2022-09-08 08:41:48 +02:00
Chocobozzz 690bb8f9f3
Prefer using Object.values 2022-08-17 15:36:03 +02:00