Commit Graph

3458 Commits

Author SHA1 Message Date
Chocobozzz 25691c9930
Prefer using sequelize replacements even for tests 2023-01-03 14:23:42 +01:00
Chocobozzz 9972ace3a3
Merge branch 'release/5.0.0' into develop 2022-12-30 15:28:49 +01:00
Chocobozzz 54db8e3d5c
Fix P2P with object storage 2022-12-30 15:05:14 +01:00
Chocobozzz 0daaab0c0e
Try to fix github api rate limit 2022-12-29 10:24:06 +01:00
Chocobozzz 4fe7cde283
Fix build 2022-12-29 10:14:43 +01:00
Chocobozzz 7ce2eac8fc
Improve sync channel logging 2022-12-28 16:11:11 +01:00
Chocobozzz ded68a9760
More robust short to complete uuid error handler 2022-12-28 14:42:48 +01:00
Chocobozzz 7a07da01c4
Improve upgrade documentation 2022-12-28 10:29:37 +01:00
Chocobozzz 03c9f04a47
Fix sync tests 2022-12-23 14:02:13 +01:00
Chocobozzz 1fed9cb8d3
Don't need to use redis to block tracker ips
There could be many of them, so reduce load by storing IPs directly
inside node memory
2022-12-23 13:40:42 +01:00
Chocobozzz 41027acb0a
Merge branch 'release/5.0.0' into develop 2022-12-21 10:56:57 +01:00
Chocobozzz dfa4944f34
Fix local channel stats 2022-12-21 10:46:58 +01:00
Chocobozzz ec3ce76f19
Prefer displaying channel in rss feeds 2022-12-20 09:28:01 +01:00
Chocobozzz 868314e8bf
Add ability to get user from file token 2022-12-20 09:15:49 +01:00
Chocobozzz 57e11a20f1
Forward 206 status code for object storage proxy 2022-12-19 16:08:00 +01:00
Chocobozzz 9b6c9b5ae6
Increase timeout 2022-12-12 16:16:27 +01:00
Chocobozzz 2732eeff9e
Fix CI using 127.0.0.1 for tests 2022-12-12 13:36:23 +01:00
Chocobozzz c7c5f8d0f1
Add austrian sign language 2022-12-09 09:18:39 +01:00
Chocobozzz c2fba93a60
Merge remote-tracking branch 'weblate/develop' into release/5.0.0 2022-12-07 09:00:49 +01:00
Chocobozzz b6640fa0af
Add req and res to allow download filter hooks 2022-12-06 13:50:18 +01:00
Chocobozzz b8598d40f6
Merge branch 'release/5.0.0' into develop 2022-12-02 17:54:23 +01:00
Chocobozzz 71e3e879c0
Support reinjecting token in private m3u8 playlist 2022-12-02 15:25:20 +01:00
Chocobozzz 190ac9df7c
Increase timeouts 2022-11-29 10:25:26 +01:00
Chocobozzz 5949eca71f
Increase old jobs to delete per hour 2022-11-28 15:16:15 +01:00
Chocobozzz a5858c3e53
Update changelog 2022-11-24 13:36:32 +01:00
Chocobozzz b7113ff7ef
Increase unicast job concurrency 2022-11-24 10:20:07 +01:00
Chocobozzz 624ea01b10
Fix overall viewers stats with start/end dates 2022-11-24 10:07:58 +01:00
Chocobozzz c3b21b68b5
Delete completed/failed jobs directly from bullmq 2022-11-23 17:13:01 +01:00
Chocobozzz 5800f354cc
Filter out invalid images from peertube 2022-11-23 16:23:22 +01:00
Chocobozzz 3299c9e124
Add missing uuids search query doc 2022-11-23 15:50:42 +01:00
Chocobozzz 22926eafdb
Fix infohash exists memoize maxage
1 minute is enough, and it could lead to unknown infohash issue when
  re-streaming in a permanent live
2022-11-23 15:50:42 +01:00
Florent fbad149ff2
Fix DISABLE_LOCAL_SEARCH blocking request to local search API (#5411) 2022-11-23 15:50:34 +01:00
Chocobozzz b1dbb9fefc
Merge branch 'release/4.3.0' into develop 2022-11-16 14:40:34 +01:00
Chocobozzz f240fb4bea
Fix broadcasting in parallel views 2022-11-16 14:40:10 +01:00
Chocobozzz 99b757488c
Fix server lint 2022-11-15 15:00:23 +01:00
Chocobozzz 4638cd713d
Don't inject untrusted input
Even if it's already checked in middlewares
It's better to have safe modals too
2022-11-15 14:41:55 +01:00
Chocobozzz 31a9ed960f
Add configuration for prometheus exporter hostname 2022-11-15 13:56:04 +01:00
Chocobozzz 077600e037
Upgrade server dependencies 2022-11-15 13:48:51 +01:00
Chocobozzz c241947630
Correctly terminate an ended live 2022-11-15 10:50:57 +01:00
Chocobozzz 90dbc73132
Type result 2022-11-14 16:36:17 +01:00
kontrollanten 564b9b5597
refactor(server): redis > ioredis (#5371)
* refactor(server): redis > ioredis

* refactor(JobQueue): reuse redis connection builder

* fix(redisio)

* fix(redis): setValue

* feat(redis): showFriendlyErrorStack

* feat(redis): auto pipelining

308017a6b9/README.md (autopipelining)

* dont use autopipelining for bullmq

* ioredis events
2022-11-14 16:26:20 +01:00
Chocobozzz ff91b644fb
Add ability to install alpha/beta/rc plugin 2022-11-14 16:21:59 +01:00
Chocobozzz a742347d50
Fix transcoding test 2022-11-14 14:34:55 +01:00
Chocobozzz f713f36bdf
Federate entire description
Introduce an explicit field truncatedDescription
description in video list is deprecated
description in video get will contain the entire description
2022-11-14 13:03:54 +01:00
Chocobozzz 44e702ded4
Prevent broken transcoding with audio only input 2022-11-14 11:39:01 +01:00
Chocobozzz 4efa5535cc
Fix infinite playlist import
Using an hard videos limit in config
2022-11-14 11:11:39 +01:00
Chocobozzz f30ef8cf98
Fix retranscoding of odd resolution 2022-11-07 10:43:22 +01:00
Chocobozzz c0a9de6652
Prevent uploadx too big log for config 2022-11-07 10:40:43 +01:00
Chocobozzz a32bf8cd20
Fix running again transcoding on a video only file 2022-11-07 10:25:24 +01:00
Chocobozzz 11ae7e2917
Fix follow constraint check with an account 2022-11-07 10:11:51 +01:00
Chocobozzz 0015924ad6
Increase test timeout 2022-11-03 08:31:27 +01:00
Chocobozzz 5fc4a1825c
Fix preview generation for imports 2022-10-31 14:29:48 +01:00
Chocobozzz 6740b6428b
Fix transcoding failure when importing a video 2022-10-31 13:30:39 +01:00
Chocobozzz e8299615c1
Fix CI 2022-10-31 09:55:09 +01:00
Chocobozzz 91c72729d8
Prevent error in redundancy scheduler 2022-10-31 08:57:52 +01:00
Chocobozzz eb8da03d1c
Prevent error in update scheduler 2022-10-31 08:51:52 +01:00
Chocobozzz c08e4cfcf9
Fix CLI build 2022-10-31 08:45:46 +01:00
Chocobozzz 9e5cf66be7
Breaking API: Consistency with role id/label 2022-10-28 16:34:08 +02:00
Chocobozzz 37ff5005b4
Add logger for uploadx 2022-10-28 10:47:06 +02:00
Chocobozzz 1b0a04dea8
Check missing config keys 2022-10-28 10:46:46 +02:00
Chocobozzz 1ebe2c2b9f
Update production.yaml 2022-10-28 09:59:39 +02:00
Chocobozzz 5a122dddc5
Option to disable static files auth check/s3 proxy 2022-10-27 09:13:10 +02:00
Chocobozzz 44df702502
More robust updateTorrentMetadata 2022-10-26 10:55:12 +02:00
Chocobozzz e82cb08722
Fix proxy tests 2022-10-25 15:01:51 +02:00
Chocobozzz aa887096f9
Correctly delete live files from object storage 2022-10-25 14:18:59 +02:00
Chocobozzz 508c1b1e9f
Correctly cleanup files from object storage 2022-10-25 11:51:20 +02:00
Chocobozzz 849f0fd3b2
Lock files to generate torrents/move files 2022-10-25 11:50:44 +02:00
Chocobozzz 3b1995a2d0
Increase test timeout 2022-10-24 14:54:21 +02:00
Chocobozzz b3ce36069f Prevent concurrency issues when sending m3u8 file 2022-10-24 14:48:24 +02:00
Chocobozzz 0177101284 Fix tests 2022-10-24 14:48:24 +02:00
Chocobozzz 9ab330b90d Use private ACL for private videos in s3 2022-10-24 14:48:24 +02:00
Chocobozzz 3545e72c68 Put private videos under a specific subdirectory 2022-10-24 14:48:24 +02:00
kontrollanten 38a3ccc7f8
feat: show contained playlists under My videos (#5125)
* feat: show contained playlists under My videos

closes #4769

* refactor(server): remove unused types

* fixes after code review

* fix(client/video-miniature): add to playlist

* fix(server/user/me): shortUUID response

* Revert "fix(client/video-miniature): add to playlist"

This reverts commit f1a0412391.

* fix(client/PlaylistService): caching

* Revert "fix(server/user/me): shortUUID response"

This reverts commit e3f1ee4e33.

* Fix fetching playlists

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-24 14:48:03 +02:00
Chocobozzz dd84f4f263
Wait segment sha processing 2022-10-11 17:14:54 +02:00
Alberto Mardegan 5e1bd8690b
server: use account/channel avatar in RSS feeds (#5325)
* server: use account/channel avatar in RSS feeds

Fixes: #5320

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-11 17:02:47 +02:00
Chocobozzz bbae45c32e
Fix live tests 2022-10-11 16:00:11 +02:00
Chocobozzz 8bd6aa0424
Also retry when fetching master m3u8 playlist 2022-10-11 14:33:42 +02:00
Chocobozzz e5fc6b5983
Fix host validation on locahost 2022-10-11 13:42:58 +02:00
Chocobozzz cea2fd90dd
Merge branch 'release/4.3.0' into develop 2022-10-11 13:30:51 +02:00
Chocobozzz a6b26afc56
Fix channel follow with manually approved follower 2022-10-11 13:27:22 +02:00
Chocobozzz 9d4c60dccc
Add ability for plugins to register ws routes 2022-10-11 11:11:04 +02:00
Chocobozzz 5cc2f0ea0a
Fix channel import with some channels 2022-10-10 15:33:32 +02:00
kontrollanten c43ed8e862
Expose PeerTube socket to plugins (#5239)
* server(pluginHelpers): add socket

* test(plugins): add socket cases

* fixes after review

* Update plugin-helpers.ts

* Update plugin-helpers.ts
2022-10-10 15:18:31 +02:00
Chocobozzz 52d6c2e0bf
Fix video job error when video has been deleted 2022-10-10 14:51:11 +02:00
Chocobozzz 97a2a704e2
Fix peers info width in live 2022-10-10 11:44:47 +02:00
Chocobozzz 34aa316f58
Try to fix tests 2022-10-10 11:40:29 +02:00
Chocobozzz 63fa260a81
Merge branch 'feature/otp' into develop 2022-10-10 11:19:58 +02:00
Chocobozzz a3e5f804ad
Encrypt OTP secret 2022-10-10 11:12:23 +02:00
Chocobozzz 2166c058f3
Allow admins to disable two factor auth 2022-10-07 14:28:35 +02:00
Chocobozzz 56f4783075
Support two factor authentication in backend 2022-10-07 10:51:16 +02:00
Chocobozzz 9b99d32804
Increase timeout 2022-10-04 14:57:11 +02:00
Chocobozzz 7dd7ff4ceb
Fix tests 2022-10-04 13:57:56 +02:00
Chocobozzz e37ca6cbc7
Prevent error log 2022-10-04 11:17:37 +02:00
Chocobozzz b7faa8372e
Decrease plugin version check for tests 2022-10-04 11:00:30 +02:00
kontrollanten 6c5f0d3aeb
server: serve files from storage/well-known (#5214)
* server: serve files from storage/well-known

closes #5206

* well-known: add tests

* test: try to skip new tests

* test: another try

* fix(config/prod): well_known path

* test: fix broken tests

* Update misc-endpoints.ts

* Use getDirectoryPath for tests

* Fix tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-04 10:53:00 +02:00
Chocobozzz cfd57d2ca0
Live supports object storage
* Sync live files (segments, master playlist, resolution playlist,
   segment sha file) into object storage
 * Automatically delete them when the live ends
 * Segment sha file is now a file on disk, and not stored in memory
   anymore
2022-10-04 10:03:17 +02:00
Chocobozzz c5f3ff39e5
Ask password reset/email verif error handling
With a user that uses a plugin authentication
2022-09-28 16:00:32 +02:00
Chocobozzz 43972ee466
Relax bitrate/fps test 2022-09-28 11:24:14 +02:00
Chocobozzz 0d6843decd
Merge branch 'release/4.3.0' into develop 2022-09-28 11:19:25 +02:00
Chocobozzz 1593e0dd5c
Add test for RTMP stream without audio 2022-09-28 11:19:08 +02:00
Chocobozzz e15bc9dcd5
Merge branch 'release/4.3.0' into develop 2022-09-28 10:32:42 +02:00
Chocobozzz 1ce4256a65
Correctly handle RTMP streams without audio 2022-09-28 10:26:28 +02:00
Chocobozzz 49aa917509
Merge branch 'release/4.3.0' into develop 2022-09-28 10:03:32 +02:00
Chocobozzz 690bad52e1
Prevent "Cannot use same state" error 2022-09-28 10:03:06 +02:00
Chocobozzz 36305301cb
Set AKISMET_KEY as env 2022-09-28 08:25:46 +02:00
Chocobozzz ca68986083
Merge branch 'release/4.3.0' into develop 2022-09-27 16:23:04 +02:00
Chocobozzz 2b32c5b37e
Fix InvalidVideoTitle console warning 2022-09-27 16:19:36 +02:00
Chocobozzz 97922ecf64
Handle sync failure in synchronizeChannel fn 2022-09-27 09:50:18 +02:00
Chocobozzz 3097acc7c2
Increase test timeout 2022-09-27 08:26:55 +02:00
Chocobozzz 84e7ff2757
Test akismet plugin signup 2022-09-26 16:27:06 +02:00
Chocobozzz 4f38148087
Add akismet tests 2022-09-23 15:38:21 +02:00
Chocobozzz b2a70e3ca2
Support refusing remote comments 2022-09-23 11:38:18 +02:00
Chocobozzz 065684b2fe
Add sync youtube playlist test 2022-09-19 16:02:02 +02:00
Chocobozzz e0bfb72ce0
Cleanup actor image without width 2022-09-16 14:56:12 +02:00
Chocobozzz 9a3a23a834
Fix onlyAfter comparison 2022-09-16 13:51:57 +02:00
Chocobozzz 3c4754a3a1
Wait transcoding by default when importing a video 2022-09-16 13:48:06 +02:00
Chocobozzz 8a6828b166
Check channel sync id is owned by channel 2022-09-16 10:58:13 +02:00
Chocobozzz cbdd81da96
Fix import script 2022-09-16 09:52:50 +02:00
Chocobozzz 3204f4d17d
Fix sync import of latest videos 2022-09-16 09:37:07 +02:00
Chocobozzz 910744fb08
Improve VideoChannelSyncLatestScheduler logs 2022-09-14 15:10:37 +02:00
Chocobozzz 638949c67a
Increase test timeout 2022-09-14 13:39:36 +02:00
Chocobozzz 4404a7c467
Prevent job queue to be started before plugins 2022-09-14 11:45:18 +02:00
Chocobozzz db312c7023
Fix old DB enum names 2022-09-13 15:22:02 +02:00
Chocobozzz 367a9dc699
Don't display remove file icon in some cases 2022-09-13 12:00:13 +02:00
Chocobozzz aac7f4304d
Increase test timeout 2022-09-13 08:42:39 +02:00
Chocobozzz 31951badb3
Don't use hexa for av01 codec 2022-09-12 10:15:42 +02:00
Chocobozzz 0cbcaccb83
Increase test timeouts 2022-09-12 08:29:01 +02:00
Chocobozzz 01ec3975e0
Fix level for AV1 2022-09-09 15:02:28 +02:00
Chocobozzz ec8c188b14
Update client dep 2022-09-09 14:59:09 +02:00
Chocobozzz d9dd51aec7
Try playlist rebuild transaction if needed 2022-09-09 12:05:57 +02:00
Chocobozzz edacb64033
Don't use safe mode when normalizing 2022-09-09 11:46:58 +02:00
Chocobozzz 8409160821
Fix context 2022-09-09 11:33:06 +02:00
Chocobozzz 3d2e4f0371
Update server dependencies 2022-09-09 11:11:52 +02:00
Chocobozzz e4fc3697ac
Fix saved live master playlist bandwidth 2022-09-09 09:21:42 +02:00
Chocobozzz 405c83f9af
Use worker thread to send HTTP requests
Compute HTTP signature could be CPU intensive
2022-09-08 12:27:22 +02:00
Chocobozzz 6c4d6ec831
Prevent compat issue with old username
We were accepting more characters, so don't break DB for these users
2022-09-08 10:45:05 +02:00
q_h 23c0b67d7b
fix: validate s3 response (#5231)
* refactor:  remove `objectStoragePut`

this is already implemented in `lib-storage`

* fix:  validate s3 response

* fix:  enable built-in retries

* chore: add `leavePartsOnError` comment

* refactor: decrease partSize to speed up retries

* refactor: rethrow s3 errors

* refactor: reduce max_upload_part  default to 100MB

* refactor: validate response

* chore: add link to explanation
2022-09-08 08:54:12 +02:00
Chocobozzz e9fc9e03c1
Optimize fetching playlist urls 2022-09-08 08:41:48 +02:00
Chocobozzz d4d9bbc6f2
Fix channel sync right check 2022-09-08 08:41:48 +02:00
Chocobozzz 6c38f40d96
Prevent weird error on sync failure 2022-09-08 08:41:48 +02:00
Chocobozzz ea139ca870
Display error on youtube-dl get info failure 2022-08-18 11:40:07 +02:00
Chocobozzz e5d771a390
Correctly fix feeds tests 2022-08-17 16:22:25 +02:00
Chocobozzz 479b269631
Fix feeds tests 2022-08-17 16:14:15 +02:00
Chocobozzz 863477173e
Cleanup tests imports 2022-08-17 15:47:54 +02:00
Chocobozzz e0faa8ad6e
We don't need to import mocha 2022-08-17 15:40:57 +02:00
Chocobozzz 690bb8f9f3
Prefer using Object.values 2022-08-17 15:36:03 +02:00
Chocobozzz bbd5aa7ead
Reimplement a typed omit function 2022-08-17 15:25:58 +02:00
Chocobozzz a85d530384
Remove unnecessary logs 2022-08-17 14:58:40 +02:00
Chocobozzz 2ec349aa85
Prefer using our pick function 2022-08-17 14:54:01 +02:00
Chocobozzz 396f6f0140
Cleanup useless express validator messages 2022-08-17 14:27:04 +02:00