Commit Graph

1250 Commits

Author SHA1 Message Date
Chocobozzz 508c1b1e9f
Correctly cleanup files from object storage 2022-10-25 11:51:20 +02:00
Chocobozzz 3b1995a2d0
Increase test timeout 2022-10-24 14:54:21 +02:00
Chocobozzz 0177101284 Fix tests 2022-10-24 14:48:24 +02:00
Chocobozzz 9ab330b90d Use private ACL for private videos in s3 2022-10-24 14:48:24 +02:00
Chocobozzz 3545e72c68 Put private videos under a specific subdirectory 2022-10-24 14:48:24 +02:00
kontrollanten 38a3ccc7f8
feat: show contained playlists under My videos (#5125)
* feat: show contained playlists under My videos

closes #4769

* refactor(server): remove unused types

* fixes after code review

* fix(client/video-miniature): add to playlist

* fix(server/user/me): shortUUID response

* Revert "fix(client/video-miniature): add to playlist"

This reverts commit f1a0412391.

* fix(client/PlaylistService): caching

* Revert "fix(server/user/me): shortUUID response"

This reverts commit e3f1ee4e33.

* Fix fetching playlists

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-24 14:48:03 +02:00
Chocobozzz dd84f4f263
Wait segment sha processing 2022-10-11 17:14:54 +02:00
Chocobozzz bbae45c32e
Fix live tests 2022-10-11 16:00:11 +02:00
Chocobozzz cea2fd90dd
Merge branch 'release/4.3.0' into develop 2022-10-11 13:30:51 +02:00
Chocobozzz a6b26afc56
Fix channel follow with manually approved follower 2022-10-11 13:27:22 +02:00
Chocobozzz 63fa260a81
Merge branch 'feature/otp' into develop 2022-10-10 11:19:58 +02:00
Chocobozzz 2166c058f3
Allow admins to disable two factor auth 2022-10-07 14:28:35 +02:00
Chocobozzz 56f4783075
Support two factor authentication in backend 2022-10-07 10:51:16 +02:00
Chocobozzz 9b99d32804
Increase timeout 2022-10-04 14:57:11 +02:00
Chocobozzz 7dd7ff4ceb
Fix tests 2022-10-04 13:57:56 +02:00
Chocobozzz b7faa8372e
Decrease plugin version check for tests 2022-10-04 11:00:30 +02:00
kontrollanten 6c5f0d3aeb
server: serve files from storage/well-known (#5214)
* server: serve files from storage/well-known

closes #5206

* well-known: add tests

* test: try to skip new tests

* test: another try

* fix(config/prod): well_known path

* test: fix broken tests

* Update misc-endpoints.ts

* Use getDirectoryPath for tests

* Fix tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-04 10:53:00 +02:00
Chocobozzz cfd57d2ca0
Live supports object storage
* Sync live files (segments, master playlist, resolution playlist,
   segment sha file) into object storage
 * Automatically delete them when the live ends
 * Segment sha file is now a file on disk, and not stored in memory
   anymore
2022-10-04 10:03:17 +02:00
Chocobozzz 43972ee466
Relax bitrate/fps test 2022-09-28 11:24:14 +02:00
Chocobozzz 0d6843decd
Merge branch 'release/4.3.0' into develop 2022-09-28 11:19:25 +02:00
Chocobozzz 1593e0dd5c
Add test for RTMP stream without audio 2022-09-28 11:19:08 +02:00
Chocobozzz 36305301cb
Set AKISMET_KEY as env 2022-09-28 08:25:46 +02:00
Chocobozzz ca68986083
Merge branch 'release/4.3.0' into develop 2022-09-27 16:23:04 +02:00
Chocobozzz 2b32c5b37e
Fix InvalidVideoTitle console warning 2022-09-27 16:19:36 +02:00
Chocobozzz 3097acc7c2
Increase test timeout 2022-09-27 08:26:55 +02:00
Chocobozzz 065684b2fe
Add sync youtube playlist test 2022-09-19 16:02:02 +02:00
Chocobozzz 3c4754a3a1
Wait transcoding by default when importing a video 2022-09-16 13:48:06 +02:00
Chocobozzz 8a6828b166
Check channel sync id is owned by channel 2022-09-16 10:58:13 +02:00
Chocobozzz 3204f4d17d
Fix sync import of latest videos 2022-09-16 09:37:07 +02:00
Chocobozzz 638949c67a
Increase test timeout 2022-09-14 13:39:36 +02:00
Chocobozzz 367a9dc699
Don't display remove file icon in some cases 2022-09-13 12:00:13 +02:00
Chocobozzz aac7f4304d
Increase test timeout 2022-09-13 08:42:39 +02:00
Chocobozzz 0cbcaccb83
Increase test timeouts 2022-09-12 08:29:01 +02:00
Chocobozzz ec8c188b14
Update client dep 2022-09-09 14:59:09 +02:00
Chocobozzz 3d2e4f0371
Update server dependencies 2022-09-09 11:11:52 +02:00
Chocobozzz e9fc9e03c1
Optimize fetching playlist urls 2022-09-08 08:41:48 +02:00
Chocobozzz ea139ca870
Display error on youtube-dl get info failure 2022-08-18 11:40:07 +02:00
Chocobozzz 863477173e
Cleanup tests imports 2022-08-17 15:47:54 +02:00
Chocobozzz e0faa8ad6e
We don't need to import mocha 2022-08-17 15:40:57 +02:00
Chocobozzz bbd5aa7ead
Reimplement a typed omit function 2022-08-17 15:25:58 +02:00
Chocobozzz 7804e577de
Increase test timeout 2022-08-16 15:41:21 +02:00
Chocobozzz 70c6a848a4
Fix tests 2022-08-16 14:03:09 +02:00
Chocobozzz 3b2006bb72
Increase timeouts 2022-08-16 10:33:27 +02:00
Chocobozzz fd3c2e8705
Add playback metric endpoint sent to OTEL 2022-08-16 10:33:27 +02:00
Chocobozzz 0e6cd1c00f
Add ability to list comments on local videos 2022-08-16 10:33:27 +02:00
Chocobozzz f4057afd20
Fix live tests 2022-08-11 09:56:17 +02:00
Chocobozzz 0cfc8c4fe4
Fix test 2022-08-10 16:01:59 +02:00
Chocobozzz a3b472a12e
Add ability to list imports of a channel sync 2022-08-10 14:32:00 +02:00
Florent 2a491182e4
Channel sync (#5135)
* Add external channel URL for channel update / creation (#754)

* Disallow synchronisation if user has no video quota (#754)

* More constraints serverside (#754)

* Disable sync if server configuration does not allow HTTP import (#754)

* Working version synchronizing videos with a job (#754)

TODO: refactoring, too much code duplication

* More logs and try/catch (#754)

* Fix eslint error (#754)

* WIP: support synchronization time change (#754)

* New frontend #754

* WIP: Create sync front (#754)

* Enhance UI, sync creation form (#754)

* Warning message when HTTP upload is disallowed

* More consistent names (#754)

* Binding Front with API (#754)

* Add a /me API (#754)

* Improve list UI (#754)

* Implement creation and deletion routes (#754)

* Lint (#754)

* Lint again (#754)

* WIP: UI for triggering import existing videos (#754)

* Implement jobs for syncing and importing channels

* Don't sync videos before sync creation + avoid concurrency issue (#754)

* Cleanup (#754)

* Cleanup: OpenAPI + API rework (#754)

* Remove dead code (#754)

* Eslint (#754)

* Revert the mess with whitespaces in constants.ts (#754)

* Some fixes after rebase (#754)

* Several fixes after PR remarks (#754)

* Front + API: Rename video-channels-sync to video-channel-syncs (#754)

* Allow enabling channel sync through UI (#754)

* getChannelInfo (#754)

* Minor fixes: openapi + model + sql (#754)

* Simplified API validators (#754)

* Rename MChannelSync to MChannelSyncChannel (#754)

* Add command for VideoChannelSync (#754)

* Use synchronization.enabled config (#754)

* Check parameters test + some fixes (#754)

* Fix conflict mistake (#754)

* Restrict access to video channel sync list API (#754)

* Start adding unit test for synchronization (#754)

* Continue testing (#754)

* Tests finished + convertion of job to scheduler (#754)

* Add lastSyncAt field (#754)

* Fix externalRemoteUrl sort + creation date not well formatted (#754)

* Small fix (#754)

* Factorize addYoutubeDLImport and buildVideo (#754)

* Check duplicates on channel not on users (#754)

* factorize thumbnail generation (#754)

* Fetch error should return status 400 (#754)

* Separate video-channel-import and video-channel-sync-latest (#754)

* Bump DB migration version after rebase (#754)

* Prettier states in UI table (#754)

* Add DefaultScope in VideoChannelSyncModel (#754)

* Fix audit logs (#754)

* Ensure user can upload when importing channel + minor fixes (#754)

* Mark synchronization as failed on exception + typos (#754)

* Change REST API for importing videos into channel (#754)

* Add option for fully synchronize a chnanel (#754)

* Return a whole sync object on creation to avoid tricks in Front (#754)

* Various remarks (#754)

* Single quotes by default (#754)

* Rename synchronization to video_channel_synchronization

* Add check.latest_videos_count and max_per_user options (#754)

* Better channel rendering in list #754

* Allow sorting with channel name and state (#754)

* Add missing tests for channel imports (#754)

* Prefer using a parent job for channel sync

* Styling

* Client styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-08-10 09:53:39 +02:00
Chocobozzz 06ac128958
Fix print transcode command test 2022-08-09 14:49:25 +02:00
Chocobozzz e2b2c726b1
Fix job queue tests 2022-08-09 11:39:31 +02:00
Chocobozzz c543e41492
Increate test timeout 2022-08-09 11:24:08 +02:00
Chocobozzz 5e2afe4290
Limit import depending on transcoding resolutions 2022-08-09 09:18:07 +02:00
Chocobozzz 84cae54e7a
Add option to not transcode original resolution 2022-08-09 09:18:07 +02:00
Florent 7e0f50d6e0 Use single quotes in server/ and update eslint rules 2022-08-08 08:25:36 +02:00
Chocobozzz 9427890798
Add more tests for plugin rebuild 2022-08-03 15:16:56 +02:00
Chocobozzz c795e19663
Automatically rebuild native modules on ABI change 2022-08-03 15:08:36 +02:00
Chocobozzz 84992f5606
Fix tests 2022-08-03 11:49:39 +02:00
Chocobozzz ec240986ef
Increase timeouts 2022-08-01 16:05:41 +02:00
Chocobozzz 1bb4c9ab2e
Add ability to delete a specific video file 2022-08-01 14:55:10 +02:00
Chocobozzz 50cc1ee48a
Fix process follow 2022-07-27 15:45:04 +02:00
Chocobozzz 073deef886
Handle rejected follows in client
Also add quick filters so it's easier to find pending follows
2022-07-27 13:52:13 +02:00
Chocobozzz 927fa4b11f
Add rejected state to follows
Prevent reprocessing already rejected follows
2022-07-27 13:52:13 +02:00
Chocobozzz 7b6b445d91
Regenerate video filenames on transcoding
In particular when using manual transcoding, to invalidate potential
HTTP caches in front of peertube
2022-07-25 10:57:16 +02:00
Chocobozzz c8fa571f32
Clearer live session
Get the save replay setting when the session started to prevent
inconsistent behaviour when the setting changed before the session was
processed by the live ending job

Display more information about the potential session replay in live
modal information
2022-07-22 15:22:21 +02:00
Chocobozzz 58c44687f7
Fix my videos counter 2022-07-18 14:53:50 +02:00
Chocobozzz 42b4063699
Add ability for client to create server logs 2022-07-18 11:37:18 +02:00
Chocobozzz ba2684cedd
Fix lint 2022-07-13 12:14:26 +02:00
Chocobozzz f686f5ed0a
Fix audio file merge
Image streams are considered as video streams by ffmpeg
Filter out image codec name
2022-07-12 16:00:15 +02:00
Chocobozzz 6504b3bfd9
Fix videos stats 2022-07-08 11:51:41 +02:00
Chocobozzz 630d0a1bf5
Introduce experimental telemetry 2022-07-06 15:13:55 +02:00
Chocobozzz 15b43b214e
Increase test timeout 2022-07-04 13:34:03 +02:00
Chocobozzz 4e56f0fff1
Merge branch 'release/4.2.0' into develop 2022-06-24 10:33:26 +02:00
Chocobozzz c3fb12b31f
Fix lint 2022-06-24 10:13:09 +02:00
Chocobozzz 92083e4228
Fix removed sha segments on fast restream 2022-06-24 09:57:55 +02:00
Chocobozzz b6e2b5df73
Fix removed sha segments on fast restream 2022-06-24 09:35:30 +02:00
Chocobozzz 64324ac646
Merge branch 'release/4.2.0' into develop 2022-06-23 10:53:16 +02:00
Chocobozzz 20886f4bf9
Fix search index tests 2022-06-23 10:31:17 +02:00
Chocobozzz 53023be33a
Fix fast restream in saved permanent live 2022-06-23 10:30:48 +02:00
Chocobozzz 2c2befaaca
Fix video right check 2022-06-22 14:03:50 +02:00
Chocobozzz ff9d43f62a
Refactor video rights checker 2022-06-22 10:25:31 +02:00
kontrollanten 2e401e8575
store uploaded video filename (#4885)
* store uploaded video filename

closes #4731

* dont crash if videos channel exist

* migration: use raw query

* video source: fixes after code review

* cleanup

* bump migration

* updates after code review

* refactor: use checkUserCanManageVideo

* videoSource: add openapi doc

* test(check-params/video-source): fix timeout

* Styling

* Correctly set original filename as source

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-06-21 15:31:25 +02:00
Durgaraj Karki c8bac5396c
fixes video not played from defined parameters in embed service (#5023)
* fixes video not played from defined parameters in embed service

* adds parameters to the oembed services

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-06-21 14:38:15 +02:00
Chocobozzz 714e33a742
Merge branch 'release/4.2.0' into develop 2022-06-20 10:23:19 +02:00
Chocobozzz 5e0dbb3e52
Fix users stats 2022-06-17 16:23:13 +02:00
Chocobozzz d3976db269
Fix searching in blocklist 2022-06-17 16:06:58 +02:00
Chocobozzz e69d1ed5cd
Increase test timeout 2022-06-17 08:01:58 +02:00
Chocobozzz ef2b5520f9
Increase test timeout 2022-06-16 16:01:37 +02:00
Chocobozzz 0c9a835466
Merge branch 'release/4.2.0' into develop 2022-06-16 14:11:31 +02:00
Chocobozzz cdd838168d
Fix live ending job that breaks new live session 2022-06-16 13:39:57 +02:00
Chocobozzz 1a99dc647f
Fix search index tests 2022-06-08 14:58:34 +02:00
Chocobozzz e435cf44c0
Fix abuse tests 2022-06-08 13:40:40 +02:00
luz paz 7a4fd56ccd Fix various typos
Found via `codespell -q 3 -S ./CREDITS.md,./CHANGELOG.md,./client/src/locale,./yarn.lock,./client/yarn.lock -L doubleclick,followings,nd,ot,ro,serie,splitted,tread,truthy`
2022-06-07 16:41:21 +02:00
Chocobozzz 6d9ed0b6cb
Merge branch 'release/4.2.0' into develop 2022-06-07 09:59:15 +02:00
Chocobozzz 4d52690134
Fix schema.org context 2022-06-07 08:47:41 +02:00
Chocobozzz 5d2fd66ab4
Merge branch 'release/4.2.0' into develop 2022-06-03 15:14:16 +02:00
Chocobozzz ceecd871a4
Fix search index tests 2022-06-03 15:14:12 +02:00
Chocobozzz e771ff815d
Merge branch 'release/4.2.0' into develop 2022-06-03 14:32:44 +02:00
Chocobozzz 010382b603
Completely remove best default trending algorithm 2022-06-03 14:04:52 +02:00
Florian CUNY c6f8ca4d65
Added "total views" in the my channels list (#5007)
* Added "total views" in the my channels list

Implements https://github.com/Chocobozzz/PeerTube/issues/4331

* Fix lint

* applied suggested change

* updated openAPI spec for the use "withStats" when getting video channels

* applied code change

* removed GROUP BY in query

* Fixed test
2022-05-31 16:01:11 +02:00
Chocobozzz e5a781ec25
Bypass rate limits for admins and moderators 2022-05-30 11:39:44 +02:00
Chocobozzz ab623c0e0b
Merge branch 'release/4.2.0' into develop 2022-05-25 15:22:28 +02:00
Chocobozzz c8fdfab0e3
More robust live ending job 2022-05-25 15:18:29 +02:00
Chocobozzz 5333788c08
Fix saving permanent live replay on quick restream 2022-05-25 14:54:16 +02:00
Chocobozzz 3cb60ca19e
Increase test timeout 2022-05-24 13:38:01 +02:00
Chocobozzz a65858746c
Fix my videos total counter 2022-05-24 09:16:42 +02:00
Chocobozzz 10178c47d0
Increase test timeout 2022-05-20 17:12:00 +02:00
Chocobozzz 6b3aa06804
Correctly fix import tests 2022-05-20 08:33:49 +02:00
Chocobozzz 8d57e72875
Increase timeouts 2022-05-19 08:27:04 +02:00
Chocobozzz cf0dd18abc
Increase timeouts 2022-05-18 15:16:34 +02:00
Chocobozzz 305ec38496
Add total viewers overall stat 2022-05-18 09:18:39 +02:00
Chocobozzz 0cc253c971
Fix import tests 2022-05-18 08:44:20 +02:00
Chocobozzz ca3d5912e1
Add use proxy for s3 (#4973)
* Fix object storage to be accessible via proxy

* fix lint

* Use hpagent

* Fix lint

* Fix PR

Co-authored-by: noellabo <noel.yoshiba@gmail.com>
2022-05-09 11:49:25 +02:00
Chocobozzz e08ec7a723
Handle HTTP signature draft 11 2022-05-06 15:13:59 +02:00
Chocobozzz f40712abbb
Add ability to filter overall video stats by date 2022-05-06 14:23:02 +02:00
Chocobozzz 49f0468d44
Add filter by start/end date overall stats in api 2022-05-05 14:13:14 +02:00
Chocobozzz f18a060a83
Remove comments, rates and views from stats
It prevent us to apply date filters
2022-05-05 13:47:51 +02:00
Chocobozzz bae616273d
Convert followers/following in raw SQL queries
Prevent weird bug in SQL generation
2022-05-05 10:29:35 +02:00
Chocobozzz 9a82ce2455
Fix quota inconstistencies with lives 2022-05-04 10:32:49 +02:00
Chocobozzz 9295c68b74
Fix live constraints tests 2022-05-03 16:12:10 +02:00
Chocobozzz 26e3e98ff0
Support live session in server 2022-05-03 14:49:15 +02:00
Chocobozzz 86c5229b4d
Save replay of permanent live in client 2022-05-03 08:32:20 +02:00
Chocobozzz 98ebfa3950
Fix getting live by anonymous user 2022-05-03 08:32:20 +02:00
Chocobozzz b3d9dedcc3
Allow oembed to fetch unlisted videos 2022-05-02 15:14:23 +02:00
Chocobozzz 40fa53ac99
Increase test timeout 2022-05-02 10:50:09 +02:00
Chocobozzz 5d9b867ed3
Fix lint 2022-04-22 10:54:05 +02:00
Chocobozzz 961cbe4269
Fix getting live by anonymous user 2022-04-22 09:50:20 +02:00
Chocobozzz 4ec52d04dc
Add ability to save replay of permanent lives 2022-04-21 11:47:57 +02:00
kontrollanten 156cdbac22
object-storage: @aws-sdk/lib-storage for multipart (#4903)
* object-storage: @aws-sdk/lib-storage for multipart

* gitignore: add .DS_Store

* test(object-storage): remove only

* test(object-storage/multipart): generate video

* fix lint issue

* test(obj-storage/video): ensure file size

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-04-19 15:22:18 +02:00
Chocobozzz 33ac85bf61
Test digest check for resumable upload 2022-04-19 14:25:33 +02:00
Chocobozzz 3c7ddd7daa
Fix email links displayed twice as text 2022-04-15 14:19:07 +02:00
Chocobozzz 389444e048
Increase test timeout 2022-04-15 11:38:01 +02:00
Chocobozzz 3eda9b775a Support interactive video stats graph 2022-04-15 09:49:35 +02:00
Chocobozzz 901bcf5c18 Add ability to set start/end date to timeserie 2022-04-15 09:49:35 +02:00
Chocobozzz ac907dc7c1 Improve viewer counter
More precise, avoid weird decrease, reuse an id to federate viewers
2022-04-15 09:49:35 +02:00
Chocobozzz d74bb0647c Fix videos history tests 2022-04-15 09:49:35 +02:00
Chocobozzz b211106695 Support video views/viewers stats in server
* Add "currentTime" and "event" body params to view endpoint
 * Merge watching and view endpoints
 * Introduce WatchAction AP activity
 * Add tables to store viewer information of local videos
 * Add endpoints to fetch video views/viewers stats of local videos
 * Refactor views/viewers handlers
 * Support "views" and "viewers" counters for both VOD and live videos
2022-04-15 09:49:35 +02:00
Chocobozzz a219c9100b
Refactor AP context builder 2022-03-24 09:40:46 +01:00
Chocobozzz 7e98a7df7d
Remove activitypub helper
Put functions in lib/activitypub instead
2022-03-23 14:24:50 +01:00
Chocobozzz 92e66e04f7
Rename studio to editor 2022-03-22 17:24:32 +01:00
Chocobozzz 1808a1f8e4
Add video edition finished notification 2022-03-22 16:25:14 +01:00
Chocobozzz 43fc899a10
Fix channels list count 2022-03-21 09:26:48 +01:00
Chocobozzz 57e4e1c1a9
Don't store remote rates of remote videos
In the future we'll stop to expose all available rates to improve users
privacy
2022-03-18 11:21:50 +01:00
Chocobozzz db1ccd05d3
Fix CI 2022-03-17 10:50:26 +01:00
Chocobozzz 2769876fb2
Fix client html cache on theme update 2022-03-17 09:09:06 +01:00
Chocobozzz 52fe4b671a
Fix torrent creation 2022-03-16 18:35:05 +01:00
Chocobozzz f443a74649 Add latency setting support 2022-03-09 09:23:10 +01:00
Chocobozzz 135c38bbc5
Fix search index tests 2022-03-02 08:40:57 +01:00
Chocobozzz b5c00b9b67
Fix lint 2022-03-01 08:33:23 +01:00
Chocobozzz 242f52253e
Fix getting avatars in videos list 2022-03-01 08:32:49 +01:00