Commit Graph

323 Commits

Author SHA1 Message Date
Chocobozzz 030177d246
Don't forward view, send updates instead
To avoid inconsistencies in the federation, now the origin server will
tell other instances what is the correct number of views
2018-11-15 16:38:37 +01:00
Chocobozzz 5c6d985fae
Check activities host 2018-11-14 16:32:27 +01:00
Chocobozzz e27ff5da6e
AP mimeType -> mediaType 2018-10-18 10:44:15 +02:00
Felix Ableitner edb4ffc7e0 Set bitrate limits for transcoding (fixes #638) (#1135)
* Set bitrate limits for transcoding (fixes #638)

* added optimization script and test, changed stuff

* fix test, improve docs

* re-add optimize-old-videos script

* added documentation

* Don't optimize videos without valid UUID, or redundancy videos

* move getUUIDFromFilename

* fix tests?

* update torrent and file size, some more fixes/improvements

* use higher bitrate for high fps video, adjust bitrates

* add test video

* don't throw error if resolution is undefined

* generate test fixture on the fly

* use random noise video for bitrate test, add promise

* shorten test video to avoid timeout

* use existing function to optimize video

* various fixes

* increase test timeout

* limit test fixture size, add link

* test fixes

* add await

* more test fixes, add -b:v parameter

* replace ffmpeg wiki link

* fix ffmpeg params

* fix unit test

* add test fixture to .gitgnore

* add video transcoding fps model

* add missing file
2018-10-08 16:26:04 +02:00
Lucas Declercq 7f2cfe3a79 Rename downloadingEnabled property to downloadEnabled 2018-10-08 14:45:22 +02:00
Lucas Declercq 156c50af30 Add downloadingEnabled property to video model 2018-10-06 19:17:39 +02:00
Chocobozzz b88a459664
Upsert cache file on create activity 2018-10-02 14:40:03 +02:00
Chocobozzz 659edaa62c
Correctly forward comment deletion 2018-10-02 11:33:18 +02:00
Chocobozzz 792e5b8e5b
Try to improve redundancy tests 2018-10-02 09:04:19 +02:00
Chocobozzz d05be4d944
Don't build redundancy urls with "-1" as fps 2018-10-01 18:40:17 +02:00
Chocobozzz a3737cbf2b
Fix video fps validator 2018-10-01 16:27:47 +02:00
Chocobozzz d382f4e917
Fix refreshing external video attributes 2018-10-01 15:34:31 +02:00
Chocobozzz 601527d795
Check video channel name is unique on our instance 2018-10-01 15:20:14 +02:00
Chocobozzz 26649b4215
Ensure video existence before duplicating it 2018-10-01 10:31:42 +02:00
Chocobozzz 8578e3b5e6
Fix federation with a comment reply 2018-09-27 11:05:50 +02:00
Chocobozzz 2e7cf5ae0c
Fix video files duplicated when fps is null
Null values are not considered equal in a UNIQUE index
2018-09-26 14:08:35 +02:00
Chocobozzz cfaf819c38
Reduce video import TTL 2018-09-25 17:49:49 +02:00
Chocobozzz 47d0b3ee61
Fix comment deletion with mastodon
Will only act with new comments
2018-09-24 16:24:42 +02:00
Chocobozzz e5565833f6
Improve redundancy: add 'min_lifetime' configuration 2018-09-24 13:38:39 +02:00
Chocobozzz 1cfa8d6809
Remove unnecessary actor existance check
We already checked it in the signature checker
2018-09-21 09:51:24 +02:00
Chocobozzz 91411dba92
Limit associations fetch when loading token 2018-09-20 11:45:59 +02:00
Chocobozzz d9bdd007d7
Put config redundancy strategies in "strategies" subkey 2018-09-19 16:12:07 +02:00
Chocobozzz 12ba460e9e
Improve AP actor checks 2018-09-19 15:47:55 +02:00
Chocobozzz e587e0ecee
Optimize activity actor load in AP processors 2018-09-19 15:22:55 +02:00
Chocobozzz d4defe07d2
Optimize video view AP processing 2018-09-19 11:41:30 +02:00
Chocobozzz 4157cdb137
Refractor videos AP functions 2018-09-19 11:16:23 +02:00
Chocobozzz 96f29c0f6d
Optimize SQL requests of videos AP endpoints 2018-09-19 10:20:38 +02:00
Chocobozzz a2377d15ee
Refractor activities sending 2018-09-14 16:51:35 +02:00
Chocobozzz c48e82b5e0 Basic video redundancy implementation 2018-09-13 14:05:49 +02:00
Chocobozzz 5cf84858d4
Add federation to ownership change 2018-09-04 10:49:53 +02:00
Chocobozzz 6b6168606b
Bufferize videos views in redis 2018-08-30 15:03:18 +02:00
Chocobozzz 687d638c2b Fetch outbox when searching an actor 2018-08-27 09:41:54 +02:00
Chocobozzz f5b0af50c8 Search video channel handle/uri 2018-08-27 09:41:54 +02:00
Chocobozzz f37dc0dd14 Add ability to search video channels 2018-08-27 09:41:54 +02:00
Chocobozzz 83e6519ba4 Refractor comment creation from federation 2018-08-27 09:41:54 +02:00
Chocobozzz 1297eb5db6 Add refresh video on search 2018-08-27 09:41:54 +02:00
Chocobozzz f6eebcb336 Add ability to search a video with an URL 2018-08-27 09:41:54 +02:00
Chocobozzz 8a19bee1a1 Add ability to set a name to a channel 2018-08-27 09:41:54 +02:00
Chocobozzz 965c4b22d0 Use height instead of width to represent the video resolution 2018-08-27 09:41:54 +02:00
Chocobozzz 06a05d5f47 Add subscriptions endpoints to REST API 2018-08-27 09:41:54 +02:00
Chocobozzz 06215f15e0
Cleanup utils helper 2018-08-14 15:28:30 +02:00
Chocobozzz 268eebed92
Add state and moderationComment for abuses on server side 2018-08-10 16:54:01 +02:00
Chocobozzz b2977eecb8 Fix fps federation 2018-08-06 11:19:16 +02:00
Chocobozzz 6104adc3e9
Don't send follow request if the follow is already accepted 2018-07-31 11:15:59 +02:00
Chocobozzz 25e4d6ee97
Refresh orphan actors 2018-07-31 11:04:33 +02:00
Chocobozzz 8e0fd45e14
Add more info logging 2018-07-30 17:02:40 +02:00
Chocobozzz 3ac046e2a4
Fix peertube on chrome 2018-07-26 16:46:36 +02:00
Chocobozzz 2cebd79701
Fix last commit 2018-07-26 11:02:04 +02:00
Rigel Kent c1e791bad0
expliciting type checks and predicates (server only) 2018-07-25 22:01:25 +02:00
Chocobozzz 40e87e9ecc Implement captions/subtitles 2018-07-16 11:50:08 +02:00
Chocobozzz bcec136ee6
Fix lint 2018-06-13 14:55:18 +02:00
Chocobozzz 90d4bb8125
Refractor retry transaction function 2018-06-13 14:27:40 +02:00
Chocobozzz 3cd0734fd9
Improve tests when waiting pending jobs 2018-06-13 10:22:53 +02:00
Chocobozzz 2186386cca
Add concept of video state, and add ability to wait transcoding before
publishing a video
2018-06-12 20:37:51 +02:00
Chocobozzz 9588d4f49b
Correctly forward video related activities 2018-05-31 10:23:56 +02:00
Chocobozzz 53a613171e
Fix publishedAt value after following a new instance 2018-05-28 18:50:44 +02:00
Chocobozzz e3d5ea4f82
Fix actor outbox 2018-05-28 12:13:00 +02:00
Chocobozzz 8fffe21a7b
Refractor and optimize AP collections
Only display urls in general object, and paginate video comments, shares, likes and
dislikes
2018-05-25 16:21:16 +02:00
Chocobozzz e251f170b0
Split files in activitypub server 2018-05-25 11:33:04 +02:00
Chocobozzz 16f29007dc
Fix cc field in classic audience 2018-05-25 11:17:41 +02:00
Chocobozzz 938d3fa0ff
Move normalize functions in helpers 2018-05-11 15:55:39 +02:00
Chocobozzz 5cf1350011
Improve AP validation for Notes 2018-05-11 15:41:54 +02:00
Chocobozzz 0f320037e6
Add ability to update a video channel 2018-05-11 15:25:51 +02:00
Chocobozzz 1d6e5dfc37
Improve video torrent AP object validator 2018-05-11 08:48:20 +02:00
Chocobozzz 9d3ef9fe05
Use ISO 639 for languages 2018-04-23 14:39:52 +02:00
Chocobozzz c73e83da28
Truncate correctly video descriptions 2018-03-28 11:00:02 +02:00
Chocobozzz 07197db4c5
Try to refractor activities sending
There is still a need for work on this part though
2018-03-27 13:33:56 +02:00
Chocobozzz 73c0809326
Fix delete comment federation 2018-03-27 11:11:15 +02:00
Chocobozzz d5b7d9110d
Fix error logging 2018-03-26 16:04:14 +02:00
Chocobozzz 9c673970f6
Add public to activitypub announces 2018-03-23 13:27:21 +01:00
Chocobozzz 8e8234abba
Improve logging when cannot fetch remote videos 2018-03-23 09:10:49 +01:00
Chocobozzz 6be84cbcea
Improve activity pub actors implementation 2018-03-22 18:40:56 +01:00
Chocobozzz a38b297d90
Add /activity to activity create ids 2018-03-22 16:11:18 +01:00
Chocobozzz bffbebbe6b
Fix issues with truncated description and utf characters 2018-03-21 15:00:58 +01:00
Chocobozzz a797728009
Fix video_share_url duplicate key in transcoding job 2018-03-19 15:22:18 +01:00
Chocobozzz 5d00a3d7aa
Update the api documentation 2018-03-19 14:20:04 +01:00
Chocobozzz f47776e265
Sanitize invalid actor description 2018-03-19 10:32:51 +01:00
Chocobozzz e3bb78a213
Fix lint 2018-02-23 16:08:32 +01:00
Chocobozzz 285fe7c930
Detect posting request in our own inbox 2018-02-23 15:09:12 +01:00
Chocobozzz 276d03ed1a
Unlisted videos are not displayed on Mastodon now 2018-02-21 10:07:02 +01:00
Chocobozzz 2422c46b27
Implement support field in video and video channel 2018-02-15 15:29:07 +01:00
Chocobozzz e3a682a877
Handle thumbnail update 2018-02-14 16:03:09 +01:00
Chocobozzz ac81d1a06d
Add ability to set video thumbnail/preview 2018-02-14 16:03:09 +01:00
Chocobozzz 46531a0abd
Add id to likes/dislikes/comments/shares collections 2018-01-29 10:52:19 +01:00
Chocobozzz 8dfd8fd7ca
Fix video announces processing 2018-01-26 17:48:41 +01:00
Chocobozzz 0a67e28bee
Use sensitive instead of nsfw in activitypub 2018-01-26 17:25:35 +01:00
Chocobozzz 4ba3b8ea1b
Don't rehost announced video activities 2018-01-26 15:49:57 +01:00
Chocobozzz 7acee6f18a
Fix announce activities 2018-01-26 13:43:34 +01:00
Chocobozzz 94a5ff8a4a
Move job queue to redis
We'll use it as cache in the future.

/!\ You'll loose your old jobs (pending jobs too) so upgrade only when
you don't have pending job anymore.
2018-01-25 18:41:17 +01:00
Chocobozzz d765fafc3f
Accept actors with url objects instead of string 2018-01-25 18:41:17 +01:00
Chocobozzz a28f353a64
Fix lint 2018-01-24 10:33:50 +01:00
Chocobozzz 1f7ab4f310
Upgrade server dependencies 2018-01-24 10:25:56 +01:00
Chocobozzz 2c897999fe
Optimize SQL query that fetch actor outbox 2018-01-18 16:43:26 +01:00
Chocobozzz 54e740594b
Avoid too many requests and fetching outbox 2018-01-18 15:42:20 +01:00
Chocobozzz f05a1c30c1
Don't show videos of remote instance after unfollow 2018-01-18 15:42:20 +01:00
Chocobozzz 7006bc6378
Fix actor followers/following counts 2018-01-15 09:47:19 +01:00
Chocobozzz 9fb3abfdac
Fix communication with mastodon 2018-01-12 15:35:30 +01:00
Chocobozzz 32b2b43c06
Update follower/following counts 2018-01-12 11:47:45 +01:00
Chocobozzz 6502c3d43e
Avoid making retried requests to dead followers 2018-01-12 10:02:11 +01:00
Chocobozzz 9a8cbd8278
Activity Pub improvements 2018-01-11 19:17:43 +01:00
Chocobozzz 4bbc373f13
Add reject processing for activitypub 2018-01-11 17:45:57 +01:00
Chocobozzz 6fd5ca1ec5
Fix actor refresh 2018-01-11 14:19:18 +01:00
Chocobozzz 7bc2917145
Add tests to handle down server 2018-01-11 11:47:44 +01:00
Chocobozzz 2ccaeeb341
Fetch remote AP objects 2018-01-10 17:19:14 +01:00
Chocobozzz 378557ef25
Fix comment creation 2018-01-08 13:15:01 +01:00
Chocobozzz 28832412d1
Fix lint 2018-01-08 10:46:41 +01:00
Chocobozzz 93ef8a9d02
Send comment to followers and parents 2018-01-08 10:15:27 +01:00
Chocobozzz d7e70384a3
Add mentions to comments 2018-01-05 11:19:25 +01:00
Chocobozzz 2890b615f3
Handle HTML is comments 2018-01-04 17:50:30 +01:00
Chocobozzz c3badc81fe
Fix delete activities 2018-01-04 16:56:36 +01:00
Chocobozzz a5625b4167
Refresh remote accounts 2018-01-04 14:04:02 +01:00
Chocobozzz 4cb6d45788
Add ability to delete comments 2018-01-04 11:19:16 +01:00
Chocobozzz 265ba139eb
Send account activitypub update events 2018-01-03 16:38:50 +01:00
Chocobozzz 4e8c872874
Circle avatar 2018-01-03 11:54:42 +01:00
Chocobozzz 47564bbe2e
Add ability to disable video comments 2018-01-03 10:38:19 +01:00
Chocobozzz c5911fd347
Begin to add avatar to actors 2017-12-29 19:10:13 +01:00
Chocobozzz da854ddd50
Propagate old comment on new follow 2017-12-28 11:16:08 +01:00
Chocobozzz f40bbe3146
Fix preview 404 2017-12-28 08:49:08 +01:00
Chocobozzz d50acfab69
Add comments federation tests 2017-12-27 20:03:37 +01:00
Chocobozzz ea44f375f5
Send video comment comments to followers/origin 2017-12-27 10:39:31 +01:00
Chocobozzz d3ea897591
Begin unit tests 2017-12-22 12:12:33 +01:00
Chocobozzz bf1f650817
Add comments controller 2017-12-22 11:29:12 +01:00
Chocobozzz 6d85247028
Create comment on replied mastodon statutes 2017-12-22 09:14:50 +01:00
Chocobozzz cb9244de97
Improve video tag in edit form 2017-12-20 15:37:03 +01:00
Chocobozzz e203f2e0e1
Only import bootstrap component that we need 2017-12-20 09:26:50 +01:00
Chocobozzz d7a7c248b3
Handle mastodon shares 2017-12-19 17:07:58 +01:00
Chocobozzz 85414add64
Fix player play exception on chromium 2017-12-19 15:17:43 +01:00
Chocobozzz 54b3806324
Fix lint 2017-12-19 14:22:38 +01:00
Chocobozzz e12a009254
Status are sent to mastodon 2017-12-19 10:53:16 +01:00
Chocobozzz 39fdb3c032
Unfollow with host 2017-12-19 10:53:16 +01:00
Chocobozzz a7d647c440
Add dirty migration :/ 2017-12-19 10:53:16 +01:00
Chocobozzz 50d6de9c28
Begin moving video channel to actor 2017-12-19 10:53:16 +01:00
Chocobozzz 3fd3ab2d34
Move models to typescript-sequelize 2017-12-13 16:50:33 +01:00
Chocobozzz f595d39477
Finish admin design 2017-12-08 17:31:21 +01:00
Chocobozzz fef2c7164e
Fix bad to/cc when undo dislike 2017-11-30 14:15:17 +01:00
Chocobozzz f00984c007
Fix conflict rate serializations 2017-11-30 13:51:53 +01:00
Chocobozzz 98ec8b8e73
Fix lint 2017-11-30 13:16:23 +01:00
Chocobozzz 25ed141c7c
Put activity pub sends inside transactions 2017-11-30 11:31:15 +01:00
Chocobozzz 5e3bb76cb6
Fix undo like/dislike forwarding 2017-11-28 08:45:03 +01:00
Chocobozzz 4e50b6a1c9
Add shares forward and collection on videos/video channels 2017-11-27 19:40:53 +01:00
Chocobozzz df1966c9b4
Fix lint 2017-11-27 19:40:53 +01:00
Chocobozzz f10336cad0
Check signature is correct with the activity pub actor 2017-11-27 19:40:53 +01:00
Chocobozzz 63c93323ec
Correctly forward like/dislikes and undo 2017-11-27 19:40:53 +01:00
Chocobozzz 16b9097594
Fetch video likes/dislikes too 2017-11-27 19:40:53 +01:00
Chocobozzz d8553faa49
Better follows tests 2017-11-27 19:40:53 +01:00
Chocobozzz 0032ebe94a
Federate likes/dislikes 2017-11-27 19:40:53 +01:00
Chocobozzz 40ff57078e
Federate video views 2017-11-27 19:40:53 +01:00
Chocobozzz c46edbc2f6
Fetch outbox to grab old activities tests 2017-11-27 19:40:53 +01:00
Chocobozzz c986175d68
Fetch outbox to grab old activities 2017-11-27 19:40:53 +01:00
Chocobozzz e71bcc0f4b
Add outbox 2017-11-27 19:40:53 +01:00
Chocobozzz b1cbc0dd3e
Fix lint 2017-11-27 19:40:53 +01:00
Chocobozzz 0f91ae62df
Add follow tests 2017-11-27 19:40:52 +01:00
Chocobozzz 7e9334c34d
Add ability to unfollow a server 2017-11-27 19:40:52 +01:00
Chocobozzz 892211e849
Move activitypub functions from helpers/ to lib/ 2017-11-27 19:40:52 +01:00
Chocobozzz 5414139835
Refractor activity pub lib/helpers 2017-11-27 19:40:52 +01:00
Chocobozzz 79d5caf994
Fix lint 2017-11-27 19:40:52 +01:00
Chocobozzz 9a27cdc27c
Optimize signature verification 2017-11-27 19:40:52 +01:00
Chocobozzz afffe98839
Speed up activity pub http requests 2017-11-27 19:40:52 +01:00
Chocobozzz 21e0727a84
Federate video abuses 2017-11-27 19:40:52 +01:00
Chocobozzz d7d5611c8a
Federate video update 2017-11-27 19:40:52 +01:00
Chocobozzz 20494f1221
Server shares user videos 2017-11-27 19:40:52 +01:00
Chocobozzz efc32059d9
Send server announce when users upload a video 2017-11-27 19:40:52 +01:00
Chocobozzz d846501818
Handle announces in inbox 2017-11-27 19:40:52 +01:00
Chocobozzz 8e10cf1a5a
Fix video upload and videos list 2017-11-27 19:40:52 +01:00
Chocobozzz 8e13fa7d09
Add video abuse to activity pub 2017-11-27 19:40:52 +01:00
Chocobozzz 51548b3181
Add follow tabs
Following
Follow
Followers
2017-11-27 19:40:51 +01:00
Chocobozzz 350e31d6b6
Follow works 2017-11-27 19:40:51 +01:00
Chocobozzz 8e69648749
Add MANAGE_PEERTUBE_FOLLOW right 2017-11-27 19:40:51 +01:00
Chocobozzz ce548a10db
Send follow/accept 2017-11-27 19:40:51 +01:00
Chocobozzz 7a7724e66e
Handle follow/accept 2017-11-27 19:40:51 +01:00
Chocobozzz 571389d43b
Make it compile at least 2017-11-27 19:40:51 +01:00
Chocobozzz 0d0e8dd090
Continue activitypub 2017-11-27 19:40:51 +01:00
Chocobozzz e4f97babf7
Begin activitypub 2017-11-27 19:40:51 +01:00