Commit Graph

803 Commits

Author SHA1 Message Date
Rigel Kent 276250f0a3
prevent multiple post-process triggering of upload-resumable (#4175)
* prevent multiple post-process triggering of upload-resumable

* switch from 409 to 503 for upload being processed

* Improve resumable upload check

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-10-25 17:42:20 +02:00
Chocobozzz 7f91ecbde4
Completely remove torrent static path 2021-10-22 10:32:53 +02:00
Chocobozzz 62549e6c98
Rewrite youtube-dl import
Use python3 binary
Allows to use a custom youtube-dl release URL
Allows to use yt-dlp (youtube-dl fork)
Remove proxy config from configuration to use HTTP_PROXY and HTTPS_PROXY
env variables
2021-10-22 10:25:24 +02:00
Chocobozzz 97b6428af7
Breaking: fix inconsistencies in configuration 2021-10-20 16:29:41 +02:00
Chocobozzz 906f46d084
Split check user params tests 2021-10-20 09:25:44 +02:00
JustAnotherArchivist 9c58375c08 Add missing start and count parameters to playlist video list API endpoint documentation 2021-10-20 08:55:32 +02:00
Chocobozzz cf0c8ee588
Fix admin edition disabling feature 2021-10-14 11:35:43 +02:00
frankstrater a232d3e50b Add python-exec to Gentoo dependencies 2021-10-13 09:18:45 +02:00
kontrollanten c80e458afb
extend client-overrides with default images (#4392)
* extend client-overrides with default images

Add:
* default-playlist.png
* default-avatar-account.png
* default-avatar-videochannel.png

solves #4108

* Rename to default-avatar-video-channel.png

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-10-12 13:50:40 +02:00
Jelle Besseling 8d8a037e3f
Allow configuration to be static/readonly (#4315)
* Allow configuration to be static/readonly

* Make all components disableable

* Improve disabled component styling

* Rename edits allowed field in configuration

* Fix CI
2021-10-12 13:33:44 +02:00
Chocobozzz d00e9c54f3
Merge branch 'next' into develop 2021-10-11 09:37:30 +02:00
frankstrater 32e06ca4de Add Python symlink step for Gentoo 2021-10-08 14:54:37 +02:00
SansPseudoFix 461bcc1ab9 Add warning about community maintenance for dependencies 2021-10-08 14:53:20 +02:00
Chocobozzz 624e42fdf9
Remove peertube watch and peertube repl
I don't have time to maintain these scripts that cause some install
issues/maintenance difficulties
2021-09-10 15:06:57 +02:00
Chocobozzz 188aa7740c
Add restart peertube info in upgrade doc 2021-09-09 11:04:57 +02:00
Chocobozzz 29b84d749e
Improve release doc 2021-09-09 09:36:36 +02:00
Chocobozzz 6f9719b568
Add dev lib documentation 2021-09-07 11:47:40 +02:00
Chocobozzz dbe91db73e
Remove old s3 method nginx config 2021-09-07 09:37:43 +02:00
Chocobozzz 6d210220be
Fix NSFW filter and add tests 2021-09-03 16:35:18 +02:00
Chocobozzz 4d557df51c
Add note about global python 2021-09-02 11:54:13 +02:00
Chocobozzz 12d6b873cd
Improve e2e workflow and add doc 2021-09-02 09:07:42 +02:00
Chocobozzz 2a21507a38
Update changelog 2021-08-27 11:18:06 +02:00
Chocobozzz 8f58172565
Allow accounts to skip account setup modal 2021-08-27 10:15:55 +02:00
Chocobozzz d35f3a86c6
Fix archlinux dep 2021-08-26 10:01:42 +02:00
Frank Sträter 644800ef55
Dependencies RHEL8 (#4337)
* Add guide for RHEL 8

* Remove hash comments in shell scripts to avoid root prompt confusion
2021-08-24 11:51:04 +02:00
Chocobozzz 66a7fc9473
Remove optimize old videos script
It is not compatible with HLS and I don't have time to maintain it
2021-08-17 10:33:36 +02:00
Jelle Besseling 0305db28c9
Add support for saving video files to object storage (#4290)
* Add support for saving video files to object storage

* Add support for custom url generation on s3 stored files

Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.

* Upload files to s3 concurrently and delete originals afterwards

* Only publish after move to object storage is complete

* Use base url instead of url template

* Fix mistyped config field

* Add rudenmentary way to download before transcode

* Implement Chocobozzz suggestions

https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478

The remarks in question:
    Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
    Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
    Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
    I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
    https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
    I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs

* Import correct function

* Support multipart upload

* Remove import of node 15.0 module stream/promises

* Extend maximum upload job length

Using the same value as for redundancy downloading seems logical

* Use dynamic part size for really large uploads

Also adds very small part size for local testing

* Fix decreasePendingMove query

* Resolve various PR comments

* Move to object storage after optimize

* Make upload size configurable and increase default

* Prune webtorrent files that are stored in object storage

* Move files after transcoding jobs

* Fix federation

* Add video path manager

* Support move to external storage job in client

* Fix live object storage tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-08-17 08:26:20 +02:00
ROBERT MCDOWELL da948b75ca Standard output type syslog is obsolete in systemed
removing the setting
StandardOutput
StandardError
2021-08-05 10:58:05 +02:00
Chocobozzz 2bee9db56a
Update plugin doc 2021-07-30 13:58:18 +02:00
WingsLikeEagles f68d1cb6ac Adding Rocky Linux 8.4
Adding documentation for Rocky Linux 8.4
Adapted from CentOS 8... but seems like there is stuff missing from that section.
2021-07-28 08:11:57 +02:00
Chocobozzz a24bd1ed41
Merge branch 'next' into develop 2021-07-21 15:51:30 +02:00
Chocobozzz 5f26f13b3c
Merge branch 'constant-registry' into develop 2021-07-21 15:45:42 +02:00
Chocobozzz 4d029ef8ec
Add ability for instances to follow any actor 2021-07-21 13:35:31 +02:00
Chocobozzz f49ff55162
Bumped to version v3.3.0 2021-07-20 15:08:50 +02:00
lutangar dc3d902234 Introduce generic video constant manager for plugins
Allow a plugin developer to get back constants values,
and reset constants deletions or additions.
2021-07-16 17:49:40 +02:00
Frank Sträter 39072b2f6a
Postgresql-setup init option for auth-host (#4253)
* Set postgresql password authentication for host

* Update postgresql-setup obsoleted argument syntax for initdb
2021-07-16 15:39:09 +02:00
jameskimmel 1d8400118a Update dependencies.md
The now LTS version of NodeJS is 14.x
2021-07-12 15:33:14 +02:00
Frank Sträter 8182a37067
Fedora guide fix (#4238)
* Fix peertube sudoer

* Add vim to Fedora packages installation

* Add oidentd to Fedora packages installation

* Enable and start the ident daemon

* Add nginx configuration

* Add future symbolic link for nginx config

* Add small change for Gentoo
2021-07-12 15:31:57 +02:00
Chocobozzz deecf33724
Bumped to version v3.3.0-rc.1 2021-07-05 15:19:45 +02:00
lutangar 4c0a6954fb Document a way to update the last available version of a plugin manually
May comes in very handy to quickly test a plugin in a production like environment before it reaches a greater world.

> This magic trick comes from @Chocobozzz himself, who passed it on to @JohnXLivingston, who then passed it down to me.
2021-06-30 11:44:54 +02:00
Chocobozzz d4a8e7a65f Support short uuid for GET video/playlist 2021-06-29 14:56:35 +02:00
frankstrater 2370d9cc4a Add downloadEnabled boolean to PUT video 2021-06-25 15:00:21 +02:00
Chocobozzz 37a44fc915 Add ability to search playlists 2021-06-25 14:44:01 +02:00
Chocobozzz 754c73f32b
Improve plugin guide doc for plugin index 2021-06-08 17:57:33 +02:00
Rigel Kent 37ede348bb
(doc) add note in config that tmp is also used while processing 2021-06-08 11:45:03 +02:00
Chocobozzz a13df19d57
Increase max image/caption/torrent upload size 2021-06-08 10:01:50 +02:00
Chocobozzz 8beea2d37d
Add ability to filter menu links 2021-06-07 13:20:08 +02:00
Rigel Kent c756bae079
add video upload types, add doc middleware to more routes 2021-06-06 10:21:06 +02:00
Rigel Kent a31e9b183e
add invalid_token error to openapi spec 2021-06-04 08:40:08 +02:00
John Livingston 9777fe9eeb
Adding frontend peertubeHelpers.getBaseRouterRoute. (#4153)
* Adding frontend peertubeHelpers.getBaseRouterRoute.

* Fix doctoc.
2021-06-03 12:28:26 +02:00
Rigel Kent 81628e5069 refactor error code values for URI compatibility 2021-06-02 16:57:07 +02:00
Rigel Kent 1cfbdd30d9 refactor deprecated body-parser usage 2021-06-02 16:57:07 +02:00
Rigel Kent 76148b27f7 refactor API errors to standard error format 2021-06-02 16:57:07 +02:00
Rigel Kent 3dd6d6cd42
move dependencies link to engines.yaml 2021-06-02 10:48:03 +02:00
Johan Fleury 383fea89f0 Allow setting log level using PEERTUBE_LOG_LEVEL envvar 2021-06-02 09:43:13 +02:00
Chocobozzz 1a148b4792
Bumped to version v3.2.1 2021-06-01 11:03:52 +02:00
Chocobozzz c215e627b5
Fix openapi doc for resumable upload 2021-05-27 16:06:24 +02:00
Chocobozzz 2539932e16
Instance homepage support (#4007)
* Prepare homepage parsers

* Add ability to update instance hompage

* Add ability to set homepage as landing page

* Add homepage preview in admin

* Dynamically update left menu for homepage

* Inject home content in homepage

* Add videos list and channel miniature custom markup

* Remove unused elements in markup service
2021-05-27 15:59:55 +02:00
Chocobozzz eb34ec30e0
Merge branch 'release/3.2.0' into develop 2021-05-27 14:04:15 +02:00
Chocobozzz 4e67a45cd9
Bumped to version v3.2.0 2021-05-27 13:56:49 +02:00
Chocobozzz 85a60d8beb
Fix broken openapi schema 2021-05-27 11:52:03 +02:00
Rigel Kent e2adb8cb40
add operationId to common operations 2021-05-26 14:24:51 +02:00
Chocobozzz 3dc8a86c80
cd /var/www/peertube in prod guide
Avoid running db creation in /root directory
2021-05-25 11:35:29 +02:00
Chocobozzz 31a911190b
Fix broadcast message log level 2021-05-25 11:35:29 +02:00
Stakovicz 78c5e31049
Allow SSL database parameter (#4114)
* Allow SSL database parameter

Allow SSL database parameter via environment variable

* Allow SSL database parameter 

Allow SSL database parameter via environment variable

* Update support/docker/production/config/custom-environment-variables.yaml

Co-authored-by: Chocobozzz <chocobozzz@cpy.re>

Co-authored-by: Chocobozzz <chocobozzz@cpy.re>
2021-05-25 11:35:29 +02:00
Chocobozzz 6a3391bced
cd /var/www/peertube in prod guide
Avoid running db creation in /root directory
2021-05-25 11:34:43 +02:00
Chocobozzz 008af5c9bb
Fix broadcast message log level 2021-05-25 11:34:43 +02:00
Stakovicz d35c81fa1c
Allow SSL database parameter (#4114)
* Allow SSL database parameter

Allow SSL database parameter via environment variable

* Allow SSL database parameter 

Allow SSL database parameter via environment variable

* Update support/docker/production/config/custom-environment-variables.yaml

Co-authored-by: Chocobozzz <chocobozzz@cpy.re>

Co-authored-by: Chocobozzz <chocobozzz@cpy.re>
2021-05-25 11:34:10 +02:00
Rigel Kent 3f71c4c068
fix typo in operationId in openapi spec 2021-05-24 19:24:44 +02:00
Rigel Kent 3cf8874f1a
add code examples for login in openapi spec 2021-05-14 19:19:10 +02:00
Chocobozzz 5b1a6d45b5
Merge branch 'release/3.2.0' into develop 2021-05-14 14:18:13 +02:00
Chocobozzz cb4bab61c1
Fix logger warning level 2021-05-14 14:17:53 +02:00
Rigel Kent c76ecc3ff7
paginate response for abuse list in openapi spec
closes #4094
2021-05-13 23:40:50 +02:00
Rigel Kent 65cb01a252
modify response for adding abuse in openapi spec
closes #4093
2021-05-13 23:37:39 +02:00
Rigel Kent ca98c8f844
modify return code for adding/removing blocked servers in openapi spec
closes #4095
2021-05-13 23:33:24 +02:00
Rigel Kent 06dc7a1b96
add accept/reject routes for server followers in openapi spec 2021-05-13 14:52:31 +02:00
Rigel Kent da35b419cd
fix route prefix for blocklist routes in openapi spec
closes #4091
2021-05-13 14:20:04 +02:00
Rigel Kent a4ce422305
fix route prefix for video redundancy routes in openapi spec
closes #4090
2021-05-13 14:18:02 +02:00
Rigel Kent b036eb057e
more faithful error description in openapi spec 2021-05-13 14:10:11 +02:00
Rigel Kent e2464d22a5
add login/logout routes in openapi spec 2021-05-12 21:49:00 +02:00
Rigel Kent 0ae3ebb03e
add cors section in openapi spec 2021-05-12 21:21:52 +02:00
Rigel Kent c00100b607
fix video playlistId/videoId for video playlists in openapi spec
closes #4081
2021-05-12 14:33:19 +02:00
Rigel Kent 9a320a06b6
add response content for createVideoChannel endpoint in openapi spec
closes #4077
2021-05-12 13:44:40 +02:00
Rigel Kent 4c440cedcc
add rating field for video like endpoint in openapi spec
closes #4080
2021-05-11 21:44:32 +02:00
Rigel Kent 77b0c6b58f
add missing user update me fields in openapi spec 2021-05-11 21:38:33 +02:00
Rigel Kent bf3c3feafb
add missing video comment fields in openapi spec
closes #4079
2021-05-11 20:19:45 +02:00
Rigel Kent ac2a5b5427
factorized upload and import post fields in openapi spec
closes #4075
2021-05-11 10:07:43 +02:00
Chocobozzz 462212107a
Bumped to version v3.2.0-rc.1 2021-05-11 09:05:52 +02:00
Chocobozzz d795b76c44
Fix nginx config 2021-05-11 08:42:13 +02:00
Rigel Kent 2c4876f215
added descriptions for video files/import fields in openapi spec 2021-05-11 01:50:42 +02:00
Rigel Kent de3876b815
explicit error formatting variant in openapi spec 2021-05-11 01:50:42 +02:00
Rigel Kent b8375da931
provide more schema examples in openapi spec 2021-05-11 01:50:42 +02:00
Chocobozzz bb8f371d37
Add monitoring dev doc 2021-05-10 19:02:25 +02:00
Chocobozzz d61515e12a
Add doc to unpublish a plugin 2021-05-10 18:35:38 +02:00
Chocobozzz f2b5aa590e
Update nginx config for resumable upload 2021-05-10 15:27:29 +02:00
Rigel Kent 045bcd0d18
refactor subscriptions response from list to totalDataList in openapi spec
closes #4067
2021-05-10 14:43:44 +02:00
Rigel Kent 985ece5755
refactor abuses response list to totalDataList in openapi spec
closes #4066
2021-05-10 14:26:21 +02:00
Rigel Kent 40cfb36b9d
specify operationId in openapi spec and factorize videoconstant ids 2021-05-10 14:17:35 +02:00
Rigel Kent fd5586b337
specify getUserId variant in openapi spec
closes #4062
2021-05-10 12:01:49 +02:00
Rigel Kent 6bd7f09781
secify username patterns for user create/register in openapi spec
closes #4061
2021-05-10 11:27:35 +02:00