Commit Graph

13251 Commits

Author SHA1 Message Date
Chocobozzz f1aae9163f
Fix hls seeking 2024-07-02 10:45:42 +02:00
Chocobozzz f81bc3d3dc
Relax client log rate limiting 2024-07-02 09:43:07 +02:00
Chocobozzz 01b3396c80
Better view handling with looped videos 2024-07-02 09:41:33 +02:00
Chocobozzz 9ee467b9cd
Better whisper logging 2024-07-02 09:01:54 +02:00
Chocobozzz ebcf3329f5
More robust transcription error job handler 2024-07-01 14:38:19 +02:00
Chocobozzz 85678854c2
Add transcription doc for remote runners 2024-07-01 14:32:53 +02:00
Chocobozzz a7fc7c97a6
Update peertube runner version
Includes transcription
2024-07-01 11:30:13 +02:00
Chocobozzz b45ed3c05a
Do not run transcription/transcoding on lives 2024-07-01 11:15:09 +02:00
Chocobozzz 45d22afca6
Add manual run to docker ci build 2024-07-01 10:53:19 +02:00
Chocobozzz dcfd83350a
Faster CI docker build 2024-07-01 10:50:29 +02:00
Chocobozzz 3b5b050a98
Include transcription package in builds 2024-07-01 10:12:48 +02:00
Chocobozzz 6b2f2417d5
Trigger gitpod rebuild
To update nodejs version
2024-07-01 08:48:59 +02:00
Chocobozzz b570d40beb
Prune storage can also prune remote object storage 2024-06-28 15:36:11 +02:00
Chocobozzz 8faed816ab
Fix lint 2024-06-28 14:43:03 +02:00
Chocobozzz 3a71086e35
Correctly handle transcription conflicts 2024-06-28 14:42:19 +02:00
kontrollanten 3c9d1ff5e3 client: extend logging
In able to make it easier to debug issues.
2024-06-28 09:21:45 +02:00
Grant 4bc29f6d3f Add Express req, res to filter:api.search.videos.local.list.params 2024-06-28 09:20:39 +02:00
Chocobozzz 0b30e58f6f
Remove verbose option from transcription
Can be specified on-demand using NODE_DEBUG=execa env variable
2024-06-28 08:51:35 +02:00
Chocobozzz b66963fe6f
Runner can choose job type 2024-06-28 08:44:59 +02:00
Chocobozzz fd4831e502
Metadata to know if the caption is auto generated 2024-06-28 08:44:59 +02:00
Chocobozzz 1bfb791e05
Integrate transcription in PeerTube 2024-06-28 08:44:58 +02:00
lutangar ef14cf4a5c
feat(transcription): groundwork
chore: fiddling around some more

chore: add ctranslate2 and timestamped

chore: add performance markers

chore: refactor test

chore: change worflow name

chore: ensure Python3

chore(duration): convert to chai/mocha syntahx

chore(transcription): add individual tests for others transcribers

chore(transcription): implement formats test of all implementations

Also compare result of other implementation to the reference implementation

chore(transcription): add more test case with other language and models size and local model

chore(test): wip ctranslate 2 adapat

chore(transcription): wip transcript file and benchmark

chore(test): clean a bit

chore(test): clean a bit

chore(test): refacto timestamed spec

chore(test): update workflow

chore(test): fix glob expansion with sh

chore(test): extract some hw info

chore(test): fix async tests

chore(benchmark): add model info

feat(transcription): allow use of a local mode in timestamped-whisper

feat(transcription): extract run and profiling info in own value object

feat(transcription): extract run concept in own class an run more bench

chore(transcription): somplify run object only a uuid is now needed and add more benchmark scenario

docs(transcription): creates own package readme

docs(transcription): add local model usage

docs(transcription): update README

fix(transcription): use fr video for better comparison

chore(transcription): make openai comparison passed

docs(timestamped): clea

chore(transcription): change transcribers transcribe method signature

Introduce whisper builtin model.

fix(transcription): activate language detection

Forbid transcript creation without a language.
Add `languageDetection` flag to an engine and some assertions.

Fix an issue in `whisper-ctranslate2` :
https://github.com/Softcatala/whisper-ctranslate2/pull/93

chore(transcription): use PeerTube time helpers instead of custom ones

Update existing time function to output an integer number of seconds and add a ms human-readable time formatter with hints of tests.

chore(transcription): use PeerTube UUID helpers

chore(transcription): enable CER evaluation

Thanks to this recent fix in Jiwer <3
https://github.com/jitsi/jiwer/issues/873

chore(jiwer): creates JiWer package

I'm not very happy with the TranscriptFileEvaluator constructor... suggestions ?

chore(JiWer): add usage in README

docs(jiwer): update JiWer readme

chore(transcription): use FunMOOC video in fixtures

chore(transcription): add proper english video fixture

chore(transcription): use os tmp directory where relevant

chore(transcription): fix jiwer cli test reference.txt

chore(transcription): move benchmark out of tests

chore(transcription): remove transcription workflow

docs(transcription): add benchmark info

fix(transcription): use ms precision in other transcribers

chore(transcription): simplify most of the tests

chore(transcription): remove slashes when building path with join

chore(transcription): make fromPath method async

chore(transcription): assert path to model is a directory for CTranslate2 transcriber

chore(transcription): ctranslate2 assertion

chore(transcription): ctranslate2 assertion

chore(transcription): add preinstall script for Python dependencies

chore(transcription): add download and unzip utils functions

chore(transcription): add download and unzip utils functions

chore(transcription): download & unzip models fixtures

chore(transcription): zip

chore(transcription): raise download file test timeout

chore(transcription): simplify download file test

chore(transcription): add transcriptions test to CI

chore(transcription): raise test preconditions timeout

chore(transcription): run preinstall scripts before running ci

chore(transcription): create dedicated tmp folder for transcriber tests

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): use short video for local model test

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): raise timeout some more

chore(transcription): setup verbosity based on NODE_ENV value
2024-06-28 08:43:40 +02:00
Chocobozzz b10482e0e0
Fix lint 2024-06-27 14:34:18 +02:00
Chocobozzz ef0a6b267b
Add server restart test 2024-06-27 11:56:48 +02:00
Chocobozzz 564089d3e6
Fix E2E tests 2024-06-27 11:48:03 +02:00
Chocobozzz 43e186ef44
Add views tag to middlewares too 2024-06-27 10:51:36 +02:00
Chocobozzz 2728810f60
Remove bundlewatch
CI fails, our projects generates too many chunks unfortunately
2024-06-26 14:20:45 +02:00
Chocobozzz 9b2a054e54
Fix lint 2024-06-26 14:20:06 +02:00
Chocobozzz 9772280e99
Upgrade to angular 18 & vite 2024-06-26 08:33:54 +02:00
Chocobozzz ec33467261
Update client dependencies 2024-06-24 10:01:38 +02:00
Chocobozzz bc8c853a53
Fix lint 2024-06-24 09:48:57 +02:00
Chocobozzz c49b67b16f
Update translations 2024-06-24 09:40:42 +02:00
chocobozzz af67a6e13a
Translated using Weblate (Ukrainian)
Currently translated at 89.7% (2169 of 2418 strings)

Translation: PeerTube/angular
Translate-URL: https://weblate.framasoft.org/projects/peertube/angular/uk/
2024-06-24 09:34:13 +02:00
Besnik Bleta 8c93ecfa09
Translated using Weblate (Albanian)
Currently translated at 99.3% (144 of 145 strings)

Translation: PeerTube/player
Translate-URL: https://weblate.framasoft.org/projects/peertube/player/sq/
2024-06-24 09:20:41 +02:00
Goudarz Jafari 0c6dc792fc
Translated using Weblate (Persian)
Currently translated at 100.0% (145 of 145 strings)

Translation: PeerTube/player
Translate-URL: https://weblate.framasoft.org/projects/peertube/player/fa/
2024-06-24 09:20:41 +02:00
T.S 0cbd280190
Translated using Weblate (Japanese)
Currently translated at 98.3% (2378 of 2418 strings)

Translation: PeerTube/angular
Translate-URL: https://weblate.framasoft.org/projects/peertube/angular/ja/
2024-06-24 09:20:41 +02:00
Chocobozzz 5412465df4
Fix build 2024-06-24 09:20:32 +02:00
Chocobozzz 209043e2d4
Fix legacy upload req timeout 2024-06-24 09:10:11 +02:00
Chocobozzz 05d84f659d
Fix loading actor involved in video 2024-06-21 16:05:40 +02:00
Chocobozzz 985e79f61e
Fix lint and tests 2024-06-21 15:28:09 +02:00
Chocobozzz 4f4d3adf73
Update apps dependencies 2024-06-21 14:49:17 +02:00
Chocobozzz a722194809
Update server dependencies 2024-06-21 14:39:50 +02:00
Chocobozzz 4ff7880584
href can be null 2024-06-21 14:05:13 +02:00
Chocobozzz 79d6e93b03
Fix downloading private videos in admin 2024-06-21 11:05:04 +02:00
Chocobozzz 4302802840
Don't display divider on empty block 2024-06-21 10:41:12 +02:00
Chocobozzz 990266f149
Owner must not be able to approve its own comment 2024-06-21 10:27:03 +02:00
Chocobozzz d5323a641b
Better onRootClick implementation
Thanks John
2024-06-21 09:51:07 +02:00
kontrollanten ab22399da0 feat(plugins/filter): add req to api.video.get.result 2024-06-21 07:01:02 +02:00
Chocobozzz e3161f4105
Highlight lives when listing videos 2024-06-20 12:07:41 +02:00
Chocobozzz 9b56fcb500
Fix trending sort label 2024-06-20 10:57:45 +02:00