]> git.immae.eu Git - github/Chocobozzz/PeerTube.git/commit
Channel sync (#5135)
authorFlorent <florent.git@zeteo.me>
Wed, 10 Aug 2022 07:53:39 +0000 (09:53 +0200)
committerGitHub <noreply@github.com>
Wed, 10 Aug 2022 07:53:39 +0000 (09:53 +0200)
commit2a491182e483b97afb1b65c908b23cb48d591807
treeec13503216ad72a3ea8f1ce3b659899f8167fb47
parent06ac128958c489efe1008eeca1df683819bd2f18
Channel sync (#5135)

* Add external channel URL for channel update / creation (#754)

* Disallow synchronisation if user has no video quota (#754)

* More constraints serverside (#754)

* Disable sync if server configuration does not allow HTTP import (#754)

* Working version synchronizing videos with a job (#754)

TODO: refactoring, too much code duplication

* More logs and try/catch (#754)

* Fix eslint error (#754)

* WIP: support synchronization time change (#754)

* New frontend #754

* WIP: Create sync front (#754)

* Enhance UI, sync creation form (#754)

* Warning message when HTTP upload is disallowed

* More consistent names (#754)

* Binding Front with API (#754)

* Add a /me API (#754)

* Improve list UI (#754)

* Implement creation and deletion routes (#754)

* Lint (#754)

* Lint again (#754)

* WIP: UI for triggering import existing videos (#754)

* Implement jobs for syncing and importing channels

* Don't sync videos before sync creation + avoid concurrency issue (#754)

* Cleanup (#754)

* Cleanup: OpenAPI + API rework (#754)

* Remove dead code (#754)

* Eslint (#754)

* Revert the mess with whitespaces in constants.ts (#754)

* Some fixes after rebase (#754)

* Several fixes after PR remarks (#754)

* Front + API: Rename video-channels-sync to video-channel-syncs (#754)

* Allow enabling channel sync through UI (#754)

* getChannelInfo (#754)

* Minor fixes: openapi + model + sql (#754)

* Simplified API validators (#754)

* Rename MChannelSync to MChannelSyncChannel (#754)

* Add command for VideoChannelSync (#754)

* Use synchronization.enabled config (#754)

* Check parameters test + some fixes (#754)

* Fix conflict mistake (#754)

* Restrict access to video channel sync list API (#754)

* Start adding unit test for synchronization (#754)

* Continue testing (#754)

* Tests finished + convertion of job to scheduler (#754)

* Add lastSyncAt field (#754)

* Fix externalRemoteUrl sort + creation date not well formatted (#754)

* Small fix (#754)

* Factorize addYoutubeDLImport and buildVideo (#754)

* Check duplicates on channel not on users (#754)

* factorize thumbnail generation (#754)

* Fetch error should return status 400 (#754)

* Separate video-channel-import and video-channel-sync-latest (#754)

* Bump DB migration version after rebase (#754)

* Prettier states in UI table (#754)

* Add DefaultScope in VideoChannelSyncModel (#754)

* Fix audit logs (#754)

* Ensure user can upload when importing channel + minor fixes (#754)

* Mark synchronization as failed on exception + typos (#754)

* Change REST API for importing videos into channel (#754)

* Add option for fully synchronize a chnanel (#754)

* Return a whole sync object on creation to avoid tricks in Front (#754)

* Various remarks (#754)

* Single quotes by default (#754)

* Rename synchronization to video_channel_synchronization

* Add check.latest_videos_count and max_per_user options (#754)

* Better channel rendering in list #754

* Allow sorting with channel name and state (#754)

* Add missing tests for channel imports (#754)

* Prefer using a parent job for channel sync

* Styling

* Client styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
90 files changed:
client/src/app/+admin/config/edit-custom-config/edit-basic-configuration.component.html
client/src/app/+admin/config/edit-custom-config/edit-basic-configuration.component.ts
client/src/app/+admin/config/edit-custom-config/edit-custom-config.component.ts
client/src/app/+admin/system/jobs/jobs.component.ts
client/src/app/+manage/video-channel-edit/video-channel-edit.component.html
client/src/app/+my-library/+my-video-channels/my-video-channels.component.html
client/src/app/+my-library/+my-video-channels/my-video-channels.component.scss
client/src/app/+my-library/my-library-routing.module.ts
client/src/app/+my-library/my-library.module.ts
client/src/app/+my-library/my-video-channel-syncs/my-video-channel-syncs.component.html [new file with mode: 0644]
client/src/app/+my-library/my-video-channel-syncs/my-video-channel-syncs.component.scss [new file with mode: 0644]
client/src/app/+my-library/my-video-channel-syncs/my-video-channel-syncs.component.ts [new file with mode: 0644]
client/src/app/+my-library/my-video-channel-syncs/video-channel-sync-edit/video-channel-sync-edit.component.html [new file with mode: 0644]
client/src/app/+my-library/my-video-channel-syncs/video-channel-sync-edit/video-channel-sync-edit.component.scss [new file with mode: 0644]
client/src/app/+my-library/my-video-channel-syncs/video-channel-sync-edit/video-channel-sync-edit.component.ts [new file with mode: 0644]
client/src/app/shared/form-validators/video-channel-validators.ts
client/src/app/shared/shared-instance/instance-features-table.component.html
client/src/app/shared/shared-main/index.ts
client/src/app/shared/shared-main/video-channel-sync/index.ts [new file with mode: 0644]
client/src/app/shared/shared-main/video-channel-sync/video-channel-sync.service.ts [new file with mode: 0644]
client/src/app/shared/shared-main/video-channel/video-channel.service.ts
config/default.yaml
config/dev.yaml
config/production.yaml.example
server.ts
server/controllers/api/accounts.ts
server/controllers/api/config.ts
server/controllers/api/index.ts
server/controllers/api/server/debug.ts
server/controllers/api/video-channel-sync.ts [new file with mode: 0644]
server/controllers/api/video-channel.ts
server/controllers/api/videos/import.ts
server/helpers/audit-logger.ts
server/helpers/custom-validators/video-channel-syncs.ts [new file with mode: 0644]
server/helpers/youtube-dl/youtube-dl-cli.ts
server/helpers/youtube-dl/youtube-dl-info-builder.ts
server/helpers/youtube-dl/youtube-dl-wrapper.ts
server/initializers/checker-after-init.ts
server/initializers/checker-before-init.ts
server/initializers/config.ts
server/initializers/constants.ts
server/initializers/database.ts
server/initializers/migrations/0730-video-channel-sync.ts [new file with mode: 0644]
server/lib/job-queue/handlers/after-video-channel-import.ts [new file with mode: 0644]
server/lib/job-queue/handlers/video-channel-import.ts [new file with mode: 0644]
server/lib/job-queue/handlers/video-import.ts
server/lib/job-queue/job-queue.ts
server/lib/schedulers/video-channel-sync-latest-scheduler.ts [new file with mode: 0644]
server/lib/server-config-manager.ts
server/lib/sync-channel.ts [new file with mode: 0644]
server/lib/video-import.ts [new file with mode: 0644]
server/middlewares/validators/config.ts
server/middlewares/validators/sort.ts
server/middlewares/validators/videos/index.ts
server/middlewares/validators/videos/video-channel-sync.ts [new file with mode: 0644]
server/middlewares/validators/videos/video-channels.ts
server/models/utils.ts
server/models/video/video-channel-sync.ts [new file with mode: 0644]
server/models/video/video-import.ts
server/tests/api/check-params/config.ts
server/tests/api/check-params/index.ts
server/tests/api/check-params/upload-quota.ts
server/tests/api/check-params/video-channel-syncs.ts [new file with mode: 0644]
server/tests/api/check-params/video-channels.ts
server/tests/api/check-params/video-imports.ts
server/tests/api/server/config.ts
server/tests/api/videos/channel-import-videos.ts [new file with mode: 0644]
server/tests/api/videos/index.ts
server/tests/api/videos/video-channel-syncs.ts [new file with mode: 0644]
server/tests/api/videos/video-imports.ts
server/tests/shared/tests.ts
server/types/express.d.ts
server/types/models/video/index.ts
server/types/models/video/video-channel-sync.ts [new file with mode: 0644]
shared/models/server/custom-config.model.ts
shared/models/server/debug.model.ts
shared/models/server/job.model.ts
shared/models/server/server-config.model.ts
shared/models/videos/channel-sync/index.ts [new file with mode: 0644]
shared/models/videos/channel-sync/video-channel-sync-create.model.ts [new file with mode: 0644]
shared/models/videos/channel-sync/video-channel-sync-state.enum.ts [new file with mode: 0644]
shared/models/videos/channel-sync/video-channel-sync.model.ts [new file with mode: 0644]
shared/models/videos/index.ts
shared/server-commands/server/config-command.ts
shared/server-commands/server/server.ts
shared/server-commands/server/servers.ts
shared/server-commands/videos/channel-syncs-command.ts [new file with mode: 0644]
shared/server-commands/videos/channels-command.ts
shared/server-commands/videos/index.ts
support/doc/api/openapi.yaml