feat(DCT-91): map video fields on AITB Dataset - #465
Merged
Conversation
Adds video_url as a supported AI Task Builder dataset schema field type, mirroring the existing audio_url support, and validates video URL extensions on dataset upload. Also moves the manual batch-preview test scripts into per-script subdirectories so multiple package main scripts can coexist under scripts/manual-tests, and adds a video equivalent of the audio preview script. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
✅ Snyk checks have passed. No issues have been found so far.
💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse. |
dessskris
marked this pull request as ready for review
July 21, 2026 18:42
Contributor
There was a problem hiding this comment.
Pull request overview
Adds video_url as a first-class typed dataset schema field for AI Task Builder, extending the existing audio_url behavior to dataset schema parsing/validation, dataset upload validation, documentation examples, and manual end-to-end preview testing.
Changes:
- Extend typed dataset schema support to allow
video_url(including CLI help text + example schema JSON). - Add upload-time validation for
video_urlcolumns in CSV/JSONL and refactor audio/video URL validation into shared helpers. - Add a new manual test script for the video batch preview flow and adjust the audio manual script directory structure.
Reviewed changes
Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| scripts/manual-tests/video_batch_preview/main.go | New manual end-to-end script for dataset creation/upload + batch preview using video_url. |
| scripts/manual-tests/audio_batch_preview/main.go | Updates repo-root resolution after moving the audio manual test into a subdirectory. |
| docs/examples/dataset-schema.json | Adds video_url to the example typed schema. |
| cmd/aitaskbuilder/upload_dataset.go | Adds video_url upload validation and refactors media URL validation into shared helpers. |
| cmd/aitaskbuilder/upload_dataset_test.go | Extends tests to cover invalid video_url uploads and JSONL validation. |
| cmd/aitaskbuilder/dataset_schema.go | Allows video_url as a valid dataset schema field type and updates the invalid-type error message. |
| cmd/aitaskbuilder/dataset_schema_test.go | Updates schema parsing tests to include video_url. |
| cmd/aitaskbuilder/create_dataset.go | Updates --schema help text to include video_url in the documented field types. |
cemprolific
reviewed
Jul 22, 2026
Audio and video URL validation each scanned the upload file fully, doubling read time for datasets with both field types.
dessskris
enabled auto-merge (squash)
July 22, 2026 12:25
cemprolific
approved these changes
Jul 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
video_urlas a supported AI Task Builder dataset schema field, mirroring the existingaudio_urlsupport, and adds a manual test script for the video batch preview flow.What changed
video_urldataset schema supportvideo_urlto the allowed dataset schema field typesvideo_urlaitaskbuilder dataset create --schemahelp text and inline examplesvideo_urltodocs/examples/dataset-schema.jsonvideo_urlVideo URL validation on dataset upload
video_urlcolumns in both CSV and JSONL uploads.mp4.mov.webmManual test scripts
scripts/manual-tests/test_audio_batch_preview.gointo its ownaudio_batch_previewsubdirectory, since a secondpackage mainscript can't live alongside it in a flat directoryscripts/manual-tests/video_batch_preview, a manual end-to-end script exercising dataset creation with avideo_urlfield, upload validation, and batch previewTest plan
go test ./...golangci-lint runscripts/manual-tests/video_batch_previewagainst a real workspace confirmed the flow end-to-end