Skip to content
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -122,7 +122,7 @@ celerybeat.pid
*.sage.py

# Environments
.env
/.env
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change required? The main README.md asks user to put the .env in notebooks/ dir, so we should not enforce this to be at /.env

.venv
env/
venv/
Expand Down
54 changes: 54 additions & 0 deletions analyzer_templates/video_chapters_dynamic.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
{
"description": "Dynamic Chaptering",
"scenario": "videoShot",
"config": {
"returnDetails": true,
"enableSegmentation": true,
"segmentationMode": "custom",
"segmentationDefinition": "Segment the video into stories or chapters. A story (chapter) in a video is a self-contained portion of the program dedicated to a specific news story, topic, or theme. Each segment typically includes a distinct introduction, development, and (sometimes) a conclusion, and can feature a combination of elements such as reporter narration, interviews, sound bites, relevant footage (B-roll), and graphics.",
"locales": [
"en-US"
]
},
"BaseAnalyzerId": "prebuilt-videoAnalyzer",
"fieldSchema": {
"name": "Content Understanding - Dynamic Chaptering",
"fields": {
"Segments": {
"type": "array",
"items": {
"type": "object",
"properties": {
"SegmentId": { "type": "string" },
"SegmentType": {
"type": "string",
"method": "generate",
"description": "The short title or a short summary of the story or chapter."
},
"Scenes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"Description": {
"type": "string",
"method": "generate",
"description": "A five-word description of the scene. A scene is a smaller segment of the segment where a continous block for storytelling unfolds within a specific time, place, and set of characters. A scene can only belong to a single chapter, and cannot overlap with other scenes. Scenes are sequential across the video."
},
"StartTimestamp": {
"type": "string",
"description": "the start timestamp of the scene"
},
"EndTimestamp": {
"type": "string",
"description": "the end timestamp of the scene"
}
}
}
}
}
}
}
}
}
}
54 changes: 54 additions & 0 deletions analyzer_templates/video_chapters_structured.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
{
"description": "Structured Chaptering",
"scenario": "videoShot",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not needed as it's only for Preview.1.

"config": {
"returnDetails": true,
"enableSegmentation": true,
"segmentationMode": "custom",
"segmentationDefinition": "Segment the video into only three chapter types: 'Topic Introduction', 'Details About the Work Done', and 'Outcome, Conclusion and Results'. Reason about the content and determine the best time to segment the video according to these chapter types. Use the timestamp of each image to identify the start and end time of each chapter, and avoid chapter overlap. You must always define the three chapter types, and each chapter must have at least one scene.",
"locales": [
"en-US"
]
},
"BaseAnalyzerId": "prebuilt-videoAnalyzer",
"fieldSchema": {
"name": "Content Understanding - Structured Chaptering",
"fields": {
"Segments": {
"type": "array",
"items": {
"type": "object",
"properties": {
"SegmentId": { "type": "string" },
"SegmentType": {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be an enum and a classify field instead?

"type": "string",
"method": "generate",
"description": "The chapter type for the segment"
},
"Scenes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"Description": {
"type": "string",
"method": "generate",
"description": "A five-word description of the scene. A scene is a smaller segment of the segment where a continous block for storytelling unfolds within a specific time, place, and set of characters. A scene can only belong to a single chapter, and cannot overlap with other scenes. Scenes are sequential across the video."
},
"StartTimestamp": {
"type": "string",
"description": "the start timestamp of the scene"
},
"EndTimestamp": {
"type": "string",
"description": "the end timestamp of the scene"
}
}
}
}
}
}
}
}
}
}
Loading