Repository navigation
Releases: aadi2/Vidify
Releases · aadi2/Vidify
Release list
Vidify Version 2.0
Vidify 2.0 Release Notes
Overview
Vidify 2.0 brings powerful upgrades to our AI-powered Chrome extension that lets users search for objects and words within YouTube videos. With the addition of real-time object detection and a dynamic "table of contents" feature, this release goes beyond transcript-only search—marking a major milestone toward smart, efficient video navigation.
What’s New in 2.0
Visual Object Detection (YOLOv8 + Grounding DINO)
- Detects key objects directly from video frames
- Users can view an auto-generated table of contents based on visual objects
- Uses YOLOv8 for speed and Grounding DINO for zero-shot, niche object support
- Achieves ~70% accuracy on COCO dataset
Object-Based Table of Contents
- Scene-by-scene breakdown of detected objects
- Clickable timestamps for jumping directly to key visual moments
YOLO Model Integration
- Integrated into backend pipeline for scalable object detection
- Ready for GPU deployment for higher performance
- Supports both standard and custom detection terms
Other Improvements
- Refined UI for toggling between object and transcript search
- Backend API supports dual processing routes (transcript + object detection)
- Faster API response and improved data parsing
- More precise indexing of both captions and object metadata
Installation & Requirements
- Chrome v88+
- Python 3.9+
- Internet connection
- Optional: GPU for local model training or inference
Known Limitations
- Object detection currently only available for YouTube videos with accessible content
- No auto-seek preview yet for object detection timestamps
- May miss some domain-specific or rare objects due to generalization
Future Roadmap
- Custom training for improved niche detection
- Compatibility with Netflix, Amazon Prime, and other streaming services
- Video summarization based on objects and transcript context
- Full-seek integration for object detection matches
Thanks for using Vidify!
Vidify Version 1.0
Vidify 1.0 Release Notes
Overview
We're excited to announce the first release of Vidify, a Chrome extension that revolutionizes how you interact with YouTube videos. Vidify enables users to search for specific keywords within videos, instantly finding the exact moments they're looking for without tedious manual scrubbing.
Key Features
Transcript Search
- Search for keywords within video transcripts
- Get timestamp-linked results with highlighted matching text
- Works with YouTube's automatically generated captions
User Experience
- Intuitive search interface with real-time results
- Progress indicators for search operations
- Visible highlighting of search terms in results
- Toggle between light and dark mode
Technical Foundation
- Chrome Extension with Side Panel support
- Cross-platform compatibility (Windows, macOS, Linux)
- Backend API for processing YouTube content
- Secure YouTube cookie handling for authenticated requests
Detailed Components
Chrome Extension
- Background Service Worker: Handles communication with the backend API
- Content Scripts: Integrates with YouTube for enhanced video navigation
- Popup UI: Clean, gradient-themed interface for video searches
- Side Panel Support: Enables searching without leaving the YouTube page
Backend Services
- Flask API: RESTful interface for video processing
- YouTube Integration: Secure downloading of video content and transcripts
- Transcript Processing: Natural language search capabilities
- WebVTT Parser: Processes and indexes caption files
CI/CD Infrastructure
- GitHub Actions: Automated testing across Windows, macOS, and Linux
- Linting: Code quality enforcement with Flake8 and Ruff
- Cross-Platform Testing: Ensures compatibility across operating systems
- Build System: Streamlined development and production builds
Installation
Development Installation
- Clone the repository
- Navigate to Chrome://extensions, switch to Developer mode
- Click "Load Unpacked" and select extension from
/build/extensiondirectory
System Requirements
- Chrome browser (version 88 or higher)
- Internet connection for API communication
- For developers: Python 3.9+ and required dependencies
Known Limitations
- Currently supports YouTube videos with available transcripts
- Search operations don't directly go to the found timestamp
- Object detection capabilities are planned for future releases
Future Roadmap
- Visual object detection using YOLOv8
- Be able to search through videos with no transcripts using custom NLP models