Skip to content

FuseClip 0.72.0

Choose a tag to compare

View all tags
@ammarrik ammarrik released this 31 Aug 18:06
v0.72.0
6c7cd28
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

FuseClip v0.72.0

FuseClip v0.72.0 introduces the AI-Powered Viral Clipper powered by Google Gemini, an interactive in-app Captions & Transcript Editor with live re-burning, an overhauled Face Tracking and 9:16 Split-Screen engine with ONNX detection, automatic project thumbnail generation with disk synchronization, and major Windows performance optimizations.

What's New

AI-Powered Viral Clipper (Google Gemini)

  • Automated Short-Form Viral Clipping: Automatically detects engaging, high-CTR moments from long-form video transcripts and generates ready-to-share clips optimized for TikTok, Instagram Reels, and YouTube Shorts.
  • Multi-Factor Virality Scoring: Evaluates candidate segments on a 0–100 viral score assessing hook strength, viewer retention curves, topic cohesion, speech velocity, dramatic pauses, and punchlines.
  • Smart Transcript Chunking: Efficiently processes hour-long transcripts through token-aware sliding windows (up to 7,500 transcript tokens per chunk with 60-second temporal overlap) to preserve narrative context without truncation.
  • AI Providers Settings & Validation: Added a dedicated AI Providers configuration tab with instant API key validation, model selection, and live connection testing.
  • Onboarding Setup Step: Added an intuitive Gemini AI setup screen to the initial onboarding wizard, allowing users to configure and test AI clipping credentials before starting their first project.
  • Configurable Clip Generation: Tailor clip generation parameters including target duration, minimum/maximum lengths, maximum clip count, and viral sensitivity thresholds.

Interactive Captions & Transcript Editor

  • In-App Cue & Word Editor: Integrated a visual transcript editor directly inside the Results panel, allowing creators to edit text, correct misspellings, adjust word timings, and refine sentence boundaries.
  • Interactive Player Seeking: Clicking any cue or word in the editor instantly seeks the video player to that exact timestamp and begins playback.
  • Real-Time Dynamic Re-Burning: Saving transcript changes automatically triggers seamless background re-rendering, instantly updating the video preview without requiring a full project restart.
  • Synchronized Playback Highlighting: Real-time active cue highlighting and smooth auto-scrolling keep the transcript synchronized with the video playback head.
  • Optional Captions Toggle: Added the ability to completely disable captions generation and rendering for cutout-only or raw short-clip workflows.

Advanced Face Tracking & 9:16 Split-Screen Engine

  • Upgraded Tracking Engine & ONNX Detection: Integrated an advanced face tracking pipeline powered by OpenShorts and ONNX-runtime face detection with mouth-motion lip tracking for active speaker detection.
  • Dynamic Dual-Speaker Split Layout: Automatically generates stacked dual-speaker compositions (speaker 1 top, speaker 2 bottom) tailored for podcast interviews and dialogue scenes.
  • Aspect Ratio Safeguard: Automatically disables split-screen layout on aspect ratios other than 9:16 (such as 1:1, 16:9, and 4:5) to prevent distorted video cropping.
  • Framing Stability & Smoothing: Eliminated rapid camera jitter and jumping between filled and contained states using enhanced IoU tracking, temporal smoothing, and hysteresis thresholds.

Enhanced Project Management & Workspace UX

  • Automatic Project Thumbnails: Automatically extracts and displays video keyframe thumbnails for all projects in the workspace grid.
  • Complete Disk Cleanup on Delete: Deleting a project now cleans up all associated media files, extracted audio tracks, and temporary caches from disk.
  • Folder Rename Synchronization: Renaming a project within the UI automatically updates the underlying directory on disk and atomically updates database storage references.
  • Project Card Context Menu: Quick-action context menus on project cards for instant opening, renaming, and project deletion.

Fixes & Improvements

  • Windows Face Tracking Stability: Offloaded face detection and tracking processing to non-blocking worker threads, eliminating "Not Responding" UI freezes on Windows during generation.
  • Intel Windows Compression Fix: Tuned FFmpeg hardware acceleration and encoding parameters to resolve slow video compression speeds on Windows systems with Intel graphics.
  • Rendering Pipeline Acceleration: Optimized caption overlay compositing and frame rendering routines for faster clip export times.
  • Deepgram API Network Stability: Hardened cloud transcription network calls with expanded upload timeouts, retry logic, and resilient error recovery.
  • Results Tab Player Stability: Fixed an issue where the video preview player could freeze or reset playback position when scrubbing through generation progress states.
  • Urdu & Hindi Typography Support: Increased caption line height and improved glyph bounding box calculations to ensure clear rendering and prevent clipping of Arabic, Persian, and Devanagari descenders.
  • Accurate Caption Previews: Fixed an issue where the style preview displayed arbitrary placeholder words instead of actual video transcript text.
  • Preset Styles & Animation Refinements: Reorganized style control cards, improved color pickers, and enabled default animations for newly created projects.
  • Actionable Error Messages: Implemented human-readable, context-specific error banners across transcription, AI clipping, and video export pipelines.
  • Settings Modal Validation: Fixed an issue where the Settings dialog could be closed when required AI provider model fields were missing.
Assets 6
Loading