Repository navigation
Release v1.5.4: HumanVBench Video OPs; Batch-local Stage Fusion; Robustness Fixes
Major Updates
π Stats: 10 PRs merged, from 6 contributors
π Code diff: 125 files changed, with 11,287 insertions and 766 deletions
π§βπ€βπ§ New OPs β Added 9 human-centric video understanding operators (human track extraction, active-speaker detection, audio ASR, speech emotion & age/gender detection, face demographic & attribute/emotion captioning, face-ratio filtering) for building HumanVBench-style pipelines. (These OPs need third-party patches/models under thirdparty/humanvbench_models/ and require a source install for now.) #938 #1013
β‘ Batch-local stage fusion β New FusedSequentialBatchOp runs a list of batch-local sub-operators sequentially inside a single dataset map stage, reducing scheduler/stage overhead for mapper/filter chains. Wired through DefaultExecutor, RayExecutor, and PartitionedRayExecutor. #1004
New OPs
- 9 HumanVBench human-centric video OPs β 8 mappers (
video_human_tracks_extraction_mapper,video_active_speaker_detect_mapper,video_audio_ASR_mapper,video_audio_speech_emotion_mapper,video_audio_detect_age_gender_mapper,video_human_tracks_face_demographic_mapper,video_captioning_face_attribute_emotion_mapper,video_captioning_from_human_tracks_mapper) + 1 filter (video_face_ratio_filter). #938 #1013 fused_sequential_batch_op(FusedSequentialBatchOp). #1004
Fixed Bugs
- HumanVBench ops runtime compatibility: scenedetect
open_videoAPI migration, SenseVoiceSmall model resolution via ModelScope, output-directory creation on init, and declared runtime deps. #1013 - Ray deduplicator shared state: share dedup backend state across
map_batchestasks, reuse actor handles, materialize stats for stateful backends. #978 - Ray checkpoint relative path: resolve
work_dir/checkpoint_dirto absolute paths inPartitionedRayExecutor. #979 clean_html_mapperon null text: no longer errors onnull/Nonetext. #1001- Boolean stat columns in
ColumnWiseAnalysis:dj-analyzeno longer crashes on boolean stat columns. #1003 - ARM64 (aarch64) install unblocked: precise
decord/torchcodecplatform markers restrict them to platforms with pre-built wheels (Linux x86_64, Windows x86_64, macOS arm64). #998
Enhancements
Acknowledgements
- @macroguo-ghy fixed Ray deduplicator shared-state handling. #978
- @wenhaozhao011-cmd fixed boolean stat column handling in
ColumnWiseAnalysis. #1003 - @bglglzd contributed code/documentation cleanup. #1007
New Contributors
Full Changelog: v1.5.3...v1.5.4