Probing into Camera Control of Video Models

📄 arXiv | 🌐 Project Page

This repository contains the code for CamProbe in Probing into Camera Control of Video Models, built on top of HunyuanVideo-1.5. We extend the original image-to-video pipeline with camera-aware warping and diffusion-time updates, enabling controllable camera motion without any additional training.

✨ Modes

• custom: load a camera trajectory from --motion_path
• latent_bank: use a predefined motion id with adjustable scale
• latent_bank_rotation: use a predefined rotation motion id such as arc_left or arc_right

🚀 Quick Start

CUDA_VISIBLE_DEVICES=0 \
python -u generate.py \
    --camera_mode custom \
    --motion_path motions/zoom_out.npz \
    --output_path outputs/custom \
    --input_json metadata.jsonl \
    --model_path tencent/HunyuanVideo-1.5

CUDA_VISIBLE_DEVICES=0 \
python -u generate.py \
    --camera_mode latent_bank_rotation \
    --output_path outputs/latent_bank_rotation \
    --input_json metadata-rotate.jsonl \
    --model_path tencent/HunyuanVideo-1.5 \
    --action_id 6 \
    --rot_angle 0.02

📝 Note

CamProbe is not tied to HunyuanVideo specifically. As long as the corresponding generation pipeline is modified to expose the same warping hook, the method can be run on other video models as well.