The official implementation of the paper:
DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model
Yuqi Wang, Ke Cheng, Jiawei He, Qitai Wang, Hengchen Dai, Yuntao Chen, Fei Xia, and Zhaoxiang Zhang
📑 paper 🎬 video demos 📖 dataset 📢zhihu
- [2024-10] Our dataset DrivingDojo is released on Huggingface.
- [2024-9] Our paper is accepted by NeurIPS 2024.
Our code is based on the open-source project diffusers. The source code is organized in diffusers/examples/world_model
The following table shows the supported finetuned methods and datasets in this repo, and we will update it continuously.
Method / Dataset | DrivingDojo | nuScenes | Waymo | OpenDV2K |
---|---|---|---|---|
Stable Video Diffusion | ✓ | ✓ | ✓ |
if you find our work useful in your research, please consider citing:
@article{wang2024drivingdojo,
title={DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model},
author={Wang, Yuqi and Cheng, Ke and He, Jiawei and Wang, Qitai and Dai, Hengchen and Chen, Yuntao and Xia, Fei and Zhang, Zhaoxiang},
journal={arXiv preprint arXiv:2410.10738},
year={2024}
}
Many thanks to the following open-source projects: