Skip to content

AutoE2E v1.0

Latest

Choose a tag to compare

@riita10069 riita10069 released this 29 Oct 01:28
cf05b86

AutoE2E v1.0 is the first tagged release of the camera-first End-to-End driving model from the Autoware Robotaxi working group.

Highlights

  • Reactive model. Runs at 10 Hz on six surround cameras, lifts them into a bird's-eye-view grid, optionally fuses a map raster, and plans the next 6.4 s of acceleration and curvature with a GRU planner. 79.9 M parameters. The World Action and Reasoning models are still in development.
  • Checkpoints on Hugging Face. nuplan-epoch-5 is trained on nuPlan v1.1 for zero-shot driving and fine-tuning. kitscenes-epoch-5 is fine-tuned on KITScenes-Multimodal.
  • Benchmarks. On KITScenes-Multimodal validation, the fine-tuned checkpoint reaches ADE 0.744 m and FDE 1.980 m at 3 s, second among the eight open-weights models compared. Issue #210 has the adapters and the full results.
  • Speed. Inference reaches up to ~76 FPS (SwinV2-Tiny, feature-concat fusion, RTX 5080, batch 1). See BENCHMARKS.md.
  • Tooling. The DataModelConsole dashboard replays camera scenes with ground-truth and predicted trajectories. Platform/ holds the EKS-based MLOps platform for training and evaluation, fully managed as IaC.

Get started

git clone --branch v1.0 https://github.com/autowarefoundation/auto_e2e.git
cd auto_e2e
make setup

Python 3.12 is required. The documentation and academic paper cover the model in detail.

What's Changed

New Contributors

Full Changelog: https://github.com/autowarefoundation/auto_e2e/commits/v1.0