v0.3.0: Matrix-Game-3.5 and PanoWorld backends

Adds two world-model backends next to Matrix-Game-3.0. All three share the Street View pipeline and the vehicle controller.

• Matrix-Game-3.5 (nycdrive/drive_mg35.py): the controller trajectory is passed in as chase-camera camera-to-world poses that follow the Street View capture path, and the model's Patch Memory is enabled. It is the sharpest of the three for the first 5 to 10 s, then leaves the roadway after 6 to 15 s. Its memory needs Depth Anything 3 weights, which are licensed CC-BY-NC-4.0.
• PanoWorld (nycdrive/drive_panoworld.py): it is conditioned on the full 360° panorama, and the vehicle path is applied as a camera translation. The perspective view is cropped at the chase-camera heading. With --anchor, segments restart from the real panorama nearest the vehicle's position. The real scene stays recognisable for 20 s, but the released model is 480p only and moves slowly.
• Matrix-Game-3.0 (nycdrive/drive.py) is unchanged: 20 chunks with frame stride 2, conditioned on the vehicle-free frame.

The project page now has a card for each model, a model selector in the viewer, a synchronised three-way comparison, a 360° viewer for the PanoWorld output, and an analysis of each model.

Project page: https://mehmetkeremturkcan.com/matrix-new-york/

v0.2.0: GTA-drive backend and vehicle controller

Changes since v0.1.0

• New backend: Matrix-Game-2.0 GTA-drive (nycdrive/drive_gta.py). This third-person driving checkpoint was trained on GTA V. Upstream removed both the checkpoint and its inference code; they are loaded from HF revision f1729d9 and Git commit 756776d^. The model generates the ego vehicle itself, and steering yaws the vehicle instead of translating it.
• Vehicle controller (nycdrive/vehicle.py). A kinematic bicycle model with a first-order chase camera. Routes are defined as (throttle, steer) and mapped to each backend's action space. Binary keys are driven by PWM, and lane changes are steering doublets.
• Matrix-Game-3.0 backend
  • Conditioned on the vehicle-free frame, which removes the smear the composited vehicle used to leave in the first second.
  • The ego vehicle is drawn from 17 yaw-indexed renders (nycdrive/car_bank.py).
  • The speed readout is removed: MG3's forward speed is fixed by the model. Scaling its pose translation by 3× left mean optical flow unchanged (0.65 vs 0.66 px/frame).
• Project page and README rewritten.
  • 14 GTA-drive clips: highway, urban, random location, user-specified lat/lon.
  • 4 side-by-side backend comparisons.

Project page: https://mehmetkeremturkcan.com/matrix-new-york/

v0.1.0

Initial version (Matrix-Game-3.0 only, 2D vehicle overlay). Superseded by v0.2.0.