Cosmos Lite v0.1.0

Cosmos Lite v0.1.0

The first public release of Cosmos Lite: an unofficial deployment extension
for running 16B NVIDIA Cosmos 3 robot policies on a single 24GB RTX 4090.

Highlights

• Packed W4A16, W8A16, and fixed mixed-precision Marlin inference.
• Direct loading below 24GB on the tested RTX 4090 configurations.
• Streaming quantization from BF16 or DCP checkpoints without loading the full
  source model onto the GPU.
• Self-contained bundles with config, tokenizer, VAE, provenance, sizes, and
  SHA256 integrity metadata.
• Reproducible replay, latency, and closed-loop rollout pipelines for RoboLab
  and RoboCasa365.
• Locked CUDA 12.8 policy runtime isolated from simulator dependencies.

Recommended Configurations

Environment and task	Quantization	Denoise	VRAM	Request latency	Success rate
RoboLab Banana	W8A16	2	21.42 GB	2,403 ms	90%
RoboLab Banana	W4A16-GenW8	2	18.03 GB	2,433 ms	100%
RoboCasa365 CloseFridge	W4A16-AttnW8	4	14.28 GB	1,231 ms	96%

Latency and VRAM are RTX 4090 measurements. See the repository benchmark
documents for complete protocols, sample counts, and qualifications.

Models

Prebuilt DROID policy bundles are available in the
Cosmos Lite Hugging Face Collection.

Quick Start

git clone https://github.com/xxxxyu/cosmos-lite.git
cd cosmos-lite
CUDA_VISIBLE_DEVICES=0 examples/quantized_robot_policy/setup.sh

• RoboLab pipeline
• RoboCasa365 pipeline
• Runtime guide

Cosmos Lite is community maintained and is not an NVIDIA product. NVIDIA
Cosmos Framework remains subject to its upstream license and notices; model
weights may have additional terms at their download locations.