Skip to content
#

fp8

Star

Here are 2 public repositories matching this topic...

Language: Shell
Filter by language
All 34 Python 17 C++ 3 Shell 2 C 1 Cuda 1 Go 1 HTML 1 Julia 1 Jupyter Notebook 1 Rust 1

custom-build-robots / tensorrt-llm-edge-prep

Star 1

Build, run, and setup scripts for the complete TensorRT-LLM pipeline on RTX A6000 Ada (SM89). Reproducible path from HuggingFace checkpoint to deployable .engine file, with FP16 baseline and FP8 quantization. Companion material to the 4-part blog series on ai-box.eu — in preparation for the NVIDIA TensorRT Edge-LLM ecosystem.

inference nvidia quantization rtx fp16 ai-agents edge-ai llm ada-architecture fp8 tensorrt-llm
  • Updated May 16, 2026
  • Shell

Improve this page

Add a description, image, and links to the fp8 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the fp8 topic, visit your repo's landing page and select "manage topics."

Learn more