Skip to content

feat(bench): BENCH-001 format comparison (MSE + dynamic range + LUT cost)#550

Merged
gHashTag merged 1 commit into
mainfrom
feat/479-format-comparison-bench
Apr 30, 2026
Merged

feat(bench): BENCH-001 format comparison (MSE + dynamic range + LUT cost)#550
gHashTag merged 1 commit into
mainfrom
feat/479-format-comparison-bench

Conversation

@gHashTag
Copy link
Copy Markdown
Owner

Summary

BENCH-001 partial implementation — systematic format comparison benchmark.

What it covers

  1. Quantization MSE: ternary vs fp16 vs bfloat16 vs GF16 (1000 Normal(0,1) samples, seed=42)
  2. Dynamic range table: min/max representable values per format
  3. LUT cost estimate: ADD/MUL LUT counts on XC7A100T

What remains (needs hardware)

  • Inference benchmark: same model, f16 vs ternary
  • PPL comparison: f16 baseline vs ternary HSLM
  • Power/throughput on FPGA

Usage

zig run benchmarks/format_comparison.zig

Refs #479

…cost

- Quantization MSE: ternary vs fp16 vs bfloat16 vs GF16 (1000 Normal samples)
- Dynamic range table: min/max representable values per format
- LUT cost estimate: ADD/MUL LUTs on XC7A100T
- Deterministic RNG seed=42 for reproducibility

Refs #479
@gHashTag gHashTag merged commit 753570a into main Apr 30, 2026
9 of 18 checks passed
@gHashTag gHashTag deleted the feat/479-format-comparison-bench branch April 30, 2026 00:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant