[Blog] AMD MI300X inference benchmark#1808

Merged

peterschmidt85 merged 10 commits intomasterfrom

1806-blog-amd-mi300x-inference-benchmark

Oct 9, 2024

Commits on Oct 9, 2024

- [Blog] AMD MI300X inference benchmark #1806 (WIP)
peterschmidt85
committed
Update AMD Inference Benchmark BlogPost

Bihan Rana
authored and
Bihan Rana
committed
- [Blog] AMD MI300X inference benchmark #1806 (WIP)
peterschmidt85
committed
Add Notes & Conclusion to AMD Inference Benchmarks

Bihan Rana
authored and
Bihan Rana
committed
Merge branch '1806-blog-amd-mi300x-inference-benchmark' of https://github.com/dstackai/dstack into 1806-blog-amd-mi300x-inference-benchmark

Bihan Rana
authored and
Bihan Rana
committed
Add VRAM consumption tgi vs vllm

Bihan Rana
authored and
Bihan Rana
committed
- [Blog] AMD MI300X inference benchmark #1806 (WIP)
peterschmidt85
committed
- [Blog] AMD MI300X inference benchmark #1806 (WIP)
peterschmidt85
committed
- [Blog] AMD MI300X inference benchmark #1806 (WIP)
peterschmidt85
committed
- [Blog] AMD MI300X inference benchmark #1806 (WIP)
peterschmidt85
committed