Pinned Loading
-
ML-Cloud-LLM-Inference-Frameworks/LLM-inference-optimization-eval
ML-Cloud-LLM-Inference-Frameworks/LLM-inference-optimization-eval PublicThis project benchmarks four LLM serving setups on Mistral-7B-Instruct-v0.3 + AG News along three axes: latency, throughput, GPU efficiency. This repo also ships a live web UI that runs the compari…
Python
-
cloud_experiment_project
cloud_experiment_project PublicCourse project on performance modeling and analysis of neural network training across GPU environments.
Python
-
chuanbinp/uncertainty-aware-inference
chuanbinp/uncertainty-aware-inference PublicWe systematically study how post-training quantization (PTQ) affects LLM confidence calibration across multiple architectures and scales, and whether knowledge distillation can recover lost calibra…
Jupyter Notebook 1
-
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.
