Starred repositories
AIInfra(AI 基础设施)指AI系统从底层芯片等硬件,到上层软件栈支持AI大模型训练和推理。
My learning notes/codes for ML SYS.
每个人都能看懂的大模型知识分享,LLMs春/秋招大模型面试前必看,让你和面试官侃侃而谈
NVIDIA device plugin for Kubernetes
The official GitHub page for the survey paper "A Survey of Large Language Models".
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
NVIDIA GPU metrics exporter for Prometheus leveraging DCGM
AISystem 主要是指AI系统,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
Optimized primitives for collective multi-GPU communication
Distributed ML Training and Fine-Tuning on Kubernetes
Letta (formerly MemGPT) is a framework for creating LLM services with memory.
AGIA(AGI Alliance)是AGI开放社区,定期组织线下沙龙,讨论AI商业化机会,共享解决方案、聚合资源助力AI更快落地。
Llama中文社区,Llama3在线体验和微调模型已开放,实时汇总最新Llama3学习资料,已将所有代码更新适配Llama3,构建最好的中文Llama大模型,完全开源可商用
Crane scheduler is a Kubernetes scheduler which can schedule pod based on actual node load.
《代码随想录》LeetCode 刷题攻略:200道经典题目刷题顺序,共60w字的详细图解,视频难点剖析,50余张思维导图,支持C++,Java,Python,Go,JavaScript等多语言版本,从此算法学习不再迷茫!🔥🔥 来看看,你会发现相见恨晚!🚀
Repository for the netperf component used by the Network-Aware framework for the Kubernetes platform based the Scheduler Framework
kmesh-net / waypoint
Forked from istio/proxyThe kmesh proxy components.