AI-Hypercomputer

All

19 repositories

maxtext
Public
A simple, performant and scalable Jax LLM!
gpt mistral fine-tuning jax sft large-language-models llm llama2 mixtral deepseek
Python
•
Apache License 2.0
•361•1.8k•50•202•Updated Jun 20, 2025Jun 20, 2025
tpu-recipes
Public
Shell
•
Apache License 2.0
•17•34•3•7•Updated Jun 19, 2025Jun 19, 2025
RecML
Public
Python
•
Apache License 2.0
•15•183•3•12•Updated Jun 19, 2025Jun 19, 2025
gpu-recipes
Public
Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
gpu benchmarks google-cloud-platform serving distributed-training
Python
•
Apache License 2.0
•26•73•4•3•Updated Jun 19, 2025Jun 19, 2025
torchprime
Public
torchprime is a reference model implementation for PyTorch on TPU.
Python
•
Other
•5•28•80•7•Updated Jun 19, 2025Jun 19, 2025
inference-benchmark
Public
Python
•
Apache License 2.0
•12•10•7•3•Updated Jun 18, 2025Jun 18, 2025
maxdiffusion
Public
Python
•
Apache License 2.0
•34•224•4•10•Updated Jun 18, 2025Jun 18, 2025
cloud-accelerator-diagnostics
Public
Python
•
Apache License 2.0
•10•21•3•0•Updated Jun 18, 2025Jun 18, 2025
pathways-utils
Public
Package of Pathways-on-Cloud utilities
Python
•
Apache License 2.0
•2•15•0•1•Updated Jun 18, 2025Jun 18, 2025
xpk
Public
xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
gke gcloud tpu
Python
•
Apache License 2.0
•41•123•24•31•Updated Jun 18, 2025Jun 18, 2025
ml-goodput-measurement
Public
Python
•
Apache License 2.0
•2•17•1•0•Updated Jun 17, 2025Jun 17, 2025
JetStream
Public
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
gpu inference pytorch transformer llama gpt gemma model-serving tpu jax
Python
•
Apache License 2.0
•44•349•13•12•Updated Jun 10, 2025Jun 10, 2025
cloud-diagnostics-xprof
Public
Python
•
Apache License 2.0
•1•7•0•0•Updated Jun 4, 2025Jun 4, 2025
accelerator-microbenchmarks
Public
Python
•
Apache License 2.0
•3•2•0•0•Updated Jun 2, 2025Jun 2, 2025
kithara
Public
Python
•
Apache License 2.0
•6•14•0•2•Updated May 19, 2025May 19, 2025
ray-tpu
Public
Python
•
Apache License 2.0
•4•12•3•0•Updated May 11, 2025May 11, 2025
aotc
Public
Python
•
Other
•0•0•0•0•Updated May 8, 2025May 8, 2025
jetstream-pytorch
Public
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
inference pytorch batching attention llama gemma model-serving tpu llm llm-inference
Python
•
Apache License 2.0
•17•61•10•4•Updated Mar 27, 2025Mar 27, 2025
cloud-tpu-monitoring-debugging
Public
HCL
•
Apache License 2.0
•1•12•0•0•Updated Feb 18, 2025Feb 18, 2025