AI-Hypercomputer

All

20 repositories

maxtext
Public
A simple, performant and scalable Jax LLM!
gpt mistral fine-tuning jax sft large-language-models llm llama2 mixtral deepseek
Python
•
Apache License 2.0
•370•1.8k•53•237•Updated Jul 3, 2025Jul 3, 2025
torchprime
Public
torchprime is a reference model implementation for PyTorch on TPU.
Python
•
Other
•6•29•81•9•Updated Jul 3, 2025Jul 3, 2025
gpu-recipes
Public
Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
gpu benchmarks google-cloud-platform serving distributed-training
Python
•
Apache License 2.0
•27•74•4•3•Updated Jul 2, 2025Jul 2, 2025
pathways-utils
Public
Package of Pathways-on-Cloud utilities
Python
•
Apache License 2.0
•4•15•0•1•Updated Jul 2, 2025Jul 2, 2025
maxdiffusion
Public
Python
•
Apache License 2.0
•37•229•4•16•Updated Jul 2, 2025Jul 2, 2025
xpk
Public
xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
gke gcloud tpu
Python
•
Apache License 2.0
•42•127•23•35•Updated Jul 2, 2025Jul 2, 2025
cloud-diagnostics-xprof
Public
Python
•
Apache License 2.0
•1•7•0•0•Updated Jul 1, 2025Jul 1, 2025
RecML
Public
Python
•
Apache License 2.0
•16•186•3•12•Updated Jun 27, 2025Jun 27, 2025
resiliency
Public
This project provides resilient training logic to improve the training efficiency of large-scale distributed workloads on Google Cloud.
Python
•
Apache License 2.0
•0•3•0•0•Updated Jun 26, 2025Jun 26, 2025
cloud-accelerator-diagnostics
Public
Python
•
Apache License 2.0
•10•21•3•0•Updated Jun 26, 2025Jun 26, 2025
ml-goodput-measurement
Public
Python
•
Apache License 2.0
•2•17•1•0•Updated Jun 25, 2025Jun 25, 2025
tpu-recipes
Public
Shell
•
Apache License 2.0
•17•35•3•7•Updated Jun 19, 2025Jun 19, 2025
inference-benchmark
Public
Python
•
Apache License 2.0
•12•10•7•4•Updated Jun 18, 2025Jun 18, 2025
JetStream
Public
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
gpu inference pytorch transformer llama gpt gemma model-serving tpu jax
Python
•
Apache License 2.0
•46•351•13•12•Updated Jun 10, 2025Jun 10, 2025
accelerator-microbenchmarks
Public
Python
•
Apache License 2.0
•3•2•0•0•Updated Jun 2, 2025Jun 2, 2025
kithara
Public
Python
•
Apache License 2.0
•6•14•0•2•Updated May 19, 2025May 19, 2025
ray-tpu
Public
Python
•
Apache License 2.0
•4•12•3•0•Updated May 11, 2025May 11, 2025
aotc
Public
Python
•
Other
•0•0•0•0•Updated May 8, 2025May 8, 2025
jetstream-pytorch
Public
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
inference pytorch batching attention llama gemma model-serving tpu llm llm-inference
Python
•
Apache License 2.0
•17•63•10•4•Updated Mar 27, 2025Mar 27, 2025
cloud-tpu-monitoring-debugging
Public
HCL
•
Apache License 2.0
•1•12•0•0•Updated Feb 18, 2025Feb 18, 2025