acarmel
Follow
Lists (1)
Stars
A simple zero-config tool to make locally trusted development certificates with any names you'd like.
A high-throughput and memory-efficient inference and serving engine for LLMs
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
The fastai book, published as Jupyter Notebooks
(WIP) A small but powerful, homemade PyTorch from scratch.
🔬 A fast, interactive web-based viewer for performance profiles.
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
The commands and processes I run to setup a new Mac computer
eBPF distributed networking observability tool for Kubernetes
A Bulletproof Way to Generate Structured JSON from Language Models
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.
Complete code for the larger example programs from the book.
kubectl plugin for spinning up netshoot container for network troubleshooting
Shell-operator is a tool for running event-driven scripts in a Kubernetes cluster
Store application configuration files in Docker/OCI registries
Export Kubernetes events to multiple destinations with routing and filtering
Show who has RBAC permissions to perform actions on different resources in Kubernetes
Easy OpenAPI specs and Swagger UI for your Flask API
Kubernetes Image Puller is used for caching images on a cluster. It creates a DaemonSet downloading and running the relevant container images on each node.
A batteries-included Python client library for Kubernetes that feels familiar for folks who already know how to use kubectl
Kubernetes controller for GitHub Actions self-hosted runners