Skip to content
View r2d4's full-sized avatar

Organizations

@kubeflow @thiggle @standard-input

Block or report r2d4

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
r2d4/README.md

AI

Typed LLM API Use TypeScript types to enforce a schema on LLM output

Model API Gateway Call over 20+ LLMs from a single API. For a WebGPU powered Llama-2 playground, see thiggle

Structured LLM Completion APIs Structured LLM completion APIs. Generate text with LLMs that conform to regex patterns, context-free grammars, or classification.

@react-llm/headless Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. All inference happens clientside in the browser. See chat.matt-rickard.com for a live example.

LLaMaTab A Chrome Extension that uses @react-llm/headless to run a LLM entirely in the browser. Load the model once and run on any site.

ReLLM Exact structure out of any LLM by constraining pre-generation logits with regex. ParserLLM is an extension to ReLLM that constrains LLMs to only generating a specific context-free grammar (e.g., JSON).

openlm a drop-in OpenAI-compatible Python library that can call LLMs from any other hosted inference API. OpenLM takes in the same parameters as the openai.Completion class and and outputs a similarly structured result.

llm.ts A TypeScript equivalent of OpenLM that works in any JS environment (browser, node, deno)

ScapeNet osrs-ocr Fine-tuned object recognition and OCR models for the MMORPG Old School RuneScape

Dist. Systems

minikube - Run Kubernetes locally

skaffold - Define, develop, and run multi-deployment applications with Kubernetes

kubeflow - Machine Learning Toolkit for Kubernetes

distroless - Built a package manager for adding APT packages into distroless containers

minikube-kvm - Virtualization backend for minikube to run KVM machines on Linux

virgo - Graph-based Declarative Configuration Language

mockerfile - Docker buildable alternative BuildKit frontend in YAML

docker-merge - Merge Docker images like git branches

12-05 Pseudonyms in American History

12-04 Fairchildren

12-03 ChatGPT After One Year

12-02 McNamara Fallacy

12-01 Data Quality in LLMs

11-30 Discord and AI GTM

11-29 Standard Causes of Human Misjudgment (Munger)

11-28 The Unreasonable Effectiveness of Monte Carlo

11-27 Razor and Blades Model

11-26 Drawbacks of Moving to the Edge

Pinned Loading

  1. dacc dacc Public

    docker-as-code compiler

    TypeScript 9 1

  2. rellm rellm Public

    Exact structure out of any language model completion.

    Python 502 23

  3. llm.ts llm.ts Public

    Call any LLM with a single API. Zero dependencies.

    TypeScript 211 9

  4. parserllm parserllm Public

    Use context-free grammars with an LLM

    Python 162 10

  5. react-llm react-llm Public

    Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().

    TypeScript 673 29

  6. llb llb Public

    Go