Skip to content
@octoml

OctoAI

Optimizing machine learning using machine learning

OctoAI is making AI fast, easy, and accessible

OctoAI delivers generative AI infrastructure to run, tune, and scale models that power AI applications. With the fastest foundation models on the market, OctoAI brings together cost savings, ease of use, and the power of open source models. You can sign up and try OctoAI for free.

Pinned Loading

  1. octocloud-templates Public

    Python 1 3

  2. octoai-textgen-cookbook Public

    Simple getting-started code examples for LLM applications powered by OctoAI

    Python 44 19

Repositories

Showing 10 of 100 repositories
  • fern-config Public

    Configuration for generating SDKs and Documentation.

    MDX 3 3 0 6 Updated Oct 7, 2024
  • homebrew-tap Public

    Homebrew Tap of OctoML products and tools.

    Ruby 0 Apache-2.0 0 0 0 Updated Sep 26, 2024
  • EAGLE Public Forked from SafeAILab/EAGLE

    OctoML Implementation of EAGLE-1 and EAGLE-2

    Python 1 Apache-2.0 113 0 0 Updated Sep 12, 2024
  • octoai-solutions Public

    A collection of reference solutions built on top of OctoAI SaaS

    Python 0 MIT 0 0 0 Updated Sep 11, 2024
  • octoai-textgen-cookbook Public

    Simple getting-started code examples for LLM applications powered by OctoAI

    Python 44 MIT 19 1 0 Updated Sep 10, 2024
  • mlc-llm Public Forked from mlc-ai/mlc-llm

    Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

    Python 5 Apache-2.0 1,725 12 1 Updated Sep 10, 2024
  • flashinfer Public Forked from flashinfer-ai/flashinfer

    FlashInfer: Kernel Library for LLM Serving

    Cuda 2 Apache-2.0 242 0 0 Updated Sep 9, 2024
  • Jupyter Notebook 0 0 0 0 Updated Sep 8, 2024
  • multicloud-asset-code-review-example Public

    Multicloud Asset Code Review Public Repo example.

    Python 0 MIT 0 0 1 Updated Sep 5, 2024
  • llama-recipes Public Forked from meta-llama/llama-cookbook

    Examples and recipes for Llama 2 model

    Jupyter Notebook 1 2,550 0 0 Updated Sep 3, 2024