Skip to content
@distantmagic

distantmagic

README.md

Welcome to Distantmagic 👋 🐈‍⬛

Our mission is to provide open-source tools that enable the effective deployment and use of LLMs and ML models in production settings for developers and MLOps/LLMOps. Our key projects include:

  1. Paddler: An open-source load balancer and reverse proxy optimized for servers running llama.cpp. Paddler ensures efficient request distribution with a stateful load balancer that monitors server slots and health, supporting dynamic scaling.
  2. LLMOps Handbook: (work in progress) Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices.
  3. Resonance: A PHP framework for building IO-intensive web applications and services featuring AI capabilities, a built-in web server, and integration with llama.cpp. It leverages asynchronous PHP and Swoole. Learn more about Resonance Framework on the official website.

Join our community on Discord to collaborate and stay updated!

Pinned Loading

  1. paddler paddler Public

    Stateful load balancer custom-tailored for llama.cpp

    Go 556 24

  2. resonance resonance Public

    PHP Framework designed to build IO-intensive web applications.

    PHP 189 9

  3. structured structured Public

    Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

    Go 44 1

  4. llmops-handbook llmops-handbook Public

    Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

    CSS 52 5

Repositories

Showing 10 of 11 repositories
  • paddler Public

    Stateful load balancer custom-tailored for llama.cpp

    distantmagic/paddler’s past year of commit activity
    Go 556 MIT 24 6 (1 issue needs help) 0 Updated Nov 4, 2024
  • resonance Public

    PHP Framework designed to build IO-intensive web applications.

    distantmagic/resonance’s past year of commit activity
    PHP 189 MIT 9 0 0 Updated Sep 17, 2024
  • llmops-handbook Public

    Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

    distantmagic/llmops-handbook’s past year of commit activity
    CSS 52 CC-BY-SA-4.0 5 4 0 Updated Aug 16, 2024
  • .github Public
    distantmagic/.github’s past year of commit activity
    0 0 0 0 Updated Jul 15, 2024
  • resonance-project Public

    Minimal code required to start a Resonance Framework project.

    distantmagic/resonance-project’s past year of commit activity
    PHP 1 1 0 0 Updated Jul 8, 2024
  • aloni Public

    Async Python framework optimized for IO-heavy applications.

    distantmagic/aloni’s past year of commit activity
    Python 3 MIT 0 0 0 Updated Jun 29, 2024
  • structured Public

    Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

    distantmagic/structured’s past year of commit activity
    Go 44 MIT 1 0 0 Updated May 16, 2024
  • swoole-futures Public

    Partial implementation of Promise/A+ spec based on Swoole Coroutines.

    distantmagic/swoole-futures’s past year of commit activity
    PHP 0 MIT 0 0 0 Updated Dec 6, 2023
  • graphql-swoole-promise-adapter Public

    Standalone GraphQL Swoole Promise adapter that can be used with https://github.com/webonyx/graphql-php

    distantmagic/graphql-swoole-promise-adapter’s past year of commit activity
    PHP 2 MIT 0 1 0 Updated Nov 8, 2023
  • go-keycloak-bridge Public
    distantmagic/go-keycloak-bridge’s past year of commit activity
    Go 0 0 0 0 Updated Feb 14, 2022
View all repositories

Top languages

Loading…

Most used topics

Loading…