Ailets: Building blocks for realtime AI apps

Ailets are components that make AI services interchangeable. Based on WebAssembly, the components can be used from any programming language and run anywhere.

Problems with existing solutions

There are a number of AI frameworks, but they have limitations.

First, the code is not language independent. If a framework is written in Python, it can't be used from JavaScript or Ruby.

We solve this problem by using WebAssembly, which is already widely supported.

Second, the frameworks are designed for top-level abstractions such as chains or agents. The low-level abstraction layers are not intended for independent use.

We provide the lowest possible abstraction that generalizes the specifics of AI vendors.

Quote from you

Ailets now is like C in the 1970s, portable and not Cobol.

How to get started

User playground on the command line

# One-time setup
OPENAI_API_KEY=sk-.....
ailets() {
  docker run --rm -e OPENAI_API_KEY=$OPENAI_API_KEY olpa/ailets "$@"
}

# Sample usage

echo "Hello!" | ailets gpt --prompt -
# Output: Hello! How can I assist you today?

ailets gpt --prompt "Hello!" --tool get_user_name
# Output: Hello, ailets! How can I assist you today?

ailets gpt --prompt "What is it?" --prompt @https://rdi.berkeley.edu/llm-agents-hackathon/assets/img/llm_agents_hackathon_banner.png
# Output: The image is an announcement or promotional banner for the "LLM
# Agents MOOC Hackathon," hosted by Berkeley's Center for Responsible, De
# centralized Intelligence. It likely pertains to a hackathon focused on
# leveraging Large Language Models (LLMs) and their integration into vari
# ous applications. The event may encourage collaboration and innovation
# in the field of artificial intelligence and machine learning, while als
# o emphasizing responsible and decentralized practices in technology.

ailets dalle --prompt "linux logo"
# Output: ![image](https://oaidalleapiprodscus.blob.core.windows.net/....)

Customer quote

I've used ailets in my startup and got a billion dollars in funding. Thank you!

Milestones

• Command-line tool complete
• Proof of concept (async-orchestration) implemented in Python
• [~] In progress: Rewriting actors in Rust
• [~] In progress: Rewrite the runtime in Rust
• To do: Rewrite the command-line tool in Rust
• To do: Integrate Ailets with hosts

Deliverables

• Command-line tool to use text generation models and dall-e. https://hub.docker.com/r/olpa/ailets, https://github.com/olpa/ailets/blob/master/docs/command-line-tool.md
• Rust crate RJiter: A streaming JSON parser
• Rust crate scan_json: React to elements in a JSON stream before the entire document is available
• pylib-v1 ailets: actor workflows in Python

Closing and call to action

Read the technical thoughts

Developers:

• ⭐ Star the repository
• Join Ailets Discord
• Eventually, start using ailets in your code

Sponsors:

The Ailets project is unique, tames AI agents, ambitious, and requires a lot of work. I need to raise funds.

• Crowdfunding: For a small amount (up to $100), pay to the GeWoVa project: https://gewova.com/buy.html
• Venture capital: Potentially, Ailets is a multi-million dollar business. View the pitch, read the slides.

Contact

Author: Oleg Parashchenko, olpa@ https://uucode.com/

Contact: via email or Ailets Discord

Website: Ailets home, github repository

License: MIT