Freeway is meant to provide a simple, flexible, extensible and lightweight standard for managing prompt templates, database query templates, user input points, and LLM-backed system diagrams.
The unit elements of Freeway are as follows:
- Prompt Templates
- Database Query Templates
- User Inputs
These units can then be used to construct a diagram of a system structure, to indicate the general flow of data.
We know that systems built on LLMs are full of json parsing, for loops, if statements, and regexes. We just think that you should focus on outlining the LLM-specific components of a system.
We also believe that prompt templates should be managed out of code, where they can be edited on their own lifecycle.
There is an open source python sdk that can be installed from PyPi:
pip install freewayaiIn the sdk/examples/outbound_sales folder there is a reference implementation using the python sdk and the FreewayAI spec to build a sample application.