Conversation
|
|
||
| ## What is Flash? | ||
|
|
||
| Flash is a CLI tool and framework from the `tetra_rp` package that enables you to build FastAPI applications with workers that run on Runpod's serverless infrastructure. Write your code locally, and Flash handles deployment, scaling, and resource management. |
There was a problem hiding this comment.
FastAPI is a great first class citizen in flash, but I don't want to limit it to saying it's just a way to create FastAPI applications. To me the bigger sell is about Flash being holistic glue that makes it easy and enjoyable to build ML-powered applications on Runpod infra.
| ``` | ||
|
|
||
| ## Examples by Category | ||
|
|
There was a problem hiding this comment.
I'm not sure if this belongs in the examples repo, but I'm tempted to say somewhere in the topline readme it could be cool to have a couple loc showing an example of how easy it is to run and manage resources on Runpod - eg
@remote
def serve_inference(data):
return ...
|
One other thought I'm having is around use cases - to me I can imagine two ways that people will use Flash
Is it worth making any examples for these? and/or how does that fit into the current setup w/ a fastapi mothership endpoint? maybe outside the scope of this PR though |
|
Great thinking! The way we discover and classify independent handlers with the FastAPI approach is just a protocol recognition pattern. We can extend this to other known patterns. We can even allow, in the future, a BYO-pattern for handler discovery. |
2 participants
This establishes initial curriculum structure to cover for our examples repo. We can change any of these as we move forward, but this is a start.