Minimal API with AI

[Koeng101]

My dream for DnaDesign is to integrate AI systems for designing DNA - the other API request is a means to this end. However, I want the end-to-end pipeline to exist, and then the rest of the functions can be added. This is meant to be an end-to-end example with deployment details:

• Have an AI system that can look at a user prompt and decide how to add information to it
• Have a chatbox system working with hyperscript/htmx (this should be as simple as possible)
• Have the simplest code integration (just fasta reading with attachments)
• Have actual deployment working (thinking just k3s with digitalocean)

I think after this point is where it gets interesting, because it can be used for things.

[Koeng101]

What is a minimally viable API here?

I would say:

• Can open attachments
• Can figure out if the user needs information or if the user needs code to be written
• Can figure out what needs to be injected into context window for users code
• Can generate code
• Can execute generated code
• Can return results to user

[Koeng101]

• Can open attachments
• Can figure out if the user needs information or if the user needs code to be written
• Can figure out what needs to be injected into context window for users code
• Can generate code
• Can execute generated code
• Can return results to user

[Koeng101]

The biggest problem here is that I have to do a crap ton of massaging and prompt engineering to get a proper output. I think I really just need a fine tune for my desired output (lua using the library, with the particular output I'm looking for). This just takes a lot of examples, which I think would be healthy to make.

[Koeng101]

As an update: figured more of this out in a separate repo, going to merge soon. Got lua generation working reliably.