Minimal API with AI

[Koeng101]

My dream for DnaDesign is to integrate AI systems for designing DNA - the other API request is a means to this end. However, I want the end-to-end pipeline to exist, and then the rest of the functions can be added. This is meant to be an end-to-end example with deployment details:

• Have an AI system that can look at a user prompt and decide how to add information to it
• Have a chatbox system working with hyperscript/htmx (this should be as simple as possible)
• Have the simplest code integration (just fasta reading with attachments)
• Have actual deployment working (thinking just k3s with digitalocean)

I think after this point is where it gets interesting, because it can be used for things.

[Koeng101]

What is a minimally viable API here?

I would say:

• Can open attachments
• Can figure out if the user needs information or if the user needs code to be written
• Can figure out what needs to be injected into context window for users code
• Can generate code
• Can execute generated code
• Can return results to user

[Koeng101]

• Can open attachments
• Can figure out if the user needs information or if the user needs code to be written
• Can figure out what needs to be injected into context window for users code
• Can generate code
• Can execute generated code
• Can return results to user

[Koeng101]

The biggest problem here is that I have to do a crap ton of massaging and prompt engineering to get a proper output. I think I really just need a fine tune for my desired output (lua using the library, with the particular output I'm looking for). This just takes a lot of examples, which I think would be healthy to make.

[Koeng101]

As an update: figured more of this out in a separate repo, going to merge soon. Got lua generation working reliably.

[Koeng101]

As an update:

I need this to realistically be a C library so I can interoperate with Python. I like writing Go and am good at it - the simplicity is really a driving factor. When it comes to biological applications, if performance is REALLY needed, can just drop into C. But being able to use this package in python is pretty essential for AI to be able to use it well, and for integration with larger systems.