Conversational AI assistant

[saltcod]

In Launch Week 7, we added Supabase AI to the SQL Editor. It was a brand new way to write SQL (by not writing it all). This is one of our most-used tools, and we get a lot of feedback about it. We’ve spent some time working on an iteration over the past few weeks and we’d love to know what you think.

What we heard:

• the one-shot prompt is fine, but a conversational ui would be better
• the one-shot prompt slowed down workflow (again, conversation = better)
• it wasn’t obvious whether or not you were sending your project metadata

What we'd like to know:

• does the new conversational Assistant help?
• does it feel much faster now? Does it keep you in the flow?
• how are the AI responses? Are you seeing areas that could be improved?

Try it out!
You can enable the new conversational Assistant from the Feature Preview:

[madebyfabian]

Just used it, very cool! One thing though, I cannot copy anything out of the right window. Whether its part of the code or any message I wrote for example. When selecting the text and hitting CMD + C, it does not get copied.

[madebyfabian]

General feedback: It definitely helps to get a better overview about where we came from and how the answers evolved. However, since it's never returning anything besides the SQL, sometimes it's hard to know if it really understood me well

[Hallidayo]

Hi @madebyfabian - Just checking does the copying issue still happen for you? I am able to my end, also if you hover over the SQL generated by the AI their should be a copy icon that you can use.

[madebyfabian]

@Hallidayo Hi there, I don't have it anymore, just checked. Works fine now :)

[rajivsinclair]

Is there going to be any way to bring this feature (and other AI-powered magic) to a self-hosted instance of Supabase? Of course, I am assuming that if the underlying LLM is not local/open-source, then we would need to configure our own API keys from OpenAI/Anthropic/Cohere/etc.

[rosmur]

and is it just querying GPT-4 under the hood? Or any specialized model - there are a few fine tuned models claiming great NL2SQL performance

[rajivsinclair]

Looks to me like it uses the GPT-3.5 model from OpenAI: https://github.com/supabase/supabase/blob/master/packages/ai-commands/src/sql.ts

[rajivsinclair]

For a self-hosted instance, can I just specify my API key in the .env for the docker containers that Supabase spins up?