Create a gradio based GUI to compare different approaches

[codelion]

Initially brought up in #8 having a GUI would make it easier to visualize and compare different approaches.

[AdityaPandeyCN]

Hi @codelion I liked this project very much and want to work on this issue. I will be grateful for any specific guidance from your side.

[codelion]

Hi @AdityaPandeyCN for the UI we can have a simple chat-like interface that connects with the optillm proxy and allows users to choose the approaches and try out queries. Something similar to https://huggingface.co/spaces/codelion/optillm

[AdityaPandeyCN]

Hey @codelion This looks good I am thinking about why the approach similar to huggingface spaces was not used where we introduce an app.py for GUI separately. I was working on this similar to that.

[codelion]

You can still continue working on that and we will add that in when ready. I just added this today since I saw -https://www.gradio.app/guides/creating-a-chatbot-fast#quickly-loading-from-ollama-or-any-open-ai-api-compatible-endpoint with the new release of gradio. As it was a single line change I added it to the optillm.py file itself.