Frameworks like Gradio and Streamlit are pretty good BUT open-webui is much more advanced and overall better option in my opinion.
Open-webui is great open source project which i and many thousands of users are using locally to connect with different llms through open ai api compatibility (with help of litellm, which is another great open source project we can connect with 100+ llms easily) and use it for either personal purpose or for providing it to customers. It is pretty awesome project you can checkout too :-) - https://github.com/open-webui/open-webui