This repository provides a setup for a ChatGPT-like interface for Large Language Models (LLMs) on Google Colab using Ollama and a user interface (UI).
This supports the article "Launch Your Own ChatGPT Clone for Free on Colab: Shareable and Online in less than 10 Minutes" (https://medium.com/@bartek.lewicz/launch-your-own-chatgpt-clone-for-free-on-colab-shareable-and-online-in-less-than-10-minutes-da19e44be5eb).
Leverages Ollama to run LLMs locally on Google Colab's free tier. Employs a user interface similar to ChatGPT for interacting with the LLM. Allows downloading various LLM models directly through the interface. Exposes the UI to the internet using Localtunnel for easy access. Getting Started:
Google Account and Familiarity with Google Colab
The detailed instructions for setup and usage are provided in the included Jupyter Notebook (AnyGPT_Colab_OLLAMA_with_UI_on_Colab.ipynb).
Ollama Homepage: https://ollama.com/
NextJS-Ollama-LLM-UI GitHub: https://github.com/jakobhoeg/nextjs-ollama-llm-ui (UI used in this project)
Localtunnel GitHub: https://github.com/localtunnel
Google Colab free tier limitations apply (runtime, sessions, resource usage). This approach is intended for experimentation and development, not production environments.
Feel free to explore, modify, and improve this setup!