Skip to content

LLama 3 is here & Groq API - Release Notes for RAG-nificent v0.0.2

Choose a tag to compare

View all tags
@MaxMLang MaxMLang released this 19 Apr 18:56
· 42 commits to master since this release
v0.0.2
1c2cf67

I'm thrilled to announce the release of RAG-nificent v0.0.2, an upgrade packed with exciting new features designed to enhance the functionality and performance of the AI-powered chatbot system. This release focuses on expanding the model selection for retrieval and generation tasks and introducing a new user-controlled feature to adjust response creativity.

What's New

Expanded Model Selection

RAG-nificent now supports a wider range of language models, providing users with the flexibility to choose the most suitable AI for their specific needs. The new lineup includes:

  • 📘 ChatGPT-3.5: Known for its engaging and human-like interactions, ideal for a variety of conversational applications.
  • 🦙 Llama3-70B-8192: Delivers high-end performance for complex language tasks and deep learning insights.
  • 🦙 Llama3-8B-8192: Offers robust capabilities in a more accessible form, perfect for diverse AI applications.
  • 🌟 Mixtral-8x7B-32768: Utilizes ensemble modeling for nuanced understanding and superior response generation.
  • 🦙 Llama2-70B-4096: A proven model for comprehensive language processing.
  • 💎 Gemma-7B-IT: Tailored for IT and technical content, providing specialized interactions.

A special highlight is the new Llama70B model by Meta, added to our arsenal to ensure top-tier performance and insights. All models are now powered by the Groq API, the fastest inference LPU available, ensuring lightning-fast responses that enhance user experience.

Temperature Slider

A new "temperature" slider has been integrated into RAG-nificent, allowing users to adjust the "temperature" setting of the language models. This setting modifies the level of creativity and variability in the responses generated by the AI. A lower temperature results in more deterministic and predictable responses, while a higher temperature makes the AI's responses more diverse and potentially more creative. This feature adds a layer of customization, giving users more control over the interaction style of the chatbot.

Enhancements

  • Integration of Groq API for all supported models to significantly boost response times and throughput.
  • Improved user interface with a simple control for adjusting the temperature setting, enhancing interactivity and user experience.
Assets 2
Loading