A versatile CLI and Python wrapper for Groq AI's breakthrough LPU Inference Engine. Streamline the creation of chatbots and generate dynamic text with speeds of up to 800 tokens/sec.
artificial-intelligence
language-processing
lpu
groq
large-language-models
mixtral-8x7b
groqapi
groqai
groq-ai
groq-api
groqaiapi
groq-ai-api
lpu-inference-engine
language-processing-unit
languageprocessingunit
large-laguage-model
llama3
llama-3
llama3-70b-8192
-
Updated
Sep 12, 2024 - Python