Fast Inference of MoE Models with CPU-GPU Orchestration
-
Updated
Nov 18, 2024 - Python
#
local-inference
Here are 4 public repositories matching this topic...
LLM chatbot example using OpenVINO with RAG (Retrieval Augmented Generation).
natural-language-processing
offline
chatbot
intel
edge-computing
rag
openvino
huggingface
edge-inference
cloud-free
llm
local-inference
langchain
dolly2
retrieval-augmented-generation
llama2
neural-chat
-
Updated
Jan 25, 2024 - Python
script which performs RAG and use a local LLM for Q&A
-
Updated
Sep 16, 2024 - Python
Script which takes a .wav audio file, performs speech-to-text using OpenAI/Whisper, and then, using Llama3, summarization and action point from the transcript generated
summarization
speech-to-text
whisper
meeting-minutes
local-inference
langchain-python
llm-inference
ollama
-
Updated
Sep 16, 2024 - Python
Improve this page
Add a description, image, and links to the local-inference topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the local-inference topic, visit your repo's landing page and select "manage topics."