Repository navigation
IntelliNode v2.0.4
New Features 🌟
- Support NVIDIA hosted models (DeepSeek and Llama 3.3) via a unified chatbot interface.
- Add streaming responses when calling NVIDIA models.
- Add new embedding provider.
Using NVIDIA Chat 💻
const { Chatbot, NvidiaInput, SupportedChatModels } = require("intellinode");
// Create a chatbot instance
const nvidiaBot = new Chatbot(NVIDIA_API_KEY, SupportedChatModels.NVIDIA);
// Prepare the chat input
const input = new NvidiaInput("You are a helpful assistant.", {
model: 'deepseek-ai/deepseek-r1', // or use 'meta/llama-3.3-70b-instruct'
maxTokens: 512,
temperature: 0.6
});
input.addUserMessage("Which number is larger, 9.11 or 9.8?");
// Send the request and log the response
const response = await nvidiaBot.chat(input);For more details, check the docs.