Skip to content

IntelliNode v2.0.4

Choose a tag to compare

@intelligentnode intelligentnode released this 02 Feb 08:05
· 103 commits to main since this release
f778851

New Features 🌟

  • Support NVIDIA hosted models (DeepSeek and Llama 3.3) via a unified chatbot interface.
  • Add streaming responses when calling NVIDIA models.
  • Add new embedding provider.

Using NVIDIA Chat 💻

const { Chatbot, NvidiaInput, SupportedChatModels } = require("intellinode");

// Create a chatbot instance
const nvidiaBot = new Chatbot(NVIDIA_API_KEY, SupportedChatModels.NVIDIA);

// Prepare the chat input
const input = new NvidiaInput("You are a helpful assistant.", {
  model: 'deepseek-ai/deepseek-r1', // or use 'meta/llama-3.3-70b-instruct'
  maxTokens: 512,
  temperature: 0.6
});
input.addUserMessage("Which number is larger, 9.11 or 9.8?");

// Send the request and log the response
const response = await nvidiaBot.chat(input);

For more details, check the docs.