Skip to content

Releases: bosslesss/inference-labs-js

v0.1.0 - initial release

Choose a tag to compare

@bosslesss bosslesss released this 29 May 05:14

First public release of inference-labs for JavaScript / TypeScript.

Install

npm install github:bosslesss/inference-labs-js
# or pinned to this release:
npm install https://github.com/bosslesss/inference-labs-js/releases/download/v0.1.0/inference-labs-0.1.0.tgz

Quickstart

import { InferenceLabs } from "inference-labs";
const client = new InferenceLabs({ apiKey: "il_live_..." });
const out = await client.generate({ prompt: "Hello", strategy: "cost-first" });
console.log(out.text, out.model, out.costUsd);

See the README for full docs, streaming, and the error types.