@proj-airi/provider-transformers

Experimental provider implementation of 🤗 Transformers.js for xsai.

This enables you possibilities to use any models supported by 🤗 Transformers.js the feel of xsai just like you are directly request OpenAI API but pure locally within the browser.

This is also possible for runtime with WebGPU or Web Workers support, e.g. Node.js.

Warning

This haven't been released yet, it is currently only used by Airi's stage and memory layer, if you found this helpful, join us to discuss on xsai #41.

Example usage

// Currently @proj-airi/provider-transformers
import { createTransformers } from '@xsai-ext/provider-transformers'
import EmbedWorkerURL from '@xsai-ext/provider-transformers/worker?worker&url'
import { embed } from '@xsai/embed'

const transformersProvider = createTransformers({ embedWorkerURL: EmbedWorkerURL })

const res = await embed({
  ...transformersProvider.embed('Xenova/all-MiniLM-L6-v2'),
  input: 'Hello, world!',
})

console.log(res.embedding)
// {
//   embedding: Array<number>[768],
// }