How to create a custom LLM

[aaronrogers]

How does one go about creating a custom LLM? It appears that BaseLLM isn't exported from the lib.

[nfcampos]

Hi @aaronrogers You can now do import { BaseLLM } from 'langchain/llms'; We don't have many docs on creating a custom LLM, my suggestion would be to look at one of the existing ones, and go from there. A simple one is https://github.com/hwchase17/langchainjs/blob/main/langchain/src/llms/cohere.ts

Any questions let me know! Happy to help

[aaronrogers]

Oh man, I just found that. I was trying to use it earlier but it wasn't working. It must've been an error on my part. 🤦

Thanks for the help!

[muhammed-shihebi]

For langchain version 0.0.173, import { BaseLLM } from 'langchain/llms/base'; is working.