Can I use llama-index based on a locally deployed model?

[Meaninles]

I wish to use llama-index with a locally deployed chatglm model, how should I do it? Or what changes should I make?

[jerryjliu]

we use langchain as the underlying LLM abstraction under the hood, i'd follow langchain docs for how to add a custom llm

docs for how to integrate llm into llamaindex: https://gpt-index.readthedocs.io/en/latest/how_to/custom_llms.html

[huangjiaheng]

we use langchain as the underlying LLM abstraction under the hood, i'd follow langchain docs for how to add a custom llm

docs for how to integrate llm into llamaindex: https://gpt-index.readthedocs.io/en/latest/how_to/custom_llms.html

404