Update llamacpp demonstration notebook #5344
Conversation
…ckend, update the example.
As for the installation process, we can link directly to the installation manual inside the llama-cpp-python repository. I also included this link in the updated version of the notebook. In case of API reference, we can link to the llama-cpp-python documentation API Reference section. As long as langchains' wrapper interface is aligned with this high-level API interface, it should be helpful enough. I could also include this link in the notebook with a warning about potential future changes. Imo, this updated version of the notebook should be informative enough to cover basic user needs in the future, since it covers only the most important steps and parameters. |
# Update llamacpp demonstration notebook Add instructions to install with BLAS backend, and update the example of model usage. Fixes #5071. However, it is more like a prevention of similar issues in the future, not a fix, since there was no problem in the framework functionality ## Who can review? Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: - @hwchase17 - @agola11
# Update llamacpp demonstration notebook Add instructions to install with BLAS backend, and update the example of model usage. Fixes langchain-ai#5071. However, it is more like a prevention of similar issues in the future, not a fix, since there was no problem in the framework functionality ## Who can review? Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: - @hwchase17 - @agola11
Update llamacpp demonstration notebook
Add instructions to install with BLAS backend, and update the example of model usage.
Fixes #5071. However, it is more like a prevention of similar issues in the future, not a fix, since there was no problem in the framework functionality
Who can review?
Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: