Oracle Cloud Infrastructure (OCI) Generative AI

[corradodebari]

Support, via OCI GenAI service, LLM models like Cohere Command R, Cohere Command R+, Cohere Embed or Meta Llama 3.

[corradodebari]

Implemented in the oracle-samples/cdb-fix.
It exploits the Langchain APIs:

• langchain_community.chat_models.oci_generative_ai.ChatOCIGenAI
• langchain_community.embeddings.oci_generative_ai.OCIGenAIEmbeddings
  that require the ~/.oci/config configured to work.
  No workaround available at the moment.

Added to the metadata list two models:

• chat: cohere.command-r-plus-08-2024
• embedding: cohere.embed-multilingual-v3.0

available in the Models/Configuration page.
At startup needs two ENV variables configured:

• OCI_COMPARTMENT_ID=".."
• OCI_PROFILE="DEFAULT"

If oci installed, it works.