Skip to content

CAP LLM Plugin helps developers create tailored Generative AI based CAP applications without exposing confidential data to LLM by anonymizing sensitive data leveraging SAP HANA Cloud Data Anonymization.

License

Notifications You must be signed in to change notification settings

SAP-samples/cap-llm-plugin-samples

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

CAP LLM Plugin

CAP LLM Plugin helps developers create tailored Generative AI based CAP applications:

  1. Without exposing confidential data to LLM by anonymizing sensitive data leveraging SAP HANA Cloud Data Anonymization.
  2. Seamlessly generate vector embeddings via SAP AI Core.
  3. Easily retrieve Chat Completion response via SAP AI Core.
  4. Effortlessly perform similarity search via SAP HANA Cloud Vector engine.
  5. Simplified single RAG (retrieval-augmented generation) retrieval method powered by SAP AI Core and SAP HANA Cloud Vector Engine.

Architecture

architecture

✔️ Anonymization Features

Feature Details
Seamlessly anonymize sensitive data using a variety of SAP HANA Cloud's anonymization capabilities Effortlessly anonymize sensitive data within a CAP application by employing a single @anonymize annotation using a diverse range of SAP HANA Cloud's anonymization algorithms, including but not limited to:
  • k-Anonymity
  • l-Diversity
  • Differential Privacy
  • Effortlessly replace the anonymized data within the LLM response with genuine information Given that the data provided to the LLM consists of anonymized information, the CAP LLM plugin ensures a seamless replacement of anonymized content within the LLM response with the corresponding authentic data.

    🎯 LLM Access Layer Features

    Feature Details
    Embedding generation via SAP AI Core Easily connect to embedding models via SAP AI Core and generate embeddings seamlessly
    Similarity search Leverage the SAP HANA Cloud's Vector engine to perform similarity search via CAP LLM Plugin
    Chat LLM Access via SAP AI Core Simple access to LLM models via SAP AI Core with simplified method for chat completion
    Streamlining RAG retrieval Single method to streamline the entire RAG retrieval process leveraging SAP AI Core and SAP HANA Cloud Vector Engine

    📚 Samples and documentation

    For API documentation for the CAP LLM plugin, refer the api-documentation.

    For how to use Anonymization with CAP LLM plugin, refer the anonymization-usage.

    For sample use cases leveraging CAP LLM Plugin, refer to Samples.

    How to obtain support

    Create an issue in this repository if you find a bug or have questions about the content.

    For additional support, ask a question in SAP Community.

    License

    Copyright (c) 2024 SAP SE or an SAP affiliate company. All rights reserved. This project is licensed under the Apache Software License, version 2.0 except as noted otherwise in the LICENSE file.

    About

    CAP LLM Plugin helps developers create tailored Generative AI based CAP applications without exposing confidential data to LLM by anonymizing sensitive data leveraging SAP HANA Cloud Data Anonymization.

    Topics

    Resources

    License

    Code of conduct

    Security policy

    Stars

    Watchers

    Forks

    Releases

    No releases published

    Packages

    No packages published