Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,11 @@
A Streamlit-based app comparing and expanding on traditional Document Understanding (OCI DU) + LLM approach vs. a multimodal LLM for extracting structured data from documents (PDFs, images).
This is is aimed at highlighting the strengths of each of our services and the power GenAI brings in combining these approaches for the best handling of complex documents.

<img src="./image.png">
</img>

Reviewed date: 22.09.2025

---

## 🔧 Features
Expand Down Expand Up @@ -130,5 +134,7 @@ This project leverages two core Oracle Cloud Infrastructure AI services:

# 📄 License

Copyright (c) 2025 Oracle and/or its affiliates.

MIT License — see LICENSE for details.

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,8 @@ This tool enables semantic search, summarization, and financial Q&A by leveragin

Author: **Ali Ottoman**

Reviewed date: 23.09.2025

---

## 🔧 Features
Expand Down Expand Up @@ -157,4 +159,6 @@ from langchain_community.chat_models.oci_generative_ai import ChatOCIGenAI

## 📄 License

Copyright (c) 2025 Oracle and/or its affiliates.

MIT License — see [LICENSE](LICENSE) for details.
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@

*This Generative AI service application relies on OCI SDK alongside the new Llama 4 models (Scout and Maverick) to extract data from PDFs (or images) into structured data as JSON.*


Reviewed: 18.09.2025

# When to use this asset?
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ streamlit run <script-name>.py
Replace `<script-name>.py` with the filename of the main script (e.g., `patient_triage_extraction.py`).

## License
Copyright (c) 2024 Oracle and/or its affiliates.
Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,7 @@ streamlit run app.py
```

## License
Copyright (c) 2024 Oracle and/or its affiliates.
Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.

Expand Down
5 changes: 3 additions & 2 deletions ai/generative-ai-service/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ Reviewed: 22.09.2025
### Youtube Videos
- [The future of generative AI: What enterprises need to know | Oracle CloudWorld 2023](https://www.youtube.com/watch?v=qcHpu6WA-k8&t=3s)
- [What is Generative AI](https://www.youtube.com/watch?v=pWNAtUwnBS8&t=3s)
- [Pre-GA OCI Generative AI (Beta) Service Product Tour](https://www.youtube.com/watch?v=1tnTyCp3GdY)
- [Pre-GA OCI Generative AI Service Product Tour](https://www.youtube.com/watch?v=1tnTyCp3GdY)
- [Oracle's Vision for the Future - Larry Ellison keynote Oracle Cloud World 2023](https://www.youtube.com/watch?v=63DmgBN1rSI)
- [Summarize any document using Oracle Generative AI](https://www.youtube.com/watch?v=6A3KGyKy91Q)
- [Dubai Citizen's Dream: An Oracle GenAI-Powered Oracle BOT to Answer All Your Questions (RAG on websites)](https://www.youtube.com/watch?v=5Y_k1r34Mp0)
Expand All @@ -101,12 +101,13 @@ Reviewed: 22.09.2025
- [Oracle to Deliver Powerful and Secure Generative AI Services for Business](https://www.oracle.com/news/announcement/oracle-to-deliver-powerful-and-secure-generative-ai-service-for-business-2023-06-13/)

## Reusable Assets Overview
- [Generative AI demo pack and deployment script](https://github.com/mgueury/streamlit_oke/)

- [Podcast Generator](https://github.com/oracle-devrel/technology-engineering/tree/main/ai/ai-speech/podcast-generator)
- [Decode Images and Videos with OCI GenAI](https://github.com/oracle-devrel/technology-engineering/tree/main/ai/generative-ai-service/decode-Images-and-Videos-with-OCI-GenAI)

## License

Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ Replace `<script-name>.py` with the filename of your main script (e.g., `video_a
```

## License
Copyright (c) 2024 Oracle and/or its affiliates.
Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.

Expand Down
2 changes: 1 addition & 1 deletion ai/generative-ai-service/complex-document-rag/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -252,7 +252,7 @@ For issues and questions:
- The open-source community

## License
Copyright (c) 2024 Oracle and/or its affiliates.
Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ Reviewed date: 22.09.2025
If you have questions or feedback, feel free to reach out via [anshuman.p.panda@oracle.com](mailto:email@example.com).

## License
Copyright (c) 2024 Oracle and/or its affiliates.
Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.

Expand Down
161 changes: 148 additions & 13 deletions ai/generative-ai-service/doc-evaluation-genai/README.md
Original file line number Diff line number Diff line change
@@ -1,23 +1,158 @@
# Document Evaluation Tool using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud
# Document Evaluation Tool using Oracle Generative AI, OCI Document Understanding and Oracle Integration Cloud

Reviewed: 23.09.2025

# Introduction

In this article, we'll explore how to make a handy tool that helps to evaluate documents using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC).
This application combines a low-code approach to orchestrate LLM AI services and applications using Oracle Integration Cloud
and Generative AI prompting techniques for tasks like document key criteria extraction, summarization, and evaluation.
This tool can be super useful in different situations:
For example, it could help recruiters in identifying the top nN% of resumes to get the best candidate for a job, as well it could help to check the RFP compliance in a vendor bid, or easily figure out what's in a bunch of email attachments without opening each one, but these are only a few examples. It can be applied to any industry and is adaptable to any department like HR, Procurement, Marketing, Customer Service, and others.

Here are 2 use cases for how you may use the document evaluation sample application:

A CV Evaluation App as part of a recruitment process:

<img src="./images/1_CVEvaluation.png"></img>
<img src="./images/2_CVEvaluationResults.png"></img>


A Supplier Proposal Evaluation App as part of a vendor bid.

<img src="./images/3_RFPEvaluation.png"></img>
<img src="./images/4_RFPEvaluationResults.png"></img>

In this article we will use as a case study: **"CV Evaluation APP"**

# Prerequisites

Before getting started, make sure you have access to the following Oracle Cloud Infrastructure (OCI) services:

- Oracle Generative AI Service (GenAI)
- Oracle Document Understanding Service
- Oracle Integration Cloud (OIC) with Visual Builder(VBCS) enabled
- Oracle Object Storage


# Solution Architecture

In this section, we'll dive into the building blocks of the solution architecture.
<img src="./images/5_SolutionArchitecture-oci-lowcode-ai-rag-logical-blocks.png"></img>

We've built the application using Oracle Visual Builder (as part of OIC), and it smoothly runs through Oracle Integration Cloud as the main, low-code orchestration tool. OCI Document Understanding is there to handle the document processing, and Generative AI Multi-Chain Prompt technique for extracting key information from these CVs, summarizing them, and helping to facilitate the decision-making process:

1. Document Evaluation Tool App interface built using VBCS:

- The “CV Evaluation App” discussed in this context is crafted within the VBCS platform. Oracle Visual Builder Cloud Service serves as a hosted environment for building your application development infrastructure. It offers an open-source, standards-based development service for creating, collaborating on, and deploying applications within the Oracle Cloud.

2. Document Processing with OCI Document Understanding.:
- The role of OCI Document Understanding is to extract content from document images and other document file types, as CVs can be in different formats.
- The service employs machine learning and optical character recognition capabilities(OCR) to analyze and extract information from various types of documents.

3. Key Criteria Extraction using OCI Generative AI Service:
- The extracted CV data from Document Understanding is sent to the OCI Generative AI Service to perform the following two tasks: CV Summarization and evaluation criteria extraction. This action is performed via one single prompt, which we will later explore in the section “Prompting with Oracle Generative AI”.

4. Integration and orchestration using OIC:
- Oracle Integration Cloud adopts a low-code approach, allowing the creation of integrations and workflows with minimal coding effort and this accelerates the development process. OIC includes monitoring and analytics tools that provide real-time visibility into integration flows. This helps to track performance, identify bottlenecks, and change and optimize LLM integration flows like the one we are exploring here.

5. Document Evaluation using Generative AI:
- The decision-making process could be facilitated in this case with the help of Oracle Generative AI. We are using prompting techniques to help recruiters with useful information that they can use in the decision-making process.



# Application Flow in Detail

In this application:

**Step1.** The File Picker action in VBCS allows the Recruiter to upload all the CVs.

<img src="./images/6_Step1VBCS_FilePicker.png"></img>

<img src="./images/7_Step1VBCS_FilePicker2.png"></img>

**Step2.** Evaluator select hard and soft criteria(input fields) from a predifined list.

<img src="./images/8_Step2VBCS_CriteriaSelection.png"></img>

**Step3.** Evaluator press the button “Evaluate”

<img src="./images/9_Step3VBCS_Evaluation1.png"></img>
<img src="./images/10_Step3VBCS_Evaluation2.png"></img>

**Step4.** After pressing the button “Evaluate”, each CV is processed via Document Understanding, triggering the **OIC Data Loader Low-Code Child Integration Flow** (CVs Data Extraction with Document Understanding REST API)

<img src="./images/11_Step4OIC_DataLoader.png"></img>
<img src="./images/12_Step4OIC_DataLoaderConfig.png"></img>
<img src="./images/13_Step4OIC_DataLoaderRestInvoke.png"></img>
<img src="./images/14_Step4OIC_DataLoaderSampleJson.png"></img>
<img src="./images/15_Step4OIC_DataLoaderSapleJson2.png"></img>
<img src="./images/16_Step4OIC_DocUnderstanding.png"></img>


**Step5.** At this step, using Generative AI the summary of the CV is created, and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).

<img src="./images/17_Step5OIC_Summarization.png"></img>
<img src="./images/18_Step5OIC_SummarizationProperties.png"></img>
<img src="./images/19_Step5OIC_SummarizationJsonDetails1.png"></img>
<img src="./images/20_Step5OIC_SummarizationJsonDetails2.png"></img>
<img src="./images/21_Step5OIC_SummarizationJsonDetails3.png"></img>
<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>

**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, to obtain one of the responses “Good Fit”/ “No Fit”

<img src="./images/23_Step6OIC_Evaluation.png"></img>
<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>

**Step7.** The list of all candidates is shown on the screen together with the response if the candidate is a good fit or not. Also, a summary of each CV is available.

<img src="./images/25_Step6OIC_VBCSEvaluationResult.png"></img>

# Prompting with Oracle Generative AI

In the following CV Evaluation APP use case we are using a Generative AI Multi-Chain Prompting technique to get the results. It consists of 2 prompts:

**Important Note:**
**All examples and data presented in this article are purely fictive and for showcasing purposes only. Any resemblance to real persons, or actual companies is purely coincidental. Dummy users and entities have been created for this demo, and no real data or information about individuals or organizations is being disclosed. We prioritize privacy and ethical considerations in the presentation of information, and any similarities to real-world entities are unintentional.**

## Prompt 1: Summarization and Key Criteria Extraction

To extract the right skills from the CV that match the Evaluator input, we have created a prompt in a Zero-shot technique, where we explicitly mention the output we need to gather out of the document:


<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>

Please access the full prompt <a href="./images/CVEvaluationAppPrompts.pdf">here</a>

## Prompt 2: Final candidate skills evaluation

To evaluate all the CVs, a single prompt was built using two combined techniques: **Few-shot Prompting** and **Chain-of-Thought Prompting**.

<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>

Please access the full prompt <a href="./images/CVEvaluationAppPrompts.pdf">here</a>

# Code
VBCS app - RecruitmentApp-1.0.zip
OIC CV Summary Generation and Evaluation Criteria extraction Parent Integration Flow - CV_JOB_MATCH_FINDER_01.00.0000.iar
OIC CVs Data Extraction Child Integration Flow - AIDOCUMENTPROCESSING_01.00.0000.iar
Generative AI Prompts: CVEvaluationAppPrompts.pdf
CV Samples - cv_samples folder

Please find the **document_evaluation_app_resources.zip** archive in <a href="./document_evaluation_app_resources.zip">/files/document_evaluation_app_resources.zip</a>

# Conclusion

In conclusion, using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC) you may build a nice solution that may sort and help in evaluating documents across various industries and departments. Its adaptability and ease of use can become a handy tool for streamlining document management processes, saving time, and helping enhance productivity across a wide range of business scenarios.

### Authors

<a href="https://github.com/jcgocol">@jcgocol</a>, <a href="https://github.com/clemnaru">@clemnaru</a>


Reviewed: 07.11.2024

# When to use this asset?

See the README document in the /files folder.

# How to use this asset?

See the README document in the /files folder.

# License

Copyright (c) 2025 Oracle and/or its affiliates.

Licensed under the Universal Permissive License (UPL), Version 1.0.

See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.

Loading