Semantic Kernel Process help in a web API project

[balaji830]

I have created an Web based application that simulates Perplexity AI. AI System understands, refines, and retrieves answers to user queries in real-time (uses Google and/or Brave search API for this purpose). It features multi-agent processing, where different AI components collaborate to classify intent, reformulate queries (Search Engines Optimized), and generate responses (along with sources and follow-up questions). So, I have Intent Classifier Agent, which classifies the intent as either Fact (that it can answer Example: What is the Capital of India?), Comparison (Tell me about Galaxy 24 and Apple iPhone 15), reasoning, general (It may or may not be able to answer, Tell me about AI it may be able to answer where as what is the current stock price of MSFT it cannot) or needs clarification. Needs clarification will send the request back to user for clarification. (Example interaction: User: Tell me about Tesla? Intent Classifier will tag it as Needs Clarification and responds with a question Are you asking about Tesla the company or the inventor?).
The application runs fine (I will open source the code shortly). I am NOT using SK's Orchestration. I am manually Orchestrating the process. I don't want to do this. I do use SK just for ChatHistory and Plugins purposes. It works great. The question is, how do I use SK Process Framework (especially How-To: Human-in-the-Loop) for an app like this? Any example or hint that I can get? Especially, how do I incorporate a Back and forth Chat (in the current implementation, I rehydrate the chat history based on a Unique ID -currently stored in Redis). I want to make this API based. Any help or guidance is helpful.
I looked at Human in the Loop, the thing I don't understand is how to does processes respond back with Intent clarification when the step raises the event NeedsClarification? Can it be done? The way i was envisioning is available in AutoGen (https://microsoft.github.io/autogen/stable/user-guide/agentchat-user-guide/tutorial/human-in-the-loop.html)

[alliscode]

Hi @balaji830, thank you for your question. This is possible to do with the process framework, but I realize that we do not have any demos that show how. I can get a sample out to help with this. Are you using python or dotnet?

[balaji830]

Thanks for reaching out. I am using dotnet (C# specifically developed as a SignalR application. May be later add Dapr into mix). The plan is to introduce Vector database (instead of always going to search API, for frequently used queries, check first in a DB and return result from that) and specialized process flows as I learn more about the framework (for vector db I think I will create another plugin. But I want to use it in a process rather than plugins).
Also, the job of intent classifier (currently this is a service) is NOT only to understand the intent of user's query but also come up with a process flow that can be applied dynamically (I am not sure if intent classifier is part of a process how can it dynamically change the process - I was thinking in terms of Parent and Child type of process. Always starts with Parent process that dynamically selects a Child process based on the intent). To give an example:
User uploads some documents and indicates that she/he wants to check for factual correctness of the content in the document. The AI understands the intent and select a multi-agent process flow that may be called "Fact Checking & Accuracy Validation" (where A "Reasoning AI" and "Fact Checker AI" collaborate to ensure factual correctness before providing an answer). Or when a user indicates check for compliance, AI understands the intent and selects a process names "Security & Compliance Review" (where A "Compliance AI" and "Privacy AI" confirm whether data can be displayed to the user. Or it needs PII sanitization). I have developed some of these kind of flows individually using Crew AI (it has limitations of its own. I will NOT be using any CrewAI flows in here. I saw there was some CrewAI integration, but I will not be using for this purposes). But I want to integrate all of it as a product using SK. It would be helpful if you can provide some guidance and examples.

[ekjuanrejon]

I am also interested in this. dotnet please

[balaji830]

@sophialagerkranspandey, I am not sure why @alliscode reply is selected as an answer. A reply is NOT an answer. He was asking for a clarification, that cannot be an answer?