-
Notifications
You must be signed in to change notification settings - Fork 372
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Information on Bot Framework and Composer's support of Language Studio (Conversational Language Understanding, Custom Question Answering)) #9400
Comments
Hi, |
btw, one of your C# specific links points to JS... although the correct link is also listed at top |
@cwhitten will there be support for CLU and its multilingual capabilities? |
CLU guidance will be coming in the months ahead. We are actively working with the Cognitive Services Language Team on the best guidance as it relates to Composer / SDK bot building. We will be providing communication once that guidance is finalized. |
Thanks @cwhitten and @Dewain27 for the update about the custom CQA recognizer and potential future updates on CLU. We are currently developing a new dialog architecture of our existing "flow-bot", written in Composer (*) and want to use CLU & Question Answering. We are in a multilingual setup with 4 languages and would love to have something similar to the existing LUIS/QnA solution with a recognizer set and some build-in support for CLU. @Dewain27 Do you already know if there will be some built-in solutions or "extensions" like a custom recognizer? In the meantime, would you recommend:
(*) PVA is currently no valid option for us, as we do not have the procurement basis and need customization like connecting via mTLS to an on-premise network. |
@primle also check out the usage of custom recognizer in these docs: https://learn.microsoft.com/en-us/composer/concept-language-understanding?source=recommendations&tabs=v2x#to-add-language-understanding-to-a-dialog |
Hi what is the update on this one @cwhitten your original post did say "coming weeks" back on the 12th of Oct, it's the end of November. What is the deal. |
Hi! Is there any update on this issue? We really need to make a decision about what tools we're gonna use moving fodward. |
I have Custom QA working fine via API calls from my Composer bot project, and processing of multi-prompts. Just Regular Expression recognizer and Custom Question Answering. How do we keep Publish from requiring actual LUIS and QNA resources? They are not used nor required. The bot was buily from EMPTY BOT Template created from Bot Composer.
Appears to make no difference whether I include or exclude the LUIS / QNA settings in publish profile... Publish tries to validate. So want to know how I disable them, as they are not used. |
Hi @cwhitten , Thanks. |
@fausttiger, i feel your pain, I've been down this exact road ☹. To fix it, you need to remove all references to QnA knowledgebase from your composer settings/project. These include QnA dialogs (and perhaps triggers, i only had to do the dialogs) in places such as the chitchat dialog at the parent level and any other dialogs referencing QnA don't forget the chitchat dialog in Bot responses section as well. You may need to go into the directory containing the bot project and do the same. Note until you remove the content of the chitchat dialog under your bot responses the issue will not go away. I found this part a bit tricky as the problem persisted even after i'd deleted the chit chat responses within the Bot response section on the canvas, in the end i had to open the file within the bot project folder, where I selected and deleted all the contents. This did the trick. |
Hi everyone, Thank you for your patience as we're worked through this. We're very close to enabling a CQA integration through a new Bot Framework component package. A PR is in review here: microsoft/botframework-components#1405, afterwhich we'll publish it to a public nuget feed. |
this is still only for a full code solution, and not a composer based solution? I have my composer based solution working, but can't deploy to azure due to dependencies wired into Composer it seems.
|
@fausttiger |
@fausttiger the approach for QnA is the same for LUIS. I decided to continue using LUIS instead of CLU because it is more complicated to setup than QnA if you consider that you have to create http actions for each intent in trigger in LUIS. Also LUIS has not been taken offline like the QnA service. |
@nickfrancis are there any .qna files in your project? You should be able to delete the |
I'll see what I can post. Trying to get Publish from Bot to work (talking with MS shortly) as can't yet publish from Composer to Azure via ImportResources. (MS person mentions Composer bug, Composer assuming types of bots/resourcs to be deployed, but don't have details). Basically
QUESTION
|
@Intelliteckai , if only Regex recognizer used for recognizer, is LUIS still used? Unknown intent can't use LUIS as I have none defined. But yes, I might just add an unused LUIS resource if needed to avoid Publish validation issues (bot doesn't require it) |
does same apply for .LU files? There are a number in my project, but they are all empty files. i.e. |
OK, with just Custom QA and Regex recognizers we got the bot deployed from Composer into Azure Bot. Our current bot project was already working find in Bot Composer web chat or emulator... we just couldn't Import Resources (created all in Azure) to publish bot code to Azure Bot. We basically just had composer create basic bot requirements + LUIS; Had language create language components, and manually add some reporting related elements in Azure This is how we provisioned/published (I'll have to get some details how we have Customer QA working in our bot composer project later)...
continue which provisions resources in Azure
Still need to determine best setup/queries to get log analytics/application insights data for telemetry /reporting in Power BI as different compared with QnAMaker. |
Any update regarding this issue? I am using Bot Composer, I tried to use the new package, but I have an issue dialog error: Type Microsoft.Bot.Components.Recognizers.CustomQuestionAnsweringRecognizer not registered in factory. |
Hi everyone. Again, thank you very much for your patience. Yesterday we published a C#-based Bot Framework package that Composer users can install into their C#-based bot project created from Composer. Note: Node.js bots cannot install or use this package. Please see the README.md for instructions on how to configure and use this custom recognizer, and if you have issues when following these instructions, open a github issue here, where the team will help troubleshoot. Note that package enables CQA runtime inferencing for intent recognition, and any knowledge-base authoring will need to be done in the Language Studio. Additionally, using this CQA recognizer is not compatible with any existing knowledge-bases that are authored directly in Composer. You will still create and use the QnA Intent Recognized trigger on the dialog which you've enabled the custom CQA recognizer. |
Thanks @cwhitten , |
Thanks @cwhitten I have done some tests and it's working as you described. |
Has anyone been updating their analytics to digest the Application Insights (workspace not old classic) and Log Analytics Workspace telemetry to work with the new Custom Question Answering or CLU? we previously modified the Virtual Assistant Analytics template |
Hi, |
Hi @cwhitten , could you help check these questions mentioned by @nghivo ? |
This was really easy to implement - thank you @cwhitten In terms of moving LUIS over - is it just a case of importing & using standard "Intent recognized" triggers within Bot Framework Composer? @fausttiger am also needing to look at analytics. Was using the same template you linked but haven't done any modification to it. |
Yes I used the Virtual Assistant power bi template with my previous QnAMaker bot... connecting to the Application Insights... (it's tagged as not supported anymore) kusto will convert to power query like
I'm not there yet, and find little examples online tha reflect the new bot and custom question answering scenario.
|
Thanks @cwhitten & @spmoreno, its working well.... BUT Does it will only work with start dialog or is there any way we can create the same thing within another dialog and call it when needed?? |
hey is there any update to migrating LUIS to CLU . we are building an enterprise level chatbot . and it doesn't make sense to build it now in January where it will stop in April ( when it comes to creation) can we have a guideline on migrating LUIS to CLU please |
We would also like any update on migrating LUIS to CLU, specifically for Composer built bots. Is it feasible to create a custom recogniser for CLU and is their any documentation on how to approach this? |
@cwhitten same issue here as mentioned by itsmeprateek, the qna trigger is not triggered if the dialog is invoked from another dialog. Is there any way to make the solution work for a multi dialog bot? |
@nickfrancis @fballan93 @Charlie2922 Hi! In case you haven't seen it, CLU can be integrated with BFC as explained here. Configuring expressions and intents is done directly in the Language Studio portal. In Composer, in addition to the package configuration, a trigger (Intent recognized type) must be generated for each intent, with the same name as it is in the portal. However, I am now working on solving other needs, such as capturing the response score in a variable or presenting the topIntent as a response. |
Latest (stable) release: Feb 3, 2022... |
12/14/22 update: See this link for more information on using a custom CQA recognizer: #9400 (comment)
Hello everyone,
With the recent announcements around the retirement of QnA Maker and GA release of CQA (Custom Question Answering), we wanted to provide some guidance to our community. We have a sample for using CQA with the BF (Bot Framework) SDK today and the link is below and for Composer we are looking to provide a package that will allow for CQA as a custom recognizer in the coming weeks. To provide some relief, we have extended the ability to create new QnA resources temporarily for those subscriptions where we identified active use of Composer for QnA authoring between 9/1/2022 and 10/1/2022. The extension will be provided to these customers until 1/1/2023. Premier Support Customers that feel that they need more time to provision QnA Maker resources that were not already approved will be required to open a support request to ask for an exception that can be evaluated by our PG for approval. We will be communicating guidance on moving away from QnA Maker for BF Composer as a resource in the coming weeks as there are great advantages to our new product offering.
Here are some documentation links that are available currently and we will post again when we have more to share:
SDK CQA Sample
BotBuilder-Samples/samples/csharp_dotnetcore/12.customQABot at main · microsoft/BotBuilder-Samples (github.com)
BotBuilder-Samples/samples/csharp_dotnetcore/48.customQABot-all-features at main · microsoft/BotBuilder-Samples (github.com)
JavaScript
https://github.com/microsoft/BotBuilder-Samples/tree/main/samples/javascript_nodejs/12.customQABot
https://github.com/microsoft/BotBuilder-Samples/tree/main/samples/javascript_nodejs/48.customQABot-all-features
Csharp
BotBuilder-Samples/samples/csharp_dotnetcore/12.customQABot at main · microsoft/BotBuilder-Samples (github.com)
BotBuilder-Samples/samples/csharp_dotnetcore/48.customQABot-all-features at main · microsoft/BotBuilder-Samples (github.com)
CQA Documentation
What is question answering? - Azure
How to migrate QnaMaker Cognitive Services - Microsoft Learn
Question Answering tutorial
We will continue to collect your feedback and share updates to this pinned github issue as we have them. Thank you
The text was updated successfully, but these errors were encountered: