How to handle the adaptive card response in Composer #1820

KoradaRajesh · 2020-01-02T14:48:08Z

Github issues should be used for bugs and feature requests. Use Stack Overflow for general "how-to" questions.

Version

What package version of the SDK are you using.

Describe the bug

Give a clear and concise description of what the bug is.

To Reproduce

Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior

Give a clear and concise description of what you expected to happen.

Screenshots

If applicable, add screenshots to help explain your problem.

Additional context

Add any other context about the problem here.

[bug]

mdrichardson · 2020-01-02T22:11:53Z

@KoradaRajesh As far as I know (@vishwacsena, correct me if I'm wrong), there's no way to capture this through a prompt, since Adaptive Card input is sent through Activity.Value and not Activity.Text.

So, you need some way of capturing those. Here's what I did:

Adaptive card json:

{
    "type": "AdaptiveCard",
    "body": [
        {
            "type": "TextBlock",
            "text": "Text Input - id: textInput"
        },
        {
            "type": "Input.Text",
            "placeholder": "Enter some text",
            "id": "textInput"
        },
        {
            "type": "TextBlock",
            "text": "Number Input - id: numberInput"
        },
        {
            "type": "Input.Number",
            "placeholder": "Enter a number",
            "id": "numberInput"
        }
    ],
    "actions": [
        {
            "type": "Action.Submit",
            "title": "Submit"
        }
    ],
    "$schema": "http://adaptivecards.io/schemas/adaptive-card.json",
    "version": "1.0"
}

Then, construct a condition with turn.activity.value && !turn.activity.text and output the result with '@{turn.activity.value}':

KoradaRajesh · 2020-01-06T13:14:39Z

yeah i have tried it but @mdrichardson how do you sent the adaptive card , if we sent in prompts it not accepting the action and again it re prompting if we sent in the (send a response) it will not wait for the submission of card ,it will immediately check the if condition in the flow.

mdrichardson · 2020-01-06T16:19:59Z

@KoradaRajesh I had to add it as a separate trigger. It's not ideal and it's difficult to get working in your flow, but that's the only way I was able to do it. If you want to point me to a copy of your bot, I might be able to help you implement it.

That being said, the Composer team marked this as an [Enhancement], so they'll work this into an actual feature. Targeted release is in March.

vishwacsena · 2020-01-06T19:26:01Z

Adaptive dialogs automatically promote up adaptive card response as an intent if an intent = xxx is included in the data. See here for a code based sample

KoradaRajesh · 2020-01-07T09:26:23Z

thank you @mdrichardson and @vishwacsena

KoradaRajesh · 2020-01-07T14:44:46Z

Adaptive dialogs automatically promote up adaptive card response as an intent if an intent = xxx is included in the data. See here for a code based sample

but in composer we can not trigger this as an intent, only .lu format intents it will accept

KoradaRajesh · 2020-01-08T15:07:48Z

@mdrichardson i have tried by triggering an activity on submitting the adaptive card but it's not evaluating

mdrichardson · 2020-01-08T16:58:29Z

@KoradaRajesh I used Activity trigger with message type. I'm not sure why your error is being given, but maybe try switching turn.activity.text == null to !turn.activity.text

KoradaRajesh · 2020-01-09T05:48:24Z

@mdrichardson i have tried both but it throwing an error

Did you keep any condition here

It's triggering Unknown intent for me

mdrichardson · 2020-01-09T17:42:38Z

New Trigger
Trigger type: Activities, Activity type: Activities (Activity received), Submit
Click "Activities", leave Condition blank, type "message" for "Activity type"
- If condition, Condition: turn.activity.value && !turn.activity.text
On the True branch, Send a response: - '@{turn.activity.value}'

That takes care of the adaptive card part. The trick is getting it to trigger something else if turn.activity.value && !turn.activity.text is false. For that, I have it launch a separate dialog on the False branch (which is a simpler copy of the RespondingWithCards sample):

Here's a link to my repo of this

I wasn't able to get this to work in a non-code, Compose-only example. @vishwacsena Is this possible?

I tried adding ..."data": { "intent": "test" } to the submit action of the card, adding a regex intent for test, and then adding a trigger for the test intent. If I manually type "test", it triggers, but it doesn't seem to grab it from the card data.

KoradaRajesh · 2020-01-13T10:18:05Z

@mdrichardson it's working i'm able to get the adaptive card response in activity received trigger but for text message also it's triggering that activity i want to trigger an activity only submitting the adaptive card.
In this scenario it's failing to trigger the OnIntent because it is not going to match the user text with any recognizer and it triggering the Activity received trigger.
Instead of this we can use the unknown intent trigger there we can handle the adaptive card response else we can keep a contion in Activity Received trigger turn.activity.value != null

prasadreddybv · 2020-02-16T09:17:16Z

Hi @KoradaRajesh - Could you please let me know how you have configured the adaptive card json in the bot messages and reading the card in the Flow. I am trying to send an adaptive card but unable to load the JSON. Thanks in Advance.

prasadreddybv · 2020-02-18T04:57:35Z

@KoradaRajesh As far as I know (@vishwacsena, correct me if I'm wrong), there's no way to capture this through a prompt, since Adaptive Card input is sent through Activity.Value and not Activity.Text.

So, you need some way of capturing those. Here's what I did:

Adaptive card json:

{
    "type": "AdaptiveCard",
    "body": [
        {
            "type": "TextBlock",
            "text": "Text Input - id: textInput"
        },
        {
            "type": "Input.Text",
            "placeholder": "Enter some text",
            "id": "textInput"
        },
        {
            "type": "TextBlock",
            "text": "Number Input - id: numberInput"
        },
        {
            "type": "Input.Number",
            "placeholder": "Enter a number",
            "id": "numberInput"
        }
    ],
    "actions": [
        {
            "type": "Action.Submit",
            "title": "Submit"
        }
    ],
    "$schema": "http://adaptivecards.io/schemas/adaptive-card.json",
    "version": "1.0"
}

Then, construct a condition with turn.activity.value && !turn.activity.text and output the result with '@{turn.activity.value}':

@mdrichardson - Could you please let me know how you have added the card JSON in bot messages as i am getting the Syntax error if i add the same json in my bot. PFB the screenshot for your reference.

mdrichardson · 2020-03-17T14:36:39Z

@prasadreddybv

I believe you need to format it more like:

@adaptivecardjson()
- ```
{
    "type"...

Note how you need the line: - ```

If that doesn't work, please open a new issue. I haven't worked with Composer is awhile and since it's in Preview, things may have changed.

GowthamDisys · 2020-08-19T16:24:46Z

@KoradaRajesh I had to add it as a separate trigger. It's not ideal and it's difficult to get working in your flow, but that's the only way I was able to do it. If you want to point me to a copy of your bot, I might be able to help you implement it.

That being said, the Composer team marked this as an [Enhancement], so they'll work this into an actual feature. Targeted release is in March.

Is this issue resolved? Can you tell me, how to get the value from action.submit in adaptive card?

vishwacsena · 2020-08-24T17:26:25Z

@GowthamDisys see this sample. It shows both using adaptive card to collect input in an input action as well as to route to appropriate dialog. In short, adaptive dialog include a recognizer by default that transforms any payload posted by action.submit into intent + entities.

adaptiveCardHandling.zip

mganeshphani · 2020-09-09T18:26:33Z

@vishwacsena thats a great example.. is there an example for multiple textbox fields from adaptivecard?

vishwacsena · 2020-09-09T20:57:24Z

@mganeshphani you can just add additional inputs. Just give them all unique IDs. Then you can access them via an entity @propertyId. Here is an example ..

{
    "type": "AdaptiveCard",
    "body": [
        {
            "type": "TextBlock",
            "size": "Medium",
            "weight": "Bolder",
            "text": "Fill in the form"
        },
        {
            "type": "Input.Text",
            "placeholder": "Enter your name",
            "id": "userName"
        },
        {
            "type": "Input.Number",
            "placeholder": "Placeholder text",
            "id": "userAge"
        },
        {
            "type": "ActionSet",
            "actions": [
                {
                    "type": "Action.Submit",
                    "title": "Submit"
                }
            ]
        }
    ],
    "$schema": "http://adaptivecards.io/schemas/adaptive-card.json",
    "version": "1.2"
}

Then you can access the data returned by adaptive card submit via @userName, @userAge etc.

mganeshphani · 2020-09-09T21:20:06Z

@vishwacsena where does the reading part go into?
I am going by template and would like to know where i can map @userName, @UserAge to the properties in bot composer?

vishwacsena · 2020-09-09T23:15:45Z

If you are asking for one piece of information at a time, you can simply set the value property in the input action to =@entityName.

If you are collecting multiple pieces of information, then it's better to just use set properties action right after the input to set them to what ever memory scope you want to set it to. E.g. user.name etc.

mganeshphani · 2020-09-09T23:19:34Z

Got it.. thanks for the info. i will try.

…

On Wed, Sep 9, 2020 at 6:15 PM Vishwac Sena Kannan ***@***.***> wrote: If you are asking for one piece of information at a time, you can simply set the value property in the input action to ***@***.*** If you are collecting multiple pieces of information, then it's better to just use set properties action right after the input to set them to what ever memory scope you want to set it to. E.g. user.name etc. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1820 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFPMMIEIJQ3KEISUWTHRTJTSFAEC5ANCNFSM4KCFUCNA> .

-- Ganesh Phani Majeti.

CopenhagenJames · 2020-09-29T15:30:07Z

I'm still trying to figure out how to collect multiple inputs. The single userName works. Adding an additional field and I keep getting an object error.

CopenhagenJames · 2020-09-29T18:44:00Z

@vishwacsena thats a great example.. is there an example for multiple textbox fields from adaptivecard?

Could you provide an example gathering multiple inputs. This works but for multiple you get an error with object to string conversions.

mganeshphani · 2020-09-30T03:38:14Z

@vishwacsena thats a great example.. is there an example for multiple textbox fields from adaptivecard?

Could you provide an example gathering multiple inputs. This works but for multiple you get an error with object to string conversions.

@CopenhagenJames as simple as this(this is just a modification of adaptivecardhandling example)

CopenhagenJames · 2020-09-30T08:15:37Z

@vishwacsena thanks for the quick response greatly appreciated

HanumantPatil · 2021-04-29T09:12:32Z

I am using adaptive cards with Bot framework composer, I am facing an issue while submitting empty fields in the adaptive card.

How we can apply validation in adaptive cards with bot composer.

We ran into a problem executing your composer dialog. Can not convert Object to String.

HanumantPatil · 2021-04-29T09:13:19Z

Sorry, the bot can't talk for a while. It's something the bot's owner needs to address. Error code: 2023. Conversation ID: IT7ZlBeSrMGLRuFHaliH1X-c. Time (UTC): 4/29/2021 9:12:58 AM. Can not convert Object to String.

We ran into a problem executing your composer dialog. Can not convert Object to String.

KoradaRajesh changed the title ~~how to handle the adaptive cards response in composer~~ how to handle the adaptive card response in composer Jan 2, 2020

KoradaRajesh changed the title ~~how to handle the adaptive card response in composer~~ How to handle the adaptive card response in Composer Jan 2, 2020

CoHealer assigned mdrichardson Jan 2, 2020

vishwacsena self-assigned this Jan 2, 2020

vishwacsena transferred this issue from microsoft/botbuilder-dotnet Jan 2, 2020

vishwacsena added the Needs-triage A new issue that require triage label Jan 2, 2020

hibrenda assigned luhan2017 Jan 3, 2020

hibrenda added Type: Enhancement R8 Release 8 - March 16th, 2020 labels Jan 3, 2020

mdrichardson removed their assignment Jan 3, 2020

hibrenda removed the Needs-triage A new issue that require triage label Jan 6, 2020

vishwacsena removed their assignment Jan 6, 2020

luhan2017 assigned zidaneymar Jan 7, 2020

KoradaRajesh closed this as completed Jan 14, 2020

cwhitten mentioned this issue Feb 9, 2021

AC input Form using BFC in PVA #5664

Closed

v-kydela mentioned this issue Mar 12, 2021

Multi option select control in Composer #6199

Closed

peta mentioned this issue May 5, 2021

Bot Composer is not waiting for action to be completed in adaptive cards #7586

Closed

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How to handle the adaptive card response in Composer #1820

How to handle the adaptive card response in Composer #1820

KoradaRajesh commented Jan 2, 2020

mdrichardson commented Jan 2, 2020

KoradaRajesh commented Jan 6, 2020 •

edited

mdrichardson commented Jan 6, 2020 •

edited

vishwacsena commented Jan 6, 2020

KoradaRajesh commented Jan 7, 2020

KoradaRajesh commented Jan 7, 2020 •

edited

KoradaRajesh commented Jan 8, 2020 •

edited

mdrichardson commented Jan 8, 2020

KoradaRajesh commented Jan 9, 2020 •

edited

mdrichardson commented Jan 9, 2020 •

edited

KoradaRajesh commented Jan 13, 2020 •

edited

prasadreddybv commented Feb 16, 2020

prasadreddybv commented Feb 18, 2020

mdrichardson commented Mar 17, 2020

GowthamDisys commented Aug 19, 2020

vishwacsena commented Aug 24, 2020

mganeshphani commented Sep 9, 2020

vishwacsena commented Sep 9, 2020

mganeshphani commented Sep 9, 2020

vishwacsena commented Sep 9, 2020

mganeshphani commented Sep 9, 2020 via email

CopenhagenJames commented Sep 29, 2020

CopenhagenJames commented Sep 29, 2020

mganeshphani commented Sep 30, 2020

CopenhagenJames commented Sep 30, 2020

HanumantPatil commented Apr 29, 2021

HanumantPatil commented Apr 29, 2021

How to handle the adaptive card response in Composer #1820

How to handle the adaptive card response in Composer #1820

Comments

KoradaRajesh commented Jan 2, 2020

Github issues should be used for bugs and feature requests. Use Stack Overflow for general "how-to" questions.

Version

Describe the bug

To Reproduce

Expected behavior

Screenshots

Additional context

mdrichardson commented Jan 2, 2020

KoradaRajesh commented Jan 6, 2020 • edited

mdrichardson commented Jan 6, 2020 • edited

vishwacsena commented Jan 6, 2020

KoradaRajesh commented Jan 7, 2020

KoradaRajesh commented Jan 7, 2020 • edited

KoradaRajesh commented Jan 8, 2020 • edited

mdrichardson commented Jan 8, 2020

KoradaRajesh commented Jan 9, 2020 • edited

mdrichardson commented Jan 9, 2020 • edited

KoradaRajesh commented Jan 13, 2020 • edited

prasadreddybv commented Feb 16, 2020

prasadreddybv commented Feb 18, 2020

mdrichardson commented Mar 17, 2020

GowthamDisys commented Aug 19, 2020

vishwacsena commented Aug 24, 2020

mganeshphani commented Sep 9, 2020

vishwacsena commented Sep 9, 2020

mganeshphani commented Sep 9, 2020

vishwacsena commented Sep 9, 2020

mganeshphani commented Sep 9, 2020 via email

CopenhagenJames commented Sep 29, 2020

CopenhagenJames commented Sep 29, 2020

mganeshphani commented Sep 30, 2020

CopenhagenJames commented Sep 30, 2020

HanumantPatil commented Apr 29, 2021

HanumantPatil commented Apr 29, 2021

KoradaRajesh commented Jan 6, 2020 •

edited

mdrichardson commented Jan 6, 2020 •

edited

KoradaRajesh commented Jan 7, 2020 •

edited

KoradaRajesh commented Jan 8, 2020 •

edited

KoradaRajesh commented Jan 9, 2020 •

edited

mdrichardson commented Jan 9, 2020 •

edited

KoradaRajesh commented Jan 13, 2020 •

edited