Proactive messages (adapter.CreateConversationAsync) are not stored in ITurnState

[hansmbakker]

Version

What package version of the SDK are you using.

• Nuget package version: 1.1.107-beta

Describe the bug

Proactive messages sent using adapter.CreateConversationAsync are not stored in ITurnState and are not logged using FileTranscriptLogger.
This is a problem when creating an AI agent that sends the outcome of a document analysis to a new conversation, where the user expects to be able to ask followup-questions about said outcome. Without that context, the bot will just ask the user to repeat what the bot just sent before.

To Reproduce
How can we reproduce this error?

1. Create an agent, e.g. from the weather agent sample.
2. Setup BlobsStorage for the state (I used Azurite for this)
3. Setup transcript logging using builder.Services.AddSingleton<Microsoft.Agents.Builder.IMiddleware[]>([new TranscriptLoggerMiddleware(new FileTranscriptLogger())]);
4. Set a breakpoint in the MessageActivityAsync method of your AgentApplication and prepare to inspect the chat history from ITurnState - see this line

   ChatHistory chatHistory = turnState.GetValue("conversation.chatHistory", () => new ChatHistory());

5. Let it send a proactive message in a team channel or in a 1:1 conversation. Make sure to send 2 activities:
   • one via the ConversationParameters.Activity parameter
   • one via the CreateConversationAsync callback parameter
6. From a user perspective, send a message in the same conversation.
7. When the breakpoint hits, inspect the chat history and the ITurnState object.

   ⚠️The proactive message is not available there - neither the ConversationParameters.Activity parameter nor the CreateConversationAsync callback parameter

8. Let the debugger continue
9. Inspect the file written by the FileTranscriptLogger. The proactive message is missing from the conversation.lease provide Code Snippets, Channel type, and any special configuration we will need to reproduce this problem.I used this code for the team channel conversation:

var adapter = this.Options.Adapter;

var agentAppId = "10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb";
var tenantId = "<redacted>";

var agentId = "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb";

// Find this using  Get-TeamChannel in PowerShell or Graph API
var channelId = "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2"; // Channel ID where the agent is registered

var message = Activity.CreateMessageActivity();
message.Text = "New project document received";

var conversationParameters = new ConversationParameters(
    isGroup: true,
    agent: new ChannelAccount(id: agentId),  // ID of your agent registered in teams. 
    tenantId: tenantId,
    channelData: new TeamsChannelData
    {
        Channel = new ChannelInfo(channelId),
    },
    topicName: "Test thread",
    activity: (Activity)message
);

try
{
    await adapter.CreateConversationAsync(
                  agentAppId,  // ID of the agent your sending too. 
                  "msteams", // ChannelID 
                  "https://smba.trafficmanager.net/emea/", // TeamsProactiveServiceEndpoints.publicGlobal, // Endpoint for the global teams service. 
                  "https://api.botframework.com/.default", // Scope for creating an access token for Teams 
                  conversationParameters,  // ConversationParameters Created above. 
                  callback,
                  default);
}
catch (Exception ex)
{
    Console.WriteLine(ex);
}

Expected behavior
Messages sent using the CreateConversationAsync method become available in followup turns via ITurnState / chat history.
This is expected for both

• the activity added to the ConversationParameters.Activity parameter
• the activity sent via the CreateConversationAsync callback parameter

Screenshots
If applicable, add screenshots to help explain your problem.

Hosting Information (please complete the following information):

• How are you Hosting this: [e.g. Azure, Desktop, Other] Desktop (local via .NET Aspire (C# Projects and Docker)
• Are you deploying: no, only local via .NET Aspire (C# Projects and Docker
• Are you using Azure Bot Services: yes
• What Client are you using: Teams
• What .net version is your build in: .net 9.0 / .net 10

Additional context
Add any other context about the problem here.

[hansmbakker]

The FileTranscriptLogger created the following transcript (redacted for privacy) for a conversation in a Teams channel, started by a proactive message.

The conversation id of one channel conversation ("thread") is the same across the whole thread

activities	shown in Teams?	logged using FileTranscriptLogger?	populated in ITurnState?
activity added in the ConversationParameters object (it was a plain text message saying "new project document received")	✔️	❌ (but CreateConversation event is logged)	❌
activity sent from the adapter.CreateConversationAsync callback parameter (in my case it was the adaptive card containing the facts about the parsed project document)	✔️	✔️	❌
following messages (starting from my question about the project duration)	✔️	✔️	✔️

[
    {
        "type": "event",
        "id": "1748984465538",
        "timestamp": "2025-06-03T21:01:05.1991978\u002B00:00",
        "serviceUrl": "https://smba.trafficmanager.net/emea/",
        "channelId": "msteams",
        "from": {
            "role": "user"
        },
        "conversation": {
            "tenantId": "<redacted for privacy>",
            "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2;messageid=1748984465538"
        },
        "recipient": {
            "id": "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb"
        },
        "membersAdded": [],
        "membersRemoved": [],
        "reactionsAdded": [],
        "reactionsRemoved": [],
        "attachments": [],
        "entities": [],
        "channelData": {
            "channel": {
                "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2"
            }
        },
        "name": "CreateConversation",
        "listenFor": [],
        "textHighlights": []
    },
    {
        "type": "message",
        "id": "1748984487145",
        "timestamp": "2025-06-03T21:01:26.6343142\u002B00:00",
        "serviceUrl": "https://smba.trafficmanager.net/emea/",
        "channelId": "msteams",
        "from": {
            "id": "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb"
        },
        "conversation": {
            "tenantId": "<redacted for privacy>",
            "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2;messageid=1748984465538"
        },
        "recipient": {
            "role": "user"
        },
        "membersAdded": [],
        "membersRemoved": [],
        "reactionsAdded": [],
        "reactionsRemoved": [],
        "attachments": [
            {
                "contentType": "application/vnd.microsoft.card.adaptive",
                "content": {
                    "type": "AdaptiveCard",
                    "version": "1.5",
                    "body": [<REDACTED CONTENT FOR PRIVACY - THIS IS AN ADAPTIVE CARD SHOWING FACTS ABOUT A PARSED DOCUMENT DESCRIBING A PROJECT>],
                }
            }
        ],
        "entities": [],
        "replyToId": "1748984465538",
        "listenFor": [],
        "textHighlights": []
    },
    {
        "type": "message",
        "id": "1748984522397",
        "timestamp": "2025-06-03T21:02:02.4816356\u002B00:00",
        "localTimestamp": "2025-06-03T23:02:02.4816356\u002B02:00",
        "localTimezone": "Europe/Amsterdam",
        "serviceUrl": "https://smba.trafficmanager.net/emea/<redacted for privacy>/",
        "channelId": "msteams",
        "from": {
            "id": "29:1y-Hydq9Oa2gPr6yl5uFOsC7tsJVTu_nAdVL4GnhFXjgT9WF7Ul_LeQ-P_synaW4_6rpsCuYYCyAbO8l7NLU3Eg",
            "name": "Person X",
            "aadObjectId": "ddefe175-d966-4053-b29f-8b43b47e536e",
            "role": "user"
        },
        "conversation": {
            "isGroup": true,
            "conversationType": "channel",
            "tenantId": "<redacted for privacy>",
            "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2;messageid=1748984465538"
        },
        "recipient": {
            "id": "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb",
            "name": "My Agent"
        },
        "textFormat": "plain",
        "membersAdded": [],
        "membersRemoved": [],
        "reactionsAdded": [],
        "reactionsRemoved": [],
        "locale": "nl-NL",
        "text": "how long will the project last?",
        "attachments": [
            {
                "contentType": "text/html",
                "content": "\u003Cp\u003Ehow long will the project last?\u003C/p\u003E"
            }
        ],
        "entities": [
            {
                "type": "clientInfo",
                "locale": "nl-NL",
                "country": "NL",
                "platform": "Windows",
                "timezone": "Europe/Amsterdam"
            }
        ],
        "channelData": {
            "teamsChannelId": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2",
            "teamsTeamId": "19:e8enfS0iVkFW4TUPH0VQGF9UsoZxZb_XLn_vib7NkTo1@thread.tacv2",
            "channel": {
                "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2"
            },
            "team": {
                "id": "19:e8enfS0iVkFW4TUPH0VQGF9UsoZxZb_XLn_vib7NkTo1@thread.tacv2"
            },
            "tenant": {
                "id": "<redacted for privacy>"
            }
        },
        "listenFor": [],
        "textHighlights": []
    },
    {
        "type": "typing",
        "id": "g_ed7b691e-d029-4fc0-bc33-ca3f471d2c7c",
        "timestamp": "2025-06-03T21:02:03.9463908\u002B00:00",
        "serviceUrl": "https://smba.trafficmanager.net/emea/<redacted for privacy>/",
        "channelId": "msteams",
        "from": {
            "id": "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb",
            "name": "My Agent"
        },
        "conversation": {
            "isGroup": true,
            "conversationType": "channel",
            "tenantId": "<redacted for privacy>",
            "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2;messageid=1748984465538"
        },
        "recipient": {
            "id": "29:1y-Hydq9Oa2gPr6yl5uFOsC7tsJVTu_nAdVL4GnhFXjgT9WF7Ul_LeQ-P_synaW4_6rpsCuYYCyAbO8l7NLU3Eg",
            "name": "Person X",
            "aadObjectId": "ddefe175-d966-4053-b29f-8b43b47e536e",
            "role": "user"
        },
        "membersAdded": [],
        "membersRemoved": [],
        "reactionsAdded": [],
        "reactionsRemoved": [],
        "locale": "nl-NL",
        "text": "TYPING",
        "attachments": [],
        "entities": [],
        "replyToId": "1748984522397",
        "listenFor": [],
        "textHighlights": []
    },
    {
        "type": "typing",
        "id": "g_6633b834-345f-4652-a335-0dfdd813dbab",
        "timestamp": "2025-06-03T21:02:17.810749\u002B00:00",
        "serviceUrl": "https://smba.trafficmanager.net/emea/<redacted for privacy>/",
        "channelId": "msteams",
        "from": {
            "id": "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb",
            "name": "My Agent"
        },
        "conversation": {
            "isGroup": true,
            "conversationType": "channel",
            "tenantId": "<redacted for privacy>",
            "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2;messageid=1748984465538"
        },
        "recipient": {
            "id": "29:1y-Hydq9Oa2gPr6yl5uFOsC7tsJVTu_nAdVL4GnhFXjgT9WF7Ul_LeQ-P_synaW4_6rpsCuYYCyAbO8l7NLU3Eg",
            "name": "Person X",
            "aadObjectId": "ddefe175-d966-4053-b29f-8b43b47e536e",
            "role": "user"
        },
        "membersAdded": [],
        "membersRemoved": [],
        "reactionsAdded": [],
        "reactionsRemoved": [],
        "locale": "nl-NL",
        "text": "TYPING",
        "attachments": [],
        "entities": [],
        "replyToId": "1748984522397",
        "listenFor": [],
        "textHighlights": []
    },
    {
        "type": "message",
        "id": "1748984538821",
        "timestamp": "2025-06-03T21:02:18.3228945\u002B00:00",
        "serviceUrl": "https://smba.trafficmanager.net/emea/<redacted for privacy>/",
        "channelId": "msteams",
        "from": {
            "id": "28:10deff5c-1eb5-48ff-a1aa-7378cd8cb4eb",
            "name": "My Agent"
        },
        "conversation": {
            "isGroup": true,
            "conversationType": "channel",
            "tenantId": "<redacted for privacy>",
            "id": "19:2880e0719d0541f5bef37bd1fd151fa2@thread.tacv2;messageid=1748984465538"
        },
        "recipient": {
            "id": "29:1y-Hydq9Oa2gPr6yl5uFOsC7tsJVTu_nAdVL4GnhFXjgT9WF7Ul_LeQ-P_synaW4_6rpsCuYYCyAbO8l7NLU3Eg",
            "name": "Person X",
            "aadObjectId": "ddefe175-d966-4053-b29f-8b43b47e536e",
            "role": "user"
        },
        "membersAdded": [],
        "membersRemoved": [],
        "reactionsAdded": [],
        "reactionsRemoved": [],
        "locale": "nl-NL",
        "text": "Please provide the content of <REDACTED DOCUMENT TYPE> so I can help determine the duration of the project.",
        "inputHint": "acceptingInput",
        "attachments": [],
        "entities": [],
        "replyToId": "1748984522397",
        "listenFor": [],
        "textHighlights": []
    }
]

[tracyboehrer]

The Activity in ConversationParameters is used as the ConversationUpdate Activity and is not logged. This is part of the ConversationParamaters and does not appear to be logged. However, the first entry is the "CreateConversation" event as a result of that. Some discussion on our side needs to happen about what function ConversationParameters serves as it's not used during CreateConversation. It does appear to be passed to the channel service in the CreateConversation Rest call.

I'll setup a test for the send withing the CreateConversation callback. Did you just use TurnContext.SendActivity for that?

[hansmbakker]

I'll setup a test for the send withing the CreateConversation callback.

That's great, thank you!

Did you just use TurnContext.SendActivity for that?

Yes, my callback looks like this (slightly cleaned up). MyAgent is implented using Semantic Kernel, similar to the weather agent sample.

ℹ️ Note that here I do just ChatHistory chatHistory = new ChatHistory(); because the AgentCallbackHandler delegate has no ITurnState where I can get the chatHistory from.

async (ITurnContext turnContext, CancellationToken cancellationToken) =>
{
    ServiceCollection serviceCollection = [
        new ServiceDescriptor(typeof(Kernel), _kernel),
        new ServiceDescriptor(typeof(ITurnContext), turnContext),
    ];

    ChatHistory chatHistory = new ChatHistory();
    var myAgent = new MyAgent(_kernel, serviceCollection.BuildServiceProvider());

    // Invoke the MyAgent to process the message
    var agentRequest = """
    Help me analyse this project document. Respond with an adaptive card containing three sections.
    One section about the client company, one section about the project and one section about the people working on it.
    """;
    AgentResponse agentResponse = await myAgent.InvokeAgentAsync(agentRequest, attachments, chatHistory);

    var proactiveMessage = Activity.CreateMessageActivity();
    var adaptiveCardAttachment = new Attachment
    {
        ContentType = "application/vnd.microsoft.card.adaptive",
        Content = agentResponse.Content
    };
    proactiveMessage.Attachments = [adaptiveCardAttachment];
    await turnContext.SendActivityAsync(proactiveMessage, cancellationToken);
}

[hansmbakker]

Maybe it is possible to create a workaround inside the callback with something like this:

var state = Options.TurnStateFactory();
await state.LoadStateAsync(turnContext);

var chatHistoryToSave = new ChatHistory();
chatHistoryToSave.AddAssistantMessage(agentResponse.Content);
state.SetValue("conversation.chatHistory", chatHistoryToSave);
await state.SaveStateAsync(turnContext);

However, I got an exception on it (something like "the activity is missing from-id") and stopped trying as I wasn't sure this was the right way to go.

[tracyboehrer]

Maybe it is possible to create a workaround inside the callback with something like this:

var state = Options.TurnStateFactory();
await state.LoadStateAsync(turnContext);

var chatHistoryToSave = new ChatHistory();
chatHistoryToSave.AddAssistantMessage(agentResponse.Content);
state.SetValue("conversation.chatHistory", chatHistoryToSave);
await state.SaveStateAsync(turnContext);
However, I got an exception on it (something like "the activity is missing from-id") and stopped trying as I wasn't sure this was the right way to go.

OK. Not sure why it's not logging to TranscriptStore. But there is a bigger problem. Which I think you just realized.

This callback is doing what ActivityHandler-based bots would have done. However, state handling is performed by AgentApplication. This is a bug on our part and overlooked during the switch to AgentApplication.

What this is forcing you to do is reconstruct what would have happened if the Activity had been received normally (via /api/messages). Not a trivial matter because the normal incoming route will handle all the DI related construction (which you had to mockup), and some behavior handled in AgentApplication.OnTurnAsync.

What a mess. Apologies.

You can get that manual handling of TurnState working by populating turnContext.Activity.From.Id. This is a super complicated way to do this, and not what we'd expect people to figure out.

A better handling would be to pump the CreateConversation event (which is the turnContext.Activiy in the callback) back through the full pipeline.

Something like:

Callback:

async (ITurnContext turnContext, CancellationToken cancellationToken) =>
{
    await Options.Adapter.ProcessProactiveAsync(turnContext.Identity, turnContext.Activity, this, cancellationToken);
}

You will need to add a Route in your MyAgent:

MyAgent:

public MyAgent(...)   // constructor
{
    OnEvent("CreateConversation", async (turnContext, turnState, cancellationToken) =>
    {
          // your existing logic for create conversation
    });
}

[tracyboehrer]

You could also probably specify this.OnTurnAsync as the callback argument. You'd still need the OnEvent added.

[hansmbakker]

Thank you for looking into this!

Mm, I don't immediately see how to use the process input I had (e.g. incoming webhook or the result of the processing of the incoming webhook) in the delegate that is passed to that OnEvent method.

I called the adapter.CreateConversationAsync just after the processing of the webhook finished, so there I could create a delegate that contained the result of that processing.

If there is a fixed method to be called from OnEvent, I'm not sure how to do it in an elegant way.