Any attempt to use AWSSDK.Extensions.Bedrock.MEAI 4.0.3 results in type load failures

[stephentoub]

Describe the bug

Trying to use AWSSDK.Extensions.Bedrock.MEAI 4.0.3 fails with exceptions like:

Unhandled exception. System.TypeLoadException: Could not load type 'Amazon.BedrockRuntime.Model.CitationsDelta' from assembly 'AWSSDK.BedrockRuntime, Version=4.0.0.0, Culture=neutral, PublicKeyToken=885c28607f98e604'.
   at Amazon.BedrockRuntime.BedrockChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext()
   at Amazon.BedrockRuntime.BedrockChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at Amazon.BedrockRuntime.BedrockChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.IAsyncDisposable.DisposeAsync()

4.0.2 works fine.

Regression Issue

• Select this option if this issue appears to be a regression.

Expected Behavior

Applications using the library should be able to run.

Current Behavior

Applications crash with a type load exception.

Reproduction Steps

1. Add a reference to AWSSDK.Extensions.Bedrock.MEAI v4.0.3.
2. Try to run code like this:

using Amazon.BedrockRuntime;
using Microsoft.Extensions.AI;

IChatClient chatClient = new AmazonBedrockRuntimeClient(
    Environment.GetEnvironmentVariable("AI:Bedrock:AccessKey"!),
    Environment.GetEnvironmentVariable("AI:Bedrock:SecretAccessKey")!,
    Amazon.RegionEndpoint.USEast1).AsIChatClient("anthropic.claude-3-sonnet-20240229-v1:0");

await foreach (var update in chatClient.GetStreamingResponseAsync("Hello"))
{
    Console.Write(update);
}

Possible Solution

No response

Additional Information/Context

No response

AWS .NET SDK and/or Package version used

AWSSDK.Extensions.Bedrock.MEAI 4.0.3

Targeted .NET Platform

.NET 9

Operating System and version

Windows 11

[normj]

I think what happened is in your previous commit 1b22dba you updated in the nuspec the version of AWSSDK.BedRuntime to 4.0.0.6 but it should have been 4.0.6.0. The CitationsDelta type was added in 4.0.1.0.

You should temporary work around this by explicitly adding a newer version of AWSSDK.BedrockRuntime to your project. Then we need to get a PR out updating the nuspec for AWSSDK.Extensions.Bedrock.MEAI to use the latest version of AWSSDK.BedrockRuntime.

[normj]

Do you want to update your new PR #4015 with that nuspec change? Unlike previous asks don't update the version in the extensions nuspec file. We are just about to deploy some new automation to handle extension versioning.

[stephentoub]

I think what happened is in your previous commit 1b22dba you updated in the nuspec the version of AWSSDK.BedRuntime to 4.0.0.6 but it should have been 4.0.6.0. The CitationsDelta type was added in 4.0.1.0.

You should temporary work around this by explicitly adding a newer version of AWSSDK.BedrockRuntime to your project. Then we need to get a PR out updating the nuspec for AWSSDK.Extensions.Bedrock.MEAI to use the latest version of AWSSDK.BedrockRuntime.

OK, thanks, that was actually from @peterrsongg in cd645c2 (I appreciate the contribution to the PR, regardless)

[stephentoub]

Do you want to update your new PR #4015 with that nuspec change? Unlike previous asks don't update the version in the extensions nuspec file. We are just about to deploy some new automation to handle extension versioning.

Will do

[stephentoub]

Updated #4015 with the newest versions of those dependencies on nuget.

[normj]

OK, thanks, that was actually from @peterrsongg in cd645c2 (I appreciate the contribution to the PR, regardless)

Apologize didn't mean to sound accusatory 😄, thanks for updating the PR.

[normj]

Version 4.0.3.1 is out with your PR that has the fix. Thanks gain for the fix.

[github-actions]

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.

[stephentoub]

thanks!

[peterrsongg]

@stephentoub just saw this, srry for pushing that bad commit😅I was trying to update the packages to the latest versions and must've mistyped

[stephentoub]

No worries, thanks for trying!