Consider removing Microsoft.Extensions.* from additional deps

[RassK]

Bug Report

Additional deps can also affect user libs, so sometimes Microsoft.Extensions.* dependency tree is misloaded because it's partially rolled forward and partially double loaded (using dependency load context).

Method not found: 'Microsoft.Extensions.Logging.ILoggingBuilder Microsoft.Extensions.Logging.LoggingBuilderExtensions.AddConfiguration(Microsoft.Extensions.Logging.ILoggingBuilder, Microsoft.Extensions.Configuration.IConfiguration)'.

Setup

ASP.NET Core app with .NET 8 framework.

(EntityFramework just takes loads of Micrososft.Extensions.* deps, so issues pop up easily)
Microsoft.EntityFrameworkCore v8.0.14
Microsoft.EntityFrameworkCore.Design v8.0.14
Microsoft.EntityFrameworkCore.Sqlite v8.0.14

OpenTelemetry .NET AutoInstrumentation: latest main

Workaround

Seems if we remove Microsoft.Extensions.* from additional deps and instead let loader to load all of those to dependency load context, the application is able to work and function normally and produce traces

Drawback

OpenTelemetry.AutoInstrumentation.AspNetCoreBootstrapper fails to load, so no logs. Don't know a fix yet for that.

System.InvalidOperationException: Startup assembly OpenTelemetry.AutoInstrumentation.AspNetCoreBootstrapper failed to execute. See the inner exception for more details.
---> System.MissingMethodException: Method not found: 'Microsoft.AspNetCore.Hosting.IWebHostBuilder Microsoft.AspNetCore.Hosting.WebHostBuilderExtensions.ConfigureLogging(Microsoft.AspNetCore.Hosting.IWebHostBuilder, System.Action`1<Microsoft.Extensions.Logging.ILoggingBuilder>)'.
at OpenTelemetry.AutoInstrumentation.AspNetCoreBootstrapper.BootstrapperHostingStartup.Configure(IWebHostBuilder builder)
at Microsoft.AspNetCore.Hosting.GenericWebHostBuilder.ExecuteHostingStartups()
--- End of inner exception stack trace ---

[RassK]

Adding some details here:

1. Additional deps were used to bump framework deps to required version. (additional deps doesn't have enough priority to bump anything else like user's referenced higher version of deps).
2. Fix made by @rajkumar-rangaraj moved Microsoft.Extensions.* loading from default ALC to dependencies ALC.
3. Fix opened a new bug which is described above. Resolve file loading issues originating from Runtime store libraries #3343

In addition Microsoft.Extensions.Logging cannot be moved to the dependencies ALC, since it contains state and state is coming from default ALC.

[RassK]

I think the source of the issue is here:

https://www.nuget.org/packages/OpenTelemetry#dependencies-body-tab

.NET 9 works, .NET 8 does not work due net8.0 SDK references packages 9.0.0 while some net8.0 packages cannot be bumped by additional deps. Even if NET 8 SDK would work, we have only NET 9 target.

[RassK]

related open-telemetry/opentelemetry-dotnet#5973

[RassK]

SIG: may consider losing some performance for more solid setup.
There is some possibility to easily pass metrics and logs from one context to another which reduces assembly version conflicts.

implementation ref: RassK#1282