Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to load data access module, 0x80131c4f You can run the debugger command 'setclrpath' to control the load of libmscordaccore.so. #414

Closed
dingsongjie opened this issue Aug 2, 2019 · 10 comments
Closed

Failed to load data access module, 0x80131c4f You can run the debugger command 'setclrpath' to control the load of libmscordaccore.so. #414

dingsongjie opened this issue Aug 2, 2019 · 10 comments
Assignees
@mikem8361
Milestone
3.0.0

Comments

@dingsongjie
Copy link

1 Load core dump
dotnet-dump analyze ./core.29010

2 run command
clrstack

3 Errors

Failed to load data access module, 0x80131c4f
You can run the debugger command 'setclrpath' to control the load of libmscordaccore.so.
If that succeeds, the SOS command should work on retry.
SOS command FAILED 0x80131C4F
@mikem8361 mikem8361 self-assigned this Aug 2, 2019
@mikem8361 mikem8361 modified the milestones: 3.next, 3.0 Aug 2, 2019
@mikem8361
Copy link
Member

Can you attach the core dump file? What version of .NET Core is this dump from?

@dingsongjie
Copy link
Author

Can you attach the core dump file? What version of .NET Core is this dump from?

from 2.2.1

@mikem8361
Copy link
Member

Can you attach the core dump?

This error message means it can find the DAC (libmscordaccore.so) in the runtime directory (the directory where libcoreclr.so) or it can't download it from the symbol server. Was the core dump generated on the same machine as the one loading it?

@dingsongjie
Copy link
Author

dingsongjie commented Aug 5, 2019 •
edited
Loading

Thank you for help , I run aspnet core in docker swarm , --cap-add=SYS_PTRACE and --privileged arguments are ignored，I can't generate dump fire in docker container . so I generated the core dump on docker host by using gcore pid , the docker host of operating system is centos7 , and docker image base on debain . I think maybe it won't work ,I am just trying to use this way to analyze the memory of my applicaiton . Can you give me some suggestion to analyze memory in docker swarm?

@dingsongjie
Copy link
Author

I have test this application on kubernetes and set --cap-add=SYS_PTRACE .
After I install gdb ,I run gcore 1, there are some warnings

[New LWP 8]
[New LWP 9]
[New LWP 12]
[New LWP 13]
[New LWP 14]
[New LWP 15]
[New LWP 16]
[New LWP 17]
[New LWP 21]
[New LWP 23]
[New LWP 24]
[New LWP 34]
[New LWP 35]
[New LWP 37]
[New LWP 38]
[New LWP 40]
[New LWP 41]
[New LWP 1834]
[New LWP 1835]
[New LWP 1836]
[New LWP 1837]
[New LWP 1838]
[New LWP 1839]
[New LWP 1840]
[New LWP 1841]
[New LWP 3344]
[New LWP 3358]
[New LWP 3360]
[New LWP 3369]
[New LWP 3372]
[New LWP 3432]
warning: Could not load vsyscall page because no executable was specified
0x00007fcc143a917f in ?? ()
warning: target file /proc/1/cmdline contained unexpected null characters
Saved corefile core.1

I run with command dotnet-dump analyze core.1 ,there is no error

I run with command modules

0000000000400000 0021A000 /usr/share/dotnet/dotnet.dpkg-new (deleted)
00007FCB711DF000 00002000 /lib/x86_64-linux-gnu/libz.so.1.2.8
00007FCB7149B000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.IO.Compression.Native.so
00007FCB71C7B000 0001D000 /app/runtimes/linux/native/libgrpc_csharp_ext.x64.so
00007FCB72F7B000 00002000 /lib/x86_64-linux-gnu/libresolv-2.24.so
00007FCB73183000 00002000 /lib/x86_64-linux-gnu/libnss_dns-2.24.so
00007FCB7338F000 00002000 /lib/x86_64-linux-gnu/libnss_files-2.24.so
00007FCB73FCF000 0002B000 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.2
00007FCB9839D000 0000A000 /usr/lib/x86_64-linux-gnu/libssl.so.1.0.2
00007FCB985C4000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Cryptography.Native.OpenSsl.so
00007FCB98F20000 00B2E000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Private.CoreLib.dll
00007FCB99B40000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.dll
00007FCB99B80000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Console.dll
00007FCB99C00000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/netstandard.dll
00007FCB99C50000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Hosting.Abstractions.dll
00007FCB99C90000 00003000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Hosting.dll
00007FCB99D20000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Threading.dll
00007FCB99D70000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.dll
00007FCB99DB0000 00008000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Server.Kestrel.Core.dll
00007FCB99F20000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Server.Kestrel.Transport.Abstractions.dll
00007FCB99F70000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Server.Kestrel.dll
00007FCB99FB0000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.IO.FileSystem.dll
00007FCB9A030000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Extensions.dll
00007FCB9A0C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.Abstractions.dll
00007FCB9A100000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Logging.dll
00007FCB9A140000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Server.IISIntegration.dll
00007FCB9A180000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.DependencyInjection.Abstractions.dll
00007FCB9A1D0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Hosting.Abstractions.dll
00007FCB9A220000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.FileProviders.Abstractions.dll
00007FCB9A260000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Collections.dll
00007FCB9A2E0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.dll
00007FCB9A320000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.EnvironmentVariables.dll
00007FCB9A360000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Primitives.dll
00007FCB9A3A0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Threading.Tasks.dll
00007FCB9A3F0000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Linq.dll
00007FCB9A4B0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.CommandLine.dll
00007FCB9A510000 00004000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Server.IIS.dll
00007FCB9A5B0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.InteropServices.RuntimeInformation.dll
00007FCB9A5F0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.InteropServices.dll
00007FCB9A630000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.DependencyInjection.dll
00007FCB9A680000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.ComponentModel.dll
00007FCB9A6C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Logging.Abstractions.dll
00007FCB9A710000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Http.Features.dll
00007FCB9A770000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.DiagnosticSource.dll
00007FCB9A7B0000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Http.Abstractions.dll
00007FCB9A810000 00003000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Http.dll
00007FCB9A870000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.ObjectPool.dll
00007FCB9A8B0000 0000D000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.Core.dll
00007FCB9AA90000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Razor.Runtime.dll
00007FCB9AAD0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.FileProviders.Physical.dll
00007FCB9AB10000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.FileExtensions.dll
00007FCB9AB50000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.Json.dll
00007FCB9ABA0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.IO.FileSystem.Watcher.dll
00007FCB9ABF0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.ComponentModel.Primitives.dll
00007FCB9AC40000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Collections.Concurrent.dll
00007FCB9ACB0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.FileSystemGlobbing.dll
00007FCB9AD00000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Threading.Timer.dll
00007FCB9AD40000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.Tracing.dll
00007FCB9AD90000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Memory.dll
00007FCB9AE00000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Buffers.dll
00007FCB9AE70000 00009000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Linq.Expressions.dll
00007FCB9B050000 00005000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.ComponentModel.TypeConverter.dll
00007FCB9B130000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.ObjectModel.dll
00007FCB9B190000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Numerics.dll
00007FCB9B200000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Private.Uri.dll
00007FCB9B270000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Options.dll
00007FCB9B2C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.dll
00007FCB9B310000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Hosting.Server.Abstractions.dll
00007FCB9B350000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Logging.Configuration.dll
00007FCB9B390000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Options.ConfigurationExtensions.dll
00007FCB9B3D0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Logging.Console.dll
00007FCB9B430000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Logging.Debug.dll
00007FCB9B470000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Logging.EventSource.dll
00007FCB9B4B0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.HostFiltering.dll
00007FCB9B500000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.dll
00007FCB9B540000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Collections.NonGeneric.dll
00007FCB9B590000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Serialization.Formatters.dll
00007FCB9B620000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Serialization.Primitives.dll
00007FCB9B670000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Xml.ReaderWriter.dll
00007FCB9B6B0000 00024000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Private.Xml.dll
00007FCB9BF40000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Xml.XmlDocument.dll
00007FCB9BF80000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Cryptography.Algorithms.dll
00007FCB9C030000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Threading.Thread.dll
00007FCB9C070000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Text.Encoding.Extensions.dll
00007FCB9C0B0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Xml.XDocument.dll
00007FCB9C0F0000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Private.Xml.Linq.dll
00007FCB9C190000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Xml.XPath.XDocument.dll
00007FCB9C200000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Globalization.dll
00007FCB9C240000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.IO.dll
00007FCB9C2C0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.dll
00007FCB9C310000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Text.RegularExpressions.dll
00007FCB9C3B0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.Emit.ILGeneration.dll
00007FCB9C3F0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.Emit.Lightweight.dll
00007FCB9C430000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.Primitives.dll
00007FCB9C490000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.TypeExtensions.dll
00007FCB9C4D0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Text.Encoding.dll
00007FCB9C510000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.Primitives.dll
00007FCB9C580000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.Extensions.dll
00007FCB9C5C0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Core.dll
00007FCB9C600000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.ServicePoint.dll
00007FCB9C640000 00004000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.Security.dll
00007FCB9C790000 00003000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.Requests.dll
00007FCB9C820000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Principal.dll
00007FCB9C860000 00004000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Cryptography.X509Certificates.dll
00007FCB9C920000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.WebHeaderCollection.dll
00007FCB9C960000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Collections.Specialized.dll
00007FCB9C9B0000 00009000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.Http.dll
00007FCB9CB20000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Threading.ThreadPool.dll
00007FCB9CC00000 00004000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.Sockets.dll
00007FCB9CCE0000 0000D000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Data.Common.dll
00007FCB9CFF0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/Microsoft.Win32.Primitives.dll
00007FCB9D030000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.NameResolution.dll
00007FCB9D0B0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authorization.dll
00007FCB9D0F0000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/System.Text.Encoding.CodePages.dll
00007FCB9D200000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.dll
00007FCB9D250000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authentication.dll
00007FCB9D2A0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authentication.Abstractions.dll
00007FCB9D2E0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.IdentityModel.Logging.dll
00007FCB9D350000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Caching.Memory.dll
00007FCB9D390000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Configuration.Binder.dll
00007FCB9D3E0000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.NetworkInformation.dll
00007FCB9D4A0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Drawing.Primitives.dll
00007FCB9D520000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.TraceSource.dll
00007FCB9D650000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.IO.Compression.dll
00007FCB9D6D0000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.DependencyModel.dll
00007FCB9D740000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.AppContext.dll
00007FCB9D780000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.IO.FileSystem.Primitives.dll
00007FCB9D810000 00004000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.Razor.dll
00007FCB9D8C0000 00005000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Identity.UI.Views.V3.dll
00007FCB9D9D0000 00005000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.RazorPages.dll
00007FCB9DA70000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Resources.ResourceManager.dll
00007FCB9DAB0000 00005000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Identity.UI.Views.V4.dll
00007FCB9DBC0000 00005000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Identity.UI.dll
00007FCB9E2C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.SpaServices.dll
00007FCB9E310000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.SpaServices.Extensions.dll
00007FCB9E380000 00005000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Routing.dll
00007FCB9E440000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Routing.Abstractions.dll
00007FCB9E490000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.Abstractions.dll
00007FCB9E510000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.ApiExplorer.dll
00007FCB9E550000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authentication.Core.dll
00007FCB9E590000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Claims.dll
00007FCB9E5E0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authorization.Policy.dll
00007FCB9E620000 00003000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.TagHelpers.dll
00007FCB9E690000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Razor.dll
00007FCB9E6D0000 00006000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.ViewFeatures.dll
00007FCB9E7C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.DataAnnotations.dll
00007FCB9E820000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.Formatters.Json.dll
00007FCB9E870000 00004000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.DataProtection.dll
00007FCB9E910000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.DataProtection.Abstractions.dll
00007FCB9E950000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Cryptography.Internal.dll
00007FCB9E990000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Antiforgery.dll
00007FCB9E9E0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.WebEncoders.dll
00007FCB9EA20000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/System.Text.Encodings.Web.dll
00007FCB9EA80000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.CodeAnalysis.Razor.dll
00007FCB9EAD0000 00008000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Razor.Language.dll
00007FCB9EC40000 00026000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.CodeAnalysis.dll
00007FCB9F1C0000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.Razor.Extensions.dll
00007FCB9F230000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Caching.Abstractions.dll
00007FCB9F280000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Mvc.Cors.dll
00007FCB9F2C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Cors.dll
00007FCB9F320000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.Emit.dll
00007FCB9F380000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authentication.JwtBearer.dll
00007FCB9F3D0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.ResponseCompression.dll
00007FCB9F410000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Http.dll
00007FCB9F470000 00005000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/Microsoft.CSharp.dll
00007FCB9F630000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.Debug.dll
00007FCB9F670000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Transactions.Local.dll
00007FCB9F7C0000 00011000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.EntityFrameworkCore.Relational.dll
00007FCB9FA50000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.Localization.Abstractions.dll
00007FCB9FAD0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Connections.Abstractions.dll
00007FCB9FB10000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/System.IO.Pipelines.dll
00007FCB9FB80000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/Microsoft.Win32.Registry.dll
00007FCB9FBE0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Cryptography.Primitives.dll
00007FCB9FC50000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.Tools.dll
00007FCB9FCB0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Security.Principal.Windows.dll
00007FCB9FD30000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Serialization.Json.dll
00007FCB9FD70000 0000B000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Private.DataContractSerialization.dll
00007FCB9FFC0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Extensions.DiagnosticAdapter.dll
00007FCBA0030000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.StaticFiles.dll
00007FCBA0080000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Diagnostics.dll
00007FCBA0120000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Localization.dll
00007FCBA0270000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Net.Ping.dll
00007FCBA0300000 00005000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Remotion.Linq.dll
00007FCBA03C0000 00006000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Collections.Immutable.dll
00007FCBA06E0000 0000A000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/System.Interactive.Async.dll
00007FCBA1AE0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Numerics.dll
00007FCBA1B40000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Serialization.dll
00007FCBA1B90000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Data.dll
00007FCBA1BD0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/System.Security.Permissions.dll
00007FCBA22B0000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Linq.Queryable.dll
00007FCBA36C0000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.JsonPatch.dll
00007FCBA3710000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.Net.Http.Headers.dll
00007FCBA3820000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Html.Abstractions.dll
00007FCBA3860000 00002000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Authentication.Cookies.dll
00007FCBA3900000 0003E000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.CodeAnalysis.CSharp.dll
00007FCBA45C0000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/Microsoft.AspNetCore.Diagnostics.Abstractions.dll
00007FCBA4610000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.ComponentModel.Annotations.dll
00007FCBA46D0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Loader.dll
00007FCBA49A0000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.StackTrace.dll
00007FCBA4A10000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Threading.Tasks.Extensions.dll
00007FCBA5410000 00001000 /usr/share/dotnet/shared/Microsoft.AspNetCore.App/2.2.1/System.Runtime.CompilerServices.Unsafe.dll
00007FCBA5540000 00001000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Runtime.Handles.dll
00007FCBA5630000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Diagnostics.Process.dll
00007FCBA56B0000 00006000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Reflection.Metadata.dll
00007FCC03FF0000 0000F000 /usr/lib/x86_64-linux-gnu/libicui18n.so.57.1
00007FCC0837D000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Native.so
00007FCC09DFA000 00002000 /usr/lib/x86_64-linux-gnu/libicudata.so.57.1
00007FCC0A18F000 00013000 /usr/lib/x86_64-linux-gnu/libicuuc.so.57.1
00007FCC0A447000 00018000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/libclrjit.so
00007FCC10271000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/System.Globalization.Native.so
00007FCC11C79000 00002000 /usr/lib/x86_64-linux-gnu/liburcu-common.so.4.1.0
00007FCC11E81000 00002000 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.4.1.0
00007FCC12089000 00002000 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.4.1.0
00007FCC12295000 00002000 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0
00007FCC1250E000 0000D000 /usr/lib/x86_64-linux-gnu/liblttng-ust.so.0.0.0
00007FCC1276F000 00040000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/libcoreclrtraceptprovider.so
00007FCC129B5000 00002000 /lib/x86_64-linux-gnu/librt-2.24.so
00007FCC12C44000 00585000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/libcoreclr.so
00007FCC134B5000 00002000 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/libhostpolicy.so
00007FCC1375E000 00002000 /usr/share/dotnet/host/fxr/2.2.1/libhostfxr.so
00007FCC13AF5000 00006000 /lib/x86_64-linux-gnu/libc-2.24.so
00007FCC13D14000 00002000 /lib/x86_64-linux-gnu/libgcc_s.so.1
00007FCC14018000 00002000 /lib/x86_64-linux-gnu/libm-2.24.so
00007FCC1438C000 0000C000 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
00007FCC145B3000 00002000 /lib/x86_64-linux-gnu/libpthread-2.24.so
00007FCC147BB000 00002000 /lib/x86_64-linux-gnu/libdl-2.24.so
00007FCC147BD000 00225000 /lib/x86_64-linux-gnu/ld-2.24.so

I run with command clrstack

Failed to load data access module, 0x80131c4f
You can run the debugger command 'setclrpath' to control the load of libmscordaccore.so.
If that succeeds, the SOS command should work on retry.
SOS command FAILED 0x80131C4F

same as I test in docker host

@mikem8361
Copy link
Member

This is probably a problem with the gcore generated core dump (see issue dotnet/symstore#47). I recommend using "createdump" which is in the runtime directory (i.e. /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/createdump).

It could also be that there is no network connectivity to download the DAC (libmscordaccore.so) or it isn't on the container you are loading the core dump. Does /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/libmscordaccore.so exist on the machine/docker/host that you are executing dotnet-dump analyze on?

Before running any commands in "dotnet-dump analyze" could you run "setsymbolserver -m -log" to turn on some logging?

@dingsongjie
Copy link
Author

dingsongjie commented Aug 6, 2019 •
edited
Loading

/usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/createdump

1.1 I run this command /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/createdump in kubernetes, it is always give me errors

Writing minidump with heap to file /tmp/coredump.1
Segmentation fault (core dumped)

1.2 I run this command /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/createdump in docker host, it is always give me errors

Writing minidump with heap to file /tmp/coredump.9272
CLRDataCreateInstance(ICLRDataEnumMemoryRegions) FAILED 80131c4e

2 /usr/share/dotnet/shared/Microsoft.NETCore.App/2.2.1/libmscordaccore.so is on my host ,when i test in kubernetes ,it existed too.

3 I run setsymbolserver -m -log with errors

Unknown option: -m
SOS command FAILED 0x80004005

@mikem8361
Copy link
Member

You are hitting a createdump bug that should be fixed in the latest service release (2.2.6).

createdump won't work from the docker host.

The option should be "-ms" as in "setsymbolserver -ms -log". Sorry.

@dingsongjie
Copy link
Author

You are hitting a createdump bug that should be fixed in the latest service release (2.2.6).

createdump won't work from the docker host.

The option should be "-ms" as in "setsymbolserver -ms -log". Sorry.

Thank you for your help ， I will try it in 2.2.6

@dingsongjie
Copy link
Author

Yes ,Createdump works in 2.2.6, and I can also createdump in docker host by attach pid where app run in docker container ,so I can analyze the momory where there app run in docker swarm ,Thanks again！！！

@bruno-garcia bruno-garcia mentioned this issue Jan 8, 2021
Closed
@ghost ghost locked as resolved and limited conversation to collaborators Jun 27, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@mikem8361 mikem8361

Labels
None yet
Projects
None yet
Milestone
3.0.0
Development

No branches or pull requests
2 participants
@mikem8361 @dingsongjie