"Internal failure occured while running MSBuild" DirectoryNotFoundException

[ViktorHofer]

MSBUILD : error MSB1025: An internal failure occurred while running MSBuild.
System.IO.DirectoryNotFoundException: Could not find a part of the path 'D:\workspace\_work\1\s\MSBuild_Logs'.
   at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound)
   at System.IO.Enumeration.FileSystemEnumerator`1.Init()
   at System.IO.Enumeration.FileSystemEnumerable`1..ctor(String directory, FindTransform transform, EnumerationOptions options, Boolean isNormalized)
   at System.IO.Enumeration.FileSystemEnumerableFactory.UserFiles(String directory, String expression, EnumerationOptions options)
   at System.IO.Directory.InternalEnumeratePaths(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options)
   at System.IO.Directory.EnumerateFiles(String path, String searchPattern, SearchOption searchOption)
   at Microsoft.Build.Shared.FileSystem.ManagedFileSystem.EnumerateFiles(String path, String searchPattern, SearchOption searchOption)
   at Microsoft.Build.Shared.FileSystem.MSBuildOnWindowsFileSystem.EnumerateFiles(String path, String searchPattern, SearchOption searchOption)
   at Microsoft.Build.Shared.ExceptionHandling.ReadAnyExceptionFromFile(DateTime fromTimeUtc)
   at Microsoft.Build.Execution.BuildManager.HandleNodeShutdown(Int32 node, NodeShutdown shutdownPacket)
   at Microsoft.Build.Execution.BuildManager.ProcessPacket(Int32 node, INodePacket packet)
   at Microsoft.Build.Execution.BuildManager.<>c__DisplayClass76_0.<Microsoft.Build.BackEnd.INodePacketHandler.PacketReceived>b__0()
   at Microsoft.Build.Execution.BuildManager.ProcessWorkQueue(Action action)
--- End of stack trace from previous location ---
   at Microsoft.Build.Execution.BuildManager.EndBuild()
   at Microsoft.Build.CommandLine.MSBuildApp.BuildProject(String projectFile, String[] targets, String toolsVersion, Dictionary`2 globalProperties, Dictionary`2 restoreProperties, ILogger[] loggers, LoggerVerbosity verbosity, DistributedLoggerRecord[] distributedLoggerRecords, Int32 cpuCount, Boolean enableNodeReuse, TextWriter preprocessWriter, TextWriter targetsWriter, Boolean detailedSummary, ISet`1 warningsAsErrors, ISet`1 warningsAsMessages, Boolean enableRestore, ProfilerLogger profilerLogger, Boolean enableProfiler, Boolean interactive, Boolean isolateProjects, GraphBuildOptions graphBuildOptions, Boolean lowPriority, String[] inputResultsCaches, String outputResultsCache)

from one of our runtime official builds: https://dev.azure.com/dnceng/internal/_build/results?buildId=1337454&view=logs&j=4d50a8bf-a143-51c7-5cc8-defff437e23b&t=0b0b242f-bbcb-57b5-fe9f-26dc042642ec&l=54

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

[rainersigwald]

This should be alleviated by #6792 but we shouldn't throw on that codepath regardless, so I'm leaving this open.

[tmds]

I just hit this one too while building .NET from source:

    MSBUILD : error MSB1025: An internal failure occurred while running MSBuild.
    System.IO.DirectoryNotFoundException: Could not find a part of the path '/home/tmds/dotnet6.0/dotnet-6.0.100-rc.2-x64-bootstrap/src/source-build-reference-packages.f5558f1481f841e318e301d9cb7dd6f0fe4dd64e/artifacts/source-build/self/src/MSBuild_Logs'.
       at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound)
       at System.IO.Enumeration.FileSystemEnumerator`1.Init()
       at System.IO.Enumeration.FileSystemEnumerableFactory.UserFiles(String directory, String expression, EnumerationOptions options)
       at System.IO.Directory.InternalEnumeratePaths(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options)
       at Microsoft.Build.Shared.ExceptionHandling.ReadAnyExceptionFromFile(DateTime fromTimeUtc)
       at Microsoft.Build.Execution.BuildManager.HandleNodeShutdown(Int32 node, NodeShutdown shutdownPacket)
       at Microsoft.Build.Execution.BuildManager.ProcessPacket(Int32 node, INodePacket packet)
       at Microsoft.Build.Execution.BuildManager.ProcessWorkQueue(Action action)
    --- End of stack trace from previous location ---
       at Microsoft.Build.Execution.BuildManager.EndBuild()
       at Microsoft.Build.CommandLine.MSBuildApp.BuildProject(String projectFile, String[] targets, String toolsVersion, Dictionary`2 globalProperties, Dictionary`2 restoreProperties, ILogger[] loggers, LoggerVerbosity verbosity, DistributedLoggerRecord[] distributedLoggerRecords, Int32 cpuCount, Boolean enableNodeReuse, TextWriter preprocessWriter, TextWriter targetsWriter, Boolean detailedSummary, ISet`1 warningsAsErrors, ISet`1 warningsAsMessages, Boolean enableRestore, ProfilerLogger profilerLogger, Boolean enableProfiler, Boolean interactive, Boolean isolateProjects, GraphBuildOptions graphBuildOptions, Boolean lowPriority, String[] inputResultsCaches, String outputResultsCache)

cc @omajid