Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AsyncMemoize: do not cancel and restart jobs that are being requested #16547

Closed
wants to merge 52 commits into from

Conversation

majocha
Copy link
Contributor

@majocha majocha commented Jan 18, 2024

This utilizes changes from #16533

The idea is to never cancel a job that is awaited by someone.
Basically cancelling a Get does not cancel the cached computation if there are other requests so there is no need for restarts.
I removed Linked CTS so computations can only be canceled by posting a message to processStateUpdate.

Disclaimer: I'm probably missing something and don't understand how this is expected to work, but just wanted to see it this passes, because it's green locally.

Copy link
Contributor

github-actions bot commented Jan 18, 2024

❗ Release notes required


✅ Found changes and release notes in following paths:

Change path Release notes path Description
src/Compiler docs/release-notes/.FSharp.Compiler.Service/8.0.300.md

@majocha
Copy link
Contributor Author

majocha commented Jan 18, 2024

Wow, so MacOS and Linux passes 😅.

The one failure seems unrelated, and due to concurrent access to StringBuilder in test utils:

Error message
System.ArgumentOutOfRangeException : Index was out of range. Must be non-negative and less than or equal to the size of the collection. (Parameter 'chunkLength')



Stack trace
   at System.Text.StringBuilder.ToString()
   at FSharp.Test.Utilities.RedirectConsole.Output() in D:\a\_work\1\s\tests\FSharp.Test.Utilities\Utilities.fs:line 114
   at FSharp.Test.Compiler.compileFSharpCompilation(Compilation compilation, Boolean ignoreWarnings, CompilationUnit cUnit) in D:\a\_work\1\s\tests\FSharp.Test.Utilities\Compiler.fs:line 684
   at FSharp.Test.Compiler.compileFSharp(FSharpCompilationSource fs) in D:\a\_work\1\s\tests\FSharp.Test.Utilities\Compiler.fs:line 707
   at FSharp.Test.Compiler.compile(CompilationUnit cUnit) in D:\a\_work\1\s\tests\FSharp.Test.Utilities\Compiler.fs:line 793
   at FSharp.Compiler.UnitTests.AssemblySigning.AssemblyKeyNameAttribute NETCOREAPP() in D:\a\_work\1\s\tests\FSharp.Compiler.UnitTests\AssemblySigningAttributes.fs:line 65
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

We should probably add some locks there.

@majocha
Copy link
Contributor Author

majocha commented Jan 18, 2024

@0101, if this is checks green, please take a look if this is the right direction.

@0101
Copy link
Contributor

0101 commented Jan 18, 2024

I'm not sure I get the logic of cancelling and restarting jobs. I mean why can one requestor cancel a job that has other active requestors?

The idea behind this is that the computation will run directly in the first requestor's thread and therefore will retain the stack trace. Which would be more valuable than saving the occasional restarts.

Unfortunately as it is now, the computation still gets disconnected. However it's still my ambition to make the stack traces work.

It might be nice to have this configurable and have stack traces for debugging and no-restarts for release.

@majocha
Copy link
Contributor Author

majocha commented Jan 18, 2024

It might be nice to have this configurable and have stack traces for debugging and no-restarts for release.

Debugging as in debugging the FCS itself?

@0101
Copy link
Contributor

0101 commented Jan 18, 2024

Debugging as in debugging the FCS itself?

Yep. Sometimes it would be nice to know when an exception happens what was the whole path to it. Now you just get the job where it happened being fired off form the thread pool.

@majocha
Copy link
Contributor Author

majocha commented Jan 18, 2024

Hmmm ok, so this passes without reverting16348 (#16536).

@0101
Copy link
Contributor

0101 commented Jan 18, 2024

Hmmm ok, so this passes without reverting16348 (#16536).

Damn, how come? The failures that happen in the other branch don't even touch this code 🤔

@majocha
Copy link
Contributor Author

majocha commented Jan 20, 2024

Hmmm ok, so this passes without reverting16348 (#16536).

Damn, how come? The failures that happen in the other branch don't even touch this code 🤔

tbh, I now think this code just hides the problem better.

let diagnosticsLogger = DiagnosticsThreadStatics.DiagnosticsLogger
let phase = DiagnosticsThreadStatics.BuildPhase
let ct2 = Cancellable.Token

try
let work =
async {
DiagnosticsThreadStatics.DiagnosticsLogger <- diagnosticsLogger
DiagnosticsThreadStatics.BuildPhase <- phase
Cancellable.Token <- ct2
return! computation |> Async.AwaitNodeCode
}

Async.StartAsTask(work, cancellationToken = defaultArg ct CancellationToken.None)
finally
DiagnosticsThreadStatics.DiagnosticsLogger <- diagnosticsLogger
DiagnosticsThreadStatics.BuildPhase <- phase
Cancellable.Token <- ct2
Async.StartAsTask(computation |> Async.AwaitNodeCode, ?cancellationToken = ct)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing these bits looks suspicious to me. It's what keeps the needed parts of the compiler context when it switches threads.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I just replaced it with what we use in production? (AwaitNodeCode)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now that I look at it, this code is different than wrapThreadStaticInfo.
Here DiagnosticsThreadStatics of the calling thread are passed onto the new thread.
In wrapThreadStaticInfo they are not:

let wrapThreadStaticInfo computation =
async {
let diagnosticsLogger = DiagnosticsThreadStatics.DiagnosticsLogger
let phase = DiagnosticsThreadStatics.BuildPhase
try
return! computation
finally
DiagnosticsThreadStatics.DiagnosticsLogger <- diagnosticsLogger
DiagnosticsThreadStatics.BuildPhase <- phase
}

@majocha
Copy link
Contributor Author

majocha commented Jan 20, 2024

At this moment this is just trying things in the dark. I don't think it fixes anything.
Actually I've seen the random test failure locally (TaskCancelledException), when running all tests in parallel in VS task explorer.

@majocha majocha closed this May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

3 participants