[WB-8532] Quick fix for service hang

[raubitsj]

WB-8532

Description

When an internal "process" dies for a run, lets force an exit of the entire service process for now so that the user process does not hang waiting on a message that will never get handled.

There are better ways to do this, but this is the simplest way to make sure we always die.

The issue was we were calling sys.exit(1) from a non mainthread in the service process which is a no no.

TODO:

• add a test
• fix exit code?

Testing

How was this PR tested?

Checklist

• Name PR "[WB-NNNN][WB-MMMM] Add support for..." similar to entries in CHANGELOG.md
• Include reference to internal ticket "Fixes WB-NNNN" (and github issue "Fixes #NNNN" if applicable)

[codecov]

Codecov Report

Merging #3280 (8f9d04b) into master (4b59ad8) will increase coverage by 0.01%.
The diff coverage is 63.15%.

@@            Coverage Diff             @@
##           master    #3280      +/-   ##
==========================================
+ Coverage   79.95%   79.96%   +0.01%     
==========================================
  Files         212      212              
  Lines       27908    27919      +11     
==========================================
+ Hits        22314    22326      +12     
+ Misses       5594     5593       -1     

Flag	Coverage Δ
functest	56.88% <63.15%> (+0.02%)	⬆️
unittest	69.32% <26.31%> (-0.01%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
wandb/sdk/internal/internal.py	87.07% <0.00%> (-0.99%)	⬇️
wandb/sdk/wandb_run.py	88.75% <42.85%> (-0.04%)	⬇️
wandb/sdk/wandb_manager.py	94.26% <83.33%> (-0.66%)	⬇️
wandb/sdk/service/service.py	89.74% <100.00%> (+0.13%)	⬆️
wandb/sdk/wandb_setup.py	89.56% <100.00%> (ø)
wandb/sdk/lib/git.py	76.35% <0.00%> (ø)
wandb/sdk/internal/meta.py	90.74% <0.00%> (+3.08%)	⬆️