Fix spark errors

[thinkall]

Why are these changes needed?

Fix a few errors related to spark. It's needed to fix the test errors in other PRs such as #1263

• spark mlflow version not found issue
• joblib issue

Related issue number

Checks

• I've included any doc changes needed for https://microsoft.github.io/FLAML/. See https://microsoft.github.io/FLAML/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

[codecov-commenter]

Codecov Report

Attention: 3 lines in your changes are missing coverage. Please review.

Comparison is base (0415638) 71.72% compared to head (dd22038) 71.64%.

Files	Patch %	Lines
flaml/tune/spark/utils.py	40.00%	2 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1274      +/-   ##
==========================================
- Coverage   71.72%   71.64%   -0.09%     
==========================================
  Files          83       83              
  Lines       11244    11249       +5     
  Branches     2359     2360       +1     
==========================================
- Hits         8065     8059       -6     
- Misses       2724     2735      +11     
  Partials      455      455              

Flag	Coverage Δ
unittests	71.51% <40.00%> (-0.09%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.