BUGFIX: fixing issue with paths for the Spark files

[ahmadnazeri]

Description

Spark looks for path /app/provider/... for the files by default. The dockerfile copied the Spark files to /app/scripts/.... Fixed the paths for it.

Type of change

Does this correspond to an open issue?

Select type(s) of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation update

Checklist:

• I have performed a self-review of my code
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• My changes generate no new warnings
• I have added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes
• I have fixed any merge conflicts

[codecov]

Codecov Report

Merging #776 (ce61031) into main (6f7b498) will decrease coverage by 6.10%.
The diff coverage is 12.68%.

@@            Coverage Diff             @@
##             main     #776      +/-   ##
==========================================
- Coverage   59.71%   53.61%   -6.10%     
==========================================
  Files          63       66       +3     
  Lines       12408    12658     +250     
==========================================
- Hits         7409     6787     -622     
- Misses       4232     5229     +997     
+ Partials      767      642     -125     

Impacted Files	Coverage Δ
config/config.go	20.00% <0.00%> (-80.00%)	⬇️
coordinator/coordinator.go	42.67% <0.00%> (-0.13%)	⬇️
helpers/compression/compression.go	0.00% <0.00%> (ø)
provider/filepath.go	0.00% <0.00%> (ø)
provider/filestore.go	4.00% <0.00%> (-38.93%)	⬇️
provider/k8s.go	4.14% <0.00%> (-26.06%)	⬇️
provider/spark.go	0.16% <ø> (-18.41%)	⬇️
runner/worker/worker.go	78.57% <ø> (ø)
metadata/metadata.go	71.02% <100.00%> (+2.05%)	⬆️
provider/provider_type/provider_type.go	100.00% <100.00%> (ø)

... and 18 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more