Fix issue 477

[iparask]

Hello,

this PR fixes #477. It resolves any shared_data directive based on a > exists or not and pushes them to the pilot via pilot's stage_in method.

This is unit tested as well.

[codecov]

Codecov Report

Merging #557 (91ad1f9) into devel (c1cc422) will increase coverage by 0.27%.
The diff coverage is 78.37%.

@@            Coverage Diff             @@
##            devel     #557      +/-   ##
==========================================
+ Coverage   63.11%   63.39%   +0.27%     
==========================================
  Files          21       21              
  Lines        2359     2371      +12     
==========================================
+ Hits         1489     1503      +14     
+ Misses        870      868       -2     

Impacted Files	Coverage Δ
src/radical/entk/execman/rp/task_processor.py	84.79% <75.00%> (+1.22%)	⬆️
src/radical/entk/execman/rp/resource_manager.py	62.24% <88.88%> (+3.35%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c1cc422...91ad1f9. Read the comment docs.

[lee212]

Are these affected?

radical.entk/src/radical/entk/execman/rp/task_processor.py

Lines 474 to 475 in b266c75

	td.input_staging = get_input_list_from_task(task, placeholders)
	td.output_staging = get_output_list_from_task(task, placeholders)

[iparask]

You mean because of $SHARED. Thank you! I'll check and get back to you

[iparask]

Your comment made me think how placeholders are resolved when there are in both sides of >. This triggered some extra changes.

However, the user needs to keep in mind that EnTK does not have any knowledge of folder structure under $SHARED. For example, a user sets shared_data as:

appman.shared_data = ['folder1/file1 > folder1/file1']

and want to use file as input staging for a task. The task definition has to include the folder tree after $SHARED:

td.input_staging = ['$SHARED/folder1/file1']

[iparask]

ping @lee212

[andre-merzky]

LGTM