[feat] Add support for associating scheduler resources with an environment

[ekouts]

This is a second attempt for this issue. I am missing the documentation + unittests but I would like first to agree on the api.

It would be very similar to the resources of the test. And the configuration would look like this.

site_configuration = {
    'systems': [
        {
            ...
            'partitions': [
                {
                    'resources': [
                        {
                            'name': 'switches',
                            'options': ['--switches={num_switches}']
                        },
                        {
                            'name': 'gres',
                            'options': ['--gres={gres}']
                        },
                        {
                            'name': 'uenv',
                            'options': [
                                '--uenv-file={file}',
                                '--uenv-mount={mount}',
                            ]
                        }
                    ]
                }
            ]
        }
    ],
    'environments': [
        {
            'name': 'myenv',
            'resources': {
                'uenv': {
                    'mount': 'one',
                    'file': 'two',
                }
            }
        }
    ]
}

That would translate to the following options in the job script:

#SBATCH --uenv-file=two
#SBATCH --uenv_mount=one

Closes #2991 .

[pep8speaks]

Hello @ekouts, Thank you for updating!

Cheers! There are no PEP8 issues in this Pull Request!Do see the ReFrame Coding Style Guide

Comment last updated at 2024-04-18 22:44:40 UTC

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 86.67%. Comparing base (2d1eca4) to head (a278d9a).
Report is 1 commits behind head on develop.

Additional details and impacted files

@@           Coverage Diff            @@
##           develop    #3152   +/-   ##
========================================
  Coverage    86.66%   86.67%           
========================================
  Files           61       61           
  Lines        12134    12139    +5     
========================================
+ Hits         10516    10521    +5     
  Misses        1618     1618           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[vkarak]

I think we should omit completely the env_resources and simply enable environments to use any of the scheduler resources. This would simplify the implementation and make also more sense at the partition level, as conceptually it doesn't make sense to separate the two types of resources.

[vkarak]

Just some minor style changes.

[ekouts]

Thanks @vkarak for finishing the PR!