Add profile block and profiling of import_* jinja calls

[jfindlay]

Originally from @ferringb.

What does this PR do?

Add the profile jinja block to enable profiling of individual lines or blocks within sls files and enable the same profile mechanism for import_yaml, import_json, import_text.

What issues does this PR fix or reference?

Fixes: #57849

Motivation

When working with a very large codebase, it becomes more important to trace inefficiencies with state and pillar render times. The profile jinja block enables the user to get finely detailed information on the most expensive areas in the codebase.

Example

Setup

# tree /srv/salt/
/srv/salt/
├── data.sls
└── example.sls

0 directories, 2 files

# cat /srv/salt/data.sls 
{%- profile as 'render import' %}
  {%- profile as 'compute imported data' %}
    {%- set values = {'counter': 0} %}
    {%- for i in range(524288) %}
      {%- do values.update({'counter': i}) %}
    {%- endfor %}
  {%- endprofile %}

  {%- profile as 'define imported data' %}
data: {{ values['counter'] }}
  {%- endprofile %}
{%- endprofile %}

# cat /srv/salt/example.sls 
{%- import_yaml 'data.sls' as imported %}

{%- profile as 'local data' %}
  {%- set local_data = {'counter': 0} %}
  {%- for i in range(313377) %}
    {%- do local_data.update({'counter': i}) %}
  {%- endfor %}
{%- endprofile %}

test:
  cmd.run:
    - name: |-
        printf 'local data: %s\nimported data: %s' '{{ local_data['counter'] }}' '{{ imported['data'] }}'

Output

The ***asterisked lines*** below are new and correspond to the profile blocks in the code above.

# salt-call --local -l profile state.apply example
[WARNING ] Insecure logging configuration detected! Sensitive data may be logged.
[INFO    ] Loading fresh modules for state activity
***[PROFILE ] Time (in seconds) to render profile block 'compute imported data': 1.5444426536560059***
***[PROFILE ] Time (in seconds) to render profile block 'define imported data': 1.52587890625e-05***
***[PROFILE ] Time (in seconds) to render profile block 'render import': 1.5447514057159424***
***[PROFILE ] Time (in seconds) to render import_yaml 'data.sls': 1.5500736236572266***
***[PROFILE ] Time (in seconds) to render profile block 'local data': 0.9385035037994385***
[PROFILE ] Time (in seconds) to render '/var/cache/salt/minion/files/base/example.sls' using 'jinja' renderer: 2.5143165588378906
[PROFILE ] Time (in seconds) to render '/var/cache/salt/minion/files/base/example.sls' using 'yaml' renderer: 0.0009343624114990234
[INFO    ] Running state [printf 'local data: %s\nimported data: %s' '313376' '524287'] at time 07:35:09.840141
[INFO    ] Executing state cmd.run for [printf 'local data: %s\nimported data: %s' '313376' '524287']
[INFO    ] Executing command 'printf 'local data: %s\nimported data: %s' '313376' '524287'' in directory '/root'
[INFO    ] {'stderr': '', 'pid': 285, 'stdout': 'local data: 313376\nimported data: 524287', 'retcode': 0}
[INFO    ] Completed state [printf 'local data: %s\nimported data: %s' '313376' '524287'] at time 07:35:09.846389 (duration_in_ms=6.249)
local:
----------
          ID: test
    Function: cmd.run
        Name: printf 'local data: %s\nimported data: %s' '313376' '524287'
      Result: True
     Comment: Command "printf 'local data: %s\nimported data: %s' '313376' '524287'" run
     Started: 07:35:09.840140
    Duration: 6.249 ms
     Changes:   
              ----------
              pid:
                  285
              retcode:
                  0
              stderr:
              stdout:
                  local data: 313376
                  imported data: 524287

Summary for local
------------
Succeeded: 1 (changed=1)
Failed:    0
------------
Total states run:     1
Total run time:   6.249 ms

Merge requirements satisfied?

[NOTICE] Bug fixes or features added to Salt require tests.

• Docs
• Changelog - https://docs.saltstack.com/en/master/topics/development/changelog.html
• Tests written/updated

Commits signed with GPG?

Yes

[cmcmarrow]

Looks good thanks for the PR!

[jfindlay]

The pre-commit errors are not from my changes. It looks like you've enforced CI style checks before refactoring the codebase.