Enable Universal Profiling as Enterprise feature

[danielmitterdorfer]

With this commit we ensure that Universal Profiling can only be used with an Enterprise license.

[elasticsearchmachine]

Pinging @elastic/profiling (Team:Universal Profiling)

[elasticsearchmachine]

Hi @danielmitterdorfer, I've created a changelog YAML for you.

[danielmitterdorfer]

Test instructions:

1. Spin up a cluster as per the command line below. Set $LICENSE to trial or basic:

./gradlew :run -Drun.license_type=$LICENSE -Dtests.heap.size=4G -Dtests.es.xpack.profiling.templates.enabled=true --https

2. Run the stacktraces API and observe that the call will fail for basic (HTTP 403) but succeed for trial (HTTP 200):

curl -k -X POST -u elastic-admin:elastic-password https://localhost:9200/_profiling/stacktraces\?pretty -H 'Content-Type: application/json' -d ' 
{
  "sample_size": 20000,
  "query": {                                           
    "bool": {
      "filter": [
        {
          "range": {
            "@timestamp": {
              "gte": "2023-01-01",
              "lt": "2023-10-05",
              "format": "yyyy-MM-dd"
            }
          }
        }
      ]
    }
  }
}
'

[danielmitterdorfer]

See #97546 (comment) for context on why we are returning the license checker in all cases (but no other components).

[danielmitterdorfer]

elasticsearch-ci/part-1 failed because of #100251

@elasticsearchmachine run elasticsearch-ci/part-1

[danielmitterdorfer]

BWC tests were flaky.

@elasticsearchmachine run elasticsearch-ci/bwc

[danielmitterdorfer]

@elasticsearchmachine run elasticsearch-ci/part-2

[rockdaboot]

The curl command works as expected together with your ES startup (fresh data).

But when starting ES with -Drun.license_type=trial --preserve-data, then restart ES with -Drun.license_type=basic --preserve-data, the new license is not recognized (curl gives 200 OK).

Also the other way round, first using basic and then trial, leaves me with a 403 response.

I guess this behavior has nothing to do with this PR, but want to make sure that this is expected.

[danielmitterdorfer]

But when starting ES with -Drun.license_type=trial --preserve-data, then restart ES with -Drun.license_type=basic --preserve-data, the new license is not recognized (curl gives 200 OK).

Ah, good catch but that's expected. The license is preserved in the cluster state and it's not that you can change the license at will with a dev cluster using the run.license_type system property. Instead you'd need to use the licensing APIs for this.

[danielmitterdorfer]

Also, I'm gonna look into these failing CI checks. Unfortunately most of the times it's just caused by unrelated flaky tests but I'll investigate these.

[rockdaboot]

LGTM, testing the PR works as expected.

[danielmitterdorfer]

@elasticsearchmachine run elasticsearch-ci/part-3

[danielmitterdorfer]

@elasticsearchmachine run elasticsearch-ci/bwc

[danielmitterdorfer]

@elasticsearchmachine run elasticsearch-ci/part-2

[danielmitterdorfer]

Merging main after I've muted several failing (flaky) tests in #100384 and #100385.

[danielmitterdorfer]

@elasticmachine merge upstream

[danielmitterdorfer]

build timed out (CI infrastructure issue)

@elasticsearchmachine run elasticsearch-ci/part-1