[Fleet] Replace Console API with internal API

[jillguyonnet]

Summary

Closes #160194

Parts of the Fleet debugger currently use the Console API to query Fleet indices and Ingest Saved Objects. This PR replaces those uses with internal API endpoints that use Elasticsearch and Saved Objects clients.

Affected parts:

• Fleet Index Debugger:
  • This component directly queries some Fleet indices.
  • The new service uses an Elasticsearch client.
  • There should be no difference with respect to the previous behaviour.
• Saved Object Debugger:
  • This component directly queries the .kibana-ingest index to retrieve saved objects of a given type.
  • Based on the type, the existing saved object names are retrieved: this is now done using a Saved Objects client and should work the same.
  • When a name is selected, the actual saved object is fetched: this is now done using a Saved Objects client and there are small differences in the result (no information is lost).

The following example shows the difference between the saved object response before and after this change:

Before

{
  "total": {
    "value": 1,
    "relation": "eq"
  },
  "max_score": 0.9808291,
  "hits": [
    {
      "_index": ".kibana_ingest_8.15.0_001",
      "_id": "ingest-agent-policies:174cc817-06d7-4e2c-88b3-44d7cb5322b6",
      "_score": 0.9808291,
      "_source": {
        "ingest-agent-policies": {
          "name": "Agent policy 1",
          "description": "",
          "namespace": "default",
          "monitoring_enabled": [
            "logs",
            "metrics"
          ],
          "inactivity_timeout": 1209600,
          "is_protected": false,
          "status": "active",
          "is_managed": false,
          "revision": 1,
          "updated_at": "2024-06-24T08:15:37.813Z",
          "updated_by": "elastic",
          "schema_version": "1.1.1"
        },
        "type": "ingest-agent-policies",
        "references": [],
        "managed": false,
        "coreMigrationVersion": "8.8.0",
        "typeMigrationVersion": "10.3.0",
        "updated_at": "2024-06-24T08:15:37.813Z",
        "created_at": "2024-06-24T08:15:37.813Z"
      }
    }
  ]
}

After

[
  {
    "type": "ingest-agent-policies",
    "id": "174cc817-06d7-4e2c-88b3-44d7cb5322b6",
    "attributes": {
      "name": "Agent policy 1",
      "description": "",
      "namespace": "default",
      "monitoring_enabled": [
        "logs",
        "metrics"
      ],
      "inactivity_timeout": 1209600,
      "is_protected": false,
      "status": "active",
      "is_managed": false,
      "revision": 1,
      "updated_at": "2024-06-24T08:15:37.813Z",
      "updated_by": "elastic",
      "schema_version": "1.1.1"
    },
    "references": [],
    "managed": false,
    "updated_at": "2024-06-24T08:15:37.813Z",
    "created_at": "2024-06-24T08:15:37.813Z",
    "version": "WzQ2OCwxXQ==",
    "coreMigrationVersion": "8.8.0",
    "typeMigrationVersion": "10.3.0",
    "score": 0.9808291
  }
]

Testing

Go to app/fleet/_debug and check the various parts described above.

Screenshots

Checklist

• Unit or functional tests were updated or added to match the most common scenarios

[obltmachine]

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

• /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
• run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

[jillguyonnet]

/ci

[elasticmachine]

Pinging @elastic/fleet (Team:Fleet)

[kibana-ci]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: 7ca9544

Failed CI Steps

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
fleet	1.4MB	1.4MB	-232.0B

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
fleet	166.5KB	166.8KB	+371.0B

History

• 💛 Build #217911 was flaky c30c5a0

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @jillguyonnet

[juliaElastic]

LGTM

[criamico]

LGTM