[receiver/vcenter] Add support for caching traversing data

[atoulme]

Component(s)

receiver/vcenter

Is your feature request related to a problem? Please describe.

The vCenter receiver currently parses the whole tree on each scrape.

This doesn't scale well when you have a very large structure.

Describe the solution you'd like

Offer caching of the tree parsed by the receiver, separately from the scraping action.

Describe alternatives you've considered

No response

Additional context

No response

[github-actions]

Pinging code owners:

• receiver/vcenter: @djaglowski @schmikei

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[djaglowski]

This is an interesting idea at a high level but I'm not sure I understand what is being proposed.

First, is parsing the json really the performance bottleneck, or is the goal to avoid requesting such a large structure (if that's even possible).

If we'd still request the same payload, do we just use portions of the raw payload as keys, and the parsed equivalent as values? Is this generalizable or is the cached "typed" e.g. a "vm cache", a "disk cache"? Does the cache need to be purged periodically or does it naturally ?

[atoulme]

I have been looking at it and will post a spike for your review.

[atoulme]

#30624 is open for discussion.

[djaglowski]

I looked over the PR but still don't understand the intention behind this. From what I can tell, we would actually scrape data in the background every refresh_ttl interval. Then, each collection_interval, we just return the most recently collected data. Is that right?

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• receiver/vcenter: @djaglowski @schmikei

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been closed as inactive because it has been stale for 120 days with no activity.