[Azure][compute_vm][compute_vm_scaleset] metrics Azure.VM.Windows.GuestMetrics and Azure.VM.Linux.GuestMetrics seems to be not available

[tetianakravchenko]

compute_vm - current configuration - https://github.com/elastic/integrations/blob/main/packages/azure_metrics/data_stream/compute_vm/agent/stream/stream.yml.hbs#L100-L150 that includes namespace: "Azure.VM.Linux.GuestMetrics" and namespace: "Azure.VM.Windows.GuestMetrics"

Note: I've configured diagnostic settings on all monitored nodes as described in https://docs.elastic.co/integrations/azure_metrics/compute_vm#guest-metrics:

But I am not getting any metrics and also I see those elastic-agent errors:

no metric definitions were found for resource /subscriptions/XXXX/resourceGroups/XXXX/providers/Microsoft.Compute/virtualMachines/XXX and namespace Azure.VM.Windows.GuestMetrics. Verify if the namespace is spelled correctly or if it is supported by the resource in case.

the same for linux:

no metric definitions were found for resource /subscriptions/XXXX/resourceGroups/XXXX/providers/Microsoft.Compute/virtualMachines/XXXX and namespace Azure.VM.Linux.GuestMetrics. Verify if the namespace is spelled correctly or if it is supported by the resource in case.

For the compute_vm_scaleset I see the same behavior - error:

no metric definitions were found for resource /subscriptions/XXXX/resourceGroups/XXXX/providers/Microsoft.Compute/virtualMachineScaleSets/XXX and namespace Azure.VM.Windows.GuestMetrics. Verify if the namespace is spelled correctly or if it is supported by the resource in case.

I am missing a guidance how to get those metrics

[tetianakravchenko]

@zmoog @tommyers-elastic could you help me with this?

[tetianakravchenko]

I was missing some extra configuration:
was fixed for the compute_vm_scaleset by: Diagnostic settings > under Sinks > Enable Azure Monitor

[tommyers-elastic]

thanks tania! do you think the docs need improving here?

[tetianakravchenko]

@tommyers-elastic yes, the only documentation I found is this - https://docs.elastic.co/integrations/azure_metrics/compute_vm#guest-metrics

[tetianakravchenko]

later I also found this https://github.com/elastic/beats/pull/20631/files with link to https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/collect-custom-metrics-guestos-resource-manager-vm, here is at least mentioned data sink

[zmoog]

@tetianakravchenko so the issue is resolved with these extra settings?

The docs are there, but it would be great if they were more precise and actionable.

[tetianakravchenko]

@zmoog

@tetianakravchenko so the issue is resolved with these extra settings?

yes, actually to be more precise required steps are:

• on vm resource under Monitoring > Install Diagnostics Extension
  • select storage account - you might need to create a Diagnostics storage account if does not exist already
  • enable guest-level monitoring
• Diagnostic settings > Sinks > Enable Azure Monitor
  note: to do so should be configured managed identity: