Failed to discover resources for group #2221

deggja · 2023-02-07T10:53:30Z

deggja
Feb 7, 2023

I recently added another resource discovery group to my Promitor resource discovery container - as well as some metrics to scrape for my scraper container.

However, for some reason it is failing to discover that specific resource. All the other discovery groups are working as expected, and this particular resource is present in the same subscriptions/resource groups as the other resources.

Resource discovery values:

resourceDiscoveryGroups:
# Removed other groups
- name: container-instances
  type: ContainerInstance

Scraper values:

- name: azure_container_instance_cpu_usage
  description: "CPU usage on all cores in millicores."
  resourceType: ContainerInstance
  azureMetricConfiguration:
    metricName: CpuUsage
    aggregation:
      type: Average
  resourceDiscoveryGroups:
  - name: container-instances

I am seeing the following error for this resource in the scraper container logs:

[10:42:57 ERR] Failed to discover resources for group container-instances.
System.Net.Http.HttpRequestException: Response status code does not indicate success: 501 (Not Implemented).
   at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
   at Promitor.Agents.Scraper.Discovery.ResourceDiscoveryClient.SendGetRequestAsync(String uriPath) in /src/Promitor.Agents.Scraper/ResourceDiscoveryClient.cs:line 58
   at Promitor.Agents.Scraper.Discovery.ResourceDiscoveryClient.GetAsync(String resourceDiscoveryGroupName, Int32 currentPage) in /src/Promitor.Agents.Scraper/ResourceDiscoveryClient.cs:line 39
   at Promitor.Agents.Scraper.Discovery.ResourceDiscoveryRepository.GetResourceDiscoveryGroupAsync(String resourceDiscoveryGroupName) in /src/Promitor.Agents.Scraper/ResourceDiscoveryRepository.cs:line 31
   at Promitor.Agents.Scraper.Scheduling.ResourcesScrapingJob.GetDiscoveryGroupScrapeDefinitions(String resourceDiscoveryGroupName, MetricDefinition metricDefinition, ConcurrentBag`1 scrapeDefinitions) in /src/Promitor.Agents.Scraper/ResourcesScrapingJob.cs:line 222

resource discovery container logs:

[10:42:57 INF] Request finished HTTP/1.1 GET http://promitor-agent-resource-discovery-con:8889/api/v2/resources/groups/container-instances/discover?currentPage=1 - - - 501 106 application/json;+charset=utf-8 15.5828ms

I think I have pretty much copy pasted the values from the example here: https://docs.promitor.io/v2.6/scraping/providers/container-instances/#example

Does anyone have any idea why I am getting this 501?