Config using AWS/DX returns only meta-metrics and no errors

[starbreiz]

I'm having the most difficult time getting anything other than meta-metrics out of my scraping. I'm pulling DirectConnect stats. Is there any known issues with this container and DX metrics?

I notice the only action is ListMetrics, but I'd like it to pull something akin to aws cloudwatch get-metric-statistics --namespace "AWS/DX" --metric-name ConnectionState --start-time 2019-09-01T00:00:00Z --end-time 2019-09-02T00:00:00Z --period 300 --statistics Maximum Minimum --dimensions Name=ConnectionId,Value=dxcon-fh2yqug2

Config:

---
region: us-east-1
metrics:
- aws_namespace: AWS/DX
  aws_metric_name: ConnectionState
  aws_dimensions: [Name, Value]
  aws_dimension_select: 
      Value: [dxcon-fh2yqug2]
  aws_statistics: [Minimum]
  aws_statistics: [Maximum]


- aws_namespace: AWS/DX
  aws_metric_name: ConnectionState
  aws_dimensions: [Name, Value]
  aws_dimension_select: 
      Value: [dxcon-ffg6ltda]
  aws_statistics: [Maximum]

Results in Prometheus:

cloudwatch_exporter_scrape_duration_seconds{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 0.311616553
-- | --
cloudwatch_exporter_scrape_duration_seconds{container_name="cloudwatch-exporter",instance="<IP>::9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 0.309972988
cloudwatch_exporter_scrape_error{container_name="cloudwatch-exporter",instance="<IP>::9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 0
cloudwatch_exporter_scrape_error{container_name="cloudwatch-exporter",instance="<IP>::9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 0
cloudwatch_requests_total{action="listMetrics",container_name="cloudwatch-exporter",instance="<IP>::9106",job="infracore-prod/prom-cloudwatch",namespace="AWS/DX",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 34
cloudwatch_requests_total{action="listMetrics",container_name="cloudwatch-exporter",instance="<IP>::9106",job="infracore-prod/prom-cloudwatch",namespace="AWS/DX",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 34
scrape_duration_seconds{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 0.313927217
scrape_duration_seconds{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 0.313396918
scrape_samples_post_metric_relabeling{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 3
scrape_samples_post_metric_relabeling{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 3
scrape_samples_scraped{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 3
scrape_samples_scraped{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 3
scrape_series_added{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 0
scrape_series_added{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 0
up{container_name="cloudwatch-exporter",instance="<IP>9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-19",pod_name="prom-cloudwatch-54cdf459b-mk4th"} | 1
up{container_name="cloudwatch-exporter",instance="<IP>:9106",job="infracore-prod/prom-cloudwatch",node="us-phx-a-k8s-p1a-09-21",pod_name="prom-cloudwatch-54cdf459b-nv46p"} | 1

[brian-brazil]

It makes more sense to ask questions like this on the prometheus-users mailing list rather than in a GitHub issue. On the mailing list, more people are available to potentially respond to your question, and the whole community can benefit from the answers provided.

[starbreiz]

Thanks... I've inquired there. Adding set_timestamp: false didn't help it either :(