Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote reader for influxdb do not read from all retention policies #3402

Open
dmitriy-lukyanchikov opened this Issue Nov 2, 2017 · 1 comment

Comments

Projects
None yet
3 participants
@dmitriy-lukyanchikov
Copy link

dmitriy-lukyanchikov commented Nov 2, 2017

What did you do?

I run query li ke this
node_load1{}

What did you expect to see?

result with all metrics that stores under all retention policies inside influxdb

What did you see instead? Under which circumstances?

only metrics that stored inside default retention policy

Environment

I run Prometheus with configured remote read and wright to influxdb 1.4

  • System information:

Ubuntu 16.04.03
Linux 4.4.0-93-generic x86_64

  • Prometheus version:

prometheus, version 1.8.0 (branch: HEAD, revision: 3569eef)
build user: root@bd4857492255
build date: 20171006-22:12:46
go version: go1.9.1

  • Prometheus configuration file:
# my global config
global:
  scrape_interval:     60s # By default, scrape targets every 15 seconds.
  evaluation_interval: 30s # By default, scrape targets every 15 seconds.
  scrape_timeout: 10s
  # scrape_timeout is set to the global default (10s).

  # Attach these labels to any time series or alerts when communicating with
  # external systems (federation, remote storage, Alertmanager).

# Load and evaluate rules in this file every 'evaluation_interval' seconds.

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:

  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  # Auto-discovery via consul tags by Registrator
  - job_name: 'federate_lr_metrics_node'
    scrape_interval: 30s

    honor_labels: true
    metrics_path: '/federate'

    params:
      'match[]':
         - '{__name__="node_load1"}'

    static_configs:
      - targets:
        - 'some_server:9090'


# Remote write configuration (for Graphite, OpenTSDB, or InfluxDB).
remote_write:
  - url: "http://localhost:8086/api/v1/prom/write?db=lr_prom"
# Remote read configuration (for InfluxDB only at the moment).
remote_read:
  - url: "http://localhost:8086/api/v1/prom/read?db=lr_prom"


@isavcic

This comment has been minimized.

Copy link

isavcic commented Nov 21, 2017

Confirming this is the case, as observed in the InfluxDB logs:

[I] 2017-11-21T23:39:53Z SELECT value FROM prometheus.rp_1s_for_1h.container_cpu_user_seconds_total WHERE (...)

Only rp_1s_for_1h is queried, to which remote storage adapter ships the metrics to.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.