Add initial proposal for VictoriaMetrics

[valyala]

VictoriaMetrics repository - https://github.com/VictoriaMetrics/VictoriaMetrics

[caniszczyk]

@valyala thanks, can you also comment how you relate to Cortex or Thanos?

Can you also discuss any collaborations or work you have done with the Prometheus team and any other CNCF projects?

[valyala]

@valyala thanks, can you also comment how you relate to Cortex or Thanos?

Common things:

• VictoriaMetrics, Cortex and Thanos solve the same issue - long-term storage for Prometheus.
• They may be used as drop-in replacement for Prometheus datasource in Grafana.
• They allow collecting data from multiple Prometheus instances and using it in a single query (aka global querying view).
• They support multi-tenancy

Different things:

• Cortex and Thanos are more mature projects comparing to VictoriaMetrics - they appeared a ~year before VictoriaMetrics.
• VictoriaMetrics doesn't share any code or architecture decisions with Cortex or Thanos - all the code is written from scratch in the most efficient way for TSDB tasks.
• Its' architecture has no external dependencies. Cluster architecture minimizes moving parts and magic. This simplifies configuration and operation burden comparing to Cortex and Thanos and makes the cluster more reliable.
• It requires less resources - RAM, CPU, storage space, Kubernetes nodes - for operating on the same amount of time series data.
• Comparing to Thanos it is simpler to integrate with Prometheus via standard remote write API. Thanos requires sidecars for non-standard stealing of Prometheus data, disabling compaction on Prometheus side and running additional components - see https://github.com/improbable-eng/thanos/blob/master/docs/getting-started.md for more info and compare this to https://github.com/VictoriaMetrics/VictoriaMetrics/blob/cluster/README.md#cluster-setup .
• Comparing to Cortex it is simpler to configure, since it doesn't need setting up and maintaining external dependencies such as Consul, Memcached, PostgreSQL, Cassandra, etc. See https://github.com/cortexproject/cortex/blob/master/docs/architecture.md for details.

Can you also discuss any collaborations or work you have done with the Prometheus team and any other CNCF projects?

• We help Prometheus users with answers at https://groups.google.com/forum/#!forum/prometheus-users .
• We promote Prometheus usage in local groups
• We propose enhancements to Grafana - Add meta-variable for better templating experience grafana/grafana#16694
• We develop datasources for Grafana - https://github.com/Vertamedia/clickhouse-grafana

[valyala]

FYI, there is also an article comparing VictoriaMetrics to Thanos - https://medium.com/@valyala/comparing-thanos-to-victoriametrics-cluster-b193bea1683

[lizrice]

@valyala how about https://github.com/m3db, how does VictoriaMetrics compare to that?

[tenmozes]

@lizrice we have not compared m3 with VM yet. However, based on public articles and documents, Victoria Metric is closer to m3 than to Thanos or Cortex

[amye]

We've moved to having the CNCF SIGs review projects, do you have a SIG that you'd like to be on the agenda for review? (SIG Storage might be easiest.)

[lizrice]

This should go to SIG Observability for a recommendation once that is up and running cc @halcyondude

[amye]

@valyala: SIG Observability is now a full SIG, suggest presenting there first.

[valyala]

@amye , thanks for the pointer to https://github.com/cncf/sig-observability ! We are going to present VictoriaMetrics there in the coming months.

[kfox1111]

any updates?

[amye]

The TOC has moved to a new sandbox application process: https://docs.google.com/forms/d/1bJhG1MuM981uQXcnBMv4Mj9yfV5_q5Kwk3qhBCLa_5A/edit

If VictoriaMetrics would like to be considered for inclusion into the sandbox, that will get a faster response.

[amye]

Closing this out as we've now moved to the Sandbox application form.

[raravena80]

@valyala I'm wondering if this project was ever submitted to the CNCF. Just curious as we are currently prototyping this at my current company.

[dims]

@raravena80 looking at http://sandbox.cncf.io/ (all the 3 tabs) i don't see it ever hit the sandbox application form

[raravena80]

@raravena80 looking at http://sandbox.cncf.io/ (all the 3 tabs) i don't see it ever hit the sandbox application form

yes, that was my guess too 😄