Skip to content

Commit

Permalink
Merge branch 'igornovg/vector-switch' into 'master'
Browse files Browse the repository at this point in the history
feat(BOUN-1003): reconfigure vector

* Replace Clickhouse ingest with vector2vector ingest using HTTP sink and native (vector protobuf schema) encoding. AWS loadbalancer is configured to proxy these ingests to a Clickhouse master node where the target Vector is running.
* Remove nginx log2metric workflow that wasn't used much
* Remove sampling which isn't used
* Rewrite Vector config from TOML to YAML (much more readable)

The target Vector is using the same username and password as Clickhouse before to make migration easier. The URL is hardcoded for now, but after migration we can also change it to the env var.

This was tested in dev and working fine. 

See merge request dfinity-lab/public/ic!17107
  • Loading branch information
blind-oracle committed Jan 12, 2024
2 parents fa6adac + 751cf03 commit 5e42368
Show file tree
Hide file tree
Showing 4 changed files with 205 additions and 422 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,10 @@ BindsTo=setup-vector.service
User=vector
Group=vector
Restart=always
Environment="NGINX_PROMETHUS_ADDR=[::]:9316"
Environment="VECTOR_PROMETHUS_ADDR=[::]:9317"
Environment="DANTED_PROMETHUS_ADDR=[::]:9323"
EnvironmentFile=/run/ic-node/etc/default/vector
ExecStart=/usr/bin/vector --config /etc/vector/vector.toml
ExecStart=/usr/bin/vector --config /etc/vector/vector.yaml

[Install]
WantedBy=multi-user.target

0 comments on commit 5e42368

Please sign in to comment.