Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Added MongoDB sink RFC #3681

Merged
merged 9 commits into from
Sep 25, 2020
Merged

docs: Added MongoDB sink RFC #3681

merged 9 commits into from
Sep 25, 2020

Conversation

jamtur01
Copy link
Contributor

@jamtur01 jamtur01 commented Sep 2, 2020

Closes #3641

Signed-off-by: James Turnbull <james@lovedthanlost.net>
Signed-off-by: James Turnbull <james@lovedthanlost.net>
@jamtur01 jamtur01 added domain: metrics Anything related to Vector's metrics events domain: rfcs labels Sep 2, 2020
Copy link
Member

@jszwedko jszwedko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall this looks good! Mostly just some comments about the metric naming.

I am curious how we'll test this one. I guess we could do an integration test with a mongodb container that doesn't bother asserting the values, but just the scraped metric names.

rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Show resolved Hide resolved
@jszwedko
Copy link
Member

Apologies for the delay in review! This one had fallen off my radar.

Signed-off-by: James Turnbull <james@lovedthanlost.net>
Signed-off-by: James Turnbull <james@lovedthanlost.net>
Signed-off-by: James Turnbull <james@lovedthanlost.net>
Copy link
Member

@jszwedko jszwedko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good! I still didn't dig too deeply into the stats themselves having little familiarity with MongoDB.

- `mongodb_extra_info_heap_usage_bytes` (gauge)
- `mongodb_extra_info_page_faults` (gauge)
- `mongodb_instance_local_time` (gauge)
- `mongodb_instance_uptime_estimate_seconds_total` (counter)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's still not clear to me what the difference is between this one and mongodb_instance_uptime_seconds_total; even after looking at https://docs.mongodb.com/manual/reference/command/serverStatus/ . Are you aware? The number seems to be the same when I ran a local mongodb docker container.

Copy link
Contributor Author

@jamtur01 jamtur01 Sep 14, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I actually can't work out the difference.

uptime
The number of seconds that the current MongoDB process has been active.

uptimeEstimate
The uptime in seconds as calculated from MongoDB’s internal course-grained time keeping system.

I guess someone might want both?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is definitely unclear to me 😄 but I'm fine with reporting both given that serverStatus does. Maybe they differ in certain circumstances.

rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
rfcs/2020-08-31-3641-mongo-metrics.md Outdated Show resolved Hide resolved
Signed-off-by: James Turnbull <james@lovedthanlost.net>
@jamtur01
Copy link
Contributor Author

Ping @JeanMertz @binarylogic I need two more approvals to merge this. Thanks!

Signed-off-by: James Turnbull <james@lovedthanlost.net>
Copy link
Contributor

@binarylogic binarylogic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, nice work. I have no idea what these metrics mean, but I'm happy to see they are consistent with the Prometheus metrics. I do wonder if the naming could be improved though. Prefixes like mongodb_mongod_metrics seem redundant, but I don't have enough MongoDB context to know for sure.

@jamtur01
Copy link
Contributor Author

Something like mongodb_mongod_ etc look redundant but are actually sub-divisions, mongod being the daemon component of mongo.

@jamtur01
Copy link
Contributor Author

Last call @JeanMertz :) Otherwise, I'm going to accept the two approvals here - if others have feedback feel free to reach out prior to implementation.

@jamtur01 jamtur01 merged commit b98ae44 into master Sep 25, 2020
@jamtur01 jamtur01 deleted the mongo_rfc branch September 25, 2020 21:00
mengesb pushed a commit to jacobbraaten/vector that referenced this pull request Dec 9, 2020
* draft

Signed-off-by: James Turnbull <james@lovedthanlost.net>

* More edits

Signed-off-by: James Turnbull <james@lovedthanlost.net>

* Addressed feedback from Jesse

Signed-off-by: James Turnbull <james@lovedthanlost.net>

* Fixed checks

Signed-off-by: James Turnbull <james@lovedthanlost.net>

* Fixed two more metric names

Signed-off-by: James Turnbull <james@lovedthanlost.net>

* More edits from Jesse

Signed-off-by: James Turnbull <james@lovedthanlost.net>

* Added full metrics

Signed-off-by: James Turnbull <james@lovedthanlost.net>
Signed-off-by: Brian Menges <brian.menges@anaplan.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
domain: metrics Anything related to Vector's metrics events
Projects
None yet
Development

Successfully merging this pull request may close these issues.

New mongodb_metrics source RFC
5 participants