Build Automated Complete End to End Test

[matttproud]

1. Builds binary running requisite whitebox tests.
2. Starts up Prometheus.
3. Tries issuing web queries to evaluate known expressions against the database.
4. Validates results.

/CC: @juliusv — You may have some ideas of some things you'd like to see captured here.

[ncabatoff]

I took a stab at this (minus step 1), see https://github.com/ncabatoff/prombench. I wasn't thinking in terms of incorporating it into the Prometheus project itself, but if desired I could create a PR. I'd need some guidance in terms of where it should go and so forth.

[grobie]

Thank you, this is awesome!

I don't think it's necessary to merge the project itself into the prometheus repository. I'm fine if people actually prefer that, but it should be totally fine to just embed it. I could imagine we add a make benchmark target, which installs prombench if not available and runs the benchmark. Similar to what we do with promu.

[ncabatoff]

That was my thinking.

[brian-brazil]

Prombench covers this.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.