DB errors in the 9th TechEmpower benchmark

[pygy]

http://www.techempower.com/benchmarks/#section=data-r9&hw=peak&test=update

On the EC2 and "dedicated i7" hardware Lapis does quite well, especially when compared to other Postgres-based systems, but on the beefy "Peak" hardware, it is at the bottom of the pile with 22k db errors.

Any idea why? Should this be resolved with the switch to pgmoon?

While typing this message, I got curious and reviewed the Lapis code, it should have capped db updates to 500 per requests and wasn't doing it: TechEmpower/FrameworkBenchmarks#949. Maybe this was related?

[leafo]

I'm not sure if the lapis version on techempower got updated to one that supports pgmoon. I'm curious what kind of effect it will have. Maybe it will fix the error, it would be nice if we could get the error messages from the benchmark.

Also if it's running multiple queries per request there might be some room for improvement by running queries in parallel within a request.

[hamiltont]

it would be nice if we could get the error messages from the benchmark

Your round 9 results are available here for ec2 and here for bare metal on an i7 chip

Oddly enough, I don't see these errors listed in those logs. The only issue here is the queries=501 test (you can see the pass with warnings messages because it should have been capped to 500). I believe @pygy is trying to fix that with his PR. I'll have to ask someone else where the website is getting that error count from.

For what it's worth, I just ran lapis from the TFB master branch, and got these results with every error coming from the database tests. It's quite possible that we are using some outdated framework. To run lapis, we first run this script and then run a lapis install and then an nginx install and then an openresty install. This is pretty spread out, we may be missing some updated version in one of these bash scripts.

I'll take another look later to see if I can find any errors in the master TFB code

[leafo]

Closing this as there don't appear to be any errors anymore. (I am curious what changed)