Skip to content
Vikas Goel edited this page Feb 4, 2017 · 4 revisions

Welcome to the mcga wiki!

Problems with THP

MongoDB

Disable THP as databases have sparse access patterns instead of contiguous access patterns: https://docs.mongodb.com/manual/tutorial/transparent-huge-pages/

Hadoop

Coalescing base pages to large pages consumes too much CPU: Turn it off http://www.ghostar.org/2015/02/transparent-huge-pages-on-hadoop-makes-me-sad/

H-Store

Similar to Redis, fork for snapshot but COW faults causes throughput drops on main thread http://hstore.cs.brown.edu/documentation/deployment/jvm-snapshots/

VoltDB

Problem with khugepaged (not explored yet)

Running h-store tpcc

export b=tpcc; export dataDir=<directory to copy data>
cd $mcga/src/bench/h-store-release-2016-06
ant hstore-prepare -Dproject=tpcc
ant compile hstore-benchmark -Dproject=$b -Dclient.interval=100 -Dsite.snapshot=true -Dsite.snapshot_interval=10000 -Dsite.anticache_enable=true -Dsite.anticache_profiling=true -Dclient.output_memory=$dataDir/$b-memory.csv -Dclient.output_csv=$dataDir/$b-throughput.csv -Dclient.output_anticache_history=$dataDir/$b-evictions.csv

olap query

SELECT ol_number, SUM(ol_quantity), SUM(ol_amount), AVG(ol_quantity), AVG(ol_amount), COUNT(*) FROM order_line WHERE ol_delivery_d > '2007-01-02 00:00:00.000000' GROUP BY ol_number ORDER BY ol_number
Clone this wiki locally