ruby-compiler-benchmark
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.gitignore
README.md
Vagrantfile
benchmark.sh
make.conf
parse_results_percent_of_baseline.rb
parse_results_total_score.rb

README.md

Ruby Compiler Benchmark

Start EC2 Instance:

export AWS_ACCESS_KEY="ABCDEFGHIJKLMNOPQRSTUVWXYZ"
export AWS_SECRET_KEY="ABCDEFGHIJKLMNOPQRSTUVWXYZ1234567890"
vagrant up --provider=aws

Start Benchmark Suite:

vagrant ssh
screen
cd /vagrant
./benchmark.sh

Collect Benchmark Results:

cd ruby-benchmark-suite
rake bench:to_csv
cd ..
./parse_results_total_score.rb

Running the full benchmark suite for all compilers takes around 12 hours.

If you only want to run it with certain compilers remove the ones you don't want from the COMPILERS array on line 54 of benchmark.sh

If you only want to run part of the benchmark suite replace:

rake bench

On line 50 of benchmark.sh with something like:

rake bench:pattern PATTERN=benchmarks/micro-benchmarks/bm_app_*.rb