Skip to content

Commit

Permalink
Initial source release
Browse files Browse the repository at this point in the history
  • Loading branch information
David Sklar committed May 4, 2010
1 parent 3f6eb63 commit 447a195
Show file tree
Hide file tree
Showing 47 changed files with 1,538 additions and 0 deletions.
4 changes: 4 additions & 0 deletions .gitignore
@@ -0,0 +1,4 @@
.deps
*.lo
*.la
*~
13 changes: 13 additions & 0 deletions LICENSE
@@ -0,0 +1,13 @@
Copyright 2010 Ning, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you
may not use this file except in compliance with the License. You may
obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied. See the License for the specific language governing
permissions and limitations under the License.
145 changes: 145 additions & 0 deletions README
@@ -0,0 +1,145 @@
-*-org-*-
#+TITLE: ub

* What

ub is a PHP microbenchmarking framework. Its purpose is to make it
fast and easy to write little code snippets and see how long they take
to run. This is particularly useful if there are a few potential ways
of solving a problem and you want to choose the fastest one.

* Basics

An ub microbenchmark is just a regular PHP script. It needs a few
comments in a few places to tell ub what to measure.

The most important comment is "// time". It tells ub to measure how
long it takes to execute the code that comes after the comment. For
example:

<?php
// time
array_merge(array('alice'), array('alice','bob'));

Save that code to a file called "array-merge.php" and then run:

ub array-merge.php

You'll get some output that looks like:

array-merge: mean=0.005670 median=0.005000 min=0.005000 max=0.027000 stdev=0.001417

All times are in milliseconds. By default, ub runs your code 1000
times and then reports the results across all 1000 iterations. The
"-i" command line argument changes the number of iterations.

Frequently, you need some setup code that you don't want to include in
the timing but needs to be run on each benchmark iteration
nonetheless. The ub comment that marks this kind of code is
"// init". For example:

<?php
// init
$numbers = range(0, 100);
shuffle($numbers);
// time
sort($numbers);

Each time ub executes a timing loop, it runs the range() and shuffle()
functions, turns on the clock, runs sort(), and then turns off the
clock. This ensures a potentially different array is shuffled in each
iteration, but the time required to construct the shuffled array isn't
part of the results.

When benchmarking functions or classes, you need to define the
function or class just once, not each time through the timing
loop. That's where the "// once" comment comes in. Use that to denote
code that should run just once, before the timing loop starts. For
example:

<?php
// once
function range_and_shuffle($size) {
$numbers = range(0, $size);
shuffle($numbers);
return $numbers;
}
// init
$nums = range_and_shuffle(100);
// time
sort($nums);

There are two other comments that are useful:
- "// done" marks code that is run inside each loop *after* the code
to time is run. The "// done" code does not count towards the
measured times.
- "// ignore" marks code that is ignored when benchmarking is
active. This is useful for debugging or other information you want
to print out when running the benchmark script through regular PHP
or through ub's runner mode.

Only the "// time" comment is required. The rest are optional, but if
they appear, have to be in order: once, init, time, done, ignore. You
must use the "//" comment style. (And strictly speaking, "//time" is
not required -- if you leave it out, the results will just reflect the
overhead of two successive gettimeofday() calls in PHP.)

* Options and Intracacies

** Passing Options to Benchmarks

Having to write entirely separate benchmark files for small variations
(such as the number of elements in an array of numbers to sort) is
tedious. Instead, use ub's option passing capabilities. The -x
command-line argument, which can be specified more than once, tells ub
to populate an $___opts array that will be available to the benchmark
file. Depending on how -x is used, different values show up in
$___opts. For example:

Command line: no -x arguments
$___opts structure: array()

Command line: -x asparagus
$___opts structure: array('asparagus' => true)

Command line: -x asparagus -x broccoli=green
$___opts structure: array('asparagus' => true, 'broccoli' => 'green')

Command line: -x asparagus -x broccoli=green -x broccoli=12
$___opts structure: array('asparagus' => true, 'broccoli' => array('green','12')

-x values with = in them are converted to key/value pairs (and the
values are always strings); -x values without = result in a value of
boolean true. Multiple keys result in $___opts array values which are
themselves values.

** Runner Mode

If you've created a benchmark file that uses $___opts, you've lost a
little bit of the ease of testing your benchmarking file by running it
through regular PHP -- there is no $___opts array available. ub's
"runner mode", activated with the -r command line argument helps with
this. Runner mode populates $___opts from command line arguments and
runs the benchmark file -- that's it. No iteration, no special
attention to the comments that delimit the file. After runner mode
builds $___opts, your benchmark file is run as usual.

** Multiple Benchmarks

You can supply multiple benchmark names or filenames on the
commandline to run them all in one go. Internally, ub uses a separate
PHP process for each benchmark. This prevents any collision between
classes or functions that may have the same name in separate benchmark
files.

** Clock Extension

ub uses PHP's gettimeofday() function (which uses the underlying
gettimeofday(2) system call) to obtain wall clock time before and
after the code to be timed is run. The experimental extension in the
"clock" subdirectory provides a PHP interface to the clock_gettime(3)
Linux system call. For now, it just offers the CLOCK_MONOTONIC clock,
but this can provide a higher granularity measure of elapsed time with
less overhead. The clock-gettime.[ch] files in this directory provide
OS X functions that duplicate Linux's clock_gettime(3) functionality.

6 changes: 6 additions & 0 deletions b/array-key-exists-missing.php
@@ -0,0 +1,6 @@
<?php
// init
$a = array('alice' => 12);
// time
array_key_exists('bob', $a);

6 changes: 6 additions & 0 deletions b/array-key-exists.php
@@ -0,0 +1,6 @@
<?php
// init
$a = array('alice' => 12);
// time
array_key_exists('alice', $a);

50 changes: 50 additions & 0 deletions b/cache-chained-method-calls.php
@@ -0,0 +1,50 @@
<?php
// once
class Library {
function doSomething($arg) {
$a = 1 + 2;
$a *= $arg;
return $a;
}
}

class Component {
private $libs = array();

public function lib($lib) {
if (! isset($this->libs[$lib])) {
$this->libs[$lib] = new Library;
$this->libs[$lib]->name = "library=$lib";
}
return $this->libs[$lib];
}

public function clearLibs() {
$this->libs = array();
}
}

class Controller {

public function __construct() {
$this->C = new Component();
}

public function withLocal() {
$lib = $this->C->lib('photo');
$value1 = $lib->doSomething(12);
$value2 = $lib->doSomething(24);
}

public function withCalls() {
$value1 = $this->C->lib('photo')->doSomething(12);
$value2 = $this->C->lib('photo')->doSomething(24);
}
}

$c = new Controller;

// init
$c->C->clearLibs();
// time
$c->withLocal();
7 changes: 7 additions & 0 deletions b/call-user-func.php
@@ -0,0 +1,7 @@
<?php
// once
function alice() {
}
// time
call_user_func('alice');

50 changes: 50 additions & 0 deletions b/chained-method-calls.php
@@ -0,0 +1,50 @@
<?php
// once
class Library {
function doSomething($arg) {
$a = 1 + 2;
$a *= $arg;
return $a;
}
}

class Component {
private $libs = array();

public function lib($lib) {
if (! isset($this->libs[$lib])) {
$this->libs[$lib] = new Library;
$this->libs[$lib]->name = "library=$lib";
}
return $this->libs[$lib];
}

public function clearLibs() {
$this->libs = array();
}
}

class Controller {

public function __construct() {
$this->C = new Component();
}

public function withLocal() {
$lib = $this->C->lib('photo');
$value1 = $lib->doSomething(12);
$value2 = $lib->doSomething(24);
}

public function withCalls() {
$value1 = $this->C->lib('photo')->doSomething(12);
$value2 = $this->C->lib('photo')->doSomething(24);
}
}

$c = new Controller;

// init
$c->C->clearLibs();
// time
$c->withCalls();
6 changes: 6 additions & 0 deletions b/function-call.php
@@ -0,0 +1,6 @@
<?php
// once
function alice() {
}
// time
alice();
8 changes: 8 additions & 0 deletions b/instantiate-simple.php
@@ -0,0 +1,8 @@
<?php
// once
class Simple {
public function minded() {
}
}
// time
$a = new Simple;
5 changes: 5 additions & 0 deletions b/isset-missing.php
@@ -0,0 +1,5 @@
<?php
// init
$a = array('alice' => 12);
// time
isset($a['bob']);
5 changes: 5 additions & 0 deletions b/isset.php
@@ -0,0 +1,5 @@
<?php
// init
$a = array('alice' => 12);
// time
isset($a['alice']);
11 changes: 11 additions & 0 deletions b/magic-method-call.php
@@ -0,0 +1,11 @@
<?php
// once
class CallMyFunction {
public function __call($method, $args) {
return 0;
}
}
// init
$c = new CallMyFunction();
// time
$c->please();
21 changes: 21 additions & 0 deletions b/magic-method-dispatch.php
@@ -0,0 +1,21 @@
<?php
// once
class CallMyFunction {
public function __call($method, $args) {
if ($method == 'please') {
return call_user_func_array(array($this, 'doPlease'), $args);
}
return 0;
}

protected function doPlease() {
return 0;
}

}
// init
$c = new CallMyFunction();
// time
$c->please();
// ignore
print "c->please = " . $c->please() . "\n";
13 changes: 13 additions & 0 deletions b/mb_strlen-1k.php
@@ -0,0 +1,13 @@
<?php
// once
function gen_string($len) {
$s = '';
while ($len--) {
$s .= chr(mt_rand(33,126));
}
return $s;
}
// init
$s = gen_string(1024);
// time
$j = mb_strlen($s);
5 changes: 5 additions & 0 deletions b/mb_strlen.php
@@ -0,0 +1,5 @@
<?php
// init
$s = md5(mt_rand()) . md5(mt_rand());
// time
$j = mb_strlen($s);
11 changes: 11 additions & 0 deletions b/method-call.php
@@ -0,0 +1,11 @@
<?php
// once
class CallMyFunction {
public function please() {
return 0;
}
}
// init
$c = new CallMyFunction();
// time
$c->please();
4 changes: 4 additions & 0 deletions b/no-comments.php
@@ -0,0 +1,4 @@
<?php
$s = 'موقع البي بي سي للأخبار بالعربية، يضم بثا إذاعيا مباشرا وأقوال الصحف بالاضافة لتغطيته لاهم الاحداث على شكل ملفات مفصلة.';
mb_strlen($s);
?>
Empty file added b/overhead.php
Empty file.

0 comments on commit 447a195

Please sign in to comment.