Skip to content

rifatwahid/php-framework-benchmark

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PHP Framework Benchmark

This project attempts to mesure minimum overhead (minimum bootstrap cost) of PHP frameworks in real world.

So I think the minimun applications to benchmark should not include:

  • cost of template engine (HTML output)
  • cost of database manipulation
  • cost of debugging information

Components like Template engine or ORM/Database library are out of scope in this project.

Benchmarking Policy

This is master branch.

  • Install a framework according to the official documentation.
  • Use the default configuration.
    • Don't remove any components/configurations even if they are not used.
    • With minimum changes to run this benchmark.
  • Set environment production/Turn off debug mode.
  • Run optimization which you normally do in your production environment, like composer's --optimize-autoloader.
  • Use controller class if a framework supports.

Some people may think using default configuration is not fair. But I think a framework's default configuration is an assertion of what it is. Default configuration is a good starting point to know a framework. And I can't optimize all the frameworks. Some frameworks are optimized, some are not, it is not fair. So I don't remove any components/configurations.

But if you are interested in benchmarking with optimization (removing components/configurations which are not used), See optimize branch.

If you find something wrong with my code, please feel free to send Pull Requests. But please note optimizing only for "Hello World" is not acceptable. Building fastest "Hello World" application is not the goal in this project.

Frameworks to Benchmark

  • Phalcon 2.0.0-RC1
  • Ice 1.0.10
  • Slim 2.6.2
  • CodeIgniter 3.0.0
  • Lumen 5.0.8
  • Yii 2.0.4
  • Silex 1.2.4
  • Cygnite 1.3.1
  • BEAR.Sunday 1.0.0-rc.3
  • FuelPHP 1.8-dev
  • CakePHP 3.0.2
  • Aura 2.0.2
  • Symfony 2.6.6
  • Laravel 5.0.27
  • Zend Framework 2.4.0
  • TYPO3 Flow 2.3.3

Results

Benchmarking Environment

  • CentOS 6.5 64bit (VM; VirtualBox)
    • PHP 5.5.23 (Remi RPM)
      • Zend OPcache v7.0.4-dev
    • Apache 2.2

Hello World Benchmark

These are my benchmarks, not yours. I encourage you to run on your environments.

(2015/05/02)

framework requests per second relative peak memory relative
phalcon-2.0 1,433.32 35.4 0.50 1.0
ice-1.0 1,101.46 27.2 0.50 1.0
slim-2.6 795.53 19.7 0.50 1.0
codeigniter-3.0 715.65 17.7 0.50 1.0
lumen-5.0 362.13 9.0 1.00 2.0
yii-2.0 358.11 8.9 1.75 3.5
silex-1.2 343.66 8.5 1.00 2.0
cygnite-1.3 344.60 8.5 0.75 1.5
bear-1.0 344.94 8.5 1.00 2.0
fuel-1.8-dev 299.44 7.4 0.75 1.5
cake-3.0 261.22 6.5 1.25 2.5
aura-2.0 204.90 5.1 1.00 2.0
symfony-2.6 100.28 2.5 3.00 6.0
laravel-5.0 71.14 1.8 2.75 5.5
zf-2.4 75.75 1.9 3.00 6.0
typo3-flow-2.3 40.46 1.0 5.25 10.5

Note(1): All the results are run on php with phalcon.so and ice.so. If you don't load phalcon.so or ice.so, the rps except for Phalcon or Ice probably increase a bit.

How to Benchmark

Install source code as http://localhost/php-framework-benchmark/.

$ git clone https://github.com/kenjis/php-framework-benchmark.git
$ cd php-framework-benchmark
$ sh setup.sh

Run benchmarks.

$ sh benchmark.sh

See http://localhost/php-framework-benchmark/.

Linux Kernel Configuration

I added below in /etc/sysctl.conf

# Added
net.netfilter.nf_conntrack_max = 100000
net.nf_conntrack_max = 100000
net.ipv4.tcp_max_tw_buckets = 180000
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_fin_timeout = 10

and run sudo sysctl -p.

If you want to see current configuration, run sudo sysctl -a.

Reference

Related

About

PHP Framework Benchmark

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • HTML 66.7%
  • PHP 31.9%
  • JavaScript 0.7%
  • CSS 0.4%
  • ApacheConf 0.2%
  • Shell 0.1%