Skip to content
File system and storage benchmark that uses a custom language to generate a large variety of workloads.
C C++ Filebench WML Yacc Roff M4 Other
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
cvars
workloads Removing obsolute attributes from oltp.f workload Apr 4, 2018
.gitignore Removing the remnants of posset feature. Jul 7, 2016
AUTHORS Importing FSL port. Jun 8, 2011
COPYING LICENSE file should go to tarball on make dist Sep 6, 2011
ChangeLog Added new ChangeLog to please automake Jul 8, 2016
LICENSE
Makefile.am Installing cvar libraries in the right location Mar 3, 2017
NEWS Updating NEWS file for upcoming release Sep 6, 2011
README Updated README to reflect 1.5 usage Jul 14, 2016
README_COND_COMP
aslr.c Resolve compilation warnings Jul 13, 2016
aslr.h Detect if ADDR_NO_RANDOMIZE flag is defined Feb 20, 2015
configure.ac
eventgen.c Another checkpatch.pl on eventgen.c Sep 21, 2015
eventgen.h Removing redundant EVENTGEN_VAR. Sep 21, 2015
fb_avl.c Small code cleanup in fb_avl.* Oct 16, 2013
fb_avl.h
fb_cvar.c Removing old files related to cvars. Sep 15, 2015
fb_cvar.h Moving cvar_libraries definition to the fb_cvar.c Oct 25, 2013
fb_localfs.c Resolve compilation warnings Jul 13, 2016
fb_random.c Removing the usage of /dev/urandom from Filebench Feb 4, 2016
fb_random.h Removing the usage of /dev/urandom from Filebench Feb 4, 2016
fbtime.c Removing RDTSC support Feb 9, 2016
fbtime.h Further cleanup in stat.c Feb 12, 2016
filebench.h When taking statistics snapshot compute total time in one place only Feb 12, 2016
fileset.c Create subdirs even when pre-creating fileset with no files Jul 1, 2016
fileset.h Removing cached attribute Sep 30, 2015
flag.h Importing FSL port. Jun 8, 2011
flowop.c When copying constant values from variables one needs to check if the… Feb 19, 2016
flowop.h Resolve compilation warnings Jul 13, 2016
flowop_library.c finishon* flowops now terminate the thread rather than the whole run Aug 4, 2016
fsplug.h Importing FSL port. Jun 8, 2011
gamma_dist.c Importing FSL port. Jun 8, 2011
gamma_dist.h Importing FSL port. Jun 8, 2011
ioprio.c
ioprio.h
ipc.c Refactoring flowop types initialization. Oct 4, 2015
ipc.h
misc.c Resolve compilation warnings Jul 13, 2016
misc.h Moving all time-related routines to fbtime.[ch] from misc.[ch] Feb 9, 2016
multi_client_sync.c Re-enabling multi node mode. Sep 23, 2015
multi_client_sync.h
parser_gram.y Perform complete random variable initialization Aug 10, 2017
parser_lex.l Removing redundant caret (^) symbols from the whitestring definition Aug 2, 2016
parsertypes.h Removing a lot of code related to attr_param_list Sep 23, 2015
procflow.c Removing not needed inherit parameter in procfllow_define() Oct 4, 2015
procflow.h Removing not needed inherit parameter in procfllow_define() Oct 4, 2015
stats.c Computing the average latency in IO Summary line properly May 10, 2017
stats.h Removing dependency on libkstat and /proc/stat. Feb 12, 2016
threadflow.c Refactoring flowop_add_from_proto() function Oct 4, 2015
threadflow.h Removing unused tf_lwpusagefd threadflow field. Feb 19, 2016
utils.c Keep a couple functions from parser_gram.y to utils.c Sep 18, 2015
utils.h Keep a couple functions from parser_gram.y to utils.c Sep 18, 2015
vars.c
vars.h Removing a lot of code related to attr_param_list Sep 23, 2015

README

Filebench - A Model Based File System Workload Generator
========================================================


INTRODUCTION
------------

Filebench is a file system and storage benchmark that can generate a large
variety of workloads. Unlike typical benchmarks it is extremely flexible and
allows to specify application's I/O behavior using its extensive Workload Model
Language (WML). Users can either describe desired workloads from scratch or use
(with or without modifications) workload personalities shipped with Filebench
(e.g., mail-, web-, file-, and database-server workloads). Filebench is equally
good for micro- and macro-benchmarking, quick to setup, and relatively easy to
use.


INSTALLATION
------------

Filebench compilation and installation is simple, and can be completed in two
steps. However, if you have downloaded a release tarball from Github
(https://github.com/filebench/filebench/releases), you can go ahead and skip to
Step 2.


Step 1: Generating autotool scripts

Makefile.in and configure files are not included in the repo, so they will have
to be generated. To do so, make sure you have libtoolize and automake tools
installed and run the following commands:

$ libtoolize
$ aclocal
$ autoheader
$ automake --add-missing
$ autoconf


Step 2: Compilation and installation

Before proceeding, make sure yacc and lex are available in your system. Then,
you can proceed with configuration, compilation, and installation as usual:

$ ./configure
$ make
$ sudo make install


QUICK-START GUIDE
-----------------

To quickly introduce a new user to Filebench we use two examples demonstrating
two different typical Filebench workflows: 1) describe a user-defined workload
in Workload Model Language (WML) and generate the workload; 2) generate one of
the predefined Filebench workloads. 
The description in this guide assumes Filebench 1.5-alpha1 or higher.


Example 1: User-defined workloads

First step is to create the description of the workload (so called workload
personality) in WML language. Typically, workload personalities are stored in
files with '.f' extension. In this example we describe a very simple workload
consisting of two processes with three threads each. Every thread continuously
picks a file among many, reads it, and then closes the file. Here is the
corresponding workload personality:

01  define fileset name="testF",entries=10000,filesize=16k,prealloc,path="/tmp"
02
03  define process name="readerP",instances=2 {
04    thread name="readerT",instances=3 {
05      flowop openfile name="openOP",filesetname="testF"
06      flowop readwholefile name="readOP",filesetname="testF"
07      flowop closefile name="closeOP"
08    }
09  }
10
11  run 60

Four main entities in Filebench are 'filesets', 'processes' consisting of
'threads', and 'flowops'. In the first line we define a fileset containing
10,000 files of 16KiB size each in /tmp directory. Filebench is instructed to
precreate all files in the fileset before executing the actual workload.

In the third and fourth lines we define two identical processes each consisting
of three identical threads. Every thread in Filebench repeats flowops (operations)
defined in it in a loop. Lines 05-07 describe the flowops that constitute the
threads: open a file in "testF" fileset, read the file  completely, and close
it. Finally, in the 11th line we indicate to run the workload for 60 seconds.

In more complex workloads one can define any number of filesets, multiple
different processes and threads, use a variety of flowops and attributes, and
more. Refer to the complete WML vocabulary for details at
https://github.com/filebench/filebench/wiki/Workload-model-language

Assuming that the personality is saved in 'readfiles.f' file, one can then
generate corresponding workload by running 'filebench -f readfiles.f' command.


Example 2: Pre-defined workloads

Filebench comes with several predefined micro- and macro-workloads (e.g.,
webserver, fileserver, mailserver) which are also described in WML, not
differently than the workload in Example 1 above. In the source code tree,
workloads are located in the workloads/ directory and are typically installed in
/usr/local/share/filebench/workloads/ during 'make install' (though this can
differ from one installation to another).

We do *not* recommend to directly use workload files from workloads/ or
/usr/local/share/filebench/workloads/ directories. The main reason is that these
workloads *are not properly sized* (e.g., in terms of the dataset sizes) to a
particular system. For instance, the initial dataset size of the webserver
workload is only slightly larger than 16MiB, which is typically not the size you
want to test the system containing multiple gigabytes of RAM with.

So, instead, copy webserver workload to any other directory:

$ cp /usr/local/share/filebench/workloads/webserver.f mywebserver.f

Then edit the copied file to increase the dataset size by setting the number of
files ('entries' attribute of a fileset) to an appropriate value. Finally, run
the workload:

$ filebench -f mywebserver.f

An extended discussion on how to scale Filebench workloads can be found at
https://github.com/filebench/filebench/wiki/Scaling-Filebench-workloads


SUPPORT
-------

To ask questions about Filebench, report bugs, or request new features, you can
use GitHub's issue tracking system. This is the central hub for both user support
and bug tracking, and can be found at https://github.com/filebench/filebench/issues
You can’t perform that action at this time.