GramTest: A tool for Grammar based Test case generation
Java ANTLR
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
src Make constructors public Mar 26, 2018
.gitignore intellij file Sep 15, 2016
.travis.yml java8 Feb 14, 2017
LICENSE Initial commit Apr 20, 2015
README.md Update README.md May 20, 2018
gramtest.iml Make constructors public Mar 26, 2018
pom.xml Make constructors public Mar 26, 2018

README.md

GramTest Build Status

This tool allows you to generate test cases based on arbitrary user defined grammars. The input grammar is given in BNF notation. Potential applications include fuzzing and automated testing.

Instructions

We use maven as our build tool. When you compile the project using maven (mvn clean package) it will generate a single all dependencies Jar, that can be run from the command line as follows:

java -jar gramtest.jar -file grammar.bnf

To take a look at all the additional options, you can run java -jar gramtest.jar -h which will print the details as below.

usage: gramtest [options]
 -dep <depth of rules>         maximum depth for recursive rules
 -ext <extension>              file extension for generated tests
 -file <grammar file>          path to the grammar file (in BNF notation)
 -h,--help                     prints this message
 -max <max size of test>       maximum size of each generated test
 -min <min size of test>       minimum size of each generated test
 -mingen <minimal generator>   use minimal sentence generation
                               (true/false)
 -num <number of tests>        maximum number of test cases
 -tests <test folder>          path to the folder to store generated tests

Bugs found using GramTest

Project Reference Status
Apache Commons Validator https://issues.apache.org/jira/browse/VALIDATOR-410 Open
segmentio/is-url https://github.com/segmentio/is-url/issues/15 Open
gajus/url-regexp https://github.com/gajus/url-regexp/issues/6 Open
segmentio/is-url https://github.com/segmentio/is-url/issues/21 Open

Articles

FAQ

  • Can I use this particular grammar with GramTest?

As long as the input grammar is described in BNF it is possible to use it with GramTest to generate random strings. Several grammars that you find online are not given in proper BNF format, have comments/text in some productions, or do not have complete clauses. Verify that the grammar you are using doesn't have any bugs before using it.

  • Why did you choose BNF and not EBNF/ABNF/etc. as the input format for GramTest?

BNF was the simplest of all formats to use, it is certainly possible to implement another input format but it is going to be a non-trivial excercise. You will need to implement your own generator that can create strings based on each type of production in the grammar.

  • Where can I find some sample BNF grammars to use?

Several examples are available in the test folder. You can refer to the unit tests to see how they can be used.