CATG is a concolic unit testing engine for Java programs. The implementation uses ASM for instrumentation. ASM instrumentation instruments (see janala.instrument.) class files at runtime and dumps (see janala.logger.) to a file a log of all instructions executed by the program and all values loaded from local stacks and heaps. A concolic execution engine (see janala.interpreters.*) then takes the log and performs both symbolic and concrete interpretation of the logged instructions.
You must have java, gradle, cvc4 (http://cvc4.cs.nyu.edu/downloads/), and python 2.7 in your PATH. Two extra jar files are needed to run the tool. Create a
lib directory in the root directory and download the following jar files
- asm-all-5.0.4.jar: http://mvnrepository.com/artifact/org.ow2.asm/asm-all/5.0.4 (Direct link: http://central.maven.org/maven2/org/ow2/asm/asm-all/5.0.4/asm-all-5.0.4.jar)
- automaton-1.11-8.jar: http://mvnrepository.com/artifact/dk.brics.automaton/automaton/1.11-8 (Direct link: http://central.maven.org/maven2/dk/brics/automaton/automaton/1.11-8/automaton-1.11-8.jar)
- emma.jar: https://mvnrepository.com/artifact/emma/emma/2.1.5320 (Direct link: http://central.maven.org/maven2/emma/emma/2.1.5320/emma-2.1.5320.jar)
place them in the
lib directory. Then invoke
To run the the full integration tests, use
./setup.sh # This builds CATG and copy it to lib/ python testall.py
To run tests and see coverage report, use
gradle build gradle jacocoTestReport
This runs the tests using online concolic execution. To run tests with offline concolic execution, use
python --offline testall.py
If you want to generate tests on a Java class file having a main method, you need to use the concolic.py script. For example, the following command generates test inputs for the class tests.Testme (the java source of this class can be found in src/integration/java/tests/Testme.java.
python concolic.py --coverage 100 tests.Testme
python janala/concolic.py -h usage: concolic.py [-h] [--offline] [-v] [-c] [-D D] maxIterations className [arguments [arguments ...]]
maxIterations Maximum number of times the program under test can be executed. className Java class to be tested. arguments Arguments passed to the program under test.
-h, --help show this help message and exit --offline Perform concolic testing offline. An intermediate trace file is generated during the execution of the program. offilne mode results in 2X slowdown that non-offline mode -v, --verbose Print commands that are executed. -c, --coverage Compute detailed coverage by rerunning tests. -D D JVM options