Skip to content

IanDarwin/annabot

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
doc
 
 
 
 
lib
 
 
 
 
src
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

AnnaBot - Annotation Assertion Based Object Testing

This project now supports maven building. The Eclipse build and other IDEs are unsupported.

For a quick demo, you should be able to run

mvn clean package assembly:single
java -jar target/annabot-1.0.0-SNAPSHOT-jar-with-dependencies.jar claimclasses systestclasses

Does NOT work at present; I need to move some files around and then update the demo command.

Remember: git update periodically. Send a pull request (or, if you must, a git diff -u or Eclipse patch).

The Main Programs

There are three main programs in the annabot package:

  • AnnaBot - the real main; use this!

  • AnnaBot0 - a test-like program

  • AnnaBotC - the Antlr-based compiler for .claim files; unfinished

Running with Maven

You can do mvn clean package assembly:single to compile, run tests, and make two Jar files, one with just our code, the other with all deps. Both appear in the target folder.

RUNNING ON ECLIPSE (old info, may not work).

The git project annabot is the root of an Eclipse project. The setup is a bit unusual: there are several source folders AND several output folders:

Input			Output
-----			------
src,regress		build
javaclaims		javaclaimclasses
dslclaims		-
systests		systestclasses

To set up for developing and testing AnnaBot as an Eclipse project, assuming you checked it out under Eclipse as a project:

1) Create a new JUnit 4 Run Configuration:

Name: AnnaBot Unit Tests
Class: AnnaBotTests

Run this; it should run > 50 tests and give a green bar.

2) Create a Java Application Configuration

Name: AnnaBot System Tests
Class: annabot.AnnaBot
Arguments -> Application Arguments: claimclasses systestclasses

Run this; it should give output something like the following:

Using 7 claims from directory claimclasses Checking 4 targets from directory systestclasses AnnaBot: Initialization took 0.1 seconds class violations.JPAEntityNoArgConstructor: JPA Entities must have a no-arg constructor class violations.JPAEntityMethodFieldAnnotated: JPA Entity must have an ID class violations.JPAEntityMethodFieldAnnotated: JPA Entities may have field OR method annotations, not both class violations.JPAEntityHasId: JPA Entity must have an ID class violations.JPAEntitySetMethodAnnotated: JPA Entities may have field OR method annotations, not both AnnaBot: found 5 error(s) in 4 classes, time 0.3 seconds

Now you can dive in and start working on the code!

OTHER IDEs

If you want it, nobody will stop you. If you get it working, please feel free to fork the project and send a pull request to include your IDE’s configuration files.

WRITING NEW CLAIMS

Each Claim class has three required methods:

/* return the description of the problem this claim finds */
public abstract String getDescription();
/** Return a list of Operators that are the "if" part of
 * a claim; if any of these operators fails, the class
 * will be bypassed and considered successful for this claim.
 */
public abstract Operator[] getClassFilter();
/** Return a list of Operators, all of which must return
 * true for this class to be considered successful against
 * this claim.
 * Only called if the Operators in getClassFilter all pass.
 */
public abstract Operator[] getOperators();

Examine the existing claims folder for some examples. Please contribute back to the project any claims that you develop for public APIs - thank you!

Testing the tester

A testing tool must itself be tested, to provide a chain of trust. The individual elements, such as the tree package’s And, AtMostOne, and friends, are all tested routinely using Junit [TestInfected]. These can be independently verified by invoking any standard JUnit4 test runner on the class tree.AllTests found in the regress folder. These are invoked automatically when you build with Maven. This also includes some tests for the basic functionality of the AnnaBot control program.

In addition, there are integration tests showing that AnnaBot does detect the failure modes described by the Claim files for JPA; these are available in the systests folder of the project.

Given these tests, I did not immediately see a need to do permutation testing on a body of existing code, since the Integration Tests provided with the package will provide an assurance that the package will find erroneous annotations it they exist. An anonymous reviewer convinced me that mutation testing is regarded as a standard approach. Manually introducing several errors into one of the sample codebases (the Toronto Centre for Phenogenomics, see Section 4) and re-running the program ensured that the errors were correctly detected.

Tests of the ClassSource files (used to discover classes in Jar files and in directory hierarchies) are in the author’s darwinsys-api project, available from the same git repository as AnnaBot itself.

About

Annotations usage tester for Java

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published