Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Test gen #186
This PR adds a generic
This PR includes wrapper scripts for evosuite and randoop and a test script, which Travis executes in the first testing stage.
This PR also adds a new parameter for test generation, test mode: regression or error-revealing.
I agree with @jose's comments and I would suggest a four-file system for all test generators:
Both EvoSuite and Randoop has several command-line parameters that may be altered for test generation. This should be handled in a way that does not require changing the core script. I definitely run experiments where I feed in all sorts of different EvoSuite configurations, and it would be risky to touch the "evosuite.sh" file with automated scripts.
Instead, scripts could edit the .config file. The .default.config file is there to retain the "default" values, and can be used to restore .config back to "normal".
Addressing the core questions in your opening post:
They seem fine, but I would also put them in a separate config file (see above)
Are the "credit" files correct?
They are the papers I would choose. You can, of course, contact the authors and ask what they would prefer.
Should this PR immediately delete the obsolete scripts run_evosuite.pl and run_randoop.pl?
Yes. Some experiment scripting (including my own) will need to be updated, but I think it would be confusing to have multiple ways to run test generation in the framework.
Should this PR immediately delete the randoop/evosuite functionality from Project.pm?
See above. Let's enable test generation in a consistent, universal manner.
I have added a script that can test the test generation process for one or more specified bugs: framework/test/test_generate_suites.sh. I think this branch is ready to merge into master once we decide on which we want to do of the following:
* Added a generic test-generation script. * Added wrapper scripts for Randoop and EvoSuite. * Made test mode (regression vs. error-revealing) a parameter. * Export list of relevant (loaded) classes to d4j properties file. * Added script to test test generation for arbitrary bugs * Removed test-gen functionality from Project module. Co-authored-by: Michael Ernst <firstname.lastname@example.org> Co-authored-by: Gregory Gay <email@example.com>