UI Testing Checklist

Before Overture is released it must be checked that all of the basic operations of the tool are sound. The following is a check-list for testing the Overture UI.

• Creating projects
  • For each type: SL, PP, RT
    • File/New/Project
    • Check inclusion of libraries
  • Check creation of new files in a project
• Editor
  • Check for syntax errors as you type
  • Check for type checking as you save
  • Check editor matches Outline view and Outline navigation works
  • Check problems appear in Problems view and link with editor
• Execution
  • Creation of a launcher
  • Check entry point, remote control and Console modes
  • Check generate coverage, including PDF output
  • Check runtime switches
  • Check output appears in Console
  • Check the Quick Interpreter - including expression recall
• Debugging
  • Check the layout of the perspective
  • Create a breakpoint and check stack
  • Check single stepping, step into, step over and stop
  • Debug multi-threaded spec with breakpoints
  • Check that invariant failures trap into debugger
  • Check that deadlock traps into debugger
  • Check variable displays at breakpoint, including history counters
  • Try skip all breakpoints
  • Create some "watches" and check they are evaluated at breaks
• Combinatorial Testing
  • Check the layout of the perspective
  • Perform a basic CT test and check results
  • Perform a large CT test and check nesting of results
  • Perform a CT test with filtering and check results
• Proof Obligations
  • Check the layout of the perspective
  • Generate a reasonable set of POs and check display
  • Check linked navigation in Editor view
• Workspace Settings
  • Check for classic/VDM10 mode switching
  • Check VDMTools integration
• Code Generation
  • Check basic generation works
• Pretty printing
  • Check that the pretty printer works with/without test coverage
• Miscellaneous
  • Check basic Eclipse functions, like Find in Files, Search etc.
  • Check project export and import works
  • Check the Help/About screen is accurate