Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Data for perl6 roast data for various implementations.
Shell Perl Perl6
tree: ef7d533271

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
bin
.gitignore
LICENSE
README
cull
doit
niecza_summary.out
perl6_pass_rates
pugs_summary.out
rakudo_summary.out

README

"Perl6 Roast Data"
    This project contains tools for running the perl6 spec test suite
    (roast) by several different implementations, as well as tracking the
    results of those runs.

    See "perl6_pass_rates" for the data.

    Each implementation's last run is checked in under a corresponding
    ".out" file. Check your implementation's file for any failures or
    unexpected passes.

"Why don't all tests pass?"
    Each implementation shares roast with all the other
    implementations. If a test is added, it might not be immediately
    fudged to work on all implementations - in fact, depending on what
    is being tested, the entire file may start failing in some
    implementations.

    The test numbers are run daily from a limited cron environment. If
    the test is expecting things (like an environment variable) these
    assumptions need to be added to the implementation's script in
    bin/
 
    Finally, these tests are run on a schedule; it's not expected that
    commits to spec and to an implementation will be synchronized
    with the running of this harness; give new tests a day to settle in.

    If you notice a test is continually failing (check the history of the
    implementation's .out file), please open a ticket with that implementation.

"How to Help - Pugs"

    Since Pugs is in maintenance mode at this point, any new tests are not
    likely to get a patch to work; To keep Pugs green, any failing tests
    should be fudged. For most tests, this involves prefixing the test
    with:

    #?pugs todo
  
    If this still doesn't allow the test file to complete, change the todo
    to a skip - this requires a reason; either put in the error diagnostic
    or the word "parsefail", e.g.:

    #?pugs skip 'No compatible multi variant found: "&is"'

    If you still can't get a test file to pass, drop by #perl6.
Something went wrong with that request. Please try again.