Export coverage

[vweevers]

Closes #162.

This disables coverage by default. If --coverage is passed, airtap collects code coverage per browser, written to .nyc-output/airtap-<hash>.json in Istanbul 1.0 format. One can generate reports with nyc report (nyc takes care of merging files from multiple browsers). In local mode, airtap writes to .nyc-output/airtap-local.json (so that no cleanup is necessary between repeated runs, e.g. if you refresh the page).

Usage in CI is airtap --sauce-connect --loopback airtap.local --coverage test.js, and if you want, add a Travis hook to post results to coveralls:

after_success: npm run coverage

"scripts": {
  "coverage": "nyc report --reporter=text-lcov | coveralls"
}

Later we should:

• Remove the "Code coverage" tab from the UI (IMO)
• Remove previous files before all tests start (this only matters when running locally and you also run node tests and already have files in .nyc-output)
• Make it more generic (not tied to nyc)
• Move the middleware to a module
• Support coverage in electron

[ralphtheninja]

Super!

[ralphtheninja]

Later we should:

Remove the "Code coverage" tab from the UI (IMO)
Remove previous files before all tests start (this only matters when running locally and you also run node tests and already have files in .nyc-output)
Make it more generic (not tied to nyc)
Move the middleware to a module
Support coverage in electron

@vweevers Please create some issues for this.

[vweevers]

Please create some issues for this.

Of course. I figured I'd wait for feedback first.

[vweevers]

I think before merging, I want to test this against memdown (and Sauce Labs).

[ralphtheninja]

@vweevers Maybe we should take parts of this PR description and put into the README. WDYT?

[vweevers]

Sure, why not :)

[ralphtheninja]

Hmm, unsure where to put the information. The doc/ folder is kind of hidden. Maybe we should link from the README to those .md files.

[ralphtheninja]

Aah nevermind, some are linked already.

[vweevers]

See also #33

[ralphtheninja]

See also #33

Adding it to the milestone.

[vweevers]

Opened issues:

• Remove "Code coverage" tab from the UI: Remove "Code coverage" tab from the UI #202
• Remove previous nyc_output before all tests start: Remove previous nyc_output before all tests start #203
• Make it more generic (not tied to nyc) I'm fine with this setup
• Move the middleware to a module: Move coverage middleware to a module #204
• Support coverage in electron: Support code coverage in Electron #205