Skip to content

Commit

Permalink
Better (most likely final) formatting for the test-reports-overview.html
Browse files Browse the repository at this point in the history
  • Loading branch information
@avodonosov
avodonosov committed Nov 26, 2011
1 parent 4055e27 commit 3a160d3
Show file tree
Hide file tree
Showing 2 changed files with 277 additions and 14 deletions.
269 changes: 256 additions & 13 deletions reports-generated/reports-overview.html
View file
Original file line number Diff line number Diff line change
@@ -1,14 +1,257 @@
<html>
<head><title>Reports Overview - CL Test Grid</title>

<style type="text/css">

body {
width: 45em;
margin-left: auto;
margin-right: auto;
}

h1 a {
text-decoration: none;
}

.test-table {
border-spacing: 0px;
}

.test-table td {
font-weight: bold;
}

.test-table .ok {
color: green;
}

.test-table .fail {
color: red;
}

.test-table .no-resource {
color: gray;
}

.test-table td {
padding: 3px;
}

table.links-to-pivots td {
padding: 4px 6px;
text-align: center;
}

.links-to-pivots table {
display: inline-table;
border-width: 2px 1px 1px 2px; /* right and bottom are
1px because TH also has 1px
at these sides and together
they form 2px
*/

border-style: solid;
border-color: #0000EE;
border-spacing: 0;
color: #0000EE;
}

.links-to-pivots table td, .links-to-pivots table th{
border: solid #0000EE;
border-width: 0 1px 1px 0;
padding: 2px 0.5ex;
text-align: left;
font-weight: bold;
}

.links-to-pivots a {
text-decoration: none;
}

</style>

</head>
<body>
<h1><a href="http://github.com/cl-test-grid/cl-test-grid">CL Test Grid</a> Reports Overview</h1>

<h3> Pivot Reports </h3>
<a href="pivot_ql_lisp-lib.html">QL / Lisp,Lib</a><br/>
<a href="pivot_ql_lib-lisp.html">QL / Lib,Lisp</a><br/>
<a href="pivot_lisp_lib-ql.html">Lisp / Lib,QL</a><br/>
<a href="pivot_lisp_ql-lib.html">Lisp / QL,Lib</a><br/>
<a href="pivot_lib_lisp-ql.html">Lib / Lisp,QL</a><br/>
<a href="pivot_lib_ql-lisp.html">Lib / QL,Lisp</a><br/>
<br/>
<a href="pivot_ql-lisp_lib.html">QL,Lisp / Lib</a><br/>
<a href="pivot_ql-lib_lisp.html">QL,Lib / Lisp</a><br/>
<a href="pivot_lisp-lib_ql.html">Lisp,Lib / QL</a><br/>
<a href="pivot_lisp-ql_lib.html">Lisp,QL / Lib</a><br/>
<a href="pivot_lib-lisp_ql.html">Lib,Lisp / QL</a><br/>
<a href="pivot_lib-ql_lisp.html">Lib,QL / Lisp</a><br/>

<p>Pivot reports allow us to summarize all the test results
into 2-dimensional tables.</p>

<p>For illustration:</p>

<table border="1" align="center" class="test-table">
<tr>
<td>&nbsp;</td><td>&nbsp;</td><td>sbcl-1-win</td><td>sbcl-1-linux</td><td>clisp-win</td>
</tr>
<tr>
<td rowspan="3">quicklisp distro 1</td><td>flexi-stream</td><td class="ok">ok</td><td class="fail">fail</td><td class="ok">ok</td>
</tr>
<tr>
<td>drakma</td><td class="fail">fail</td><td class="ok">ok</td><td class="no-resource">no-resource</td>
</tr>
<tr>
<td>babel</td><td class="fail">ok</td><td class="ok">ok</td><td class="fail">fail</td>
</tr>
<tr>
<td rowspan="3">quicklisp distro 2</td><td>flexi-stream</td><td class="ok">ok</td><td class="fail">fail</td><td class="ok">ok</td>
</tr>
<tr>
<td>drakma</td><td class="fail">fail</td><td class="ok">ok</td><td class="no-resource">no-resource</td>
</tr>
<tr>
<td>babel</td><td class="fail">ok</td><td class="ok">ok</td><td class="fail">fail</td>
</tr>
<tr>
<td rowspan="3">quicklisp distro 3</td><td>flexi-stream</td><td class="ok">ok</td><td class="fail">fail</td><td class="ok">ok</td>
</tr>
<tr>
<td>drakma</td><td class="fail">fail</td><td class="ok">ok</td><td class="no-resource">no-resource</td>
</tr>
<tr>
<td>babel</td><td class="fail">ok</td><td class="ok">ok</td><td class="fail">fail</td>
</tr>
</table>

<p>Depending on what fields we choose for rows and columns,
we have 12 possible combinations (the links are clickable):</p>

<table class="links-to-pivots" align="center">
<tr>
<td>
<a href="pivot_lib_ql-lisp.html">
<table>
<tr><td>&nbsp;</td><td>ql</td></tr>
<tr><td>&nbsp;</td><td>lisp</td></tr>
<tr><td>lib</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_lib_lisp-ql.html">
<table>
<tr><td>&nbsp;</td><td>lisp</td></tr>
<tr><td>&nbsp;</td><td>ql</td></tr>
<tr><td>lib</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_ql_lib-lisp.html">
<table>
<tr><td>&nbsp;</td><td>lib</td></tr>
<tr><td>&nbsp;</td><td>lisp</td></tr>
<tr><td>ql</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_ql_lisp-lib.html" >
<table>
<tr><td>&nbsp;</td><td>lisp</td></tr>
<tr><td>&nbsp;</td><td>lib</td></tr>
<tr><td>ql</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_lisp_lib-ql.html">
<table>
<tr><td>&nbsp;</td><td>lib</td></tr>
<tr><td>&nbsp;</td><td>ql</td></tr>
<tr><td>lisp</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_lisp_ql-lib.html">
<table>
<tr><td>&nbsp;</td><td>ql</td></tr>
<tr><td>&nbsp;</td><td>lib</td></tr>
<tr><td>lisp</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
</tr>
<tr>
<td>
<a href="pivot_lib-ql_lisp.html">
<table>
<tr><td>&nbsp;</td><td>&nbsp;</td><td>lisp</td></tr>
<tr><td>lib</td><td>ql</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_lib-lisp_ql.html">
<table>
<tr><td>&nbsp;</td><td>&nbsp;</td><td>ql</td></tr>
<tr><td>lib</td><td>lisp</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_ql-lib_lisp.html">
<table>
<tr><td>&nbsp;</td><td>&nbsp;</td><td>lisp</td></tr>
<tr><td>ql</td><td>lib</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_ql-lisp_lib.html">
<table>
<tr><td>&nbsp;</td><td>&nbsp;</td><td>lib</td></tr>
<tr><td>ql</td><td>lisp</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_lisp-lib_ql.html">
<table>
<tr><td>&nbsp;</td><td>&nbsp;</td><td>ql</td></tr>
<tr><td>lisp</td><td>lib</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
<td>
<a href="pivot_lisp-ql_lib.html">
<table>
<tr><td>&nbsp;</td><td>&nbsp;</td><td>lib</td></tr>
<tr><td>lisp</td><td>ql</td><td>&nbsp;</td></tr>
</table>
</a>
</td>
</tr>
</table>

<h3>Test Runs Report</h3>
<p>The <a href="test-runs-report.html">Test Runs Report</a> is a table where
every test run is represented by row. Columns include test run description
(lisp implementation, quicklisp distro, user contact, etc.) + a column for
every library test status (ok/fail) linked to the corresponding library test log.</p>

<h3>CSV Export</h3>
<p>The full database dump to a <a href="export.csv">CSV file</a> may be used to
import the test results into Excel, Open Office Calc, Google Spreadsheet, or
other data analisys software.</p>

<h3>Lisp Data</h3>
<p>All the above reports where generated from Common Lisp data contained in the
<a href="https://raw.github.com/cl-test-grid/cl-test-grid/master/db.lisp">db.lisp</a>
file.
The format is simple list which may be read by a single <tt>read</tt> call.</p>
<p>For convenience, use <tt>(test-grid:read-db)</tt> if you have the sources
checked out, or this code otherwise:
<pre>
(with-open-file (in <a href="https://raw.github.com/cl-test-grid/cl-test-grid/master/db.lisp">#P"db.lisp"</a>
:direction :input
:element-type 'character)
(with-standard-io-syntax
(let ((*read-eval* nil))
(safe-read in)))))))
</pre>

</body>
</html>
22 changes: 21 additions & 1 deletion test-grid.lisp
View file
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ TODO:
- A pivot -like table report of library test results, allowing
rows/columns to be any of quicklisp distro, lisp version
library name. With grouping and sorging.
+ CSV export of the database to use it then with spreadsheets,
- CSV export of the database to use it then with spreadsheets,
google fusion tables, etc. Initial intent
was to format it as a pivot for various projections
(by quicklisp releases, by platform, etc).
Expand All @@ -58,10 +58,27 @@ TODO:
to represent test result(s) for a particular
library, i.e. :ok, :fail, :no-resource).
5h
- Test that the test-duration field value
(Common Lisp rational) can be read
by spreadsheet software (MS/Open Offices,
Google Spreadsheets).
- an informer which may be embedded into a library
project page, with reports about the test statuses
for this single library on various platforms with
various quicklisp versions
- an overview page with brief explanation of all
the above reports and links to the reports.
- change
"represents every test run as a separate row"
to
"represents every <tt>test-grid:run-tests</tt> as a separate row"
(after user will know this command from the main project description)
?
- Description of CSV report may link to an example
of the CSV report imported to a Google Spreadsheet
with pivot calculating avearage duration of
tests for every library.
- spell check
- simple UI (command line) with guiding messages
for the user who runs the tests. Spend as little
efforts as possible on this task, to release quickly.
Expand Down Expand Up @@ -100,6 +117,9 @@ TODO:
- For all the libraries which need manual configuration
(cffi, usocket) provide giding message to the
user how to configure them.
- finalize the decision what command user runs
to performs the tests. Describe this main command
in the README (in the first paragraph).
==================================================
========== Milestone: release 0 ============
Expand Down

0 comments on commit 3a160d3

Please sign in to comment.