Skip to content

Week of July 20th

Jump to bottom Edit New page
Rahul Krishna edited this page Aug 3, 2015 · 12 revisions

Defect Data

Summary

Data set Baseline Base+FSS HOW CART XTREES
Ant
Jedit
Lucene
Poi
Ivy

Quartile Charts

## synapse

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.55  ,  0.08 (               *              ), 0.55,  0.55,  0.63
   1 ,         cart ,    0.55  ,  0.08 (               *              ), 0.55,  0.55,  0.63
   1 ,      baseln0 ,    0.64  ,  0.26 (       --------|----*         ), 0.42,  0.64,  0.67
   2 ,          HOW ,    0.65  ,  0.05 (               |    -*        ), 0.63,  0.65,  0.67
   2 ,      baseln1 ,    0.65  ,  0.00 (               |     *        ), 0.65,  0.65,  0.65

## ivy

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.78  ,  0.15 (    -----------|---*          ), 0.62,  0.78,  0.78
   1 ,         cart ,    0.78  ,  0.17 (       --------|---*          ), 0.65,  0.78,  0.82
   1 ,      baseln0 ,    0.78  ,  0.07 (               | --*          ), 0.75,  0.78,  0.82
   2 ,          HOW ,    0.85  ,  0.00 (               |           *  ), 0.85,  0.85,  0.85
   2 ,      baseln1 ,    0.85  ,  0.00 (               |           *  ), 0.85,  0.85,  0.85

## jedit

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.45  ,  0.18 (           ----|-*            ), 0.36,  0.45,  0.55
   1 ,         cart ,    0.45  ,  0.18 (           ----|-*            ), 0.36,  0.45,  0.55
   2 ,          HOW ,    0.55  ,  0.00 (               |       *      ), 0.55,  0.55,  0.55
   2 ,      baseln0 ,    0.55  ,  0.00 (               |       *      ), 0.55,  0.55,  0.55
   2 ,      baseln1 ,    0.55  ,  0.00 (               |       *      ), 0.55,  0.55,  

## poi

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.40  ,  0.12 (       --*     |              ), 0.36,  0.40,  0.48
   1 ,         cart ,    0.43  ,  0.13 (       ----*   |              ), 0.37,  0.43,  0.50
   2 ,      baseln0 ,    0.54  ,  0.10 (               |-*            ), 0.50,  0.54,  0.60
   2 ,          HOW ,    0.58  ,  0.16 (             --|---*          ), 0.46,  0.58,  0.62
   3 ,      baseln1 ,    0.61  ,  0.08 (               |  ---*        ), 0.56,  0.61,  0.63

## ant

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.43  ,  0.24 (    -----------|-*            ), 0.22,  0.43,  0.46
   1 ,         cart ,    0.43  ,  0.25 (   ------------|-*            ), 0.22,  0.43,  0.46
   2 ,      baseln0 ,    0.48  ,  0.11 (               |----*         ), 0.42,  0.48,  0.53
   2 ,          HOW ,    0.52  ,  0.04 (               |     --*      ), 0.50,  0.52,  0.54
   2 ,      baseln1 ,    0.53  ,  0.01 (               |       *      ), 0.52,  0.53,  0.53

Config Data

Summary

Data set Baseline Base+FSS HOW CART XTREES
SQL*
x264
Apache
BDBC
LLVM
BDBJ
** Negligible Improvement in SQL

Quartile Charts

## Apache 

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.66  ,  0.09 (  --*          |              ), 0.64,  0.66,  0.73
   1 ,         cart ,    0.69  ,  0.07 (     -*        |              ), 0.67,  0.69,  0.74
   2 ,          HOW ,    0.79  ,  0.03 (           -*  |              ), 0.77,  0.79,  0.80
   3 ,      baseln1 ,    1.00  ,  0.01 (               |         -*   ), 0.99,  1.00,  1.00
   4 ,      baseln0 ,    1.05  ,  0.05 (               |          ---*), 1.00,  1.05,  1.05

## BDBJ 

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,          HOW ,    0.63  ,  0.11 ( --*           |              ), 0.59,  0.63,  0.70
   2 ,         cart ,    0.75  ,  0.25 (  ------*      |              ), 0.62,  0.75,  0.87
   2 ,       xtrees ,    0.76  ,  0.10 (        *      |              ), 0.75,  0.76,  0.85
   3 ,      baseln0 ,    0.94  ,  0.06 (               |*             ), 0.94,  0.94,  1.00
   3 ,      baseln1 ,    1.00  ,  0.00 (               |   *          ), 1.00,  1.00,  1.00

## LLVM 

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.89  ,  0.04 ( -*            |              ), 0.89,  0.89,  0.93
   1 ,         cart ,    0.89  ,  0.01 ( -*            |              ), 0.89,  0.89,  0.89
   2 ,          HOW ,    0.92  ,  0.01 (        -*     |              ), 0.92,  0.92,  0.93
   3 ,      baseln1 ,    1.00  ,  0.00 (               |           --*), 1.00,  1.00,  1.00
   3 ,      baseln0 ,    1.00  ,  0.00 (               |            -*), 1.00,  1.00,  1.00

## X264 


rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,       xtrees ,    0.58  ,  0.15 ( *             |              ), 0.57,  0.58,  0.72
   1 ,         cart ,    0.59  ,  0.06 ( *             |              ), 0.57,  0.59,  0.62
   2 ,          HOW ,    0.71  ,  0.03 (      *        |              ), 0.69,  0.71,  0.73
   3 ,      baseln0 ,    1.00  ,  0.01 (               |  *           ), 0.99,  1.00,  1.00
   3 ,      baseln1 ,    1.00  ,  0.00 (               |  *           ), 1.00,  1.00,  1.00

## BDBC 

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,         cart ,    0.11  ,  0.03 (*              |              ), 0.09,  0.11,  0.12
   1 ,       xtrees ,    0.12  ,  0.02 (*              |              ), 0.11,  0.12,  0.12
   1 ,          HOW ,    0.19  ,  0.04 ( -*            |              ), 0.17,  0.19,  0.22
   2 ,      baseln1 ,    1.00  ,  0.09 (            -* |              ), 0.91,  1.00,  1.00
   3 ,      baseln0 ,    1.37  ,  0.04 (               |   *          ), 1.37,  1.37,  1.41

## SQL 

rank ,         name ,    med   ,  iqr 
----------------------------------------------------
   1 ,          HOW ,    0.98  ,  0.00 (         *     |              ), 0.98,  0.98,  0.98
   2 ,         CART ,    0.99  ,  0.05 (       --------|*             ), 0.97,  1.00,  1.02
   2 ,       xtrees ,    1.00  ,  0.01 (              -*              ), 0.99,  1.00,  1.01
   3 ,         Base ,    1.01  ,  0.01 (               |  *           ), 1.00,  1.01,  1.02
   3 ,     Base+FSS ,    1.02  ,  0.03 (               |   -----*     ), 1.01,  1.02,  1.03

# Deltas
## Ant
![image](https://cloud.githubusercontent.com/assets/1433964/8920497/dfecd6a4-3497-11e5-859c-a2b8ddb530e2.png)
## Ivy
![image](https://cloud.githubusercontent.com/assets/1433964/8920640/91e0a1f0-3499-11e5-85d2-389ad0fecf89.png)
Add a custom footer
Add a custom sidebar

Clone this wiki locally