Travis Scanner

This is the repository of the paper "An Analysis of 35+ Million Jobs of Travis CI".

If you are using this repository please cite it like this

@inproceedings{DurieuxTravis19,
  author    = {Thomas Durieux and
               Rui Abreu and
               Martin Monperrus and
               Tegawend{\'{e}} F. Bissyand{\'{e}} and
               Luis Cruz},
  title     = {An Analysis of 35+ Million Jobs of Travis {CI}},
  booktitle = {2019 {IEEE} International Conference on Software Maintenance and Evolution,
               {ICSME} 2019, Cleveland, OH, USA, September 29 - October 4, 2019},
  pages     = {291--295},
  publisher = {{IEEE}},
  year      = {2019},
  url       = {https://doi.org/10.1109/ICSME.2019.00044},
  doi       = {10.1109/ICSME.2019.00044}
}

Install

cd script
npm install
npm run-script build

Usage

Download jobs

Download all the Travis-CI jobs into DEST folder (see script/collect.js). The JSON files are called X-Y.json, eg 480037011-480037260.json. This means that the file contains all jobs between 480037011 and 480037260. This is way more performant that saving one job per file.

npm run-script collect

TravisCI real-time

User interface that monitors the jobs that are currently running at Travis-CI

npm run-script server
open http://localhost:9080

Parse Travis-CI log

const log_parser = require("./parser/parser-init").parser;
job = {id: '480040000'}
log_parser(job, (tests, errors) => {
    job.tests = tests;
    job.errors = errors;
    let count = 0;
    let nbFailure = 0;
    let nbError = 0;
    let nbSkipped = 0;
    let time = 0.0;
    for (let test of tests) {
        count += test.nbTest;
        nbFailure += test.nbFailure;
        nbError += test.nbError;
        nbSkipped += test.nbSkipped;
        time += test.time;
    }
    console.log(count, nbFailure, nbError, nbSkipped, time, errors.length)
});