Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
.cm adding AEC and html generator Dec 4, 2015
module major update! Jul 13, 2018
person major update! Jul 13, 2018
script major update! Jul 13, 2018
wfe minor fixes Aug 14, 2018
.ckr.json added missing CK repo deps Jun 18, 2018
.gitignore AE dummy files Sep 20, 2015
CONTRIBUTIONS fixing names Nov 13, 2016 clean up Aug 12, 2018

logo logo

This is a Collective Knowledge repository with sources and templates for Artifact Evaluation evaluation website.


Install Collective Knowledge (CK) on Linux, Windows or MacOS as described in this Read Me.

Pull this repository:

 $ ck pull repo:ck-artifact-evaluation

Note that dependency on ck-web and other CK repositories will be automatically resolved.

 $ ck start web
 $ Open web page: http://localhost:3344/?template=artifact-evaluation&page=index

That's all!

Note, that it is also possible to create a static website for as follows:

 $ cd `script/compile-website-adapt-workshop`
 $ ./

or on Windows:

 $ ck find script/compile-website-adapt-workshop
 $ cd /D {above directory}
 $ create_website.bat

CK will create all static html pages in the "tmp-website" sub-directory that you can upload to your web server.


Just send a pull request and contact Grigori Fursin to upload your updates to .

Public discussions

Artifacts in the CK format

We promote collaborative and reproducible research where artifacts and workflows are shared along with papers in a common "plug&play" format to let the community quickly reuse them and thus accelerate science!

Please check ACM proceedings of our 1st ACM ReQUEST tournament with a live scoreboard and with all artifacts and workflows shared in a common CK format!

You can also check this reusable and customizable artifact from CGO'17 with automatic cross-platform software installation and web-based experimental dashboard powered by the CK framework:

Vision publications

  author =    {Grigori Fursin},
  title =     {{Collective Tuning Initiative}: automating and accelerating development and optimization of computing systems},
  booktitle = {Proceedings of the GCC Developers' Summit},
  year =      {2009},
  month =     {June},
  location =  {Montreal, Canada},
  keys =      {}
  url  =      {}
 author = {Fursin, Grigori and Dubach, Christophe},
 title = {Community-driven Reviewing and Validation of Publications},
 booktitle = {Proceedings of the 1st ACM SIGPLAN Workshop on Reproducible Research Methodologies and New Publication Models in Computer Engineering},
 series = {TRUST '14},
 year = {2014},
 isbn = {978-1-4503-2951-4},
 location = {Edinburgh, United Kingdom},
 pages = {5:1--5:4},
 articleno = {5},
 numpages = {4},
 url = { },
 doi = {10.1145/2618137.2618142},
 acmid = {2618142},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {collaborative artifact evaluation, collective mind, community-driven journals, crowdsourcing paper reviewing, reproducible research, software and hardware dependencies},
    title = {{Collective Knowledge}: towards {R\&D} sustainability},
    author = {Fursin, Grigori and Lokhmotov, Anton and Plowman, Ed},
    booktitle = {Proceedings of the Conference on Design, Automation and Test in Europe (DATE'16)},
    year = {2016},
    month = {March},
    url = {}