Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Clone this wiki locally
[ Home ]
This page has been deprecated. Automatically generated list of all CK repositories and their dependencies is now available at http://cKnowledge.org/shared-repos.html !
Table of Contents
Here you can find a manually updated list of shared CK repositories.
You can easily install any Git based repository via
$ ck pull repo --url=[URL to a GIT-based CK repository]
If CK-powered repository is shared via https://github.com/ctuning, you can easily install it by name:
$ ck pull repo:[repo name]
For example, you can pull CK repository for universal and multi-objective autotuning via
$ ck pull repo:ck-autotuning
By default, all pulled repositories are stored in a USER space in the CK directory. If required, this directory can be changed via CK_REPOS environment variable.
Note, that we use https protocol by default. However, if you would like to use git protocol instead, just add --git flag to the above command line.
It is possible to update any shared repository using the same pull command. It is also possible to automatically update all shared Git-based CK repositories via:
$ ck pull all
You can list all new entries from a pulled repository via:
$ ck list [repo_name]:: --all
Note, that it is possible to share CK repositories as zip archives (useful to share artifacts along with publications and add them as supplementary material for ACM Digital Library, for example). Such repositories can be installed via
$ ck add repo:[repo_name] --zip=[zip archive name or full URL if not at github.com/ctuning] --quiet
Finally, you can find all shared modules from CK repositories Shared-modules.
- ck-env (ck pull repo:ck-env) - enable package installation across different platforms (hardware, OS, libs) and simplify co-existence of multiple versions of tools and libraries during experimentation.
- ck-analytics (ck pull repo:ck-analytics) - CK experimentation, statistical analysis, predictive analytics and graphs.
- ck-docker (ck pull repo:ck-docker) - automation of various Docker tasks (build, run, pull) via CK with examples.
- ck-web (ck pull repo:ck-web) - CK web front-end for interactive articles, graphs and tables (see example of our live CK-powered repo here).
- ck-autotuning (ck pull repo:ck-autotuning) - customizable multi-objective program autotuning/benchmarking (OpenCL/CUDA/MPI/algorithm/compiler flags/etc) and design space exploration for heterogeneous multicore systems (see DATE'16 paper and interactive report).
- ck-crowdtuning (ck pull repo:ck-crowdtuning) - universal engine to crowdsource experiments across various platforms (cloud, mobile phones, tablets, laptops, data centers, etc) such as multi-objective autotuning (OpenCL, compiler flags, etc).
- ck-crowdtuning-platforms (ck pull repo:ck-crowdtuning-platforms) - descriptions of platforms participated in experiment crowdsourcing (automatically and manually added features for predictive analytics).
- ctuning-programs (ck pull repo:ctuning-programs) - CK repository with benchmarks and codelets shared by the community (to move from rigid, outdated and non representative benchmarks to continuously evolving and realistic applications and kernels).
- ctuning-datasets-min (ck pull repo:ctuning-datasets-min) - CK repository with a minimal set of shared data sets (for above programs).
- ck-dissemination-modules (ck pull repo:ck-dissemination-modules) - modules for artifact evaluation and knowledge dissemination.
- ck-request - CK artifacts and workflows from open ACM ReQuEST tournaments on SW/HW co-design of AI workloads (speed, accuracy, costs)
- CK AI artifact locator - beta browser of customizable, portable and reusable AI artifacts in the CK format
- ck-tensorflow (ck pull repo:ck-tensorflow') - CK-based crowd-benchmarking and crowd-tuning for TensorFlow DNN framework [IOWCL'16 paper].
- ck-caffe (ck pull repo --url=https://github.com/dividiti/ck-caffe) - CK-based crowd-benchmarking and crowd-tuning for Caffe DNN framework [IOWCL'16 paper].
- ck-mxnet (ck pull repo:mxnet) - CK-based workflows to install and use MXNet DNN framework across diverse platforms and environments.
- ck-caffe2 (ck pull repo:ck-caffe2) - CK-based crowd-benchmarking and crowd-tuning for Caffe DNN framework [IOWCL'16 paper].
- ck-tinydnn (ck pull repo:ck-tinydnn') - CK-based crowd-benchmarking and crowd-tuning for TinyDNN (on-going project to unify any workload crowd-benchmarking and crowd-tuning).
- ck-cntk (ck pull repo:cntk) - CK-based workflows to install and use Microsoft Cognitive Toolkit across different platforms and environments.
Workflows and artifacts from international projects and ACM/IEEE conferences:
- reproduce-cgo2017-paper (ck pull repo --url=https://github.com/SamAinsworth/reproduce-cgo2017-paper) - Artifacts from the ACM CGO'17 paper "Software Prefetching for Indirect Memory Accesses" by S.Ainsworth and T.M.Jones [paper PDF with Artifact Appendix].
- IA3_Paper16_ArtifactEvaluation (ck pull repo --url=https://github.com/vasupsu/IA3_Paper16_ArtifactEvaluation) - Artifacts from the IA3@SuperComputing'18 paper "Optimizing Word2Vec Performance on Multicore Systems" by V.Rengasamy et.al. [paper PDF with Artifact Appendix].
- artifact.zip via ACM Digital Library (download and install manually at the moment - we collaborating with ACM to automate this process) - Artifacts from the SuperComputing'15 paper "A parallel connectivity algorithm for de Bruijn graphs in metagenomic applications" by P.Flick et.al. [ACM DL page with CK artifact].
- ck-wa (ck pull repo:ck-wa) - CK front-end and experimental workflows for ARM workload automation framework to crowdsource benchmarking and auto-tuning of realistic workloads using diverse hardware with latest environment (see ARM TechCon'16 presentation and DATE'16 paper).
- gemmbench (ck pull repo --url=https://github.com/dividiti/gemmbench) - Crowd-benchmarking, autotuning and crowd-tuning of various implementations of GEMM algorithm with multiple data sets shared by the community (see ADAPT'16 paper for more details).
- ck-dissemination (ck pull repo --url=https://github.com/gfursin/ck-dissemination) - Grigori Fursin's R&D notes in the CK format.
- ck-clsmith (ck pull repo:ck-clsmith) - CLSmith tool from Imperial College to detect OpenCL bugs (originally published at PLDI'15). See ADAPT'16 paper for more details.
- ck-lift (ck pull repo --url=https://github.com/lift-project/ck-lift) - CK workflow for Edinburgh's Lift compiler.
- reproduce-milepost-project (ck pull repo:reproduce-milepost-project) - artifacts from our past MILEPOST project to extract program semantic features and reproduce machine-learning based compilation.
- reproduce-carp-project (ck pull repo:reproduce-carp-project) - artifacts (code and data) from the EU FP7 CARP project (polyhedral optimization).
- reproduce-pamela-project (ck pull repo:reproduce-pamela-project) - artifacts (code and data) and experimental workflows to build and run various SLAM implementations across diverse devices using CK framework!
- reproduce-ck-paper (ck pull repo:reproduce-ck-paper) - misc artifacts from our CPC'15 paper on performance- and cost-aware software engineering (not yet completed).
Grigori Fursin shared all data sets from the PLDI'10 paper "Evaluating iterative optimization across 1000 datasets" in the Collective Knowledge Format via Google Drive:
We suggest to share large CK repositories in zip archive via BitTorrent to optimize sharing (upload and download) of such repositories across multiple users. We use the following file name convention for such repositories: ckr-<repo></repo>-YYYYMMDD.zip.
- ckr-32332f6412da1be1-20150803.zip (~287Mb) - Data sets (MiDatasets and cDatasets) from our past R&D to crowdsource autotuning and benchmarking (crowd-tuning and crowd-benchmarking). Get torrent here.