This repository hosts documentation and code for the webapp behind csmetrics.org.
Table of Contents
Summary of methodology and data processing -- opens a separate document
Frequently asked questions -- opens a separate document
(Development of CSmetrics stops July 2018, we are open for the community to contribute and take over ... )
[Instructions for reproducing the ranking] (TODO)
- document weighting scheme of venues
- document+link to raw scores and how they are used
- document curation of categories
Defaults Load the page and then press the green 'Go' button to produce a combined aggregated metric (both measured and predicted) for 6729 institutions (academic and industry) for papers published in 2007 to 2016 at 209 conferences and 80 journals.
Figure 1. Quick Start User Guide.
Year slider Use this slider to change the year range of the measured (citations, retrospective) and predicted (prospective) metrics. By default the two ranges are mutually exclusive, click the slider to unlock and adjust the two year ranges independently.
Venue selection Click each area keyword to toggle inclusion/exclusion of conferences in the corresponding area. The list of conferences on the lower left and the list of acronyms on the right will update correspondingly. Use the check boxes on the left to select or deselect individual conferences. We have currated a list of CS conference/journal venues and their categories. Submit a pull request to propose edits to the venues.
Venue weighting The default venue weight is the geometric mean of the citations for all papers in the venue from 2007 to 2016. You can change the weight to equal (i.e., each conference has a weight of 1.0) with the “Venue weight” dropdown box on the right.
Combining metrics The α slider changes the relative geometric weighting of the measured versus predicted metric. We add a small constant ε to prevent invalid values when an institution has zero publications in a venue.
Navigating the institution list The webpage updates instantly without having to press the ‘Go’ button when you: change the list of institutions being ranked, change the entries per page, and flip pages. Otherwise, if you change the venues, years, or α, you need to select 'Go' again.
List of institutions Because authors do not identify their institutions uniformly, we use Microsoft Academic Graph for cleaning institution names and aliases. More details on how we cleaned the data are here.
Contributions and Feedback This version is a pre-release and we welcome feedback. Changes are gladly reviewed and accepted via pull requests, other discussions and feature requests should be submitted as github issue
This project is written in python3 with the Django web framework.
- Fork and clone this repository
- Install Django and other requirements
$ pip install -r requirements.txt
- Run the server:
- Access the server: http://localhost:8000
- Make and test changes locally
- Push changes to your fork and submit a pull request.