NIPS papers pretty html
This is a set of scripts for creating nice preview page (see here: http://cs.stanford.edu/~karpathy/nipspreview/ ) for all papers published at NIPS. I hope these scripts can be useful to others to create similar pages for other conferences. They show how one can manipulate PDFs, extract image thumbnails, analyze word frequencies, do AJAX requests to load abstracts, etc.
Clone this repository
git clone https://github.com/karpathy/nipspreview.git
Download nips25offline from
http://books.nips.cc/nips25.htmland move it into the folder created in step 0
Make sure you have ImageMagick:
sudo apt-get install imagemagick
pdftowordcloud.py(to generate top words for each paper. Output saved in topwords.p as pickle)
pdftothumbs.py(to generate tiny thumbnails for all papers. Outputs saved in thumbs/ folder)
scrape.py(to generate paperid, title, authors list by scraping NIPS .html page)
makecorpus.py(to create allpapers.txt file that has all papers one per row)
python lda.py -f allpapers.txt -k 7 --alpha=0.5 --beta=0.5 -i 100. This will generate a pickle file called
ldaphi.pthat contains the LDA word distribution matrix. Thanks to this nice LDA code by shuyo! It requires nltk library and numpy. In this example we are using 7 categories. You would need to change the
nipsnice_template.htmlfile a bit if you wanted to try different number of categories.
Generate the abstract files inside abstracts/ folder using
getabstracts.py. Some user interaction may be necessary because of poorly formatted papers that make abstract extraction a pain. See script.
generatenicelda.py(to create the nipsnice.html page)