Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

There are way too many stories on Hacker News, and there's no option for "show me only the stories that Joel would like". So I built one. (Maybe "cobbled together" is more appropriate.)

branch: master

Create license

latest commit a664aa077f
Joel Grus authored February 22, 2014
Octocat-spinner-32 README.markdown added link to blogger February 16, 2012
Octocat-spinner-32 back_predict.rb initial commit February 16, 2012
Octocat-spinner-32 blogger.rb delete swp file February 17, 2012
Octocat-spinner-32 featurizer.rb initial commit February 16, 2012
Octocat-spinner-32 judger.rb initial commit February 16, 2012
Octocat-spinner-32 license Create license February 22, 2014
Octocat-spinner-32 model.rb initial commit February 16, 2012
Octocat-spinner-32 scrape_api.rb initial commit February 16, 2012
Octocat-spinner-32 scrape_old.rb initial commit February 16, 2012
Octocat-spinner-32 stemmable.rb initial commit February 16, 2012
Octocat-spinner-32 stopwords.rb initial commit February 16, 2012
Octocat-spinner-32 story.rb initial commit February 16, 2012
Octocat-spinner-32 test_featurizer.rb initial commit February 16, 2012
Octocat-spinner-32 utils.rb initial commit February 16, 2012
Octocat-spinner-32 worst_errors.rb initial commit February 16, 2012
README.markdown

There are way too many stories on Hacker News, and there's no option for "show me only the stories that Joel would like". So I built one. (Maybe "cobbled together" is more appropriate.)

I used Ruby 1.9.2 with the "mongo_mapper" gem. If you want to scrape the HN daily archives to get old stories, you'll also need the "nokogiri" gem. And if you want to post the results to blogger, you'll need the "blogger" and "maruku" gems.

Anyway, if one wanted to use this, one would install mongo (or already have it installed). Then one would run "scrape_old.rb" to download the old HN daily archives. And one would run "scrape_api.rb" to download the more recent stories.

Next one would run "judger.rb" and rate a lot of stories as to whether you liked or disliked them. Once you're done judging, it will automatically build a model and predict for everything in the database and spit out some stats.

You can do what you want with the results. I post mine to Blogger, using the code in "blogger.rb". This runs automatically once an hour, as does "scrape_api.rb".

That's it. The Porter Stemmer "stemmable.rb" is the canonical version that floats around the web. The list in "stopwords.rb" I found on a website. Everything else is by me, and you can use it for whatever you want to, although I'm not sure that you would want to.

Something went wrong with that request. Please try again.