Skip to content

alex101101/hacker-news-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hacker News Scraper

Overview

Scrapes the top stories on Hacker News' front page and outputs the story summaries as JSON

Useage

./hackernews --posts 3

Installed:

  • Java 8 jre/jdk
  • Maven
  • linux or mac to run bash script

Main Libraries Used

Library Description
jackson-databind Fast, reliable and simple library to serialize and de-serialize JSON objects
htmlunit Popular library for navigating website for testing/scraping purposes and parsing HTML dom
hibernate-validation Implementation of the Java validation standard. Allows easy validation of model object fields
junit Assists in writing unit tests
args4j A simple and well recieved library that allows command line input to be parsed and validated

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published