Skip to content
gvamos edited this page Aug 28, 2013 · 5 revisions

Web scraping, content, and journalism

  1. ScraperWiki A community dedicated to collecting data from the web into databases to support analysis. They cover a lot of British government data sources.
  2. Data.gov US government publicly available data
  3. Data Journalism Journalism publishing data, preferably in a machine readable format.
  4. Pro Publica's data scraping portal A portal for journalists who commonly need to report on events deduced from data and text published on the web.
  5. DbPedia A subset of Wikipedia designed to support semantic queries

Software Tools and Documentation

  1. Beautiful Soup A python toolkit for data scraping
  2. ClioPatria Prolog based software to provide a semantic web (SPARQL) endpoint capable of logical inferences.
  3. SWI Prolog Prolog environment used by ClioPatria
  4. Learning SPARQL Good introductory book on how to operate and query semantic databases
  5. Semantic Web for the Working Ontologist A more detailed and advanced text on semantic web development and operation

Clone this wiki locally