@TransparencyToolkit

Transparency Toolkit

Watching the watchers

  • LookingGlass dataspec for tweets

    Updated Feb 23, 2017
  • API for calling crawlers

    Ruby 2 1 Updated Feb 23, 2017
  • General scraping/document loading tool

    JavaScript 16 4 Updated Feb 23, 2017
  • A crawler for Twitter

    Ruby 1 Updated Feb 23, 2017
  • Crawls public LinkedIn profiles

    Ruby 5 2 Updated Feb 18, 2017
  • Scrapes all pages on any site you specify for keywords.

    Ruby 16 4 Updated Feb 18, 2017
  • Resume data and scripts for managing it

    Ruby 59 23 Updated Feb 5, 2017
  • Intuitive faceted search tool configurable for any JSON dataset

    CSS 114 24 Updated Feb 3, 2017
  • Scripts for managing scrapers

    Ruby 15 2 Updated Jan 20, 2017
  • A crawler for converting email files on disk to JSON

    Ruby 3 2 Updated Jan 19, 2017
  • OCRs document and extracts metadata

    Ruby 4 Updated Jan 19, 2017
  • Runs block of code on every file in directory

    Ruby 3 Updated Jan 20, 2017
  • Dataspec for emails

    1 Updated Jan 5, 2017
  • Dataspec for SII

    Ruby 6 1 Updated Jan 4, 2017
  • Crawler for the resume website Indeed

    Ruby 2 2 Updated Oct 30, 2016
  • Dataspec for plain files loaded in via Harvester/DirCrawl.

    2 1 Updated Oct 11, 2016
  • A dataspec for the Google crawler

    Updated Oct 8, 2016
  • A LookingGlass dataspec file for data scraped form LinkedIn.com

    3 1 Updated Oct 8, 2016
  • A LookingGlass dataspec file for data scraped from Indeed.com

    2 1 Updated Oct 8, 2016
  • An open narrative mapping tool to corroborate narratives across multiple sources and formats

    Ruby 2 Updated Oct 1, 2016
  • A collection of public data about the debate of encryption helping terrorists

    Updated Sep 30, 2016
  • Transparency Toolkit software specifications

    3 2 Updated Sep 10, 2016
  • Random, non-generalized bits of code

    Ruby Updated Aug 22, 2016
  • Automates deployment of LookingGlass instances

    Shell 1 Updated Aug 19, 2016
  • Videos of data collection and processing for screensavers

    1 Updated May 29, 2016
  • NSA documents in machine readable form

    Ruby 52 21 Updated May 17, 2016
  • Parse classification-related information

    Python 1 3 Updated May 17, 2016
  • A theme for Privacy International collaborations

    CSS 2 Updated May 14, 2016
  • A theme for LookingGlass for Snowden doc search

    CSS 2 Updated Apr 7, 2016
  • A dataspec for Snowden documents

    2 1 Updated Apr 6, 2016