@datatogether

Data Together

Data Together seeks to build a better future for data.

Pinned repositories

  1. datatogether

    🏁 Start here! Discussion for Data Together: Building a better future for data

    19 6

  2. roadmap

    Coordinating technical work & roadmapping additional services

    7 3

  3. website

    A static-generated website to introduce the Data Together project, built with Hugo.

    CSS 3 2

  4. api

    Serves the Data Together JSON API

    HTML 1 3

  5. webapp

    Web application to allow users to add content metadata about crawled resources

    JavaScript 9 5

  6. research

    πŸ“š A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity

    24 3

  • Data. Together. Let's read about it!

    5 2 Updated Sep 11, 2018
  • Parallelized web crawler written in Golang

    Go 13 7 AGPL-3.0 Updated Sep 4, 2018
  • 🏁 Start here! Discussion for Data Together: Building a better future for data

    19 6 CC-BY-SA-4.0 Updated Aug 20, 2018
  • A static-generated website to introduce the Data Together project, built with Hugo.

    CSS 3 2 Updated Aug 20, 2018
  • Websockets-based API backend for our react and redux webapp.

    Go 4 1 AGPL-3.0 Updated Aug 16, 2018
  • Guide for Deploying the Data Together Reference Platform

    Updated Jul 31, 2018
  • Serves the Data Together JSON API

    HTML 1 3 AGPL-3.0 Updated Jun 28, 2018
  • Coordinating technical work & roadmapping additional services

    7 3 Updated Apr 19, 2018
  • command line tool for storing data together on the distributed web

    Go 7 2 GPL-3.0 Updated Apr 6, 2018
  • golang package for creating/working with warc & cdxj archives

    Go 2 1 GPL-3.0 Updated Apr 6, 2018
  • Golang package that provides utils for working with dotsql and postgres

    Go 2 1 AGPL-3.0 Updated Mar 20, 2018
  • Golang WARC (Web ARChive) Library

    Go 15 5 AGPL-3.0 Updated Mar 14, 2018
  • Golang package implementing the CDXJ file format used by OpenWayback 3.0.0+ to index web archive contents

    Go 4 AGPL-3.0 Updated Mar 14, 2018
  • modify the contents of web-related content types for archival purposes

    Go 1 GPL-3.0 Updated Mar 14, 2018
  • Library that extracts xmp metadata from a PDF document.

    Go 3 GPL-3.0 Updated Mar 1, 2018
  • Golang package for parsing Extensible Metadata Platform (XMP) documents

    Go 4 1 AGPL-3.0 Updated Feb 18, 2018
  • Web application to allow users to add content metadata about crawled resources

    JavaScript 9 5 AGPL-3.0 Updated Feb 15, 2018
  • Python package for scraping websites into the Data Together pipeline via morph.io

    Python 4 1 AGPL-3.0 Updated Dec 1, 2017
  • Golang package for making sensible guesses about file formats from Url strings

    Go 2 AGPL-3.0 Updated Nov 4, 2017
  • extract urls of dependant files for displaying a web page

    Go 1 AGPL-3.0 Updated Nov 4, 2017
  • Service for managing & executing archiving tasks written in Golang

    Go 2 1 AGPL-3.0 Updated Nov 4, 2017
  • Experimental Golang implementation of the ipfs datastore interface for sql databases.

    Go 3 AGPL-3.0 Updated Nov 4, 2017
  • Core Archive Model Definitions

    Go 5 AGPL-3.0 Updated Nov 4, 2017
  • Command line tool for extracting urls from a HTML web page using a jquery-style selector

    Go 2 AGPL-3.0 Updated Nov 4, 2017
  • Service for serving archived content stored on amazon S3.

    Go 2 AGPL-3.0 Updated Nov 3, 2017
  • Learning materials for Data Together

    Shell 1 3 CC-BY-SA-4.0 Updated Nov 2, 2017
  • Project for visualizing the status of digital data archiving efforts across various data repositories

    Go 2 3 AGPL-3.0 Updated Oct 30, 2017
  • Golang package for working with linked data structures, an implementation of the W3C Data Catalog Vocabulary (DCAT)

    Go 3 1 GPL-3.0 Updated Oct 27, 2017
  • Open-licensed artwork related to Data Together

    CC-BY-SA-4.0 Updated Oct 27, 2017
  • User & Identity Management server

    Go 7 2 AGPL-3.0 Updated Oct 27, 2017