Skip to content

Introduction

Jefferson Smith edited this page May 26, 2021 · 16 revisions

Goals

Describe overall project. Keep it tight and high level, with links to other sources to provide more detail. Here we should focus on issues that inform the decisions taken within about the data processing itself. ($zoe?)

Roles and Responsibiliteies

Responsibilities within the project are divided among three basic role types:

  • INTERACT works with several data partners who provide services for collecting metadata, telemetry data, and/or survey data from participants
  • Each city in the study has a research coordinator who spearheads local recruiting of participants, handles device assignments, metadata collection, telemetry data collection, and provides liaison between participants, data partners, and other project team members as required.
  • Within the project team, there are several data wranglers who work with coordinators and data partners to ensure smooth migration of the collected data to ComputeCanada and then oversee the verification, cleaning and integration of the migrated data into a form suitable for researchers.

Data Pipeline Broken Into Distinct Phases

Studies within the INTERACT system follow a data flow that divides the process into a number of sequential steps:

  1. Recruitment: in which participants are invited and enrolled into a study
  2. Collection: in which participants generate digital telemetry of their movements and answer surveys/questionnaires
  3. Migration: in which the collected data is moved from the collection points to ComputeCanada
  4. Ingest: during which the migrated data is verified, cleaned, and normalized into usable raw-data tables
  5. Digest: in which the raw data is summarized and annotated with basic metrics to prepare it for analysis by researchers

Data Pipeline Infrastructure

Describe the resources used to assemble the system: 3rd party partners, institutional services, key technogogies. ($jeff,$zoe)


($sketched)

Clone this wiki locally