Skip to content

Introduction

Jump to bottom
Jefferson Smith edited this page May 26, 2021 · 16 revisions

Goals

Describe overall project. Keep it tight and high level, with links to other sources to provide more detail. Here we should focus on issues that inform the decisions taken within about the data processing itself. ($zoe?)

Roles and Responsibiliteies

Responsibilities within the project are divided among three basic role types:

  • INTERACT works with several data partners who provide services for collecting metadata, telemetry data, and/or survey data from participants
  • Each city in the study has a research coordinator who spearheads local recruiting of participants, handles device assignments, metadata collection, telemetry data collection, and provides liaison between participants, data partners, and other project team members as required.
  • Within the project team, there are several data wranglers who work with coordinators and data partners to ensure smooth migration of the collected data to ComputeCanada and then oversee the verification, cleaning and integration of the migrated data into a form suitable for researchers.

Data Pipeline Phases

Studies within the INTERACT system follow a data flow that divides the process into a number of sequential steps:

  1. Recruitment: in which participants are invited and enrolled into a study
  2. Collection: in which participants generate digital telemetry of their movements and answer surveys/questionnaires
  3. Migration: in which the collected data is moved from the collection points to ComputeCanada
  4. Ingest: during which the migrated data is verified, cleaned, and normalized into usable raw-data tables
  5. Digest: in which the raw data is summarized and annotated with basic metrics to prepare it for analysis by researchers

Data Pipeline Infrastructure

Describe the resources used to assemble the system: 3rd party partners, institutional services, key technogogies. ($jeff,$zoe)

Data Collection Partners

  • SenseAnalytics provides INTERACT with SenseDoc devices, which are hip-worn tracking devices that cache their data locally for later retrieval by our study coordinators
  • Ethica uses a smartphone app to collect telemetry and survey data from registered participants and cache it on secure servers until it can be migrated to ComputeCanada upon completion of the study
  • Polygon (formerly known as Treksoft) provides our coordinators with a participant management portal and also manages a survey engine that we use to gather map-based survey data from participants (Maybe $zoe can provide a more accurate explanation)

($sketched)

Clone this wiki locally