MMCA - Multimdal Collaboration Analytics (MMCA) - A Literature Review

By Harvard Learning, Innovation, and Technology Lab (LIT)

GitHub organization

• ✅ master: latest stable build
• live: currently deployed site
• testing: General testing branch
• Others: Individual branches for specific features, to be merged into testing

Structure

assets folder - contain images to style the website
data - contains all the json data files
js folder - contains all javascript file for creating the graphs and diagrams
html files - located in the project directory

Legend

❌ ❌ - Not possible
❌ ✅ - Possible and will be done
❌❔ - Not done but not sure if possible
✅ - Done
⏳ - Pending

Improvements

• remove harvard logos, developer information, etc. Add back when the paper is accepted ✅
  
• Information to the subpages of the website. Create a document with instructions on how to update the dataset, redeploy the website, and modify its content? ⏳
  
• Main visualization at the top of the page (move the paragraph about purpose to a different subpage) ✅
  
• Possible to use the back button of the browser to reset the visualization? ❌ ❌
  
• Google scholar links need to be added to any node in the sub-visualizations (e.g., when clicking on a connection ) ✅
  
• The text from the yellow bubbles overlaps and is sometimes difficult to read; can you change the size of the bubbles so that the text doesn’t overlap? ✅
  
• The different line type (e.g., dotted, solid) and labels (e.g., glm, corr, etc) makes the visualization a little too busy; we feel like they should be removed ✅
  
• could you change the color of the yellow bubbles based on modality type? ✅
  
• Script for translating the csv to JSON ✅
  
• Documentation for convert-to-JSON script ⏳
  
• Keep bubbles inside overall rectangle visualization ✅
  

Main TODOs

• Decrease height between detail graphs ✅
• Try to make nodes share 1 ❌ ❌
• Change color scheme ✅
• Make sure sankey nodes show metric ✅
• Data input ✅
• Group like sankey nodes together ✅
• Fix arrow sizes ✅
• Deployed!! https://mmca-website.netlify.app/ 🚀 ✅

Data Layer 1

Speech Participation >> DONE ✅
Visual Attention >> DONE ✅
Task-related >> DONE ✅
Text >> DONE ✅
Touch >> DONE ✅
Eye Motion >> DONE ✅
Hand Motion >> DONE ✅
Gross body motion >> DONE ✅
Location >> DONE ✅
Facial expressions >> DONE ✅
Head motion >> DONE ✅
speech features >> DONE ✅
speech content >> DONE ✅
EDA >> DONE ✅
Combined >> DONE ✅
Heart >> DONE ✅
Brain >> DONE ✅

Data Layer 2

Head >> DONE ✅
Physiological >> DONE ✅
Log data >> DONE ✅
Gaze >> DONE ✅
Verbal >> DONE ✅
Body >> DONE ✅

Data Layer 3

affective >> DONE ✅
Cognitive Engagement >> DONE ✅
Communication >> DONE ✅
Interpersonal >> DONE ✅
Coordination >> DONE ✅
Learning >> DONE ✅
Performance >> DONE ✅
Group composition >> DONE ✅

Data Layer 4

Condition >> DONE ✅
Process >> DONE ✅
Product >> DONE ✅

Technology Used

HTML/CSS, JS, D3.js

Developed by Eric Sheen