Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 31 additions & 0 deletions _includes/header.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,31 @@
<header class="site-header" style="border-top: 0px;">

<div class="wrapper">
{%- assign default_paths = site.pages | map: "path" -%}
{%- assign page_paths = site.header_pages | default: default_paths -%}
{%- assign titles_size = site.pages | map: 'title' | join: '' | size -%}
<a class="site-title" rel="author" href="{{ "/" | relative_url }}">{{ site.title | escape }}</a>

{%- if titles_size > 0 -%}
<nav class="site-nav">
<input type="checkbox" id="nav-trigger" class="nav-trigger" />
<label for="nav-trigger">
<span class="menu-icon">
<svg viewBox="0 0 18 15" width="18px" height="15px">
<path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
</svg>
</span>
</label>

<div class="trigger">
{%- for path in page_paths -%}
{%- assign my_page = site.pages | where: "path", path | first -%}
{%- if my_page.title -%}
<a class="page-link" href="{{ my_page.url | relative_url }}">{{ my_page.title | escape }}</a>
{%- endif -%}
{%- endfor -%}
</div>
</nav>
{%- endif -%}
</div>
</header>
Binary file added assets/images/course_feedback.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
File renamed without changes
Binary file added assets/images/mas_dataset.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/ommie.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/stress_detector.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
29 changes: 28 additions & 1 deletion projects.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,31 @@
layout: page
title: Projects
---
coming soon...
## MAS Dataset
![MAS Dataset](assets/images/mas_dataset.png)
<br><br>
I curated a dataset of 353 short clips of people in monologue scenarios experiencing stress. Each clip is annotated for stress across four audio-visual modalities. Labels are high quality, with an inter-rater reliability of 0.85--significantly higher than comparable datasets.

<br>
<br>

## Multimodal Stress Detector
![Multimodal Stress Detector](assets/images/stress_detector.png)
<br><br>
I designed an audio-visual stress detector that uses late fusion to interpret expressions of stress across multiple modalities. This approach allows the system to combine the strength of multiple modalities while maintaining robust performance even when some are unavailable. This system achieved an F1 score of 0.85 on the MAS dataset and is currently being investigated for use in detecting and correcting implicit bias

<br>
<br>

## Ommie
![Ommie](assets/images/ommie.png)
<br><br>
I helped write the control architecture of Ommie, a therapy robot being deployed in hospitals, wellness clinics, schools, and in the home. My changes to the high-level behavior loops and lower-level hardware drivers drastically improved Ommie's maximum continuous runtime, uncapping it from less than five minutes to virtually unlimited

<br>
<br>

## Real-Time Course Feedback
![Course Feedback](assets/images/course_feedback.png)
<br><br>
I led a team of undergrads to design a system that allowed students to give feedback on a class in real-time using a Kinect body-tracking system installed outside the lecture hall. Out of 36 teams, our project won the class choice award for CPSC 484: Human-Computer Interaction.
2 changes: 1 addition & 1 deletion publications.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ title: Publications
*indicates equal contribution

## Integrating Multimodal Affective Signals for Stress Detection from Audio-Visual Data
![Stress Detection](assets/images/stress%20detection.png) <br><br>
![Stress Detection](assets/images/icmi2024.png) <br><br>
Debasmita Ghose\*, __Oz Gitelson__\*, Brian Scassellati

ACM International Conference on Multimodal Interaction, 2024 (__ICMI 2024__), San Jose, Costa Rica
Expand Down