Skip to content

Update test-resources MIMIC synthetic data #29

Merged
will-pang merged 3 commits into
mainfrom
MP-26-UpdateTestResources
May 24, 2026
Merged

Update test-resources MIMIC synthetic data #29
will-pang merged 3 commits into
mainfrom
MP-26-UpdateTestResources

Conversation

@will-pang

@will-pang will-pang commented May 3, 2026

Copy link
Copy Markdown

Description

A very small PR to update the synthetic data for MIMIC-4, especially as we're trying to be more careful with data leakage in multimodal tasks.

We're hoping to use this standardized task setup found in multimodal_mimic.py base task.

Screenshot 2026-05-11 at 6 22 26 AM

Overview of Changes

  • Update test-resources/core/mimic4demo/note/discharge.csv: Added a note for subject 10003 during admission id 20006 which notes that the patient passed away. If our task setup is correct, this should not appear in the training set because it leaks the outcome for mortality prediction
  • Update test-resources/core/mimic4demo/hosp/diagnoses_icd.csv: Added an ICD-10 code for subject 10003 during admission id 20006 with ICD-10 code R99 which codes for Ill-defined and unknown cause of mortality. If our task setup is correct, this should not appear in the training set because it leaks the outcome for mortality prediction

Testing Notes

  • Tested in examples/multimodal_mimic4_task_tutorial.ipynb for members who have a MORTALITY_LABEL = 1 as the outcome to make sure that we don't leak the note data that indicates a member passed away

@will-pang will-pang changed the title Update discharge.csv Update synthetic data May 3, 2026
@will-pang will-pang changed the title Update synthetic data Update test-resources MIMIC synthetic data May 4, 2026
@will-pang will-pang assigned Rian354 and will-pang and unassigned Rian354 May 11, 2026
@will-pang will-pang marked this pull request as ready for review May 11, 2026 13:23

@joshuxchn joshuxchn left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@will-pang will-pang merged commit 786980c into main May 24, 2026
@will-pang will-pang deleted the MP-26-UpdateTestResources branch June 3, 2026 08:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants