Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Null date/times in table populated with offset of "0" #49

Open
alistairewj opened this issue Aug 21, 2018 · 1 comment
Open

Null date/times in table populated with offset of "0" #49

alistairewj opened this issue Aug 21, 2018 · 1 comment

Comments

@alistairewj
Copy link
Member

Originally raised on eicu-website. From @obadawi

We recently discovered that the ETL transforming raw eCM data into eRI data converts null date/time fields into "0" which will then appear to have an offset equal to the time of ICU admission. We believe this mainly affects the medications table which may often have null stop dates when medications are ordered but are trying to investigate further. This is something we can fix in a future eRI release but I doubt it can be updated in the current CRD release. We should add comments to the documentation to inform users of this and we can add more clarity to it as we learn more about what areas are affected.

@jraffa added a useful summary

I put this together to help understand the extent this may be problematic.

table offset cols affected total_rows pct_affected
admissiondrug drugoffset, drugenteredoffset 2327 874920 0.3
admissiondx admitdxenteredoffset 1373 626858 0.2
allergy allergyoffset, allergyenteredoffset 1105 251949 0.4
autoacuityoverridehistory timestampoffset 2 34141 0.0
autoacuityquickentry lastsavedoffset 4 104045 0.0
careplancareprovider careprovidersaveoffset 2674 502765 0.5
careplaneol cpleolsaveoffset, cpleoldiscussionoffset 675 1433 47.1
careplangeneral cplitemoffset 41959 3115018 1.3
careplangoal cplgoaloffset 575 504139 0.1
careplaninfectiousdisease cplinfectdiseaseoffset 12 8056 0.1
customlab labotheroffset 0 1082 0.0
diagnosis diagnosisoffset 414 2710672 0.0
infusiondrug infusionoffset 1248 4803719 0.0
intakeoutput intakeoutputoffset, intakeoutputentryoffset 5722 12994887 0.0
lab labresultoffset, labresultrevisedoffset 22129 39132531 0.1
medication drugorderoffset, drugstartoffset, drugstopoffset 289542 7301853 4.0
microlab culturetakenoffset 52 16996 0.3
note noteoffset, noteenteredoffset 16127 3835897 0.4
nurseassessment nurseassessoffset, nurseassessentryoffset 12342 18255000 0.1
nursecare nursecareoffset, nursecareentryoffset 7479 13618762 0.1
nursecharting nursingchartoffset, nursingchartentryoffset 144017 221108200 0.1
pasthistory pasthistoryoffset, pasthistoryenteredoffset 5740 1149180 0.5
patient hospitaladmitoffset, hospitaldischargeoffset, unitdischargeoffset 7967 200859 4.0
physicalexam physicalexamoffset 31200 9873332 0.3
respiratorycare respcarestatusoffset, ventstartoffset, ventendoffset, priorventstartoffset, priorventendoffset 865381 865381 100.0
respiratorycharting respchartoffset, respchartentryoffset 21139 26747237 0.1
smartalert triggeroffset, reactivateoffset 378158 596603 63.4
ssadmf expirationoffset 0 473 0.0
treatment treatmentoffset 671 3688745 0.0
vitalaperiodic observationoffset 12278 25075074 0.0
vitalperiodic observationoffset 13484 146671642 0.0
@willemvandenboom
Copy link

Is there any idea by when a release with this fixed for respiratorycare would become available?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants