Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing values in numeric columns force string-type on input #573

Closed
pjcross opened this issue Jan 29, 2016 · 1 comment
Closed

Missing values in numeric columns force string-type on input #573

pjcross opened this issue Jan 29, 2016 · 1 comment

Comments

@pjcross
Copy link
Contributor

pjcross commented Jan 29, 2016

One of our users requested that Slycat handle numeric columns with missing data by treating the column as real valued instead of a text column. He was working in the Parameter Space model. This becomes an issue when the user wants to do filtering on that variable or color-code the points that do have values. He didn't want to add dummy values like zero, since his data might naturally have those values. I suggested that he fill all of the blanks in the csv with Nans. This will enable him to filter and color-code those points that have values. I can see that the same situation would also cause issues with CCA since the entire column would be unavailable for analysis, rather than just removing the row with the missing value (our CCA behavior with Nans). Although we can push the issue back into a preprocessing step for the user, I think it would make more sense if we provided an avenue to take care of this while parsing the table during ingestion. Maybe we could offer a checkbox in the wizard to insert Nans into blanks? That way if the user was looking for Nans in the original data, they could turn it off. But for most cases, we would just automatically insert Nans, which would provide the desired behavior in the models.

@Mletter1
Copy link
Collaborator

need to add this to .dat

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants