Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data Munging: get sigma and wavelength vectors, trim the ends, put the data into an HDF5 file. #2

Closed
gully opened this issue Jul 2, 2016 · 5 comments
Closed

Data Munging: get sigma and wavelength vectors, trim the ends, put the data into an HDF5 file. #2

gully opened this issue Jul 2, 2016 · 5 comments

Comments

@gully
Copy link
Member

gully commented Jul 2, 2016

No description provided.

@nattieg
Copy link
Collaborator

nattieg commented Jul 5, 2016

Uploaded new data file and a variance file into /data/raw/. Data definitely has nans - trimmed them in my notebook but there's probably a better way.

Still need to:
Trim noisy ends
Put data in HDF5

@gully
Copy link
Member Author

gully commented Jul 6, 2016

I will put the data in HDF5 because HDF5 is flaky and I have code that already does that. I can do some data cleaning in the process too.

nattieg pushed a commit that referenced this issue Jul 7, 2016
Update notebook to finish data munging o110 and o113 relating to Issue …
86139e4 
…#2
@nattieg
Copy link
Collaborator

nattieg commented Jul 7, 2016 •
edited
Loading

Followed your example and cleaned and converted orders 110 and 113. The HDF5 files for both are in /data/reduced/

We may want to be more aggressive in cleaning 110 and 113.

@nattieg
Copy link
Collaborator

nattieg commented Jul 7, 2016

I added a notebook to check the SN values. The values calculated from the variance don't agree with the values from the SN file directly. I don't know why. Let's chat about this?

@gully
Copy link
Member Author

gully commented Jun 8, 2017

Issue #6 will do this for ALL the orders so I am closing this now.

@gully gully closed this as completed Jun 8, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gully @nattieg