Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Paper: Optimizing Python-Based Spectroscopic Data Processing on NERSC Supercomputers #454

Open
wants to merge 17 commits into
base: 2019
from

Conversation

Projects
None yet
4 participants
@lastephey
Copy link

commented Apr 19, 2019

If you are creating this PR in order to submit a draft of your paper,
see http://procbuild.scipy.org/ for logs generated by the build
process.

See the project readme
for more information.

@TahiriNadia

This comment has been minimized.

Copy link

commented May 3, 2019

Missing references?

@lastephey

This comment has been minimized.

Copy link
Author

commented May 3, 2019

Yes, the references are currently broken. I am using a .bib file for the references but clearly something is not working. (I have looked at the examples from 2018 and am trying to replicate what they did.) My bib file is automatically generated by Zoterro so I'm not sure if that's an issue. I'd appreciate any help or additional documentation you could send to help me fix this. Thank you.

@deniederhut

This comment has been minimized.

Copy link
Member

commented May 3, 2019

Hm... my first suggestion would be to run make clean before building to make sure an old .aux file is not preventing the bibfile from being included. The next step is to look at the .log file to see if there is an error.

@lastephey

This comment has been minimized.

Copy link
Author

commented May 3, 2019

Thank you for the suggestions. I found the problem: the underscore in my bib name (I changed it from scipy_bib to scipybib and now it works). I'll push another test draft.

lastephey and others added some commits May 13, 2019

Proposed changes to abstract
* Call out turnaround timescale of data processing and why it matters
* Change one instance of writing/write to some other word
* Add "maintainable"
* Spell out KNL
* Replace "important data" with "key data structures"
* image -> spectroscopic

@deniederhut deniederhut added the paper label May 20, 2019

rcthomas and others added some commits May 22, 2019

Edits up to and starting on Optimization Results
Question about line 404, "processors per chip?"
Merge pull request #2 from lastephey/up-to-opt-results
Edits up to and starting on Optimization Results
@lastephey

This comment has been minimized.

Copy link
Author

commented May 22, 2019

Hi @deniederhut and @TahiriNadia, I noticed that my most recent changes are not showing up in the build system. It is still showing an older version (commit 0f1f760 instead of
f4cf05a). Is there something I should do? I have tried building a few times with the most recent commit and can't seem to get it to refresh. Thank you.

@TahiriNadia

This comment has been minimized.

Copy link

commented May 22, 2019

Hi @lastephey the system takes time to build (update) the paper. Now, your last modification was updated on the system. You need to check this last version. Thank you

@deniederhut

This comment has been minimized.

Copy link
Member

commented May 22, 2019

procbuild -- for better or worse -- will only rebuild a paper if the last build is more than five minutes old. Is the newer version showing up now?

@lastephey

This comment has been minimized.

Copy link
Author

commented May 22, 2019

Hi @TahiriNadia and @deniederhut, thanks for your help. I waited longer than 5 minutes before trying to build again. It is still showing the older version. The newer version builds without any problems on my laptop.

@deniederhut

This comment has been minimized.

Copy link
Member

commented May 22, 2019

Hm I will need to take a look

@lastephey

This comment has been minimized.

Copy link
Author

commented May 22, 2019

Thank you. For some reason the build system just seems to be one commit behind. I guess I could try to push a dummy commit to force it to update if you think that's a good option.

@deniederhut

This comment has been minimized.

Copy link
Member

commented May 22, 2019

Might have been related to this GitHub outage -- https://www.githubstatus.com/incidents/nf4gcjtcsqdb

Is the paper on procbuild now the correct one?

@lastephey

This comment has been minimized.

Copy link
Author

commented May 22, 2019

Yes it's correct now. Thanks for your help!

@lastephey lastephey changed the title Paper: test build system with draft Paper: Optimizing Python-Based Spectroscopic Data Processing on NERSC Supercomputers May 23, 2019

@lastephey lastephey closed this May 23, 2019

@lastephey lastephey reopened this May 23, 2019

@lastephey

This comment has been minimized.

Copy link
Author

commented May 23, 2019

This paper is ready to be submitted. Thanks for your help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.