Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Makefile for generating data, cluster scripts, batching create_gene_summary #5

Merged
merged 17 commits into from
Dec 12, 2019

Conversation

dleehr
Copy link
Collaborator

@dleehr dleehr commented Dec 12, 2019

  • Adds Makefile, see README for instructions
  • Updates create_gene_summary.R to fetch gene summaries in batches (significant speedup) and save output as Rdata (instead of feather)
  • Includes build-slurm.sh and upload-slurm.sh scripts for generating data on HPC cluster and uploading results to data service.

@dleehr
Copy link
Collaborator Author

dleehr commented Dec 12, 2019

@hirscheylab I've run the Makefile on HARDAC and uploaded the data to DDS. I'll next be loading the data onto the web server and sharing the files with you. The Makefile should work on your machine as well as the cluster, but let me know if you have questions.

@matthewhirschey matthewhirschey merged commit e10416c into matthewhirschey:master Dec 12, 2019
@dleehr dleehr deleted the add-makefile branch December 13, 2019 19:19
johnbradley added a commit to Duke-GCB/ddh that referenced this pull request Jan 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants