Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shell executable added #31

Merged
merged 17 commits into from
Apr 11, 2023
Merged

Shell executable added #31

merged 17 commits into from
Apr 11, 2023

Conversation

kcho
Copy link
Member

@kcho kcho commented Apr 5, 2023

This PR added a shell executable python code, calling get_run_sheet_df on Pronet and Prescient PHOENIX directories. It also runs dataflow_dpdash function to create dpdash loadable CSV files.

How to run the shell executable code

# add qqc to PYTHONPATH
export PYTHONPATH=/PATH/TO/BRANCH/qqc:$PYTHONPATH
python scripts/mriflow_check.py -d

This will create /data/predict1/data_from_nda/MRI_ROOT/flow_check/mri_data_flow.csv that summarizes MRI dataflow, and DPDash importable csv files in the same directory.

@kcho kcho requested a review from nickckim April 5, 2023 20:40
@kcho
Copy link
Member Author

kcho commented Apr 5, 2023

The following line is added to the crontab to execute mriflow_check.py -d at 7AM every morning. (on hna002 node)

# crontab -e
# MRI dataflow check
0 7 * * * PYTHONPATH=/data/predict1/home/kcho/software/tmp/qqc:${PYTHONPATH} BASH_ENV=/PHShome/kc244/preload.sh /data/pnl/kcho/anaconda3/bin/python /data/predict1/home/kcho/software/tmp/qqc/scripts/mriflow_check.py -d > /dev/null 2>&1

@nickckim
Copy link
Collaborator

Looks great!

Comment from run sheet added back to `mri_data_flow.csv`
@kcho kcho merged commit c1f7b51 into to_dpdash Apr 11, 2023
@kcho kcho deleted the shell_executable branch April 11, 2023 22:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants