-
Notifications
You must be signed in to change notification settings - Fork 1
Add data analysis sketch #10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Scott,
Just a few thoughts. Happy to discuss.
One extra point: Do we want include model evaluation/benchmarking in this section? ESMValTool (and eventually modelevaluation.org when it's deployed)?
| ## Analysis Basics | ||
|
|
||
| * Accessing VDI | ||
| * The different NCI filesystems |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Might be worth listing what they are, since people might know some but not others.
|
|
||
| * Accessing VDI | ||
| * The different NCI filesystems | ||
| * Finding data recap |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If this is for self-assessment, then I guess this should provide links to the "finding data" pages.
| * Writing Python scripts | ||
| * Testing analysis scripts | ||
| * Parallel processing with Dask | ||
| * Piplelines for processing lots of files |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Typo - pipelines
| * Previewing files with ncview and xconv | ||
| * Creating plots with Matplotlib | ||
| * Maps and projections with Cartopy | ||
| * Plotting stats with Seaborne |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
typo - Seaborn
| * Maps and projections with Cartopy | ||
| * Plotting stats with Seaborne | ||
| * Importing data into GIS | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Include 3D visualisation as an advanced skill set?
|
|
||
| ## Data Formats | ||
|
|
||
| * HDF5/NetCDF - Self-describing data |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe divide into reading and creating. For reading - ncdump.
Should CF standards be included here?
| @@ -0,0 +1,36 @@ | |||
| # Analysing Model Results | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we want to divide into beginner and advanced skill sets like Claire was doing?
| * CDO and NCO commands | ||
| * CLEX Conda environments | ||
| * Using Jupyter Notebook | ||
| * Basic Pandas, Xarray and Matplotlib |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we also want to include Numpy and Scipy here?
No description provided.