Skip to content

Commit

Permalink
Update documentation for new tutorial
Browse files Browse the repository at this point in the history
Added info about the new AMI for GC 12.2.0

Signed-off-by: Bob Yantosca <yantosca@seas.harvard.edu>
  • Loading branch information
yantosca committed Feb 21, 2019
1 parent 6af25fb commit 3cbba41
Show file tree
Hide file tree
Showing 3 changed files with 50 additions and 60 deletions.
33 changes: 3 additions & 30 deletions doc/source/chapter02_beginner-tutorial/quick-start.rst
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ In the EC2 console, make sure you are in the **US East (N. Virginia)** region as

.. _choose_ami-label:

In the EC2 console, click on "AMIs" (Amazon Machine Images) under "IMAGES" on the left navigation bar. Then select "Public images" and search for ``ami-06f4d4afd350f6e4c`` or ``GEOSChem_with_GCHP_12.1.1_tutorial_20181216`` – that's the system with both the classic and the `High-Performance <http://wiki.seas.harvard.edu/geos-chem/index.php/GEOS-Chem_HP>`_ versions of GEOS-Chem installed. Select it and click on "Launch".
In the EC2 console, click on "AMIs" (Amazon Machine Images) under "IMAGES" on the left navigation bar. Then select "Public images" and search for ``ami-0ee8892ae47c31be1`` or ``GEOSChem12.2.0_tutorial_20190221`` – that's the system with both the classic version of GEOS-Chem installed. Select it and click on "Launch".

.. figure:: img/search_ami.png

Expand Down Expand Up @@ -201,34 +201,7 @@ We encourage users to try the new NetCDF diagnostics, but you can still use the
Also, you could indeed download the output data and use old tools like IDL & MATLAB to analyze them, but we highly recommend the open-source Python/Jupyter/xarray ecosystem. It will vastly improve user experience and working efficiency, and also help open science and reproducible research.


Bonus: Running GEOS-Chem High Performance (GCHP)
------------------------------------------------

GCHP is also fully functioning on the cloud. Running it on a single EC2 instance (equivalent to a single node on HPC clusters) is extremely easy. The biggest instance on AWS is ``x1.32xlarge`` with `64 physical cores <https://aws.amazon.com/ec2/physicalcores/>`_ and 2 TB memory. (Multi-node setup is quite cumbersome right now and we are actively looking into this.)

Go to the pre-configured run directory::

$ cd ~/tutorial/gchp_standard

Just run the pre-compiled the model by::

$ mpirun -np 6 -oversubscribe ./geos

``-oversubscribe`` is needed when the number of physical cores is less than the number of MPI processes (6 here). No need for this option on bigger instances.

.. warning::
Make sure that the geoscience Python environment is **deactivated** (``source deactivate geo``) before calling ``mpirun``. Otherwise the incorrect ``mpirun`` coming with Anaconda will be used. Use ``which mpirun`` and ``mpirun --version`` to make sure the correct executable is called. It should be OpenMPI 3 at ``/usr/local/bin/mpirun``.

Remember to use ``r5.2xlarge`` or even bigger instances, otherwise the run will crash at the middle due to inadequate memory.

After a successful run (takes ~10 min), GCHP also produces NetCDF diagnostics inside ``OutputDir/`` of the run directory. Again a pre-generated output file is already contained in the AMI. Use this :doc:`example notebook <../chapter06_appendix/plot_GCHP_data>` located at ``~/tutorial/python_example/plot_GCHP.ipynb`` to plot GCHP output data directly on the native `Cubed-Sphere grid <http://acmg.seas.harvard.edu/geos/cubed_sphere.html>`_.

See https://github.com/lizziel/geoschem_data_visualization for more comprehensive examples of GCHP data analysis. See `GCHP main page <http://wiki.seas.harvard.edu/geos-chem/index.php/GEOS-Chem_HP>`_ for more tutorials on GCHP.


.. _terminate-label:

Step 5: Shut down the server (Very important!!)
Step 4: Shut down the server (Very important!!)
-----------------------------------------------

Right-click on the instance in your console to get this menu:
Expand All @@ -243,4 +216,4 @@ There are two different ways to stop being charged:
Unless you save your system as an AMI or transfer the data to other storage services,
you will lose all your data and software.

You will learn how to save your data and configurations persistently in the next tutorials. You might also want to :doc:`simplify your ssh login command <../chapter06_appendix/ssh-config>`.
You will learn how to save your data and configurations persistently in the next tutorials. You might also want to :doc:`simplify your ssh login command <../chapter06_appendix/ssh-config>`.
6 changes: 3 additions & 3 deletions doc/source/chapter06_appendix/aws-resources-for-gc.rst
Original file line number Diff line number Diff line change
Expand Up @@ -8,14 +8,14 @@ Latest resources:
+-------------------+------------------------+----------+----------------------------------+
| Resource | ID/name | Size | Content |
+===================+========================+==========+==================================+
|| Standard tutorial| ami-06f4d4afd350f6e4c | 200 GB | 0. Ubuntu 18.04 |
|| Standard tutorial| ami-0ee8892ae47c31be1 | 200 GB | 0. Ubuntu 18.04 |
| AMI | | | 1. gfortran 7.3.0, |
| | | | netCDF-Fortran 4.4.4, |
| | | | OpenMPI 3.1.3 |
| | | | 2. Geoscientific Python |
| | | | environment |
| | | | 3. Pre-compiled GC-classic and |
| | | | GCHP 12.1.1 |
| | | | 12.2.0 |
| | | | 4. Minimum GEOS-Chem input data |
+-------------------+------------------------+----------+----------------------------------+
|| Container | ami-040f96ea8f5a0973e | 200 GB | 0. Amazon Linux 2 AMI |
Expand All @@ -40,4 +40,4 @@ Old resources (for record):
| | | | environment |
| | | | 3. Pre-compiled GC-classic 12.0.0|
| | | | 4. Minimum GEOS-Chem input data |
+-------------------+------------------------+----------+----------------------------------+
+-------------------+------------------------+----------+----------------------------------+
71 changes: 44 additions & 27 deletions doc/source/chapter06_appendix/plot_GC-classic_data.ipynb

Large diffs are not rendered by default.

0 comments on commit 3cbba41

Please sign in to comment.