Merge pull request #5 from informatics-lab/section3_implementation

section 3 & 4 content from lecture 2
informatics-lab · Mar 9, 2021 · 596b715 · 596b715
2 parents d073b14 + 8e26fef
commit 596b715
Show file tree

Hide file tree

Showing 10 changed files with 7,492 additions and 153 deletions.
diff --git a/01_history_philosophy_scientific_computing.ipynb b/01_history_philosophy_scientific_computing.ipynb
@@ -2,10 +2,11 @@
  "cells": [
   {
    "cell_type": "markdown",
-   "id": "swedish-granny",
+   "id": "coordinated-sunglasses",
    "metadata": {},
    "source": [
     "# Section 1: The History and Philosophy of Scientific Computing\n",
+    "![Pangeo Logo](images/pangeo_logo_small.png)\n",
     "\n",
     "What is a Pangeo? Is it :\n",
     "* a computing platform\n",
@@ -17,12 +18,14 @@
     "\n",
     "It is, in a sense, the last one, though *Pangeo as a Lifestyle* (PaaL) is still in the early stages of development. Some users may interact with Pangeo through a particular implementation and get the sense it is a platform or software package, if one were to pick just one of those, it would be a community that has come together to develop tools and recipes for tackling challenges around big data in scientific computing. The mindset is also important, because there is no one set of tools to address this, and the tools keep evolving. Instead it is about approaching those challenges in a certain way.\n",
     "\n",
-    "In this series of lectures, we will be considering not just what a Pangeo platform is and how to create it, but also the context in which the need for such a platform arose and why existing platforms and paradigms were (and are) not addressing the needs of scientific computing then and now. Section 1 will be focused on what user of scientific compouting systems really need and what systems they have been provided with so far that at best only partially adress their needs, and in a worst case distort the nature of the scientific enquiry so that fits inside thecnology available, rather than technology we create being driven by the needs of scientific enquiry. We will start by looking at a few typical use cases of scientific computing systems. We will then describe existing solutions and examine their shortcomings."
+    "In this series of lectures, we will be considering not just what a Pangeo platform is and how to create it, but also the context in which the need for such a platform arose and why existing platforms and paradigms were (and are) not addressing the needs of scientific computing then and now. Section 1 will be focused on what user of scientific compouting systems really need and what systems they have been provided with so far that at best only partially adress their needs, and in a worst case distort the nature of the scientific enquiry so that fits inside thecnology available, rather than technology we create being driven by the needs of scientific enquiry. We will start by looking at a few typical use cases of scientific computing systems. We will then describe existing solutions and examine their shortcomings.\n",
+    "\n",
+    "Pangeo community website: https://pangeo.io/"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "clean-antique",
+   "id": "obvious-developer",
    "metadata": {},
    "source": [
     "## Key concepts and components of scientific system\n",
@@ -32,7 +35,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "classified-terror",
+   "id": "vital-civilian",
    "metadata": {},
    "source": [
     "First lets define the necessary components of a scientific computing system.\n",
@@ -46,7 +49,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "waiting-comparison",
+   "id": "expired-estimate",
    "metadata": {},
    "source": [
     "Some key concepts associated with this description:\n",
@@ -57,15 +60,15 @@
   },
   {
    "cell_type": "markdown",
-   "id": "oriental-request",
+   "id": "headed-public",
    "metadata": {},
    "source": [
     "## Use cases of Scientific Computing"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "capital-joining",
+   "id": "arbitrary-template",
    "metadata": {},
    "source": [
     "Talking in the abstract about a platform is difficult and note very helpful when what we want from our platform is to enable  and optimise the experiences for specific usesd. So lets think about some typical users of a scientific compute platform.\n",
@@ -76,7 +79,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "atlantic-object",
+   "id": "settled-rates",
    "metadata": {},
    "source": [
     "### Use case 1 - Scientific Analyst\n",
@@ -92,7 +95,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "turkish-steps",
+   "id": "specialized-regulation",
    "metadata": {},
    "source": [
     "### Use case 2 - Data Engineer\n",
@@ -106,7 +109,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "acquired-offer",
+   "id": "frank-handling",
    "metadata": {},
    "source": [
     "### Use case 3 - Software Engineer\n",
@@ -121,7 +124,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "stopped-jerusalem",
+   "id": "reasonable-clarity",
    "metadata": {},
    "source": [
     "### Use Case 4 - Application Developer\n",
@@ -134,7 +137,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "understood-ferry",
+   "id": "lined-puppy",
    "metadata": {},
    "source": [
     "### Uses not covered\n",
@@ -144,7 +147,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "indie-gateway",
+   "id": "awful-apollo",
    "metadata": {},
    "source": [
     "## Previous models of computing\n",
@@ -154,7 +157,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "promotional-participation",
+   "id": "fresh-employer",
    "metadata": {},
    "source": [
     "## The desktop model of computing\n",
@@ -187,7 +190,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "vulnerable-accessory",
+   "id": "aerial-ancient",
    "metadata": {},
    "source": [
     "![Desktop model of computing ](images/DesktopModel_diagram.png)"
@@ -196,14 +199,14 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "interior-package",
+   "id": "motivated-welsh",
    "metadata": {},
    "outputs": [],
    "source": []
   },
   {
    "cell_type": "markdown",
-   "id": "lined-command",
+   "id": "living-fortune",
    "metadata": {},
    "source": [
     "## Scheduled Linux clusters\n",
@@ -233,15 +236,15 @@
   },
   {
    "cell_type": "markdown",
-   "id": "exceptional-birmingham",
+   "id": "occasional-filling",
    "metadata": {},
    "source": [
     "![A Diagram of a scientific computing ecosystem built around a scheduled Linux Cluster ](images/LinuxScheduledClusterModel_diagram.png)"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "amino-intensity",
+   "id": "million-india",
    "metadata": {},
    "source": [
     "### Models & Use Cases\n",
@@ -270,7 +273,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "quiet-commerce",
+   "id": "southwest-hospital",
    "metadata": {},
    "source": [
     "## Existing model: the verdict\n",
@@ -291,17 +294,17 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "usual-hebrew",
+   "id": "immune-bracelet",
    "metadata": {},
    "outputs": [],
    "source": []
   }
  ],
  "metadata": {
   "kernelspec": {
-   "display_name": "Python 3",
+   "display_name": "pangeo_lectures",
    "language": "python",
-   "name": "python3"
+   "name": "pangeo_lectures"
   },
   "language_info": {
    "codemirror_mode": {
@@ -313,7 +316,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.7.9"
+   "version": "3.7.10"
   }
  },
  "nbformat": 4,