Add combined benchmark images to notebook.

casangi · Sep 1, 2021 · 6f653a0 · 6f653a0
1 parent 6cf0a75
commit 6f653a0
Showing 1 changed file with 41 additions and 38 deletions.
diff --git a/docs/benchmarking.ipynb b/docs/benchmarking.ipynb
@@ -49,6 +49,23 @@
     "The datasets from each project code and Member Object Unit Set (MOUS) were processed following publicly documented ALMA archival reprocessing workflows, and come from public observations used used by other teams in previous benchmarking and profiling efforts.\n"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "### 2017.1.00271.S \n",
+    "\n",
+    "Compact array observations over many (nine) execution blocks using the mosaic gridder \n",
+    "\n",
+    "-   MOUS uid://A001/X1273/X2e3\n",
+    "-   MeasurementSet Rows: 315831\n",
+    "-   CNGI Shape (time, baseline, chan, pol): (455, 745, 7635, 2)\n",
+    "-   Visibility Data Size: 82.82 GB\n",
+    "\n",
+    "\n",
+    "![im10](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/X2e3/combined_X2e3.png)\n"
+   ]
+  },
   {
    "cell_type": "markdown",
    "metadata": {
@@ -64,11 +81,8 @@
     "-   CNGI Shape (time, baseline, chan, pol): (282, 55, 1024, 2)\n",
     "-   Visibility Data Size: 508.23 MB\n",
     "\n",
-    "![im2](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/node_A001_X133d_X1a36.png)\n",
-    "\n",
-    "![im3](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/cluster_A001_X133d_X1a36.png)\n",
-    "\n",
-    "![im4](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/aws_A001_X133d_X1a36.png)\n"
+    "![im2](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/X1a36/combined_X1a36.png)\n",
+    "\n"
    ]
   },
   {
@@ -77,43 +91,16 @@
     "id": "qT4jN2RRAgZf"
    },
    "source": [
-    "### 2017.1.00271.S \n",
+    "### 2017.1.00717.S\n",
     "\n",
-    "Compact array observations over many (nine) execution blocks using the mosaic gridder \n",
+    "Main array observations with many spectral channels and visibilities using the standard gridder\n",
     "\n",
     "-   MOUS uid://A001/X1273/Xc66\n",
     "-   MeasurementSet Rows: 100284\n",
     "-   CNGI Shape (time, baseline, chan, pol): (2564, 53, 2048, 2)\n",
     "-   Visibility Data Size: 8.91 GB\n",
     "\n",
-    "![im6](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/node_A001_X1273_Xc66.png)\n",
-    "\n",
-    "![im7](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/cluster_A001_X1273_Xc66.png)\n",
-    "\n",
-    "![im8](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/aws_A001_X1273_Xc66.png)"
-   ]
-  },
-  {
-   "cell_type": "markdown",
-   "metadata": {
-    "id": "fJUbfLR3KT-4"
-   },
-   "source": [
-    "### 2017.1.00717.S\n",
-    "\n",
-    "Main array observations with many spectral channels and visibilities using the standard gridder\n",
-    "\n",
-    "-   MOUS uid://A001/X1273/X2e3\n",
-    "-   MeasurementSet Rows: 315831\n",
-    "-   CNGI Shape (time, baseline, chan, pol): (455, 745, 7635, 2)\n",
-    "-   Visibility Data Size: 82.82 GB\n",
-    "\n",
-    "\n",
-    "![im10](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/node_A001_X1273_X2e3.png)\n",
-    "\n",
-    "![im11](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/cluster_A001_X1273_X2e3.png)\n",
-    "\n",
-    "![im12](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/aws_A001_X1273_X2e3.png)\n"
+    "![im6](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/Xc66/combined_Xc66.png)\n"
    ]
   },
   {
@@ -131,11 +118,18 @@
     "-   CNGI Shape (time, baseline, chan, pol): (729, 1159, 3853, 2)\n",
     "-   Visibility Data Size: 104.17 GB\n",
     "\n",
-    "![im14](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/node_A001_X12a3_X3be.png)\n",
+    "![im14](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/Xc66/combined_Xc66.png)\n",
     "\n",
-    "![im15](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/cluster_A001_X12a3_X3be.png)\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "**Speed Up and Work**\n",
     "\n",
-    "![im16](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/aws_A001_X12a3_X3be.png)\n"
+    "![im340](https://raw.githubusercontent.com/casangi/cngi_prototype/master/docs/_media/gcf_size_cluster_A001_X12a3_X3be.png)\n"
    ]
   },
   {
@@ -175,6 +169,15 @@
     "Note that for some settings of dask array chunking, one dask chunk had a shape smaller than the others due to combination of multiple executions before conversion. This effectively separated on-disk chunk shape along time time dimension, with some limited potential to degrade performance.\n"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "**CHILES Benchmark**\n",
+    "\n",
+    "\n"
+   ]
+  },
   {
    "cell_type": "markdown",
    "metadata": {