Skip to content

better explanations in dask-jupyterlab demo #56

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
stonebig merged 1 commit into from
Dec 20, 2020
Merged

better explanations in dask-jupyterlab demo #56

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
53 changes: 40 additions & 13 deletions docs/dask_jupyterlab_extension_demo.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,13 +1,27 @@
{
"cells": [
{
"cell_type": "code",
"execution_count": null,
"cell_type": "markdown",
"metadata": {},
"outputs": [],
"source": [
"## basic Dask_jupyerlab extension demo\n",
"see https://www.youtube.com/watch?feature=player_embedded&v=EX_voquHdk0"
"see https://www.youtube.com/watch?feature=player_embedded&v=EX_voquHdk0\n",
"\n",
"If not working, see the how-to: https://github.com/dask/dask-labextension\n",
"\n",
"You may have, if not working, to re-run;\n",
"\n",
"<pre>jupyter serverextension enable dask_labextension</pre>\n"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Step 1: launch a Client\n",
"\n",
"- warning; Dask-Jupyterlab doesn't work for Python-3.9.1, even with Distributed-2020.12.0\n",
"- check here for progress on the issue: https://github.com/dask/distributed/issues/4168)"
]
},
{
Expand All @@ -23,7 +37,7 @@
"<td style=\"vertical-align: top; border: 0px solid white\">\n",
"<h3 style=\"text-align: left;\">Client</h3>\n",
"<ul style=\"text-align: left; list-style: none; margin: 0; padding: 0;\">\n",
" <li><b>Scheduler: </b>tcp://127.0.0.1:61256</li>\n",
" <li><b>Scheduler: </b>tcp://127.0.0.1:52679</li>\n",
" <li><b>Dashboard: </b><a href='http://127.0.0.1:8787/status' target='_blank'>http://127.0.0.1:8787/status</a></li>\n",
"</ul>\n",
"</td>\n",
Expand All @@ -39,7 +53,7 @@
"</table>"
],
"text/plain": [
"<Client: 'tcp://127.0.0.1:61256' processes=4 threads=4, memory=8.44 GB>"
"<Client: 'tcp://127.0.0.1:52679' processes=4 threads=4, memory=8.44 GB>"
]
},
"execution_count": 1,
Expand All @@ -53,9 +67,22 @@
"client"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## step2 \n",
"- click on the DASK Extension (the red pictures) on the left left pannel\n",
"- copy the Dashoard url (in blue in the cell above this one) in the DASK DASHBOARD URL ot the Dask Extension panel that appears\n",
"- click on the refresh circualr arrow on the left of the bottom CLUSTERS line of the Dask Extension panel\n",
"- .... this make the buttons of the DASK extension to go from GREY to ORANGE\n",
"- .....clicking on each of them open a dedicated pan with related information: for example \"GRAPH\"\n",
"- ..... with jupyterlan you can show it side-to-side with current notebook by moving tabs\n"
]
},
{
"cell_type": "code",
"execution_count": 4,
"execution_count": 2,
"metadata": {},
"outputs": [
{
Expand Down Expand Up @@ -118,7 +145,7 @@
" <line x1=\"120\" y1=\"0\" x2=\"120\" y2=\"120\" style=\"stroke-width:2\" />\n",
"\n",
" <!-- Colored Rectangle -->\n",
" <polygon points=\"0.000000,0.000000 120.000000,0.000000 120.000000,120.000000 0.000000,120.000000\" style=\"fill:#ECB172A0;stroke-width:0\"/>\n",
" <polygon points=\"0.0,0.0 120.0,0.0 120.0,120.0 0.0,120.0\" style=\"fill:#ECB172A0;stroke-width:0\"/>\n",
"\n",
" <!-- Text -->\n",
" <text x=\"60.000000\" y=\"140.000000\" font-size=\"1.0rem\" font-weight=\"100\" text-anchor=\"middle\" >20000</text>\n",
Expand All @@ -132,7 +159,7 @@
"dask.array<random_sample, shape=(20000, 20000), dtype=float64, chunksize=(1250, 1250), chunktype=numpy.ndarray>"
]
},
"execution_count": 4,
"execution_count": 2,
"metadata": {},
"output_type": "execute_result"
}
Expand All @@ -146,16 +173,16 @@
},
{
"cell_type": "code",
"execution_count": 6,
"execution_count": 4,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"199998586.85963023"
"199999688.8147819"
]
},
"execution_count": 6,
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
}
Expand Down Expand Up @@ -189,7 +216,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.8.5"
"version": "3.8.7rc1"
}
},
"nbformat": 4,
Expand Down