firstDraft #1

ashutoshbondre · 2017-06-13T04:13:13Z

Added 3 files:

spec.json (The json data)
script.py (The python script which generated the notebook)
firstDraft.ipynb (The actual notebook)

This is the notebook.

ellisonbg

Talked to Ashutosh today in person. Summary of the discussion:

Add %%html cells with the converted HTML from the spec file so we can compare our generated HTML.
Split the notebook into a series of smaller ones, each with maybe 100 cells (the full one is quite large).
Add a section header for each example such as "Example 1" as a Markdown cell.

rgbkrk · 2017-06-14T20:03:07Z

Oooh, I'm liking this spec file and script. Great approach for testing our own compliance.

ashutoshbondre · 2017-06-14T20:59:42Z

Hey quick question, how can I run the code cell using python command? Like I know in the notebook you can do shift+enter, but if I don't want to manually do that, and just run the code cells using my script & get the output of the code cells in the notebook, what is the command / syntax for that?
If at all that's possible.
Thanks.

mpacer · 2017-06-14T21:12:32Z

@ashutoshbondre Where are you running it from? If you can use nbconvert the Execute preprocessor probably does what you want: http://nbconvert.readthedocs.io/en/latest/execute_api.html

And if you want to do on individual cells directly, I'd recommend looking at the internals of the Execute preprocessor, specifically the preprocess_cell or the run_cell commands. I wouldn't use that code verbatim (it makes more sense in the nbconvert context) but it should get you a good chunk of the way there.

mpacer · 2017-06-14T22:17:00Z

Btw, just looked and was there a reason you used a python2 kernel? If not please switch to using python3? I anticipate that we'll eventually run into unicode bugs in this spec code otherwise.

ashutoshbondre · 2017-06-14T22:19:06Z

No reason. I will change that, and thanks for the help.

On Jun 14, 2017 3:17 PM, "M Pacer" ***@***.***> wrote: Btw, just looked and was there a reason you used a python2 kernel? If not

please switch to using python3? I anticipate that we'll eventually run into unicode bugs in this spec code otherwise.

…

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

mpacer · 2017-06-14T22:26:53Z

Looking at what you have, what I'd do is something like:

# ⋮ your imports
from nbconvert import ExecutePreprocessor

kernel_name = 'python3' # set it programmatically so that you only need to change it in one place
display_name = 'Python 3'
output_path = '/Users/ashu/github/ans.ipynb' # probably want to use a relative path? 
timeout_amount = 60 # none of these should take too long
metadata = {'kernelspec': {
    'name': your_kernel_name
    'display_name': display_name
    }} # this might need to be populated with more valid metadata, but I'm not sure which metadata you'll actually need.
format_version = 4.3
# ⋮ this is where your spec reading and cell writing would happen
executor = ExecutePreprocessor(timeout=60, kernel_name=your_kernel_name)
executor.preprocess(nb, metadata)
nbformat.write(nb,"/Users/ashu/github/ans.ipynb", format_version)

Hope that helps!

mpacer

Tried to find all of the little things that will make this more portable and configurable in the long run. Some of my example code would address these issues (at least by making them top level variables instead of hard-coded values).

mpacer · 2017-06-14T22:27:16Z

script.py

+for i in range(len(data)):
+    cells +=[new_markdown_cell(data[i]["markdown"])]
+nb=new_notebook(cells=cells,metadata={'kernelspec': {
+            'name': 'python2',


probably shouldn't hard code this.

mpacer · 2017-06-14T22:27:40Z

script.py

+    cells +=[new_markdown_cell(data[i]["markdown"])]
+nb=new_notebook(cells=cells,metadata={'kernelspec': {
+            'name': 'python2',
+            'display_name': 'Python 2'


You shouldn't hard code this as you want it to be easily changeable.

mpacer · 2017-06-14T22:28:16Z

script.py

+        }})
+
+
+nbformat.write(nb,"/Users/ashu/github/ans.ipynb",4.0)


probably don't want to hard code the path or the version number as it's reasonable to expect that we want to do this on any number of potential versions.

Probably want the path to be relative, because this makes it so you're the only one who can easily run this without directly editing the file.

mpacer · 2017-06-14T22:29:34Z

script.py

+import nbformat
+from pprint import pprint
+from nbformat.v4 import new_code_cell, new_markdown_cell, new_notebook
+with open('spec.json') as data_file:    


You should either use absolute paths or relative paths consistently (here you're implicitly using a relative path, later you use an absolute path).

ashutoshbondre · 2017-06-15T00:02:26Z

@mpacer Thanks for the review, did most of the changes. Also ExecutePreprocessor did what I wanted.

One reason I used python 2 kernel was because that was the default one I had, I am having problems with executing the code in python3.
I set up a different environment in python 3 using "conda create" command, but when I execute the code there,it doesn't even recognize nbformat. Says "no module named nbformat" .

Currently I am working on Python 2.7.13. Can you tell me, what can I do here, to switch to the right environment. I am pretty sure, I am just missing some minute detail.
Thanks

ellisonbg · 2017-06-15T15:14:48Z

You would need to run `pip install nbformat` to install that package in the 2.7 environment, making sure that the right version of pip/python is in your path. Python packages have to be installed separately in each python version's site-packages dir.

…

On Wed, Jun 14, 2017 at 5:02 PM, Ashutosh Bondre ***@***.***> wrote: @mpacer <https://github.com/mpacer> Thanks for the review, did most of the changes. Also ExecutePreprocessor did what I wanted. One reason I used python 2 kernel was because that was the default one I had, I am having problems with executing the code in python3. I set up a different environment in python 3 using "conda create" command, but when I execute the code there,it doesn't even recognize nbformat. Says "no module named nbformat" . Currently I am working on Python 2.7.13. Can you tell me, what can I do here, to switch to the right environment. I am pretty sure, I am just missing some minute detail. Thanks — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#1 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABr0BaYzdmzIN1TUVhPkl-AaKy_T7pgks5sEHSTgaJpZM4N39u1> .

-- Brian E. Granger Associate Professor of Physics and Data Science Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger@calpoly.edu and ellisonbg@gmail.com

mpacer · 2017-06-15T15:47:35Z

You need to switch into that environment and specifically install nbformat, notebook, lab, &c. to that environment. To make it easy you could use conda install but you should also be able to use pip if you want. If you go that route & run into trouble let me know. Then, you need to install the kernel relative to that environment, which you can install by following instructions here: http://ipython.readthedocs.io/en/stable/install/kernel_install.html If you want access to that kernel in all your environments use `--sys-prefix` when installing. Then it should work.

…

On Wed, Jun 14, 2017 at 17:02 Ashutosh Bondre ***@***.***> wrote: @mpacer <https://github.com/mpacer> Thanks for the review, did most of the changes. Also ExecutePreprocessor did what I wanted. One reason I used python 2 kernel was because that was the default one I had, I am having problems with executing the code in python3. I set up a different environment in python 3 using "conda create" command, but when I execute the code there,it doesn't even recognize nbformat. Says "no module named nbformat" . Currently I am working on Python 2.7.13. Can you tell me, what can I do here, to switch to the right environment. I am pretty sure, I am just missing some minute detail. Thanks — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACXg6MmWwnuMzvQnzG5b8tmyThTT5Gsdks5sEHSTgaJpZM4N39u1> .

The script creates as many notebook as possible, each with 100 entries.

ashutoshbondre · 2017-06-15T18:45:24Z

Ready for review:
Hi, I did all the necessary changes, added relative paths as well.
The script now takes json data of any size & creates a number of notebooks, each with 100 examples. So in our case we have 643 entires, so it creates 7 notebooks, six with size 100 & seventh with 43 entries. Notebooks are named nb1, nb2, nb3, etc. on creation.
Each notebook has 3 cells for each entry, which are:

Markdown cell with example number, eg. "Example 1"
Actual markdown code in a markdown cell.
Code cell, with html code for each markdown, each code cell already executed in place.

Thanks,
Ashutosh

ashutoshbondre · 2017-06-15T18:46:31Z

All made with python3 kernel.

rgbkrk · 2017-07-08T01:05:12Z

I'd like to go ahead and assume that the requested changes were made and this is ready to go.

Mhtpyurt

Sevdiğim

Mhtpyurt · 2023-09-15T08:51:42Z

firstDraft.ipynb

Mhtpyurt · 2023-09-15T08:51:52Z

firstDraft.ipynb

ashutoshbondre added 5 commits June 12, 2017 21:06

Add files via upload

1e01a1b

This is the notebook.

Delete firstDraft.ipynb

ff3ef57

Add files via upload

0cf28c9

Add files via upload

2b5e6ea

Add files via upload

c63b736

ellisonbg requested changes Jun 14, 2017

View reviewed changes

mpacer reviewed Jun 14, 2017

View reviewed changes

ashutoshbondre added 3 commits June 15, 2017 11:35

Create script.py

e761003

Delete firstDraft.ipynb

3b8878b

Sample-1 Notebook with 1-100 entries.

3ccfd91

The script creates as many notebook as possible, each with 100 entries.

ellisonbg approved these changes Jul 8, 2017

View reviewed changes

ellisonbg merged commit ede1605 into jupyter:master Jul 8, 2017

Mhtpyurt reviewed Sep 15, 2023

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

firstDraft #1

firstDraft #1

ashutoshbondre commented Jun 13, 2017

ellisonbg left a comment

rgbkrk commented Jun 14, 2017

ashutoshbondre commented Jun 14, 2017

mpacer commented Jun 14, 2017 •

edited

Loading

mpacer commented Jun 14, 2017

ashutoshbondre commented Jun 14, 2017 via email

mpacer commented Jun 14, 2017

mpacer left a comment

mpacer Jun 14, 2017

mpacer Jun 14, 2017

mpacer Jun 14, 2017

mpacer Jun 14, 2017

mpacer Jun 14, 2017

ashutoshbondre commented Jun 15, 2017

ellisonbg commented Jun 15, 2017 via email

mpacer commented Jun 15, 2017 via email

ashutoshbondre commented Jun 15, 2017 •

edited

Loading

ashutoshbondre commented Jun 15, 2017

rgbkrk commented Jul 8, 2017

Mhtpyurt left a comment

Mhtpyurt Sep 15, 2023

Mhtpyurt Sep 15, 2023

		}})


		nbformat.write(nb,"/Users/ashu/github/ans.ipynb",4.0)

firstDraft #1

firstDraft #1

Conversation

ashutoshbondre commented Jun 13, 2017

ellisonbg left a comment

Choose a reason for hiding this comment

rgbkrk commented Jun 14, 2017

ashutoshbondre commented Jun 14, 2017

mpacer commented Jun 14, 2017 • edited Loading

mpacer commented Jun 14, 2017

ashutoshbondre commented Jun 14, 2017 via email

mpacer commented Jun 14, 2017

mpacer left a comment

Choose a reason for hiding this comment

mpacer Jun 14, 2017

Choose a reason for hiding this comment

mpacer Jun 14, 2017

Choose a reason for hiding this comment

mpacer Jun 14, 2017

Choose a reason for hiding this comment

mpacer Jun 14, 2017

Choose a reason for hiding this comment

mpacer Jun 14, 2017

Choose a reason for hiding this comment

ashutoshbondre commented Jun 15, 2017

ellisonbg commented Jun 15, 2017 via email

mpacer commented Jun 15, 2017 via email

ashutoshbondre commented Jun 15, 2017 • edited Loading

ashutoshbondre commented Jun 15, 2017

rgbkrk commented Jul 8, 2017

Mhtpyurt left a comment

Choose a reason for hiding this comment

Mhtpyurt Sep 15, 2023

Choose a reason for hiding this comment

Mhtpyurt Sep 15, 2023

Choose a reason for hiding this comment

mpacer commented Jun 14, 2017 •

edited

Loading

ashutoshbondre commented Jun 15, 2017 •

edited

Loading