D2.3: Review on emerging technologies #43

Closed
minrk opened this Issue Sep 8, 2015 · 67 comments

Comments

@minrk
Contributor

minrk commented Sep 8, 2015

This deliverable reviews emerging technologies that did not exist, or were not sufficiently visible at the time the OpenDreamKit proposal was written. Its goal is to inform Work Packages on technologies that have a potential impact on the achievement of their tasks, and to suggest corrective actions to be undertaken when needed. A secondary goal for this review is to inform the general public about technologies related to OpenDreamKit.

Parts of this deliverable appeared, or will appear, on OpenDreamKit's weblog, and we will keep posting reviews there as new technologies emerge.

@minrk minrk added this to the D2.3 milestone Sep 8, 2015

@nthiery nthiery modified the milestones: Month 12: 2016-08-31, D2.3 Mar 22, 2016

@pdehaye

This comment has been minimized.

Show comment
Hide comment
@tkw1536

This comment has been minimized.

Show comment
Hide comment
@tkw1536

tkw1536 Jul 4, 2016

Contributor
  • How long should the blog posts be?
  • How / Where should we publish the blog post? I could not find any useful instructions in the README.
Contributor

tkw1536 commented Jul 4, 2016

  • How long should the blog posts be?
  • How / Where should we publish the blog post? I could not find any useful instructions in the README.
@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Jul 4, 2016

Contributor
  • It depends how much you have to say. Try to write something interesting and engaging: you want people to come to the website to read it. Then, if it's too long, we'll cut it for the deliverable. If it's too short, we'll dilute it.
  • Blog posts go in the _post folder of the website: https://github.com/OpenDreamKit/OpenDreamKit.github.io, following Jekyll conventions. I will improve the README over the next weeks.
Contributor

defeo commented Jul 4, 2016

  • It depends how much you have to say. Try to write something interesting and engaging: you want people to come to the website to read it. Then, if it's too long, we'll cut it for the deliverable. If it's too short, we'll dilute it.
  • Blog posts go in the _post folder of the website: https://github.com/OpenDreamKit/OpenDreamKit.github.io, following Jekyll conventions. I will improve the README over the next weeks.

tkw1536 added a commit to tkw1536/OpenDreamKit.github.io that referenced this issue Aug 18, 2016

Write a blog post on Docker for Mac and Windows
In the scope of OpenDreamKit/OpenDreamKit#43 I have written a short blog
post about Docker now being available natively for Mac and Windows.

@tkw1536 tkw1536 referenced this issue in OpenDreamKit/OpenDreamKit.github.io Aug 18, 2016

Closed

Write a blog post on Docker for Mac and Windows #33

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Aug 18, 2016

Contributor

Reminder: it is good to have blog posts but we when say "collate" we should
really copy and paste the post content as we were told links are not
enough...

Best

Viviane

2016-08-18 18:26 GMT+02:00 Min RK notifications@github.com:

Review technologies and trends that evolved since the beginning of the
project and may influence our

Plan: write blog posts about such, and collate them in the report.


You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#43, or mute the
thread
https://github.com/notifications/unsubscribe-auth/ADcG4E6p_NFU1RT4Bn5WyNBS2lW8S9Lrks5qhIeegaJpZM4F5ylv
.

Contributor

VivianePons commented Aug 18, 2016

Reminder: it is good to have blog posts but we when say "collate" we should
really copy and paste the post content as we were told links are not
enough...

Best

Viviane

2016-08-18 18:26 GMT+02:00 Min RK notifications@github.com:

Review technologies and trends that evolved since the beginning of the
project and may influence our

Plan: write blog posts about such, and collate them in the report.


You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#43, or mute the
thread
https://github.com/notifications/unsubscribe-auth/ADcG4E6p_NFU1RT4Bn5WyNBS2lW8S9Lrks5qhIeegaJpZM4F5ylv
.

@bpilorget

This comment has been minimized.

Show comment
Hide comment
@bpilorget

bpilorget Aug 30, 2016

Contributor

@defeo Have you begun compiling the different articles? FYI, Viviane is writing hers today

Contributor

bpilorget commented Aug 30, 2016

@defeo Have you begun compiling the different articles? FYI, Viviane is writing hers today

@bpilorget bpilorget closed this Aug 30, 2016

@bpilorget bpilorget reopened this Aug 30, 2016

@bpilorget

This comment has been minimized.

Show comment
Hide comment
@bpilorget

bpilorget Aug 30, 2016

Contributor

The README gives info on how to write deliverables (scroll down): https://github.com/OpenDreamKit/OpenDreamKit

Contributor

bpilorget commented Aug 30, 2016

The README gives info on how to write deliverables (scroll down): https://github.com/OpenDreamKit/OpenDreamKit

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Aug 30, 2016

Contributor

I only got feedback from @tkw1536, for the moment. I'm waiting for everything else. Ping to @embray, @minrk, @markuspf and @nthiery.

Contributor

defeo commented Aug 30, 2016

I only got feedback from @tkw1536, for the moment. I'm waiting for everything else. Ping to @embray, @minrk, @markuspf and @nthiery.

@markuspf

This comment has been minimized.

Show comment
Hide comment
@markuspf

markuspf Aug 30, 2016

Member

There's basically nothing useful I can say about JupyterLab at the moment, other than "yeah, would be interesting as an HPC-GAP frontend."

Member

markuspf commented Aug 30, 2016

There's basically nothing useful I can say about JupyterLab at the moment, other than "yeah, would be interesting as an HPC-GAP frontend."

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Aug 30, 2016

Contributor

I'm writting my piece, should be finished tomorrow.

2016-08-30 17:00 GMT+02:00 Luca De Feo notifications@github.com:

I only got feedback from @tkw1536 https://github.com/tkw1536, for the
moment. I'm waiting for everything else. Ping to @embray
https://github.com/embray, @minrk https://github.com/minrk, @markuspf
https://github.com/markuspf and @nthiery https://github.com/nthiery.


You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#43 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADcG4ObMOv7o_NHqtzQ3RwyLkbi96qVpks5qlEWBgaJpZM4F5ylv
.

Contributor

VivianePons commented Aug 30, 2016

I'm writting my piece, should be finished tomorrow.

2016-08-30 17:00 GMT+02:00 Luca De Feo notifications@github.com:

I only got feedback from @tkw1536 https://github.com/tkw1536, for the
moment. I'm waiting for everything else. Ping to @embray
https://github.com/embray, @minrk https://github.com/minrk, @markuspf
https://github.com/markuspf and @nthiery https://github.com/nthiery.


You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#43 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADcG4ObMOv7o_NHqtzQ3RwyLkbi96qVpks5qlEWBgaJpZM4F5ylv
.

@embray

This comment has been minimized.

Show comment
Hide comment
@embray

embray Aug 31, 2016

Contributor

Sorry, I'm going to need more time on this. I haven't even tried out the Ubuntu-on-Windows yet, though Bill Hart has written up some useful notes on his experience with it (as it pertains to Sage) so far, so maybe I can just draw from that.

Contributor

embray commented Aug 31, 2016

Sorry, I'm going to need more time on this. I haven't even tried out the Ubuntu-on-Windows yet, though Bill Hart has written up some useful notes on his experience with it (as it pertains to Sage) so far, so maybe I can just draw from that.

@minrk

This comment has been minimized.

Show comment
Hide comment
@minrk

minrk Aug 31, 2016

Contributor

We have had issues in Jupyter with Ubuntu on Windows, stemming from zeromq. It appears that the zeromq socket library when retrieving binaries from distributions such as conda, do not work on Ubuntu-on-Windows. However, people who are careful to use zeromq installed via apt-get, then things seem to work. That tells me that it's currently a very preliminary, unstable environment on which to work, where docker-on-Windows is more stable and reliable for users.

As for JupyterLab, there is not much to say about the thing itself - it's a nicer redesign of the existing notebook webapp with mainly the same capabilities. However, the way it's being built enables building different applications, such as making other non-notebook webpages (e.g. documentation) interactive.

Contributor

minrk commented Aug 31, 2016

We have had issues in Jupyter with Ubuntu on Windows, stemming from zeromq. It appears that the zeromq socket library when retrieving binaries from distributions such as conda, do not work on Ubuntu-on-Windows. However, people who are careful to use zeromq installed via apt-get, then things seem to work. That tells me that it's currently a very preliminary, unstable environment on which to work, where docker-on-Windows is more stable and reliable for users.

As for JupyterLab, there is not much to say about the thing itself - it's a nicer redesign of the existing notebook webapp with mainly the same capabilities. However, the way it's being built enables building different applications, such as making other non-notebook webpages (e.g. documentation) interactive.

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Aug 31, 2016

Contributor

Hi everyone,

@bpilorget I think it would be more reasonable to ask a delay on this one. October 1st seems ok. I don't have a better excuse than "it is the end of the summer and everyone is busy", we should have foreseen this and obviously, we didn't. Also, to be honest, I don't know who's ideas it was to include this deliverable but it seems that nobody had a clear idea what to do with it.

A delay won't have any impact on other tasks as this is just a survey. On the other hand, having something good will be valuable for the project, much better than if we quickly wrap up a quick report this week.

What do you think? (and @nthiery as well)

Best

Viviane

PS: my piece is started but not finished yet, as I said "it is the end of the summer and everyone is busy"

Contributor

VivianePons commented Aug 31, 2016

Hi everyone,

@bpilorget I think it would be more reasonable to ask a delay on this one. October 1st seems ok. I don't have a better excuse than "it is the end of the summer and everyone is busy", we should have foreseen this and obviously, we didn't. Also, to be honest, I don't know who's ideas it was to include this deliverable but it seems that nobody had a clear idea what to do with it.

A delay won't have any impact on other tasks as this is just a survey. On the other hand, having something good will be valuable for the project, much better than if we quickly wrap up a quick report this week.

What do you think? (and @nthiery as well)

Best

Viviane

PS: my piece is started but not finished yet, as I said "it is the end of the summer and everyone is busy"

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Aug 31, 2016

Contributor

Do we need a one month delay? From what I gather, things are not going to be much more mature on the Windows/Ubuntu side in one month. As for JupyterLab, I guess we (@minrk and I?) can just extract from the official post on the Jupyer blog.
If we are late delivering by one or two weeks, I guess we don't need an official extension. Is this enough time for you @VivianePons ?

Contributor

defeo commented Aug 31, 2016

Do we need a one month delay? From what I gather, things are not going to be much more mature on the Windows/Ubuntu side in one month. As for JupyterLab, I guess we (@minrk and I?) can just extract from the official post on the Jupyer blog.
If we are late delivering by one or two weeks, I guess we don't need an official extension. Is this enough time for you @VivianePons ?

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Aug 31, 2016

Contributor

One or two weeks is definitely enough for me, I want to be finished with this as soon as possible. What do we do for Windows/Ubuntu? At this point, what are we going to include in the report?

Contributor

VivianePons commented Aug 31, 2016

One or two weeks is definitely enough for me, I want to be finished with this as soon as possible. What do we do for Windows/Ubuntu? At this point, what are we going to include in the report?

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Aug 31, 2016

Contributor
Contributor

defeo commented Aug 31, 2016

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Aug 31, 2016

Contributor

So what are our emerging technologies so far?

Contributor

VivianePons commented Aug 31, 2016

So what are our emerging technologies so far?

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Aug 31, 2016

Contributor

So what are our emerging technologies so far?

  • SageMathCloud
  • Docker on Windows
  • JupyterLab
  • Cloud infrastructure ???

If people can think of something obvious I'm forgetting, let me know.

Contributor

defeo commented Aug 31, 2016

So what are our emerging technologies so far?

  • SageMathCloud
  • Docker on Windows
  • JupyterLab
  • Cloud infrastructure ???

If people can think of something obvious I'm forgetting, let me know.

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Aug 31, 2016

Contributor

In anycase, we should notify the PO that we are going to be a bit late.

Contributor

VivianePons commented Aug 31, 2016

In anycase, we should notify the PO that we are going to be a bit late.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Aug 31, 2016

Contributor

On Wed, Aug 31, 2016 at 06:24:20AM -0700, VivianePons wrote:

In anycase, we should notify the PO that we are going to be a bit late.

Will do.

Contributor

nthiery commented Aug 31, 2016

On Wed, Aug 31, 2016 at 06:24:20AM -0700, VivianePons wrote:

In anycase, we should notify the PO that we are going to be a bit late.

Will do.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Aug 31, 2016

Contributor

On Wed, Aug 31, 2016 at 06:12:36AM -0700, Luca De Feo wrote:

One or two weeks is definitely enough for me, I want to be finished
with this as soon as possible. What do we do for Windows/Ubuntu?
Nothing? If there's nothing people can say about it, this means that
the technology is not emerging yet.

We should at least mention it, say what the potential could be for us,
state that we did experiments and report on the outcome, mention it's
not mature enough at this stage to be sure it will fulfill it's
potential and that we will keep closely monitoring progress.

Cheers,

Contributor

nthiery commented Aug 31, 2016

On Wed, Aug 31, 2016 at 06:12:36AM -0700, Luca De Feo wrote:

One or two weeks is definitely enough for me, I want to be finished
with this as soon as possible. What do we do for Windows/Ubuntu?
Nothing? If there's nothing people can say about it, this means that
the technology is not emerging yet.

We should at least mention it, say what the potential could be for us,
state that we did experiments and report on the outcome, mention it's
not mature enough at this stage to be sure it will fulfill it's
potential and that we will keep closely monitoring progress.

Cheers,

@minrk

This comment has been minimized.

Show comment
Hide comment
@minrk

minrk Aug 31, 2016

Contributor

A brief mention along the lines of "UoW brings the prospect of linux software on Windows closer to reality, but is not yet sufficiently mature to recommend. Docker on Windows, however..." should cover it. Linking to the Jupyter issues where people have encountered trouble might be appropriate.

Contributor

minrk commented Aug 31, 2016

A brief mention along the lines of "UoW brings the prospect of linux software on Windows closer to reality, but is not yet sufficiently mature to recommend. Docker on Windows, however..." should cover it. Linking to the Jupyter issues where people have encountered trouble might be appropriate.

@embray

This comment has been minimized.

Show comment
Hide comment
@embray

embray Aug 31, 2016

Contributor

I will write something. I have a bit more than a sentence to say on it (even so without getting too technical). And important point to make about the Windows Subsystem for Linux is that even Microsoft is positioning it solely as a tool for developer convenience and not for end-user software distribution / execution.

Contributor

embray commented Aug 31, 2016

I will write something. I have a bit more than a sentence to say on it (even so without getting too technical). And important point to make about the Windows Subsystem for Linux is that even Microsoft is positioning it solely as a tool for developer convenience and not for end-user software distribution / execution.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 1, 2016

Contributor

@defeo: do you have something specific in mind for the "cloud infrastructure" item? Right now, I would not know what to say.

Contributor

nthiery commented Sep 1, 2016

@defeo: do you have something specific in mind for the "cloud infrastructure" item? Right now, I would not know what to say.

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 1, 2016

Contributor
Contributor

defeo commented Sep 1, 2016

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Sep 5, 2016

Contributor

I posted my SMC piece, it's on a branch "smc-post" on the website. Could someone ( @defeo @nthiery ?) proof read it and then merge to the main branch?

Best

Viviane

Contributor

VivianePons commented Sep 5, 2016

I posted my SMC piece, it's on a branch "smc-post" on the website. Could someone ( @defeo @nthiery ?) proof read it and then merge to the main branch?

Best

Viviane

@fangohr

This comment has been minimized.

Show comment
Hide comment
@fangohr

fangohr Sep 5, 2016

Contributor

Regarding 'Cloud Infrastructure' -- aren't things like GitHub, CircleCI/Travis/..., Readthedocs, codebeat, docker hub, all cloud hosted infrastructure? They have already made a big difference to how code in science and maths is developed/hosted/continuously built, tested and deployed, and there is probably more emerging?

Contributor

fangohr commented Sep 5, 2016

Regarding 'Cloud Infrastructure' -- aren't things like GitHub, CircleCI/Travis/..., Readthedocs, codebeat, docker hub, all cloud hosted infrastructure? They have already made a big difference to how code in science and maths is developed/hosted/continuously built, tested and deployed, and there is probably more emerging?

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 6, 2016

Contributor

Regarding 'Clould Infrastructure' -- aren't things like GitHub, CircleCI/Travis/..., Readthedocs, codebeat, docker hub, all cloud hosted infrastructure? They have already made a big difference to how code in science and maths is developed/hosted/continuously built, tested and deployed, and there is probably more emerging?

They are. But they all were well established before we wrote the proposal.

Is there anything "emerging" right now, which we didn't know about one
year ago? If so, do you feel like writing a short piece on it, Hans?

Contributor

defeo commented Sep 6, 2016

Regarding 'Clould Infrastructure' -- aren't things like GitHub, CircleCI/Travis/..., Readthedocs, codebeat, docker hub, all cloud hosted infrastructure? They have already made a big difference to how code in science and maths is developed/hosted/continuously built, tested and deployed, and there is probably more emerging?

They are. But they all were well established before we wrote the proposal.

Is there anything "emerging" right now, which we didn't know about one
year ago? If so, do you feel like writing a short piece on it, Hans?

@embray

This comment has been minimized.

Show comment
Hide comment
@embray

embray Sep 9, 2016

Contributor

@VivianePons Thanks--sounds like a good strategy (I will make a PR--still puts it in a separate branch but gives others an opportunity for review before publishing).

Contributor

embray commented Sep 9, 2016

@VivianePons Thanks--sounds like a good strategy (I will make a PR--still puts it in a separate branch but gives others an opportunity for review before publishing).

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 9, 2016

Contributor

On Fri, Sep 09, 2016 at 01:22:29AM -0700, Erik Bray wrote:

Where are we supposed to be putting these blog posts?

Go to http://opendreamkit.org/activities/, and click Edit this
page. The README has instructions.

I'm working on a report about the Windows Subsystem for Linux
today, before I leave for vacation.

Thanks!

Contributor

nthiery commented Sep 9, 2016

On Fri, Sep 09, 2016 at 01:22:29AM -0700, Erik Bray wrote:

Where are we supposed to be putting these blog posts?

Go to http://opendreamkit.org/activities/, and click Edit this
page. The README has instructions.

I'm working on a report about the Windows Subsystem for Linux
today, before I leave for vacation.

Thanks!

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 9, 2016

Contributor

On Fri, Sep 09, 2016 at 01:25:57AM -0700, VivianePons wrote:

I put mine in the activites section of the website
https://github.com/OpenDreamKit/OpenDreamKit.github.io/tree/master/_act
ivities
I put mine in a separate branch to allow proof reading before
publusing, a
pull request is another option

Variant: put page as layout. The file still gets compiled by Jekyll on
github and can be browsed by guessing its url; but it is not linked as
a post.

Feel free to edit the README to add such suggestions.

Cheers,

Contributor

nthiery commented Sep 9, 2016

On Fri, Sep 09, 2016 at 01:25:57AM -0700, VivianePons wrote:

I put mine in the activites section of the website
https://github.com/OpenDreamKit/OpenDreamKit.github.io/tree/master/_act
ivities
I put mine in a separate branch to allow proof reading before
publusing, a
pull request is another option

Variant: put page as layout. The file still gets compiled by Jekyll on
github and can be browsed by guessing its url; but it is not linked as
a post.

Feel free to edit the README to add such suggestions.

Cheers,

embray added a commit to embray/OpenDreamKit.github.io that referenced this issue Sep 9, 2016

@embray embray referenced this issue in OpenDreamKit/OpenDreamKit.github.io Sep 9, 2016

Merged

First draft of blog post on Windows Subsystem for Linux #36

@embray

This comment has been minimized.

Show comment
Hide comment
@embray

embray Sep 9, 2016

Contributor

I added the first draft of my post in a pull request--see link above.

Contributor

embray commented Sep 9, 2016

I added the first draft of my post in a pull request--see link above.

@bpilorget

This comment has been minimized.

Show comment
Hide comment
@bpilorget

bpilorget Sep 15, 2016

Contributor

FYI, maybe not for this deliverable but to keep in mind when time comes ->
Some of you may already know this: https://www.softwareheritage.org/mission/
The goal of this archive is to become the "Library of Alexandria of software". This was funded by INRIA (Institut National de Recherche en Informatique) and is supported by Microsoft, the Linux foundation, Github and other organisations.

Contributor

bpilorget commented Sep 15, 2016

FYI, maybe not for this deliverable but to keep in mind when time comes ->
Some of you may already know this: https://www.softwareheritage.org/mission/
The goal of this archive is to become the "Library of Alexandria of software". This was funded by INRIA (Institut National de Recherche en Informatique) and is supported by Microsoft, the Linux foundation, Github and other organisations.

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 15, 2016

Contributor

Just pushed in https://github.com/OpenDreamKit/OpenDreamKit/tree/master/WP2/D2.3.
Feel free to comment, exp. if you're the author of one of the pieces.

@embray, @VivianePons, concerning your blog posts, isn't it a bit weird to have them in _activities, rather than in _posts? I suggest:

  1. To move them to _posts,
  2. To change the publication dates to some date in the future (we could publish them with a one week interval, for example).
Contributor

defeo commented Sep 15, 2016

Just pushed in https://github.com/OpenDreamKit/OpenDreamKit/tree/master/WP2/D2.3.
Feel free to comment, exp. if you're the author of one of the pieces.

@embray, @VivianePons, concerning your blog posts, isn't it a bit weird to have them in _activities, rather than in _posts? I suggest:

  1. To move them to _posts,
  2. To change the publication dates to some date in the future (we could publish them with a one week interval, for example).
@bpilorget

This comment has been minimized.

Show comment
Hide comment
@bpilorget

bpilorget Sep 16, 2016

Contributor

Hi, I guess all the paragraphs are in there then. Is it ready to be polished (typos etc.)?

Contributor

bpilorget commented Sep 16, 2016

Hi, I guess all the paragraphs are in there then. Is it ready to be polished (typos etc.)?

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 16, 2016

Contributor

Yup

Contributor

defeo commented Sep 16, 2016

Yup

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

I have just proofread the whole document, and made minor edits. It's in fact a very interesting read; thanks for the hard work! Maybe there could have been a few more reviews, but as long as we keep this watch for further emerging technologies, and writing posts about relevant ones, I believe we are all good.

Contributor

nthiery commented Sep 19, 2016

I have just proofread the whole document, and made minor edits. It's in fact a very interesting read; thanks for the hard work! Maybe there could have been a few more reviews, but as long as we keep this watch for further emerging technologies, and writing posts about relevant ones, I believe we are all good.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

@defeo: About the author list: should e.g. @minrk be there? (I don't know who wrote the JupyterLab part). If you feel like it you may add me for the binder section + proofreading, but both were minor actions.

Contributor

nthiery commented Sep 19, 2016

@defeo: About the author list: should e.g. @minrk be there? (I don't know who wrote the JupyterLab part). If you feel like it you may add me for the binder section + proofreading, but both were minor actions.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

@VivianePons: About SageMathCloud:

On top of the usual interface, SMC's Jupyter offers real time synchronization among multiusers
This does not include real time collaborative editions, right? Maybe this should be clarified.

Contributor

nthiery commented Sep 19, 2016

@VivianePons: About SageMathCloud:

On top of the usual interface, SMC's Jupyter offers real time synchronization among multiusers
This does not include real time collaborative editions, right? Maybe this should be clarified.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

Once those two items are taken care off, this will be ready for submission.

Contributor

nthiery commented Sep 19, 2016

Once those two items are taken care off, this will be ready for submission.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

Just to keep this info around for history:

Contributor

nthiery commented Sep 19, 2016

Just to keep this info around for history:

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

@bpilorget: could you please browse through my diff, and implement the changes I made in the corresponding blog posts (not all them are up yet)? Thanks.

Contributor

nthiery commented Sep 19, 2016

@bpilorget: could you please browse through my diff, and implement the changes I made in the corresponding blog posts (not all them are up yet)? Thanks.

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 19, 2016

Contributor

About the author list: should @minrk be there? (I don't know who wrote the JupyterLab part).

I wrote it, taking excerpts from

http://blog.jupyter.org/2016/07/14/jupyter-lab-alpha/

(I think the excerpts are within the limits allowed by reasonable
citation practice)

If you feel like it you may add me for the binder section + proofreading, but both were minor actions.

Sure.

About SageMathCloud:

On top of the usual interface, SMC's Jupyter offers real time synchronization among multiusers
This does not include real time collaborative editions, right? Maybe this should be clarified.

Dunno. @VivianePons?

Contributor

defeo commented Sep 19, 2016

About the author list: should @minrk be there? (I don't know who wrote the JupyterLab part).

I wrote it, taking excerpts from

http://blog.jupyter.org/2016/07/14/jupyter-lab-alpha/

(I think the excerpts are within the limits allowed by reasonable
citation practice)

If you feel like it you may add me for the binder section + proofreading, but both were minor actions.

Sure.

About SageMathCloud:

On top of the usual interface, SMC's Jupyter offers real time synchronization among multiusers
This does not include real time collaborative editions, right? Maybe this should be clarified.

Dunno. @VivianePons?

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

We just checked with @VivianePons on one of her test SMC project. SMC uses a patched version of Jupyter that indeed allows real time collaborative edits. It just has a slightly lower granularity then for SMC notebooks: it's more at the level of the cell than the character.
This is documented here: https://github.com/sagemathinc/smc/wiki/sagejupyter#ipython-nb
We don't know if the patch was submitted or discussed with upstream.
@minrk: if not already done, please double check on this with @williamstein.

Contributor

nthiery commented Sep 19, 2016

We just checked with @VivianePons on one of her test SMC project. SMC uses a patched version of Jupyter that indeed allows real time collaborative edits. It just has a slightly lower granularity then for SMC notebooks: it's more at the level of the cell than the character.
This is documented here: https://github.com/sagemathinc/smc/wiki/sagejupyter#ipython-nb
We don't know if the patch was submitted or discussed with upstream.
@minrk: if not already done, please double check on this with @williamstein.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

Thanks Luca for the feedback!

Contributor

nthiery commented Sep 19, 2016

Thanks Luca for the feedback!

@VivianePons

This comment has been minimized.

Show comment
Hide comment
@VivianePons

VivianePons Sep 19, 2016

Contributor

Following the discussion with Nicolas, I added an extra paragraph on two interesting aspects:

  • real time synchro on Jupyter notebook on SMC
  • Jupyer kernels used through the SMC worksheet
    I added it both on the latex and on the md file for the blog posts.

I also moved the post from _activites to _posts (knowing that anyway, I intend to merge those two in the near future).

At the moment, the publishing date is still the same. We should change it when we decide to actually post it.

Contributor

VivianePons commented Sep 19, 2016

Following the discussion with Nicolas, I added an extra paragraph on two interesting aspects:

  • real time synchro on Jupyter notebook on SMC
  • Jupyer kernels used through the SMC worksheet
    I added it both on the latex and on the md file for the blog posts.

I also moved the post from _activites to _posts (knowing that anyway, I intend to merge those two in the near future).

At the moment, the publishing date is still the same. We should change it when we decide to actually post it.

@bpilorget

This comment has been minimized.

Show comment
Hide comment
@bpilorget

bpilorget Sep 19, 2016

Contributor

could you please browse through my diff, and implement the changes I made in the corresponding blog posts (not all them are up yet)? Thanks.

@nthiery I could only find the Docker for Mac and Windows post. Do you know where the other documents are?

Contributor

bpilorget commented Sep 19, 2016

could you please browse through my diff, and implement the changes I made in the corresponding blog posts (not all them are up yet)? Thanks.

@nthiery I could only find the Docker for Mac and Windows post. Do you know where the other documents are?

@defeo

This comment has been minimized.

Show comment
Hide comment
Contributor

defeo commented Sep 19, 2016

@williamstein

This comment has been minimized.

Show comment
Hide comment
@williamstein

williamstein Sep 19, 2016

Contributor

Heh, I'm here and can answer any questions about this. @haraldschilly can also.

SMC uses a patched version of Jupyter that indeed allows real time collaborative edits.

More details: the "patching" is monkey patching that happens entirely client side at the Javascript level. No original source code of Jupyter is changed. Instead, after the Jupyter iframe loads, some javascript is executed to add some hooks.

It just has a slightly lower granularity then for SMC notebooks: it's more at the level of the cell than the character.

Sync should work at the exact same level of granularity as SMC worksheets.

You might have been confused by the source, since there are two levels of diffing in the source code, one involving the cells and another involving their content. The cell-level diffing is used entirely to optimize updating the Jupyter HTML/DOM. If you know about React.js (or other "virtual DOM" libraries like vue.js), this is the same idea (except I first implemented it long ago before react was released, so it isn't nearly as good -- it's just a standard trick these days)...

This is documented here: https://github.com/sagemathinc/smc/wiki/sagejupyter#ipython-nb
We don't know if the patch was submitted or discussed with upstream.

At present there's no patch to their code to submit. Realtime sync is a little more complicated than just what goes on inside https://github.com/sagemathinc/smc/blob/master/src/smc-webapp/editor_jupyter.coffee; there's a whole "environment" around that, involving backend servers, etc., which has to be implemented somehow too...

There is a hackpad all about sync that Kyle Kelly and other Jupyter devs have been working on for a while, which I've contributed a lot to: https://nteract.hackpad.com/Realtime-collaboration-Ltj13iXQnQa
I don't know if this is public (?) -- login is definitely required at least.

Contributor

williamstein commented Sep 19, 2016

Heh, I'm here and can answer any questions about this. @haraldschilly can also.

SMC uses a patched version of Jupyter that indeed allows real time collaborative edits.

More details: the "patching" is monkey patching that happens entirely client side at the Javascript level. No original source code of Jupyter is changed. Instead, after the Jupyter iframe loads, some javascript is executed to add some hooks.

It just has a slightly lower granularity then for SMC notebooks: it's more at the level of the cell than the character.

Sync should work at the exact same level of granularity as SMC worksheets.

You might have been confused by the source, since there are two levels of diffing in the source code, one involving the cells and another involving their content. The cell-level diffing is used entirely to optimize updating the Jupyter HTML/DOM. If you know about React.js (or other "virtual DOM" libraries like vue.js), this is the same idea (except I first implemented it long ago before react was released, so it isn't nearly as good -- it's just a standard trick these days)...

This is documented here: https://github.com/sagemathinc/smc/wiki/sagejupyter#ipython-nb
We don't know if the patch was submitted or discussed with upstream.

At present there's no patch to their code to submit. Realtime sync is a little more complicated than just what goes on inside https://github.com/sagemathinc/smc/blob/master/src/smc-webapp/editor_jupyter.coffee; there's a whole "environment" around that, involving backend servers, etc., which has to be implemented somehow too...

There is a hackpad all about sync that Kyle Kelly and other Jupyter devs have been working on for a while, which I've contributed a lot to: https://nteract.hackpad.com/Realtime-collaboration-Ltj13iXQnQa
I don't know if this is public (?) -- login is definitely required at least.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 19, 2016

Contributor

On Mon, Sep 19, 2016 at 09:43:38AM -0700, William Stein wrote:

Heh, I'm here and can answer any questions about this.

Great, thanks a lot for the details, that's helpful; I wasn't sure
you'd have time to jump in. Glad to hear as well that their are
already plenty of discussions going on on that topic. Then we can
focus our energy elsewhere :-)

Sync should work at the exact same level of granularity as SMC
worksheets.

You might have been confused by the source, since there are two levels
of diffing in the source code, one involving the cells and another
involving their content. The cell-level diffing is used entirely to
optimize updating the Jupyter HTML/DOM. If you know about React.js (or
other "virtual DOM" libraries like vue.js), this is the same idea
(except I first implemented it long ago before react was released, so
it isn't nearly as good -- it's just a standard trick these days)...

This impression came just from using it. SMC felt more reactive; it
may well have just been some unrelated side effect of latency. It's
good to know that there is no intrinsic difference.

Cheers,
Nicolas

Contributor

nthiery commented Sep 19, 2016

On Mon, Sep 19, 2016 at 09:43:38AM -0700, William Stein wrote:

Heh, I'm here and can answer any questions about this.

Great, thanks a lot for the details, that's helpful; I wasn't sure
you'd have time to jump in. Glad to hear as well that their are
already plenty of discussions going on on that topic. Then we can
focus our energy elsewhere :-)

Sync should work at the exact same level of granularity as SMC
worksheets.

You might have been confused by the source, since there are two levels
of diffing in the source code, one involving the cells and another
involving their content. The cell-level diffing is used entirely to
optimize updating the Jupyter HTML/DOM. If you know about React.js (or
other "virtual DOM" libraries like vue.js), this is the same idea
(except I first implemented it long ago before react was released, so
it isn't nearly as good -- it's just a standard trick these days)...

This impression came just from using it. SMC felt more reactive; it
may well have just been some unrelated side effect of latency. It's
good to know that there is no intrinsic difference.

Cheers,
Nicolas

@williamstein

This comment has been minimized.

Show comment
Hide comment
@williamstein

williamstein Sep 20, 2016

Contributor

This impression came just from using it. SMC felt more reactive; it
may well have just been some unrelated side effect of latency. It's
good to know that there is no intrinsic difference.

I may have set a throttling or debouncing parameter differently to reduce
potential or perceived slow-down during usage. But it still operates at
the character level, not cell level.

William

Contributor

williamstein commented Sep 20, 2016

This impression came just from using it. SMC felt more reactive; it
may well have just been some unrelated side effect of latency. It's
good to know that there is no intrinsic difference.

I may have set a throttling or debouncing parameter differently to reduce
potential or perceived slow-down during usage. But it still operates at
the character level, not cell level.

William

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 21, 2016

Contributor

Corrected date and authors and submitted to the EU portal. Thanks to everyone.

Contributor

defeo commented Sep 21, 2016

Corrected date and authors and submitted to the EU portal. Thanks to everyone.

@defeo defeo closed this Sep 21, 2016

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 22, 2016

Contributor

Good to know that you can upload on the EU portal (apparently Benoît could not nor Michael). One less thing I have to manage myself. Thanks!
The reason I had not uploaded earlier is that I was waiting for feedback from our PO about the style of our latest deliverables w.r.t. the reviewer's request. But that's allright.

Contributor

nthiery commented Sep 22, 2016

Good to know that you can upload on the EU portal (apparently Benoît could not nor Michael). One less thing I have to manage myself. Thanks!
The reason I had not uploaded earlier is that I was waiting for feedback from our PO about the style of our latest deliverables w.r.t. the reviewer's request. But that's allright.

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 22, 2016

Contributor
Contributor

defeo commented Sep 22, 2016

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Sep 22, 2016

Contributor

On Thu, Sep 22, 2016 at 02:05:55AM -0700, Luca De Feo wrote:

It still says "draft" on the portal, I guess you have to validate it
anyway.

Ah perfect.
Next time, let's close it once it's completely submitted.

Cheers

Contributor

nthiery commented Sep 22, 2016

On Thu, Sep 22, 2016 at 02:05:55AM -0700, Luca De Feo wrote:

It still says "draft" on the portal, I guess you have to validate it
anyway.

Ah perfect.
Next time, let's close it once it's completely submitted.

Cheers

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Sep 22, 2016

Contributor

Nothing forbids re-opening the issue.

Contributor

defeo commented Sep 22, 2016

Nothing forbids re-opening the issue.

@defeo defeo reopened this Sep 22, 2016

embray added a commit to embray/OpenDreamKit.github.io that referenced this issue Oct 4, 2016

@bpilorget

This comment has been minimized.

Show comment
Hide comment
@bpilorget

bpilorget Oct 24, 2016

Contributor

Deliverables update

@defeo As you know , during the interim review in Bremen, reviewers gave advice to improve deliverables. UPSud tried to follow their advice by updating D5.1 #107
The main critic is that deliverables should be static document. Therefore we went through the #107 report to check if all links were still working and also if the information contained on the links was necessary for the understanding of the report.
As a result when it was necessary annexes were added to the #107 report.

Can you please do the same for this deliverable and add annexes when need be?

Contributor

bpilorget commented Oct 24, 2016

Deliverables update

@defeo As you know , during the interim review in Bremen, reviewers gave advice to improve deliverables. UPSud tried to follow their advice by updating D5.1 #107
The main critic is that deliverables should be static document. Therefore we went through the #107 report to check if all links were still working and also if the information contained on the links was necessary for the understanding of the report.
As a result when it was necessary annexes were added to the #107 report.

Can you please do the same for this deliverable and add annexes when need be?

@defeo

This comment has been minimized.

Show comment
Hide comment
@defeo

defeo Nov 2, 2016

Contributor

Can you please do the same for this deliverable and add annexes when need be?

@bpilorget, I confirm that this deliverable is ready and complete, and needs no appendices.

Contributor

defeo commented Nov 2, 2016

Can you please do the same for this deliverable and add annexes when need be?

@bpilorget, I confirm that this deliverable is ready and complete, and needs no appendices.

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Jan 4, 2017

Contributor

Report submitted on the EU portal.

Contributor

nthiery commented Jan 4, 2017

Report submitted on the EU portal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment