Add support for reprozip

[yuvipanda]

ReproZip is an awesome OSS project that lets users capture dependencies of a computation with syscall capture and turn that into a self contained .rpz file. This .rpz file can then be built into a docker image & run!

We should add support for running .rpz files in repo2docker (and hence binderhub). There are two steps:

1. Figure out how to tell repo2docker that it's dealing with a rpz file (related to Adding support for OSF #102 refactoring maybe?)
2. Call out into reprozip-docker to produce a docker image

This should help us support rpz files in binderhub easily.

[choldgraf]

+1 to that, would be very cool. Maybe we can grab one of the reprozip people tomorrow and sit down w/ em? You were speaking to them after the talk, yeah?

[remram44]

We are around. In fact, you were sitting with us at breakfast 😝

[choldgraf]

hehe, indeed I figured that out this morning :-)

[yuvipanda]

I had more conversations over lunch yesterday about this. Problems we need to solve:

1. Right now, repo2docker treats one repo (directory) as one image. With rpz files, one file is an image. How do we map this?
2. rpz files will most likely not have jupyter installed in them. How do we do that? We can't depend on any environment existing inside the rpz, so can't just depend on pip install working.
3. Same as (2) but for kernelspec files. How do we get those in? How do we decide what kernels need to be there?

This is just for the use case of 'rpz files opened with Jupyter Notebooks'. However, it is possible that the model instead should be just 'rpz files executing the one command / series of commands that were traced with them'. That's also a use-case we should support, and that will be conceptually a bit simpler perhaps. Am not sure what a non-API UI for that will look like yet, however.

[betatim]

Could we support "rpz file" as a new build pack? So you add the contents of one "on top of" the basic layers of the standard docker image used by repo2docker?

[choldgraf]

I think a challenge that Yuvi mentioned is that they often have repos with multiple rpz files. But that doesn't seem like a deal breaker as you could always use a text file to point to one or another.

…

On Thu, Nov 9, 2017, 8:24 AM Tim Head ***@***.***> wrote: Could we support "rpz file" as a new build pack? So you add the contents of one "on top of" the basic layers of the standard docker image used by repo2docker? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#133 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABwSHdNj6TPQTOPvZeBMzC7CetlZ8Ynjks5s0vz1gaJpZM4QUBzU> .

[jzf2101]

@remram44 maybe we can talk about this some time?

[remram44]

Absolutely! We're happy to talk more about what you think we should look into and what you are interested in 😉

I've been meaning to put forward a proof-of-concept of this, but I am pretty swamped. Hopefully very soon.

[yuvipanda]

What is a possible next step here? :)

[manics]

Is this still on the wish list?