Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for CernVM-FS graph driver #383

Open
jwflory opened this issue Jul 11, 2019 · 7 comments

Comments

@jwflory
Copy link

@jwflory jwflory commented Jul 11, 2019

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind feature

Description

CernVM-FS (cvmfs) is a read-only, distributed filesystem with use cases specific to research / HPC computing. There is a CernVM-FS graph driver for Docker that enables Docker to use cvmfs as a storage back-end.

This is desirable for a number of reasons. For advanced computing environments with parallel file systems (see containers/libpod#3478), there are a number of challenges for user namespaces in these environments. Using cvmfs as a storage back-end for containers works around the existing challenges with parallel filesystems and also allows administrators of these computing environments to store and distribute container images quickly.

A user story:

Systems Administrator Joe wants to put container image artifacts on a cheaper tier storage than GPFS (containers/libpod#3478) and chose CernVM-FS. Would a container storage support for cvmfs make sense? Red Hat Quay supports bittorrent. Would cvmfs make sense for Red Hat Quay or should a Quay → cvmfs bridge such as DUCC be used?

Steps to reproduce the issue:

  1. podman --storage-driver=cvmfs pull registry.fedoraproject.org/fedora:latest

Additional environment details (AWS, VirtualBox, physical, etc.):

This use case is, as far as I am aware, exclusive to HPC / grid computing administrators for enabling rootless container support in parallel filesystem environments.

@rhatdan

This comment has been minimized.

Copy link
Member

@rhatdan rhatdan commented Jul 11, 2019

We would need a PR from someone with access to Cern VM-FS. I am not sure if Fedora or Ubuntu has native support for this.

@rhatdan

This comment has been minimized.

Copy link
Member

@rhatdan rhatdan commented Nov 1, 2019

@jwflory Is this still something you want to pursue?

@jwflory

This comment has been minimized.

Copy link
Author

@jwflory jwflory commented Nov 2, 2019

@rhatdan Unfortunately it isn't something I'm able to work on right now, sorry!

@rhatdan

This comment has been minimized.

Copy link
Member

@rhatdan rhatdan commented Nov 3, 2019

@nalind is this something we could handle?

@nalind

This comment has been minimized.

Copy link
Contributor

@nalind nalind commented Nov 5, 2019

I'd have to do more research into it to be certain.

@SEJeff

This comment has been minimized.

Copy link

@SEJeff SEJeff commented Nov 7, 2019

If it helps, we've got an ok from cvmfs upstream to package it for Fedora and maybe get it into EPEL. I won't be able to work on that for a month or more likely two but did plan on doing that. It is mostly just some c code and libcurl

@rhatdan

This comment has been minimized.

Copy link
Member

@rhatdan rhatdan commented Nov 7, 2019

Sounds cool. If anyone else wants to jump on this in the mean time, it would be appreciated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants
You can’t perform that action at this time.