New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Http accessible folder that we can update on one of the penguins #28

Closed
pjotrp opened this Issue Jan 25, 2016 · 10 comments

Comments

Projects
None yet
2 participants
@pjotrp
Member

pjotrp commented Jan 25, 2016

In line with an E-mail I sent last week, can we have a directory exposed to outside, e.g., through http://files.genenetwork.org/. This should reflect a writable directory for the 'gnfiles' group of which I should be member. This is the starting point for deploying data files. This dir should now have 1TB free and may grow out of that in a year when adding raw data. Files going into this dir should contain a SHA value in the name that represent either MD5 or Pfff values.

@pjotrp pjotrp added the enhancement label Jan 25, 2016

@lyan6

This comment has been minimized.

Show comment
Hide comment
@lyan6

lyan6 Jan 27, 2016

Contributor

Hi Pjotr,

Do you think this plan is OK?

  1. Create a 1TB partition on another server, and then mount it on Penguin by NFS.
  2. Your account on penguin can read/write that partition/directory.
  3. Create a public http service (http://files.genenework.org/) which reflects that directory, and anybody can download files from this.
Contributor

lyan6 commented Jan 27, 2016

Hi Pjotr,

Do you think this plan is OK?

  1. Create a 1TB partition on another server, and then mount it on Penguin by NFS.
  2. Your account on penguin can read/write that partition/directory.
  3. Create a public http service (http://files.genenework.org/) which reflects that directory, and anybody can download files from this.
@pjotrp

This comment has been minimized.

Show comment
Hide comment
@pjotrp

pjotrp Jan 27, 2016

Member

Fine with me :)

Member

pjotrp commented Jan 27, 2016

Fine with me :)

@pjotrp

This comment has been minimized.

Show comment
Hide comment
@pjotrp

pjotrp Feb 8, 2016

Member

Where are we on this one? I want to move the genotype files out of the GN2 repo.

Member

pjotrp commented Feb 8, 2016

Where are we on this one? I want to move the genotype files out of the GN2 repo.

@lyan6

This comment has been minimized.

Show comment
Hide comment
@lyan6

lyan6 Feb 10, 2016

Contributor

The HTTP service is running.

http://files.genenetwork.org/

@Penguin:/mnt/big/files.genenetwork.org

Contributor

lyan6 commented Feb 10, 2016

The HTTP service is running.

http://files.genenetwork.org/

@Penguin:/mnt/big/files.genenetwork.org

@pjotrp

This comment has been minimized.

Show comment
Hide comment
@pjotrp

pjotrp Feb 10, 2016

Member

Thanks! Can we also mount this dir on penguin2? GN2 will use it.

Member

pjotrp commented Feb 10, 2016

Thanks! Can we also mount this dir on penguin2? GN2 will use it.

@pjotrp

This comment has been minimized.

Show comment
Hide comment
@pjotrp

pjotrp Feb 14, 2016

Member

Actually it is fine like this. Thanks and closed!

Member

pjotrp commented Feb 14, 2016

Actually it is fine like this. Thanks and closed!

@pjotrp pjotrp closed this Feb 14, 2016

@pjotrp

This comment has been minimized.

Show comment
Hide comment
@pjotrp

pjotrp Feb 25, 2016

Member

It is working great. Are we making backups of this folder? Please close on confirmation.

Member

pjotrp commented Feb 25, 2016

It is working great. Are we making backups of this folder? Please close on confirmation.

@pjotrp pjotrp reopened this Feb 25, 2016

@lyan6

This comment has been minimized.

Show comment
Hide comment
@lyan6

lyan6 Mar 18, 2016

Contributor

To build a public rsyncd service which reflects that directory ...

Contributor

lyan6 commented Mar 18, 2016

To build a public rsyncd service which reflects that directory ...

@lyan6

This comment has been minimized.

Show comment
Hide comment
@lyan6

lyan6 Mar 21, 2016

Contributor

The public rsyncd service is running.

rsync -nah --stats rsync://files.genenetwork.org/gnfiles/

Contributor

lyan6 commented Mar 21, 2016

The public rsyncd service is running.

rsync -nah --stats rsync://files.genenetwork.org/gnfiles/

@lyan6

This comment has been minimized.

Show comment
Hide comment
@lyan6

lyan6 Mar 23, 2016

Contributor

Backups for this folder is done, and an auto script as crontab is running.

Contributor

lyan6 commented Mar 23, 2016

Backups for this folder is done, and an auto script as crontab is running.

@lyan6 lyan6 closed this Mar 23, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment