Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rework old.pkg.pacman.store that it's a static html page, not a MFS listing #1

Closed
RubenKelevra opened this issue Feb 6, 2020 · 1 comment
Labels
bug Something isn't working

Comments

@RubenKelevra
Copy link
Owner

Currently, everything hold in MFS will be stored forever on a node, regardless if pinned by the cluster or not.

To circumvent an overflow of the trusted node, inserting new packages, we need to modify the old.pkg.pacman.store function to an HTML document, which just holds links to the CID's to the snapshots.

In this process the snapshots should be moved from old.pkg.pacman.store to the subdirectory, having a file called default which is an HTML document in the style of an IPFS listing which holds the CID as a link.

The directories need to be pinned by the cluster, non-recursive, with a timeout, when they are replaced, to allow for proper unpinning and garbage collection of the files on the trusted host.

See also:
ipfs/kubo#6878

@RubenKelevra RubenKelevra added the bug Something isn't working label Feb 6, 2020
@RubenKelevra RubenKelevra added this to To do in client-packages via automation Feb 10, 2020
@RubenKelevra RubenKelevra added this to the client-packages-basic milestone Feb 10, 2020
@RubenKelevra RubenKelevra moved this from To do to next in client-packages Feb 10, 2020
@RubenKelevra RubenKelevra moved this from next to In progress in client-packages Feb 19, 2020
@RubenKelevra RubenKelevra moved this from In progress to Done in client-packages Feb 20, 2020
RubenKelevra added a commit that referenced this issue Feb 20, 2020
-cache structure has changed, normal pkgs are now in cache/ and additionally as copy in the individually repo folders
-root folders are now recursively pinned, this should allow for faster lookup, sinc the whole cluster hold all data (for directories)
-the archive is now not a copy, but only a html-list. This allows the importing server to properly garbage collect after 2 month of holding packages (they are no longer stored in the MFS) fixes #1
@RubenKelevra
Copy link
Owner Author

fixed in 4cd1151

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Development

No branches or pull requests

1 participant