Skip to content

Commit

Permalink
chunked: implement lookaside cache
Browse files Browse the repository at this point in the history
avoid parsing each json TOC file for the layers in the local storage,
but attempt to create a lookaside cache in a custom format faster to
load (and potentially be mmap'able).

The same cache is used to lookup files, chunks and candidates for
deduplication with hard links.

There are 3 kind of digests stored:

- digest(file.payload))
- digest(digest(file.payload) + file.UID + file.GID + file.mode + file.xattrs)
- digest(i) for each i in chunks(file payload)

Signed-off-by: Giuseppe Scrivano <gscrivan@redhat.com>
  • Loading branch information
giuseppe committed Jan 10, 2022
1 parent a5f0cdd commit 10697a0
Show file tree
Hide file tree
Showing 2 changed files with 388 additions and 99 deletions.
Loading

0 comments on commit 10697a0

Please sign in to comment.