inspiration/ideas for kompress

[karlicoss]

Ideally I want something like pathlib.Path, but also supporting archives. Ideally it would be transparent, so for the data consumer it doesn't matter if the file is compressed or not.

At the moment I'm using a helper. It's a bit crude, but mostly works. Would be nice to replace it with a proper library though, that's worth extra dependency.

Potential candidates:

• https://github.com/PyFilesystem/pyfilesystem2
  uses some sort of non-standard interface, but perhaps possible to implement a Path adapter
  will probably need to use https://github.com/althonos/fs.archive (although it doesn't support xz at the moment)
• https://github.com/jaraco/zipp
  only supports zip files? (backport of python's zipfile.Path)
• https://github.com/ponty/pyunpack
  some non-standard interface, but perhaps more interesting is that it uses this, supports quite a few formats: https://github.com/wummel/patool

Some relevant discussions:

• Make pathlib extensible

Related:

• replace PosixPath with PurePosixPath (fixes #28) HPI#29

[karlicoss]

This looks interesting https://github.com/PyFilesystem/pyfilesystem2

[karlicoss]

Interesting enough, there are some useful functions in the standard library

https://docs.python.org/3/library/shutil.html#shutil.unpack_archive
https://docs.python.org/3/library/tarfile.html#tarfile.open

However seems that it only supports .tar packed files, so not possible to use it as a handy universal file extractor

[karlicoss]

Actually tarfile isn't too bad, seems that it's capable of guessing compression and the interface is okay. So might be possible to have a short wrapper similar to ZipPath if there are more tar.gz exports karlicoss/HPI@5799c06

[karlicoss]

Btw seems that there's been some interesting progress here, some great work towards making pathlib.Path more extensibe (although some thing are only available since python 3.12) https://discuss.python.org/t/make-pathlib-extensible

[karlicoss]

After a few years, seems that nothing like this exists, so started extracting in a library https://github.com/karlicoss/kompress

[karlicoss]

transferred the issue since it has some useful links here

[karlicoss]

went through the thread linked above to catch up

• a couple of Path implementations https://discuss.python.org/t/make-pathlib-extensible/3428/41
• seems that from 3.12 we can subclass pathlib.Path directly, worth doing that in compat mode https://discuss.python.org/t/make-pathlib-extensible/3428/59
• seems that it will actually be backported, so maybe we'll eventually just switch to this! https://github.com/jazzband/pathlib2