Sharded GGUF in subdir

[coyotte508]

yes valid question from @coyotte508 actually (read too fast initially)

IIRC @Narsil the shard index file contains relative filenames (there's no notion of directory), right? we should always assume the single files are in the same folder imo, correct?

Let's open an issue so we don't forget this, ok?

Originally posted by @julien-c in #563 (comment)

[coyotte508]

cc @mishig25 too

[julien-c]

@coyotte508 the issue (and my past comment) is with safetensors files, not GGUF, so i think we can close this one in favor of #588

[coyotte508]

yes 🤦