FileStorageService support for folder scattering

[luis100]

Anti-cluttering technique similar to hashed directory structure.

For folders that will have entries that are randomly generated, like the storage/aip, that will have a sub-folder for each AIP with the ID as the folder name, which ill be an randomly generated UUID, we can use a technique to work-around the possible cluttering of billions of directory entries.

Example: 123e4567-e89b-12d3-a456-426655440000
123/e45/123e4567-e89b-12d3-a456-426655440000

Have a configuration in roda-core.properties that defines the folders where this technique will be used and with what configuration.

core.storage.filesystem.sparse = aip
core.storage.filesystem.sparse = jobreport
# base path regex pattern
core.storage.filesystem.sparse.aip.base = aip/
# first block with 3 characters, second block with 2 characters, then entry with all characters
core.storage.filesystem.sparse.aip.path = aip/%3/%2/%all 
# if path first not found, fallback to second option
# first block with 3 characters, second block with 2 characters, then entry with rest of characters
core.storage.filesystem.sparse.aip.path = aip2/%3/%2/%rest 

# base path regex pattern
core.storage.filesystem.sparse.jobreport.base = job-report/(.*)/
core.storage.filesystem.sparse.jobreport.base = job-report/$1/%2/%all

[nunovieira220]

Done on 47ffeac