fsimage-generator

FSImage generator

Generates an FSImage file (via MiniDFSCluster) containing directories and files for testing and benching.

See FsImageGenerator for details (directory depth, files per directory etc.)

Building

mvn package

Running

java [-Ddfs.image.compress=true] -jar target/hfsa-fsimage-generator-VERSION.jar

Example output:

2020-01-14 20:23:27,126 INFO  FsImageGenerator  - Max depth = 5, max width = 2, files-factor = 10
2020-01-14 20:23:27,127 INFO  FsImageGenerator  - Generates 806 dirs (depth up to 5) and 209560 files
2020-01-14 20:23:42,107 INFO  FsImageGenerator  - Progress: 100 directories and 26000 files...
2020-01-14 20:23:50,717 INFO  FsImageGenerator  - Progress: 200 directories and 52000 files...
...
2020-01-14 20:24:41,387 INFO  FsImageGenerator  - Progress: 800 directories / 208000 files...
2020-01-14 20:24:42,377 INFO  FsImageGenerator  - Created new FSImage containing meta data for 806 directories and 209560 files
2020-01-14 20:24:42,377 INFO  FsImageGenerator  - FSImage path : /Users/mm/projects/hfsa/fsimage-generator/fsimage.img