lib

Hadoop FSImage Analyzer (HFSA)

The HFSA lib supports fast and partly multithreaded fsimage processing API file-, directory- and symlink aware visitor, derived from Apache HDFS FSImageLoader

Example Usage

Use parallel() for multithreaded execution when loading or visiting INode hierarchy:

RandomAccessFile file = new RandomAccessFile("src/test/resources/fsi_small.img", "r");
FsImageData fsimageData = new FsImageLoader.Builder().parallel().build().load(file);
new FsVisitor.Builder().parallel().visit(fsImageData,new FsVisitor() {
    @Override
    public void onFile(FsImageProto.INodeSection.INode inode, String path) {
        System.out.println("Visiting file " + inode.getName().toStringUtf8());
        // You can access size, permissions, ...
    }

    @Override
    public void onDirectory(FsImageProto.INodeSection.INode inode, String path) {
        System.out.println("Visiting directory " + inode.getName().toStringUtf8());
    }

    @Override
    public void onSymLink(FsImageProto.INodeSection.INode inode, String path) {
        System.out.println("Visiting sym link " + inode.getName().toStringUtf8());
    }
}, "/some/start/path");

See HdfsFSIMageTool for a more advanced usage.