Hierarchical Scene Analysis (HSA) - Benchmark
This project contains all benchmark code and data used in:
[Hierarchical Scene Annotation] (http://vision.caltech.edu/~mmaire/papers/pdf/seg_annotate_bmvc2013.pdf)
Michael Maire, Stella X. Yu, and Pietro Perona
British Machine Vision Conference (BMVC), 2013
It includes the results of evaluating the gPb-UCM algorithm on the Shore dataset with hierarchical groundtruth, as described in the above paper.
To evaluate your own segmentation algorithm on this benchmark:
- Replace the files in
datasets/shore/ucm/with weighted boundary maps output by your segmentation algorithm.
benchmark/correspond/directory (compiles boundary correspondence MATLAB mex file).
run_bench_batch.mwith "datasets/shore" as the first argument. Generated results will be placed in
- Optionally use
combine_bench.mto summarize benchmark results.
MATLAB code within
benchmark/ is organized as follows:
bench/eval_boundary.m - main benchmark function
bench/combine_bench.m - benchmark stats summarization
bench/run_bench_batch.m - script for running benchmark
correspond/ - boundary correspondence code
mpi/ - tools for distributed benchmark execution
render/ - rendering of region tree annotations
util/ - utilities for working with region trees and UCMs
vis/ - benchmark visualization code
Shore Dataset Images
We are able to redistribute the original images of the Shore dataset free of charge, but for the purpose of research use only. To obtain a copy of the images, please use the following form to submit your request:
If you do not receive a response within one business day, please contact Michael Maire via email: email@example.com.
The benchmark code expects the image .jpg files to reside in:
Copyright (C) 2013 Michael Maire firstname.lastname@example.org
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
This project includes code from various external sources:
BSDS Benchmark Boundary Correspondence Code
Image & Video Matlab Toolbox by Piotr Dollar
License: Simplified BSD