Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
images Add positive and negative samples Aug 4, 2017
inference Add pre-trained models Jul 26, 2017
models Add pre-trained models Jul 26, 2017
samples Add pre-trained models Jul 26, 2017
README.md
crosswalk_downloader.py Add pre-trained models Jul 26, 2017
regions.json Add script and regions.json Mar 16, 2017

README.md

Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification

Rodrigo F. Berriel, André Teixeira Lopes, Alberto F. de Souza, and Thiago Oliveira-Santos

IEEE Geoscience and Remote Sensing Letters: 10.1109/LGRS.2017.2719863

Thumbnail

High-resolution satellite imagery have been increasingly used on remote sensing classification problems. One of the main factors is the availability of this kind of data. Even though, very little effort has been placed on the zebra crossing classification problem. In this letter, crowdsourcing systems are exploited in order to enable the automatic acquisition and annotation of a large-scale satellite imagery database for crosswalks related tasks. Then, this dataset is used to train deep-learning-based models in order to accurately classify satellite images that contains or not zebra crossings. A novel dataset with more than 240,000 images from 3 continents, 9 countries and more than 20 cities were used in the experiments. Experimental results showed that freely available crowdsourcing data can be used to accurately (96.78%) train robust models to perform crosswalk classification on a global scale.


Dataset Automatic Acquisition and Annotation

To download the dataset, you should run the command below for each region of interest. Be careful with your API quota.

python crosswalk-downloader.py --region={REGION_NAME} --negative --positive --key={API_KEY}
# e.g. to download the crosswalks only of the regions in Asia
python crosswalk-downloader.py --region=asia --positive --key={API_KEY}

Test with your data

Pre-trained models are available here.

This Python notebook may help you with the inference process.

Dataset

The dataset used in this work is defined by a group of city-based regions. As stated in the paper, "even though each part of the dataset is named after a city, some selected regions were large enough to partially include neighboring towns". The regions can be seen in the file regions.json and a summary of the dataset can be seen below.

Dataset Name Crosswalks No-Crosswalks
Europe-Belgium-Brussels 7,916 18,739
Europe-France-Lion 5,168 11,960
Europe-France-Paris 5,828 13,353
Europe-France-Marseille 2,615 6,668
Europe-France-Toulouse 4,794 11,046
Europe-Italy-Turim 5,081 11,324
Europe-Italy-Milan 4,536 10,147
Europe-Portugal-Porto 1,630 3,786
Europe-Portugal-Lisbon 1,731 4,460
Europe-Spain-Saragoca 1,413 3,310
Europe-Switzerland-Zurich 1,842 4,668
Europe                 42,554 99,461 
America-USA-Seattle 1,276 2,929
America-USA-WashingtonDC 2,838 6,503
America-USA-Philadelphia 2,356 6,145
America-USA-NewYork 2,191 4,919
America-Canada-Mississauga 3,259 7,463
America-Canada-Toronto 3,902 8,852
America 15,822 36,811
Asia-Japan-Tokyo 6,888 15,529
Asia-Japan-Toyokawa 1,837 4,140
Asia-Japan-Sapporo 6,946 15,780
Asia 15,671 35,449
Total 74,047 171,721

Positive Samples

PositiveSamples

Negative Samples

NegativeSamples

BibTeX

@article{berriel2017grsl,
    Author  = {Rodrigo F. Berriel and Andre T. Lopes and Alberto F. de Souza and Thiago Oliveira-Santos},
    Title   = {{Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification}},
    Journal = {IEEE Geoscience and Remote Sensing Letters},
    Year    = {2017},
    DOI     = {10.1109/LGRS.2017.2719863},
    ISSN    = {1545-598X},
}