Skip to content
How to use machine learning to find interesting places on satellite maps
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
doc
examples
model
README.md
requirements.txt

README.md

Search for illegal amber mining on satellite images, HOWTO

How we created dataset and trained a model

Read here for even more detailed description of a project

This is a description of methodology for project Leprosy of the Land made by Texty during March, 2018. Main idea was to use machine learning to find all places of illegal amber mining in Nothern-West regions of Ukraine, on satellite images.

Motivation

In 2010 world prices for amber started to surge. Due to this in 2012 demand was so high that north-western part of Ukraine became place of "amber rush" and "new Wild West". Thousands of prospectors starts to search for gems with shovels and later with water pumps. Hundreds of hectars in forests / agricultural land became a desert, a lifeless moon landscape. 2014-2016 were most intence years of illegal mining, but it's still going right now.

We decided to estimate, for the first time, the scale of environmental impact from this phenomenon.

Project stages

  1. Research how patches of land with illegal mining could look on satellite images (look at images for some known locations with amber mining, use known videos and photos, make interviews with field experts)

  2. Find which map providers have relatively recent satellite images with good resolution. Find examples of places with mining on such images (Mostly it's Bing Maps by Microsoft. It has excellent API, for example it provides useful metadata such as a date for each tile. Due to small characteristic size of digged holes, we needed resolution no less then 1m per pixel).

  3. Find and compile initial set of coordinates for images with traces of mining (we found first places with mining with a huge help from participants of Open Data Day Kyiv )

  4. Split each such tile to superpixels/segments (part of image with approximately homogeneous visual appearance)

  5. Use neural net to extract features for each superpixel (we used pretrained, vanilla ResNet50 from Keras library)

  6. Create labelled set of superpixels for binary classificator (split images on two sets - with traces of amber mining, and without such traces)

  7. Create machine model to classify superpixels (XGBoost was choosed due to best performance, after several tries)

  8. Apply steps 4,5 and classifier from step 7 to each superpixel/segment for all images from region of interest. If more then 2 superpixels classified as positive, mark current image as area of mining (We processed approximately 450,000 images from region with total area about 70,000 km^2, total computation time was ~100 hours on one computer with two GeForce GTX 960 onboard)

  9. Create interactive map with places found by our method ( Most active period of mining was during 2014-2016 years. Most tiles from maps dated by 2015. We found more then 1,000 hectares of damaged land)

Result: we present most informative, as for this moment, interactive map of impact on environment due to illegal amber mining in Ukraine (this article is in English)

Python notebooks

Sources of inspiration

At first we were thinking about such (amber related) project back in 2016, during work on deforestation in Karpathian mountains. But in that time we didn't have relatively recent satellite images with resolution big enough.

I'd like to say couple of kind words for Terrapattern, amazing project which proved that similar analysis of satellite images is possible.

Other remarks

For the article, we used a novel way to make a transition between main visual elements --- fragments of satellite images --- and interactive map with the same images. You should see it by yourself :)

Publicity

Contact autor of this repository:

Anatoliy Bondarenko

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.