Skip to content
This project deals with extracting all primary features and their related tags to geopackage
HTML Dockerfile Shell
Branch: master
Clone or download
Latest commit e00a5fb Jan 5, 2020
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
archive Create readme.md Jan 5, 2020
docker adds docker files Jan 5, 2020
download.osmdata.xyz
logos Add files via upload Sep 26, 2019
taginfo Update taginfo.json Oct 11, 2019
workflow_scripts Update 01_baseconfig Jan 5, 2020
LICENSE Initial commit May 19, 2019
README.md Update README.md Jan 5, 2020

README.md

osmdata.xyz logo

osmdata.xyz | global osm extracts

This project provides global data extracts based on OpenStreetMap data as GeoPackages. Each extract represents its related primary feature respectively key value regarding the OpenStreetMap project. Every GeoPackage contains the three types of geometries: point, line and polygon. For each primary feature all prepared tags are always contained in the same way (see mapping.yml).

Extracts are available on

https://download.osmdata.xyz/

In a monthly cycle new extracts are provided. The first Planet Dump of each month from openstreetmap.org will be available 10 days later as it takes a while for the data to be processed. Every second month, Buildings and Highways will be updated.

Projection of the geodata: WGS 84 | EPSG 4326 | https://spatialreference.org/ref/epsg/4326/

Why

OpenStreetMap (OSM) offers an amazing collection of data. The information contained provides many possibilities to better understand the whole world, e.g. with the use of a geographic information system (GIS). There are many tools to create small extracts from the OSM data: overpass-turbo (API) or other tools in QGIS/ArcGIS. A bigger challenge is the creation of ready to use GIS-compatible data sets from OSM, which cover whole countries, continents or even the whole world.

osmdata.xyz is my hobby and absolutely non-commercial. I'm happy to share open data, knowledge and insights.

Utilized tools to create extracts

Workflow: https://github.com/michaelmgis/osmdata.xyz/tree/master/workflow_scripts

Data basis

Recent improvements and changes

  • 01.2020
  • 10.2019
    • definition of geometrytype improve reading the content of a GeoPackage with QGIS
    • new tags: internet_access, wifi
  • 08.2019
    • all geometries of each map feature are stored in one GeoPackage
    • new processing chain - imposm3 is used since the extracts from 20190805 - see workflow_scripts.

Approach and statistics

The processing chain published here is designed to reduce storage consumption as much as possible. Each extract based on the primary map feature (e.g. building) is created individually. Intermediate products are deleted to save storage space.

Example 1 - current workflow: "building" as extract with the highest storage usage: A maximum of 608 GB of storage space is required to create the largest data set "building". All other primary map features require significantly less storage.

Type Size
all PBF files 50,00 GB
impcache 33,50 GB
PostGIS database 234,40 GB
Building GPKG 290,00 GB
Sum 607,90 GB

Example 2 - entire global data set is stored in a database - extract of buildings: A maximum of 924 GB of storage is required to create the largest data set "building".

Type Size
PBF 47,00 GB
impcache 92,00 GB
PostGIS database 495,00 GB
Building GPKG 290,00 GB
Sum 924,00 GB

Conclusion: If storage space plays a role, then the approach published here is recommended. If there is enough memory, you can skip the step of splitting the PBF files (03_osm_filter) and just transfer everything to the database.

Copyright and License

OpenStreetMap© is open data, licensed under the Open Data Commons Open Database License (ODbL) by the OpenStreetMap Foundation (OSMF). https://www.openstreetmap.org/copyright/en

Happy about feedback

Let me know, if you are happy or what could be improved. Please post an issue or write to hello@osmdata.xyz

You can’t perform that action at this time.