Skip to content
This repository has been archived by the owner on Oct 23, 2024. It is now read-only.

Data missing #7

Closed
SomeoneElseOSM opened this issue Feb 24, 2017 · 15 comments
Closed

Data missing #7

SomeoneElseOSM opened this issue Feb 24, 2017 · 15 comments
Assignees

Comments

@SomeoneElseOSM
Copy link

http://www.openstreetmap.org/note/610114 describes some data moved from OSM to OHM. The OHM node created was http://www.openhistoricalmap.org/node/2083425344 , but that doesn't seem to be in the data that has been restored.

@rwarren2
Copy link

Yes, the data is lost. I'll post to the mail list about this.

@rwarren2 rwarren2 self-assigned this Feb 25, 2017
@mmd-osm
Copy link

mmd-osm commented Mar 5, 2017

Hi everyone. I have found an old planet dump on my disk dated 2016/01/23. Will post a link once the upload finishes.

@rwarren2
Copy link

rwarren2 commented Mar 5, 2017

Excellent. Reloading the data should be interesting. Have to check how many people made edits since we restarted the system.

@mmd-osm
Copy link

mmd-osm commented Mar 5, 2017

OK, here we go: http://dev.overpass-api.de/tmp/psv/ohm/ohm_planet_20160123.pbf

To reduce file size I have converted the osm.bz2 file to pbf via osmium tool. Please let me know if you see some issues with the file.

@SomeoneElseOSM
Copy link
Author

Excellent news! For the benefit of anyone else who might want to download that, how big actually is that?

@mmd-osm
Copy link

mmd-osm commented Mar 5, 2017

It's 722 MB in total. Not too much compared to the usual osm planet dumps. So, let's grab your copy today!

@rwarren2
Copy link

rwarren2 commented Mar 5, 2017

Getting "HTTP request sent, awaiting response... 403 Forbidden"

@mmd-osm
Copy link

mmd-osm commented Mar 5, 2017

Can you try again please? wget was blocked in .htaccess

@rwarren2
Copy link

rwarren2 commented Mar 5, 2017

Got a copy. Will work on this today +6hours.

Thank you for this.

@mmd-osm
Copy link

mmd-osm commented Mar 5, 2017

File contents look a bit strange, though. I can only find some nodes, but no ways or relations. The original file was called ohm_planet_20160123.osm.bz2 with a file size of 1343133623. Is that somewhat in line with what you would expect? I will also upload the original file, but that'll take a bit longer...

http://dev.overpass-api.de/tmp/psv/ohm/ohm_planet_20160123.osm.bz2 - 1.3GB

@rwarren2
Copy link

rwarren2 commented Mar 6, 2017

Downloading this file too. Working on it.

@rwarren2
Copy link

rwarren2 commented Mar 6, 2017

I looks like the dump is complete. I am going to need to figure out how to reload this data.

@rwarren2
Copy link

rwarren2 commented Mar 6, 2017

Thanks for this!

@mmd-osm
Copy link

mmd-osm commented Mar 6, 2017

It's a bit strange that things like http://www.openhistoricalmap.org/way/198180456 are missing in the dump. It may be that the dump generation already had some issues last year and only exported nodes.

In the worst case this dump is not that helpful as baseline for a full restore, but maybe you could selectively extract some POI nodes at least, or use stale nodes as starting points for new ways (avoids some of the tracing effort).

Maybe you could try and reach out to Jochen (@joto) on how to use osmium tools to filter / merge your 2015 dump and my 2016 dump into something useful.

BTW: I downloaded it last year to run some tests with Overpass and start_dates.

@rwarren2
Copy link

rwarren2 commented Sep 8, 2019

Ok. At this point, this is obsolete.

@rwarren2 rwarren2 closed this as completed Sep 8, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants