Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PostgreSQL processing stage - output ideas #207

Open
pnorman opened this issue Oct 28, 2014 · 3 comments
Open

PostgreSQL processing stage - output ideas #207

pnorman opened this issue Oct 28, 2014 · 3 comments

Comments

@pnorman
Copy link
Collaborator

pnorman commented Oct 28, 2014

Currently the output for the last stage where indexes are created and clustering is done looks like this

Sorting data and creating indexes for planet_osm_point
Sorting data and creating indexes for planet_osm_line
Sorting data and creating indexes for planet_osm_roads
Sorting data and creating indexes for planet_osm_polygon
Maximum node in persistent node cache: 0
Stopping table: planet_osm_nodes
Stopping table: planet_osm_ways
Building index on table: planet_osm_ways (fastupdate=off)
Stopping table: planet_osm_rels
Building index on table: planet_osm_rels (fastupdate=off)
Stopped table: planet_osm_nodes in 0s
Analyzing planet_osm_point finished
Analyzing planet_osm_roads finished
Stopped table: planet_osm_rels in 227s
Analyzing planet_osm_line finished
Analyzing planet_osm_polygon finished
Copying planet_osm_point to cluster by geometry finished
Creating geometry index on  planet_osm_point
Copying planet_osm_roads to cluster by geometry finished
Creating geometry index on  planet_osm_roads
Creating osm_id index on  planet_osm_roads
Creating indexes on  planet_osm_roads finished
All indexes on  planet_osm_roads created  in 1901s
Completed planet_osm_roads
Creating osm_id index on  planet_osm_point
Creating indexes on  planet_osm_point finished
All indexes on  planet_osm_point created  in 2407s
Completed planet_osm_point
Copying planet_osm_line to cluster by geometry finished
Creating geometry index on  planet_osm_line
 Creating osm_id index on  planet_osm_line
Creating indexes on  planet_osm_line finished
All indexes on  planet_osm_line created  in 8101s
Completed planet_osm_line
...

Unless you know how to read it, this is very unhelpful for knowing where you are and what remains to be done. Even if you do know, it's still a pain.

How does this look as an alternative output format?

                        roads  point  line  polygon  way  rels
Cluster Index Building      x      x     x        x    -     -
Clustering                  x      x     x        x    -     -
Indexing                    x      x     x        .    .     x
hstore indexing             x      x     .             -     - [if applicable]
Analyzing                   x      x     x        x    x     x
@achapkowski
Copy link

I like it, simple, to the point.

@pnorman
Copy link
Collaborator Author

pnorman commented Nov 11, 2014

#202 might be good to resolve first

@joto
Copy link
Collaborator

joto commented Jan 25, 2023

Just a note on this: With modern PostgreSQL versions it is possible to monitor index creation progress through the pg_stat_progress_create_index system table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants