Skip to content

Instantly share code, notes, and snippets.

@olt
Last active December 18, 2015 01:39
Show Gist options
  • Save olt/5705180 to your computer and use it in GitHub Desktop.
Save olt/5705180 to your computer and use it in GitHub Desktop.
Imposm3 import with generalized tables of germany-20130529.osm.pbf on a Intel i7-2600, 32GB RAM, 7.2k SATA RAID1
$ imposm3 version
0.1dev-20130906-a48cd03
$ IMPOSM_READ_PROCS=6:2:2:2:2 imposm3 import -connection=postgis://localhost/osm_germany -mapping mapping.json -overwritecache -write -read germany-20130529.osm.pbf
[Sep 16 10:42:19] removing existing cache /tmp/imposm3
[Sep 16 10:42:20] [reader] reading /opt/osm_data/pbf/germany-20130529.osm.pbf with data till 2013-05-28 20:59:04 +0200 CEST
[Sep 16 10:43:20] [ 1m0s] C: 3305000/s (135381109) N: 51400/s (2107184) W: 339700/s (6458891) R: 0/s (0)
[Sep 16 10:43:59] [ 1m39s] C: 3305000/s (135381109) N: 51400/s (2107184) W: 353300/s (20502138) R: 211660/s (112256)
[Sep 16 10:43:59] Reading OSM data took: 1m39.870029303s
[Sep 16 10:44:59] [ 1m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 26200/s ( 1.7%) R: 2960/s (100.0%)
[Sep 16 10:45:59] [ 2m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 28600/s (10.4%) R: 2960/s (100.0%)
[Sep 16 10:46:59] [ 3m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 30500/s (20.0%) R: 2960/s (100.0%)
[Sep 16 10:47:59] [ 4m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 32700/s (30.9%) R: 2960/s (100.0%)
[Sep 16 10:48:59] [ 5m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 34300/s (42.5%) R: 2960/s (100.0%)
[Sep 16 10:49:59] [ 6m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 35600/s (54.7%) R: 2960/s (100.0%)
[Sep 16 10:50:59] [ 7m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 36700/s (66.9%) R: 2960/s (100.0%)
[Sep 16 10:51:59] [ 8m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 37500/s (79.4%) R: 2960/s (100.0%)
[Sep 16 10:52:59] [ 9m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 38500/s (92.9%) R: 2960/s (100.0%)
[Sep 16 10:53:59] [ 10m0s] C: 0/s ( 0.0%) N: 78600/s (100.0%) W: 38800/s (100.0%) R: 2960/s (100.0%)
[Sep 16 10:54:02] Writing OSM data took: 10m2.495312082s
[Sep 16 10:54:02] [ 10m2s] C: 0/s ( 0.0%) N: 78600/s (100.0%) W: 38800/s (100.0%) R: 2960/s (100.0%)
[Sep 16 10:54:06] [PostGIS] Generalizing osm_waterareas into osm_osm_waterareas_gen1 took: 3.956445576s
[Sep 16 10:54:10] [PostGIS] Generalizing osm_waterways into osm_osm_waterways_gen1 took: 8.477395963s
[Sep 16 10:54:18] [PostGIS] Generalizing osm_roads into osm_osm_roads_gen1 took: 16.318057405s
[Sep 16 10:55:16] [PostGIS] Generalizing osm_landusages into osm_osm_landusages_gen1 took: 1m13.989545325s
[Sep 16 10:55:16] [PostGIS] Generalizing osm_waterareas_gen1 into osm_osm_waterareas_gen0 took: 601.679891ms
[Sep 16 10:55:18] [PostGIS] Generalizing osm_waterways_gen1 into osm_osm_waterways_gen0 took: 2.644157471s
[Sep 16 10:55:21] [PostGIS] Generalizing osm_roads_gen1 into osm_osm_roads_gen0 took: 5.01863415s
[Sep 16 10:55:31] [PostGIS] Generalizing osm_landusages_gen1 into osm_osm_landusages_gen0 took: 15.287515323s
[Sep 16 10:55:31] [PostGIS] Creating generalized tables took: 1m29.27744169s
[Sep 16 10:55:31] [PostGIS] Creating OSM id index on osm_transport_areas took: 10.763014ms
[Sep 16 10:55:31] [PostGIS] Creating OSM id index on osm_amenities took: 32.834623ms
[Sep 16 10:55:31] [PostGIS] Creating geometry index on osm_transport_areas took: 33.115768ms
[Sep 16 10:55:31] [PostGIS] Creating OSM id index on osm_waterareas took: 115.824616ms
[Sep 16 10:55:31] [PostGIS] Creating OSM id index on osm_transport_points took: 160.071861ms
[Sep 16 10:55:31] [PostGIS] Creating geometry index on osm_amenities took: 284.756658ms
[Sep 16 10:55:32] [PostGIS] Creating OSM id index on osm_landusages took: 1.103000732s
[Sep 16 10:55:32] [PostGIS] Creating OSM id index on osm_barrierways took: 1.140203211s
[Sep 16 10:55:33] [PostGIS] Creating geometry index on osm_waterareas took: 1.506733349s
[Sep 16 10:55:33] [PostGIS] Creating OSM id index on osm_housenumbers_interpolated took: 16.318134ms
[Sep 16 10:55:33] [PostGIS] Creating geometry index on osm_housenumbers_interpolated took: 239.195385ms
[Sep 16 10:55:34] [PostGIS] Creating geometry index on osm_barrierways took: 1.554657117s
[Sep 16 10:55:36] [PostGIS] Creating OSM id index on osm_housenumbers took: 1.640226444s
[Sep 16 10:55:36] [PostGIS] Creating geometry index on osm_transport_points took: 4.69881999s
[Sep 16 10:55:38] [PostGIS] Creating OSM id index on osm_admin took: 1.912022753s
[Sep 16 10:55:38] [PostGIS] Creating geometry index on osm_admin took: 202.881264ms
[Sep 16 10:55:40] [PostGIS] Creating OSM id index on osm_buildings took: 7.685652568s
[Sep 16 10:55:41] [PostGIS] Creating OSM id index on osm_barrierpoints took: 2.647583842s
[Sep 16 10:55:42] [PostGIS] Creating geometry index on osm_barrierpoints took: 1.965037953s
[Sep 16 10:55:47] [PostGIS] Creating OSM id index on osm_roads took: 4.5771562s
[Sep 16 10:55:54] [PostGIS] Creating geometry index on osm_housenumbers took: 18.511009568s
[Sep 16 10:55:54] [PostGIS] Creating OSM id index on osm_waterways took: 156.416269ms
[Sep 16 10:55:57] [PostGIS] Creating geometry index on osm_waterways took: 2.492108131s
[Sep 16 10:55:57] [PostGIS] Creating OSM id index on osm_aeroways took: 3.483888ms
[Sep 16 10:55:57] [PostGIS] Creating geometry index on osm_aeroways took: 15.2319ms
[Sep 16 10:55:57] [PostGIS] Creating OSM id index on osm_places took: 70.497421ms
[Sep 16 10:55:58] [PostGIS] Creating geometry index on osm_places took: 722.709126ms
[Sep 16 10:55:58] [PostGIS] Creating OSM id index on osm_waterareas_gen1 took: 8.123413ms
[Sep 16 10:55:58] [PostGIS] Creating geometry index on osm_waterareas_gen1 took: 65.873875ms
[Sep 16 10:55:58] [PostGIS] Creating OSM id index on osm_waterareas_gen0 took: 1.94815ms
[Sep 16 10:55:58] [PostGIS] Creating geometry index on osm_waterareas_gen0 took: 7.244658ms
[Sep 16 10:55:58] [PostGIS] Creating OSM id index on osm_roads_gen0 took: 410.041565ms
[Sep 16 10:56:00] [PostGIS] Creating geometry index on osm_landusages took: 28.40191169s
[Sep 16 10:56:01] [PostGIS] Creating OSM id index on osm_roads_gen1 took: 382.292014ms
[Sep 16 10:56:09] [PostGIS] Creating geometry index on osm_roads_gen0 took: 10.701053835s
[Sep 16 10:56:09] [PostGIS] Creating OSM id index on osm_waterways_gen0 took: 136.768976ms
[Sep 16 10:56:12] [PostGIS] Creating geometry index on osm_roads_gen1 took: 10.768472457s
[Sep 16 10:56:12] [PostGIS] Creating OSM id index on osm_waterways_gen1 took: 133.909693ms
[Sep 16 10:56:12] [PostGIS] Creating geometry index on osm_waterways_gen0 took: 3.344301418s
[Sep 16 10:56:12] [PostGIS] Creating OSM id index on osm_landusages_gen1 took: 303.990687ms
[Sep 16 10:56:14] [PostGIS] Creating geometry index on osm_waterways_gen1 took: 2.484302995s
[Sep 16 10:56:14] [PostGIS] Creating OSM id index on osm_landusages_gen0 took: 78.874072ms
[Sep 16 10:56:17] [PostGIS] Creating geometry index on osm_landusages_gen0 took: 2.35673453s
[Sep 16 10:56:18] [PostGIS] Creating geometry index on osm_landusages_gen1 took: 5.073778173s
[Sep 16 10:57:07] [PostGIS] Creating geometry index on osm_roads took: 1m19.613587592s
[Sep 16 10:58:18] [PostGIS] Creating geometry index on osm_buildings took: 2m37.788128526s
[Sep 16 10:58:18] [PostGIS] Creating geometry indices took: 2m47.352271681s
[Sep 16 10:58:18] Importing OSM data took: 14m19.125211368s
[Sep 16 10:58:18] Imposm took: 15m58.995382253s
@olt
Copy link
Author

olt commented Sep 16, 2013

See https://gist.github.com/olt/6578538 for numbers with -diff enabled.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment