Skip to content

Instantly share code, notes, and snippets.

@olt
Created September 16, 2013 09:37
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save olt/6578538 to your computer and use it in GitHub Desktop.
Save olt/6578538 to your computer and use it in GitHub Desktop.
Imposm3 diff-enabled import with generalized tables of germany-20130529.osm.pbf (1.7GB) on a Intel i7-2600, 32GB RAM, 7.2k SATA RAID1
$ imposm3 version
0.1dev-20130906-a48cd03
$ IMPOSM_READ_PROCS=6:2:2:2:2 time imposm3 import -connection=postgis://localhost/osm_germany -mapping mapping.json -overwritecache -write -read /opt/osm_data/pbf/germany-20130529.osm.pbf --diff
[Sep 16 11:04:18] removing existing cache /tmp/imposm3
[Sep 16 11:04:19] [reader] reading /opt/osm_data/pbf/germany-20130529.osm.pbf with data till 2013-05-28 20:59:04 +0200 CEST
[Sep 16 11:05:19] [ 1m0s] C: 3225000/s (135381109) N: 50100/s (2107184) W: 337400/s (6162891) R: 0/s (0)
[Sep 16 11:05:59] [ 1m39s] C: 3225000/s (135381109) N: 50100/s (2107184) W: 354900/s (20502138) R: 304590/s (112256)
[Sep 16 11:05:59] Reading OSM data took: 1m40.652336077s
[Sep 16 11:06:59] [ 1m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 20400/s ( 0.8%) R: 2550/s (100.0%)
[Sep 16 11:07:59] [ 2m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 21100/s ( 7.0%) R: 2550/s (100.0%)
[Sep 16 11:08:59] [ 3m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 22100/s (13.8%) R: 2550/s (100.0%)
[Sep 16 11:09:59] [ 4m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 22600/s (20.7%) R: 2550/s (100.0%)
[Sep 16 11:10:59] [ 5m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 23500/s (28.4%) R: 2550/s (100.0%)
[Sep 16 11:11:59] [ 6m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 24200/s (36.4%) R: 2550/s (100.0%)
[Sep 16 11:12:59] [ 7m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 25000/s (45.0%) R: 2550/s (100.0%)
[Sep 16 11:13:59] [ 8m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 25800/s (54.0%) R: 2550/s (100.0%)
[Sep 16 11:14:59] [ 9m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 26200/s (62.4%) R: 2550/s (100.0%)
[Sep 16 11:15:59] [ 10m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 26500/s (70.8%) R: 2550/s (100.0%)
[Sep 16 11:16:59] [ 11m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 26900/s (79.9%) R: 2550/s (100.0%)
[Sep 16 11:17:59] [ 12m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 27400/s (89.4%) R: 2550/s (100.0%)
[Sep 16 11:18:59] [ 13m0s] C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 27800/s (99.0%) R: 2550/s (100.0%)
[Sep 16 11:19:39] [13m40s] C: 0/s ( 0.0%) N: 65700/s (100.0%) W: 27900/s (100.0%) R: 2550/s (100.0%)
[Sep 16 11:19:40] Writing OSM data took: 13m40.956878351s
[Sep 16 11:19:44] [PostGIS] Generalizing osm_waterareas into osm_osm_waterareas_gen1 took: 3.901403167s
[Sep 16 11:19:48] [PostGIS] Generalizing osm_waterways into osm_osm_waterways_gen1 took: 8.519526606s
[Sep 16 11:19:56] [PostGIS] Generalizing osm_roads into osm_osm_roads_gen1 took: 16.379079142s
[Sep 16 11:20:54] [PostGIS] Generalizing osm_landusages into osm_osm_landusages_gen1 took: 1m13.93084298s
[Sep 16 11:20:54] [PostGIS] Generalizing osm_waterareas_gen1 into osm_osm_waterareas_gen0 took: 598.141053ms
[Sep 16 11:20:56] [PostGIS] Generalizing osm_waterways_gen1 into osm_osm_waterways_gen0 took: 2.589288236s
[Sep 16 11:20:59] [PostGIS] Generalizing osm_roads_gen1 into osm_osm_roads_gen0 took: 5.178580913s
[Sep 16 11:21:09] [PostGIS] Generalizing osm_landusages_gen1 into osm_osm_landusages_gen0 took: 15.392540552s
[Sep 16 11:21:09] [PostGIS] Creating generalized tables took: 1m29.32373937s
[Sep 16 11:21:09] [PostGIS] Creating OSM id index on osm_amenities took: 18.835485ms
[Sep 16 11:21:09] [PostGIS] Creating OSM id index on osm_housenumbers_interpolated took: 31.627988ms
[Sep 16 11:21:09] [PostGIS] Creating OSM id index on osm_barrierways took: 120.623114ms
[Sep 16 11:21:09] [PostGIS] Creating geometry index on osm_housenumbers_interpolated took: 246.977978ms
[Sep 16 11:21:09] [PostGIS] Creating geometry index on osm_amenities took: 259.862668ms
[Sep 16 11:21:09] [PostGIS] Creating OSM id index on osm_places took: 42.941868ms
[Sep 16 11:21:09] [PostGIS] Creating OSM id index on osm_waterareas took: 129.903827ms
[Sep 16 11:21:10] [PostGIS] Creating geometry index on osm_places took: 693.429901ms
[Sep 16 11:21:10] [PostGIS] Creating OSM id index on osm_barrierpoints took: 115.852844ms
[Sep 16 11:21:11] [PostGIS] Creating geometry index on osm_barrierways took: 1.425180104s
[Sep 16 11:21:11] [PostGIS] Creating geometry index on osm_waterareas took: 1.94117945s
[Sep 16 11:21:12] [PostGIS] Creating geometry index on osm_barrierpoints took: 1.823043554s
[Sep 16 11:21:12] [PostGIS] Creating OSM id index on osm_aeroways took: 202.928482ms
[Sep 16 11:21:12] [PostGIS] Creating geometry index on osm_aeroways took: 19.586979ms
[Sep 16 11:21:12] [PostGIS] Creating OSM id index on osm_admin took: 31.096813ms
[Sep 16 11:21:12] [PostGIS] Creating OSM id index on osm_housenumbers took: 1.688658635s
[Sep 16 11:21:12] [PostGIS] Creating geometry index on osm_admin took: 139.159974ms
[Sep 16 11:21:12] [PostGIS] Creating OSM id index on osm_transport_areas took: 4.24635ms
[Sep 16 11:21:12] [PostGIS] Creating geometry index on osm_transport_areas took: 16.915496ms
[Sep 16 11:21:13] [PostGIS] Creating OSM id index on osm_landusages took: 1.127096641s
[Sep 16 11:21:13] [PostGIS] Creating OSM id index on osm_roads took: 4.201974452s
[Sep 16 11:21:18] [PostGIS] Creating OSM id index on osm_buildings took: 6.015571622s
[Sep 16 11:21:37] [PostGIS] Creating geometry index on osm_housenumbers took: 24.543764879s
[Sep 16 11:21:37] [PostGIS] Creating OSM id index on osm_waterways took: 134.148988ms
[Sep 16 11:21:39] [PostGIS] Creating geometry index on osm_landusages took: 26.505016104s
[Sep 16 11:21:39] [PostGIS] Creating OSM id index on osm_transport_points took: 202.593241ms
[Sep 16 11:21:39] [PostGIS] Creating geometry index on osm_waterways took: 2.385757646s
[Sep 16 11:21:39] [PostGIS] Creating OSM id index on osm_waterareas_gen1 took: 7.568353ms
[Sep 16 11:21:39] [PostGIS] Creating geometry index on osm_waterareas_gen1 took: 59.308725ms
[Sep 16 11:21:39] [PostGIS] Creating OSM id index on osm_waterareas_gen0 took: 1.819993ms
[Sep 16 11:21:39] [PostGIS] Creating geometry index on osm_waterareas_gen0 took: 6.515921ms
[Sep 16 11:21:41] [PostGIS] Creating OSM id index on osm_roads_gen0 took: 1.411209044s
[Sep 16 11:21:42] [PostGIS] Creating geometry index on osm_transport_points took: 3.107902635s
[Sep 16 11:21:43] [PostGIS] Creating OSM id index on osm_roads_gen1 took: 375.260632ms
[Sep 16 11:21:49] [PostGIS] Creating geometry index on osm_roads_gen0 took: 8.000828567s
[Sep 16 11:21:50] [PostGIS] Creating OSM id index on osm_waterways_gen0 took: 1.223528156s
[Sep 16 11:21:50] [PostGIS] Creating geometry index on osm_roads_gen1 took: 7.701476249s
[Sep 16 11:21:51] [PostGIS] Creating OSM id index on osm_waterways_gen1 took: 128.235631ms
[Sep 16 11:21:53] [PostGIS] Creating geometry index on osm_waterways_gen0 took: 2.587130373s
[Sep 16 11:21:53] [PostGIS] Creating geometry index on osm_waterways_gen1 took: 2.553897239s
[Sep 16 11:21:53] [PostGIS] Creating OSM id index on osm_landusages_gen1 took: 617.973521ms
[Sep 16 11:21:54] [PostGIS] Creating OSM id index on osm_landusages_gen0 took: 1.072847511s
[Sep 16 11:21:55] [PostGIS] Creating geometry index on osm_landusages_gen0 took: 958.569273ms
[Sep 16 11:21:58] [PostGIS] Creating geometry index on osm_landusages_gen1 took: 4.575209134s
[Sep 16 11:22:43] [PostGIS] Creating geometry index on osm_roads took: 1m29.29496964s
[Sep 16 11:23:48] [PostGIS] Creating geometry index on osm_buildings took: 2m29.31365811s
[Sep 16 11:23:48] [PostGIS] Creating geometry indices took: 2m38.697714058s
[Sep 16 11:23:48] Importing OSM data took: 17m48.978499842s
[Sep 16 11:23:48] Imposm took: 19m29.630988005s
4992.97user 213.59system 19:30.09elapsed 444%CPU (0avgtext+0avgdata 12781824maxresident)k
216inputs+29547384outputs (16682major+51811725minor)pagefaults 0swaps
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment