Skip to content

Instantly share code, notes, and snippets.

@JochenFromm
Created November 20, 2023 11:48
Show Gist options
  • Save JochenFromm/3a1ccb57279a2deaf8b312937735a44e to your computer and use it in GitHub Desktop.
Save JochenFromm/3a1ccb57279a2deaf8b312937735a44e to your computer and use it in GitHub Desktop.
$ arch
arm64
$ docker run -it \
-e PBF_URL=http://download.geofabrik.de/asia/maldives-latest.osm.pbf \
-p 9000:8080 \
--name nominatim \
mediagis/nominatim:4.3
Unable to find image 'mediagis/nominatim:4.3' locally
4.3: Pulling from mediagis/nominatim
a451ba22fc45: Pull complete
4f4fb700ef54: Pull complete
00d168560872: Pull complete
Digest: sha256:f0d4e1791ea545edc9c069551005cdd2d45f78deb18ddb1611cb64aeafb92eaa
Status: Downloaded newer image for mediagis/nominatim:4.3
+ tailpid=0
+ replicationpid=0
+ trap stopServices SIGTERM TERM INT
+ /app/config.sh
+ id nominatim
+ useradd -m -p qaIACxO6wMR3 nominatim
+ IMPORT_FINISHED=/var/lib/postgresql/14/main/import-finished
+ '[' '!' -f /var/lib/postgresql/14/main/import-finished ']'
+ /app/init.sh
+ OSMFILE=/nominatim/data.osm.pbf
+ CURL=("curl" "-L" "-A" "${USER_AGENT}" "--fail-with-body")
+ SCP='sshpass -p ... scp -o StrictHostKeyChecking=no ...@u355874-sub1.your-storagebox.de'
+ '[' -z '' ']'
++ nproc
+ THREADS=5
+ '[' '' = true ']'
+ '[' -f '' ']'
+ echo 'Skipping optional Wikipedia importance import'
Skipping optional Wikipedia importance import
+ '[' '' = true ']'
+ '[' -f '' ']'
+ echo 'Skipping optional GB postcode import'
Skipping optional GB postcode import
+ '[' '' = true ']'
+ '[' -f '' ']'
+ echo 'Skipping optional US postcode import'
Skipping optional US postcode import
+ '[' '' = true ']'
+ '[' -f '' ']'
+ echo 'Skipping optional Tiger addresses import'
Skipping optional Tiger addresses import
+ '[' http://download.geofabrik.de/asia/maldives-latest.osm.pbf '!=' '' ']'
+ echo Downloading OSM extract from http://download.geofabrik.de/asia/maldives-latest.osm.pbf
Downloading OSM extract from http://download.geofabrik.de/asia/maldives-latest.osm.pbf
+ curl -L -A mediagis/nominatim-docker:4.3.2 --fail-with-body http://download.geofabrik.de/asia/maldives-latest.osm.pbf -C - --create-dirs -o /nominatim/data.osm.pbf
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2946k 100 2946k 0 0 3493k 0 --:--:-- --:--:-- --:--:-- 3516k
+ '[' '' '!=' '' ']'
+ '[' '!' -f /var/lib/postgresql/14/main/PG_VERSION ']'
+ cp /etc/postgresql/14/main/conf.d/postgres-import.conf.disabled /etc/postgresql/14/main/conf.d/postgres-import.conf
+ sudo service postgresql start
* Starting PostgreSQL 14 database server [ OK ]
+ sudo -E -u postgres psql postgres -tAc 'SELECT 1 FROM pg_roles WHERE rolname='\''nominatim'\'''
+ grep -q 1
+ sudo -E -u postgres createuser -s nominatim
+ grep -q 1
+ sudo -E -u postgres psql postgres -tAc 'SELECT 1 FROM pg_roles WHERE rolname='\''www-data'\'''
+ sudo -E -u postgres createuser -SDR www-data
+ sudo -E -u postgres psql postgres -tAc 'ALTER USER nominatim WITH ENCRYPTED PASSWORD '\''qaIACxO6wMR3'\'''
ALTER ROLE
+ sudo -E -u postgres psql postgres -tAc 'ALTER USER "www-data" WITH ENCRYPTED PASSWORD '\''qaIACxO6wMR3'\'''
ALTER ROLE
+ sudo -E -u postgres psql postgres -c 'DROP DATABASE IF EXISTS nominatim'
NOTICE: database "nominatim" does not exist, skipping
DROP DATABASE
+ chown -R nominatim:nominatim /nominatim
+ cd /nominatim
+ '[' '' = true ']'
+ sudo -E -u nominatim nominatim import --osm-file /nominatim/data.osm.pbf --threads 5
2023-11-20 11:31:41: Using project directory: /nominatim
2023-11-20 11:31:52: Creating database
2023-11-20 11:31:56: Setting up country tables
2023-11-20 11:32:03: Importing OSM data file
2023-11-20 11:32:03 osm2pgsql version 1.9.2
2023-11-20 11:32:03 Database version: 14.9 (Ubuntu 14.9-0ubuntu0.22.04.1)
2023-11-20 11:32:03 PostGIS version: 3.2
2023-11-20 11:32:03 Storing properties to table '"public"."osm2pgsql_properties"'.
2023-11-20 11:32:24 Reading input files done in 20s.
2023-11-20 11:32:24 Processed 396544 nodes in 5s - 79k/s
2023-11-20 11:32:24 Processed 57219 ways in 13s - 4k/s
2023-11-20 11:32:24 Processed 1135 relations in 2s - 568/s
2023-11-20 11:32:24 No marked ways (Skipping stage 2).
2023-11-20 11:32:24 Clustering table 'place' by geometry...
2023-11-20 11:32:24 No indexes to create on table 'place'.
2023-11-20 11:32:24 Creating id index on table 'place'...
2023-11-20 11:32:25 Analyzing table 'place'...
2023-11-20 11:32:26 Done postprocessing on table 'planet_osm_nodes' in 0s
2023-11-20 11:32:26 Building index on table 'planet_osm_ways'
2023-11-20 11:32:29 Done postprocessing on table 'planet_osm_ways' in 3s
2023-11-20 11:32:29 Building index on table 'planet_osm_rels'
2023-11-20 11:32:30 Done postprocessing on table 'planet_osm_rels' in 0s
2023-11-20 11:32:30 All postprocessing on table 'place' done in 1s.
2023-11-20 11:32:30 Storing properties to table '"public"."osm2pgsql_properties"'.
2023-11-20 11:32:30 osm2pgsql took 26s overall.
2023-11-20 11:32:30: Importing wikipedia importance data
2023-11-20 11:32:30: Wikipedia importance dump file not found. Calculating importance values of locations will not use Wikipedia importance data.
2023-11-20 11:32:30: Importing secondary importance raster data
2023-11-20 11:32:30: Secondary importance file not imported. Falling back to default ranking.
2023-11-20 11:32:30: Create functions (1st pass)
2023-11-20 11:32:31: Create tables
2023-11-20 11:32:32: Create functions (2nd pass)
2023-11-20 11:32:33: Create table triggers
2023-11-20 11:32:33: Create partition tables
2023-11-20 11:32:37: Create functions (3rd pass)
2023-11-20 11:32:38: Initialise tables
2023-11-20 11:32:40: Load data into placex table
..............
2023-11-20 11:32:59: Setting up tokenizer
2023-11-20 11:33:03: Calculate postcodes
2023-11-20 11:33:03: Indexing places
2023-11-20 11:33:03: Starting indexing rank (0 to 4) using 5 threads
2023-11-20 11:33:04: Starting rank 1 (using batch size 1)
2023-11-20 11:33:04: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 1
2023-11-20 11:33:04: Starting rank 2 (using batch size 1)
2023-11-20 11:33:04: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 2
2023-11-20 11:33:04: Starting rank 3 (using batch size 1)
2023-11-20 11:33:04: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 3
2023-11-20 11:33:04: Starting rank 4 (using batch size 1)
2023-11-20 11:33:06: Done 1/1 in 1 @ 0.611 per second - FINISHED rank 4
2023-11-20 11:33:14: Starting indexing boundaries using 5 threads
2023-11-20 11:33:15: Starting boundaries rank 4 (using batch size 1)
2023-11-20 11:33:15: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 4
2023-11-20 11:33:15: Starting boundaries rank 5 (using batch size 1)
2023-11-20 11:33:15: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 5
2023-11-20 11:33:15: Starting boundaries rank 6 (using batch size 1)
2023-11-20 11:33:15: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 6
2023-11-20 11:33:15: Starting boundaries rank 7 (using batch size 1)
2023-11-20 11:33:15: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 7
2023-11-20 11:33:15: Starting boundaries rank 8 (using batch size 1)
2023-11-20 11:33:17: Done 21/21 in 1 @ 10.660 per second - FINISHED boundaries rank 8
2023-11-20 11:33:17: Starting boundaries rank 9 (using batch size 1)
2023-11-20 11:33:17: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 9
2023-11-20 11:33:17: Starting boundaries rank 10 (using batch size 1)
2023-11-20 11:33:17: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 10
2023-11-20 11:33:17: Starting boundaries rank 11 (using batch size 1)
2023-11-20 11:33:17: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 11
2023-11-20 11:33:17: Starting boundaries rank 12 (using batch size 1)
2023-11-20 11:33:18: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 12
2023-11-20 11:33:18: Starting boundaries rank 13 (using batch size 1)
2023-11-20 11:33:18: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 13
2023-11-20 11:33:18: Starting boundaries rank 14 (using batch size 1)
2023-11-20 11:33:18: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 14
2023-11-20 11:33:18: Starting boundaries rank 15 (using batch size 1)
2023-11-20 11:33:18: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 15
2023-11-20 11:33:18: Starting boundaries rank 16 (using batch size 1)
2023-11-20 11:33:19: Done 5/5 in 1 @ 3.645 per second - FINISHED boundaries rank 16
2023-11-20 11:33:19: Starting boundaries rank 17 (using batch size 1)
2023-11-20 11:33:20: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 17
2023-11-20 11:33:20: Starting boundaries rank 18 (using batch size 1)
2023-11-20 11:33:21: Done 6/6 in 1 @ 3.645 per second - FINISHED boundaries rank 18
2023-11-20 11:33:21: Starting boundaries rank 19 (using batch size 1)
2023-11-20 11:33:21: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 19
2023-11-20 11:33:21: Starting boundaries rank 20 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 20
2023-11-20 11:33:22: Starting boundaries rank 21 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 21
2023-11-20 11:33:22: Starting boundaries rank 22 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 22
2023-11-20 11:33:22: Starting boundaries rank 23 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 23
2023-11-20 11:33:22: Starting boundaries rank 24 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 24
2023-11-20 11:33:22: Starting boundaries rank 25 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 25
2023-11-20 11:33:22: Starting indexing rank (5 to 25) using 5 threads
2023-11-20 11:33:22: Starting rank 5 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 5
2023-11-20 11:33:22: Starting rank 6 (using batch size 1)
2023-11-20 11:33:22: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 6
2023-11-20 11:33:22: Starting rank 7 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 7
2023-11-20 11:33:23: Starting rank 8 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 8
2023-11-20 11:33:23: Starting rank 9 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 9
2023-11-20 11:33:23: Starting rank 10 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 10
2023-11-20 11:33:23: Starting rank 11 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 11
2023-11-20 11:33:23: Starting rank 12 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 12
2023-11-20 11:33:23: Starting rank 13 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 13
2023-11-20 11:33:23: Starting rank 14 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 14
2023-11-20 11:33:23: Starting rank 15 (using batch size 1)
2023-11-20 11:33:23: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 15
2023-11-20 11:33:23: Starting rank 16 (using batch size 1)
2023-11-20 11:33:25: Done 32/32 in 1 @ 16.555 per second - FINISHED rank 16
2023-11-20 11:33:25: Starting rank 17 (using batch size 1)
2023-11-20 11:33:26: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 17
2023-11-20 11:33:26: Starting rank 18 (using batch size 1)
2023-11-20 11:33:26: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 18
2023-11-20 11:33:26: Starting rank 19 (using batch size 1)
2023-11-20 11:33:26: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 19
2023-11-20 11:33:26: Starting rank 20 (using batch size 1)
2023-11-20 11:33:27: Done 1/1 in 1 @ 0.796 per second - FINISHED rank 20
2023-11-20 11:33:27: Starting rank 21 (using batch size 1)
2023-11-20 11:33:27: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 21
2023-11-20 11:33:27: Starting rank 22 (using batch size 1)
2023-11-20 11:33:29: Done 80 in 2 @ 39.452 per second - rank 22 ETA (seconds): 1.32
2023-11-20 11:33:30: Done 119 in 2 @ 50.998 per second - rank 22 ETA (seconds): 0.25
2023-11-20 11:33:30: Done 132/132 in 2 @ 54.672 per second - FINISHED rank 22
2023-11-20 11:33:30: Starting rank 23 (using batch size 1)
2023-11-20 11:33:30: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 23
2023-11-20 11:33:30: Starting rank 24 (using batch size 1)
2023-11-20 11:33:30: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 24
2023-11-20 11:33:30: Starting rank 25 (using batch size 1)
2023-11-20 11:33:32: Done 16/16 in 1 @ 9.432 per second - FINISHED rank 25
2023-11-20 11:33:41: Starting indexing rank (26 to 30) using 5 threads
2023-11-20 11:33:41: Starting rank 26 (using batch size 1)
2023-11-20 11:33:43: Done 200 in 2 @ 98.320 per second - rank 26 ETA (seconds): 75.76
2023-11-20 11:33:43: Done 298 in 2 @ 115.097 per second - rank 26 ETA (seconds): 63.87
2023-11-20 11:33:44: Done 413 in 3 @ 133.266 per second - rank 26 ETA (seconds): 54.30
2023-11-20 11:33:44: Done 546 in 3 @ 148.060 per second - rank 26 ETA (seconds): 47.97
2023-11-20 11:33:45: Done 694 in 4 @ 157.298 per second - rank 26 ETA (seconds): 44.22
2023-11-20 11:33:46: Done 851 in 5 @ 165.920 per second - rank 26 ETA (seconds): 40.97
2023-11-20 11:33:46: Done 1016 in 5 @ 183.505 per second - rank 26 ETA (seconds): 36.15
2023-11-20 11:33:47: Done 1199 in 5 @ 200.495 per second - rank 26 ETA (seconds): 32.17
2023-11-20 11:33:47: Done 1399 in 6 @ 216.973 per second - rank 26 ETA (seconds): 28.81
2023-11-20 11:33:48: Done 1615 in 6 @ 231.549 per second - rank 26 ETA (seconds): 26.06
2023-11-20 11:33:48: Done 1846 in 7 @ 243.546 per second - rank 26 ETA (seconds): 23.83
2023-11-20 11:33:49: Done 2089 in 8 @ 254.305 per second - rank 26 ETA (seconds): 21.86
2023-11-20 11:33:50: Done 2343 in 8 @ 266.346 per second - rank 26 ETA (seconds): 19.92
2023-11-20 11:33:50: Done 2609 in 9 @ 277.592 per second - rank 26 ETA (seconds): 18.16
2023-11-20 11:33:51: Done 2886 in 10 @ 288.289 per second - rank 26 ETA (seconds): 16.52
2023-11-20 11:33:51: Done 3174 in 10 @ 297.516 per second - rank 26 ETA (seconds): 15.04
2023-11-20 11:33:52: Done 3471 in 11 @ 304.985 per second - rank 26 ETA (seconds): 13.70
2023-11-20 11:33:53: Done 3775 in 12 @ 313.055 per second - rank 26 ETA (seconds): 12.37
2023-11-20 11:33:54: Done 4088 in 12 @ 320.216 per second - rank 26 ETA (seconds): 11.12
2023-11-20 11:33:54: Done 4408 in 13 @ 326.383 per second - rank 26 ETA (seconds): 9.93
2023-11-20 11:33:55: Done 4734 in 14 @ 329.166 per second - rank 26 ETA (seconds): 8.86
2023-11-20 11:33:56: Done 5063 in 15 @ 330.952 per second - rank 26 ETA (seconds): 7.81
2023-11-20 11:33:57: Done 5393 in 16 @ 335.400 per second - rank 26 ETA (seconds): 6.73
2023-11-20 11:33:58: Done 5728 in 16 @ 338.624 per second - rank 26 ETA (seconds): 5.67
2023-11-20 11:33:59: Done 6066 in 17 @ 341.426 per second - rank 26 ETA (seconds): 4.64
2023-11-20 11:33:59: Done 6407 in 18 @ 343.326 per second - rank 26 ETA (seconds): 3.62
2023-11-20 11:34:00: Done 6750 in 19 @ 345.138 per second - rank 26 ETA (seconds): 2.60
2023-11-20 11:34:01: Done 7095 in 20 @ 347.241 per second - rank 26 ETA (seconds): 1.60
2023-11-20 11:34:02: Done 7442 in 21 @ 346.975 per second - rank 26 ETA (seconds): 0.60
2023-11-20 11:34:03: Done 7649/7649 in 22 @ 346.089 per second - FINISHED rank 26
2023-11-20 11:34:03: Starting rank 27 (using batch size 1)
2023-11-20 11:34:05: Done 110 in 2 @ 53.430 per second - rank 27 ETA (seconds): 0.95
2023-11-20 11:34:05: Done 161/161 in 2 @ 71.824 per second - FINISHED rank 27
2023-11-20 11:34:05: Starting rank 28 (using batch size 1)
2023-11-20 11:34:05: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 28
2023-11-20 11:34:05: Starting rank 29 (using batch size 1)
2023-11-20 11:34:06: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 29
2023-11-20 11:34:06: Starting rank 30 (using batch size 20)
2023-11-20 11:34:08: Done 140 in 2 @ 69.555 per second - rank 30 ETA (seconds): 210.84
2023-11-20 11:34:08: Done 200 in 2 @ 95.329 per second - rank 30 ETA (seconds): 153.21
2023-11-20 11:34:08: Done 300 in 2 @ 130.298 per second - rank 30 ETA (seconds): 111.32
2023-11-20 11:34:08: Done 440 in 2 @ 160.626 per second - rank 30 ETA (seconds): 89.43
2023-11-20 11:34:09: Done 600 in 3 @ 192.179 per second - rank 30 ETA (seconds): 73.92
2023-11-20 11:34:09: Done 780 in 3 @ 224.522 per second - rank 30 ETA (seconds): 62.47
2023-11-20 11:34:10: Done 1000 in 3 @ 255.650 per second - rank 30 ETA (seconds): 54.00
2023-11-20 11:34:10: Done 1260 in 4 @ 284.155 per second - rank 30 ETA (seconds): 47.67
2023-11-20 11:34:11: Done 1540 in 5 @ 294.213 per second - rank 30 ETA (seconds): 45.09
2023-11-20 11:34:12: Done 1840 in 6 @ 301.821 per second - rank 30 ETA (seconds): 42.96
2023-11-20 11:34:13: Done 2140 in 6 @ 311.790 per second - rank 30 ETA (seconds): 40.62
2023-11-20 11:34:13: Done 2460 in 7 @ 316.572 per second - rank 30 ETA (seconds): 39.00
2023-11-20 11:34:14: Done 2780 in 8 @ 328.016 per second - rank 30 ETA (seconds): 36.66
2023-11-20 11:34:15: Done 3100 in 9 @ 330.466 per second - rank 30 ETA (seconds): 35.42
2023-11-20 11:34:16: Done 3420 in 10 @ 339.097 per second - rank 30 ETA (seconds): 33.57
2023-11-20 11:34:17: Done 3760 in 10 @ 344.054 per second - rank 30 ETA (seconds): 32.10
2023-11-20 11:34:17: Done 4120 in 11 @ 352.263 per second - rank 30 ETA (seconds): 30.33
2023-11-20 11:34:18: Done 4460 in 12 @ 350.417 per second - rank 30 ETA (seconds): 29.52
2023-11-20 11:34:20: Done 4820 in 14 @ 338.327 per second - rank 30 ETA (seconds): 29.51
2023-11-20 11:34:21: Done 5160 in 15 @ 332.123 per second - rank 30 ETA (seconds): 29.04
2023-11-20 11:34:22: Done 5480 in 16 @ 339.311 per second - rank 30 ETA (seconds): 27.48
2023-11-20 11:34:23: Done 5820 in 16 @ 344.896 per second - rank 30 ETA (seconds): 26.05
2023-11-20 11:34:23: Done 6160 in 17 @ 349.700 per second - rank 30 ETA (seconds): 24.72
2023-11-20 11:34:24: Done 6520 in 18 @ 356.594 per second - rank 30 ETA (seconds): 23.23
2023-11-20 11:34:25: Done 6880 in 19 @ 360.452 per second - rank 30 ETA (seconds): 21.99
2023-11-20 11:34:26: Done 7240 in 19 @ 364.702 per second - rank 30 ETA (seconds): 20.74
2023-11-20 11:34:26: Done 7600 in 20 @ 368.833 per second - rank 30 ETA (seconds): 19.53
2023-11-20 11:34:27: Done 7960 in 21 @ 373.825 per second - rank 30 ETA (seconds): 18.31
2023-11-20 11:34:28: Done 8340 in 22 @ 373.055 per second - rank 30 ETA (seconds): 17.33
2023-11-20 11:34:29: Done 8700 in 23 @ 372.854 per second - rank 30 ETA (seconds): 16.37
2023-11-20 11:34:30: Done 9080 in 24 @ 373.875 per second - rank 30 ETA (seconds): 15.31
2023-11-20 11:34:31: Done 9460 in 24 @ 379.657 per second - rank 30 ETA (seconds): 14.08
2023-11-20 11:34:31: Done 9840 in 25 @ 383.112 per second - rank 30 ETA (seconds): 12.96
2023-11-20 11:34:32: Done 10220 in 26 @ 386.129 per second - rank 30 ETA (seconds): 11.87
2023-11-20 11:34:33: Done 10600 in 27 @ 390.501 per second - rank 30 ETA (seconds): 10.77
2023-11-20 11:34:34: Done 11000 in 27 @ 392.938 per second - rank 30 ETA (seconds): 9.68
2023-11-20 11:34:34: Done 11380 in 28 @ 395.208 per second - rank 30 ETA (seconds): 8.67
2023-11-20 11:34:35: Done 11780 in 29 @ 395.855 per second - rank 30 ETA (seconds): 7.64
2023-11-20 11:34:36: Done 12180 in 30 @ 398.095 per second - rank 30 ETA (seconds): 6.59
2023-11-20 11:34:37: Done 12580 in 31 @ 397.164 per second - rank 30 ETA (seconds): 5.60
2023-11-20 11:34:38: Done 12960 in 32 @ 396.907 per second - rank 30 ETA (seconds): 4.65
2023-11-20 11:34:39: Done 13360 in 33 @ 398.202 per second - rank 30 ETA (seconds): 3.63
2023-11-20 11:34:40: Done 13760 in 34 @ 398.486 per second - rank 30 ETA (seconds): 2.62
2023-11-20 11:34:41: Done 14160 in 35 @ 399.393 per second - rank 30 ETA (seconds): 1.61
2023-11-20 11:34:42: Done 14560 in 36 @ 401.607 per second - rank 30 ETA (seconds): 0.61
2023-11-20 11:34:43: Done 14805/14805 in 36 @ 401.097 per second - FINISHED rank 30
2023-11-20 11:34:43: Starting rank 0 (using batch size 1)
2023-11-20 11:34:45: Done 130 in 2 @ 64.806 per second - rank 0 ETA (seconds): 22.16
2023-11-20 11:34:45: Done 194 in 2 @ 81.098 per second - rank 0 ETA (seconds): 16.92
2023-11-20 11:34:45: Done 275 in 2 @ 103.387 per second - rank 0 ETA (seconds): 12.49
2023-11-20 11:34:46: Done 378 in 3 @ 125.788 per second - rank 0 ETA (seconds): 9.44
2023-11-20 11:34:46: Done 503 in 3 @ 145.863 per second - rank 0 ETA (seconds): 7.29
2023-11-20 11:34:47: Done 648 in 3 @ 163.235 per second - rank 0 ETA (seconds): 5.62
2023-11-20 11:34:47: Done 811 in 4 @ 175.958 per second - rank 0 ETA (seconds): 4.29
2023-11-20 11:34:48: Done 986 in 5 @ 186.429 per second - rank 0 ETA (seconds): 3.11
2023-11-20 11:34:49: Done 1172 in 5 @ 196.431 per second - rank 0 ETA (seconds): 2.01
2023-11-20 11:34:50: Done 1368 in 6 @ 199.962 per second - rank 0 ETA (seconds): 0.99
2023-11-20 11:34:50: Done 1566/1566 in 7 @ 208.108 per second - FINISHED rank 0
2023-11-20 11:34:50: Starting interpolation lines (location_property_osmline) (using batch size 20)
2023-11-20 11:34:51: Done 19/19 in 0 @ 21.644 per second - FINISHED interpolation lines (location_property_osmline)
2023-11-20 11:35:01: Starting indexing postcodes using 5 threads
2023-11-20 11:35:01: Starting postcodes (location_postcode) (using batch size 20)
2023-11-20 11:35:02: Done 92/92 in 0 @ 94.657 per second - FINISHED postcodes (location_postcode)
2023-11-20 11:35:02: Post-process tables
2023-11-20 11:35:04: Create search index for default country names.
2023-11-20 11:35:12: Recompute word counts
2023-11-20 11:35:13: Setup website at /nominatim/website
+ '[' -f tiger-nominatim-preprocessed.csv.tar.gz ']'
+ sudo -E -u nominatim nominatim index --threads 5
2023-11-20 11:35:16: Using project directory: /nominatim
2023-11-20 11:35:31: Starting indexing boundaries using 5 threads
2023-11-20 11:35:31: Starting boundaries rank 4 (using batch size 1)
2023-11-20 11:35:31: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 4
2023-11-20 11:35:31: Starting boundaries rank 5 (using batch size 1)
2023-11-20 11:35:31: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 5
2023-11-20 11:35:31: Starting boundaries rank 6 (using batch size 1)
2023-11-20 11:35:31: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 6
2023-11-20 11:35:31: Starting boundaries rank 7 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 7
2023-11-20 11:35:32: Starting boundaries rank 8 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 8
2023-11-20 11:35:32: Starting boundaries rank 9 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 9
2023-11-20 11:35:32: Starting boundaries rank 10 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 10
2023-11-20 11:35:32: Starting boundaries rank 11 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 11
2023-11-20 11:35:32: Starting boundaries rank 12 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 12
2023-11-20 11:35:32: Starting boundaries rank 13 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 13
2023-11-20 11:35:32: Starting boundaries rank 14 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 14
2023-11-20 11:35:32: Starting boundaries rank 15 (using batch size 1)
2023-11-20 11:35:32: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 15
2023-11-20 11:35:32: Starting boundaries rank 16 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 16
2023-11-20 11:35:33: Starting boundaries rank 17 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 17
2023-11-20 11:35:33: Starting boundaries rank 18 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 18
2023-11-20 11:35:33: Starting boundaries rank 19 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 19
2023-11-20 11:35:33: Starting boundaries rank 20 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 20
2023-11-20 11:35:33: Starting boundaries rank 21 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 21
2023-11-20 11:35:33: Starting boundaries rank 22 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 22
2023-11-20 11:35:33: Starting boundaries rank 23 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 23
2023-11-20 11:35:33: Starting boundaries rank 24 (using batch size 1)
2023-11-20 11:35:33: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 24
2023-11-20 11:35:33: Starting boundaries rank 25 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 25
2023-11-20 11:35:34: Starting indexing rank (0 to 30) using 5 threads
2023-11-20 11:35:34: Starting rank 1 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 1
2023-11-20 11:35:34: Starting rank 2 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 2
2023-11-20 11:35:34: Starting rank 3 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 3
2023-11-20 11:35:34: Starting rank 4 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 4
2023-11-20 11:35:34: Starting rank 5 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 5
2023-11-20 11:35:34: Starting rank 6 (using batch size 1)
2023-11-20 11:35:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 6
2023-11-20 11:35:34: Starting rank 7 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 7
2023-11-20 11:35:35: Starting rank 8 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 8
2023-11-20 11:35:35: Starting rank 9 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 9
2023-11-20 11:35:35: Starting rank 10 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 10
2023-11-20 11:35:35: Starting rank 11 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 11
2023-11-20 11:35:35: Starting rank 12 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 12
2023-11-20 11:35:35: Starting rank 13 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 13
2023-11-20 11:35:35: Starting rank 14 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 14
2023-11-20 11:35:35: Starting rank 15 (using batch size 1)
2023-11-20 11:35:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 15
2023-11-20 11:35:35: Starting rank 16 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 16
2023-11-20 11:35:36: Starting rank 17 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 17
2023-11-20 11:35:36: Starting rank 18 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 18
2023-11-20 11:35:36: Starting rank 19 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 19
2023-11-20 11:35:36: Starting rank 20 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 20
2023-11-20 11:35:36: Starting rank 21 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 21
2023-11-20 11:35:36: Starting rank 22 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 22
2023-11-20 11:35:36: Starting rank 23 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 23
2023-11-20 11:35:36: Starting rank 24 (using batch size 1)
2023-11-20 11:35:36: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 24
2023-11-20 11:35:36: Starting rank 25 (using batch size 1)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 25
2023-11-20 11:35:37: Starting rank 26 (using batch size 1)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 26
2023-11-20 11:35:37: Starting rank 27 (using batch size 1)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 27
2023-11-20 11:35:37: Starting rank 28 (using batch size 1)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 28
2023-11-20 11:35:37: Starting rank 29 (using batch size 1)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 29
2023-11-20 11:35:37: Starting rank 30 (using batch size 20)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 30
2023-11-20 11:35:37: Starting rank 0 (using batch size 1)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 0
2023-11-20 11:35:37: Starting interpolation lines (location_property_osmline) (using batch size 20)
2023-11-20 11:35:37: Done 0/0 in 0 @ 0.000 per second - FINISHED interpolation lines (location_property_osmline)
+ sudo -E -u nominatim nominatim admin --check-database
2023-11-20 11:35:39: Using project directory: /nominatim
2023-11-20 11:35:39: Checking database
Checking database connection ... OK
Checking for placex table ... OK
Checking for placex content ... OK
Checking that tokenizer works ... OK
Checking for wikipedia/wikidata data ... WARNING
Wikipedia/Wikidata importance tables missing.
Quality of search results may be degraded. Reverse geocoding is unaffected.
See https://nominatim.org/release-docs/latest/admin/Import/#wikipediawikidata-rankings
Checking indexing status ... OK
Checking that database indexes are complete ... OK
Checking that all database indexes are valid ... OK
Checking TIGER external data table. ... not applicable
+ '[' '' '!=' '' ']'
+ '[' '' = true ']'
+ export NOMINATIM_QUERY_TIMEOUT=600
+ NOMINATIM_QUERY_TIMEOUT=600
+ export NOMINATIM_REQUEST_TIMEOUT=3600
+ NOMINATIM_REQUEST_TIMEOUT=3600
+ '[' '' = true ']'
+ sudo -H -E -u nominatim nominatim admin --warm
2023-11-20 11:35:58: Using project directory: /nominatim
2023-11-20 11:35:58: Warming database caches
+ export NOMINATIM_QUERY_TIMEOUT=10
+ NOMINATIM_QUERY_TIMEOUT=10
+ export NOMINATIM_REQUEST_TIMEOUT=60
+ NOMINATIM_REQUEST_TIMEOUT=60
+ sudo -E -u nominatim psql -d nominatim -c 'ANALYZE VERBOSE'
INFO: analyzing "public.spatial_ref_sys"
INFO: "spatial_ref_sys": scanned 867 of 867 pages, containing 8500 live rows and 0 dead rows; 8500 rows in sample, 8500 estimated total rows
INFO: analyzing "public.place_to_be_deleted"
INFO: "place_to_be_deleted": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
INFO: analyzing "pg_catalog.pg_type"
INFO: "pg_type": scanned 48 of 48 pages, containing 2027 live rows and 14 dead rows; 2027 rows in sample, 2027 estimated total rows
INFO: analyzing "public.placex"
INFO: "placex": scanned 1517 of 1517 pages, containing 24395 live rows and 0 dead rows; 24395 rows in sample, 24395 estimated total rows
INFO: analyzing "public.planet_osm_ways"
INFO: "planet_osm_ways": scanned 1379 of 1379 pages, containing 57219 live rows and 0 dead rows; 30000 rows in sample, 57219 estimated total rows
[...]
INFO: "location_area_country": scanned 2 of 2 pages, containing 46 live rows and 0 dead rows; 46 rows in sample, 46 estimated total rows
INFO: analyzing "public.location_property_tiger"
INFO: "location_property_tiger": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
INFO: analyzing "public.location_property_osmline"
INFO: "location_property_osmline": scanned 1 of 1 pages, containing 19 live rows and 19 dead rows; 19 rows in sample, 19 estimated total rows
INFO: analyzing "public.location_postcode"
INFO: "location_postcode": scanned 83 of 83 pages, containing 92 live rows and 0 dead rows; 92 rows in sample, 92 estimated total rows
INFO: analyzing "public.search_name"
INFO: "search_name": scanned 307 of 307 pages, containing 9487 live rows and 0 dead rows; 9487 rows in sample, 9487 estimated total rows
INFO: analyzing "public.location_road_0"
INFO: "word": scanned 470 of 470 pages, containing 30237 live rows and 0 dead rows; 30000 rows in sample, 30237 estimated total rows
ANALYZE
+ sudo service postgresql stop
* Stopping PostgreSQL 14 database server [ OK ]
+ rm /etc/postgresql/14/main/conf.d/postgres-import.conf
+ echo 'Deleting downloaded dumps in /nominatim'
Deleting downloaded dumps in /nominatim
+ rm -f '/nominatim/*sql.gz'
+ rm -f '/nominatim/*csv.gz'
+ rm -f /nominatim/tiger-nominatim-preprocessed.csv.tar.gz
+ '[' http://download.geofabrik.de/asia/maldives-latest.osm.pbf '!=' '' ']'
+ rm -f /nominatim/data.osm.pbf
+ touch /var/lib/postgresql/14/main/import-finished
+ service postgresql start
* Starting PostgreSQL 14 database server [ OK ]
+ cd /nominatim
+ sudo -E -u nominatim nominatim refresh --website --functions
2023-11-20 11:37:12: Using project directory: /nominatim
2023-11-20 11:37:12: Create functions
2023-11-20 11:37:29: Setting up website directory at /nominatim/website
+ service apache2 start
* Starting Apache httpd web server apache2 AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.17.0.2. Set the 'ServerName' directive globally to suppress this message
[Mon Nov 20 11:37:30.685961 2023] [core:emerg] [pid 1158] (95)Operation not supported: AH00023: Couldn't create the mpm-accept mutex
(95)Operation not supported: could not create accept mutex
AH00015: Unable to open logs
Action 'start' failed.
The Apache error log may have more information.
*
+ '[' '' '!=' '' ']'
+ tailpid=1161
+ tail -Fv /var/log/postgresql/postgresql-14-main.log /var/log/apache2/access.log /var/log/apache2/error.log /var/log/replication.log
+ export NOMINATIM_QUERY_TIMEOUT=600
+ NOMINATIM_QUERY_TIMEOUT=600
+ export NOMINATIM_REQUEST_TIMEOUT=3600
+ NOMINATIM_REQUEST_TIMEOUT=3600
+ '[' '' = true ']'
+ echo 'Warm database caches for search and reverse queries'
Warm database caches for search and reverse queries
+ sudo -H -E -u nominatim nominatim admin --warm
==> /var/log/postgresql/postgresql-14-main.log <==
2023-11-20 11:37:06.603 UTC [118] LOG: aborting any active transactions
2023-11-20 11:37:06.615 UTC [118] LOG: background worker "logical replication launcher" (PID 133) exited with exit code 1
2023-11-20 11:37:06.624 UTC [124] LOG: shutting down
2023-11-20 11:37:06.887 UTC [118] LOG: database system is shut down
2023-11-20 11:37:08.214 UTC [1022] LOG: starting PostgreSQL 14.9 (Ubuntu 14.9-0ubuntu0.22.04.1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit
2023-11-20 11:37:08.217 UTC [1022] LOG: listening on IPv4 address "0.0.0.0", port 5432
2023-11-20 11:37:08.217 UTC [1022] LOG: listening on IPv6 address "::", port 5432
2023-11-20 11:37:08.221 UTC [1022] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2023-11-20 11:37:08.239 UTC [1026] LOG: database system was shut down at 2023-11-20 11:37:06 UTC
2023-11-20 11:37:08.257 UTC [1022] LOG: database system is ready to accept connections
==> /var/log/apache2/access.log <==
==> /var/log/apache2/error.log <==
tail: cannot open '/var/log/replication.log' for reading: No such file or directory
2023-11-20 11:37:32: Using project directory: /nominatim
2023-11-20 11:37:32: Warming database caches
+ export NOMINATIM_QUERY_TIMEOUT=10
+ NOMINATIM_QUERY_TIMEOUT=10
+ export NOMINATIM_REQUEST_TIMEOUT=60
+ NOMINATIM_REQUEST_TIMEOUT=60
+ echo 'Warming finished'
Warming finished
+ echo '--> Nominatim is ready to accept requests'
--> Nominatim is ready to accept requests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment