-
-
Save msbarry/ee305d2892e1f1cc56b6ed8737fe63eb to your computer and use it in GitHub Desktop.
power.yml planetiler run (r7g.metal)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ java -Xmx30g -jar planetiler.jar power.yml --nodemap-type=array --storage=mmap --force --output=data/output.pmtiles | |
| 0:00:00 DEB - argument: schema=power.yml (Location of YML-format schema definition file) | |
| 0:00:00 DEB - argument: madvise=true (default value for whether to use linux madvise(random) to improve memory-mapped read performance for temporary storage) | |
| 0:00:00 DEB - argument: storage=mmap (default storage type for temporary data, one of [ram, mmap, direct]) | |
| 0:00:00 DEB - argument: threads=64 (num threads) | |
| 0:00:00 DEB - argument: write_threads=2 (number of threads to use when writing temp features) | |
| 0:00:00 DEB - argument: process_threads=62 (number of threads to use when processing input features) | |
| 0:00:00 DEB - argument: bounds=null (bounds) | |
| 0:00:00 DEB - argument: polygon=null (a .poly file that limits output to tiles intersecting the shape) | |
| 0:00:00 DEB - argument: minzoom=0 (minimum zoom level) | |
| 0:00:00 DEB - argument: maxzoom=14 (maximum zoom level up to 15) | |
| 0:00:00 DEB - argument: render_maxzoom=14 (maximum rendering zoom level up to 15) | |
| 0:00:00 DEB - argument: feature_read_threads=2 (number of threads to use when reading features at tile write time) | |
| 0:00:00 DEB - argument: loginterval=10 seconds (time between logs) | |
| 0:00:00 DEB - argument: force=true (overwriting output file and ignore disk/RAM warnings) | |
| 0:00:00 DEB - argument: gzip_temp=false (gzip temporary feature storage (uses more CPU, but less disk space)) | |
| 0:00:00 DEB - argument: mmap_temp=true (use memory-mapped IO for temp feature files) | |
| 0:00:00 DEB - argument: sort_max_readers=6 (maximum number of concurrent read threads to use when sorting chunks) | |
| 0:00:00 DEB - argument: sort_max_writers=6 (maximum number of concurrent write threads to use when sorting chunks) | |
| 0:00:00 DEB - argument: nodemap_type=array (type of node location map, one of [noop, sortedtable, sparsearray, array]) | |
| 0:00:00 DEB - argument: nodemap_storage=mmap (storage for node location map, one of [ram, mmap, direct]) | |
| 0:00:00 DEB - argument: nodemap_madvise=true (use linux madvise(random) for node locations) | |
| 0:00:00 DEB - argument: multipolygon_geometry_storage=mmap (storage for multipolygon geometries, one of [ram, mmap, direct]) | |
| 0:00:00 DEB - argument: multipolygon_geometry_madvise=true (use linux madvise(random) for temporary multipolygon geometry storage) | |
| 0:00:00 DEB - argument: http_user_agent=Planetiler downloader (https://github.com/onthegomap/planetiler) (User-Agent header to set when downloading files over HTTP) | |
| 0:00:00 DEB - argument: http_timeout=30 seconds (Timeout to use when downloading files over HTTP) | |
| 0:00:00 DEB - argument: http_retries=1 (Retries to use when downloading files over HTTP) | |
| 0:00:00 DEB - argument: download_chunk_size_mb=100 (Size of file chunks to download in parallel in megabytes) | |
| 0:00:00 DEB - argument: download_threads=1 (Number of parallel threads to use when downloading each file) | |
| 0:00:00 DEB - argument: download_max_bandwidth= (Maximum bandwidth to consume when downloading files in units mb/s, mbps, kbps, etc.) | |
| 0:00:00 DEB - argument: min_feature_size_at_max_zoom=0.0625 (Default value for the minimum size in tile pixels of features to emit at the maximum zoom level to allow for overzooming) | |
| 0:00:00 DEB - argument: min_feature_size=1.0 (Default value for the minimum size in tile pixels of features to emit below the maximum zoom level) | |
| 0:00:00 DEB - argument: simplify_tolerance_at_max_zoom=0.0625 (Default value for the tile pixel tolerance to use when simplifying features at the maximum zoom level to allow for overzooming) | |
| 0:00:00 DEB - argument: simplify_tolerance=0.1 (Default value for the tile pixel tolerance to use when simplifying features below the maximum zoom level) | |
| 0:00:00 DEB - argument: osm_lazy_reads=true (Read OSM blocks from disk in worker threads) | |
| 0:00:00 DEB - argument: skip_filled_tiles=false (Skip writing tiles containing only polygon fills to the output) | |
| 0:00:00 DEB - argument: tile_warning_size_mb=1.0 (Maximum size in megabytes of a tile to emit a warning about) | |
| 0:00:00 DEB - argument: color=null (Color the terminal output) | |
| 0:00:00 DEB - argument: keep_unzipped=false (keep unzipped sources by default after reading) | |
| 0:00:00 INF - argument: stats=use in-memory stats | |
| 0:00:00 DEB - argument: tmpdir=data/tmp (temp directory) | |
| 0:00:00 DEB - argument: only_download=false (download source data then exit) | |
| 0:00:00 DEB - argument: download=false (download sources) | |
| 0:00:00 DEB - argument: temp_nodes=data/tmp/node.db (temp node db location) | |
| 0:00:00 DEB - argument: temp_multipolygons=data/tmp/multipolygon.db (temp multipolygon db location) | |
| 0:00:00 DEB - argument: temp_features=data/tmp/feature.db (temp feature db location) | |
| 0:00:00 DEB - argument: osm_parse_node_bounds=false (parse bounds from OSM nodes instead of header) | |
| 0:00:00 DEB - argument: osm_path=data/sources/aws_230227.osm.pbf (osm OSM input file path) | |
| 0:00:00 DEB - argument: free_osm_after_read=false (delete osm input file after reading to make space for output (reduces peak disk usage)) | |
| 0:00:00 DEB - argument: output=data/output.pmtiles (output tile archive URI) | |
| 0:00:00 DEB - argument: version=false (show version then exit) | |
| 0:00:00 INF - Planetiler build git hash: 72f86c8b6361f1b6ae80337220525333f943d7e9 | |
| 0:00:00 INF - Planetiler build version: 0.6.0 | |
| 0:00:00 INF - Planetiler build timestamp: 2023-04-01T09:24:50.895Z | |
| 0:00:00 DEB - argument: help=false (show arguments then exit) | |
| 0:00:00 INF - Building ConfiguredProfile profile into file:///data/data/output.pmtiles in these phases: | |
| 0:00:00 INF - osm_pass1: Pre-process OpenStreetMap input (store node locations then relation members) | |
| 0:00:00 INF - osm_pass2: Process OpenStreetMap nodes, ways, then relations | |
| 0:00:00 INF - sort: Sort rendered features by tile ID | |
| 0:00:00 INF - archive: Encode each tile and write to TileArchiveConfig[format=PMTILES, scheme=FILE, uri=file:///data/data/output.pmtiles, options={}] | |
| 0:00:00 DEB - ✓ 94G storage on /data (tmpfs) requested for read phase disk, 355G available | |
| 0:00:00 DEB - - 82G used for temporary node location cache | |
| 0:00:00 DEB - - 11G used for temporary multipolygon geometry cache | |
| 0:00:00 DEB - ✓ 94G storage on /data (tmpfs) requested for read phase, 355G available | |
| 0:00:00 DEB - - 82G used for array node location cache (switch to sparsearray to reduce size) | |
| 0:00:00 DEB - - 11G used for multipolygon way geometries | |
| 0:00:00 DEB - ✓ 94G temporary files and 507G of free memory for OS to cache them | |
| 0:00:00 INF - Setting map bounds from input: Env[-180.0 : 180.0, -90.0 : 90.0] | |
| 0:00:00 DEB - argument: archive_name=Power ('name' attribute for tileset metadata) | |
| 0:00:00 DEB - argument: archive_description=Features that represent electrical power grid ('description' attribute for tileset metadata) | |
| 0:00:00 DEB - argument: archive_attribution=<a href="https://www.openstreetmap.org/copyright" target="_blank">© OpenStreetMap contributors</a> ('attribution' attribute for tileset metadata) | |
| 0:00:00 DEB - argument: archive_version=null ('version' attribute for tileset metadata) | |
| 0:00:00 DEB - argument: archive_type=baselayer ('type' attribute for tileset metadata) | |
| 0:00:00 DEB - argument: archive_format=pbf ('format' attribute for tileset metadata) | |
| 0:00:00 INF - Using merge sort feature map, chunk size=2000mb max workers=64 | |
| 0:00:00 INF [osm_pass1] - | |
| 0:00:00 INF [osm_pass1] - Starting... | |
| 0:00:10 INF [osm_pass1] - nodes: [ 1.6B 159M/s ] 17G ways: [ 0 0/s ] rels: [ 0 0/s ] blocks: [ 6.7k 662/s ] | |
| cpus: 53.1 gc: 5% heap: 7.2G/32G direct: 3.8G postGC: 3.6G hppc: 848 | |
| read( 2%) -> (127/190) -> process(81% 84% 82% 82% 83% 82% 80% 82% 81% 82% 83% 82% 83% 83% 83% 81% 82% 81% 84% 82% 81% 83% 84% 82% 82% 82% 82% 85% 81% 83% 83% 82% 82% 82% 82% 82% 83% 82% 82% 84% 83% 82% 83% 82% 82% 81% 82% 83% 84% 83% 82% 81% 81% 83% 83% 83% 82% 81% 82% 81% 82% 81% 82%) | |
| 0:00:20 INF [osm_pass1] - nodes: [ 3.7B 210M/s ] 38G ways: [ 0 0/s ] rels: [ 0 0/s ] blocks: [ 13k 658/s ] | |
| cpus: 54.8 gc: 4% heap: 4.6G/32G direct: 4.9G postGC: 3.6G hppc: 848 | |
| read( 2%) -> (126/190) -> process(82% 86% 86% 86% 86% 83% 83% 87% 83% 86% 83% 84% 87% 83% 87% 83% 83% 83% 86% 84% 83% 84% 87% 86% 84% 87% 84% 87% 83% 84% 83% 87% 85% 83% 83% 86% 86% 83% 83% 83% 84% 86% 86% 83% 83% 86% 86% 87% 83% 83% 83% 83% 83% 83% 83% 86% 83% 85% 91% 82% 83% 84% 83%) | |
| 0:00:30 INF [osm_pass1] - nodes: [ 5.9B 223M/s ] 61G ways: [ 0 0/s ] rels: [ 0 0/s ] blocks: [ 19k 633/s ] | |
| cpus: 55.7 gc: 4% heap: 7.2G/32G direct: 5.9G postGC: 5G hppc: 848 | |
| read( 2%) -> (126/190) -> process(85% 85% 85% 85% 85% 85% 87% 87% 85% 85% 87% 85% 87% 85% 87% 87% 85% 86% 85% 87% 86% 85% 88% 85% 88% 85% 87% 87% 85% 87% 85% 85% 85% 85% 85% 85% 85% 85% 87% 85% 87% 85% 85% 87% 85% 87% 85% 85% 85% 85% 86% 85% 85% 85% 87% 87% 85% 85% 92% 85% 87% 87% 87%) | |
| 0:00:40 INF [osm_pass1] - nodes: [ 8.2B 224M/s ] 82G ways: [ 0 0/s ] rels: [ 0 0/s ] blocks: [ 25k 621/s ] | |
| cpus: 55.8 gc: 4% heap: 10G/32G direct: 6.4G postGC: 6.6G hppc: 848 | |
| read( 2%) -> (127/190) -> process(86% 86% 86% 86% 85% 86% 85% 87% 86% 86% 87% 87% 87% 86% 87% 86% 85% 87% 86% 86% 85% 86% 88% 87% 87% 85% 85% 87% 86% 87% 86% 86% 85% 86% 86% 85% 85% 86% 86% 86% 86% 86% 86% 85% 86% 85% 86% 85% 86% 86% 87% 86% 86% 86% 87% 85% 85% 86% 96% 86% 86% 86% 85%) | |
| 0:00:41 INF [osm_pass1:process] - Finished nodes: 8,248,421,285 (201M/s) in 41s cpu:36m54s gc:2s avg:54.1 | |
| 0:00:50 INF [osm_pass1] - nodes: [ 8.2B 3.3M/s ] 85G ways: [ 361M 36M/s ] rels: [ 0 0/s ] blocks: [ 31k 604/s ] | |
| cpus: 53.5 gc: 7% heap: 4.8G/32G direct: 6.4G postGC: 4.5G hppc: 848 | |
| read( 1%) -> (127/190) -> process(80% 80% 80% 80% 80% 80% 80% 80% 80% 81% 81% 80% 81% 81% 80% 80% 81% 80% 80% 81% 81% 81% 80% 81% 80% 80% 80% 80% 81% 80% 80% 80% 80% 81% 80% 80% 80% 80% 80% 80% 80% 80% 80% 81% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 87% 80% 80% 80% 80%) | |
| 0:01:00 INF [osm_pass1] - nodes: [ 8.2B 0/s ] 85G ways: [ 869M 50M/s ] rels: [ 0 0/s ] blocks: [ 39k 701/s ] | |
| cpus: 59.2 gc: 7% heap: 5.2G/32G direct: 6.4G postGC: 4.5G hppc: 848 | |
| read( 2%) -> (127/190) -> process(90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 90% 89%) | |
| 0:01:02 INF [osm_pass1:process] - Finished ways: 924,624,366 (45M/s) in 20s cpu:19m43s gc:1s avg:58.5 | |
| 0:01:10 INF [osm_pass1] - nodes: [ 8.2B 0/s ] 85G ways: [ 924M 5.5M/s ] rels: [ 9.7M 974k/s ] blocks: [ 40k 107/s ] | |
| cpus: 11.2 gc: 1% heap: 7.2G/32G direct: 6G postGC: 4.5G hppc: 49M | |
| read( -%) -> (0/190) -> process(17% 17% 20% 13% 14% 38% 13% 14% 15% 16% 15% 14% 13% 16% -% 13% 14% -% 19% 14% 14% 22% 15% 14% 13% 24% 13% 23% 13% 15% 15% 16% 13% 14% 21% -% 15% -% 23% 14% -% 14% 23% 15% 20% 15% 15% 16% 13% 18% 14% 15% 14% 24% 14% 14% 13% 14% 17% 14% 13% 22% 15%) | |
| 0:01:11 INF [osm_pass1:process] - Finished relations: 10,712,590 (1.1M/s) in 10s cpu:50s avg:5.2 | |
| 0:01:11 INF [osm_pass1] - nodes: [ 8.2B 0/s ] 85G ways: [ 924M 0/s ] rels: [ 10M 1.2M/s ] blocks: [ 40k 73/s ] | |
| cpus: 4.2 gc: 0% heap: 9.4G/32G direct: 134M postGC: 4.5G hppc: 52M | |
| read( -%) -> (0/190) -> process( -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -%) | |
| 0:01:11 DEB [osm_pass1] - Processed 40,132 blocks: | |
| 0:01:11 DEB [osm_pass1] - nodes: 8,248,421,285 (201M/s) in 41s cpu:36m54s gc:2s avg:54.1 | |
| 0:01:11 DEB [osm_pass1] - ways: 924,624,366 (45M/s) in 20s cpu:19m43s gc:1s avg:58.5 | |
| 0:01:11 DEB [osm_pass1] - relations: 10,712,590 (1.1M/s) in 10s cpu:50s avg:5.2 | |
| 0:01:11 INF [osm_pass1] - Finished in 1m11s cpu:57m31s gc:3s avg:48.5 | |
| 0:01:11 INF [osm_pass1] - read 1x(2% 1s wait:1m4s done:5s) | |
| 0:01:11 INF [osm_pass1] - process 63x(74% 53s sys:1s block:9s wait:1s) | |
| 0:01:11 INF [osm_pass2] - | |
| 0:01:11 INF [osm_pass2] - Starting... | |
| 0:01:21 INF [osm_pass2] - nodes: [ 1.3B 16% 131M/s ] 85G ways: [ 0 0% 0/s ] rels: [ 0 0% 0/s ] features: [ 1.3M 137k/s ] 4G blocks: [ 5.6k 14% 559/s ] | |
| cpus: 54.9 gc: 4% heap: 6G/32G direct: 16k postGC: 4.3G relInfo: 52M mpGeoms: 277 | |
| read( 1%) -> (32/94) -> process(86% 86% 86% 86% 85% 86% 86% 86% 86% 86% 86% 86% 86% 86% 85% 85% 85% 86% 86% 86% 86% 86% 86% 86% 86% 86% 86% 86% 87% 86% 85% 86% 86% 86% 86% 87% 86% 86% 86% 85% 86% 86% 86% 86% 86% 86% 86% 85% 86% 86% 85% 86% 86% 86% 86% 86% 86% 85% 86% 85% 86% 86%) -> (26k/114k) -> write( 2% 2%) | |
| 0:01:31 INF [osm_pass2] - nodes: [ 2.7B 34% 146M/s ] 85G ways: [ 0 0% 0/s ] rels: [ 0 0% 0/s ] features: [ 5.4M 409k/s ] 4G blocks: [ 10k 26% 497/s ] | |
| cpus: 55.7 gc: 4% heap: 12G/32G direct: 16k postGC: 4.3G relInfo: 52M mpGeoms: 277 | |
| read( 1%) -> (32/94) -> process(87% 88% 87% 87% 87% 88% 88% 87% 87% 87% 88% 87% 87% 87% 87% 87% 88% 87% 87% 87% 88% 88% 88% 88% 87% 87% 88% 87% 88% 87% 87% 87% 87% 87% 87% 89% 88% 87% 87% 87% 87% 87% 87% 87% 87% 88% 88% 87% 88% 87% 87% 87% 89% 87% 87% 87% 87% 87% 87% 88% 87% 87%) -> (29k/114k) -> write( 6% 6%) | |
| 0:01:41 INF [osm_pass2] - nodes: [ 4.3B 52% 152M/s ] 85G ways: [ 0 0% 0/s ] rels: [ 0 0% 0/s ] features: [ 9.8M 437k/s ] 4G blocks: [ 15k 37% 440/s ] | |
| cpus: 55.9 gc: 4% heap: 8.2G/32G direct: 16k postGC: 4.4G relInfo: 52M mpGeoms: 277 | |
| read( 1%) -> (32/94) -> process(87% 88% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 88% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 88% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 88% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 87% 89% 87% 87%) -> (31k/114k) -> write( 7% 7%) | |
| 0:01:51 INF [osm_pass2] - nodes: [ 5.8B 71% 155M/s ] 85G ways: [ 0 0% 0/s ] rels: [ 0 0% 0/s ] features: [ 13M 389k/s ] 4G blocks: [ 19k 48% 440/s ] | |
| cpus: 56.2 gc: 4% heap: 4.8G/32G direct: 16k postGC: 4.3G relInfo: 52M mpGeoms: 277 | |
| read( 1%) -> (32/94) -> process(88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88%) -> (34k/114k) -> write( 6% 6%) | |
| 0:02:01 INF [osm_pass2] - nodes: [ 7.4B 90% 155M/s ] 85G ways: [ 0 0% 0/s ] rels: [ 0 0% 0/s ] features: [ 19M 554k/s ] 4G blocks: [ 23k 59% 431/s ] | |
| cpus: 56.4 gc: 4% heap: 5.8G/32G direct: 16k postGC: 4.3G relInfo: 52M mpGeoms: 277 | |
| read( 1%) -> (32/94) -> process(88% 88% 88% 88% 88% 88% 88% 88% 89% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88% 88%) -> (35k/114k) -> write(10% 10%) | |
| 0:02:07 DEB [osm_pass2:process] - Sorting long long multimap... | |
| 0:02:07 DEB [osm_pass2:process] - Sorted long long multimap 0s cpu:0.6s avg:501.9 | |
| 0:02:07 INF [osm_pass2:process] - Finished nodes: 8,248,421,285 (147M/s) in 56s cpu:51m55s gc:2s avg:55.9 | |
| 0:02:11 INF [osm_pass2] - nodes: [ 8.2B 100% 82M/s ] 85G ways: [ 48M 5% 4.8M/s ] rels: [ 0 0% 0/s ] features: [ 24M 524k/s ] 4G blocks: [ 27k 67% 328/s ] | |
| cpus: 42.2 gc: 4% heap: 10G/32G direct: 3.1M postGC: 5.2G relInfo: 52M mpGeoms: 839M | |
| read( 1%) -> (32/94) -> process(61% 68% 66% 63% 66% 73% 68% 63% 65% 66% 72% 63% 63% 63% 66% 69% 70% 66% 64% 66% 67% 65% 63% 63% 62% 63% 62% 71% 63% 58% 68% 70% 63% 62% 61% 65% 64% 62% 60% 63% 62% 62% 69% 68% 66% 65% 62% 65% 61% 61% 68% 61% 60% 63% 63% 63% 65% 63% 70% 63% 69% 64%) -> (33k/114k) -> write( 9% 9%) | |
| 0:02:21 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 183M 20% 13M/s ] rels: [ 0 0% 0/s ] features: [ 27M 301k/s ] 4G blocks: [ 29k 73% 222/s ] | |
| cpus: 24 gc: 4% heap: 12G/32G direct: 3.1M postGC: 8G relInfo: 52M mpGeoms: 2.5G | |
| read( 0%) -> (32/94) -> process(35% 35% 27% 27% 34% 33% 37% 32% 34% 52% 37% 43% 26% 41% 36% 40% 30% 36% 45% 44% 39% 35% 40% 43% 35% 31% 34% 46% 26% 32% 41% 30% 47% 34% 29% 54% 31% 28% 36% 27% 34% 34% 33% 40% 30% 37% 33% 30% 29% 29% 44% 24% 27% 32% 31% 40% 34% 37% 40% 33% 57% 48%) -> (32k/114k) -> write( 3% 3%) | |
| 0:02:31 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 314M 34% 13M/s ] rels: [ 0 0% 0/s ] features: [ 29M 219k/s ] 4G blocks: [ 31k 78% 201/s ] | |
| cpus: 22.1 gc: 5% heap: 14G/32G direct: 3.1M postGC: 4.3G relInfo: 52M mpGeoms: 4.1G | |
| read( 0%) -> (32/94) -> process(24% 31% 33% 30% 43% 41% 25% 36% 26% 30% 27% 25% 25% 40% 34% 36% 26% 32% 34% 24% 36% 26% 42% 32% 34% 38% 42% 47% 21% 34% 31% 34% 23% 38% 34% 25% 36% 28% 42% 26% 33% 49% 47% 46% 21% 22% 38% 27% 22% 21% 25% 49% 31% 30% 22% 42% 45% 22% 23% 51% 23% 26%) -> (29k/114k) -> write( 2% 2%) | |
| 0:02:41 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 503M 54% 18M/s ] rels: [ 0 0% 0/s ] features: [ 31M 195k/s ] 4G blocks: [ 33k 85% 264/s ] | |
| cpus: 26.2 gc: 4% heap: 6.5G/32G direct: 3.1M postGC: 4.5G relInfo: 52M mpGeoms: 5.7G | |
| read( 0%) -> (32/94) -> process(36% 24% 45% 29% 44% 36% 45% 31% 26% 45% 42% 29% 37% 32% 61% 28% 57% 41% 43% 34% 61% 34% 28% 27% 40% 39% 33% 49% 42% 46% 42% 48% 30% 40% 54% 28% 45% 39% 36% 48% 46% 57% 50% 44% 30% 40% 34% 43% 33% 31% 30% 57% 54% 58% 33% 53% 45% 24% 32% 28% 37% 45%) -> (32k/114k) -> write( 2% 2%) | |
| 0:02:51 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 645M 70% 14M/s ] rels: [ 0 0% 0/s ] features: [ 33M 127k/s ] 4G blocks: [ 35k 89% 198/s ] | |
| cpus: 35.9 gc: 3% heap: 4.8G/32G direct: 3.1M postGC: 4.5G relInfo: 52M mpGeoms: 7.2G | |
| read( 0%) -> (32/94) -> process(41% 45% 64% 46% 64% 48% 52% 51% 46% 53% 65% 50% 72% 49% 48% 54% 64% 61% 58% 64% 71% 54% 59% 53% 64% 52% 48% 65% 56% 61% 63% 55% 52% 65% 57% 50% 65% 62% 60% 69% 52% 49% 55% 54% 52% 51% 51% 67% 54% 56% 55% 65% 51% 49% 51% 52% 50% 46% 53% 74% 55% 58%) -> (28k/114k) -> write( 1% 1%) | |
| 0:03:01 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 742M 80% 9.7M/s ] rels: [ 0 0% 0/s ] features: [ 33M 87k/s ] 4G blocks: [ 37k 93% 135/s ] | |
| cpus: 60.5 gc: 2% heap: 9.1G/32G direct: 3.1M postGC: 4.5G relInfo: 52M mpGeoms: 8G | |
| read( 0%) -> (32/94) -> process(93% 96% 97% 96% 97% 96% 96% 96% 96% 97% 96% 96% 97% 96% 96% 97% 97% 97% 96% 97% 96% 96% 96% 96% 97% 96% 96% 96% 97% 96% 97% 96% 97% 96% 97% 96% 97% 97% 97% 96% 97% 96% 96% 96% 96% 96% 97% 96% 96% 97% 97% 97% 97% 96% 97% 96% 96% 96% 97% 97% 96% 97%) -> (32k/114k) -> write( 1% 1%) | |
| 0:03:11 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 838M 91% 9.5M/s ] rels: [ 0 0% 0/s ] features: [ 34M 86k/s ] 4G blocks: [ 38k 96% 131/s ] | |
| cpus: 59.7 gc: 2% heap: 9.1G/32G direct: 3.1M postGC: 4.9G relInfo: 52M mpGeoms: 9.2G | |
| read( 0%) -> (32/94) -> process(93% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 97% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95%) -> (32k/114k) -> write( 1% 1%) | |
| 0:03:20 INF [osm_pass2:process] - Finished ways: 924,624,366 (12M/s) in 1m14s cpu:48m52s gc:2s avg:39.8 | |
| 0:03:21 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 924M 100% 8.6M/s ] rels: [ 10M 98% 1M/s ] features: [ 35M 95k/s ] 4G blocks: [ 40k 100% 153/s ] | |
| cpus: 55.5 gc: 2% heap: 5.4G/32G direct: 3.1M postGC: 4.5G relInfo: 52M mpGeoms: 10G | |
| read( -%) -> (0/94) -> process(83% 87% 89% 88% 86% 89% 89% 90% 89% 89% 88% 89% 88% 84% 89% 85% 85% 87% 88% 88% 89% 89% 87% 89% 89% 87% 87% 88% 90% 89% 89% 88% 89% 90% 88% 89% 90% 90% 88% 87% 88% 88% 90% 90% 88% 89% 88% 89% 87% 89% 90% 87% 89% 88% 89% 88% 87% 88% 87% 87% 88% 89%) -> (33k/114k) -> write( 1% 1%) | |
| 0:03:22 INF [osm_pass2:process] - Finished relations: 10,712,590 (7.1M/s) in 2s cpu:35s avg:23.1 | |
| 0:03:22 INF [osm_pass2] - nodes: [ 8.2B 100% 0/s ] 85G ways: [ 924M 100% 0/s ] rels: [ 10M 100% 491k/s ] features: [ 35M 72k/s ] 1.7G blocks: [ 40k 100% 50/s ] | |
| cpus: 1.7 gc: 0% heap: 5.8G/32G direct: 16k postGC: 4.5G relInfo: 52M mpGeoms: 10G | |
| read( -%) -> (0/94) -> process( -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -%) -> (0/114k) -> write( -% -%) | |
| 0:03:22 DEB [osm_pass2] - Processed 40,132 blocks: | |
| 0:03:22 DEB [osm_pass2] - nodes: 8,248,421,285 (147M/s) in 56s cpu:51m55s gc:2s avg:55.9 | |
| 0:03:22 DEB [osm_pass2] - ways: 924,624,366 (12M/s) in 1m14s cpu:48m52s gc:2s avg:39.8 | |
| 0:03:22 DEB [osm_pass2] - relations: 10,712,590 (7.1M/s) in 2s cpu:35s avg:23.1 | |
| 0:03:22 INF [osm_pass2] - Finished in 2m11s cpu:1h41m1s gc:5s avg:46.4 | |
| 0:03:22 INF [osm_pass2] - read 1x(1% 0.9s wait:2m8s done:1s) | |
| 0:03:22 INF [osm_pass2] - process 62x(72% 1m35s block:26s wait:1s) | |
| 0:03:22 INF [osm_pass2] - write 2x(4% 5s wait:2m5s) | |
| 0:03:29 INF - Deleting node.db to make room for output file | |
| 0:03:29 INF [sort] - | |
| 0:03:29 INF [sort] - Starting... | |
| 0:03:29 INF [sort] - Grouped 3 chunks into 2 | |
| 0:03:32 INF [sort] - chunks: [ 2 / 2 100% ] 1.7G | |
| cpus: 26.2 gc: 12% heap: 6.6G/32G direct: 16k postGC: 6.2G | |
| -> (0/8) -> worker( -% -%) | |
| 0:03:32 INF [sort] - Finished in 3s cpu:1m9s avg:26.1 | |
| 0:03:32 INF [sort] - worker 5x(30% 0.8s done:2s) | |
| 0:03:32 INF - read:1s write:1s sort:1s | |
| 0:03:32 INF [archive] - | |
| 0:03:32 INF [archive] - Starting... | |
| 0:03:32 INF [archive:write] - Starting z7 | |
| 0:03:32 INF [archive:write] - Finished z7 in 0.1s cpu:3s avg:61.8, now starting z8 | |
| 0:03:32 INF [archive:write] - Finished z8 in 0.1s cpu:7s avg:53.2, now starting z9 | |
| 0:03:32 INF [archive:write] - Finished z9 in 0.2s cpu:8s avg:53.4, now starting z10 | |
| 0:03:32 INF [archive:write] - Finished z10 in 0.1s cpu:6s avg:49.7, now starting z11 | |
| 0:03:33 INF [archive:write] - Finished z11 in 0.2s cpu:10s avg:44, now starting z12 | |
| 0:03:33 INF [archive:write] - Finished z12 in 0.6s cpu:23s avg:41.4, now starting z13 | |
| 0:03:35 INF [archive:write] - Finished z13 in 1s cpu:56s avg:38.5, now starting z14 | |
| 0:03:38 INF [archive:write] - Finished z14 in 3s cpu:1m17s avg:24.6 | |
| 0:03:38 INF [archive:write] - Building directories with 4096 entries per leaf, attempt 1... | |
| 0:03:39 INF [archive:write] - Built directories with 1112 leaves, 4859B root directory | |
| 0:03:39 INF [archive:write] - Writing metadata and leaf directories... | |
| 0:03:39 INF [archive:write] - Writing header... | |
| 0:03:39 INF [archive:write] - # addressed tiles: 4551768 | |
| 0:03:39 INF [archive:write] - # of tile entries: 4551741 | |
| 0:03:39 INF [archive:write] - # of tile contents: 4551493 | |
| 0:03:39 INF [archive:write] - Root directory: 4.8kB | |
| 0:03:39 INF [archive:write] - # leaves: 1112 | |
| 0:03:39 INF [archive:write] - Leaf directories: 7.7MB | |
| 0:03:39 INF [archive:write] - Avg leaf size: 6.9kB | |
| 0:03:39 INF [archive:write] - Total dir bytes: 7.7MB | |
| 0:03:39 INF [archive:write] - Average bytes per addressed tile: 1.703621098439112 | |
| 0:03:39 INF [archive] - features: [ 35M 100% 5.1M/s ] 1.7G tiles: [ 4.5M 649k/s ] 980M | |
| cpus: 30.3 gc: 5% heap: 19G/32G direct: 16k postGC: 11G | |
| read( -% -%) -> merge( -%) -> (0/1.6k) -> encode( -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -% -%) -> (0/1.6k) -> write( -%) | |
| last tile: 14/15937/3898 (z14 98%) https://www.openstreetmap.org/#map=14/68.18789/170.17822 | |
| 0:03:39 DEB [archive] - Tile stats: | |
| 0:03:39 DEB [archive] - z0 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z1 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z2 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z3 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z4 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z5 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z6 avg:0 max:0 | |
| 0:03:39 DEB [archive] - z7 avg:6.6k max:136k | |
| 0:03:39 DEB [archive] - z8 avg:2.8k max:80k | |
| 0:03:39 DEB [archive] - z9 avg:1.2k max:42k | |
| 0:03:39 DEB [archive] - z10 avg:594 max:19k | |
| 0:03:39 DEB [archive] - z11 avg:331 max:11k | |
| 0:03:39 DEB [archive] - z12 avg:220 max:8.6k | |
| 0:03:39 DEB [archive] - z13 avg:373 max:127k | |
| 0:03:39 DEB [archive] - z14 avg:221 max:46k | |
| 0:03:39 DEB [archive] - all avg:281 max:136k | |
| 0:03:39 DEB [archive] - # features: 35,757,153 | |
| 0:03:39 DEB [archive] - # tiles: 4,551,768 | |
| 0:03:39 INF [archive] - Finished in 7s cpu:3m32s avg:30.2 | |
| 0:03:39 INF [archive] - read 2x(13% 0.9s wait:1s done:4s) | |
| 0:03:39 INF [archive] - merge 1x(38% 3s wait:1s done:2s) | |
| 0:03:39 INF [archive] - encode 62x(42% 3s block:3s done:1s) | |
| 0:03:39 INF [archive] - write 1x(87% 6s sys:3s) | |
| 0:03:39 INF - Finished in 3m39s cpu:2h43m21s gc:9s avg:44.8 | |
| 0:03:39 INF - FINISHED! | |
| 0:03:39 INF - | |
| 0:03:39 INF - ---------------------------------------- | |
| 0:03:39 INF - overall 3m39s cpu:2h43m21s gc:9s avg:44.8 | |
| 0:03:39 INF - osm_pass1 1m11s cpu:57m31s gc:3s avg:48.5 | |
| 0:03:39 INF - read 1x(2% 1s wait:1m4s done:5s) | |
| 0:03:39 INF - process 63x(74% 53s sys:1s block:9s wait:1s) | |
| 0:03:39 INF - osm_pass2 2m11s cpu:1h41m1s gc:5s avg:46.4 | |
| 0:03:39 INF - read 1x(1% 0.9s wait:2m8s done:1s) | |
| 0:03:39 INF - process 62x(72% 1m35s block:26s wait:1s) | |
| 0:03:39 INF - write 2x(4% 5s wait:2m5s) | |
| 0:03:39 INF - sort 3s cpu:1m9s avg:26.1 | |
| 0:03:39 INF - worker 5x(30% 0.8s done:2s) | |
| 0:03:39 INF - archive 7s cpu:3m32s avg:30.2 | |
| 0:03:39 INF - read 2x(13% 0.9s wait:1s done:4s) | |
| 0:03:39 INF - merge 1x(38% 3s wait:1s done:2s) | |
| 0:03:39 INF - encode 62x(42% 3s block:3s done:1s) | |
| 0:03:39 INF - write 1x(87% 6s sys:3s) | |
| 0:03:39 INF - ---------------------------------------- | |
| 0:03:39 INF - archive 980MB | |
| 0:03:39 INF - features 1.7GB |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment