Skip to content

Instantly share code, notes, and snippets.

@dgaubert

dgaubert/pluto-benchmark.md

Last active February 28, 2017 11:01
Show Gist options
  • Save dgaubert/71e0aaf71b88e0a8098f95066e0fb86d to your computer and use it in GitHub Desktop.
Save dgaubert/71e0aaf71b88e0a8098f95066e0fb86d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pluto-benchmark.md

Pluto benchmark

Test pluto-map, from zoom 18 to zoom 0 and given a bounding-box it iterates over a predefined bounding-box to request meaningful tiles (non empty tiles), instead of looping over the whole quad-tree.

Complete cycle (about 90k tiles)

Node v0.10.26 / Mapnik 2.3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 300 -t 1 -c 20
Running 5m test @ http://cdb.localhost.lan:8181/
  1 threads and 20 connections
Thread Stats   Avg      Stdev     Max   +/- Stdev
  Latency    65.88ms   60.21ms   1.89s    94.27%
  Req/Sec   333.66    140.59   747.00     67.87%
Latency Distribution
   50%   55.36ms
   75%   73.22ms
   90%  100.21ms
   99%  239.45ms
98336 requests in 5.00m, 115.81MB read
Socket errors: connect 0, read 1, write 1, timeout 22
Requests/sec:    327.74
Transfer/sec:    395.25KB

Node v6.9.5 / Mapnik 3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 300 -t 1 -c 20
Running 5m test @ http://cdb.localhost.lan:8181/
  1 threads and 20 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    69.15ms   63.88ms   1.77s    93.89%
    Req/Sec   320.65    130.20   700.00     68.18%
  Latency Distribution
     50%   58.02ms
     75%   73.63ms
     90%  101.05ms
     99%  267.65ms
93046 requests in 5.00m, 108.55MB read
Socket errors: connect 0, read 1, write 0, timeout 38
Requests/sec:    310.12
Transfer/sec:    370.48KB

30 seconds, 4 threads

Node v0.10.26 / Mapnik 2.3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    24.96ms   14.56ms 130.66ms   79.57%
    Req/Sec    82.20     36.55   280.00     69.87%
  Latency Distribution
     50%   21.28ms
     75%   28.29ms
     90%   44.87ms
     99%   77.97ms
  9892 requests in 30.04s, 14.02MB read
Requests/sec:    329.27
Transfer/sec:    477.82KB

Node v6.9.5 / Mapnik 3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    26.44ms   15.29ms 282.15ms   83.32%
    Req/Sec    77.82     32.74   290.00     68.70%
  Latency Distribution
     50%   22.91ms
     75%   29.41ms
     90%   44.44ms
     99%   78.31ms
  9379 requests in 30.09s, 12.95MB read
Requests/sec:    311.72
Transfer/sec:    440.67KB

Small bounding-box: less empty tile

Manhattan level

Node v0.10.26 / Mapnik 2.3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    39.78ms   27.40ms 185.43ms   68.30%
    Req/Sec    51.65     36.85   250.00     83.19%
  Latency Distribution
     50%   33.14ms
     75%   58.21ms
     90%   77.21ms
     99%  117.75ms
  6191 requests in 30.05s, 22.97MB read
Requests/sec:    206.01
Transfer/sec:    782.65KB

Node v6.9.5 / Mapnik 3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    38.67ms   26.20ms 271.08ms   68.83%
    Req/Sec    53.09     37.33   280.00     85.80%
  Latency Distribution
     50%   32.37ms
     75%   57.01ms
     90%   72.36ms
     99%  108.36ms
  6380 requests in 30.08s, 23.90MB read
Requests/sec:    212.12
Transfer/sec:    813.69KB

South Manhattan

Node v0.10.26 / Mapnik 2.3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    50.95ms   38.14ms 312.98ms   68.12%
    Req/Sec    41.56     33.73   232.00     85.85%
  Latency Distribution
     50%   45.19ms
     75%   75.37ms
     90%   99.95ms
     99%  163.12ms
  4902 requests in 30.08s, 32.85MB read
Requests/sec:    162.95
Transfer/sec:      1.09MB

Node v6.9.5 / Mapnik 3.x / polygons / pluto map / default style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    50.79ms   38.30ms 282.85ms   67.85%
    Req/Sec    41.42     35.27   222.00     85.53%
  Latency Distribution
     50%   46.73ms
     75%   76.02ms
     90%   98.33ms
     99%  161.72ms
  4911 requests in 30.09s, 33.05MB read
Requests/sec:    163.20
Transfer/sec:      1.10MB

South Manhattan + TurboCarto: ramp

pluto-map-styled

Node v0.10.26 / Mapnik 2.3.x / polygons / pluto map / custom style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    49.37ms   34.82ms 349.28ms   67.31%
    Req/Sec    42.00     32.00   200.00     84.57%
  Latency Distribution
     50%   47.67ms
     75%   71.45ms
     90%   92.75ms
     99%  143.79ms
  5024 requests in 30.10s, 35.93MB read
Requests/sec:    166.90
Transfer/sec:      1.19MB

Node v6.9.5 / Mapnik 3.x / polygons / pluto map / custom style

wrk http://cdb.localhost.lan:8181/ --latency -s scripts/simple_map.lua -d 30 -t 4
Running 30s test @ http://cdb.localhost.lan:8181/
  4 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    50.89ms   39.36ms 367.65ms   75.18%
    Req/Sec    41.90     32.55   280.00     83.90%
  Latency Distribution
     50%   47.65ms
     75%   72.05ms
     90%   96.88ms
     99%  180.69ms
  4977 requests in 30.10s, 35.07MB read
Requests/sec:    165.35
Transfer/sec:      1.17MB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment