Is hyper slow?

cpuinfo

vendor_id       : GenuineIntel
cpu family      : 6
model           : 63
model name      : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
stepping        : 2
microcode       : 0x2e
cpu MHz         : 3040.039
cache size      : 30720 KB
physical id     : 0
siblings        : 24
core id         : 13
cpu cores       : 12
apicid          : 27
initial apicid  : 27
fpu             : yes
fpu_exception   : yes
cpuid level     : 15
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm ida arat epb pln pts dtherm tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc
bugs            :
bogomips        : 5000.24
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

notes

Code is taken from TechEmpower FrameworkBenchmarks repo.
Lua script for wrk from here: https://github.com/TechEmpower/FrameworkBenchmarks/blob/master/toolset/setup/linux/client.sh#L36-L49
Run on 24 core Xeon E5-2680, bare metal (both wrk and hyper server).

pipeline.lua

init = function(args)
  local r = {}
  local depth = tonumber(args[1]) or 1
  for i=1,depth do
    r[i] = wrk.format()
  end
  req = table.concat(r)
end

request = function()
  return req
end

results

+ ./wrk -H 'Host: localhost' -H 'Accept: text/plain,text/html;q=0.9,application/xhtml+xml;q=0.9,application/xml;q=0.8,*/*;q=0.7' -H 'Connection: keep-alive' --latency -d 15 -c 256 --timeout 8 -t 8 http://127.
0.0.1:8080/plaintext -s ./pipeline.lua -- 16
Running 15s test @ http://127.0.0.1:8080/plaintext
  8 threads and 256 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    22.26ms   11.04ms  56.16ms   58.92%
    Req/Sec    12.84k     1.01k   19.71k    78.50%
  Latency Distribution
     50%   22.36ms
     75%   32.26ms
     90%   37.45ms
     99%   40.32ms
  1533514 requests in 15.03s, 190.12MB read
Requests/sec: 102038.98
Transfer/sec:     12.65MB

+ ./wrk -H 'Host: localhost' -H 'Accept: text/plain,text/html;q=0.9,application/xhtml+xml;q=0.9,application/xml;q=0.8,*/*;q=0.7' -H 'Connection: keep-alive' --latency -d 15 -c 1024 --timeout 8 -t 8 http://12$
.0.0.1:8080/plaintext -s ./pipeline.lua -- 16
Running 15s test @ http://127.0.0.1:8080/plaintext
  8 threads and 1024 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    22.88ms   11.81ms  67.70ms   57.52%
    Req/Sec    48.97k     1.76k   69.05k    76.48%
  Latency Distribution
     50%   23.27ms
     75%   33.33ms
     90%   39.70ms
     99%   48.52ms
  5845214 requests in 15.10s, 724.68MB read
Requests/sec: 387221.77
Transfer/sec:     48.01MB

+ ./wrk -H 'Host: localhost' -H 'Accept: text/plain,text/html;q=0.9,application/xhtml+xml;q=0.9,application/xml;q=0.8,*/*;q=0.7' -H 'Connection: keep-alive' --latency -d 15 -c 4096 --timeout 8 -t 8 http://12$
.0.0.1:8080/plaintext -s ./pipeline.lua -- 16
Running 15s test @ http://127.0.0.1:8080/plaintext
  8 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    68.80ms   39.98ms 287.13ms   64.14%
    Req/Sec    68.43k     6.30k  141.17k    75.32%
  Latency Distribution
     50%   64.51ms
     75%   96.03ms
     90%  124.09ms
     99%  170.98ms
  8131037 requests in 15.10s, 0.98GB read
Requests/sec: 538654.82
Transfer/sec:     66.78MB

+ ./wrk -H 'Host: localhost' -H 'Accept: text/plain,text/html;q=0.9,application/xhtml+xml;q=0.9,application/xml;q=0.8,*/*;q=0.7' -H 'Connection: keep-alive' --latency -d 15 -c 16384 --timeout 8 -t 8 http://12
7.0.0.1:8080/plaintext -s ./pipeline.lua -- 16
Running 15s test @ http://127.0.0.1:8080/plaintext
  8 threads and 16384 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   262.11ms  140.85ms 766.22ms   60.92%
    Req/Sec    67.30k     9.21k  158.55k    72.54%
  Latency Distribution
     50%  258.87ms
     75%  375.86ms
     90%  471.95ms
     99%    0.00us
  7952020 requests in 15.12s, 0.96GB read
Requests/sec: 525893.27
Transfer/sec:     65.20MB

More environment info:

Distributor ID: Ubuntu
Description:    Ubuntu 14.04.4 LTS
Release:        14.04
Codename:       trusty

Linux <redacted> 4.4.7 #2 SMP Wed Apr 20 13:38:39 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux

rustc 1.16.0 (30cf806ef 2017-03-10)