Skip to content

Instantly share code, notes, and snippets.

@jasonvarga
Last active March 5, 2021 18:53
Show Gist options
  • Save jasonvarga/5e2765777f19eea9f33ae4d7a0e601e5 to your computer and use it in GitHub Desktop.
Save jasonvarga/5e2765777f19eea9f33ae4d7a0e601e5 to your computer and use it in GitHub Desktop.
Statamic 2 vs 3

Tests run on a 2013 Macbook Pro with 2.8GHz Intel Core i7, 16 GB 1600 MHz DDR3 using Laravel Valet.

Statamic 2 with 5000 entries

On a template listing 10 posts sorted by date.

Concurrency 1

$ ab -t 20 -c 1 https://statamic2.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic2.test (be patient)
Finished 5 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic2.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic2.test

Document Path:          /
Document Length:        514 bytes

Concurrency Level:      1
Time taken for tests:   24.248 seconds
Complete requests:      5
Failed requests:        0
Total transferred:      7709 bytes
HTML transferred:       2570 bytes
Requests per second:    0.21 [#/sec] (mean)
Time per request:       4849.686 [ms] (mean)
Time per request:       4849.686 [ms] (mean, across all concurrent requests)
Transfer rate:          0.31 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       12   35  47.7     16     120
Processing:  4502 4814 298.3   4906    5203
Waiting:     4502 4814 298.3   4906    5203
Total:       4568 4850 274.9   4918    5222

Percentage of the requests served within a certain time (ms)
  50%   4809
  66%   5027
  75%   5027
  80%   5222
  90%   5222
  95%   5222
  98%   5222
  99%   5222
 100%   5222 (longest request)

Concurrency 20

$ ab -t 20 -c 20 https://statamic2.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic2.test (be patient)
Finished 7 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic2.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic2.test

Document Path:          /
Document Length:        514 bytes

Concurrency Level:      20
Time taken for tests:   25.815 seconds
Complete requests:      7
Failed requests:        0
Total transferred:      10793 bytes
HTML transferred:       3598 bytes
Requests per second:    0.27 [#/sec] (mean)
Time per request:       73758.069 [ms] (mean)
Time per request:       3687.903 [ms] (mean, across all concurrent requests)
Transfer rate:          0.41 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:      118  195  34.0    208     208
Processing:  4778 12493 4684.2  12768   20713
Waiting:     4777 12493 4684.5  12768   20713
Total:       4896 12688 4709.0  12976   20921

Percentage of the requests served within a certain time (ms)
  50%  12558
  66%  13393
  75%  13879
  80%  13879
  90%  20921
  95%  20921
  98%  20921
  99%  20921
 100%  20921 (longest request)

Concurrency 100

$ ab -t 20 -c 100 https://statamic2.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic2.test (be patient)
Finished 2 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic2.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic2.test

Document Path:          /
Document Length:        514 bytes

Concurrency Level:      100
Time taken for tests:   23.340 seconds
Complete requests:      2
Failed requests:        0
Total transferred:      3080 bytes
HTML transferred:       1028 bytes
Requests per second:    0.09 [#/sec] (mean)
Time per request:       1167011.250 [ms] (mean)
Time per request:       11670.112 [ms] (mean, across all concurrent requests)
Transfer rate:          0.13 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:      131  495 514.4    859     859
Processing:  9281 11178 2682.6  13074   13074
Waiting:     9275 11175 2686.4  13074   13074
Total:       9412 11672 3197.0  13933   13933

Percentage of the requests served within a certain time (ms)
  50%  13933
  66%  13933
  75%  13933
  80%  13933
  90%  13933
  95%  13933
  98%  13933
  99%  13933
 100%  13933 (longest request)

Statamic 2 with 5000 entries

On a blank template

$ ab -t 20 -c 100 https://statamic2.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic2.test (be patient)
Finished 57 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic2.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic2.test

Document Path:          /
Document Length:        3 bytes

Concurrency Level:      100
Time taken for tests:   20.087 seconds
Complete requests:      57
Failed requests:        0
Total transferred:      58692 bytes
HTML transferred:       171 bytes
Requests per second:    2.84 [#/sec] (mean)
Time per request:       35240.782 [ms] (mean)
Time per request:       352.408 [ms] (mean, across all concurrent requests)
Transfer rate:          2.85 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       76  911 159.6    942     947
Processing:   337 8403 5309.4   8121   18737
Waiting:      330 8399 5315.7   8121   18736
Total:        413 9314 5356.1   9061   19675

Percentage of the requests served within a certain time (ms)
  50%   8937
  66%  11717
  75%  13273
  80%  14234
  90%  17095
  95%  18982
  98%  19326
  99%  19675
 100%  19675 (longest request)

Statamic 2 with 100 entries

On a template listing 10 posts sorted by date.

Concurrency 1

$ ab -t 20 -c 1 https://statamic2.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic2.test (be patient)
Finished 161 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic2.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic2.test

Document Path:          /
Document Length:        484 bytes

Concurrency Level:      1
Time taken for tests:   20.047 seconds
Complete requests:      161
Failed requests:        0
Total transferred:      243301 bytes
HTML transferred:       77924 bytes
Requests per second:    8.03 [#/sec] (mean)
Time per request:       124.515 [ms] (mean)
Time per request:       124.515 [ms] (mean, across all concurrent requests)
Transfer rate:          11.85 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       10   13   7.0     11      92
Processing:   102  111  14.3    106     240
Waiting:      102  111  14.3    106     240
Total:        113  124  17.2    119     266

Percentage of the requests served within a certain time (ms)
  50%    119
  66%    122
  75%    125
  80%    127
  90%    143
  95%    155
  98%    165
  99%    200
 100%    266 (longest request)

Concurrency 100

$ ab -t 20 -c 100 https://statamic2.test/ 
This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic2.test (be patient)
Finished 255 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic2.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic2.test

Document Path:          /
Document Length:        484 bytes

Concurrency Level:      100
Time taken for tests:   20.020 seconds
Complete requests:      255
Failed requests:        0
Total transferred:      385369 bytes
HTML transferred:       123420 bytes
Requests per second:    12.74 [#/sec] (mean)
Time per request:       7851.067 [ms] (mean)
Time per request:       78.511 [ms] (mean, across all concurrent requests)
Transfer rate:          18.80 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       10  382 458.6     22    1190
Processing:   148 5786 2150.8   6393    9537
Waiting:      143 5786 2150.9   6393    9537
Total:        273 6168 1870.9   6488    9547

Percentage of the requests served within a certain time (ms)
  50%   6488
  66%   7101
  75%   7556
  80%   7685
  90%   8047
  95%   8192
  98%   8751
  99%   8979
 100%   9547 (longest request)

Statamic 3 with 5000 entries

On a template listing 10 posts sorted by date.

Concurrency 1

$ ab -t 20 -c 1 https://statamic3.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic3.test (be patient)
Finished 23 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic3.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic3.test

Document Path:          /
Document Length:        484 bytes

Concurrency Level:      1
Time taken for tests:   20.069 seconds
Complete requests:      23
Failed requests:        0
Total transferred:      33255 bytes
HTML transferred:       11132 bytes
Requests per second:    1.15 [#/sec] (mean)
Time per request:       872.570 [ms] (mean)
Time per request:       872.570 [ms] (mean, across all concurrent requests)
Transfer rate:          1.62 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       12   15   5.4     12      32
Processing:   769  858 188.4    800    1660
Waiting:      768  858 188.4    800    1659
Total:        780  872 190.6    813    1680

Percentage of the requests served within a certain time (ms)
  50%    808
  66%    834
  75%    841
  80%    850
  90%    981
  95%   1102
  98%   1680
  99%   1680
 100%   1680 (longest request)

Concurrency 20

$ ab -t 20 -c 20 https://statamic3.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic3.test (be patient)
Finished 54 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic3.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic3.test

Document Path:          /
Document Length:        484 bytes

Concurrency Level:      20
Time taken for tests:   20.010 seconds
Complete requests:      54
Failed requests:        0
Total transferred:      78150 bytes
HTML transferred:       26136 bytes
Requests per second:    2.70 [#/sec] (mean)
Time per request:       7411.051 [ms] (mean)
Time per request:       370.553 [ms] (mean, across all concurrent requests)
Transfer rate:          3.81 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       17   96  96.1     26     246
Processing:   932 5752 1876.1   6690    7744
Waiting:      931 5752 1876.1   6690    7744
Total:       1077 5849 1815.4   6721    7990

Percentage of the requests served within a certain time (ms)
  50%   6721
  66%   6832
  75%   6870
  80%   6943
  90%   7091
  95%   7200
  98%   7398
  99%   7990
 100%   7990 (longest request)

Concurrency 100

$ ab -t 20 -c 100 https://statamic3.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic3.test (be patient)
Finished 47 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic3.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic3.test

Document Path:          /
Document Length:        484 bytes

Concurrency Level:      100
Time taken for tests:   20.022 seconds
Complete requests:      47
Failed requests:        0
Total transferred:      67975 bytes
HTML transferred:       22748 bytes
Requests per second:    2.35 [#/sec] (mean)
Time per request:       42599.479 [ms] (mean)
Time per request:       425.995 [ms] (mean, across all concurrent requests)
Transfer rate:          3.32 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       68  609  80.7    621     624
Processing:   821 9693 5112.7   9638   18483
Waiting:      815 9693 5112.9   9638   18483
Total:        889 10302 5134.8  10260   19107

Percentage of the requests served within a certain time (ms)
  50%  10035
  66%  13587
  75%  14961
  80%  15572
  90%  17401
  95%  17793
  98%  19107
  99%  19107
 100%  19107 (longest request)

Statamic 3 with 5000 entries

On a blank template

$ ab -t 20 -c 100 https://statamic3.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic3.test (be patient)
Finished 85 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic3.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic3.test

Document Path:          /
Document Length:        3 bytes

Concurrency Level:      100
Time taken for tests:   20.001 seconds
Complete requests:      85
Failed requests:        0
Total transferred:      82116 bytes
HTML transferred:       255 bytes
Requests per second:    4.25 [#/sec] (mean)
Time per request:       23530.274 [ms] (mean)
Time per request:       235.303 [ms] (mean, across all concurrent requests)
Transfer rate:          4.01 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       78  843 149.6    834    1203
Processing:   410 9366 5258.7   9360   18244
Waiting:      405 9361 5265.9   9360   18244
Total:        534 10209 5331.2  10194   19444

Percentage of the requests served within a certain time (ms)
  50%  10097
  66%  12684
  75%  14884
  80%  15956
  90%  17422
  95%  18533
  98%  19165
  99%  19444
 100%  19444 (longest request)

Statamic 3 with 100 entries

On a template listing 10 posts sorted by date.

Concurrency 1

$ ab -t 20 -c 1 https://statamic3.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic3.test (be patient)
Finished 231 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic3.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic3.test

Document Path:          /
Document Length:        483 bytes

Concurrency Level:      1
Time taken for tests:   20.032 seconds
Complete requests:      231
Failed requests:        0
Total transferred:      333990 bytes
HTML transferred:       111573 bytes
Requests per second:    11.53 [#/sec] (mean)
Time per request:       86.718 [ms] (mean)
Time per request:       86.718 [ms] (mean, across all concurrent requests)
Transfer rate:          16.28 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       10   14   6.6     12      92
Processing:    57   73  16.7     67     172
Waiting:       57   73  16.7     67     172
Total:         68   87  19.2     80     186

Percentage of the requests served within a certain time (ms)
  50%     80
  66%     84
  75%     88
  80%     93
  90%    113
  95%    130
  98%    150
  99%    170
 100%    186 (longest request)

Concurrency 100

$ ab -t 20 -c 100 https://statamic3.test/

This is ApacheBench, Version 2.3 <$Revision: 1826891 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking statamic3.test (be patient)
Finished 400 requests


Server Software:        nginx/1.13.9
Server Hostname:        statamic3.test
Server Port:            443
SSL/TLS Protocol:       TLSv1.2,ECDHE-RSA-AES256-GCM-SHA384,2048,256
TLS Server Name:        statamic3.test

Document Path:          /
Document Length:        483 bytes

Concurrency Level:      100
Time taken for tests:   20.001 seconds
Complete requests:      400
Failed requests:        0
Total transferred:      578234 bytes
HTML transferred:       193200 bytes
Requests per second:    20.00 [#/sec] (mean)
Time per request:       5000.326 [ms] (mean)
Time per request:       50.003 [ms] (mean, across all concurrent requests)
Transfer rate:          28.23 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       16  304 512.1     23    1476
Processing:    74 4066 1229.9   4559    5263
Waiting:       69 4066 1230.6   4559    5263
Total:        169 4371 973.0   4616    5563

Percentage of the requests served within a certain time (ms)
  50%   4616
  66%   4732
  75%   5018
  80%   5069
  90%   5133
  95%   5168
  98%   5255
  99%   5369
 100%   5563 (longest request)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment