Skip to content

Instantly share code, notes, and snippets.

@shvchk
Created September 24, 2023 23:52
Show Gist options
  • Save shvchk/0bdf2754f6b4505d2b2a32002edc9df0 to your computer and use it in GitHub Desktop.
Save shvchk/0bdf2754f6b4505d2b2a32002edc9df0 to your computer and use it in GitHub Desktop.

Launch

Wireguard

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3744992   3667684    102636      2,58      3392     73012    440220     11,06    120340      9280       184     57282     55428      3040      2664     16260

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3706116   3645659    106890      2,69     11680     98298    464403     11,67    137454     26687       830     58196     56476      2986      2747     16571

Netbird

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3737908   3660688    108840      2,74      2984     73704    448816     11,28    121714      8840         3     57924     56024      2928      2680     16868

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3666520   3616885    124209      3,12     10968    120761    624505     15,69    192173     18930       564     83425     57002      3344      3189     17415

Zerotier

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3708612   3640062    119855      3,01      2338     91630    599478     15,06    148366      9050       162     67480     57026      3181      3147     17306

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3687964   3627326    124550      3,13      7634    102175    656586     16,50    167306     14908       190     76432     57137      3638      3365     17742

Tailscale

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3710296   3641886    117715      2,96      2465     91852    593028     14,90    148903      9134        65     67789     57132      3184      3132     17316

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3644470   3593121    148182      3,72      8666    119236    715554     17,98    197360     20663        90     94106     58905      3421      3426     17890

iperf3 tests

Raw

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3646552   3588970    157674      3,96      2702    113460    777552     19,54    200256      9390       152     97532     59072      3686      3560     17790

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      1,03      0,00     14,01      0,03      1,31      0,00     10,50      0,00      0,00     73,11

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3639357   3582326    163802      4,12      3624    113600    777680     19,54    200264     10362         3     97404     59077      3712      3560     17784

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3639316   3582765    162934      4,09      4389    113796    777552     19,54    200296     11204         2     97326     59025      3712      3560     17800

Performance: 10.1 Gbits/sec

Wireguard

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3638512   3580907    165185      4,15      2751    113388    777824     19,55    200377      9467        29     97745     59624      3840      3568     17960

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      0,27      0,00     24,78      0,01     36,15      0,00     15,51      0,00      0,00     23,27

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3637662   3580605    164296      4,13      3693    113524    778084     19,55    200849     10434        19     98083     60286      3853      3560     17966

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3640606   3583581    162061      4,07      3887    113394    777956     19,55    200870     10626         4     98238     59512      3872      3568     17976

Performance: 988 Mbits/sec

Netbird

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3642876   3585215    161082      4,05      2614    113424    778088     19,55    200970      9330       178     98279     59464      3824      3564     17912

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      0,30      0,00     24,39      0,01     34,96      0,00     16,32      0,00      0,00     24,02

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3634490   3577458    167591      4,21      3733    113556    778258     19,56    201338     10460         4     98519     60090      3834      3564     17928

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3650956   3593934    151443      3,81      3873    113428    778228     19,56    201155     10609         0     98508     59760      3834      3556     17938

Performance: 946 Mbits/sec

Tailscale

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3646128   3580917    174586      4,39      5258     95535    588224     14,78    174085     31168        30    108524     57948      3632      3136     17616

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all     20,68      0,00     13,69      0,03     25,94      0,00      4,85      0,00      0,00     34,81

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3503088   3438454    316256      7,95      5918     95965    723595     18,18    272317     72827        60    247306     58228      3648      3404     17632

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3490600   3426122    328456      8,25      6061     96108    735874     18,49    193460    163968       175    259254     58231      3648      3428     17632

Performance: 935 Mbits/sec

Zerotier

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3647432   3580048    177354      4,46      2615     94048    744212     18,70    172723     43970       132    124032     58007      3456      3428     17456

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      8,50      0,00     23,21      0,04     22,06      0,00      5,19      0,00      0,00     41,00

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3635624   3568937    187758      4,72      3812     94245    744353     18,70    173557     45170        63    124679     58018      3456      3432     17446

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3633988   3567441    189214      4,75      3998     94116    744344     18,70    173382     45355        58    124652     58140      3440      3428     17440

Performance: 414 Mbits/sec


iperf3 bidirectional tests

Raw

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3639698   3572488    184781      4,64      2713     94099    744608     18,71    173675     44063        63    124964     58166      3424      3428     17424

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      0,79      0,00     16,52      0,04      1,32      0,00      7,32      0,00      0,00     74,01

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3625718   3559232    197235      4,96      3838     94406    744864     18,72    174280     45196        10    125234     58259      3426      3428     17424

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3640704   3574472    181720      4,57      4269     94488    744608     18,71    174057     45700         7    125032     58275      3424      3428     17424

Performance:

[  5][TX-C]   0.00-90.00  sec  38.2 GBytes  3.64 Gbits/sec    0             sender
[  7][RX-C]   0.00-90.00  sec  66.8 GBytes  6.38 Gbits/sec    0             sender

Wireguard

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3666140   3608799    136997      3,44     11443    105131    640367     16,09    174088     18630       593     80156     59745      3648      3376     18120

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      0,31      0,00     24,72      0,01     37,52      0,00     13,86      0,00      0,00     23,58

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3651680   3594589    149795      3,76     11699    105400    640743     16,10    174678     18867         5     80528     60882      3664      3380     18104

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3655144   3598007    146941      3,69     11829    105142    640584     16,10    174231     19022         7     80372     60400      3664      3384     18088

Performance:

[  5][TX-C]   0.00-90.00  sec  8.17 GBytes   780 Mbits/sec  986             sender
[  7][RX-C]   0.00-90.00  sec  2.61 GBytes   249 Mbits/sec    0             sender

Netbird

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3636236   3578866    166064      4,17      2692    114180    704800     17,71    204857      9394       171    101406     60284      3760      3532     18264

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      0,24      0,00     21,92      0,01     40,36      0,00     14,74      0,00      0,00     22,72

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3627642   3571073    172149      4,33      4005    114458    705135     17,72    205164     10740        20    101462     61202      3824      3536     18296

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3631992   3575356    168344      4,23      4118    114202    704932     17,71    204598     10860        22    101177     60800      3824      3536     18296

Performance:

[  5][TX-C]   0.00-90.00  sec  5.67 GBytes   541 Mbits/sec  848             sender
[  7][RX-C]   0.00-90.00  sec  3.27 GBytes   312 Mbits/sec    0             sender

Tailscale

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3641408   3574145    182855      4,59      2213     94698    745624     18,74    175111     43696        23    125916     58282      3440      3432     17780

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all     10,34      0,00     12,51      0,05     33,27      0,00      2,01      0,00      0,00     41,82

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3517206   3450903    304728      7,66      3785     95042    745880     18,74    269679     61990        76    236960     58695      3461      3440     17780

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3505877   3439626    316050      7,94      3906     94786    745624     18,74    182698    165840        15    253863     58836      3472      3444     17796

Performance:

[  5][TX-C]   0.00-90.00  sec  1.23 GBytes   118 Mbits/sec  2237             sender
[  7][RX-C]   0.00-90.00  sec  3.15 GBytes   300 Mbits/sec    0             sender

Zerotier

Before:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3721948   3645557    120223      3,02      2057     75872    494896     12,44    134290      7962        18     68367     59364      3456      2932     17776

During test:

Average:        CPU      %usr     %nice      %sys   %iowait    %steal      %irq     %soft    %guest    %gnice     %idle
Average:        all      8,58      0,00     22,04      0,05     21,79      0,00      1,43      0,00      0,00     46,11

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3715496   3640178    124277      3,12      3853     76213    495258     12,45    135461      9805        27     69234     59624      3456      2928     17776

After:

Average:    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
Average:      3719280   3643936    120551      3,03      4037     75964    495140     12,44    135111      9996         2     69154     59632      3456      2932     17760

Performance:

[  5][TX-C]   0.00-90.00  sec  1.28 GBytes   122 Mbits/sec  1140             sender
[  7][RX-C]   0.00-90.00  sec  3.75 GBytes   358 Mbits/sec  4120             sender
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment