Skip to content

Instantly share code, notes, and snippets.

@jeffmccune
Last active September 23, 2020 17:26
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save jeffmccune/0f381a69e0a8111c3cac882911062923 to your computer and use it in GitHub Desktop.
Atom Gigabit ZFS encryption

Write:

tank% bash -x /data/media/fio-test /data/media/local-test
+ fio --filename=/data/media/local-test --name=write --ioengine=posixaio --rw=write --bs=128k --size=16GB --numjobs=1 --iodepth=128 --runtime=60 --time_based --group_reporting --eta-newline=1
write: (g=0): rw=write, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=posixaio, iodepth=128
fio-3.12
Starting 1 process
write: Laying out IO file (1 file / 16384MiB)
Jobs: 1 (f=1): [W(1)][6.6%][w=368MiB/s][w=2941 IOPS][eta 00m:57s]
Jobs: 1 (f=1): [W(1)][8.3%][w=179MiB/s][w=1432 IOPS][eta 00m:55s]
write: (groupid=0, jobs=1): err= 0: pid=31390: Wed Sep 23 10:22:48 2020
  write: IOPS=1475, BW=184MiB/s (193MB/s)(10.8GiB/60067msec); 0 zone resets
    slat (usec): min=3, max=116556, avg=19.47, stdev=423.46
    clat (usec): min=1337, max=450572, avg=85721.10, stdev=33765.43
     lat (usec): min=1349, max=450589, avg=85740.57, stdev=33764.36
    clat percentiles (msec):
     |  1.00th=[   16],  5.00th=[   26], 10.00th=[   51], 20.00th=[   78],
     | 30.00th=[   81], 40.00th=[   84], 50.00th=[   86], 60.00th=[   88],
     | 70.00th=[   91], 80.00th=[   96], 90.00th=[  106], 95.00th=[  125],
     | 99.00th=[  222], 99.50th=[  251], 99.90th=[  447], 99.95th=[  447],
     | 99.99th=[  451]
   bw (  KiB/s): min=65536, max=759552, per=99.84%, avg=188610.36, stdev=75135.75, samples=120
   iops        : min=  512, max= 5934, avg=1473.40, stdev=587.02, samples=120
  lat (msec)   : 2=0.02%, 4=0.06%, 10=0.04%, 20=2.55%, 50=7.33%
  lat (msec)   : 100=74.88%, 250=14.55%, 500=0.56%
  cpu          : usr=2.55%, sys=0.26%, ctx=9834, majf=0, minf=45
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=2.2%, 16=8.3%, 32=24.8%, >=64=64.6%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=98.7%, 8=0.2%, 16=0.2%, 32=0.2%, 64=0.1%, >=64=0.7%
     issued rwts: total=0,88649,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=128

Run status group 0 (all jobs):
  WRITE: bw=184MiB/s (193MB/s), 184MiB/s-184MiB/s (193MB/s-193MB/s), io=10.8GiB (11.6GB), run=60067-60067msec

ZFS Properties:

tank% sudo zfs get all data/media
NAME        PROPERTY              VALUE                                   SOURCE
data/media  type                  filesystem                              -
data/media  creation              Thu Jul 16 14:47 2020                   -
data/media  used                  7.46T                                   -
data/media  available             34.6T                                   -
data/media  referenced            7.46T                                   -
data/media  compressratio         1.00x                                   -
data/media  mounted               yes                                     -
data/media  quota                 none                                    default
data/media  reservation           none                                    default
data/media  recordsize            128K                                    default
data/media  mountpoint            /data/media                             default
data/media  sharenfs              no_root_squash,async,rw=192.168.2.0/24  local
data/media  checksum              on                                      default
data/media  compression           off                                     default
data/media  atime                 on                                      default
data/media  devices               on                                      default
data/media  exec                  on                                      default
data/media  setuid                on                                      default
data/media  readonly              off                                     default
data/media  zoned                 off                                     default
data/media  snapdir               hidden                                  default
data/media  aclinherit            restricted                              default
data/media  createtxg             22                                      -
data/media  canmount              on                                      default
data/media  xattr                 sa                                      local
data/media  copies                1                                       default
data/media  version               5                                       -
data/media  utf8only              off                                     -
data/media  normalization         none                                    -
data/media  casesensitivity       sensitive                               -
data/media  vscan                 off                                     default
data/media  nbmand                off                                     default
data/media  sharesmb              on                                      local
data/media  refquota              none                                    default
data/media  refreservation        none                                    default
data/media  guid                  10802685748294043327                    -
data/media  primarycache          all                                     default
data/media  secondarycache        all                                     default
data/media  usedbysnapshots       0B                                      -
data/media  usedbydataset         7.46T                                   -
data/media  usedbychildren        0B                                      -
data/media  usedbyrefreservation  0B                                      -
data/media  logbias               latency                                 default
data/media  objsetid              89                                      -
data/media  dedup                 off                                     default
data/media  mlslabel              none                                    default
data/media  sync                  standard                                default
data/media  dnodesize             auto                                    local
data/media  refcompressratio      1.00x                                   -
data/media  written               7.46T                                   -
data/media  logicalused           7.46T                                   -
data/media  logicalreferenced     7.46T                                   -
data/media  volmode               default                                 default
data/media  filesystem_limit      none                                    default
data/media  snapshot_limit        none                                    default
data/media  filesystem_count      none                                    default
data/media  snapshot_count        none                                    default
data/media  snapdev               hidden                                  default
data/media  acltype               off                                     default
data/media  context               none                                    default
data/media  fscontext             none                                    default
data/media  defcontext            none                                    default
data/media  rootcontext           none                                    default
data/media  relatime              off                                     default
data/media  redundant_metadata    all                                     default
data/media  overlay               off                                     default
data/media  encryption            aes-256-gcm                             -
data/media  keylocation           file:///etc/zfs/passphrase.media        local
data/media  keyformat             passphrase                              -
data/media  pbkdf2iters           342K                                    -
data/media  encryptionroot        data/media                              -
data/media  keystatus             available                               -
data/media  special_small_blocks  0                                       default
processor       : 7
vendor_id       : GenuineIntel
cpu family      : 6
model           : 77
model name      : Intel(R) Atom(TM) CPU  C2758  @ 2.40GHz
stepping        : 8
microcode       : 0x127
cpu MHz         : 2400.000
cache size      : 1024 KB
physical id     : 14
siblings        : 1
core id         : 0
cpu cores       : 1
apicid          : 14
initial apicid  : 14
fpu             : yes
fpu_exception   : yes
cpuid level     : 11
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx rdtscp lm constant_tsc arch_perfmon nopl xtopology tsc_reliable nonstop_tsc cpuid pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes rdrand hypervisor lahf_lm 3dnowprefetch cpuid_fault pti tsc_adjust smep arat
bugs            : cpu_meltdown spectre_v1 spectre_v2 mds msbds_only
bogomips        : 4800.00
clflush size    : 64
cache_alignment : 64
address sizes   : 43 bits physical, 48 bits virtual
power management:
@jeffmccune
Copy link
Author

jeffmccune commented Sep 23, 2020

Screen Shot 2020-09-23 at 10 24 37 AM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment