Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
root@rk3399-buster:~# lspci -vv -s 01:00.0
01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 (prog-if 02 [NVM Express])
Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 216
NUMA node: 0
Region 0: Memory at fa000000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [50] MSI: Enable- Count=1/32 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [70] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L0s unlimited, L1 <64us
ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Not Supported
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
Capabilities: [b0] MSI-X: Enable+ Count=8 Masked-
Vector table: BAR=0 offset=00003000
PBA: BAR=0 offset=00002000
Capabilities: [100 v2] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
Capabilities: [148 v1] Device Serial Number 00-00-00-00-00-00-00-00
Capabilities: [158 v1] Power Budgeting <?>
Capabilities: [168 v1] #19
Capabilities: [188 v1] Latency Tolerance Reporting
Max snoop latency: 0ns
Max no snoop latency: 0ns
Capabilities: [190 v1] L1 PM Substates
L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
PortCommonModeRestoreTime=10us PortTPowerOnTime=10us
L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
T_CommonMode=0us LTR1.2_Threshold=0ns
L1SubCtl2: T_PwrOn=10us
Kernel driver in use: nvme
lspci: Unable to load libkmod resources: error -12
root@rk3399-buster:~# cat samsung-960evo.fio
[global]
bs=1M
ioengine=libaio
iodepth=32
size=10g
direct=1
runtime=60
directory=/mnt
filename=test.file
[seq-read]
rw=read
stonewall
[rand-read]
rw=randread
stonewall
[seq-write]
rw=write
stonewall
[rand-write]
rw=randwrite
stonewall
root@rk3399-buster:~# fio -f samsung-960evo.fio
seq-read: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
rand-read: (g=1): rw=randread, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
seq-write: (g=2): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
rand-write: (g=3): rw=randwrite, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.1
Starting 4 processes
seq-read: Laying out IO file (1 file / 10240MiB)
3;fio-3.1;seq-read;0;0;10485760;1558293;1521;6729;161;1237;167.115829;35.570939;6976;40921;20826.539803;899.531116;1.000000%=20840;5.000000%=20840;10.000000%=20840;20.000000%=20840;30.000000%=20840;40.000000%=20840;50.000000%=20840;60.000000%=20840;70.000000%=20840;80.000000%=20840;90.000000%=20840;95.000000%=20840;99.000000%=21102;99.500000%=22675;99.900000%=34340;99.950000%=37486;99.990000%=40108;0%=0;0%=0;0%=0;7438;41083;20994.001220;886.367548;1056000;1547842;70.643283%;1100829.333333;140782.624476;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.431034%;26.426873%;10218;0;537;0.1%;0.1%;0.1%;0.1%;0.2%;99.7%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.13%;0.48%;99.39%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;nvme0n1;20480;20255;0;4;426296;587540;988680;96.92%
3;fio-3.1;rand-read;1;0;10485760;1557830;1521;6731;161;1175;167.098082;39.297614;6729;40547;20828.990146;1022.370619;1.000000%=20840;5.000000%=20840;10.000000%=20840;20.000000%=20840;30.000000%=20840;40.000000%=20840;50.000000%=20840;60.000000%=20840;70.000000%=20840;80.000000%=20840;90.000000%=20840;95.000000%=21102;99.000000%=21364;99.500000%=21626;99.900000%=33816;99.950000%=37486;99.990000%=40108;0%=0;0%=0;0%=0;6913;40711;20996.431082;1009.989374;1033859;1555015;70.989824%;1105900.769231;135350.974090;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.861813%;26.047548%;10199;0;535;0.1%;0.1%;0.1%;0.1%;0.2%;99.7%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.25%;0.44%;99.31%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;nvme0n1;20480;20255;0;4;426296;587540;988680;96.92%
3;fio-3.1;seq-write;2;0;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;10485760;1415464;1382;7408;304;18358;401.851726;183.501445;12747;43996;22712.398451;1607.196829;1.000000%=20578;5.000000%=21364;10.000000%=21626;20.000000%=21889;30.000000%=22151;40.000000%=22151;50.000000%=22675;60.000000%=22675;70.000000%=23199;80.000000%=23724;90.000000%=23986;95.000000%=24248;99.000000%=26345;99.500000%=30277;99.900000%=40108;99.950000%=41156;99.990000%=43253;0%=0;0%=0;0%=0;13098;44365;23115.448463;1604.699473;995761;1376232;74.533570%;1054995.857143;96577.590132;21.263670%;37.599568%;10168;0;9;0.1%;0.1%;0.1%;0.1%;0.2%;99.7%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.97%;99.03%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;nvme0n1;20480;20255;0;4;426296;587540;988680;96.92%
3;fio-3.1;rand-write;3;0;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;10485760;914110;892;11471;267;96801;410.508267;971.721895;11769;198763;35401.212757;27431.428081;1.000000%=21364;5.000000%=21889;10.000000%=22413;20.000000%=22937;30.000000%=23199;40.000000%=23724;50.000000%=24248;60.000000%=24510;70.000000%=24772;80.000000%=31588;90.000000%=101187;95.000000%=104333;99.000000%=107479;99.500000%=108527;99.900000%=170917;99.950000%=185597;99.990000%=196083;0%=0;0%=0;0%=0;12081;199207;35812.905239;27446.523885;303104;1374208;99.509115%;909622.772727;499415.141881;13.182214%;24.821273%;10182;0;9;0.1%;0.1%;0.1%;0.1%;0.2%;99.7%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.83%;85.38%;2.50%;11.29%;0.00%;0.00%;0.00%;0.00%;0.00%;nvme0n1;20480;20255;0;4;426296;587540;988680;96.92%
seq-read: (groupid=0, jobs=1): err= 0: pid=14486: Thu Dec 14 22:30:10 2017
read: IOPS=1521, BW=1522MiB/s (1596MB/s)(10.0GiB/6729msec)
slat (usec): min=161, max=1237, avg=167.12, stdev=35.57
clat (usec): min=6976, max=40921, avg=20826.54, stdev=899.53
lat (usec): min=7438, max=41083, avg=20994.00, stdev=886.37
clat percentiles (usec):
| 1.00th=[20841], 5.00th=[20841], 10.00th=[20841], 20.00th=[20841],
| 30.00th=[20841], 40.00th=[20841], 50.00th=[20841], 60.00th=[20841],
| 70.00th=[20841], 80.00th=[20841], 90.00th=[20841], 95.00th=[20841],
| 99.00th=[21103], 99.50th=[22676], 99.90th=[34341], 99.95th=[37487],
| 99.99th=[40109]
bw ( MiB/s): min= 1031, max= 1511, per=70.64%, avg=1075.03, stdev=137.48, samples=12
iops : min= 1031, max= 1511, avg=1074.58, stdev=137.45, samples=12
lat (msec) : 10=0.13%, 20=0.48%, 50=99.39%
cpu : usr=0.43%, sys=26.43%, ctx=10218, majf=0, minf=537
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=99.7%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwt: total=10240,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
rand-read: (groupid=1, jobs=1): err= 0: pid=14556: Thu Dec 14 22:30:10 2017
read: IOPS=1521, BW=1521MiB/s (1595MB/s)(10.0GiB/6731msec)
slat (usec): min=161, max=1175, avg=167.10, stdev=39.30
clat (usec): min=6729, max=40547, avg=20828.99, stdev=1022.37
lat (usec): min=6913, max=40711, avg=20996.43, stdev=1009.99
clat percentiles (usec):
| 1.00th=[20841], 5.00th=[20841], 10.00th=[20841], 20.00th=[20841],
| 30.00th=[20841], 40.00th=[20841], 50.00th=[20841], 60.00th=[20841],
| 70.00th=[20841], 80.00th=[20841], 90.00th=[20841], 95.00th=[21103],
| 99.00th=[21365], 99.50th=[21627], 99.90th=[33817], 99.95th=[37487],
| 99.99th=[40109]
bw ( MiB/s): min= 1009, max= 1518, per=70.99%, avg=1079.98, stdev=132.18, samples=13
iops : min= 1009, max= 1518, avg=1079.54, stdev=132.15, samples=13
lat (msec) : 10=0.25%, 20=0.44%, 50=99.31%
cpu : usr=0.86%, sys=26.05%, ctx=10199, majf=0, minf=535
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=99.7%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwt: total=10240,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
seq-write: (groupid=2, jobs=1): err= 0: pid=14625: Thu Dec 14 22:30:10 2017
write: IOPS=1382, BW=1382MiB/s (1449MB/s)(10.0GiB/7408msec)
slat (usec): min=304, max=18358, avg=401.85, stdev=183.50
clat (usec): min=12747, max=43996, avg=22712.40, stdev=1607.20
lat (usec): min=13098, max=44365, avg=23115.45, stdev=1604.70
clat percentiles (usec):
| 1.00th=[20579], 5.00th=[21365], 10.00th=[21627], 20.00th=[21890],
| 30.00th=[22152], 40.00th=[22152], 50.00th=[22676], 60.00th=[22676],
| 70.00th=[23200], 80.00th=[23725], 90.00th=[23987], 95.00th=[24249],
| 99.00th=[26346], 99.50th=[30278], 99.90th=[40109], 99.95th=[41157],
| 99.99th=[43254]
bw ( MiB/s): min= 972, max= 1343, per=74.53%, avg=1030.27, stdev=94.31, samples=14
iops : min= 972, max= 1343, avg=1029.79, stdev=94.17, samples=14
lat (msec) : 20=0.97%, 50=99.03%
cpu : usr=21.26%, sys=37.60%, ctx=10168, majf=0, minf=9
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=99.7%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwt: total=0,10240,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
rand-write: (groupid=3, jobs=1): err= 0: pid=14703: Thu Dec 14 22:30:10 2017
write: IOPS=892, BW=893MiB/s (936MB/s)(10.0GiB/11471msec)
slat (usec): min=267, max=96801, avg=410.51, stdev=971.72
clat (msec): min=11, max=198, avg=35.40, stdev=27.43
lat (msec): min=12, max=199, avg=35.81, stdev=27.45
clat percentiles (msec):
| 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 23],
| 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25],
| 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 102], 95.00th=[ 105],
| 99.00th=[ 108], 99.50th=[ 109], 99.90th=[ 171], 99.95th=[ 186],
| 99.99th=[ 197]
bw ( KiB/s): min=303104, max=1374208, per=99.51%, avg=909622.77, stdev=499415.14, samples=22
iops : min= 296, max= 1342, avg=888.27, stdev=487.74, samples=22
lat (msec) : 20=0.83%, 50=85.38%, 100=2.50%, 250=11.29%
cpu : usr=13.18%, sys=24.82%, ctx=10182, majf=0, minf=9
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=99.7%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwt: total=0,10240,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=1522MiB/s (1596MB/s), 1522MiB/s-1522MiB/s (1596MB/s-1596MB/s), io=10.0GiB (10.7GB), run=6729-6729msec
Run status group 1 (all jobs):
READ: bw=1521MiB/s (1595MB/s), 1521MiB/s-1521MiB/s (1595MB/s-1595MB/s), io=10.0GiB (10.7GB), run=6731-6731msec
Run status group 2 (all jobs):
WRITE: bw=1382MiB/s (1449MB/s), 1382MiB/s-1382MiB/s (1449MB/s-1449MB/s), io=10.0GiB (10.7GB), run=7408-7408msec
Run status group 3 (all jobs):
WRITE: bw=893MiB/s (936MB/s), 893MiB/s-893MiB/s (936MB/s-936MB/s), io=10.0GiB (10.7GB), run=11471-11471msec
Disk stats (read/write):
nvme0n1: ios=20480/20255, merge=0/4, ticks=426296/587540, in_queue=988680, util=96.92%
root@rk3399-buster:~#
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.