Skip to content

Instantly share code, notes, and snippets.

@FlorianHeigl
Last active September 21, 2020 12:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save FlorianHeigl/934d86b96cbba25cf6d42c09f262784b to your computer and use it in GitHub Desktop.
Save FlorianHeigl/934d86b96cbba25cf6d42c09f262784b to your computer and use it in GitHub Desktop.
can't get CSD to show higher capacity anymore

System OV

[root@wwdbemame pkg]# uname -a
Linux wwdbemame.internal.triasoft.de 4.18.0-193.19.1.el8_2.x86_64 #1 SMP Mon Sep 14 14:37:00 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
[root@wwdbemame pkg]# rpm -aq  | grep -e CSD -e sfx
sfx3xdriver-src-3.2.1.0-52500.el8.x86_64
CSD2000-U2-04759-0.x86_64
[root@wwdbemame ~]# sfx-nvme sfx query-cap /dev/sfdv0n1 
logic            capacity: 3840GB(0x1bf1f72b0)
provisioned      capacity: 3840GB(0x1bf1f72b0)
free provisioned capacity: 3840GB(0x1bf1f72b0)
used provisioned capacity:    0GB(0x0)
[root@wwdbemame ~]# sfx-nvme sfx change-cap /dev/sfdv0n1 -c 5000 -f 
5000G 0B 1220942646 4K
NVME IO command error:INVALID_FIELD: A reserved coded value or an unsupported value in a defined field(4002)
[root@wwdbemame pkg]# cat /etc/scaleflux/sfxparam 
drv use_intx=0
drv sfx_cc=CCSS
drv support_fw_vers=4759

adding the old blk_capacity

[root@wwdbemame pkg]# vi /etc/scaleflux/sfxparam
drv use_intx=0
drv sfx_cc=CCSS
drv support_fw_vers=4759
blk capacity=6400

Added -f just for despair

[root@wwdbemame pkg]# sfx-nvme sfx change-cap /dev/sfdv0n1 -c 6400 -f 
6400G 0B 1562805846 4K
NVME IO command error:INVALID_FIELD: A reserved coded value or an unsupported value in a defined field(4002)

I didn't find a way to still enable atomic write mode. You can see the capacities are default.

[root@wwdbemame pkg]# sfx-status 

SFX card: /dev/sfdv0n1
PCIe Vendor ID:                    0xcc53                             
PCIe Subsystem Vendor ID:          0xcc53                             
Manufacturer:                      ScaleFlux                          
Model:                             CSD 2000 Series                    
Serial Number:                     UC1945A7118M                       
OPN:                               CSDU3RF040B1                       
FPGA BitStream:                    4759                               
Drive Type:                        U.2-V                              
Software Revision:                 3.2.1.0-52500                      
Temperature:                       41 C                               
Power Consumption:                 0 W                                
Atomic Write mode:                 OFF                                
Percentage Used:                   0%                                 
Data Read:                         5026 GiB                           
Data Written:                      2776 GiB                           
Correctable Error Cnt:             0                                  
Uncorrectable Error Cnt:           0                                  
PCIe Link Status:                  Gen2 x4                            
PCIe Device Status:                Good                               
Formatted Capacity:                3840 GB                            
Provisioned Capacity:              3840 GB                            
Compression Ratio:                 100%                               
Physical Used Ratio:               0%                                 
Critical Warning:                  0                                  
[root@wwdbemame pkg]# sfx-logs 
[ Scan PCIe Bus		] Found 1 CSS device(s)
[ Host OS		] OS (Centos)
[ Host OS		] Kernel (4.18.0-193.19.1.el8_2.x86_64)
[ Check NVMe CLI	] Installed (nvme version 1.9)
[ Check tuned-adm	] Found (tuned-adm 2.13.0)
[ Check numactl		] Installed
[ Scan CSS Drive(s)	] Found 1 Vanda drive(s)
[ Get System Logs	] Completed
[ Get tuned-adm info	] Completed
[ Get numactl info	] Completed
[ Get CSS mod info	] Completed
[ Get Proc Interrupts 	] Completed
[ Get DMI Tables	] Completed
[ Get System Info	] Completed
[ Get sfx_messages	] Completed
[ NVMe page 0xcc sfdv0n1	] Completed
[ NVMe page 0x02 sfdv0n1	] Completed
[ NVMe page 0xc2 sfdv0n1	] Completed
[ NVMe page 0x03 sfdv0n1	] Completed
[ NVMe page 0xc4 sfdv0n1	] Completed
[ NVMe page 0xC6 sfdv0n1	] Completed
[ NVMe SMART LOG sfdv0n1	] Completed
[ NVMe FW-LOG    sfdv0n1	] Completed
[ Parsing NVMe 	 sfdv0n1 ] Completed
[ System Block 	 sfdv0n1 ] Completed
[ Get add_random sfdv0n1	] Completed
[ Get nr_request sfdv0n1	] Completed
[ Get rotational sfdv0n1	] Completed
[ Get rq_affinit sfdv0n1	] Completed
[ Get scheduler  sfdv0n1	] Completed
[ Block Dev      sfdv0n1	] Completed
[ SFX Dbg Info   sfdv0n1	] Gathering 
[     blk_ftl_coherency	] Completed
[     blk_ftl_gc	] Completed
[     blk_ftl_mim	] Completed
[     blk_ftl_perf	] Completed
[     blk_ftl_schedule	] Completed
[     ccs_map		] Completed
[     ccs_nvme		] Completed
[     ccs_stats		] Completed
[     ccs_perf_debug	] Completed
[     ccs_sblock	] Completed
[     ccs_snapshot	] Completed
[     ccs_write_session	] Completed
[ SFX Dbg Info   sfdv0n1	] Completed
[ FPGA passthru  sfdv0n1	] Skipped
[ Call Stack 		] Completed
[root@wwdbemame pkg]# sfx-nvme sfx change-cap /dev/sfdv0n1 -c 6400 -f 
6400G 0B 1562805846 4K
NVME IO command error:INVALID_FIELD: A reserved coded value or an unsupported value in a defined field(4002)
[root@wwdbemame pkg]# sfx-
sfx-action       sfx-diag-perf    sfx-fsb          sfx-fwdownload   sfx-logs         sfx-nvme         sfx-performance  sfx-powerdown    sfx-thermal      
sfx-cpu-usage    sfx-filesize     sfx-functions    sfx-ledctl       sfx-name-rules   sfx-pcimem       sfx-pincpu       sfx-status       
[root@wwdbemame pkg]# sfx-
sfx-action       sfx-diag-perf    sfx-fsb          sfx-fwdownload   sfx-logs         sfx-nvme         sfx-performance  sfx-powerdown    sfx-thermal      
sfx-cpu-usage    sfx-filesize     sfx-functions    sfx-ledctl       sfx-name-rules   sfx-pcimem       sfx-pincpu       sfx-status       
[root@wwdbemame pkg]# sfx-performance 
Found Tuned installed. Continue with enabling performance profile on this system? (Y/N) y
Performance settings already configured.
[root@wwdbemame pkg]# sfx-status 

SFX card: /dev/sfdv0n1
PCIe Vendor ID:                    0xcc53                             
PCIe Subsystem Vendor ID:          0xcc53                             
Manufacturer:                      ScaleFlux                          
Model:                             CSD 2000 Series                    
Serial Number:                     UC1945A7118M                       
OPN:                               CSDU3RF040B1                       
FPGA BitStream:                    4759                               
Drive Type:                        U.2-V                              
Software Revision:                 3.2.1.0-52500                      
Temperature:                       41 C                               
Power Consumption:                 0 W                                
Atomic Write mode:                 OFF                                
Percentage Used:                   0%                                 
Data Read:                         5026 GiB                           
Data Written:                      2776 GiB                           
Correctable Error Cnt:             0                                  
Uncorrectable Error Cnt:           0                                  
PCIe Link Status:                  Gen2 x4                            
PCIe Device Status:                Good                               
Formatted Capacity:                3840 GB                            
Provisioned Capacity:              3840 GB                            
Compression Ratio:                 100%                               
Physical Used Ratio:               0%                                 
Critical Warning:                  0       

cleaned up log for power cycle & all, no good

[root@wwdbemame pkg]# sfx-fwdownload -a -c -y /opt/scaleflux/FPGA/CSDU3RF_04759.bin 
Download image on /dev/sfxv0 starts, it will take several minutes...
You may use 'dmesg' to view the progress of download.
Firmware download success
Image for /dev/sfxv0 is downloaded successfully.
Download Done
No support of firmware activation without reset for Intel S5520UR 
Please power off, wait for 10 seconds, and power on the system after this script finishes.
[root@wwdbemame pkg]# poweroff
Connection to 192.168.200.159 closed by remote host.
Connection to 192.168.200.159 closed.
[root@wwdbemame pkg]# sfx-fwdownload -a -c -y /opt/scaleflux/FPGA/CSDU3RF_04759.bin 
Download image on /dev/sfxv0 starts, it will take several minutes...
You may use 'dmesg' to view the progress of download.
Firmware download success
Image for /dev/sfxv0 is downloaded successfully.
Download Done
No support of firmware activation without reset for Intel S5520UR 
Please power off, wait for 10 seconds, and power on the system after this script finishes.
[root@wwdbemame pkg]# poweroff
Connection to 192.168.200.159 closed by remote host.
Connection to 192.168.200.159 closed.
@FlorianHeigl
Copy link
Author

I looked through linux-nvme/nvme-cli@876ad92 and it should be the right approach

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment