Skip to content

Instantly share code, notes, and snippets.

@li-ch

li-ch/switch40g.md

Created May 11, 2017 09:13
Show Gist options
  • Save li-ch/7ae7e30b7c69e0867240df4912a1ff0c to your computer and use it in GitHub Desktop.
Save li-ch/7ae7e30b7c69e0867240df4912a1ff0c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
switch40g.md

Configuring Mellanox Switches

  1. Login to management console using admin:admin
  2. enable
  3. configure terminal
  4. vlan ### ### is the VLAN id, we use 198 and 199.
  5. Then the terminal will enter VLAN configuration mode, we set name to vlan### with name ###
  6. exit VLAN configuration mode
  7. Configure connect ports. For switch with VLAN 199, ethernet ports 1/1, 1/3, 1/5, 1/7 are connected to each server's eth2. For switch with VLAN 198 ethernet ports 1/10, 1/12, 1/14, 1/16 are connected to each server's eth3.

For each connected port, do the following:

switch (config) # interface ethernet 1/1 switchport mode hybrid
switch (config) # interface ethernet 1/1 switchport hybrid allowed-vlan all

Do not configure ports to trunk mode. Won't work!

  1. Disable flow control (disbled by default):
switch (config) # interface ethernet 1/1-1/2 flowcontrol send off force
switch (config) # interface ethernet 1/1-1/2 flowcontrol receive off force
  1. Enable PFC on priority 3
switch (config) # dcb priority-flow-control enable
This action might cause traffic loss while shutting down a port with priority-flow-control mode on
Type 'yes' to confirm  enable pfc globally: yes
switch (config) # dcb priority-flow-control priority 3 enable
switch (config) # interface ethernet 1/1-1/2 dcb priority-flow-control mode on force
  1. Configure the NICs following Mellanox documentation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment