Skip to content

Instantly share code, notes, and snippets.

@SteVwonder
Created July 24, 2018 20:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save SteVwonder/1af65a6529e19001f6ca839f543877fb to your computer and use it in GitHub Desktop.
Save SteVwonder/1af65a6529e19001f6ca839f543877fb to your computer and use it in GitHub Desktop.
# herbein1 at sierra4361 in /nfs/tmp2/herbein1/sierra-test [13:42:17]
→ bsub -nnodes 1 -G guests -Is jsrun -n1 --bind=none taskset -c 0-87 bash -c 'CUDA_VISIBLE_DEVICES=0,1,2,3 CUDA_DEVICE_ORDER=PCI_BUS_ID hwloc-ls --restrict binding'
Job <143722> is submitted to default queue <pbatch>.
<<Waiting for dispatch ...>>
<<Starting on sierra4369>>
Machine (128GB total) + Group0 L#0 + NUMANode L#0 (P#0 128GB) [80/18667]
Package L#0
L3 L#0 (10MB) + L2 L#0 (512KB)
L1d L#0 (32KB) + L1i L#0 (32KB) + Core L#0
PU L#0 (P#0)
PU L#1 (P#1)
PU L#2 (P#2)
PU L#3 (P#3)
L1d L#1 (32KB) + L1i L#1 (32KB) + Core L#1
PU L#4 (P#4)
PU L#5 (P#5)
PU L#6 (P#6)
PU L#7 (P#7)
L3 L#1 (10MB) + L2 L#1 (512KB)
L1d L#2 (32KB) + L1i L#2 (32KB) + Core L#2
PU L#8 (P#8)
PU L#9 (P#9)
PU L#10 (P#10)
PU L#11 (P#11)
L1d L#3 (32KB) + L1i L#3 (32KB) + Core L#3
PU L#12 (P#12)
PU L#13 (P#13)
PU L#14 (P#14)
PU L#15 (P#15)
L3 L#2 (10MB) + L2 L#2 (512KB)
L1d L#4 (32KB) + L1i L#4 (32KB) + Core L#4
PU L#16 (P#16)
PU L#17 (P#17)
PU L#18 (P#18)
PU L#19 (P#19)
L1d L#5 (32KB) + L1i L#5 (32KB) + Core L#5
PU L#20 (P#20)
PU L#21 (P#21)
PU L#22 (P#22)
PU L#23 (P#23)
L3 L#3 (10MB) + L2 L#3 (512KB) + L1d L#6 (32KB) + L1i L#6 (32KB) + Core L#6
PU L#24 (P#24)
PU L#25 (P#25)
PU L#26 (P#26)
PU L#27 (P#27)
L3 L#4 (10MB) + L2 L#4 (512KB)
L1d L#7 (32KB) + L1i L#7 (32KB) + Core L#7
PU L#28 (P#28)
PU L#29 (P#29)
PU L#30 (P#30)
PU L#31 (P#31)
L1d L#8 (32KB) + L1i L#8 (32KB) + Core L#8
PU L#32 (P#32)
PU L#33 (P#33)
PU L#34 (P#34)
PU L#35 (P#35)
L3 L#5 (10MB) + L2 L#5 (512KB)
L1d L#9 (32KB) + L1i L#9 (32KB) + Core L#9
PU L#36 (P#36)
PU L#37 (P#37)
PU L#38 (P#38)
PU L#39 (P#39)
L1d L#10 (32KB) + L1i L#10 (32KB) + Core L#10
PU L#40 (P#40)
PU L#41 (P#41)
PU L#42 (P#42)
PU L#43 (P#43)
L3 L#6 (10MB) + L2 L#6 (512KB)
L1d L#11 (32KB) + L1i L#11 (32KB) + Core L#11
PU L#44 (P#44)
PU L#45 (P#45)
PU L#46 (P#46)
PU L#47 (P#47)
L1d L#12 (32KB) + L1i L#12 (32KB) + Core L#12
PU L#48 (P#48)
PU L#49 (P#49)
PU L#50 (P#50)
PU L#51 (P#51)
L3 L#7 (10MB) + L2 L#7 (512KB) + L1d L#13 (32KB) + L1i L#13 (32KB) + Core L#13
PU L#52 (P#52)
PU L#53 (P#53)
PU L#54 (P#54)
PU L#55 (P#55)
L3 L#8 (10MB) + L2 L#8 (512KB)
L1d L#14 (32KB) + L1i L#14 (32KB) + Core L#14
PU L#56 (P#56)
PU L#57 (P#57)
PU L#58 (P#58)
PU L#59 (P#59)
L1d L#15 (32KB) + L1i L#15 (32KB) + Core L#15
PU L#60 (P#60)
PU L#61 (P#61)
PU L#62 (P#62)
PU L#63 (P#63)
L3 L#9 (10MB) + L2 L#9 (512KB)
L1d L#16 (32KB) + L1i L#16 (32KB) + Core L#16
PU L#64 (P#64)
PU L#65 (P#65)
PU L#66 (P#66)
PU L#67 (P#67)
L1d L#17 (32KB) + L1i L#17 (32KB) + Core L#17
PU L#68 (P#68)
PU L#69 (P#69)
PU L#70 (P#70)
PU L#71 (P#71)
L3 L#10 (10MB) + L2 L#10 (512KB)
L1d L#18 (32KB) + L1i L#18 (32KB) + Core L#18
PU L#72 (P#72)
PU L#73 (P#73)
PU L#74 (P#74)
PU L#75 (P#75)
L1d L#19 (32KB) + L1i L#19 (32KB) + Core L#19
PU L#76 (P#76)
PU L#77 (P#77)
PU L#78 (P#78)
PU L#79 (P#79)
L3 L#11 (10MB) + L2 L#11 (512KB)
L1d L#20 (32KB) + L1i L#20 (32KB) + Core L#20
PU L#80 (P#80)
PU L#81 (P#81)
PU L#82 (P#82)
PU L#83 (P#83)
L1d L#21 (32KB) + L1i L#21 (32KB) + Core L#21
PU L#84 (P#84)
PU L#85 (P#85)
PU L#86 (P#86)
PU L#87 (P#87)
HostBridge L#0
PCIBridge
PCI 144d:a822
Block(Disk) L#0 "nvme0n1"
HostBridge L#2
PCIBridge
PCIBridge
PCI 1a03:2000
GPU L#1 "card4"
GPU L#2 "controlD68"
HostBridge L#5
PCIBridge
PCI 15b3:1019
Net L#3 "hsi0"
OpenFabrics L#4 "mlx5_0"
PCI 15b3:1019
Net L#5 "hsi1"
OpenFabrics L#6 "mlx5_1"
HostBridge L#7
PCIBridge
PCIBridge
PCIBridge
PCI 1b4b:9235
PCIBridge
PCI 10de:1db1
GPU L#7 "renderD128"
GPU L#8 "card0"
CoProc L#9 "cuda0"
PCIBridge
PCI 10de:1db1
GPU L#10 "card1"
GPU L#11 "renderD129"
CoProc L#12 "cuda1"
HostBridge L#13
PCIBridge
PCI 14e4:1657
Net L#13 "enP5p1s0f0"
PCI 14e4:1657
Net L#14 "enP5p1s0f1"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment