Skip to content

Instantly share code, notes, and snippets.

View Michaelvll's full-sized avatar

Zhanghao Wu Michaelvll

  • Sky Computing Lab, UC Berkeley
  • Berkeley, CA
View GitHub Profile
@Michaelvll
Michaelvll / lite-transformer-pruning.yaml
Created August 13, 2020 02:31
Pruning configuration for Lite Transformer with NervanaSystems/distiller
pruners:
my_pruner:
class: 'SensitivityPruner'
sensitivities:
'encoder.layers.0.self_attn.branches.0.k_proj.weight': 0.8
'encoder.layers.0.self_attn.branches.0.v_proj.weight': 0.8
'encoder.layers.0.self_attn.branches.0.q_proj.weight': 0.8
'encoder.layers.0.self_attn.branches.0.out_proj.weight': 0.8
'encoder.layers.0.self_attn.branches.1.weight_linear.weight': 0.8
'encoder.layers.0.self_attn.branches.1.linear1.weight': 0.4
@Michaelvll
Michaelvll / Makefile
Last active November 17, 2018 05:01
Makefile for *.s assemble to or *.cpp compile to inst_rom.mem
# By MW
CROSS_COMPILE = riscv32-unknown-elf-
CXX = $(CROSS_COMPILE)g++
C = $(CROSS_COMPILE)gcc
CXXFLAGS = -march=rv32i -mabi=ilp32 -c -O2
CFLAGS = -march=rv32i -mabi=ilp32 -c -O2
AS = $(CROSS_COMPILE)as
AS_FLAGS = -march=rv32i
LD = $(CROSS_COMPILE)ld