zilunpeng/get_teacher_wav2vec2_prob.py

Created March 23, 2021 21:16

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/zilunpeng/50ba4243c5a8641cf85f87b838f9e89a.js"></script>
Save zilunpeng/50ba4243c5a8641cf85f87b838f9e89a to your computer and use it in GitHub Desktop.

Download ZIP

Get teacher model's probability distribution. Code below is part of the knowledge distillation toolkit (https://git.io/JYePf).

Raw

get_teacher_wav2vec2_prob.py

	with torch.no_grad():
	teacher_net_output = self.teacher_model(*batch)
	teacher_prob = teacher_net_output["prob"]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment