1pha/L2_Regularization.py

Created December 9, 2020 07:37

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/1pha/605ea9571998dfaede0b7610ad1e2de8.js"></script>
Save 1pha/605ea9571998dfaede0b7610ad1e2de8 to your computer and use it in GitHub Desktop.

Download ZIP

L2 Regularization in PyTorch

Raw

L2_Regularization.py

	_lambda = 0.0005
	l2_reg = torch.tensor(0.)

	for param in model.parameters():
	l2_reg += torch.norm(param)

	loss += lamb * l2_reg

Author

1pha commented Dec 9, 2020

From Stackoverflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment