Skip to content

Instantly share code, notes, and snippets.

@fmassa
Last active July 3, 2017 08:25
Show Gist options
  • Save fmassa/f148df8f7c443c851a4c to your computer and use it in GitHub Desktop.
Save fmassa/f148df8f7c443c851a4c to your computer and use it in GitHub Desktop.
-- suppose you have a model called model
lrs_model = model:clone()
lrs = lrs_model:getParameters()
lrs:fill(1) -- setting the base learning rate to 1
-- now lets set the learning rate factor of the bias of module 5 to 2
lrs_model:get(5).bias:fill(2)
-- same thing for the weights of module 2, let's set them to 3
lrs_model:get(2).weight:fill(3)
-- now pass lrs_model to optimState, which was created previously
optimState.learningRates = lrs
@KangolHsu
Copy link

mark

@AIML
Copy link

AIML commented Dec 20, 2016

thanks a lot

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment