Skip to content

Instantly share code, notes, and snippets.

@sshleifer

sshleifer/hardness_grid.py

Created May 29, 2019 15:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save sshleifer/a06172aa52a9411eb69517226ac4fdb9 to your computer and use it in GitHub Desktop.
Save sshleifer/a06172aa52a9411eb69517226ac4fdb9 to your computer and use it in GitHub Desktop.
Download ZIP
ideal grid/api for hardness sampling
Raw
hardness_grid.py
pg1 = update_batch_size(ParameterGrid({
'lr': [1e-4, 1e-3, 3e-3, 1e-2, .05, 1e-1],
'label_smoothing': [True, False],
'size': [128],
'bs': [256],
'hardness_percentile': [.75, .5, .25, .1] # top 50%, top25%
}))
# Now based on easiness
pg2 = update_batch_size(ParameterGrid({
'lr': [1e-4, 1e-3, 3e-3, 1e-2, .05, 1e-1],
'label_smoothing': [True, False],
'size': [128],
'bs': [256],
'easiness_percentile': [.75, .5, .25, .1]
}))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment