Skip to content

Instantly share code, notes, and snippets.

@amogkam
Created August 17, 2020 17:18
Show Gist options
  • Save amogkam/36c0898a507c39497782905a6717368d to your computer and use it in GitHub Desktop.
Save amogkam/36c0898a507c39497782905a6717368d to your computer and use it in GitHub Desktop.
{
"per_gpu_batch_size": (16, 64),
"weight_decay": (0, 0.3),
"learning_rate": (1e-5, 5e-5),
"warmup_steps": (0, 500),
"num_epochs": (2, 5)
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment