Skip to content

Instantly share code, notes, and snippets.

@tezansahu
Created March 6, 2022 05:10
Show Gist options
  • Save tezansahu/a1ab8574dbb0138837bfac338d2babb2 to your computer and use it in GitHub Desktop.
Save tezansahu/a1ab8574dbb0138837bfac338d2babb2 to your computer and use it in GitHub Desktop.
training_args = {
'train_batch_size':8,
'gradient_accumulation_steps':16,
'learning_rate': 2e-5,
'num_train_epochs': 3,
'max_seq_length': 60 # based on the histogram of number of words present in the headline
}
model_params = {
'model_type': 'bert',
'model_name': 'bert-base-uncased'
}
model, result, model_outputs, wrong_predictions = trainModel(model_params, training_args, mlf_run, 'bert_3epochs')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment