Skip to content

Instantly share code, notes, and snippets.

@jrzaurin
Last active June 13, 2021 09:21
Show Gist options
  • Save jrzaurin/33986b91e904769fcc55ad3eceb05c46 to your computer and use it in GitHub Desktop.
Save jrzaurin/33986b91e904769fcc55ad3eceb05c46 to your computer and use it in GitHub Desktop.
Results for the Facebook Comments Volume dataset with TabMlp
mlp_hidden_dims mlp_activation mlp_dropout mlp_batchnorm mlp_batchnorm_last mlp_linear_first embed_dropout lr batch_size weight_decay optimizer lr_scheduler base_lr max_lr div_factor final_div_factor n_cycles val_loss_or_metric
[100,50] relu 0.1 False False True 0.0 0.001 512 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 32.5931
[100,50] relu 0.1 False False False 0.0 0.001 512 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.3515
[200, 100] relu 0.1 False False False 0.0 0.001 256 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.4140
[200, 100] relu 0.1 False False False 0.1 0.001 256 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.5679
[200, 100] relu 0.1 False False False 0.0 0.001 512 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.6284
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment