Skip to content

Instantly share code, notes, and snippets.

@jrzaurin
Last active June 13, 2021 09:22
Show Gist options
  • Save jrzaurin/c6435fe76f1aa7af04ad7db844032eea to your computer and use it in GitHub Desktop.
Save jrzaurin/c6435fe76f1aa7af04ad7db844032eea to your computer and use it in GitHub Desktop.
Results for the Facebook Comments Volume dataset with TabResnet
blocks_dims blocks_dropout mlp_hidden_dims mlp_activation mlp_dropout mlp_batchnorm mlp_batchnorm_last mlp_linear_first embed_dropout lr batch_size weight_decay optimizer lr_scheduler base_lr max_lr div_factor final_div_factor n_cycles val_loss_or_metric
[100, 100, 100] 0.1 None relu 0.1 False False False 0.0 0.0005 512 0.0 Adam CyclicLR 0.0005 0.03 25 10000.0 10.0 34.4972
[100, 100, 100] 0.1 None relu 0.1 False False False 0.0 0.0005 512 0.0 AdamW CyclicLR 0.0005 0.03 25 10000.0 10.0 34.8520
[100, 100, 100] 0.1 None relu 0.1 False False False 0.0 0.0005 512 0.0 Adam CyclicLR 0.0005 0.03 25 10000.0 10.0 34.95044
[100, 100, 100] 0.1 None relu 0.1 False False False 0.0 0.0005 512 0.0 Adam CyclicLR 0.0005 0.01 25 10000.0 10.0 35.1667
[100, 100, 100] 0.1 None relu 0.1 False False False 0.0 0.0005 512 0.0 AdamW CyclicLR 0.0005 0.01 25 10000.0 10.0 35.2503
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment