Skip to content

Instantly share code, notes, and snippets.

@jrzaurin

jrzaurin/fb_comments_tabtransformer.csv

Last active June 13, 2021 09:22
Show Gist options
  • Save jrzaurin/2b75aa6b6a6aa93e60d6813aabdb8b07 to your computer and use it in GitHub Desktop.
Save jrzaurin/2b75aa6b6a6aa93e60d6813aabdb8b07 to your computer and use it in GitHub Desktop.
Download ZIP
Results for the Facebook Comments Volume dataset with TabTransformer
Raw
fb_comments_tabtransformer.csv
embed_dropout full_embed_dropout shared_embed add_shared_embed frac_shared_embed input_dim n_heads n_blocks dropout ff_hidden_dim transformer_activation mlp_hidden_dims mlp_activation mlp_batchnorm mlp_batchnorm_last mlp_linear_first with_wide lr batch_size weight_decay optimizer lr_scheduler base_lr max_lr div_factor final_div_factor n_cycles val_loss_or_metric
0.0 False False False 8 16 2 4 0.1 relu None relu False False False False 0.0005 1024 0.0 Adam CyclicLR 0.0005 0.01 25 10000.0 10.0 33.0956
0.0 False False False 8 16 2 4 0.1 relu None relu False False False False 0.0005 4096 0.0 AdamW OneCycleLR 0.001 0.01 25 1000.0 5.0 33.1283
0.0 False False False 8 16 2 4 0.1 relu None relu False False False False 0.001 1024 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.2175
0.0 False False False 8 16 2 4 0.1 relu same relu False False False False 0.001 1024 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.4698
0.0 False False False 8 16 4 4 0.1 relu None relu False False False False 0.001 1024 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 33.7950
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment