Skip to content

Instantly share code, notes, and snippets.

@nickswalker
Created May 11, 2020 22:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nickswalker/89e784a4af9db07d601b2a2ecedec583 to your computer and use it in GitHub Desktop.
Save nickswalker/89e784a4af9db07d601b2a2ecedec583 to your computer and use it in GitHub Desktop.
Results from commit 3fe80db
seq_acc
mean std count
exp model test_name
results_all albert-base-v2transformer_seq2seq para 0.897 0.026 15
bert-base-uncasedtransformer_seq2seq para 0.931 0.008 15
bert-large-uncasedtransformer_seq2seq para 0.912 0.022 15
distilbert-base-uncasedtransformer_seq2seq para 0.921 0.024 15
distilgpt2transformer_seq2seq para 0.888 0.022 15
distilroberta-basetransformer_seq2seq para 0.915 0.026 15
elmo_seq2seq para 0.906 0.021 15
glove_seq2seq para 0.905 0.011 15
gpt2transformer_seq2seq para 0.827 0.030 15
roberta-basetransformer_seq2seq para 0.920 0.014 15
seq2seq para 0.891 0.019 15
xlnet-base-casedtransformer_seq2seq para 0.652 0.026 15
results_all_logical albert-base-v2transformer_seq2seq para_logical 0.203 0.032 15
bert-base-uncasedtransformer_seq2seq para_logical 0.216 0.034 15
bert-large-uncasedtransformer_seq2seq para_logical 0.209 0.043 15
distilbert-base-uncasedtransformer_seq2seq para_logical 0.215 0.052 15
distilgpt2transformer_seq2seq para_logical 0.011 0.033 15
distilroberta-basetransformer_seq2seq para_logical 0.191 0.039 15
elmo_seq2seq para_logical 0.266 0.026 15
glove_seq2seq para_logical 0.044 0.036 15
gpt2transformer_seq2seq para_logical 0.000 0.001 15
roberta-basetransformer_seq2seq para_logical 0.147 0.053 15
seq2seq para_logical 0.010 0.013 15
xlnet-base-casedtransformer_seq2seq para_logical 0.000 0.000 15
results_gen albert-base-v2transformer_seq2seq gen 0.974 0.011 15
bert-base-uncasedtransformer_seq2seq gen 0.984 0.006 15
bert-large-uncasedtransformer_seq2seq gen 0.970 0.021 15
distilbert-base-uncasedtransformer_seq2seq gen 0.981 0.006 15
distilgpt2transformer_seq2seq gen 0.961 0.030 15
distilroberta-basetransformer_seq2seq gen 0.980 0.012 15
elmo_seq2seq gen 0.981 0.005 15
glove_seq2seq gen 0.965 0.009 15
gpt2transformer_seq2seq gen 0.830 0.069 15
roberta-basetransformer_seq2seq gen 0.980 0.006 15
seq2seq gen 0.958 0.016 15
xlnet-base-casedtransformer_seq2seq gen 0.681 0.046 15
results_gen_logical albert-base-v2transformer_seq2seq gen_logical 0.296 0.179 15
bert-base-uncasedtransformer_seq2seq gen_logical 0.334 0.196 15
bert-large-uncasedtransformer_seq2seq gen_logical 0.290 0.161 15
distilbert-base-uncasedtransformer_seq2seq gen_logical 0.357 0.132 15
distilgpt2transformer_seq2seq gen_logical 0.016 0.017 15
distilroberta-basetransformer_seq2seq gen_logical 0.104 0.142 15
elmo_seq2seq gen_logical 0.409 0.111 15
glove_seq2seq gen_logical 0.086 0.148 15
gpt2transformer_seq2seq gen_logical 0.000 0.000 15
roberta-basetransformer_seq2seq gen_logical 0.183 0.165 15
seq2seq gen_logical 0.058 0.111 15
xlnet-base-casedtransformer_seq2seq gen_logical 0.000 0.000 15
results_para albert-base-v2transformer_seq2seq para 0.721 0.018 15
bert-base-uncasedtransformer_seq2seq para 0.790 0.019 15
bert-large-uncasedtransformer_seq2seq para 0.779 0.022 15
distilbert-base-uncasedtransformer_seq2seq para 0.777 0.026 15
distilgpt2transformer_seq2seq para 0.724 0.028 15
distilroberta-basetransformer_seq2seq para 0.770 0.025 15
elmo_seq2seq para 0.765 0.029 15
glove_seq2seq para 0.715 0.017 15
gpt2transformer_seq2seq para 0.676 0.030 15
roberta-basetransformer_seq2seq para 0.761 0.021 15
seq2seq para 0.679 0.023 15
xlnet-base-casedtransformer_seq2seq para 0.453 0.035 15
results_para_logical albert-base-v2transformer_seq2seq para_logical 0.208 0.050 15
bert-base-uncasedtransformer_seq2seq para_logical 0.229 0.040 15
bert-large-uncasedtransformer_seq2seq para_logical 0.174 0.062 15
distilbert-base-uncasedtransformer_seq2seq para_logical 0.194 0.061 15
distilgpt2transformer_seq2seq para_logical 0.002 0.005 15
distilroberta-basetransformer_seq2seq para_logical 0.121 0.074 15
elmo_seq2seq para_logical 0.261 0.022 15
glove_seq2seq para_logical 0.004 0.009 15
gpt2transformer_seq2seq para_logical 0.000 0.000 15
roberta-basetransformer_seq2seq para_logical 0.111 0.058 15
seq2seq para_logical 0.005 0.007 15
xlnet-base-casedtransformer_seq2seq para_logical 0.000 0.000 15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment