Skip to content

Instantly share code, notes, and snippets.

@codez266
Created December 28, 2017 16:29
Show Gist options
  • Save codez266/5fbf7ab5853225680a598a5bb954f7c1 to your computer and use it in GitHub Desktop.
Save codez266/5fbf7ab5853225680a598a5bb954f7c1 to your computer and use it in GitHub Desktop.
Statistics on 10k ranomly shuffled wikiproject samples with model aggregations
counts (n=10000):
label n TP FP FN TN
--------------------------------------------- ---- --- ---- ---- ---- ----
'STEM.Time' 270 --> 200 70 155 9575
'STEM.Physics' 284 --> 245 39 554 9162
'STEM.Space' 251 --> 229 22 111 9638
'STEM.Mathematics' 164 --> 133 31 283 9553
'Culture.Crafts and hobbies' 232 --> 156 76 44 9724
'History_And_Society.Transportation' 469 --> 389 80 155 9376
'Geography.Maps' 287 --> 217 70 564 9149
'Culture.Internet culture' 236 --> 204 32 396 9368
'History_And_Society.Business and economics' 724 --> 555 169 696 8580
'Assistance.Article improvement and grading' 5 --> 0 5 0 9995
'STEM.Biology' 360 --> 276 84 414 9226
'STEM.Science' 281 --> 213 68 1069 8650
'STEM.Technology' 468 --> 384 84 847 8685
'Geography.Countries' 2696 --> 2010 686 1451 5853
'Culture.Media' 242 --> 201 41 892 8866
'History_And_Society.History and society' 868 --> 617 251 1734 7398
'Assistance.Contents systems' 210 --> 104 106 132 9658
'Culture.Broadcasting' 344 --> 287 57 415 9241
'Assistance.Maintenance' 690 --> 303 387 387 8923
'Culture.Food and drink' 249 --> 198 51 48 9703
'History_And_Society.Military and warfare' 467 --> 396 71 319 9214
'Culture.Philosophy and religion' 446 --> 331 115 521 9033
'Geography.Oceania' 446 --> 344 102 285 9269
'Culture.Plastic arts' 419 --> 342 77 427 9154
'History_And_Society.Education' 319 --> 267 52 217 9464
'STEM.Engineering' 264 --> 207 57 715 9021
'Culture.Visual arts' 538 --> 467 71 562 8900
'STEM.Meteorology' 222 --> 183 39 7 9771
'Culture.Language and literature' 2255 --> 1955 300 1534 6211
'Geography.Landforms' 236 --> 200 36 104 9660
'Culture.Entertainment' 633 --> 552 81 583 8784
'STEM.Medicine' 244 --> 193 51 304 9452
'Geography.Bodies of water' 248 --> 219 29 125 9627
'STEM.Information science' 238 --> 180 58 247 9515
'Culture.Sports' 508 --> 440 68 128 9364
'Geography.Europe' 1759 --> 1408 351 1328 6913
'History_And_Society.Politics and government' 497 --> 388 109 764 8739
'Geography.Cities' 92 --> 65 27 98 9810
'STEM.Geosciences' 200 --> 158 42 283 9517
'Culture.Performing arts' 538 --> 466 72 102 9360
'Culture.Arts' 200 --> 181 19 243 9557
'STEM.Chemistry' 284 --> 254 30 240 9476
'Assistance.Files' 32 --> 5 27 12 9956
precision (micro=None, macro=None):
------------------------------------------- -----
STEM.Time 0.563
STEM.Physics 0.307
STEM.Space 0.674
STEM.Mathematics 0.32
Culture.Crafts and hobbies 0.78
History_And_Society.Transportation 0.715
Geography.Maps 0.278
Culture.Internet culture 0.34
History_And_Society.Business and economics 0.444
Assistance.Article improvement and grading
STEM.Biology 0.4
STEM.Science 0.166
STEM.Technology 0.312
Geography.Countries 0.581
Culture.Media 0.184
History_And_Society.History and society 0.262
Assistance.Contents systems 0.441
Culture.Broadcasting 0.409
Assistance.Maintenance 0.439
Culture.Food and drink 0.805
History_And_Society.Military and warfare 0.554
Culture.Philosophy and religion 0.388
Geography.Oceania 0.547
Culture.Plastic arts 0.445
History_And_Society.Education 0.552
STEM.Engineering 0.225
Culture.Visual arts 0.454
STEM.Meteorology 0.963
Culture.Language and literature 0.56
Geography.Landforms 0.658
Culture.Entertainment 0.486
STEM.Medicine 0.388
Geography.Bodies of water 0.637
STEM.Information science 0.422
Culture.Sports 0.775
Geography.Europe 0.515
History_And_Society.Politics and government 0.337
Geography.Cities 0.399
STEM.Geosciences 0.358
Culture.Performing arts 0.82
Culture.Arts 0.427
STEM.Chemistry 0.514
Assistance.Files 0.294
------------------------------------------- -----
recall (micro=0.79, macro=0.76):
------------------------------------------- -----
STEM.Time 0.741
STEM.Physics 0.863
STEM.Space 0.912
STEM.Mathematics 0.811
Culture.Crafts and hobbies 0.672
History_And_Society.Transportation 0.829
Geography.Maps 0.756
Culture.Internet culture 0.864
History_And_Society.Business and economics 0.767
Assistance.Article improvement and grading 0
STEM.Biology 0.767
STEM.Science 0.758
STEM.Technology 0.821
Geography.Countries 0.746
Culture.Media 0.831
History_And_Society.History and society 0.711
Assistance.Contents systems 0.495
Culture.Broadcasting 0.834
Assistance.Maintenance 0.439
Culture.Food and drink 0.795
History_And_Society.Military and warfare 0.848
Culture.Philosophy and religion 0.742
Geography.Oceania 0.771
Culture.Plastic arts 0.816
History_And_Society.Education 0.837
STEM.Engineering 0.784
Culture.Visual arts 0.868
STEM.Meteorology 0.824
Culture.Language and literature 0.867
Geography.Landforms 0.847
Culture.Entertainment 0.872
STEM.Medicine 0.791
Geography.Bodies of water 0.883
STEM.Information science 0.756
Culture.Sports 0.866
Geography.Europe 0.8
History_And_Society.Politics and government 0.781
Geography.Cities 0.707
STEM.Geosciences 0.79
Culture.Performing arts 0.866
Culture.Arts 0.905
STEM.Chemistry 0.894
Assistance.Files 0.156
------------------------------------------- -----
match_rate (micro=0.163, macro=0.083):
------------------------------------------- -----
STEM.Time 0.036
STEM.Physics 0.08
STEM.Space 0.034
STEM.Mathematics 0.042
Culture.Crafts and hobbies 0.02
History_And_Society.Transportation 0.054
Geography.Maps 0.078
Culture.Internet culture 0.06
History_And_Society.Business and economics 0.125
Assistance.Article improvement and grading 0
STEM.Biology 0.069
STEM.Science 0.128
STEM.Technology 0.123
Geography.Countries 0.346
Culture.Media 0.109
History_And_Society.History and society 0.235
Assistance.Contents systems 0.024
Culture.Broadcasting 0.07
Assistance.Maintenance 0.069
Culture.Food and drink 0.025
History_And_Society.Military and warfare 0.072
Culture.Philosophy and religion 0.085
Geography.Oceania 0.063
Culture.Plastic arts 0.077
History_And_Society.Education 0.048
STEM.Engineering 0.092
Culture.Visual arts 0.103
STEM.Meteorology 0.019
Culture.Language and literature 0.349
Geography.Landforms 0.03
Culture.Entertainment 0.114
STEM.Medicine 0.05
Geography.Bodies of water 0.034
STEM.Information science 0.043
Culture.Sports 0.057
Geography.Europe 0.274
History_And_Society.Politics and government 0.115
Geography.Cities 0.016
STEM.Geosciences 0.044
Culture.Performing arts 0.057
Culture.Arts 0.042
STEM.Chemistry 0.049
Assistance.Files 0.002
------------------------------------------- -----
filter_rate (micro=0.837, macro=0.917):
------------------------------------------- -----
STEM.Time 0.964
STEM.Physics 0.92
STEM.Space 0.966
STEM.Mathematics 0.958
Culture.Crafts and hobbies 0.98
History_And_Society.Transportation 0.946
Geography.Maps 0.922
Culture.Internet culture 0.94
History_And_Society.Business and economics 0.875
Assistance.Article improvement and grading 1
STEM.Biology 0.931
STEM.Science 0.872
STEM.Technology 0.877
Geography.Countries 0.654
Culture.Media 0.891
History_And_Society.History and society 0.765
Assistance.Contents systems 0.976
Culture.Broadcasting 0.93
Assistance.Maintenance 0.931
Culture.Food and drink 0.975
History_And_Society.Military and warfare 0.928
Culture.Philosophy and religion 0.915
Geography.Oceania 0.937
Culture.Plastic arts 0.923
History_And_Society.Education 0.952
STEM.Engineering 0.908
Culture.Visual arts 0.897
STEM.Meteorology 0.981
Culture.Language and literature 0.651
Geography.Landforms 0.97
Culture.Entertainment 0.886
STEM.Medicine 0.95
Geography.Bodies of water 0.966
STEM.Information science 0.957
Culture.Sports 0.943
Geography.Europe 0.726
History_And_Society.Politics and government 0.885
Geography.Cities 0.984
STEM.Geosciences 0.956
Culture.Performing arts 0.943
Culture.Arts 0.958
STEM.Chemistry 0.951
Assistance.Files 0.998
------------------------------------------- -----
f1 (micro=None, macro=None):
------------------------------------------- -----
STEM.Time 0.64
STEM.Physics 0.452
STEM.Space 0.775
STEM.Mathematics 0.459
Culture.Crafts and hobbies 0.722
History_And_Society.Transportation 0.768
Geography.Maps 0.406
Culture.Internet culture 0.488
History_And_Society.Business and economics 0.562
Assistance.Article improvement and grading
STEM.Biology 0.526
STEM.Science 0.273
STEM.Technology 0.452
Geography.Countries 0.653
Culture.Media 0.301
History_And_Society.History and society 0.383
Assistance.Contents systems 0.466
Culture.Broadcasting 0.549
Assistance.Maintenance 0.439
Culture.Food and drink 0.8
History_And_Society.Military and warfare 0.67
Culture.Philosophy and religion 0.51
Geography.Oceania 0.64
Culture.Plastic arts 0.576
History_And_Society.Education 0.665
STEM.Engineering 0.349
Culture.Visual arts 0.596
STEM.Meteorology 0.888
Culture.Language and literature 0.681
Geography.Landforms 0.741
Culture.Entertainment 0.624
STEM.Medicine 0.521
Geography.Bodies of water 0.74
STEM.Information science 0.541
Culture.Sports 0.818
Geography.Europe 0.626
History_And_Society.Politics and government 0.471
Geography.Cities 0.51
STEM.Geosciences 0.493
Culture.Performing arts 0.843
Culture.Arts 0.58
STEM.Chemistry 0.653
Assistance.Files 0.204
------------------------------------------- -----
accuracy (micro=0.898, macro=0.945):
------------------------------------------- -----
STEM.Time 0.978
STEM.Physics 0.941
STEM.Space 0.987
STEM.Mathematics 0.969
Culture.Crafts and hobbies 0.988
History_And_Society.Transportation 0.976
Geography.Maps 0.937
Culture.Internet culture 0.957
History_And_Society.Business and economics 0.914
Assistance.Article improvement and grading 1
STEM.Biology 0.95
STEM.Science 0.886
STEM.Technology 0.907
Geography.Countries 0.786
Culture.Media 0.907
History_And_Society.History and society 0.802
Assistance.Contents systems 0.976
Culture.Broadcasting 0.953
Assistance.Maintenance 0.923
Culture.Food and drink 0.99
History_And_Society.Military and warfare 0.961
Culture.Philosophy and religion 0.936
Geography.Oceania 0.961
Culture.Plastic arts 0.95
History_And_Society.Education 0.973
STEM.Engineering 0.923
Culture.Visual arts 0.937
STEM.Meteorology 0.995
Culture.Language and literature 0.817
Geography.Landforms 0.986
Culture.Entertainment 0.934
STEM.Medicine 0.964
Geography.Bodies of water 0.985
STEM.Information science 0.97
Culture.Sports 0.98
Geography.Europe 0.832
History_And_Society.Politics and government 0.913
Geography.Cities 0.988
STEM.Geosciences 0.968
Culture.Performing arts 0.983
Culture.Arts 0.974
STEM.Chemistry 0.973
Assistance.Files 0.996
------------------------------------------- -----
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment