Skip to content

Instantly share code, notes, and snippets.

@codez266
Last active January 14, 2018 14:57
Show Gist options
  • Save codez266/8953c7c0a9cc6d489eaf66a1e5bf914d to your computer and use it in GitHub Desktop.
Save codez266/8953c7c0a9cc6d489eaf66a1e5bf914d to your computer and use it in GitHub Desktop.
GradientBoosting statistics on drafttopic full dataset
counts (n=93415):
label n TP FP FN TN
--------------------------------------------- ----- --- ----- ----- ---- -----
'STEM.Time' 2382 --> 1515 867 116 90917
'STEM.Physics' 2633 --> 1498 1135 378 90404
'STEM.Space' 2522 --> 2135 387 101 90792
'STEM.Mathematics' 1659 --> 1090 569 74 91682
'Culture.Crafts and hobbies' 2150 --> 1236 914 67 91198
'History_And_Society.Transportation' 4276 --> 3091 1185 339 88800
'Geography.Maps' 2552 --> 1374 1178 73 90790
'Culture.Internet culture' 2150 --> 1295 855 266 90999
'History_And_Society.Business and economics' 6583 --> 3525 3058 863 85969
'Assistance.Article improvement and grading' 71 --> 9 62 223 93121
'STEM.Biology' 3437 --> 1944 1493 291 89687
'STEM.Science' 2310 --> 630 1680 138 90967
'STEM.Technology' 4283 --> 1715 2568 692 88440
'Geography.Countries' 25576 --> 15173 10403 4533 63306
'Culture.Media' 2206 --> 703 1503 253 90956
'History_And_Society.History and society' 7582 --> 1677 5905 633 85200
'Assistance.Contents systems' 2083 --> 465 1618 284 91048
'Culture.Broadcasting' 3322 --> 2124 1198 419 89674
'Assistance.Maintenance' 6392 --> 1835 4557 437 86586
'Culture.Food and drink' 2472 --> 1746 726 168 90775
'History_And_Society.Military and warfare' 4395 --> 2952 1443 394 88626
'Culture.Philosophy and religion' 4116 --> 1998 2118 489 88810
'Geography.Oceania' 4212 --> 2594 1618 197 89006
'Culture.Plastic arts' 3924 --> 2343 1581 438 89053
'History_And_Society.Education' 2781 --> 1769 1012 245 90389
'STEM.Engineering' 2378 --> 852 1526 289 90748
'Culture.Visual arts' 4871 --> 2960 1911 519 88025
'STEM.Meteorology' 2118 --> 1725 393 66 91231
'Culture.Language and literature' 20527 --> 14935 5592 2269 70619
'Geography.Landforms' 2229 --> 1731 498 133 91053
'Culture.Entertainment' 6185 --> 4336 1849 608 86622
'STEM.Medicine' 2513 --> 1645 868 294 90608
'Geography.Bodies of water' 2336 --> 1829 507 157 90922
'STEM.Information science' 2136 --> 1274 862 130 91149
'Culture.Sports' 5027 --> 4150 877 370 88018
'Geography.Europe' 16102 --> 9081 7021 2590 74723
'History_And_Society.Politics and government' 4371 --> 1830 2541 609 88435
'Geography.Cities' 821 --> 438 383 117 92477
'STEM.Geosciences' 2085 --> 1281 804 140 91190
'Culture.Performing arts' 4721 --> 3878 843 436 88258
'Culture.Arts' 2079 --> 1563 516 89 91247
'STEM.Chemistry' 2519 --> 1760 759 308 90588
'Assistance.Files' 374 --> 16 358 47 92994
match_rate (micro=0.078, macro=0.033): [528/1918]
------------------------------------------- -----
History_And_Society.Business and economics 0.047
History_And_Society.Education 0.022
Assistance.Maintenance 0.024
STEM.Physics 0.02
Culture.Language and literature 0.184
Assistance.Contents systems 0.008
Culture.Plastic arts 0.03
Culture.Philosophy and religion 0.027
Geography.Landforms 0.02
Culture.Entertainment 0.053
STEM.Time 0.017
Culture.Sports 0.048
STEM.Medicine 0.021
STEM.Chemistry 0.022
History_And_Society.Politics and government 0.026
Culture.Broadcasting 0.027
History_And_Society.Military and warfare 0.036
Geography.Maps 0.015
History_And_Society.History and society 0.025
Assistance.Files 0.001
STEM.Information science 0.015
History_And_Society.Transportation 0.037
Geography.Europe 0.125
STEM.Geosciences 0.015
STEM.Space 0.024
Culture.Internet culture 0.017
Assistance.Article improvement and grading 0.002
STEM.Engineering 0.012
STEM.Meteorology 0.019
Geography.Bodies of water 0.021
Culture.Media 0.01
STEM.Science 0.008
Culture.Food and drink 0.02
Geography.Countries 0.211
Geography.Oceania 0.03
Culture.Arts 0.018
Culture.Performing arts 0.046
STEM.Mathematics 0.012
Geography.Cities 0.006
STEM.Biology 0.024
Culture.Crafts and hobbies 0.014
STEM.Technology 0.026
Culture.Visual arts 0.037
------------------------------------------- -----
filter_rate (micro=0.922, macro=0.967):
------------------------------------------- -----
History_And_Society.Business and economics 0.953
History_And_Society.Education 0.978
Assistance.Maintenance 0.976
STEM.Physics 0.98
Culture.Language and literature 0.816
Assistance.Contents systems 0.992
Culture.Plastic arts 0.97
Culture.Philosophy and religion 0.973
Geography.Landforms 0.98
Culture.Entertainment 0.947
STEM.Time 0.983
Culture.Sports 0.952
STEM.Medicine 0.979
STEM.Chemistry 0.978
History_And_Society.Politics and government 0.974
Culture.Broadcasting 0.973
History_And_Society.Military and warfare 0.964
Geography.Maps 0.985
History_And_Society.History and society 0.975
Assistance.Files 0.999
STEM.Information science 0.985
History_And_Society.Transportation 0.963
Geography.Europe 0.875
STEM.Geosciences 0.985
STEM.Space 0.976
Culture.Internet culture 0.983
Assistance.Article improvement and grading 0.998
STEM.Engineering 0.988
STEM.Meteorology 0.981
Geography.Bodies of water 0.979 [451/1918]
Culture.Media 0.99
STEM.Science 0.992
Culture.Food and drink 0.98
Geography.Countries 0.789
Geography.Oceania 0.97
Culture.Arts 0.982
Culture.Performing arts 0.954
STEM.Mathematics 0.988
Geography.Cities 0.994
STEM.Biology 0.976
Culture.Crafts and hobbies 0.986
STEM.Technology 0.974
Culture.Visual arts 0.963
------------------------------------------- -----
recall (micro=0.59, macro=0.566):
------------------------------------------- -----
History_And_Society.Business and economics 0.535
History_And_Society.Education 0.636
Assistance.Maintenance 0.287
STEM.Physics 0.569
Culture.Language and literature 0.728
Assistance.Contents systems 0.223
Culture.Plastic arts 0.597
Culture.Philosophy and religion 0.485
Geography.Landforms 0.777
Culture.Entertainment 0.701
STEM.Time 0.636
Culture.Sports 0.826
STEM.Medicine 0.655
STEM.Chemistry 0.699
History_And_Society.Politics and government 0.419
Culture.Broadcasting 0.639
History_And_Society.Military and warfare 0.672
Geography.Maps 0.538
History_And_Society.History and society 0.221
Assistance.Files 0.043
STEM.Information science 0.596
History_And_Society.Transportation 0.723
Geography.Europe 0.564 [412/1918]
STEM.Geosciences 0.614
STEM.Space 0.847
Culture.Internet culture 0.602
Assistance.Article improvement and grading 0.127
STEM.Engineering 0.358
STEM.Meteorology 0.814
Geography.Bodies of water 0.783
Culture.Media 0.319
STEM.Science 0.273
Culture.Food and drink 0.706
Geography.Countries 0.593
Geography.Oceania 0.616
Culture.Arts 0.752
Culture.Performing arts 0.821
STEM.Mathematics 0.657
Geography.Cities 0.533
STEM.Biology 0.566
Culture.Crafts and hobbies 0.575
STEM.Technology 0.4
Culture.Visual arts 0.608
------------------------------------------- -----
!recall (micro=0.982, macro=0.994):
------------------------------------------- -----
History_And_Society.Business and economics 0.99
History_And_Society.Education 0.997
Assistance.Maintenance 0.995
STEM.Physics 0.996
Culture.Language and literature 0.969
Assistance.Contents systems 0.997
Culture.Plastic arts 0.995
Culture.Philosophy and religion 0.995
Geography.Landforms 0.999
Culture.Entertainment 0.993
STEM.Time 0.999
Culture.Sports 0.996
STEM.Medicine 0.997
STEM.Chemistry 0.997
History_And_Society.Politics and government 0.993
Culture.Broadcasting 0.995 [373/1918]
History_And_Society.Military and warfare 0.996
Geography.Maps 0.999
History_And_Society.History and society 0.993
Assistance.Files 0.999
STEM.Information science 0.999
History_And_Society.Transportation 0.996
Geography.Europe 0.966
STEM.Geosciences 0.998
STEM.Space 0.999
Culture.Internet culture 0.997
Assistance.Article improvement and grading 0.998
STEM.Engineering 0.997
STEM.Meteorology 0.999
Geography.Bodies of water 0.998
Culture.Media 0.997
STEM.Science 0.998
Culture.Food and drink 0.998
Geography.Countries 0.933
Geography.Oceania 0.998
Culture.Arts 0.999
Culture.Performing arts 0.995
STEM.Mathematics 0.999
Geography.Cities 0.999
STEM.Biology 0.997
Culture.Crafts and hobbies 0.999
STEM.Technology 0.992
Culture.Visual arts 0.994
------------------------------------------- -----
precision (micro=0.832, macro=0.819):
------------------------------------------- -----
History_And_Society.Business and economics 0.803
History_And_Society.Education 0.878
Assistance.Maintenance 0.808
STEM.Physics 0.799
Culture.Language and literature 0.868
Assistance.Contents systems 0.621
Culture.Plastic arts 0.843
Culture.Philosophy and religion 0.803
Geography.Landforms 0.929 [334/1918]
Culture.Entertainment 0.877
STEM.Time 0.929
Culture.Sports 0.918
STEM.Medicine 0.848
STEM.Chemistry 0.851
History_And_Society.Politics and government 0.75
Culture.Broadcasting 0.835
History_And_Society.Military and warfare 0.882
Geography.Maps 0.95
History_And_Society.History and society 0.726
Assistance.Files 0.254
STEM.Information science 0.907
History_And_Society.Transportation 0.901
Geography.Europe 0.778
STEM.Geosciences 0.901
STEM.Space 0.955
Culture.Internet culture 0.83
Assistance.Article improvement and grading 0.039
STEM.Engineering 0.747
STEM.Meteorology 0.963
Geography.Bodies of water 0.921
Culture.Media 0.735
STEM.Science 0.82
Culture.Food and drink 0.912
Geography.Countries 0.77
Geography.Oceania 0.929
Culture.Arts 0.946
Culture.Performing arts 0.899
STEM.Mathematics 0.936
Geography.Cities 0.789
STEM.Biology 0.87
Culture.Crafts and hobbies 0.949
STEM.Technology 0.713
Culture.Visual arts 0.851
------------------------------------------- -----
!precision (micro=0.952, macro=0.979):
------------------------------------------- -----
History_And_Society.Business and economics 0.966
History_And_Society.Education 0.989 [295/1918]
Assistance.Maintenance 0.95
STEM.Physics 0.988
Culture.Language and literature 0.927
Assistance.Contents systems 0.983
Culture.Plastic arts 0.983
Culture.Philosophy and religion 0.977
Geography.Landforms 0.995
Culture.Entertainment 0.979
STEM.Time 0.991
Culture.Sports 0.99
STEM.Medicine 0.991
STEM.Chemistry 0.992
History_And_Society.Politics and government 0.972
Culture.Broadcasting 0.987
History_And_Society.Military and warfare 0.984
Geography.Maps 0.987
History_And_Society.History and society 0.935
Assistance.Files 0.996
STEM.Information science 0.991
History_And_Society.Transportation 0.987
Geography.Europe 0.914
STEM.Geosciences 0.991
STEM.Space 0.996
Culture.Internet culture 0.991
Assistance.Article improvement and grading 0.999
STEM.Engineering 0.983
STEM.Meteorology 0.996
Geography.Bodies of water 0.994
Culture.Media 0.984
STEM.Science 0.982
Culture.Food and drink 0.992
Geography.Countries 0.859
Geography.Oceania 0.982
Culture.Arts 0.994
Culture.Performing arts 0.991
STEM.Mathematics 0.994
Geography.Cities 0.996
STEM.Biology 0.984
Culture.Crafts and hobbies 0.99 [256/1918]
STEM.Technology 0.972
Culture.Visual arts 0.979
------------------------------------------- -----
f1 (micro=0.681, macro=0.659):
------------------------------------------- -----
History_And_Society.Business and economics 0.643
History_And_Society.Education 0.738
Assistance.Maintenance 0.424
STEM.Physics 0.664
Culture.Language and literature 0.792
Assistance.Contents systems 0.328
Culture.Plastic arts 0.699
Culture.Philosophy and religion 0.605
Geography.Landforms 0.846
Culture.Entertainment 0.779
STEM.Time 0.755
Culture.Sports 0.869
STEM.Medicine 0.739
STEM.Chemistry 0.767
History_And_Society.Politics and government 0.537
Culture.Broadcasting 0.724
History_And_Society.Military and warfare 0.763
Geography.Maps 0.687
History_And_Society.History and society 0.339
Assistance.Files 0.073
STEM.Information science 0.72
History_And_Society.Transportation 0.802
Geography.Europe 0.654
STEM.Geosciences 0.731
STEM.Space 0.897
Culture.Internet culture 0.698
Assistance.Article improvement and grading 0.059
STEM.Engineering 0.484
STEM.Meteorology 0.883
Geography.Bodies of water 0.846
Culture.Media 0.445
STEM.Science 0.409
Culture.Food and drink 0.796
Geography.Countries 0.67 [217/1918]
Geography.Oceania 0.741
Culture.Arts 0.838
Culture.Performing arts 0.858
STEM.Mathematics 0.772
Geography.Cities 0.637
STEM.Biology 0.685
Culture.Crafts and hobbies 0.716
STEM.Technology 0.513
Culture.Visual arts 0.709
------------------------------------------- -----
!f1 (micro=0.967, macro=0.986):
------------------------------------------- -----
History_And_Society.Business and economics 0.978
History_And_Society.Education 0.993
Assistance.Maintenance 0.972
STEM.Physics 0.992
Culture.Language and literature 0.947
Assistance.Contents systems 0.99
Culture.Plastic arts 0.989
Culture.Philosophy and religion 0.986
Geography.Landforms 0.997
Culture.Entertainment 0.986
STEM.Time 0.995
Culture.Sports 0.993
STEM.Medicine 0.994
STEM.Chemistry 0.994
History_And_Society.Politics and government 0.983
Culture.Broadcasting 0.991
History_And_Society.Military and warfare 0.99
Geography.Maps 0.993
History_And_Society.History and society 0.963
Assistance.Files 0.998
STEM.Information science 0.995
History_And_Society.Transportation 0.991
Geography.Europe 0.94
STEM.Geosciences 0.995
STEM.Space 0.997
Culture.Internet culture 0.994
Assistance.Article improvement and grading 0.998
STEM.Engineering 0.99
STEM.Meteorology 0.997
Geography.Bodies of water 0.996
Culture.Media 0.99
STEM.Science 0.99
Culture.Food and drink 0.995
Geography.Countries 0.894
Geography.Oceania 0.99
Culture.Arts 0.997
Culture.Performing arts 0.993
STEM.Mathematics 0.997
Geography.Cities 0.997
STEM.Biology 0.99
Culture.Crafts and hobbies 0.995
STEM.Technology 0.982
Culture.Visual arts 0.986
------------------------------------------- -----
accuracy (micro=0.945, macro=0.975):
------------------------------------------- -----
History_And_Society.Business and economics 0.958
History_And_Society.Education 0.987
Assistance.Maintenance 0.947
STEM.Physics 0.984
Culture.Language and literature 0.916
Assistance.Contents systems 0.98
Culture.Plastic arts 0.978
Culture.Philosophy and religion 0.972
Geography.Landforms 0.993
Culture.Entertainment 0.974
STEM.Time 0.989
Culture.Sports 0.987
STEM.Medicine 0.988
STEM.Chemistry 0.989
History_And_Society.Politics and government 0.966
Culture.Broadcasting 0.983
History_And_Society.Military and warfare 0.98
Geography.Maps 0.987
History_And_Society.History and society 0.93 [140/1918]
Assistance.Files 0.996
STEM.Information science 0.989
History_And_Society.Transportation 0.984
Geography.Europe 0.897
STEM.Geosciences 0.99
STEM.Space 0.995
Culture.Internet culture 0.988
Assistance.Article improvement and grading 0.997
STEM.Engineering 0.981
STEM.Meteorology 0.995
Geography.Bodies of water 0.993
Culture.Media 0.981
STEM.Science 0.981
Culture.Food and drink 0.99
Geography.Countries 0.84
Geography.Oceania 0.981
Culture.Arts 0.994
Culture.Performing arts 0.986
STEM.Mathematics 0.993
Geography.Cities 0.995
STEM.Biology 0.981
Culture.Crafts and hobbies 0.989
STEM.Technology 0.965
Culture.Visual arts 0.974
------------------------------------------- -----
fpr (micro=0.018, macro=0.006):
------------------------------------------- -----
History_And_Society.Business and economics 0.01
History_And_Society.Education 0.003
Assistance.Maintenance 0.005
STEM.Physics 0.004
Culture.Language and literature 0.031
Assistance.Contents systems 0.003
Culture.Plastic arts 0.005
Culture.Philosophy and religion 0.005
Geography.Landforms 0.001
Culture.Entertainment 0.007
STEM.Time 0.001
Culture.Sports 0.004 [101/1918]
STEM.Medicine 0.003
STEM.Chemistry 0.003
History_And_Society.Politics and government 0.007
Culture.Broadcasting 0.005
History_And_Society.Military and warfare 0.004
Geography.Maps 0.001
History_And_Society.History and society 0.007
Assistance.Files 0.001
STEM.Information science 0.001
History_And_Society.Transportation 0.004
Geography.Europe 0.034
STEM.Geosciences 0.002
STEM.Space 0.001
Culture.Internet culture 0.003
Assistance.Article improvement and grading 0.002
STEM.Engineering 0.003
STEM.Meteorology 0.001
Geography.Bodies of water 0.002
Culture.Media 0.003
STEM.Science 0.002
Culture.Food and drink 0.002
Geography.Countries 0.067
Geography.Oceania 0.002
Culture.Arts 0.001
Culture.Performing arts 0.005
STEM.Mathematics 0.001
Geography.Cities 0.001
STEM.Biology 0.003
Culture.Crafts and hobbies 0.001
STEM.Technology 0.008
Culture.Visual arts 0.006
------------------------------------------- -----
roc_auc (micro=0.949, macro=0.952):
------------------------------------------- -----
History_And_Society.Business and economics 0.961
History_And_Society.Education 0.972
Assistance.Maintenance 0.848
STEM.Physics 0.981
Culture.Language and literature 0.954 [62/1918]
Assistance.Contents systems 0.941
Culture.Plastic arts 0.975
Culture.Philosophy and religion 0.952
Geography.Landforms 0.988
Culture.Entertainment 0.977
STEM.Time 0.972
Culture.Sports 0.98
STEM.Medicine 0.98
STEM.Chemistry 0.983
History_And_Society.Politics and government 0.953
Culture.Broadcasting 0.978
History_And_Society.Military and warfare 0.978
Geography.Maps 0.974
History_And_Society.History and society 0.884
Assistance.Files 0.811
STEM.Information science 0.975
History_And_Society.Transportation 0.979
Geography.Europe 0.935
STEM.Geosciences 0.978
STEM.Space 0.987
Culture.Internet culture 0.981
Assistance.Article improvement and grading 0.587
STEM.Engineering 0.964
STEM.Meteorology 0.989
Geography.Bodies of water 0.986
Culture.Media 0.959
STEM.Science 0.945
Culture.Food and drink 0.981
Geography.Countries 0.899
Geography.Oceania 0.971
Culture.Arts 0.987
Culture.Performing arts 0.986
STEM.Mathematics 0.982
Geography.Cities 0.975
STEM.Biology 0.963
Culture.Crafts and hobbies 0.969
STEM.Technology 0.951
Culture.Visual arts 0.977
------------------------------------------- ----- [23/1918]
pr_auc (micro=0.778, macro=0.745):
------------------------------------------- -----
History_And_Society.Business and economics 0.748
History_And_Society.Education 0.804
Assistance.Maintenance 0.516
STEM.Physics 0.773
Culture.Language and literature 0.884
Assistance.Contents systems 0.408
Culture.Plastic arts 0.805
Culture.Philosophy and religion 0.672
Geography.Landforms 0.928
Culture.Entertainment 0.872
STEM.Time 0.828
Culture.Sports 0.92
STEM.Medicine 0.827
STEM.Chemistry 0.846
History_And_Society.Politics and government 0.647
Culture.Broadcasting 0.801
History_And_Society.Military and warfare 0.849
Geography.Maps 0.838
History_And_Society.History and society 0.498
Assistance.Files 0.049
STEM.Information science 0.807
History_And_Society.Transportation 0.891
Geography.Europe 0.768
STEM.Geosciences 0.809
STEM.Space 0.955
Culture.Internet culture 0.779
Assistance.Article improvement and grading 0.014
STEM.Engineering 0.611
STEM.Meteorology 0.949
Geography.Bodies of water 0.918
Culture.Media 0.544
STEM.Science 0.543
Culture.Food and drink 0.881
Geography.Countries 0.773
Geography.Oceania 0.86
Culture.Arts 0.928
Culture.Performing arts 0.933
STEM.Mathematics 0.88
Geography.Cities 0.713
STEM.Biology 0.767
Culture.Crafts and hobbies 0.823
STEM.Technology 0.596
Culture.Visual arts 0.801
------------------------------------------- -----
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment