Skip to content

Instantly share code, notes, and snippets.

@codez266

codez266/random_forest_drafttopic

Created January 14, 2018 14:57
Show Gist options
  • Save codez266/c3c57df36915cab179fd833c06f9f02f to your computer and use it in GitHub Desktop.
Save codez266/c3c57df36915cab179fd833c06f9f02f to your computer and use it in GitHub Desktop.
Download ZIP
RandomForest statistics on drafttopic full dataset
Raw
random_forest_drafttopic
Statistics:
counts (n=93415):
label n TP FP FN TN
--------------------------------------------- ----- --- ----- ---- ----- -----
'STEM.Time' 2382 --> 1904 478 4702 86331
'STEM.Physics' 2633 --> 2411 222 7577 83205
'STEM.Space' 2522 --> 2381 141 2824 88069
'STEM.Mathematics' 1659 --> 1462 197 5666 86090
'Culture.Crafts and hobbies' 2150 --> 1754 396 2419 88846
'History_And_Society.Transportation' 4276 --> 3711 565 2520 86619
'Geography.Maps' 2552 --> 2141 411 7840 83023
'Culture.Internet culture' 2150 --> 1998 152 6556 84709
'History_And_Society.Business and economics' 6583 --> 5415 1168 9478 77354
'Assistance.Article improvement and grading' 71 --> 25 46 2 93342
'STEM.Biology' 3437 --> 2687 750 5108 84870
'STEM.Science' 2310 --> 1932 378 16229 74876
'STEM.Technology' 4283 --> 3553 730 11153 77979
'Geography.Countries' 25576 --> 18751 6825 13678 54161
'Culture.Media' 2206 --> 1961 245 13160 78049
'History_And_Society.History and society' 7582 --> 5745 1837 20892 64941
'Assistance.Contents systems' 2083 --> 1444 639 6686 84646
'Culture.Broadcasting' 3322 --> 2977 345 6555 83538
'Assistance.Maintenance' 6392 --> 3337 3055 6625 80398
'Culture.Food and drink' 2472 --> 2088 384 876 90067
'History_And_Society.Military and warfare' 4395 --> 3736 659 3663 85357
'Culture.Philosophy and religion' 4116 --> 3294 822 8213 81086
'Geography.Oceania' 4212 --> 3463 749 5507 83696
'Culture.Plastic arts' 3924 --> 3370 554 6058 83433
'History_And_Society.Education' 2781 --> 2360 421 3921 86713
'STEM.Engineering' 2378 --> 1960 418 10540 80497
'Culture.Visual arts' 4871 --> 4432 439 9091 79453
'STEM.Meteorology' 2118 --> 1873 245 793 90504
'Culture.Language and literature' 20527 --> 18239 2288 15860 57028
'Geography.Landforms' 2229 --> 2112 117 3323 87863
'Culture.Entertainment' 6185 --> 5496 689 7483 79747
'STEM.Medicine' 2513 --> 2112 401 3632 87270
'Geography.Bodies of water' 2336 --> 2122 214 2495 88584
'STEM.Information science' 2136 --> 1812 324 4920 86359
'Culture.Sports' 5027 --> 4516 511 1471 86917
'Geography.Europe' 16102 --> 12577 3525 13024 64289
'History_And_Society.Politics and government' 4371 --> 3728 643 10110 78934
'Geography.Cities' 821 --> 639 182 1554 91040
'STEM.Geosciences' 2085 --> 1802 283 6367 84963
'Culture.Performing arts' 4721 --> 4191 530 1363 87331
'Culture.Arts' 2079 --> 1951 128 4059 87277
'STEM.Chemistry' 2519 --> 2305 214 4116 86780
'Assistance.Files' 374 --> 225 149 13512 79529
rates:
'STEM.Time' 'STEM.Physics' 'STEM.Space' 'STEM.Mathematics' 'Culture.Crafts and hobbies' 'History_And_Society.Transportation' 'Geography.Maps' 'Culture.Internet culture' 'History_And_Society.Business and economics' 'Assistance.Article improvement and grading' 'STEM.Biology' 'STEM.Science' 'STEM.Technology' 'Geography.Countries' 'Culture.Media' 'History_And_Society.History and society' 'Assistance.Contents systems' 'Culture.Broadcasting' 'Assistance.Maintenance' 'Culture.Food and drink' 'History_And_Society.Military and warfare' 'Culture.Philosophy and religion' 'Geography.Oceania' 'Culture.Plastic arts' 'History_And_Society.Education' 'STEM.Engineering' 'Culture.Visual arts' 'STEM.Meteorology' 'Culture.Language and literature' 'Geography.Landforms' 'Culture.Entertainment' 'STEM.Medicine' 'Geography.Bodies of water' 'STEM.Information science' 'Culture.Sports' 'Geography.Europe' 'History_And_Society.Politics and government' 'Geography.Cities' 'STEM.Geosciences' 'Culture.Performing arts' 'Culture.Arts' 'STEM.Chemistry' 'Assistance.Files'
------ ------------- ---------------- -------------- -------------------- ------------------------------ -------------------------------------- ------------------ ---------------------------- ---------------------------------------------- ---------------------------------------------- ---------------- ---------------- ------------------- ----------------------- ----------------- ------------------------------------------- ------------------------------- ------------------------ -------------------------- -------------------------- -------------------------------------------- ----------------------------------- --------------------- ------------------------ --------------------------------- -------------------- ----------------------- -------------------- ----------------------------------- ----------------------- ------------------------- ----------------- ----------------------------- ---------------------------- ------------------ -------------------- ----------------------------------------------- -------------------- -------------------- --------------------------- ---------------- ------------------ --------------------
sample 0.025 0.028 0.027 0.018 0.023 0.046 0.027 0.023 0.07 0.001 0.037 0.025 0.046 0.274 0.024 0.081 0.022 0.036 0.068 0.026 0.047 0.044 0.045 0.042 0.03 0.025 0.052 0.023 0.22 0.024 0.066 0.027 0.025 0.023 0.054 0.172 0.047 0.009 0.022 0.051 0.022 0.027 0.004
match_rate (micro=0.183, macro=0.111):
------------------------------------------- -----
Geography.Cities 0.023
Culture.Philosophy and religion 0.123
Assistance.Contents systems 0.087
STEM.Geosciences 0.087
Culture.Entertainment 0.139
Geography.Oceania 0.096
History_And_Society.Education 0.067
Culture.Media 0.162
STEM.Science 0.194
STEM.Engineering 0.134
Geography.Bodies of water 0.049
Culture.Language and literature 0.365
STEM.Technology 0.157
STEM.Space 0.056
History_And_Society.Transportation 0.067
History_And_Society.Military and warfare 0.079
STEM.Mathematics 0.076
Assistance.Files 0.147
Culture.Arts 0.064
Culture.Food and drink 0.032
History_And_Society.Business and economics 0.159
STEM.Meteorology 0.029
Culture.Performing arts 0.059
Geography.Europe 0.274
Culture.Internet culture 0.092
Culture.Broadcasting 0.102
STEM.Medicine 0.061
STEM.Chemistry 0.069
Culture.Plastic arts 0.101
Geography.Landforms 0.058
Culture.Visual arts 0.145
History_And_Society.Politics and government 0.148
Assistance.Article improvement and grading 0
Geography.Maps 0.107
STEM.Biology 0.083
Culture.Crafts and hobbies 0.045
STEM.Information science 0.072
STEM.Time 0.071
History_And_Society.History and society 0.285
Assistance.Maintenance 0.107
STEM.Physics 0.107
Geography.Countries 0.347
Culture.Sports 0.064
------------------------------------------- -----
filter_rate (micro=0.817, macro=0.889):
------------------------------------------- -----
Geography.Cities 0.977
Culture.Philosophy and religion 0.877
Assistance.Contents systems 0.913
STEM.Geosciences 0.913
Culture.Entertainment 0.861
Geography.Oceania 0.904
History_And_Society.Education 0.933
Culture.Media 0.838
STEM.Science 0.806
STEM.Engineering 0.866
Geography.Bodies of water 0.951
Culture.Language and literature 0.635
STEM.Technology 0.843
STEM.Space 0.944
History_And_Society.Transportation 0.933
History_And_Society.Military and warfare 0.921
STEM.Mathematics 0.924
Assistance.Files 0.853
Culture.Arts 0.936
Culture.Food and drink 0.968
History_And_Society.Business and economics 0.841
STEM.Meteorology 0.971
Culture.Performing arts 0.941
Geography.Europe 0.726
Culture.Internet culture 0.908
Culture.Broadcasting 0.898
STEM.Medicine 0.939
STEM.Chemistry 0.931
Culture.Plastic arts 0.899
Geography.Landforms 0.942
Culture.Visual arts 0.855
History_And_Society.Politics and government 0.852
Assistance.Article improvement and grading 1
Geography.Maps 0.893
STEM.Biology 0.917
Culture.Crafts and hobbies 0.955
STEM.Information science 0.928
STEM.Time 0.929
History_And_Society.History and society 0.715
Assistance.Maintenance 0.893
STEM.Physics 0.893
Geography.Countries 0.653
Culture.Sports 0.936
------------------------------------------- -----
recall (micro=0.823, macro=0.828):
------------------------------------------- -----
Geography.Cities 0.778
Culture.Philosophy and religion 0.8
Assistance.Contents systems 0.693
STEM.Geosciences 0.864
Culture.Entertainment 0.889
Geography.Oceania 0.822
History_And_Society.Education 0.849
Culture.Media 0.889
STEM.Science 0.836
STEM.Engineering 0.824
Geography.Bodies of water 0.908
Culture.Language and literature 0.889
STEM.Technology 0.83
STEM.Space 0.944
History_And_Society.Transportation 0.868
History_And_Society.Military and warfare 0.85
STEM.Mathematics 0.881
Assistance.Files 0.602
Culture.Arts 0.938
Culture.Food and drink 0.845
History_And_Society.Business and economics 0.823
STEM.Meteorology 0.884
Culture.Performing arts 0.888
Geography.Europe 0.781
Culture.Internet culture 0.929
Culture.Broadcasting 0.896
STEM.Medicine 0.84
STEM.Chemistry 0.915
Culture.Plastic arts 0.859
Geography.Landforms 0.948
Culture.Visual arts 0.91
History_And_Society.Politics and government 0.853
Assistance.Article improvement and grading 0.352
Geography.Maps 0.839
STEM.Biology 0.782
Culture.Crafts and hobbies 0.816
STEM.Information science 0.848
STEM.Time 0.799
History_And_Society.History and society 0.758
Assistance.Maintenance 0.522
STEM.Physics 0.916
Geography.Countries 0.733
Culture.Sports 0.898
------------------------------------------- -----
!recall (micro=0.882, macro=0.922):
------------------------------------------- -----
Geography.Cities 0.983
Culture.Philosophy and religion 0.908
Assistance.Contents systems 0.927
STEM.Geosciences 0.93
Culture.Entertainment 0.914
Geography.Oceania 0.938
History_And_Society.Education 0.957
Culture.Media 0.856
STEM.Science 0.822
STEM.Engineering 0.884
Geography.Bodies of water 0.973
Culture.Language and literature 0.782
STEM.Technology 0.875
STEM.Space 0.969
History_And_Society.Transportation 0.972
History_And_Society.Military and warfare 0.959
STEM.Mathematics 0.938
Assistance.Files 0.855
Culture.Arts 0.956
Culture.Food and drink 0.99
History_And_Society.Business and economics 0.891
STEM.Meteorology 0.991
Culture.Performing arts 0.985
Geography.Europe 0.832
Culture.Internet culture 0.928
Culture.Broadcasting 0.927
STEM.Medicine 0.96
STEM.Chemistry 0.955
Culture.Plastic arts 0.932
Geography.Landforms 0.964
Culture.Visual arts 0.897
History_And_Society.Politics and government 0.886
Assistance.Article improvement and grading 1
Geography.Maps 0.914
STEM.Biology 0.943
Culture.Crafts and hobbies 0.973
STEM.Information science 0.946
STEM.Time 0.948
History_And_Society.History and society 0.757
Assistance.Maintenance 0.924
STEM.Physics 0.917
Geography.Countries 0.798
Culture.Sports 0.983
------------------------------------------- -----
precision (micro=0.427, macro=0.375):
------------------------------------------- -----
Geography.Cities 0.291
Culture.Philosophy and religion 0.286
Assistance.Contents systems 0.178
STEM.Geosciences 0.221
Culture.Entertainment 0.423
Geography.Oceania 0.386
History_And_Society.Education 0.376
Culture.Media 0.13
STEM.Science 0.106
STEM.Engineering 0.157
Geography.Bodies of water 0.46
Culture.Language and literature 0.535
STEM.Technology 0.242
STEM.Space 0.457
History_And_Society.Transportation 0.596
History_And_Society.Military and warfare 0.505
STEM.Mathematics 0.205
Assistance.Files 0.016
Culture.Arts 0.325
Culture.Food and drink 0.704
History_And_Society.Business and economics 0.364
STEM.Meteorology 0.703
Culture.Performing arts 0.755
Geography.Europe 0.491
Culture.Internet culture 0.234
Culture.Broadcasting 0.312
STEM.Medicine 0.368
STEM.Chemistry 0.359
Culture.Plastic arts 0.357
Geography.Landforms 0.389
Culture.Visual arts 0.328
History_And_Society.Politics and government 0.269
Assistance.Article improvement and grading 0.926
Geography.Maps 0.215
STEM.Biology 0.345
Culture.Crafts and hobbies 0.42
STEM.Information science 0.269
STEM.Time 0.288
History_And_Society.History and society 0.216
Assistance.Maintenance 0.335
STEM.Physics 0.241
Geography.Countries 0.578
Culture.Sports 0.754
------------------------------------------- -----
!precision (micro=0.97, macro=0.989):
------------------------------------------- -----
Geography.Cities 0.998
Culture.Philosophy and religion 0.99
Assistance.Contents systems 0.993
STEM.Geosciences 0.997
Culture.Entertainment 0.991
Geography.Oceania 0.991
History_And_Society.Education 0.995
Culture.Media 0.997
STEM.Science 0.995
STEM.Engineering 0.995
Geography.Bodies of water 0.998
Culture.Language and literature 0.961
STEM.Technology 0.991
STEM.Space 0.998
History_And_Society.Transportation 0.994
History_And_Society.Military and warfare 0.992
STEM.Mathematics 0.998
Assistance.Files 0.998
Culture.Arts 0.999
Culture.Food and drink 0.996
History_And_Society.Business and economics 0.985
STEM.Meteorology 0.997
Culture.Performing arts 0.994
Geography.Europe 0.948
Culture.Internet culture 0.998
Culture.Broadcasting 0.996
STEM.Medicine 0.995
STEM.Chemistry 0.998
Culture.Plastic arts 0.993
Geography.Landforms 0.999
Culture.Visual arts 0.995
History_And_Society.Politics and government 0.992
Assistance.Article improvement and grading 1
Geography.Maps 0.995
STEM.Biology 0.991
Culture.Crafts and hobbies 0.996
STEM.Information science 0.996
STEM.Time 0.994
History_And_Society.History and society 0.972
Assistance.Maintenance 0.963
STEM.Physics 0.997
Geography.Countries 0.888
Culture.Sports 0.994
------------------------------------------- -----
f1 (micro=0.544, macro=0.484):
------------------------------------------- -----
Geography.Cities 0.424
Culture.Philosophy and religion 0.422
Assistance.Contents systems 0.283
STEM.Geosciences 0.351
Culture.Entertainment 0.574
Geography.Oceania 0.525
History_And_Society.Education 0.521
Culture.Media 0.226
STEM.Science 0.189
STEM.Engineering 0.263
Geography.Bodies of water 0.61
Culture.Language and literature 0.668
STEM.Technology 0.374
STEM.Space 0.616
History_And_Society.Transportation 0.706
History_And_Society.Military and warfare 0.634
STEM.Mathematics 0.333
Assistance.Files 0.032
Culture.Arts 0.482
Culture.Food and drink 0.768
History_And_Society.Business and economics 0.504
STEM.Meteorology 0.783
Culture.Performing arts 0.816
Geography.Europe 0.603
Culture.Internet culture 0.373
Culture.Broadcasting 0.463
STEM.Medicine 0.512
STEM.Chemistry 0.516
Culture.Plastic arts 0.505
Geography.Landforms 0.551
Culture.Visual arts 0.482
History_And_Society.Politics and government 0.409
Assistance.Article improvement and grading 0.51
Geography.Maps 0.342
STEM.Biology 0.478
Culture.Crafts and hobbies 0.555
STEM.Information science 0.409
STEM.Time 0.424
History_And_Society.History and society 0.336
Assistance.Maintenance 0.408
STEM.Physics 0.382
Geography.Countries 0.647
Culture.Sports 0.82
------------------------------------------- -----
!f1 (micro=0.923, macro=0.954):
------------------------------------------- -----
Geography.Cities 0.991
Culture.Philosophy and religion 0.947
Assistance.Contents systems 0.959
STEM.Geosciences 0.962
Culture.Entertainment 0.951
Geography.Oceania 0.964
History_And_Society.Education 0.976
Culture.Media 0.921
STEM.Science 0.9
STEM.Engineering 0.936
Geography.Bodies of water 0.985
Culture.Language and literature 0.863
STEM.Technology 0.929
STEM.Space 0.983
History_And_Society.Transportation 0.983
History_And_Society.Military and warfare 0.975
STEM.Mathematics 0.967
Assistance.Files 0.921
Culture.Arts 0.977
Culture.Food and drink 0.993
History_And_Society.Business and economics 0.936
STEM.Meteorology 0.994
Culture.Performing arts 0.989
Geography.Europe 0.886
Culture.Internet culture 0.962
Culture.Broadcasting 0.96
STEM.Medicine 0.977
STEM.Chemistry 0.976
Culture.Plastic arts 0.962
Geography.Landforms 0.981
Culture.Visual arts 0.943
History_And_Society.Politics and government 0.936
Assistance.Article improvement and grading 1
Geography.Maps 0.953
STEM.Biology 0.967
Culture.Crafts and hobbies 0.984
STEM.Information science 0.971
STEM.Time 0.971
History_And_Society.History and society 0.851
Assistance.Maintenance 0.943
STEM.Physics 0.955
Geography.Countries 0.841
Culture.Sports 0.989
------------------------------------------- -----
accuracy (micro=0.879, macro=0.919):
------------------------------------------- -----
Geography.Cities 0.981
Culture.Philosophy and religion 0.903
Assistance.Contents systems 0.922
STEM.Geosciences 0.929
Culture.Entertainment 0.913
Geography.Oceania 0.933
History_And_Society.Education 0.954
Culture.Media 0.857
STEM.Science 0.822
STEM.Engineering 0.883
Geography.Bodies of water 0.971
Culture.Language and literature 0.806
STEM.Technology 0.873
STEM.Space 0.968
History_And_Society.Transportation 0.967
History_And_Society.Military and warfare 0.954
STEM.Mathematics 0.937
Assistance.Files 0.854
Culture.Arts 0.955
Culture.Food and drink 0.987
History_And_Society.Business and economics 0.886
STEM.Meteorology 0.989
Culture.Performing arts 0.98
Geography.Europe 0.823
Culture.Internet culture 0.928
Culture.Broadcasting 0.926
STEM.Medicine 0.957
STEM.Chemistry 0.954
Culture.Plastic arts 0.929
Geography.Landforms 0.963
Culture.Visual arts 0.898
History_And_Society.Politics and government 0.885
Assistance.Article improvement and grading 0.999
Geography.Maps 0.912
STEM.Biology 0.937
Culture.Crafts and hobbies 0.97
STEM.Information science 0.944
STEM.Time 0.945
History_And_Society.History and society 0.757
Assistance.Maintenance 0.896
STEM.Physics 0.917
Geography.Countries 0.781
Culture.Sports 0.979
------------------------------------------- -----
fpr (micro=0.118, macro=0.078):
------------------------------------------- -----
Geography.Cities 0.017
Culture.Philosophy and religion 0.092
Assistance.Contents systems 0.073
STEM.Geosciences 0.07
Culture.Entertainment 0.086
Geography.Oceania 0.062
History_And_Society.Education 0.043
Culture.Media 0.144
STEM.Science 0.178
STEM.Engineering 0.116
Geography.Bodies of water 0.027
Culture.Language and literature 0.218
STEM.Technology 0.125
STEM.Space 0.031
History_And_Society.Transportation 0.028
History_And_Society.Military and warfare 0.041
STEM.Mathematics 0.062
Assistance.Files 0.145
Culture.Arts 0.044
Culture.Food and drink 0.01
History_And_Society.Business and economics 0.109
STEM.Meteorology 0.009
Culture.Performing arts 0.015
Geography.Europe 0.168
Culture.Internet culture 0.072
Culture.Broadcasting 0.073
STEM.Medicine 0.04
STEM.Chemistry 0.045
Culture.Plastic arts 0.068
Geography.Landforms 0.036
Culture.Visual arts 0.103
History_And_Society.Politics and government 0.114
Assistance.Article improvement and grading 0
Geography.Maps 0.086
STEM.Biology 0.057
Culture.Crafts and hobbies 0.027
STEM.Information science 0.054
STEM.Time 0.052
History_And_Society.History and society 0.243
Assistance.Maintenance 0.076
STEM.Physics 0.083
Geography.Countries 0.202
Culture.Sports 0.017
------------------------------------------- -----
roc_auc (micro=0.919, macro=0.939):
------------------------------------------- -----
Geography.Cities 0.975
Culture.Philosophy and religion 0.93
Assistance.Contents systems 0.89
STEM.Geosciences 0.963
Culture.Entertainment 0.962
Geography.Oceania 0.945
History_And_Society.Education 0.965
Culture.Media 0.935
STEM.Science 0.906
STEM.Engineering 0.931
Geography.Bodies of water 0.98
Culture.Language and literature 0.913
STEM.Technology 0.925
STEM.Space 0.989
History_And_Society.Transportation 0.97
History_And_Society.Military and warfare 0.965
STEM.Mathematics 0.968
Assistance.Files 0.833
Culture.Arts 0.983
Culture.Food and drink 0.976
History_And_Society.Business and economics 0.932
STEM.Meteorology 0.983
Culture.Performing arts 0.98
Geography.Europe 0.884
Culture.Internet culture 0.975
Culture.Broadcasting 0.968
STEM.Medicine 0.965
STEM.Chemistry 0.978
Culture.Plastic arts 0.96
Geography.Landforms 0.985
Culture.Visual arts 0.962
History_And_Society.Politics and government 0.936
Assistance.Article improvement and grading 0.822
Geography.Maps 0.947
STEM.Biology 0.937
Culture.Crafts and hobbies 0.955
STEM.Information science 0.963
STEM.Time 0.931
History_And_Society.History and society 0.839
Assistance.Maintenance 0.777
STEM.Physics 0.969
Geography.Countries 0.842
Culture.Sports 0.966
------------------------------------------- -----
pr_auc (micro=0.662, macro=0.646):
------------------------------------------- -----
Geography.Cities 0.685
Culture.Philosophy and religion 0.588
Assistance.Contents systems 0.357
STEM.Geosciences 0.699
Culture.Entertainment 0.725
Geography.Oceania 0.723
History_And_Society.Education 0.741
Culture.Media 0.31
STEM.Science 0.264
STEM.Engineering 0.366
Geography.Bodies of water 0.864
Culture.Language and literature 0.737
STEM.Technology 0.483
STEM.Space 0.92
History_And_Society.Transportation 0.826
History_And_Society.Military and warfare 0.773
STEM.Mathematics 0.633
Assistance.Files 0.022
Culture.Arts 0.795
Culture.Food and drink 0.854
History_And_Society.Business and economics 0.617
STEM.Meteorology 0.904
Culture.Performing arts 0.898
Geography.Europe 0.64
Culture.Internet culture 0.649
Culture.Broadcasting 0.662
STEM.Medicine 0.705
STEM.Chemistry 0.756
Culture.Plastic arts 0.718
Geography.Landforms 0.845
Culture.Visual arts 0.677
History_And_Society.Politics and government 0.513
Assistance.Article improvement and grading 0.486
Geography.Maps 0.637
STEM.Biology 0.644
Culture.Crafts and hobbies 0.769
STEM.Information science 0.706
STEM.Time 0.695
History_And_Society.History and society 0.346
Assistance.Maintenance 0.431
STEM.Physics 0.6
Geography.Countries 0.668
Culture.Sports 0.867
------------------------------------------- -----
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment