Skip to content

Instantly share code, notes, and snippets.

@ivmarkp

ivmarkp/adhoceval_pl2.txt

Last active July 26, 2016 06:19
Show Gist options
  • Save ivmarkp/d31b684462d47ac435fe7f2f632f94cf to your computer and use it in GitHub Desktop.
Save ivmarkp/d31b684462d47ac435fe7f2f632f94cf to your computer and use it in GitHub Desktop.
Download ZIP
Evaluation results of PL2 weighting scheme with config file attached to see what parameters are in use.
Raw
adhoceval_pl2.txt
Result for the run: xapianpl2
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.00917974
-----------------------------------------------------
Precision of Query: 127 is : 0.000275786
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
Precision of Query: 129 is : 0.263143
-----------------------------------------------------
Precision of Query: 130 is : 0.189916
-----------------------------------------------------
Precision of Query: 131 is : 0
-----------------------------------------------------
Precision of Query: 132 is : 0.00309427
-----------------------------------------------------
Precision of Query: 133 is : 0.316756
-----------------------------------------------------
Precision of Query: 134 is : 0
-----------------------------------------------------
Precision of Query: 135 is : 0
-----------------------------------------------------
Precision of Query: 136 is : 0
-----------------------------------------------------
Precision of Query: 137 is : 0.0220671
-----------------------------------------------------
Precision of Query: 138 is : 0.139634
-----------------------------------------------------
Precision of Query: 139 is : 0.0533167
-----------------------------------------------------
Precision of Query: 140 is : 6.6454e-05
-----------------------------------------------------
Precision of Query: 141 is : 0.220369
-----------------------------------------------------
Precision of Query: 142 is : 0
-----------------------------------------------------
Precision of Query: 143 is : 0
-----------------------------------------------------
Precision of Query: 144 is : 0
-----------------------------------------------------
Precision of Query: 145 is : 0.000705435
-----------------------------------------------------
Precision of Query: 146 is : 0.000274807
-----------------------------------------------------
Precision of Query: 147 is : 0
-----------------------------------------------------
Precision of Query: 148 is : 0.0465843
-----------------------------------------------------
Precision of Query: 149 is : 0
-----------------------------------------------------
Precision of Query: 150 is : 0.100941
-----------------------------------------------------
Precision of Query: 151 is : 0.0258466
-----------------------------------------------------
Precision of Query: 152 is : 0.221465
-----------------------------------------------------
Precision of Query: 153 is : 0
-----------------------------------------------------
Precision of Query: 154 is : 0.133945
-----------------------------------------------------
Precision of Query: 155 is : 0.00634921
-----------------------------------------------------
Precision of Query: 156 is : 0.456469
-----------------------------------------------------
Precision of Query: 157 is : 0
-----------------------------------------------------
Precision of Query: 158 is : 0
-----------------------------------------------------
Precision of Query: 159 is : 0
-----------------------------------------------------
Precision of Query: 160 is : 0
-----------------------------------------------------
Precision of Query: 161 is : 0.00163666
-----------------------------------------------------
Precision of Query: 162 is : 0
-----------------------------------------------------
Precision of Query: 163 is : 0.000629716
-----------------------------------------------------
Precision of Query: 164 is : 0.729535
-----------------------------------------------------
Precision of Query: 165 is : 0.10985
-----------------------------------------------------
Precision of Query: 166 is : 0.454153
-----------------------------------------------------
Precision of Query: 167 is : 0
-----------------------------------------------------
Precision of Query: 168 is : 0.0840534
-----------------------------------------------------
Precision of Query: 169 is : 0
-----------------------------------------------------
Precision of Query: 170 is : 0
-----------------------------------------------------
Precision of Query: 171 is : 0.0678146
-----------------------------------------------------
Precision of Query: 172 is : 0.0657
-----------------------------------------------------
Precision of Query: 173 is : 0
-----------------------------------------------------
Precision of Query: 174 is : 0
-----------------------------------------------------
Precision of Query: 175 is : 0.114724
-----------------------------------------------------
_______________________________________________________
Evaluation:
_______________________________________________________
Number of Queries: 50
-----------------------------------------------------
Retrieved: 20000
-----------------------------------------------------
Relevant Retrieved: 633
-----------------------------------------------------
Relevant in Qrel: 2761
_______________________________________________________
Mean Evaluation:
_______________________________________________________
Mean Average Precision : 0.0752646
-----------------------------------------------------
Mean Relevance Precision : 1.39228e+192
_______________________________________________________
Precision At Rank:
_______________________________________________________
Precision at Rank: 1 is: 0.08
-----------------------------------------------------
Precision at Rank: 2 is: 0.12
-----------------------------------------------------
Precision at Rank: 3 is: 0.124444
-----------------------------------------------------
Precision at Rank: 4 is: 0.118333
-----------------------------------------------------
Precision at Rank: 5 is: 0.108267
-----------------------------------------------------
Precision at Rank: 10 is: 0.0992778
-----------------------------------------------------
Precision at Rank: 15 is: 0.0875033
-----------------------------------------------------
Precision at Rank: 20 is: 0.078186
-----------------------------------------------------
Precision at Rank: 30 is: 0.0682913
-----------------------------------------------------
Precision at Rank: 50 is: 0.0552228
-----------------------------------------------------
Precision at Rank: 100 is: 0.0416878
-----------------------------------------------------
Precision at Rank: 200 is: 0.0253087
-----------------------------------------------------
Precision at Rank: 500 is: 0.0101235
-----------------------------------------------------
Precision at Rank: 1000 is: 0.00506174
-----------------------------------------------------
_______________________________________________________
Precision At Recall:
_______________________________________________________
Precision at Recall: 0 is: 0.310709
-----------------------------------------------------
Precision at Recall: 10 is: 0.288724
-----------------------------------------------------
Precision at Recall: 20 is: 0.235695
-----------------------------------------------------
Precision at Recall: 30 is: 0.179979
-----------------------------------------------------
Precision at Recall: 40 is: 0.140713
-----------------------------------------------------
Precision at Recall: 50 is: 0.123953
-----------------------------------------------------
Precision at Recall: 60 is: 0.109761
-----------------------------------------------------
Precision at Recall: 70 is: 0.060424
-----------------------------------------------------
Precision at Recall: 80 is: 0.0522467
-----------------------------------------------------
Precision at Recall: 90 is: 0.00416667
-----------------------------------------------------
Precision at Recall: 100 is: 0.00170543
-----------------------------------------------------
Raw
config
textfile /home/vivek/Downloads/FIREData/2011/en.docs.2011/
language english
db /home/vivek/Downloads/index
runname xapianpl2
stopsfile /home/vivek/Downloads/stopwords.txt
noresults 200
indexbigram true
queryparsebigram true
weightingscheme pl2
pl2param_c 1.0
topicfile /home/vivek/Downloads/en.topics.126-175.2011.txt
queryfile /home/vivek/Downloads/en_query_run_1.txt
relfile /home/vivek/Downloads/en.qrels.126-175.2011.txt
resultsfile /home/vivek/Downloads/en_result_file_1_pl2.txt
transfile /home/vivek/Downloads/en_transaction_file_1_pl2.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment