Skip to content

Instantly share code, notes, and snippets.

@ivmarkp

ivmarkp/adhoceval_bm25plus.txt

Created July 25, 2016 11:10
Show Gist options
  • Save ivmarkp/232abdd2153a1b1aa617832fe741584e to your computer and use it in GitHub Desktop.
Save ivmarkp/232abdd2153a1b1aa617832fe741584e to your computer and use it in GitHub Desktop.
Download ZIP
Evaluation results of BM25+ weighting scheme with config file attached to see what parameters are in use.
Raw
adhoceval_bm25plus.txt
Result for the run: xapianbm25plus
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.0251299
-----------------------------------------------------
Precision of Query: 127 is : 0.000690923
-----------------------------------------------------
Precision of Query: 128 is : 0.000126502
-----------------------------------------------------
Precision of Query: 129 is : 0.370415
-----------------------------------------------------
Precision of Query: 130 is : 0.333644
-----------------------------------------------------
Precision of Query: 131 is : 0
-----------------------------------------------------
Precision of Query: 132 is : 0.00420437
-----------------------------------------------------
Precision of Query: 133 is : 0.288557
-----------------------------------------------------
Precision of Query: 134 is : 0
-----------------------------------------------------
Precision of Query: 135 is : 0
-----------------------------------------------------
Precision of Query: 136 is : 0
-----------------------------------------------------
Precision of Query: 137 is : 0.257589
-----------------------------------------------------
Precision of Query: 138 is : 0.00632234
-----------------------------------------------------
Precision of Query: 139 is : 0.132476
-----------------------------------------------------
Precision of Query: 140 is : 0
-----------------------------------------------------
Precision of Query: 141 is : 0.258416
-----------------------------------------------------
Precision of Query: 142 is : 0
-----------------------------------------------------
Precision of Query: 143 is : 0
-----------------------------------------------------
Precision of Query: 144 is : 0
-----------------------------------------------------
Precision of Query: 145 is : 0.00461397
-----------------------------------------------------
Precision of Query: 146 is : 0.0186292
-----------------------------------------------------
Precision of Query: 147 is : 0
-----------------------------------------------------
Precision of Query: 148 is : 0
-----------------------------------------------------
Precision of Query: 149 is : 0
-----------------------------------------------------
Precision of Query: 150 is : 0.0902778
-----------------------------------------------------
Precision of Query: 151 is : 0.0670799
-----------------------------------------------------
Precision of Query: 152 is : 0.144107
-----------------------------------------------------
Precision of Query: 153 is : 0.0064086
-----------------------------------------------------
Precision of Query: 154 is : 0.25427
-----------------------------------------------------
Precision of Query: 155 is : 0.0768715
-----------------------------------------------------
Precision of Query: 156 is : 0.627688
-----------------------------------------------------
Precision of Query: 157 is : 0
-----------------------------------------------------
Precision of Query: 158 is : 0
-----------------------------------------------------
Precision of Query: 159 is : 0.00644643
-----------------------------------------------------
Precision of Query: 160 is : 0
-----------------------------------------------------
Precision of Query: 161 is : 0.0212766
-----------------------------------------------------
Precision of Query: 162 is : 0
-----------------------------------------------------
Precision of Query: 163 is : 0.00513101
-----------------------------------------------------
Precision of Query: 164 is : 0.781538
-----------------------------------------------------
Precision of Query: 165 is : 0.108052
-----------------------------------------------------
Precision of Query: 166 is : 0.684767
-----------------------------------------------------
Precision of Query: 167 is : 0
-----------------------------------------------------
Precision of Query: 168 is : 0.0683546
-----------------------------------------------------
Precision of Query: 169 is : 0
-----------------------------------------------------
Precision of Query: 170 is : 0
-----------------------------------------------------
Precision of Query: 171 is : 0.0734934
-----------------------------------------------------
Precision of Query: 172 is : 0.358236
-----------------------------------------------------
Precision of Query: 173 is : 0
-----------------------------------------------------
Precision of Query: 174 is : 0.00110149
-----------------------------------------------------
Precision of Query: 175 is : 0.0452393
-----------------------------------------------------
_______________________________________________________
Evaluation:
_______________________________________________________
Number of Queries: 50
-----------------------------------------------------
Retrieved: 20000
-----------------------------------------------------
Relevant Retrieved: 742
-----------------------------------------------------
Relevant in Qrel: 2761
_______________________________________________________
Mean Evaluation:
_______________________________________________________
Mean Average Precision : 0.100415
-----------------------------------------------------
Mean Relevance Precision : 9.47764e+231
_______________________________________________________
Precision At Rank:
_______________________________________________________
Precision at Rank: 1 is: 0.16
-----------------------------------------------------
Precision at Rank: 2 is: 0.16
-----------------------------------------------------
Precision at Rank: 3 is: 0.151111
-----------------------------------------------------
Precision at Rank: 4 is: 0.148333
-----------------------------------------------------
Precision at Rank: 5 is: 0.138667
-----------------------------------------------------
Precision at Rank: 10 is: 0.120777
-----------------------------------------------------
Precision at Rank: 15 is: 0.106306
-----------------------------------------------------
Precision at Rank: 20 is: 0.0989424
-----------------------------------------------------
Precision at Rank: 30 is: 0.0898074
-----------------------------------------------------
Precision at Rank: 50 is: 0.0762443
-----------------------------------------------------
Precision at Rank: 100 is: 0.0550334
-----------------------------------------------------
Precision at Rank: 200 is: 0.0329567
-----------------------------------------------------
Precision at Rank: 500 is: 0.0131827
-----------------------------------------------------
Precision at Rank: 1000 is: 0.00659134
-----------------------------------------------------
_______________________________________________________
Precision At Recall:
_______________________________________________________
Precision at Recall: 0 is: 0.428575
-----------------------------------------------------
Precision at Recall: 10 is: 0.311313
-----------------------------------------------------
Precision at Recall: 20 is: 0.271245
-----------------------------------------------------
Precision at Recall: 30 is: 0.236449
-----------------------------------------------------
Precision at Recall: 40 is: 0.186381
-----------------------------------------------------
Precision at Recall: 50 is: 0.192664
-----------------------------------------------------
Precision at Recall: 60 is: 0.143716
-----------------------------------------------------
Precision at Recall: 70 is: 0.125621
-----------------------------------------------------
Precision at Recall: 80 is: 0.0718999
-----------------------------------------------------
Precision at Recall: 90 is: 0.0280847
-----------------------------------------------------
Precision at Recall: 100 is: 0.00752778
-----------------------------------------------------
Raw
config
textfile /home/vivek/Downloads/FIREData/2011/en.docs.2011/
language english
db /home/vivek/Downloads/index/
runname xapianbm25plus
stopsfile /home/vivek/Downloads/stopwords.txt
noresults 200
indexbigram true
queryparsebigram true
weightingscheme bm25plus
bm25plusparam_k1 1.0
bm25plusparam_k2 0
bm25plusparam_k3 1.0
bm25plusparam_b 0.5
bm25plusparam_min_normlen 0.5
bm25plusparam_delta 1.0
topicfile /home/vivek/Downloads/en.topics.126-175.2011.txt
queryfile /home/vivek/Downloads/en_query_run_1.txt
relfile /home/vivek/Downloads/en.qrels.126-175.2011.txt
resultsfile /home/vivek/Downloads/en_result_file_1_bm25plus.txt
transfile /home/vivek/Downloads/en.transaction_file_1_bm25plus.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment