Skip to content

Instantly share code, notes, and snippets.

View ivmarkp's full-sized avatar

Vivek Pal ivmarkp

11 followers · 57 following
  • New Delhi, India
View GitHub Profile
@ivmarkp
ivmarkp / README.rst
Last active August 7, 2016 13:49

Running evaluations

Following are the steps to help getting started with running evaluations of inbuilt weighting schemes in Xapian, i.e. BM25, PL2, LMWeight etc. along with the new ones, i.e. BM25+, PL2+ etc.

1. Open up terminal and type :: git clone https://github.com/samuelharden/xapian-evaluation.git

@ivmarkp
ivmarkp / adhoceval_tfidf_Ptn.txt
Created August 7, 2016 13:47
Evaluation results of "'Ptn" normalization of TfIdfWeight which basically represents "Pxx" normalization string.
_______________________________________________________
Result for the run: xapiantfidf_Ptn
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.02873
-----------------------------------------------------
Precision of Query: 127 is : 0.000690923
-----------------------------------------------------
Precision of Query: 128 is : 0
@ivmarkp
ivmarkp / adhoceval_tfidf_nPn.txt
Created August 7, 2016 13:42
Evaluation results of "'nPn" normalization of TfIdfWeight which basically represents "xPx" normalization string.
Result for the run: xapiantfidf_nPn
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.02873
-----------------------------------------------------
Precision of Query: 127 is : 0.000656867
-----------------------------------------------------
Precision of Query: 128 is : 0.000151999
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_tfidf_ntP.txt
Last active August 7, 2016 13:43
Evaluation results of "'ntP" normalization of TfIdfWeight which basically represents "xxP" normalization string.
Result for the run: xapiantfidf_ntP
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.0361212
-----------------------------------------------------
Precision of Query: 127 is : 0.00127373
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_tfidf_ntn.txt
Created August 7, 2016 11:28
Evaluation results of default normalization ("ntn") of TfIdfWeight Scheme with config file attached.
Result for the run: xapiantfidf_ntn
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.0169687
-----------------------------------------------------
Precision of Query: 127 is : 0.00039929
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_tfidf_PPP.txt
Last active August 7, 2016 13:44
Evaluation results of Pivoted normalization ("PPP") of TfIdfWeight scheme with config file attached to see what parameters are in use.
Result for the run: xapiantfidf_PPP
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.00371954
-----------------------------------------------------
Precision of Query: 127 is : 0.000664624
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_lmweight_dirplus.txt
Created July 25, 2016 11:23
Evaluation results of Dirichlet (Dir+) smoothing of LMWeight scheme with config file attached to see what parameters are in use.
Result for the run: xapianlmweight_dirplus
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.026204
-----------------------------------------------------
Precision of Query: 127 is : 0.0001523
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_lmweight_dir.txt
Created July 25, 2016 11:22
Evaluation results of Dirichlet (Dir) smoothing of LMWeight scheme with config file attached to see what parameters are in use.
Result for the run: xapianlmweight_dir
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.026204
-----------------------------------------------------
Precision of Query: 127 is : 0.0001523
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_pl2plus.txt
Created July 25, 2016 11:18
Evaluation results of PL2+ weighting scheme with config file attached to see what parameters are in use.
Result for the run: xapianpl2plus
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.00232665
-----------------------------------------------------
Precision of Query: 127 is : 0.000345901
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------
@ivmarkp
ivmarkp / adhoceval_pl2.txt
Last active July 26, 2016 06:19
Evaluation results of PL2 weighting scheme with config file attached to see what parameters are in use.
Result for the run: xapianpl2
-----------------------------------------------------
Query wise Precision:
_______________________________________________________
50Precision of Query: 126 is : 0.00917974
-----------------------------------------------------
Precision of Query: 127 is : 0.000275786
-----------------------------------------------------
Precision of Query: 128 is : 0
-----------------------------------------------------