Skip to content

Instantly share code, notes, and snippets.

@alexanderguzhva
Created March 1, 2024 20:29
Show Gist options
  • Save alexanderguzhva/9eb03ed60354d7e76cfa25e676f983ac to your computer and use it in GitHub Desktop.
Save alexanderguzhva/9eb03ed60354d7e76cfa25e676f983ac to your computer and use it in GitHub Desktop.
baseline for benchs/bench_ivf_fastscan.py (sift1M)
======IVF1024,PQ32x4fs
nprobe 1, Recall@1: 0.922700, speed: 0.005082 ms/query
nprobe 2, Recall@1: 0.944000, speed: 0.005744 ms/query
nprobe 4, Recall@1: 0.956000, speed: 0.006967 ms/query
nprobe 6, Recall@1: 0.958100, speed: 0.008595 ms/query
nprobe 8, Recall@1: 0.960000, speed: 0.010168 ms/query
nprobe 12, Recall@1: 0.961600, speed: 0.013421 ms/query
nprobe 16, Recall@1: 0.960900, speed: 0.016743 ms/query
nprobe 24, Recall@1: 0.961300, speed: 0.022848 ms/query
nprobe 32, Recall@1: 0.961800, speed: 0.029043 ms/query
nprobe 48, Recall@1: 0.961700, speed: 0.041180 ms/query
nprobe 64, Recall@1: 0.961700, speed: 0.053640 ms/query
nprobe 128, Recall@1: 0.961300, speed: 0.102321 ms/query
======IVF1024,PQ32x4fsr
nprobe 1, Recall@1: 0.941200, speed: 0.004868 ms/query
nprobe 2, Recall@1: 0.961800, speed: 0.007194 ms/query
nprobe 4, Recall@1: 0.971600, speed: 0.011908 ms/query
nprobe 6, Recall@1: 0.974000, speed: 0.016407 ms/query
nprobe 8, Recall@1: 0.975100, speed: 0.020700 ms/query
nprobe 12, Recall@1: 0.976200, speed: 0.029315 ms/query
nprobe 16, Recall@1: 0.976900, speed: 0.037768 ms/query
nprobe 24, Recall@1: 0.977600, speed: 0.054759 ms/query
nprobe 32, Recall@1: 0.977700, speed: 0.071595 ms/query
nprobe 48, Recall@1: 0.977800, speed: 0.105489 ms/query
nprobe 64, Recall@1: 0.977800, speed: 0.140314 ms/query
nprobe 128, Recall@1: 0.978300, speed: 0.277072 ms/query
======IVF1024,LSQ30x4fsr_Nlsq2x4(rescale_norm=True)
nprobe 1, Recall@1: 0.971300, speed: 0.005109 ms/query
nprobe 2, Recall@1: 0.985200, speed: 0.005999 ms/query
nprobe 4, Recall@1: 0.990700, speed: 0.007832 ms/query
nprobe 6, Recall@1: 0.992100, speed: 0.009435 ms/query
nprobe 8, Recall@1: 0.992800, speed: 0.011323 ms/query
nprobe 12, Recall@1: 0.993400, speed: 0.014825 ms/query
nprobe 16, Recall@1: 0.993600, speed: 0.018121 ms/query
nprobe 24, Recall@1: 0.993600, speed: 0.024420 ms/query
nprobe 32, Recall@1: 0.993700, speed: 0.031062 ms/query
nprobe 48, Recall@1: 0.994100, speed: 0.044124 ms/query
nprobe 64, Recall@1: 0.994200, speed: 0.058158 ms/query
nprobe 128, Recall@1: 0.994200, speed: 0.110720 ms/query
======IVF1024,RQ30x4fsr_Nrq2x4(rescale_norm=True)
nprobe 1, Recall@1: 0.959700, speed: 0.004922 ms/query
nprobe 2, Recall@1: 0.978800, speed: 0.006097 ms/query
nprobe 4, Recall@1: 0.986300, speed: 0.007861 ms/query
nprobe 6, Recall@1: 0.987400, speed: 0.009655 ms/query
nprobe 8, Recall@1: 0.987600, speed: 0.011329 ms/query
nprobe 12, Recall@1: 0.988700, speed: 0.014746 ms/query
nprobe 16, Recall@1: 0.989100, speed: 0.018317 ms/query
nprobe 24, Recall@1: 0.989600, speed: 0.024869 ms/query
nprobe 32, Recall@1: 0.990500, speed: 0.031843 ms/query
nprobe 48, Recall@1: 0.990500, speed: 0.044313 ms/query
nprobe 64, Recall@1: 0.990600, speed: 0.057584 ms/query
nprobe 128, Recall@1: 0.990600, speed: 0.110541 ms/query
======IVF1024,LSQ30x4fsr_Nlsq2x4(rescale_norm=False)
nprobe 1, Recall@1: 0.970700, speed: 0.004887 ms/query
nprobe 2, Recall@1: 0.985600, speed: 0.005866 ms/query
nprobe 4, Recall@1: 0.990900, speed: 0.007599 ms/query
nprobe 6, Recall@1: 0.992300, speed: 0.009341 ms/query
nprobe 8, Recall@1: 0.992900, speed: 0.011095 ms/query
nprobe 12, Recall@1: 0.993700, speed: 0.014339 ms/query
nprobe 16, Recall@1: 0.993700, speed: 0.017685 ms/query
nprobe 24, Recall@1: 0.993800, speed: 0.024190 ms/query
nprobe 32, Recall@1: 0.993800, speed: 0.030693 ms/query
nprobe 48, Recall@1: 0.994300, speed: 0.043220 ms/query
nprobe 64, Recall@1: 0.994400, speed: 0.056599 ms/query
nprobe 128, Recall@1: 0.994400, speed: 0.108211 ms/query
======IVF1024,RQ30x4fsr_Nrq2x4(rescale_norm=False)
nprobe 1, Recall@1: 0.958400, speed: 0.004908 ms/query
nprobe 2, Recall@1: 0.978700, speed: 0.006006 ms/query
nprobe 4, Recall@1: 0.986100, speed: 0.007816 ms/query
nprobe 6, Recall@1: 0.987500, speed: 0.009464 ms/query
nprobe 8, Recall@1: 0.987800, speed: 0.011183 ms/query
nprobe 12, Recall@1: 0.988800, speed: 0.014619 ms/query
nprobe 16, Recall@1: 0.989100, speed: 0.017884 ms/query
nprobe 24, Recall@1: 0.989400, speed: 0.024365 ms/query
nprobe 32, Recall@1: 0.990100, speed: 0.031221 ms/query
nprobe 48, Recall@1: 0.990100, speed: 0.043644 ms/query
nprobe 64, Recall@1: 0.990200, speed: 0.056543 ms/query
nprobe 128, Recall@1: 0.990200, speed: 0.108680 ms/query
======IVF1024,LSQ30x4fs_Nlsq2x4(rescale_norm=True)
nprobe 1, Recall@1: 0.969000, speed: 0.004898 ms/query
nprobe 2, Recall@1: 0.986500, speed: 0.005886 ms/query
nprobe 4, Recall@1: 0.991900, speed: 0.007623 ms/query
nprobe 6, Recall@1: 0.993600, speed: 0.009166 ms/query
nprobe 8, Recall@1: 0.994700, speed: 0.010897 ms/query
nprobe 12, Recall@1: 0.994200, speed: 0.014050 ms/query
nprobe 16, Recall@1: 0.994100, speed: 0.017307 ms/query
nprobe 24, Recall@1: 0.994100, speed: 0.023478 ms/query
nprobe 32, Recall@1: 0.994200, speed: 0.029751 ms/query
nprobe 48, Recall@1: 0.994400, speed: 0.041653 ms/query
nprobe 64, Recall@1: 0.994300, speed: 0.054051 ms/query
nprobe 128, Recall@1: 0.994100, speed: 0.102793 ms/query
======IVF1024,RQ30x4fs_Nrq2x4(rescale_norm=True)
nprobe 1, Recall@1: 0.940000, speed: 0.005045 ms/query
nprobe 2, Recall@1: 0.962900, speed: 0.005906 ms/query
nprobe 4, Recall@1: 0.973200, speed: 0.007622 ms/query
nprobe 6, Recall@1: 0.976200, speed: 0.009235 ms/query
nprobe 8, Recall@1: 0.975700, speed: 0.010819 ms/query
nprobe 12, Recall@1: 0.978100, speed: 0.013979 ms/query
nprobe 16, Recall@1: 0.978600, speed: 0.017255 ms/query
nprobe 24, Recall@1: 0.978700, speed: 0.023496 ms/query
nprobe 32, Recall@1: 0.978400, speed: 0.030111 ms/query
nprobe 48, Recall@1: 0.978400, speed: 0.041782 ms/query
nprobe 64, Recall@1: 0.978400, speed: 0.054030 ms/query
nprobe 128, Recall@1: 0.978300, speed: 0.103557 ms/query
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment