Skip to content

Instantly share code, notes, and snippets.

@bwhitman
Created June 23, 2011 00:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save bwhitman/1041616 to your computer and use it in GitHub Desktop.
Save bwhitman/1041616 to your computer and use it in GitHub Desktop.
Echoprint accuracy numbers from Bigeval
NOTE: duplicates in our bigeval DB are the main cause of fp failures.
-c 1000 -d 30 -e wav -p
PR 0.0109 CAR 0.9907 FAR 0.1176 FRR 0.0093 {'err-api': 0, 'fp-a': 2, 'fp-b': 2, 'err-data': 3, 'tp': 960, 'tn': 15, 'err-codegen': 0, 'total': 1000, 'fn': 7, 'err-munge': 11}
-d 60 -e wav
PR 0.0030 CAR 0.9969 FAR 0.0000 FRR 0.0031 {'err-api': 0, 'fp-a': 2, 'fp-b': 0, 'err-data': 3, 'tp': 976, 'tn': 9, 'err-codegen': 0, 'total': 1000, 'fn': 1, 'err-munge': 9}
-d 60 -e mp3
PR 0.0136 CAR 0.9877 FAR 0.1000 FRR 0.0123 {'err-api': 0, 'fp-a': 3, 'fp-b': 1, 'err-data': 1, 'tp': 962, 'tn': 9, 'err-codegen': 0, 'total': 1000, 'fn': 9, 'err-munge': 15}
-d 30 -e mp3
PR 0.0163 CAR 0.9834 FAR 0.0000 FRR 0.0166 {'err-api': 0, 'fp-a': 11, 'fp-b': 0, 'err-data': 4, 'tp': 949, 'tn': 20, 'err-codegen': 0, 'total': 1000, 'fn': 5, 'err-munge': 11}
-d 30 -e mp3 -b 96
PR 0.0260 CAR 0.9773 FAR 0.2500 FRR 0.0227 {'err-api': 0, 'fp-a': 10, 'fp-b': 4, 'err-data': 2, 'tp': 949, 'tn': 12, 'err-codegen': 0, 'total': 1000, 'fn': 12, 'err-munge': 11}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment