Command:
for i in 1 4096; do echo "Beam width $i" && python -m coqui_stt_training.evaluate --test_files /models/csv/cv-test.csv --alphabet_config_path /models/alphabet_small.txt --load_checkpoint_dir /models/m1 --scorer /lm/all-o4-prune014-3M.scorer --test_batch_size 8 --beam_width $i; done
Output:
Beam width 1
2022-01-09 10:21:14.192777: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2022-01-09 10:21:15.626985: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 3599895000 Hz
2022-01-09 10:21:15.627403: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4484610 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2022-01-09 10:21:15.627415: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version
2022-01-09 10:21:15.628756: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1
2022-01-09 10:21:15.730082: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:15.730532: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4ae7840 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2022-01-09 10:21:15.730556: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): GeForce RTX 2060 SUPER, Compute Capability 7.5
2022-01-09 10:21:15.730779: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:15.731376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Found device 0 with properties:
name: GeForce RTX 2060 SUPER major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:09:00.0
2022-01-09 10:21:15.731408: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
2022-01-09 10:21:15.733885: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.11
2022-01-09 10:21:15.734980: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2022-01-09 10:21:15.735246: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2022-01-09 10:21:15.737680: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2022-01-09 10:21:15.738297: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.11
2022-01-09 10:21:15.738457: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8
2022-01-09 10:21:15.738593: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:15.739290: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:15.739834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1767] Adding visible gpu devices: 0
2022-01-09 10:21:15.739851: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
2022-01-09 10:21:15.940756: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1180] Device interconnect StreamExecutor with strength 1 edge matrix:
2022-01-09 10:21:15.940794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1186] 0
2022-01-09 10:21:15.940799: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1199] 0: N
2022-01-09 10:21:15.941021: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:15.941427: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:15.941774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1325] Created TensorFlow device (/device:GPU:0 with 7223 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2060 SUPER, pci bus id: 0000:09:00.0, compute capability: 7.5)
2022-01-09 10:21:16.716538: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:16.716949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Found device 0 with properties:
name: GeForce RTX 2060 SUPER major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:09:00.0
2022-01-09 10:21:16.716971: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
2022-01-09 10:21:16.717003: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.11
2022-01-09 10:21:16.717014: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2022-01-09 10:21:16.717025: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2022-01-09 10:21:16.717036: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2022-01-09 10:21:16.717054: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.11
2022-01-09 10:21:16.717066: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8
2022-01-09 10:21:16.717128: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:16.717508: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:16.717827: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1767] Adding visible gpu devices: 0
2022-01-09 10:21:16.717849: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1180] Device interconnect StreamExecutor with strength 1 edge matrix:
2022-01-09 10:21:16.717853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1186] 0
2022-01-09 10:21:16.717857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1199] 0: N
2022-01-09 10:21:16.717929: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:16.718294: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:21:16.718623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1325] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7223 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2060 SUPER, pci bus id: 0000:09:00.0, compute capability: 7.5)
I Loading best validating checkpoint from /models/m1/best_dev-2183490
I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/bias
I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/kernel
I Loading variable from checkpoint: global_step
I Loading variable from checkpoint: layer_1/bias
I Loading variable from checkpoint: layer_1/weights
I Loading variable from checkpoint: layer_2/bias
I Loading variable from checkpoint: layer_2/weights
I Loading variable from checkpoint: layer_3/bias
I Loading variable from checkpoint: layer_3/weights
I Loading variable from checkpoint: layer_5/bias
I Loading variable from checkpoint: layer_5/weights
I Loading variable from checkpoint: layer_6/bias
I Loading variable from checkpoint: layer_6/weights
Testing model on /models/csv/cv-test.csv
Test epoch | Steps: 0 | Elapsed Time: 0:00:00 2022-01-09 10:21:17.249756: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.11
2022-01-09 10:21:17.698061: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8
Test epoch | Steps: 804 | Elapsed Time: 0:03:06
Test on /models/csv/cv-test.csv - WER: 0.172611, CER: 0.069803, loss: 14.636967
--------------------------------------------------------------------------------
Best WER:
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 49.454514
- wav: file:///data/cv/common_voice_cs_23684478.wav
- src: "v budově se nachází nová moderní multimediální stálá národopisná expozice slovácko"
- res: "v budově se nachází nová moderní multimediální stálá národopisná expozice slovácko"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 43.003513
- wav: file:///data/cv/common_voice_cs_20484498.wav
- src: "právo pokojně se shromažďovat je zaručeno"
- res: "právo pokojně se shromažďovat je zaručeno"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 40.026520
- wav: file:///data/cv/common_voice_cs_25647929.wav
- src: "nachází se zde římskokatolický kostel svatého jana nepomuckého"
- res: "nachází se zde římskokatolický kostel svatého jana nepomuckého"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 39.427250
- wav: file:///data/cv/common_voice_cs_23879018.wav
- src: "používá se pro symfonické koncerty i pro komorní hudbu"
- res: "používá se pro symfonické koncerty i pro komorní hudbu"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 39.232529
- wav: file:///data/cv/common_voice_cs_24600591.wav
- src: "přes zdánlivou jednoduchost konstrukce byl celý proces výroby funkční jednotky poměrně složitý"
- res: "přes zdánlivou jednoduchost konstrukce byl celý proces výroby funkční jednotky poměrně složitý"
--------------------------------------------------------------------------------
Median WER:
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.032258, loss: 13.259224
- wav: file:///data/cv/common_voice_cs_22371331.wav
- src: "města mají vliv na venkovské regiony a své bezprostřední okolí"
- res: "města mají vliv na venkovské regiony své bezprostřední okolí"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.014706, loss: 13.172638
- wav: file:///data/cv/common_voice_cs_23896861.wav
- src: "poté její postavení na žebříčku mělo neustále zhoršující se tendenci"
- res: "poté její postavení na žebříčku měla neustále zhoršující se tendenci"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.030303, loss: 12.767273
- wav: file:///data/cv/common_voice_cs_23773747.wav
- src: "za prvé vyzývám prosím okamžitě zastavme prodej zbraní těmto zemím"
- res: "za prvé vyzývám prosím okamžitě zastavme prodej sebraní těmto zemím"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.017544, loss: 12.454067
- wav: file:///data/cv/common_voice_cs_20831497.wav
- src: "ptali se hlavně ostatní soutěžící co byli v soutěži prvně"
- res: "ptali se hlavně ostatní soutěžící co byli v soutěži první"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.043478, loss: 11.681917
- wav: file:///data/cv/common_voice_cs_20587217.wav
- src: "romeo se dozvídá o smrti julie a chce se zabít"
- res: "romeo se dozvídá o smrti julie chce se zabít"
--------------------------------------------------------------------------------
Worst WER:
--------------------------------------------------------------------------------
WER: 1.500000, CER: 0.600000, loss: 17.485899
- wav: file:///data/cv/common_voice_cs_20678625.wav
- src: "tak nechoď"
- res: "pak mi po"
--------------------------------------------------------------------------------
WER: 1.500000, CER: 0.222222, loss: 5.668883
- wav: file:///data/cv/common_voice_cs_20466989.wav
- src: "řekněme makropulos"
- res: "řekněme makro pod os"
--------------------------------------------------------------------------------
WER: 2.000000, CER: 0.388889, loss: 31.100052
- wav: file:///data/cv/common_voice_cs_20729298.wav
- src: "tentononc spíchnul"
- res: "tento no spíš mu"
--------------------------------------------------------------------------------
WER: 2.000000, CER: 0.875000, loss: 15.033339
- wav: file:///data/cv/common_voice_cs_20532955.wav
- src: "nilvínie"
- res: "měl mě"
--------------------------------------------------------------------------------
WER: 2.000000, CER: 0.166667, loss: 9.498473
- wav: file:///data/cv/common_voice_cs_20515324.wav
- src: "ježišikriste"
- res: "ježíši kriste"
--------------------------------------------------------------------------------
Beam width 4096
2022-01-09 10:24:33.315902: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2022-01-09 10:24:34.757584: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 3599895000 Hz
2022-01-09 10:24:34.758068: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x61cd3a0 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2022-01-09 10:24:34.758093: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version
2022-01-09 10:24:34.760405: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1
2022-01-09 10:24:34.834982: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:34.835423: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x682eb40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2022-01-09 10:24:34.835437: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): GeForce RTX 2060 SUPER, Compute Capability 7.5
2022-01-09 10:24:34.835566: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:34.835900: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Found device 0 with properties:
name: GeForce RTX 2060 SUPER major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:09:00.0
2022-01-09 10:24:34.835920: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
2022-01-09 10:24:34.837334: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.11
2022-01-09 10:24:34.837953: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2022-01-09 10:24:34.838091: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2022-01-09 10:24:34.839456: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2022-01-09 10:24:34.839773: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.11
2022-01-09 10:24:34.839852: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8
2022-01-09 10:24:34.839929: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:34.840320: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:34.840636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1767] Adding visible gpu devices: 0
2022-01-09 10:24:34.840652: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
2022-01-09 10:24:35.041817: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1180] Device interconnect StreamExecutor with strength 1 edge matrix:
2022-01-09 10:24:35.041854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1186] 0
2022-01-09 10:24:35.041879: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1199] 0: N
2022-01-09 10:24:35.042109: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.042504: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.042841: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1325] Created TensorFlow device (/device:GPU:0 with 7223 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2060 SUPER, pci bus id: 0000:09:00.0, compute capability: 7.5)
2022-01-09 10:24:35.818257: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.818653: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Found device 0 with properties:
name: GeForce RTX 2060 SUPER major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:09:00.0
2022-01-09 10:24:35.818675: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.11.0
2022-01-09 10:24:35.818699: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.11
2022-01-09 10:24:35.818709: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2022-01-09 10:24:35.818718: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2022-01-09 10:24:35.818727: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2022-01-09 10:24:35.818735: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.11
2022-01-09 10:24:35.818745: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8
2022-01-09 10:24:35.818794: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.819152: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.819477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1767] Adding visible gpu devices: 0
2022-01-09 10:24:35.819499: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1180] Device interconnect StreamExecutor with strength 1 edge matrix:
2022-01-09 10:24:35.819503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1186] 0
2022-01-09 10:24:35.819509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1199] 0: N
2022-01-09 10:24:35.819579: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.819936: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-01-09 10:24:35.820252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1325] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7223 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2060 SUPER, pci bus id: 0000:09:00.0, compute capability: 7.5)
I Loading best validating checkpoint from /models/m1/best_dev-2183490
I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/bias
I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/kernel
I Loading variable from checkpoint: global_step
I Loading variable from checkpoint: layer_1/bias
I Loading variable from checkpoint: layer_1/weights
I Loading variable from checkpoint: layer_2/bias
I Loading variable from checkpoint: layer_2/weights
I Loading variable from checkpoint: layer_3/bias
I Loading variable from checkpoint: layer_3/weights
I Loading variable from checkpoint: layer_5/bias
I Loading variable from checkpoint: layer_5/weights
I Loading variable from checkpoint: layer_6/bias
I Loading variable from checkpoint: layer_6/weights
Testing model on /models/csv/cv-test.csv
Test epoch | Steps: 0 | Elapsed Time: 0:00:00 2022-01-09 10:24:36.344678: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.11
2022-01-09 10:24:36.797587: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8
Test epoch | Steps: 804 | Elapsed Time: 0:03:09
Test on /models/csv/cv-test.csv - WER: 0.172611, CER: 0.069803, loss: 14.636967
--------------------------------------------------------------------------------
Best WER:
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 49.454514
- wav: file:///data/cv/common_voice_cs_23684478.wav
- src: "v budově se nachází nová moderní multimediální stálá národopisná expozice slovácko"
- res: "v budově se nachází nová moderní multimediální stálá národopisná expozice slovácko"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 43.003513
- wav: file:///data/cv/common_voice_cs_20484498.wav
- src: "právo pokojně se shromažďovat je zaručeno"
- res: "právo pokojně se shromažďovat je zaručeno"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 40.026520
- wav: file:///data/cv/common_voice_cs_25647929.wav
- src: "nachází se zde římskokatolický kostel svatého jana nepomuckého"
- res: "nachází se zde římskokatolický kostel svatého jana nepomuckého"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 39.427250
- wav: file:///data/cv/common_voice_cs_23879018.wav
- src: "používá se pro symfonické koncerty i pro komorní hudbu"
- res: "používá se pro symfonické koncerty i pro komorní hudbu"
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 39.232529
- wav: file:///data/cv/common_voice_cs_24600591.wav
- src: "přes zdánlivou jednoduchost konstrukce byl celý proces výroby funkční jednotky poměrně složitý"
- res: "přes zdánlivou jednoduchost konstrukce byl celý proces výroby funkční jednotky poměrně složitý"
--------------------------------------------------------------------------------
Median WER:
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.032258, loss: 13.259224
- wav: file:///data/cv/common_voice_cs_22371331.wav
- src: "města mají vliv na venkovské regiony a své bezprostřední okolí"
- res: "města mají vliv na venkovské regiony své bezprostřední okolí"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.014706, loss: 13.172638
- wav: file:///data/cv/common_voice_cs_23896861.wav
- src: "poté její postavení na žebříčku mělo neustále zhoršující se tendenci"
- res: "poté její postavení na žebříčku měla neustále zhoršující se tendenci"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.030303, loss: 12.767273
- wav: file:///data/cv/common_voice_cs_23773747.wav
- src: "za prvé vyzývám prosím okamžitě zastavme prodej zbraní těmto zemím"
- res: "za prvé vyzývám prosím okamžitě zastavme prodej sebraní těmto zemím"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.017544, loss: 12.454067
- wav: file:///data/cv/common_voice_cs_20831497.wav
- src: "ptali se hlavně ostatní soutěžící co byli v soutěži prvně"
- res: "ptali se hlavně ostatní soutěžící co byli v soutěži první"
--------------------------------------------------------------------------------
WER: 0.100000, CER: 0.043478, loss: 11.681917
- wav: file:///data/cv/common_voice_cs_20587217.wav
- src: "romeo se dozvídá o smrti julie a chce se zabít"
- res: "romeo se dozvídá o smrti julie chce se zabít"
--------------------------------------------------------------------------------
Worst WER:
--------------------------------------------------------------------------------
WER: 1.500000, CER: 0.600000, loss: 17.485899
- wav: file:///data/cv/common_voice_cs_20678625.wav
- src: "tak nechoď"
- res: "pak mi po"
--------------------------------------------------------------------------------
WER: 1.500000, CER: 0.222222, loss: 5.668883
- wav: file:///data/cv/common_voice_cs_20466989.wav
- src: "řekněme makropulos"
- res: "řekněme makro pod os"
--------------------------------------------------------------------------------
WER: 2.000000, CER: 0.388889, loss: 31.100052
- wav: file:///data/cv/common_voice_cs_20729298.wav
- src: "tentononc spíchnul"
- res: "tento no spíš mu"
--------------------------------------------------------------------------------
WER: 2.000000, CER: 0.875000, loss: 15.033339
- wav: file:///data/cv/common_voice_cs_20532955.wav
- src: "nilvínie"
- res: "měl mě"
--------------------------------------------------------------------------------
WER: 2.000000, CER: 0.166667, loss: 9.498473
- wav: file:///data/cv/common_voice_cs_20515324.wav
- src: "ježišikriste"
- res: "ježíši kriste"
--------------------------------------------------------------------------------