Returnn Loss nan - Full setup

stdout.txt

RETURNN starting up, version 20191217.234858--git-09b41c6f-dirty, date/time 2019-12-20-15-38-17 (UTC+0000), pid 50071, cwd /home/ubuntu/rwth-i6/returnn-experiments/2018-asr-attention/librispeech/full-setup-attention, Python /home/ubuntu/tf1.13/bin/python3
RETURNN command line options: ['returnn.config']
Hostname: ip-10-1-21-241
TensorFlow: 1.15.0 (v1.15.0-rc3-22-g590d6ee) (<site-package> in /home/ubuntu/tf1.13/lib/python3.6/site-packages/tensorflow)
Setup TF inter and intra global thread pools, num_threads None, session opts {'log_device_placement': False, 'device_count': {'GPU': 0}}.
CUDA_VISIBLE_DEVICES is set to '1'.
Local devices available to TensorFlow:
  1/4: name: "/device:CPU:0"
       device_type: "CPU"
       memory_limit: 268435456
       locality {
       }
       incarnation: 12261386161435914550
  2/4: name: "/device:XLA_CPU:0"
       device_type: "XLA_CPU"
       memory_limit: 17179869184
       locality {
       }
       incarnation: 848695335245832095
       physical_device_desc: "device: XLA_CPU device"
  3/4: name: "/device:XLA_GPU:0"
       device_type: "XLA_GPU"
       memory_limit: 17179869184
       locality {
       }
       incarnation: 5140956879647141658
       physical_device_desc: "device: XLA_GPU device"
  4/4: name: "/device:GPU:0"
       device_type: "GPU"
       memory_limit: 11270098125
       locality {
         bus_id: 1
         links {
         }
       }
       incarnation: 10864850659973115127
       physical_device_desc: "device: 0, name: Tesla K80, pci bus id: 0000:00:18.0, compute capability: 3.7"
Using gpu device 1: Tesla K80
<LibriSpeechCorpus 'train' epoch=1>, epoch 1. Old mean seq len (transcription) is 183.267376, new is 63.708029, requested max is 75.000000. Old num seqs is 6575, new num seqs is 822.
<LibriSpeechCorpus 'train' epoch=1>, epoch 1. Old num seqs 14063, new num seqs 822.
<LibriSpeechCorpus 'train' epoch=1>, epoch 1. Old mean seq len (transcription) is 183.267376, new is 63.708029, requested max is 75.000000. Old num seqs is 6575, new num seqs is 822.
<LibriSpeechCorpus 'train' epoch=1>, epoch 1. Old num seqs 14063, new num seqs 822.
Train data:
  input: 40 x 1
  output: {'classes': [10025, 1], 'raw': {'dtype': 'string', 'shape': ()}, 'data': [40, 2]}
  LibriSpeechCorpus, sequences: 822, frames: unknown
Dev data:
  LibriSpeechCorpus, sequences: 3000, frames: unknown
Learning-rate-control: file data/exp-returnn/train-scores.data does not exist yet
Update config key 'max_seq_length' for epoch 1: {'classes': 75} -> {'classes': 60}
Setup tf.Session with options {'log_device_placement': False, 'device_count': {'GPU': 1}} ...
Rec layer 'output' (search False, train 'globals/train_flag:0') sub net:
  Input layers moved out of loop: (#: 2)
    output
    target_embed
  Output layers moved out of loop: (#: 3)
    output_prob
    readout
    readout_in
  Layers in loop: (#: 10)
    s
    att
    att0
    att_weights
    energy
    energy_tanh
    energy_in
    weight_feedback
    accum_att_weights
    s_transformed
  Unused layers: (#: 1)
    end
Network layer topology:
  extern data: classes: Data(shape=(None,), dtype='int32', sparse=True, dim=10025, available_for_inference=False, batch_shape_meta=[B,T|'time:var:extern_data:classes']), data: Data(shape=(None, 40), batch_shape_meta=[B,T|'time:var:extern_data:data',F|40])
  used data keys: ['classes', 'data']
  layers:
    layer softmax 'ctc' #: 10026
    layer source 'data' #: 40
    layer decide 'decision' #: 10025
    layer linear 'enc_ctx' #: 1024
    layer split_dims 'enc_value' #: 2048
    layer copy 'encoder' #: 2048
    layer linear 'inv_fertility' #: 1
    layer rec 'lstm0_bw' #: 1024
    layer rec 'lstm0_fw' #: 1024
    layer pool 'lstm0_pool' #: 2048
    layer rec 'lstm5_bw' #: 1024
    layer rec 'lstm5_fw' #: 1024
    layer rec 'output' #: 10025
    layer eval 'source' #: 40
net params #: 87166092
net trainable params: [<tf.Variable 'ctc/W:0' shape=(2048, 10026) dtype=float32_ref>, <tf.Variable 'ctc/b:0' shape=(10026,) dtype=float32_ref>, <tf.Variable 'enc_ctx/W:0' shape=(2048, 1024) dtype=float32_ref>, <tf.Variable 'enc_ctx/b:0' shape=(1024,) dtype=float32_ref>, <tf.Variable 'inv_fertility/W:0' shape=(2048, 1) dtype=float32_ref>, <tf.Variable 'lstm0_bw/rec/W:0' shape=(40, 4096) dtype=float32_ref>, <tf.Variable 'lstm0_bw/rec/W_re:0' shape=(1024, 4096) dtype=float32_ref>, <tf.Variable 'lstm0_bw/rec/b:0' shape=(4096,) dtype=float32_ref>, <tf.Variable 'lstm0_fw/rec/W:0' shape=(40, 4096) dtype=float32_ref>, <tf.Variable 'lstm0_fw/rec/W_re:0' shape=(1024, 4096) dtype=float32_ref>, <tf.Variable 'lstm0_fw/rec/b:0' shape=(4096,) dtype=float32_ref>, <tf.Variable 'lstm5_bw/rec/W:0' shape=(2048, 4096) dtype=float32_ref>, <tf.Variable 'lstm5_bw/rec/W_re:0' shape=(1024, 4096) dtype=float32_ref>, <tf.Variable 'lstm5_bw/rec/b:0' shape=(4096,) dtype=float32_ref>, <tf.Variable 'lstm5_fw/rec/W:0' shape=(2048, 4096) dtype=float32_ref>, <tf.Variable 'lstm5_fw/rec/W_re:0' shape=(1024, 4096) dtype=float32_ref>, <tf.Variable 'lstm5_fw/rec/b:0' shape=(4096,) dtype=float32_ref>, <tf.Variable 'output/rec/energy/W:0' shape=(1024, 1) dtype=float32_ref>, <tf.Variable 'output/rec/output_prob/W:0' shape=(500, 10025) dtype=float32_ref>, <tf.Variable 'output/rec/output_prob/b:0' shape=(10025,) dtype=float32_ref>, <tf.Variable 'output/rec/readout_in/W:0' shape=(3669, 1000) dtype=float32_ref>, <tf.Variable 'output/rec/readout_in/b:0' shape=(1000,) dtype=float32_ref>, <tf.Variable 'output/rec/s/rec/lstm_cell/bias:0' shape=(4000,) dtype=float32_ref>, <tf.Variable 'output/rec/s/rec/lstm_cell/kernel:0' shape=(3669, 4000) dtype=float32_ref>, <tf.Variable 'output/rec/s_transformed/W:0' shape=(1000, 1024) dtype=float32_ref>, <tf.Variable 'output/rec/target_embed/W:0' shape=(10025, 621) dtype=float32_ref>, <tf.Variable 'output/rec/weight_feedback/W:0' shape=(1, 1024) dtype=float32_ref>]
start training at epoch 1 and step 0
using batch size: 20000, max seqs: 200
learning rate control: NewbobMultiEpoch(num_epochs=20, update_interval=1, relative_error_threshold=-0.01, learning_rate_decay_factor=0.9, learning_rate_growth_factor=1.0), epoch data: 1: EpochData(learningRate=0.0003, error={}), 2: EpochData(learningRate=0.0003555555555555555, error={}), 3: EpochData(learningRate=0.0004111111111111111, error={}), ..., 8: EpochData(learningRate=0.0006888888888888888, error={}), 9: EpochData(learningRate=0.0007444444444444445, error={}), 10: EpochData(learningRate=0.0008, error={}), error key: None
pretrain: Pretrain construction algo <function custom_construction_algo at 0x7f5325576a60>, number of pretrain epochs: 45 (repetitions: [10, 5, 5, 5, 5, 5, 5, 5])
<LibriSpeechCorpus 'train' epoch=1>, epoch 1. Old mean seq len (transcription) is 183.267376, new is 63.708029, requested max is 75.000000. Old num seqs is 6575, new num seqs is 822.
<LibriSpeechCorpus 'train' epoch=1>, epoch 1. Old num seqs 14063, new num seqs 822.
Update config key 'max_seq_length' for epoch 1: {'classes': 75} -> {'classes': 60}
start pretrain epoch 1 with learning rate 0.0003 ...
TF: log_dir: data/exp-returnn/train-2019-12-20-15-38-17
Create Adam optimizer.
Initialize optimizer (default) with slots ['m', 'v'].
These additional variable were created by the optimizer: [<tf.Variable 'optimize/beta1_power:0' shape=() dtype=float32_ref>, <tf.Variable 'optimize/beta2_power:0' shape=() dtype=float32_ref>].
pretrain epoch 1, step 0, cost:ctc 11.30795914816616, cost:output/output_prob 9.21431381934724, error:ctc 1.0926640720572323, error:decision 0.0, error:output/output_prob 0.9999999811407178, loss 5315.2686, max_size:classes 12, max_size:data 437, mem_usage:GPU:0 1.4GB, num_seqs 45, 2.673 sec/step, elapsed 0:00:08, exp. remaining 0:00:13, complete 38.81%
pretrain epoch 1, step 1, cost:ctc 6.9158620462304725, cost:output/output_prob 9.203241811405292, error:ctc 1.0053763431496918, error:decision 0.0, error:output/output_prob 0.9919354829471558, loss 5996.3066, max_size:classes 15, max_size:data 361, mem_usage:GPU:0 3.3GB, num_seqs 45, 1.210 sec/step, elapsed 0:00:09, exp. remaining 0:00:13, complete 41.12%
pretrain epoch 1, step 2, cost:ctc 6.713805034787356, cost:output/output_prob 9.165991359945338, error:ctc 0.9999999748542905, error:decision 0.0, error:output/output_prob 0.8886010139249265, loss 6129.6016, max_size:classes 11, max_size:data 457, mem_usage:GPU:0 3.3GB, num_seqs 43, 1.417 sec/step, elapsed 0:00:11, exp. remaining 0:00:14, complete 44.16%
pretrain epoch 1, step 3, cost:ctc 6.483902742643522, cost:output/output_prob 9.08475503293198, error:ctc 0.9781818247865885, error:decision 0.0, error:output/output_prob 0.8981818242464215, loss 4281.381, max_size:classes 13, max_size:data 697, mem_usage:GPU:0 3.5GB, num_seqs 28, 1.559 sec/step, elapsed 0:00:12, exp. remaining 0:00:14, complete 47.32%
pretrain epoch 1, step 4, cost:ctc 4.275941279521476, cost:output/output_prob 8.947137455677876, error:ctc 0.9704640880227089, error:decision 0.0, error:output/output_prob 0.9092826563864946, loss 6267.7397, max_size:classes 17, max_size:data 429, mem_usage:GPU:0 3.5GB, num_seqs 43, 1.391 sec/step, elapsed 0:00:14, exp. remaining 0:00:13, complete 50.61%
pretrain epoch 1, step 5, cost:ctc 7.64848610442084, cost:output/output_prob 8.660060268303141, error:ctc 0.9747899658977985, error:decision 0.0, error:output/output_prob 0.9117647525854409, loss 3881.4338, max_size:classes 14, max_size:data 669, mem_usage:GPU:0 3.5GB, num_seqs 21, 1.400 sec/step, elapsed 0:00:15, exp. remaining 0:00:13, complete 54.14%
pretrain epoch 1, step 6, cost:ctc 4.656427338501572, cost:output/output_prob 8.541652935099137, error:ctc 0.9817351191304624, error:decision 0.0, error:output/output_prob 0.9178081811405718, loss 2890.3796, max_size:classes 14, max_size:data 1096, mem_usage:GPU:0 3.5GB, num_seqs 18, 2.138 sec/step, elapsed 0:00:17, exp. remaining 0:00:13, complete 56.69%
pretrain epoch 1, step 7, cost:ctc 5.426124407370025, cost:output/output_prob 8.288919076153434, error:ctc 0.9826589375734329, error:decision 0.0, error:output/output_prob 0.9190751239657402, loss 4745.4053, max_size:classes 15, max_size:data 702, mem_usage:GPU:0 3.5GB, num_seqs 28, 1.598 sec/step, elapsed 0:00:19, exp. remaining 0:00:12, complete 60.10%
pretrain epoch 1, step 8, cost:ctc 2.7818127143468274, cost:output/output_prob 8.136272931832025, error:ctc 0.9771428466774523, error:decision 0.0, error:output/output_prob 0.9199999901466072, loss 3821.33, max_size:classes 18, max_size:data 663, mem_usage:GPU:0 3.5GB, num_seqs 28, 1.548 sec/step, elapsed 0:00:20, exp. remaining 0:00:12, complete 62.41%
pretrain epoch 1, step 9, cost:ctc 5.621432395909949, cost:output/output_prob 8.072757707654148, error:ctc 0.9720000461675227, error:decision 0.0, error:output/output_prob 0.924000043887645, loss 3423.5474, max_size:classes 19, max_size:data 691, mem_usage:GPU:0 3.5GB, num_seqs 19, 1.467 sec/step, elapsed 0:00:22, exp. remaining 0:00:11, complete 65.57%
pretrain epoch 1, step 10, cost:ctc 4.76096520950523, cost:output/output_prob 7.994223659807176, error:ctc 0.9773585051298141, error:decision 0.0, error:output/output_prob 0.9283019006252289, loss 3380.125, max_size:classes 19, max_size:data 1015, mem_usage:GPU:0 3.5GB, num_seqs 19, 2.056 sec/step, elapsed 0:00:24, exp. remaining 0:00:11, complete 68.25%
pretrain epoch 1, step 11, cost:ctc 5.051463973278487, cost:output/output_prob 7.849642702180404, error:ctc 0.9825581358745694, error:decision 0.0, error:output/output_prob 0.9273255779407918, loss 4437.9805, max_size:classes 17, max_size:data 796, mem_usage:GPU:0 3.5GB, num_seqs 25, 1.742 sec/step, elapsed 0:00:25, exp. remaining 0:00:10, complete 70.56%
pretrain epoch 1, step 12, cost:ctc 5.247076703027744, cost:output/output_prob 7.756572103356915, error:ctc 0.9837398570962249, error:decision 0.0, error:output/output_prob 0.9295393140055238, loss 4798.346, max_size:classes 18, max_size:data 744, mem_usage:GPU:0 3.5GB, num_seqs 26, 1.660 sec/step, elapsed 0:00:27, exp. remaining 0:00:09, complete 73.84%
pretrain epoch 1, step 13, cost:ctc 4.074817782458467, cost:output/output_prob 7.7652759040475985, error:ctc 0.9859484366606921, error:decision 0.0, error:output/output_prob 0.9203746689017862, loss 5055.72, max_size:classes 19, max_size:data 739, mem_usage:GPU:0 3.5GB, num_seqs 27, 1.710 sec/step, elapsed 0:00:29, exp. remaining 0:00:09, complete 76.28%
pretrain epoch 1, step 14, cost:ctc 4.3065142175714755, cost:output/output_prob 7.810078549617856, error:ctc 0.9756637131795287, error:decision 0.0, error:output/output_prob 0.9336283151060343, loss 5476.7, max_size:classes 20, max_size:data 683, mem_usage:GPU:0 3.5GB, num_seqs 29, 1.615 sec/step, elapsed 0:00:30, exp. remaining 0:00:08, complete 78.10%
pretrain epoch 1, step 15, cost:ctc 7.006644596498347, cost:output/output_prob 7.868878766328976, error:ctc 0.9809523944277316, error:decision 0.0, error:output/output_prob 0.9269841397181153, loss 4685.79, max_size:classes 18, max_size:data 915, mem_usage:GPU:0 3.5GB, num_seqs 21, 1.937 sec/step, elapsed 0:00:32, exp. remaining 0:00:07, complete 80.66%
pretrain epoch 1, step 16, cost:ctc 5.3134983449376705, cost:output/output_prob 7.775362658151153, error:ctc 0.9783080387860537, error:decision 0.0, error:output/output_prob 0.9197397083044052, loss 6033.965, max_size:classes 20, max_size:data 706, mem_usage:GPU:0 3.5GB, num_seqs 28, 1.666 sec/step, elapsed 0:00:34, exp. remaining 0:00:07, complete 82.60%
pretrain epoch 1, step 17, cost:ctc 4.484141918973364, cost:output/output_prob 7.881790937476353, error:ctc 0.9818731108680367, error:decision 0.0, error:output/output_prob 0.936555890366435, loss 4093.1238, max_size:classes 20, max_size:data 1021, mem_usage:GPU:0 3.5GB, num_seqs 19, 2.107 sec/step, elapsed 0:00:36, exp. remaining 0:00:06, complete 84.31%
pretrain epoch 1, step 18, cost:ctc 5.251395474520791, cost:output/output_prob 7.99830903734312, error:ctc 0.9638009467162192, error:decision 0.0, error:output/output_prob 0.9366516242735088, loss 5856.369, max_size:classes 21, max_size:data 764, mem_usage:GPU:0 3.5GB, num_seqs 26, 1.744 sec/step, elapsed 0:00:38, exp. remaining 0:00:05, complete 86.74%
pretrain epoch 1, step 19, cost:ctc 5.317056844465583, cost:output/output_prob 7.813567975835043, error:ctc 0.9602977589238436, error:decision 0.0, error:output/output_prob 0.9602977589238436, loss 5291.6416, max_size:classes 24, max_size:data 881, mem_usage:GPU:0 3.5GB, num_seqs 22, 1.915 sec/step, elapsed 0:00:40, exp. remaining 0:00:04, complete 89.05%
pretrain epoch 1, step 20, cost:ctc 4.005549476715714, cost:output/output_prob 7.756319195230731, error:ctc 0.968838513828814, error:decision 0.0, error:output/output_prob 0.9546742080710828, loss 4151.9395, max_size:classes 23, max_size:data 1038, mem_usage:GPU:0 3.5GB, num_seqs 19, 2.132 sec/step, elapsed 0:00:42, exp. remaining 0:00:04, complete 91.36%
pretrain epoch 1, step 21, cost:ctc 2.7174321549529163, cost:output/output_prob 7.565062862576894, error:ctc 0.971042452729307, error:decision 0.0, error:output/output_prob 0.9517374337883665, loss 5326.3325, max_size:classes 23, max_size:data 677, mem_usage:GPU:0 3.5GB, num_seqs 27, 1.614 sec/step, elapsed 0:00:44, exp. remaining 0:00:03, complete 93.31%
pretrain epoch 1, step 22, cost:ctc 3.3493970995439213, cost:output/output_prob 7.349845624406612, error:ctc 0.9733333229087293, error:decision 0.0, error:output/output_prob 0.9706666562706232, loss 4012.216, max_size:classes 21, max_size:data 836, mem_usage:GPU:0 3.5GB, num_seqs 20, 1.769 sec/step, elapsed 0:00:45, exp. remaining 0:00:02, complete 95.74%
pretrain epoch 1, step 23, cost:ctc 5.5218899172876945, cost:output/output_prob 7.458101496052905, error:ctc 0.9727890957146883, error:decision 0.0, error:output/output_prob 0.9319727700203657, loss 3816.1177, max_size:classes 22, max_size:data 1320, mem_usage:GPU:0 3.5GB, num_seqs 15, 2.518 sec/step, elapsed 0:00:48, exp. remaining 0:00:00, complete 98.05%
pretrain epoch 1, step 24, cost:ctc 3.948962771516562, cost:output/output_prob 7.535601805743737, error:ctc 0.9798488283995538, error:decision 0.0, error:output/output_prob 0.9370276713743805, loss 4559.372, max_size:classes 23, max_size:data 920, mem_usage:GPU:0 3.5GB, num_seqs 21, 1.950 sec/step, elapsed 0:00:50, exp. remaining 0:00:00, complete 98.05%
pretrain epoch 1, step 25, cost:ctc 5.0055474456487445, cost:output/output_prob 7.256274891592512, error:ctc 0.9690402206033469, error:decision 0.0, error:output/output_prob 0.9566563200205566, loss 3960.5688, max_size:classes 28, max_size:data 1229, mem_usage:GPU:0 3.5GB, num_seqs 16, 2.436 sec/step, elapsed 0:00:52, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 26, cost:ctc 6.0946757107523695, cost:output/output_prob 7.403737047555126, error:ctc 0.9893993008881808, error:decision 0.0, error:output/output_prob 0.9434629047755153, loss 3820.0508, max_size:classes 23, max_size:data 1391, mem_usage:GPU:0 3.5GB, num_seqs 14, 2.627 sec/step, elapsed 0:00:55, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 27, cost:ctc 6.6535932024033855, cost:output/output_prob 7.3353564873010555, error:ctc 0.9753694413229823, error:decision 0.0, error:output/output_prob 0.9359605750069022, loss 5679.5137, max_size:classes 25, max_size:data 1000, mem_usage:GPU:0 3.5GB, num_seqs 20, 2.097 sec/step, elapsed 0:00:57, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 28, cost:ctc 6.248400739243607, cost:output/output_prob 7.452621293381866, error:ctc 0.9774999781511723, error:decision 0.0, error:output/output_prob 0.9524999787099658, loss 5480.409, max_size:classes 26, max_size:data 1006, mem_usage:GPU:0 3.5GB, num_seqs 19, 2.093 sec/step, elapsed 0:00:59, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 29, cost:ctc 4.213677016670289, cost:output/output_prob 7.520286190049092, error:ctc 0.9834515377879143, error:decision 0.0, error:output/output_prob 0.9385342800524086, loss 4963.4663, max_size:classes 27, max_size:data 1014, mem_usage:GPU:0 3.5GB, num_seqs 19, 2.139 sec/step, elapsed 0:01:01, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 30, cost:ctc 4.83774244650715, cost:output/output_prob 7.794254100032958, error:ctc 0.9857549807056785, error:decision 0.0, error:output/output_prob 0.9572649523615837, loss 4433.831, max_size:classes 25, max_size:data 1241, mem_usage:GPU:0 3.5GB, num_seqs 16, 2.441 sec/step, elapsed 0:01:04, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 31, cost:ctc 4.402599390460409, cost:output/output_prob 7.776628877542407, error:ctc 0.9755555791780353, error:decision 0.0, error:output/output_prob 0.9466666895896196, loss 5480.6523, max_size:classes 25, max_size:data 992, mem_usage:GPU:0 3.5GB, num_seqs 20, 2.090 sec/step, elapsed 0:01:06, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 32, cost:ctc 2.72299450356104, cost:output/output_prob 7.555633103225773, error:ctc 0.9739336855709553, error:decision 0.0, error:output/output_prob 0.9549763388931751, loss 4337.5806, max_size:classes 28, max_size:data 1018, mem_usage:GPU:0 3.5GB, num_seqs 19, 2.148 sec/step, elapsed 0:01:08, exp. remaining 0:00:01, complete 98.05%
pretrain epoch 1, step 33, cost:ctc 4.971967086975269, cost:output/output_prob 7.656301726028687, error:ctc 0.9842105684801936, error:decision 0.0, error:output/output_prob 0.9394737244583666, loss 4798.742, max_size:classes 28, max_size:data 1051, mem_usage:GPU:0 3.5GB, num_seqs 17, 2.156 sec/step, elapsed 0:01:10, exp. remaining 0:00:01, complete 98.05%
Stats:
  mem_usage:GPU:0: Stats(mean=3.4GB, std_dev=371.3MB, min=1.4GB, max=3.5GB, num_seqs=34, avg_data_len=1)
pretrain epoch 1, finished after 34 steps, 0:01:10 elapsed (91.8% computing time)
Save model under data/exp-returnn/model.pretrain.001
Learning-rate-control: error key 'train_error_ctc' from {'train_score_ctc': 5.062520321541986, 'train_score_output/output_prob': 7.94508490724009, 'train_error_ctc': 0.9807334221197433, 'train_error_decision': 0.0, 'train_error_output/output_prob': 0.9377479126566329}
pretrain epoch 1 score: ctc 5.062520321541986 output/output_prob 7.94508490724009 error: ctc 0.9807334221197433 decision 0.0 output/output_prob 0.9377479126566329 elapsed: 0:01:10
TF: log_dir: data/exp-returnn/dev-1-2019-12-20-15-38-17
pretrain epoch 1 'dev' eval, step 0, cost:ctc 5.379083818237518, cost:output/output_prob 7.684909434868474, error:ctc 0.9854014520533384, error:decision 0.0, error:output/output_prob 0.9732360020279885, loss 5369.3013, max_size:classes 60, max_size:data 2818, mem_usage:GPU:0 3.5GB, num_seqs 7, 2.605 sec/step, elapsed 0:00:07, exp. remaining 0:03:04, complete 3.77%
pretrain epoch 1 'dev' eval, step 1, cost:ctc 5.589082979140358, cost:output/output_prob 8.03057197471287, error:ctc 0.9861386446282268, error:decision 0.0, error:output/output_prob 0.97425745613873, loss 6877.926, max_size:classes 59, max_size:data 2032, mem_usage:GPU:0 3.5GB, num_seqs 9, 1.721 sec/step, elapsed 0:00:08, exp. remaining 0:02:58, complete 4.77%
pretrain epoch 1 'dev' eval, step 2, cost:ctc 0.8008012234574551, cost:output/output_prob 7.950434598099946, error:ctc 0.9789842194877565, error:decision 0.0, error:output/output_prob 0.9737302791327238, loss 4996.9556, max_size:classes 60, max_size:data 1824, mem_usage:GPU:0 3.5GB, num_seqs 10, 1.531 sec/step, elapsed 0:00:10, exp. remaining 0:02:49, complete 5.83%
pretrain epoch 1 'dev' eval, step 3, cost:ctc 3.327320331736587, cost:output/output_prob 7.614134699551015, error:ctc 0.9832402355968951, error:decision 0.0, error:output/output_prob 0.9776536433491855, loss 5875.5615, max_size:classes 59, max_size:data 1850, mem_usage:GPU:0 3.5GB, num_seqs 10, 1.569 sec/step, elapsed 0:00:12, exp. remaining 0:02:41, complete 6.93%
pretrain epoch 1 'dev' eval, step 4, cost:ctc 2.8200264825171644, cost:output/output_prob 7.442103735787441, error:ctc 0.9735234696418047, error:decision 0.0, error:output/output_prob 0.9735234696418047, loss 5038.7056, max_size:classes 60, max_size:data 2083, mem_usage:GPU:0 3.5GB, num_seqs 9, 1.738 sec/step, elapsed 0:00:13, exp. remaining 0:02:57, complete 7.20%
pretrain epoch 1 'dev' eval, step 5, cost:ctc 1.9480126965221984, cost:output/output_prob 7.653414439295489, error:ctc 0.9795081419870257, error:decision 0.0, error:output/output_prob 0.9795081419870257, loss 4685.4966, max_size:classes 58, max_size:data 2023, mem_usage:GPU:0 3.5GB, num_seqs 9, 1.672 sec/step, elapsed 0:00:15, exp. remaining 0:03:08, complete 7.57%
pretrain epoch 1 'dev' eval, step 6, cost:ctc 4.060812131486188, cost:output/output_prob 7.681371620988387, error:ctc 0.9775701233884321, error:decision 0.0, error:output/output_prob 0.9775701233884321, loss 6282.0684, max_size:classes 57, max_size:data 1835, mem_usage:GPU:0 3.5GB, num_seqs 10, 1.555 sec/step, elapsed 0:00:17, exp. remaining 0:03:17, complete 7.93%
pretrain epoch 1 'dev' eval, step 7, cost:ctc 2.4454483164641663, cost:output/output_prob 7.4315790062287315, error:ctc 0.9814814641140402, error:decision 0.0, error:output/output_prob 0.9740740568377079, loss 5333.5947, max_size:classes 57, max_size:data 1912, mem_usage:GPU:0 3.5GB, num_seqs 10, 1.592 sec/step, elapsed 0:00:18, exp. remaining 0:03:25, complete 8.30%
pretrain epoch 1 'dev' eval, step 8, cost:ctc 1.3891571660234947, cost:output/output_prob 7.7322589023494865, error:ctc 0.9841827861964704, error:decision 0.0, error:output/output_prob 0.9630931550636889, loss 5190.086, max_size:classes 60, max_size:data 1710, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.473 sec/step, elapsed 0:00:20, exp. remaining 0:03:31, complete 8.67%
pretrain epoch 1 'dev' eval, step 9, cost:ctc 1.4558643098330322, cost:output/output_prob 7.615589403525518, error:ctc 0.9772727163508533, error:decision 0.0, error:output/output_prob 0.9720279611647128, loss 5188.8716, max_size:classes 58, max_size:data 1692, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.454 sec/step, elapsed 0:00:21, exp. remaining 0:03:36, complete 9.03%
pretrain epoch 1 'dev' eval, step 10, cost:ctc 1.457069226521611, cost:output/output_prob 7.561144519431537, error:ctc 0.9816513839177788, error:decision 0.0, error:output/output_prob 0.9779816591180862, loss 4914.9263, max_size:classes 58, max_size:data 1676, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.440 sec/step, elapsed 0:00:22, exp. remaining 0:03:40, complete 9.43%
pretrain epoch 1 'dev' eval, step 11, cost:ctc 3.8295542266594675, cost:output/output_prob 7.785772797093215, error:ctc 0.9794775891350581, error:decision 0.0, error:output/output_prob 0.9701492311432957, loss 6225.8154, max_size:classes 56, max_size:data 1789, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.516 sec/step, elapsed 0:00:24, exp. remaining 0:03:43, complete 9.87%
pretrain epoch 1 'dev' eval, step 12, cost:ctc 3.0522456270914233, cost:output/output_prob 7.639490692210984, error:ctc 0.9788461547577754, error:decision 0.0, error:output/output_prob 0.9750000009080395, loss 5559.703, max_size:classes 49, max_size:data 1701, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.439 sec/step, elapsed 0:00:25, exp. remaining 0:03:44, complete 10.37%
pretrain epoch 1 'dev' eval, step 13, cost:ctc 2.343160311738899, cost:output/output_prob 7.527070436431131, error:ctc 0.9847328276373446, error:decision 0.0, error:output/output_prob 0.9770992398262024, loss 3879.0007, max_size:classes 55, max_size:data 2377, mem_usage:GPU:0 3.5GB, num_seqs 8, 1.894 sec/step, elapsed 0:00:27, exp. remaining 0:03:50, complete 10.77%
pretrain epoch 1 'dev' eval, step 14, cost:ctc inf, cost:output/output_prob 7.3629858444468255, error:ctc 0.9784314304124564, error:decision 0.0, error:output/output_prob 0.9745098615530878, loss inf, max_size:classes 56, max_size:data 1766, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.497 sec/step, elapsed 0:00:29, exp. remaining 0:03:52, complete 11.20%
pretrain epoch 1 'dev' eval, step 15, cost:ctc 2.322872222670469, cost:output/output_prob 7.718436107577986, error:ctc 0.9823183063417673, error:decision 0.0, error:output/output_prob 0.9705304866656661, loss 5111.026, max_size:classes 50, max_size:data 1749, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.474 sec/step, elapsed 0:00:30, exp. remaining 0:03:54, complete 11.60%
pretrain epoch 1 'dev' eval, step 16, cost:ctc 3.7953752780623518, cost:output/output_prob 7.646952785239591, error:ctc 0.9823183063417673, error:decision 0.0, error:output/output_prob 0.9705304866656661, loss 5824.1445, max_size:classes 53, max_size:data 1677, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.418 sec/step, elapsed 0:00:32, exp. remaining 0:03:56, complete 12.00%
pretrain epoch 1 'dev' eval, step 17, cost:ctc 3.0939476256224907, cost:output/output_prob 7.663394512359503, error:ctc 0.9876797057222575, error:decision 0.0, error:output/output_prob 0.9691992122679949, loss 5238.825, max_size:classes 49, max_size:data 1746, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.475 sec/step, elapsed 0:00:33, exp. remaining 0:03:57, complete 12.40%
pretrain epoch 1 'dev' eval, step 18, cost:ctc 4.667821525192153, cost:output/output_prob 7.627405576145634, error:ctc 0.9774127649143338, error:decision 0.0, error:output/output_prob 0.9671458241064101, loss 5987.7754, max_size:classes 53, max_size:data 1782, mem_usage:GPU:0 3.5GB, num_seqs 11, 1.501 sec/step, elapsed 0:00:35, exp. remaining 0:03:59, complete 12.83%
pretrain epoch 1 'dev' eval, step 19, cost:ctc 2.8003368275192315, cost:output/output_prob 7.164740251114267, error:ctc 0.9808795336866752, error:decision 0.0, error:output/output_prob 0.9598470290657133, loss 5211.7354, max_size:classes 48, max_size:data 1598, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.362 sec/step, elapsed 0:00:36, exp. remaining 0:03:59, complete 13.23%
pretrain epoch 1 'dev' eval, step 20, cost:ctc 2.648821482617919, cost:output/output_prob 7.46900965906184, error:ctc 0.9763205768540502, error:decision 0.0, error:output/output_prob 0.9635701215593144, loss 5554.6895, max_size:classes 46, max_size:data 1534, mem_usage:GPU:0 3.5GB, num_seqs 13, 1.317 sec/step, elapsed 0:00:37, exp. remaining 0:03:59, complete 13.63%
pretrain epoch 1 'dev' eval, step 21, cost:ctc 0.4822461687842292, cost:output/output_prob 7.459338296443491, error:ctc 0.9846860953839496, error:decision 0.0, error:output/output_prob 0.9678407656028867, loss 5185.8545, max_size:classes 51, max_size:data 1277, mem_usage:GPU:0 3.5GB, num_seqs 15, 1.155 sec/step, elapsed 0:00:39, exp. remaining 0:03:58, complete 14.07%
pretrain epoch 1 'dev' eval, step 22, cost:ctc 2.8089375263612055, cost:output/output_prob 7.840617066114191, error:ctc 0.9796747602522373, error:decision 0.0, error:output/output_prob 0.9573170375078917, loss 5239.581, max_size:classes 47, max_size:data 1558, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.331 sec/step, elapsed 0:00:40, exp. remaining 0:03:59, complete 14.40%
pretrain epoch 1 'dev' eval, step 23, cost:ctc 2.5038251092493624, cost:output/output_prob 7.511657573560342, error:ctc 0.9738430241122842, error:decision 0.0, error:output/output_prob 0.961770589929074, loss 4977.6953, max_size:classes 45, max_size:data 1444, mem_usage:GPU:0 3.5GB, num_seqs 13, 1.246 sec/step, elapsed 0:00:41, exp. remaining 0:03:58, complete 14.87%
pretrain epoch 1 'dev' eval, step 24, cost:ctc 1.3237166926555801, cost:output/output_prob 7.8586511097273615, error:ctc 0.9799196422100067, error:decision 0.0, error:output/output_prob 0.9678714498877525, loss 4572.8193, max_size:classes 53, max_size:data 1579, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.358 sec/step, elapsed 0:00:42, exp. remaining 0:03:57, complete 15.33%
pretrain epoch 1 'dev' eval, step 25, cost:ctc inf, cost:output/output_prob 7.997435179423292, error:ctc 0.9772726863157004, error:decision 0.0, error:output/output_prob 0.9690082238521427, loss inf, max_size:classes 50, max_size:data 1600, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.369 sec/step, elapsed 0:00:44, exp. remaining 0:03:56, complete 15.77%
pretrain epoch 1 'dev' eval, step 26, cost:ctc 4.067454542218769, cost:output/output_prob 7.64712091461206, error:ctc 0.9847825637552887, error:decision 0.0, error:output/output_prob 0.9565216954797506, loss 5388.705, max_size:classes 46, max_size:data 1605, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.363 sec/step, elapsed 0:00:45, exp. remaining 0:03:55, complete 16.23%
pretrain epoch 1 'dev' eval, step 27, cost:ctc 3.186117541079966, cost:output/output_prob 7.183689188524113, error:ctc 0.9723866004496813, error:decision 0.0, error:output/output_prob 0.9605522807687521, loss 5257.492, max_size:classes 43, max_size:data 1429, mem_usage:GPU:0 3.5GB, num_seqs 13, 1.234 sec/step, elapsed 0:00:46, exp. remaining 0:03:52, complete 16.77%
pretrain epoch 1 'dev' eval, step 28, cost:ctc 3.614114328448238, cost:output/output_prob 7.653913546175545, error:ctc 0.9800443374551833, error:decision 0.0, error:output/output_prob 0.9689578630495816, loss 5081.881, max_size:classes 43, max_size:data 1456, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.244 sec/step, elapsed 0:00:48, exp. remaining 0:03:49, complete 17.33%
pretrain epoch 1 'dev' eval, step 29, cost:ctc 2.308887674865332, cost:output/output_prob 7.656403034602874, error:ctc 0.9804347378667444, error:decision 0.0, error:output/output_prob 0.9630434343125671, loss 4584.034, max_size:classes 43, max_size:data 1591, mem_usage:GPU:0 3.5GB, num_seqs 12, 1.341 sec/step, elapsed 0:00:49, exp. remaining 0:03:48, complete 17.83%
pretrain epoch 1 'dev' eval, step 30, cost:ctc 1.9301455537686536, cost:output/output_prob 7.587181292120874, error:ctc 0.9775509780738503, error:decision 0.0, error:output/output_prob 0.9632652644068003, loss 4663.49, max_size:classes 44, max_size:data 1461, mem_usage:GPU:0 3.5GB, num_seqs 13, 1.256 sec/step, elapsed 0:00:50, exp. remaining 0:03:46, complete 18.30%
pretrain epoch 1 'dev' eval, step 31, cost:ctc 4.511576786982317, cost:output/output_prob 7.41116609407959, error:ctc 0.9791666958481073, error:decision 0.0, error:output/output_prob 0.9661458621267229, loss 4578.333, max_size:classes 42, max_size:data 1952, mem_usage:GPU:0 3.5GB, num_seqs 10, 1.612 sec/step, elapsed 0:00:52, exp. remaining 0:03:47, complete 18.73%
pretrain epoch 1 'dev' eval, step 32, cost:ctc 3.5796451568603516, cost:output/output_prob 7.699268341064453, error:ctc 0.978515625, error:decision 0.0, error:output/output_prob 0.953125, loss 5774.8037, max_size:classes 40, max_size:data 1409, mem_usage:GPU:0 3.5GB, num_seqs 14, 1.224 sec/step, elapsed 0:00:53, exp. remaining 0:03:45, complete 19.23%
pretrain epoch 1 'dev' eval, step 33, cost:ctc 2.3087421145299913, cost:output/output_prob 7.450487818687606, error:ctc 0.9769230778329074, error:decision 0.0, error:output/output_prob 0.9576923085842282, loss 5074.8, max_size:classes 41, max_size:data 1299, mem_usage:GPU:0 3.5GB, num_seqs 14, 1.124 sec/step, elapsed 0:00:54, exp. remaining 0:03:42, complete 19.77%
pretrain epoch 1 'dev' eval, step 34, cost:ctc 5.236753983002927, cost:output/output_prob 7.683017657116579, error:ctc 0.9826464336365461, error:decision 0.0, error:output/output_prob 0.9609544593840837, loss 5956.0146, max_size:classes 42, max_size:data 1447, mem_usage:GPU:0 3.5GB, num_seqs 13, 1.249 sec/step, elapsed 0:00:55, exp. remaining 0:03:39, complete 20.30%
pretrain epoch 1 'dev' eval, step 35, cost:ctc 2.4283853387714203, cost:output/output_prob 7.664673387000619, error:ctc 0.9814433353021741, error:decision 0.0, error:output/output_prob 0.9608247778378427, loss 4895.1333, max_size:classes 39, max_size:data 1395, mem_usage:GPU:0 3.5GB, num_seqs 14, 1.202 sec/step, elapsed 0:00:57, exp. remaining 0:03:37, complete 20.80%
pretrain epoch 1 'dev' eval, step 36, cost:ctc 1.4926518649539986, cost:output/output_prob 7.4751987403821545, error:ctc 0.9798534837318584, error:decision 0.0, error:output/output_prob 0.9523809561505914, loss 4896.4463, max_size:classes 37, max_size:data 1191, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.057 sec/step, elapsed 0:00:58, exp. remaining 0:03:33, complete 21.40%
pretrain epoch 1 'dev' eval, step 37, cost:ctc 1.7876238903556896, cost:output/output_prob 7.464906374465841, error:ctc 0.9809358755592257, error:decision 0.0, error:output/output_prob 0.9566724440082908, loss 5338.71, max_size:classes 38, max_size:data 1139, mem_usage:GPU:0 3.5GB, num_seqs 17, 1.018 sec/step, elapsed 0:00:59, exp. remaining 0:03:30, complete 21.93%
pretrain epoch 1 'dev' eval, step 38, cost:ctc 2.718776764100568, cost:output/output_prob 7.595753838203905, error:ctc 0.9711538470583037, error:decision 0.0, error:output/output_prob 0.961538462433964, loss 5363.5557, max_size:classes 40, max_size:data 1285, mem_usage:GPU:0 3.5GB, num_seqs 15, 1.130 sec/step, elapsed 0:01:00, exp. remaining 0:03:28, complete 22.43%
pretrain epoch 1 'dev' eval, step 39, cost:ctc 2.5704742267010943, cost:output/output_prob 7.390835142465448, error:ctc 0.9808510327711701, error:decision 0.0, error:output/output_prob 0.9638297567144036, loss 4681.8154, max_size:classes 38, max_size:data 1355, mem_usage:GPU:0 3.5GB, num_seqs 14, 1.177 sec/step, elapsed 0:01:01, exp. remaining 0:03:26, complete 22.93%
pretrain epoch 1 'dev' eval, step 40, cost:ctc 2.658302500683476, cost:output/output_prob 7.611036887831233, error:ctc 0.9757708851248026, error:decision 0.0, error:output/output_prob 0.9647576697170734, loss 4662.2803, max_size:classes 41, max_size:data 1448, mem_usage:GPU:0 3.5GB, num_seqs 13, 1.240 sec/step, elapsed 0:01:02, exp. remaining 0:03:24, complete 23.50%
pretrain epoch 1 'dev' eval, step 41, cost:ctc 3.4011269627054617, cost:output/output_prob 7.548797253348255, error:ctc 0.9773662255611271, error:decision 0.0, error:output/output_prob 0.9506172551773489, loss 5321.663, max_size:classes 39, max_size:data 1281, mem_usage:GPU:0 3.5GB, num_seqs 15, 1.123 sec/step, elapsed 0:01:03, exp. remaining 0:03:22, complete 24.03%
pretrain epoch 1 'dev' eval, step 42, cost:ctc 2.0960039156633172, cost:output/output_prob 7.699439853142054, error:ctc 0.9813084412598984, error:decision 0.0, error:output/output_prob 0.9514018982881681, loss 5240.5625, max_size:classes 37, max_size:data 1178, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.047 sec/step, elapsed 0:01:04, exp. remaining 0:03:19, complete 24.60%
pretrain epoch 1 'dev' eval, step 43, cost:ctc 4.095195988190085, cost:output/output_prob 7.27536559100787, error:ctc 0.9788867295719684, error:decision 0.0, error:output/output_prob 0.957773486385122, loss 5924.0625, max_size:classes 36, max_size:data 1207, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.059 sec/step, elapsed 0:01:06, exp. remaining 0:03:16, complete 25.17%
pretrain epoch 1 'dev' eval, step 44, cost:ctc 4.057247688360235, cost:output/output_prob 7.530217394563806, error:ctc 0.9765458651818335, error:decision 0.0, error:output/output_prob 0.9552239030599594, loss 5434.521, max_size:classes 35, max_size:data 1272, mem_usage:GPU:0 3.5GB, num_seqs 15, 1.112 sec/step, elapsed 0:01:07, exp. remaining 0:03:14, complete 25.70%
pretrain epoch 1 'dev' eval, step 45, cost:ctc 2.130986123597353, cost:output/output_prob 7.431815308735054, error:ctc 0.9774305628379807, error:decision 0.0, error:output/output_prob 0.9496527848532423, loss 5508.174, max_size:classes 38, max_size:data 1031, mem_usage:GPU:0 3.5GB, num_seqs 18, 0.943 sec/step, elapsed 0:01:08, exp. remaining 0:03:11, complete 26.23%
pretrain epoch 1 'dev' eval, step 46, cost:ctc 4.155132236831832, cost:output/output_prob 7.531684336555372, error:ctc 0.9792960844933987, error:decision 0.0, error:output/output_prob 0.9503105767071247, loss 5644.7324, max_size:classes 38, max_size:data 1201, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.065 sec/step, elapsed 0:01:09, exp. remaining 0:03:08, complete 26.87%
pretrain epoch 1 'dev' eval, step 47, cost:ctc 4.570076228229254, cost:output/output_prob 7.318135802849383, error:ctc 0.97821348416619, error:decision 0.0, error:output/output_prob 0.9520696939434856, loss 5456.6895, max_size:classes 34, max_size:data 1332, mem_usage:GPU:0 3.5GB, num_seqs 15, 1.153 sec/step, elapsed 0:01:10, exp. remaining 0:03:06, complete 27.43%
pretrain epoch 1 'dev' eval, step 48, cost:ctc 2.3555230636063698, cost:output/output_prob 7.761814706849236, error:ctc 0.9826464336365461, error:decision 0.0, error:output/output_prob 0.9522776696830988, loss 4664.093, max_size:classes 37, max_size:data 1326, mem_usage:GPU:0 3.5GB, num_seqs 15, 1.153 sec/step, elapsed 0:01:11, exp. remaining 0:03:03, complete 28.07%
pretrain epoch 1 'dev' eval, step 49, cost:ctc 3.506975880519292, cost:output/output_prob 7.5880443843061585, error:ctc 0.9724951232783496, error:decision 0.0, error:output/output_prob 0.9607073036022484, loss 5647.365, max_size:classes 34, max_size:data 1123, mem_usage:GPU:0 3.5GB, num_seqs 17, 1.011 sec/step, elapsed 0:01:12, exp. remaining 0:03:00, complete 28.70%
pretrain epoch 1 'dev' eval, step 50, cost:ctc 2.11872286097028, cost:output/output_prob 7.411948252618856, error:ctc 0.9817443983629346, error:decision 0.0, error:output/output_prob 0.9513184356037527, loss 4698.621, max_size:classes 35, max_size:data 1229, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.085 sec/step, elapsed 0:01:13, exp. remaining 0:02:57, complete 29.27%
pretrain epoch 1 'dev' eval, step 51, cost:ctc 2.886874978803178, cost:output/output_prob 7.42356842218328, error:ctc 0.9823183063417673, error:decision 0.0, error:output/output_prob 0.9587426669895649, loss 5248.0156, max_size:classes 34, max_size:data 1152, mem_usage:GPU:0 3.5GB, num_seqs 17, 1.021 sec/step, elapsed 0:01:14, exp. remaining 0:02:54, complete 29.97%
pretrain epoch 1 'dev' eval, step 52, cost:ctc 2.3712113015482146, cost:output/output_prob 7.471774192736689, error:ctc 0.9821782484650612, error:decision 0.0, error:output/output_prob 0.9623762676492333, loss 4970.7075, max_size:classes 39, max_size:data 1120, mem_usage:GPU:0 3.5GB, num_seqs 17, 1.014 sec/step, elapsed 0:01:15, exp. remaining 0:02:52, complete 30.53%
pretrain epoch 1 'dev' eval, step 53, cost:ctc 4.966987116767541, cost:output/output_prob 7.295935918155237, error:ctc 0.9715536218136549, error:decision 0.0, error:output/output_prob 0.9518599673174322, loss 5604.156, max_size:classes 34, max_size:data 1224, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.082 sec/step, elapsed 0:01:16, exp. remaining 0:02:49, complete 31.13%
pretrain epoch 1 'dev' eval, step 54, cost:ctc 3.490579585405783, cost:output/output_prob 7.531764520345064, error:ctc 0.9868995789438486, error:decision 0.0, error:output/output_prob 0.9432314559817314, loss 5048.2334, max_size:classes 33, max_size:data 1180, mem_usage:GPU:0 3.5GB, num_seqs 16, 1.044 sec/step, elapsed 0:01:17, exp. remaining 0:02:46, complete 31.77%
pretrain epoch 1 'dev' eval, step 55, cost:ctc 2.69327547236054, cost:output/output_prob 7.493157390178766, error:ctc 0.9815157243283466, error:decision 0.0, error:output/output_prob 0.9537892914377153, loss 5510.8604, max_size:classes 32, max_size:data 1015, mem_usage:GPU:0 3.5GB, num_seqs 19, 0.924 sec/step, elapsed 0:01:18, exp. remaining 0:02:44, complete 32.40%
pretrain epoch 1 'dev' eval, step 56, cost:ctc 2.4958115591430214, cost:output/output_prob 7.548980448389102, error:ctc 0.9750519818626344, error:decision 0.0, error:output/output_prob 0.9480249546468258, loss 4831.545, max_size:classes 32, max_size:data 1115, mem_usage:GPU:0 3.5GB, num_seqs 17, 0.989 sec/step, elapsed 0:01:19, exp. remaining 0:02:40, complete 33.10%
pretrain epoch 1 'dev' eval, step 57, cost:ctc 2.556023174807678, cost:output/output_prob 7.473597463906743, error:ctc 0.9788867295719684, error:decision 0.0, error:output/output_prob 0.9558541006408633, loss 5225.4326, max_size:classes 32, max_size:data 1029, mem_usage:GPU:0 3.5GB, num_seqs 19, 0.935 sec/step, elapsed 0:01:20, exp. remaining 0:02:37, complete 33.83%
pretrain epoch 1 'dev' eval, step 58, cost:ctc 3.496497711629871, cost:output/output_prob 7.493874610692757, error:ctc 0.9790076367789879, error:decision 0.0, error:output/output_prob 0.9503816824872047, loss 5758.955, max_size:classes 34, max_size:data 1039, mem_usage:GPU:0 3.5GB, num_seqs 19, 0.952 sec/step, elapsed 0:01:21, exp. remaining 0:02:35, complete 34.43%
pretrain epoch 1 'dev' eval, step 59, cost:ctc 5.23763353056205, cost:output/output_prob 7.436984258414725, error:ctc 0.975446472177282, error:decision 0.0, error:output/output_prob 0.9419643278233707, loss 5678.2285, max_size:classes 30, max_size:data 1138, mem_usage:GPU:0 3.5GB, num_seqs 17, 1.003 sec/step, elapsed 0:01:22, exp. remaining 0:02:32, complete 35.17%
pretrain epoch 1 'dev' eval, step 60, cost:ctc 2.2587916792078317, cost:output/output_prob 7.345252687843754, error:ctc 0.9719298447016627, error:decision 0.0, error:output/output_prob 0.9421052826801315, loss 5474.305, max_size:classes 32, max_size:data 913, mem_usage:GPU:0 3.5GB, num_seqs 21, 0.858 sec/step, elapsed 0:01:23, exp. remaining 0:02:29, complete 35.87%
pretrain epoch 1 'dev' eval, step 61, cost:ctc 4.691888078003444, cost:output/output_prob 7.621301830054165, error:ctc 0.9784017016645521, error:decision 0.0, error:output/output_prob 0.9524837757926434, loss 5701.007, max_size:classes 33, max_size:data 1127, mem_usage:GPU:0 3.5GB, num_seqs 17, 1.018 sec/step, elapsed 0:01:24, exp. remaining 0:02:26, complete 36.53%
pretrain epoch 1 'dev' eval, step 62, cost:ctc 2.292945955778009, cost:output/output_prob 7.4597786039967104, error:ctc 0.9828326161950827, error:decision 0.0, error:output/output_prob 0.9484978523105383, loss 4544.7695, max_size:classes 30, max_size:data 1108, mem_usage:GPU:0 3.5GB, num_seqs 18, 0.984 sec/step, elapsed 0:01:25, exp. remaining 0:02:23, complete 37.33%
pretrain epoch 1 'dev' eval, step 63, cost:ctc 2.4833047760545526, cost:output/output_prob 7.608657353352157, error:ctc 0.9819639404304326, error:decision 0.0, error:output/output_prob 0.9338677474297583, loss 5035.889, max_size:classes 30, max_size:data 896, mem_usage:GPU:0 3.5GB, num_seqs 19, 0.827 sec/step, elapsed 0:01:26, exp. remaining 0:02:20, complete 38.10%
pretrain epoch 1 'dev' eval, step 64, cost:ctc 2.1455557625587574, cost:output/output_prob 7.331621428307358, error:ctc 0.9815195412375033, error:decision 0.0, error:output/output_prob 0.9404517780058086, loss 4615.3853, max_size:classes 29, max_size:data 1015, mem_usage:GPU:0 3.5GB, num_seqs 19, 0.919 sec/step, elapsed 0:01:27, exp. remaining 0:02:17, complete 38.80%
pretrain epoch 1 'dev' eval, step 65, cost:ctc 3.5981538957310306, cost:output/output_prob 7.420971725798665, error:ctc 0.9720670511014758, error:decision 0.0, error:output/output_prob 0.9459962872788309, loss 5917.2705, max_size:classes 29, max_size:data 952, mem_usage:GPU:0 3.5GB, num_seqs 21, 0.881 sec/step, elapsed 0:01:28, exp. remaining 0:02:14, complete 39.60%
pretrain epoch 1 'dev' eval, step 66, cost:ctc 3.0113647242089887, cost:output/output_prob 7.329421679575973, error:ctc 0.9738318055169658, error:decision 0.0, error:output/output_prob 0.9420561036095024, loss 5532.3203, max_size:classes 29, max_size:data 903, mem_usage:GPU:0 3.5GB, num_seqs 22, 0.847 sec/step, elapsed 0:01:28, exp. remaining 0:02:11, complete 40.30%
pretrain epoch 1 'dev' eval, step 67, cost:ctc 3.3233254663554135, cost:output/output_prob 7.555563464325132, error:ctc 0.9736842177808285, error:decision 0.0, error:output/output_prob 0.9407894806936383, loss 4960.7734, max_size:classes 30, max_size:data 1075, mem_usage:GPU:0 3.5GB, num_seqs 18, 0.960 sec/step, elapsed 0:01:29, exp. remaining 0:02:09, complete 41.03%
pretrain epoch 1 'dev' eval, step 68, cost:ctc 3.7130069926070064, cost:output/output_prob 7.58283656641288, error:ctc 0.9698113352060318, error:decision 0.0, error:output/output_prob 0.9471698254346848, loss 5986.797, max_size:classes 29, max_size:data 902, mem_usage:GPU:0 3.5GB, num_seqs 22, 0.844 sec/step, elapsed 0:01:30, exp. remaining 0:02:06, complete 41.80%
pretrain epoch 1 'dev' eval, step 69, cost:ctc 3.2822297847197035, cost:output/output_prob 7.339599214103828, error:ctc 0.9879759645555168, error:decision 0.0, error:output/output_prob 0.9398797715548426, loss 5300.2925, max_size:classes 28, max_size:data 929, mem_usage:GPU:0 3.5GB, num_seqs 21, 0.861 sec/step, elapsed 0:01:31, exp. remaining 0:02:04, complete 42.43%
pretrain epoch 1 'dev' eval, step 70, cost:ctc 2.120037255725947, cost:output/output_prob 7.173628751208298, error:ctc 0.9815950691699982, error:decision 0.0, error:output/output_prob 0.9488752335309982, loss 4544.6025, max_size:classes 28, max_size:data 995, mem_usage:GPU:0 3.5GB, num_seqs 20, 0.904 sec/step, elapsed 0:01:32, exp. remaining 0:02:01, complete 43.20%
pretrain epoch 1 'dev' eval, step 71, cost:ctc 1.2566036476815725, cost:output/output_prob 7.607044148019668, error:ctc 0.9746192693710327, error:decision 0.0, error:output/output_prob 0.947546511888504, loss 5238.416, max_size:classes 32, max_size:data 798, mem_usage:GPU:0 3.5GB, num_seqs 24, 0.761 sec/step, elapsed 0:01:33, exp. remaining 0:01:58, complete 44.00%
pretrain epoch 1 'dev' eval, step 72, cost:ctc 2.8279956458494557, cost:output/output_prob 7.393735401574305, error:ctc 0.9722222050186248, error:decision 0.0, error:output/output_prob 0.9518518350087107, loss 5519.735, max_size:classes 28, max_size:data 844, mem_usage:GPU:0 3.5GB, num_seqs 23, 0.801 sec/step, elapsed 0:01:34, exp. remaining 0:01:55, complete 44.77%
pretrain epoch 1 'dev' eval, step 73, cost:ctc 2.7391867207330733, cost:output/output_prob 7.023064764946412, error:ctc 0.9774127649143338, error:decision 0.0, error:output/output_prob 0.9507187188137323, loss 4754.2163, max_size:classes 26, max_size:data 912, mem_usage:GPU:0 3.5GB, num_seqs 21, 0.838 sec/step, elapsed 0:01:34, exp. remaining 0:01:53, complete 45.57%
pretrain epoch 1 'dev' eval, step 74, cost:ctc 2.974359891287492, cost:output/output_prob 7.278879760780229, error:ctc 0.974217328359373, error:decision 0.0, error:output/output_prob 0.946593018481508, loss 5567.509, max_size:classes 29, max_size:data 827, mem_usage:GPU:0 3.5GB, num_seqs 24, 0.807 sec/step, elapsed 0:01:35, exp. remaining 0:01:50, complete 46.33%
pretrain epoch 1 'dev' eval, step 75, cost:ctc 3.5722534014150256, cost:output/output_prob 7.386712224598114, error:ctc 0.9827213559765369, error:decision 0.0, error:output/output_prob 0.9481641214806587, loss 5074.001, max_size:classes 27, max_size:data 915, mem_usage:GPU:0 3.5GB, num_seqs 21, 0.844 sec/step, elapsed 0:01:36, exp. remaining 0:01:47, complete 47.20%
pretrain epoch 1 'dev' eval, step 76, cost:ctc 3.4633885218823366, cost:output/output_prob 7.386749716836391, error:ctc 0.9707112722098826, error:decision 0.0, error:output/output_prob 0.935146419564262, loss 5186.366, max_size:classes 25, max_size:data 874, mem_usage:GPU:0 3.5GB, num_seqs 22, 0.805 sec/step, elapsed 0:01:37, exp. remaining 0:01:45, complete 48.03%
pretrain epoch 1 'dev' eval, step 77, cost:ctc 2.930902124910091, cost:output/output_prob 7.308734750406984, error:ctc 0.969939892180264, error:decision 0.0, error:output/output_prob 0.9398797715548426, loss 5109.5786, max_size:classes 28, max_size:data 849, mem_usage:GPU:0 3.5GB, num_seqs 23, 0.804 sec/step, elapsed 0:01:38, exp. remaining 0:01:42, complete 48.83%
pretrain epoch 1 'dev' eval, step 78, cost:ctc 3.1383994527132586, cost:output/output_prob 7.54232803674995, error:ctc 0.973170732613653, error:decision 0.0, error:output/output_prob 0.92682926915586, loss 4379.098, max_size:classes 26, max_size:data 1043, mem_usage:GPU:0 3.5GB, num_seqs 19, 0.938 sec/step, elapsed 0:01:39, exp. remaining 0:01:40, complete 49.67%
pretrain epoch 1 'dev' eval, step 79, cost:ctc 3.5275824429417924, cost:output/output_prob 7.535534049324895, error:ctc 0.9800000465475023, error:decision 0.0, error:output/output_prob 0.9340000443626195, loss 5531.558, max_size:classes 29, max_size:data 844, mem_usage:GPU:0 3.5GB, num_seqs 23, 0.815 sec/step, elapsed 0:01:39, exp. remaining 0:01:37, complete 50.60%
pretrain epoch 1 'dev' eval, step 80, cost:ctc 1.6809920018154116, cost:output/output_prob 7.429668366833539, error:ctc 0.9817072805017233, error:decision 0.0, error:output/output_prob 0.934959314763546, loss 4482.4453, max_size:classes 27, max_size:data 826, mem_usage:GPU:0 3.5GB, num_seqs 24, 0.792 sec/step, elapsed 0:01:40, exp. remaining 0:01:34, complete 51.53%
pretrain epoch 1 'dev' eval, step 81, cost:ctc 3.175292309865881, cost:output/output_prob 7.385554761645835, error:ctc 0.9663157453760505, error:decision 0.0, error:output/output_prob 0.9326315363869071, loss 5016.4023, max_size:classes 25, max_size:data 861, mem_usage:GPU:0 3.5GB, num_seqs 23, 0.801 sec/step, elapsed 0:01:41, exp. remaining 0:01:32, complete 52.37%
pretrain epoch 1 'dev' eval, step 82, cost:ctc 4.162900132323614, cost:output/output_prob 7.347889814911923, error:ctc 0.9858011933974922, error:decision 0.0, error:output/output_prob 0.9330628579482436, loss 5674.8193, max_size:classes 26, max_size:data 818, mem_usage:GPU:0 3.5GB, num_seqs 24, 0.774 sec/step, elapsed 0:01:42, exp. remaining 0:01:29, complete 53.23%
pretrain epoch 1 'dev' eval, step 83, cost:ctc 4.109802004226253, cost:output/output_prob 7.097026461903738, error:ctc 0.9740820473525673, error:decision 0.0, error:output/output_prob 0.9438444671686739, loss 5188.7617, max_size:classes 24, max_size:data 864, mem_usage:GPU:0 3.5GB, num_seqs 23, 0.804 sec/step, elapsed 0:01:43, exp. remaining 0:01:27, complete 54.17%
pretrain epoch 1 'dev' eval, step 84, cost:ctc 4.692499340894756, cost:output/output_prob 7.408827467731044, error:ctc 0.9920635493472219, error:decision 0.0, error:output/output_prob 0.9265873550903052, loss 6099.0684, max_size:classes 23, max_size:data 762, mem_usage:GPU:0 3.5GB, num_seqs 26, 0.736 sec/step, elapsed 0:01:43, exp. remaining 0:01:24, complete 55.10%
pretrain epoch 1 'dev' eval, step 85, cost:ctc 1.9875001608565768, cost:output/output_prob 7.193542515205138, error:ctc 0.9766990499338135, error:decision 0.0, error:output/output_prob 0.9378640976501629, loss 4728.237, max_size:classes 25, max_size:data 794, mem_usage:GPU:0 3.5GB, num_seqs 25, 0.755 sec/step, elapsed 0:01:44, exp. remaining 0:01:22, complete 56.03%
pretrain epoch 1 'dev' eval, step 86, cost:ctc 4.032850999302582, cost:output/output_prob 7.4452299184417825, error:ctc 0.9757708851248026, error:decision 0.0, error:output/output_prob 0.9295153804123402, loss 5211.049, max_size:classes 22, max_size:data 815, mem_usage:GPU:0 3.5GB, num_seqs 24, 0.763 sec/step, elapsed 0:01:45, exp. remaining 0:01:19, complete 57.00%
pretrain epoch 1 'dev' eval, step 87, cost:ctc 3.702915384772467, cost:output/output_prob 7.194689299385914, error:ctc 0.9750000508502126, error:decision 0.0, error:output/output_prob 0.9375000488944352, loss 5230.85, max_size:classes 22, max_size:data 789, mem_usage:GPU:0 3.5GB, num_seqs 25, 0.756 sec/step, elapsed 0:01:46, exp. remaining 0:01:16, complete 58.00%
pretrain epoch 1 'dev' eval, step 88, cost:ctc 2.1213637336108775, cost:output/output_prob 7.442992175027569, error:ctc 0.979553892626427, error:decision 0.0, error:output/output_prob 0.9349442276870831, loss 5145.6235, max_size:classes 24, max_size:data 708, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.702 sec/step, elapsed 0:01:46, exp. remaining 0:01:14, complete 58.90%
pretrain epoch 1 'dev' eval, step 89, cost:ctc 3.7426043364158086, cost:output/output_prob 7.425740353382081, error:ctc 0.9829867910593747, error:decision 0.0, error:output/output_prob 0.9413988883607088, loss 5908.054, max_size:classes 24, max_size:data 696, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.691 sec/step, elapsed 0:01:47, exp. remaining 0:01:11, complete 59.93%
pretrain epoch 1 'dev' eval, step 90, cost:ctc 4.69038874614921, cost:output/output_prob 7.589621491752723, error:ctc 0.9798657763749361, error:decision 0.0, error:output/output_prob 0.9172259550541639, loss 5489.1646, max_size:classes 23, max_size:data 777, mem_usage:GPU:0 3.5GB, num_seqs 25, 0.737 sec/step, elapsed 0:01:48, exp. remaining 0:01:09, complete 60.87%
pretrain epoch 1 'dev' eval, step 91, cost:ctc 3.098789847438752, cost:output/output_prob 7.276649536872355, error:ctc 0.982978692278266, error:decision 0.0, error:output/output_prob 0.9297872046008706, loss 4876.4565, max_size:classes 21, max_size:data 751, mem_usage:GPU:0 3.5GB, num_seqs 26, 0.720 sec/step, elapsed 0:01:48, exp. remaining 0:01:07, complete 61.90%
pretrain epoch 1 'dev' eval, step 92, cost:ctc 1.9983877129666183, cost:output/output_prob 7.22875827829796, error:ctc 0.9764706459827721, error:decision 0.0, error:output/output_prob 0.9235294663812965, loss 4705.844, max_size:classes 22, max_size:data 697, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.685 sec/step, elapsed 0:01:49, exp. remaining 0:01:04, complete 62.93%
pretrain epoch 1 'dev' eval, step 93, cost:ctc 2.477823998878506, cost:output/output_prob 7.350183152046327, error:ctc 0.9837727958802134, error:decision 0.0, error:output/output_prob 0.9188640753272921, loss 4845.2075, max_size:classes 20, max_size:data 687, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.683 sec/step, elapsed 0:01:50, exp. remaining 0:01:02, complete 63.73%
pretrain epoch 1 'dev' eval, step 94, cost:ctc 2.8421809018813065, cost:output/output_prob 7.0137960068379925, error:ctc 0.9790356056764722, error:decision 0.0, error:output/output_prob 0.920335398055613, loss 4701.3013, max_size:classes 24, max_size:data 692, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.686 sec/step, elapsed 0:01:50, exp. remaining 0:01:00, complete 64.67%
pretrain epoch 1 'dev' eval, step 95, cost:ctc 2.2191218113470654, cost:output/output_prob 7.300469361854084, error:ctc 0.9820359265431762, error:decision 0.0, error:output/output_prob 0.9221556871198118, loss 4769.3154, max_size:classes 22, max_size:data 683, mem_usage:GPU:0 3.5GB, num_seqs 29, 0.673 sec/step, elapsed 0:01:51, exp. remaining 0:00:58, complete 65.73%
pretrain epoch 1 'dev' eval, step 96, cost:ctc 4.3012375425893765, cost:output/output_prob 7.397158924108566, error:ctc 0.9729207240743561, error:decision 0.0, error:output/output_prob 0.9226305872434749, loss 6048.071, max_size:classes 22, max_size:data 656, mem_usage:GPU:0 3.5GB, num_seqs 30, 0.664 sec/step, elapsed 0:01:52, exp. remaining 0:00:55, complete 66.73%
pretrain epoch 1 'dev' eval, step 97, cost:ctc 5.191779120336207, cost:output/output_prob 7.442783618151907, error:ctc 0.9883450102061033, error:decision 0.0, error:output/output_prob 0.9324009530246258, loss 5420.2275, max_size:classes 20, max_size:data 728, mem_usage:GPU:0 3.5GB, num_seqs 27, 0.704 sec/step, elapsed 0:01:52, exp. remaining 0:00:53, complete 67.83%
pretrain epoch 1 'dev' eval, step 98, cost:ctc 3.6218255533123056, cost:output/output_prob 7.114593071517845, error:ctc 0.9778671688400209, error:decision 0.0, error:output/output_prob 0.927565359743312, loss 5336.0, max_size:classes 20, max_size:data 623, mem_usage:GPU:0 3.5GB, num_seqs 31, 0.624 sec/step, elapsed 0:01:53, exp. remaining 0:00:50, complete 69.10%
pretrain epoch 1 'dev' eval, step 99, cost:ctc 4.972932262146287, cost:output/output_prob 7.497638221999523, error:ctc 0.9730337178334594, error:decision 0.0, error:output/output_prob 0.9146067509427667, loss 5549.404, max_size:classes 21, max_size:data 713, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.704 sec/step, elapsed 0:01:54, exp. remaining 0:00:48, complete 70.33%
pretrain epoch 1 'dev' eval, step 100, cost:ctc 3.2212139130933792, cost:output/output_prob 7.3247478816902, error:ctc 0.9725737925618887, error:decision 0.0, error:output/output_prob 0.926160292699933, loss 4998.786, max_size:classes 19, max_size:data 637, mem_usage:GPU:0 3.5GB, num_seqs 31, 0.639 sec/step, elapsed 0:01:54, exp. remaining 0:00:46, complete 71.40%
pretrain epoch 1 'dev' eval, step 101, cost:ctc 4.758786897603159, cost:output/output_prob 7.2623697759188985, error:ctc 0.9728033223655074, error:decision 0.0, error:output/output_prob 0.9246861687861383, loss 5746.1133, max_size:classes 18, max_size:data 629, mem_usage:GPU:0 3.5GB, num_seqs 31, 0.632 sec/step, elapsed 0:01:55, exp. remaining 0:00:43, complete 72.60%
pretrain epoch 1 'dev' eval, step 102, cost:ctc 4.946688453872696, cost:output/output_prob 7.460353432113947, error:ctc 0.9810298299416899, error:decision 0.0, error:output/output_prob 0.9322493411600589, loss 4578.198, max_size:classes 18, max_size:data 805, mem_usage:GPU:0 3.5GB, num_seqs 24, 0.754 sec/step, elapsed 0:01:56, exp. remaining 0:00:41, complete 73.90%
pretrain epoch 1 'dev' eval, step 103, cost:ctc 4.7037548937155975, cost:output/output_prob 7.233300111709013, error:ctc 0.9783654210623354, error:decision 0.0, error:output/output_prob 0.9134615724906325, loss 4965.8145, max_size:classes 18, max_size:data 710, mem_usage:GPU:0 3.5GB, num_seqs 28, 0.690 sec/step, elapsed 0:01:57, exp. remaining 0:00:38, complete 75.10%
pretrain epoch 1 'dev' eval, step 104, cost:ctc 3.8502966501398532, cost:output/output_prob 7.240671949938815, error:ctc 0.9875259944237769, error:decision 0.0, error:output/output_prob 0.9085239148698747, loss 5334.756, max_size:classes 20, max_size:data 611, mem_usage:GPU:0 3.5GB, num_seqs 32, 0.627 sec/step, elapsed 0:01:57, exp. remaining 0:00:36, complete 76.27%
pretrain epoch 1 'dev' eval, step 105, cost:ctc 4.557666038734709, cost:output/output_prob 7.076877341495447, error:ctc 0.977220997447148, error:decision 0.0, error:output/output_prob 0.9111617691814899, loss 5107.5645, max_size:classes 19, max_size:data 659, mem_usage:GPU:0 3.5GB, num_seqs 30, 0.647 sec/step, elapsed 0:01:58, exp. remaining 0:00:34, complete 77.67%
pretrain epoch 1 'dev' eval, step 106, cost:ctc 3.4891419733645535, cost:output/output_prob 7.104204569702688, error:ctc 0.9807280395179987, error:decision 0.0, error:output/output_prob 0.91006422881037, loss 4947.093, max_size:classes 18, max_size:data 606, mem_usage:GPU:0 3.5GB, num_seqs 33, 0.632 sec/step, elapsed 0:01:58, exp. remaining 0:00:31, complete 79.03%
pretrain epoch 1 'dev' eval, step 107, cost:ctc 3.3022574183363815, cost:output/output_prob 7.234998757712731, error:ctc 0.983364153187722, error:decision 0.0, error:output/output_prob 0.9057301410939544, loss 5700.6553, max_size:classes 22, max_size:data 520, mem_usage:GPU:0 3.5GB, num_seqs 38, 0.598 sec/step, elapsed 0:01:59, exp. remaining 0:00:29, complete 80.37%
pretrain epoch 1 'dev' eval, step 108, cost:ctc 5.030302534506234, cost:output/output_prob 7.229941668653282, error:ctc 0.9756592058110982, error:decision 0.0, error:output/output_prob 0.900608497671783, loss 6044.301, max_size:classes 22, max_size:data 539, mem_usage:GPU:0 3.5GB, num_seqs 37, 0.608 sec/step, elapsed 0:02:00, exp. remaining 0:00:26, complete 81.77%
pretrain epoch 1 'dev' eval, step 109, cost:ctc 4.232445996022136, cost:output/output_prob 7.066386104378012, error:ctc 0.9782608563546091, error:decision 0.0, error:output/output_prob 0.9130434659309685, loss 4677.717, max_size:classes 16, max_size:data 609, mem_usage:GPU:0 3.5GB, num_seqs 32, 0.620 sec/step, elapsed 0:02:00, exp. remaining 0:00:24, complete 83.07%
pretrain epoch 1 'dev' eval, step 110, cost:ctc 5.808970409757876, cost:output/output_prob 7.083989429346957, error:ctc 0.9733333569020033, error:decision 0.0, error:output/output_prob 0.9088889108970761, loss 5801.832, max_size:classes 15, max_size:data 553, mem_usage:GPU:0 3.5GB, num_seqs 36, 0.620 sec/step, elapsed 0:02:01, exp. remaining 0:00:22, complete 84.53%
pretrain epoch 1 'dev' eval, step 111, cost:ctc 5.055823895456058, cost:output/output_prob 7.168838174302209, error:ctc 0.9898579884320498, error:decision 0.0, error:output/output_prob 0.900608497671783, loss 6026.759, max_size:classes 17, max_size:data 508, mem_usage:GPU:0 3.5GB, num_seqs 39, 0.555 sec/step, elapsed 0:02:01, exp. remaining 0:00:20, complete 85.87%
pretrain epoch 1 'dev' eval, step 112, cost:ctc 4.517229173436931, cost:output/output_prob 7.058796771591972, error:ctc 0.9844098282046616, error:decision 0.0, error:output/output_prob 0.9020044805947691, loss 5197.6357, max_size:classes 17, max_size:data 510, mem_usage:GPU:0 3.5GB, num_seqs 36, 0.563 sec/step, elapsed 0:02:02, exp. remaining 0:00:17, complete 87.37%
pretrain epoch 1 'dev' eval, step 113, cost:ctc 3.7948219309834026, cost:output/output_prob 7.183610635191826, error:ctc 0.9813083801418542, error:decision 0.0, error:output/output_prob 0.9088784758932889, loss 4698.7695, max_size:classes 16, max_size:data 571, mem_usage:GPU:0 3.5GB, num_seqs 35, 0.598 sec/step, elapsed 0:02:03, exp. remaining 0:00:15, complete 88.63%
pretrain epoch 1 'dev' eval, step 114, cost:ctc 4.524375747186923, cost:output/output_prob 7.161859491783332, error:ctc 0.9794238386675715, error:decision 0.0, error:output/output_prob 0.8991769275162369, loss 5679.5107, max_size:classes 17, max_size:data 471, mem_usage:GPU:0 3.5GB, num_seqs 42, 0.527 sec/step, elapsed 0:02:03, exp. remaining 0:00:13, complete 90.17%
pretrain epoch 1 'dev' eval, step 115, cost:ctc 5.309853858568317, cost:output/output_prob 6.957252003072028, error:ctc 0.9870410102885216, error:decision 0.0, error:output/output_prob 0.8898487882688642, loss 5679.67, max_size:classes 13, max_size:data 486, mem_usage:GPU:0 3.5GB, num_seqs 41, 0.532 sec/step, elapsed 0:02:04, exp. remaining 0:00:10, complete 91.87%
pretrain epoch 1 'dev' eval, step 116, cost:ctc 4.904849618792241, cost:output/output_prob 7.14883654233995, error:ctc 0.9837963036261499, error:decision 0.0, error:output/output_prob 0.8842592658475041, loss 5207.1924, max_size:classes 14, max_size:data 495, mem_usage:GPU:0 3.5GB, num_seqs 40, 0.532 sec/step, elapsed 0:02:04, exp. remaining 0:00:08, complete 93.70%
pretrain epoch 1 'dev' eval, step 117, cost:ctc 3.97353218763692, cost:output/output_prob 6.892869431838335, error:ctc 0.9912280775606632, error:decision 0.0, error:output/output_prob 0.8991228137165308, loss 4955.079, max_size:classes 17, max_size:data 471, mem_usage:GPU:0 3.5GB, num_seqs 42, 0.533 sec/step, elapsed 0:02:05, exp. remaining 0:00:06, complete 95.40%
pretrain epoch 1 'dev' eval, step 118, cost:ctc 5.115233733344155, cost:output/output_prob 6.884605272034719, error:ctc 0.9799498689826578, error:decision 0.0, error:output/output_prob 0.8872180399484932, loss 4787.9355, max_size:classes 14, max_size:data 505, mem_usage:GPU:0 3.5GB, num_seqs 39, 0.538 sec/step, elapsed 0:02:05, exp. remaining 0:00:03, complete 97.20%
pretrain epoch 1 'dev' eval, step 119, cost:ctc 4.641196172138507, cost:output/output_prob 7.121212894045357, error:ctc 0.9753363719210029, error:decision 0.0, error:output/output_prob 0.8766816584393382, loss 5246.034, max_size:classes 13, max_size:data 452, mem_usage:GPU:0 3.5GB, num_seqs 44, 0.501 sec/step, elapsed 0:02:06, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 120, cost:ctc 5.647820476497714, cost:output/output_prob 6.809709698557924, error:ctc 0.9840425220318139, error:decision 0.0, error:output/output_prob 0.8803191210608929, loss 4684.0312, max_size:classes 12, max_size:data 498, mem_usage:GPU:0 3.5GB, num_seqs 40, 0.525 sec/step, elapsed 0:02:06, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 121, cost:ctc 5.545276916402031, cost:output/output_prob 7.144049383909135, error:ctc 0.9954442328307778, error:decision 0.0, error:output/output_prob 0.8815490116830915, loss 5570.6143, max_size:classes 13, max_size:data 428, mem_usage:GPU:0 3.5GB, num_seqs 45, 0.477 sec/step, elapsed 0:02:07, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 122, cost:ctc 5.304369255348263, cost:output/output_prob 7.137698058168098, error:ctc 0.9943019892089069, error:decision 0.0, error:output/output_prob 0.8860398815013468, loss 4367.1655, max_size:classes 14, max_size:data 513, mem_usage:GPU:0 3.5GB, num_seqs 38, 0.564 sec/step, elapsed 0:02:07, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 123, cost:ctc 5.855927432993212, cost:output/output_prob 6.906924462869824, error:ctc 0.9873737364541739, error:decision 0.0, error:output/output_prob 0.8712121204007417, loss 5054.0894, max_size:classes 13, max_size:data 434, mem_usage:GPU:0 3.5GB, num_seqs 46, 0.479 sec/step, elapsed 0:02:08, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 124, cost:ctc 6.524688918729169, cost:output/output_prob 6.757405739750993, error:ctc 0.9856458967551589, error:decision 0.0, error:output/output_prob 0.8516746098175645, loss 5551.916, max_size:classes 16, max_size:data 385, mem_usage:GPU:0 3.5GB, num_seqs 51, 0.459 sec/step, elapsed 0:02:08, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 125, cost:ctc 7.184459570801209, cost:output/output_prob 6.741792875502597, error:ctc 0.9860465079545975, error:decision 0.0, error:output/output_prob 0.8790697641670704, loss 5988.2886, max_size:classes 11, max_size:data 360, mem_usage:GPU:0 3.5GB, num_seqs 55, 0.440 sec/step, elapsed 0:02:09, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 126, cost:ctc inf, cost:output/output_prob 6.868330508373219, error:ctc 0.983783807605505, error:decision 0.0, error:output/output_prob 0.8486486691981554, loss inf, max_size:classes 11, max_size:data 386, mem_usage:GPU:0 3.5GB, num_seqs 51, 0.457 sec/step, elapsed 0:02:09, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 127, cost:ctc 8.876057509110069, cost:output/output_prob 6.990994159355068, error:ctc 0.997109804302454, error:decision 0.0, error:output/output_prob 0.8641618303954601, loss 5490.0, max_size:classes 11, max_size:data 366, mem_usage:GPU:0 3.5GB, num_seqs 54, 0.435 sec/step, elapsed 0:02:10, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 128, cost:ctc 9.660228659937275, cost:output/output_prob 6.954808416497144, error:ctc 1.0000000074505806, error:decision 0.0, error:output/output_prob 0.873456796631217, loss 5383.272, max_size:classes 11, max_size:data 329, mem_usage:GPU:0 3.5GB, num_seqs 60, 0.412 sec/step, elapsed 0:02:10, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 1 'dev' eval, step 129, cost:ctc 12.577504136051743, cost:output/output_prob 6.883668954652592, error:ctc 0.9999999990686774, error:decision 0.0, error:output/output_prob 0.9677419345825911, loss 1809.8892, max_size:classes 5, max_size:data 288, mem_usage:GPU:0 3.5GB, num_seqs 25, 0.275 sec/step, elapsed 0:02:10, exp. remaining 0:00:01, complete 99.20%
Stats:
  mem_usage:GPU:0: Stats(mean=3.5GB, std_dev=0.0B, min=3.5GB, max=3.5GB, num_seqs=130, avg_data_len=1)
pretrain epoch 1 'dev' eval, finished after 130 steps, 0:02:10 elapsed (96.4% computing time)
Learning-rate-control: error key 'dev_score_output/output_prob' from {'dev_score_ctc': inf, 'dev_score_output/output_prob': 7.40758433733548, 'dev_error_ctc': 0.9798023427516609, 'dev_error_decision': 0.0, 'dev_error_output/output_prob': 0.9408462881899242}
dev: score ctc inf output/output_prob 7.40758433733548 error ctc 0.9798023427516609 decision 0.0 output/output_prob 0.9408462881899242
Only 1 epochs stored so far and keeping last 2 epochs and best 4 epochs, thus not cleaning up any epochs yet.
<LibriSpeechCorpus 'train' epoch=2>, epoch 2. Old mean seq len (transcription) is 182.545197, new is 61.407143, requested max is 75.000000. Old num seqs is 6715, new num seqs is 840.
<LibriSpeechCorpus 'train' epoch=2>, epoch 2. Old num seqs 14062, new num seqs 840.
Update config key 'max_seq_length' for epoch 2: {'classes': 75} -> {'classes': 60}
start pretrain epoch 2 with learning rate 0.0003555555555555555 ...
TF: log_dir: data/exp-returnn/train-2019-12-20-15-38-17
pretrain epoch 2, step 0, cost:ctc 8.165468939542848, cost:output/output_prob 7.088296892083463, error:ctc 0.9806451462209225, error:decision 0.0, error:output/output_prob 0.9548386950045824, loss 4728.6675, max_size:classes 11, max_size:data 406, mem_usage:GPU:0 3.5GB, num_seqs 49, 1.312 sec/step, elapsed 0:00:01, exp. remaining 0:00:06, complete 21.19%
pretrain epoch 2, step 1, cost:ctc 6.015452687705647, cost:output/output_prob 7.098948772878431, error:ctc 0.9902676320634783, error:decision 0.0, error:output/output_prob 0.8856447618454695, loss 5390.019, max_size:classes 12, max_size:data 424, mem_usage:GPU:0 3.5GB, num_seqs 47, 1.407 sec/step, elapsed 0:00:03, exp. remaining 0:00:04, complete 40.83%
pretrain epoch 2, step 2, cost:ctc 5.53530980050482, cost:output/output_prob 7.16876343142701, error:ctc 0.9881305578164756, error:decision 0.0, error:output/output_prob 0.8872403507120907, loss 4281.2725, max_size:classes 12, max_size:data 548, mem_usage:GPU:0 3.5GB, num_seqs 36, 1.734 sec/step, elapsed 0:00:04, exp. remaining 0:00:04, complete 51.43%
pretrain epoch 2, step 3, cost:ctc 4.626632407482873, cost:output/output_prob 6.966983320133352, error:ctc 0.9705882773268968, error:decision 0.0, error:output/output_prob 0.9660633902531117, loss 5124.378, max_size:classes 13, max_size:data 439, mem_usage:GPU:0 3.5GB, num_seqs 45, 1.429 sec/step, elapsed 0:00:06, exp. remaining 0:00:05, complete 54.17%
pretrain epoch 2, step 4, cost:ctc 4.967612286582153, cost:output/output_prob 7.277838473535212, error:ctc 0.9882075618952513, error:decision 0.0, error:output/output_prob 0.9080188814550638, loss 5192.0713, max_size:classes 16, max_size:data 517, mem_usage:GPU:0 3.5GB, num_seqs 38, 1.719 sec/step, elapsed 0:00:08, exp. remaining 0:00:05, complete 57.98%
pretrain epoch 2, step 5, cost:ctc 4.381613986162847, cost:output/output_prob 7.03855032594879, error:ctc 0.9780822177417575, error:decision 0.0, error:output/output_prob 0.9123287913389503, loss 4168.36, max_size:classes 14, max_size:data 620, mem_usage:GPU:0 3.5GB, num_seqs 32, 1.500 sec/step, elapsed 0:00:09, exp. remaining 0:00:06, complete 59.76%
pretrain epoch 2, step 6, cost:ctc 4.229062398346372, cost:output/output_prob 7.366495430547445, error:ctc 0.9877451329957694, error:decision 0.0, error:output/output_prob 0.9142157186288387, loss 4730.9873, max_size:classes 17, max_size:data 493, mem_usage:GPU:0 3.5GB, num_seqs 35, 1.629 sec/step, elapsed 0:00:11, exp. remaining 0:00:07, complete 61.31%
pretrain epoch 2, step 7, cost:ctc 4.1231618202807, cost:output/output_prob 7.115790519862344, error:ctc 1.0000000384170562, error:decision 0.0, error:output/output_prob 0.9236277204472572, loss 4709.121, max_size:classes 18, max_size:data 620, mem_usage:GPU:0 3.5GB, num_seqs 32, 1.530 sec/step, elapsed 0:00:12, exp. remaining 0:00:06, complete 64.64%
pretrain epoch 2, step 8, cost:ctc 4.151199782792219, cost:output/output_prob 7.288054056583633, error:ctc 0.9973822091706097, error:decision 0.0, error:output/output_prob 0.9188481769524515, loss 4369.795, max_size:classes 17, max_size:data 708, mem_usage:GPU:0 3.5GB, num_seqs 28, 1





pretrain epoch 5 'dev' eval, step 66, cost:ctc 2.9717514234926345, cost:output/output_prob 7.2535601118327415, error:ctc 0.9588785340311007, error:decision 0.0, error:output/output_prob 0.9588785340311007, loss 5470.5415, max_size:classes 29, max_size:data 903, mem_usage:GPU:0 3.6GB, num_seqs 22, 0.846 sec/step, elapsed 0:01:28, exp. remaining 0:02:11, complete 40.30%
pretrain epoch 5 'dev' eval, step 67, cost:ctc 2.980284060547774, cost:output/output_prob 7.254719570739098, error:ctc 0.9605263229459524, error:decision 0.0, error:output/output_prob 0.9342105332762003, loss 4667.1616, max_size:classes 30, max_size:data 1075, mem_usage:GPU:0 3.6GB, num_seqs 18, 0.958 sec/step, elapsed 0:01:29, exp. remaining 0:02:08, complete 41.03%
pretrain epoch 5 'dev' eval, step 68, cost:ctc 3.8381350531390126, cost:output/output_prob 7.244992461290167, error:ctc 0.9584905803203583, error:decision 0.0, error:output/output_prob 0.9566037878394127, loss 5874.0576, max_size:classes 29, max_size:data 902, mem_usage:GPU:0 3.6GB, num_seqs 22, 0.841 sec/step, elapsed 0:01:30, exp. remaining 0:02:06, complete 41.80%
pretrain epoch 5 'dev' eval, step 69, cost:ctc 3.4265900402788816, cost:output/output_prob 7.111502392545617, error:ctc 0.9579158439300954, error:decision 0.0, error:output/output_prob 0.9559118358884007, loss 5258.508, max_size:classes 28, max_size:data 929, mem_usage:GPU:0 3.6GB, num_seqs 21, 0.871 sec/step, elapsed 0:01:31, exp. remaining 0:02:04, complete 42.43%
pretrain epoch 5 'dev' eval, step 70, cost:ctc 1.9356518004155419, cost:output/output_prob 6.991465399908975, error:ctc 0.9591001821681857, error:decision 0.0, error:output/output_prob 0.9611451718956232, loss 4365.3604, max_size:classes 28, max_size:data 995, mem_usage:GPU:0 3.6GB, num_seqs 20, 0.907 sec/step, elapsed 0:01:32, exp. remaining 0:02:01, complete 43.20%
pretrain epoch 5 'dev' eval, step 71, cost:ctc 1.3297505114337582, cost:output/output_prob 7.3748899649590385, error:ctc 0.9593908432871103, error:decision 0.0, error:output/output_prob 0.9678510800004005, loss 5144.4424, max_size:classes 32, max_size:data 798, mem_usage:GPU:0 3.6GB, num_seqs 24, 0.771 sec/step, elapsed 0:01:33, exp. remaining 0:01:58, complete 44.00%
pretrain epoch 5 'dev' eval, step 72, cost:ctc 2.8229356054297345, cost:output/output_prob 7.227224716586705, error:ctc 0.95740739046596, error:decision 0.0, error:output/output_prob 0.9592592422850431, loss 5427.087, max_size:classes 28, max_size:data 844, mem_usage:GPU:0 3.6GB, num_seqs 23, 0.806 sec/step, elapsed 0:01:33, exp. remaining 0:01:55, complete 44.77%
pretrain epoch 5 'dev' eval, step 73, cost:ctc 2.4170175877809186, cost:output/output_prob 6.876991463549302, error:ctc 0.9568788832984865, error:decision 0.0, error:output/output_prob 0.9589322714600712, loss 4526.182, max_size:classes 26, max_size:data 912, mem_usage:GPU:0 3.6GB, num_seqs 21, 0.843 sec/step, elapsed 0:01:34, exp. remaining 0:01:53, complete 45.57%
pretrain epoch 5 'dev' eval, step 74, cost:ctc 2.8222692715271482, cost:output/output_prob 7.115763696247343, error:ctc 0.9558011217741297, error:decision 0.0, error:output/output_prob 0.9613259837497027, loss 5396.3516, max_size:classes 29, max_size:data 827, mem_usage:GPU:0 3.6GB, num_seqs 24, 0.787 sec/step, elapsed 0:01:35, exp. remaining 0:01:50, complete 46.33%
pretrain epoch 5 'dev' eval, step 75, cost:ctc 3.476647038812274, cost:output/output_prob 7.14267759374701, error:ctc 0.9546436029486358, error:decision 0.0, error:output/output_prob 0.9740820473525673, loss 4916.7476, max_size:classes 27, max_size:data 915, mem_usage:GPU:0 3.6GB, num_seqs 21, 0.857 sec/step, elapsed 0:01:36, exp. remaining 0:01:47, complete 47.20%
pretrain epoch 5 'dev' eval, step 76, cost:ctc 3.420143710212045, cost:output/output_prob 7.1774369320886535, error:ctc 0.9539748709648848, error:decision 0.0, error:output/output_prob 0.9623430715873837, loss 5065.6436, max_size:classes 25, max_size:data 874, mem_usage:GPU:0 3.6GB, num_seqs 22, 0.810 sec/step, elapsed 0:01:37, exp. remaining 0:01:45, complete 48.03%
pretrain epoch 5 'dev' eval, step 77, cost:ctc 3.012966156365536, cost:output/output_prob 7.146390528638676, error:ctc 0.9539078278467059, error:decision 0.0, error:output/output_prob 0.9519038198050112, loss 5069.519, max_size:classes 28, max_size:data 849, mem_usage:GPU:0 3.6GB, num_seqs 23, 0.799 sec/step, elapsed 0:01:37, exp. remaining 0:01:42, complete 48.83%
pretrain epoch 5 'dev' eval, step 78, cost:ctc 2.9542417972444923, cost:output/output_prob 7.277175240199654, error:ctc 0.9536585374735296, error:decision 0.0, error:output/output_prob 0.9292682935483754, loss 4194.881, max_size:classes 26, max_size:data 1043, mem_usage:GPU:0 3.6GB, num_seqs 19, 0.946 sec/step, elapsed 0:01:38, exp. remaining 0:01:40, complete 49.67%
pretrain epoch 5 'dev' eval, step 79, cost:ctc 3.5594532940649515, cost:output/output_prob 7.332017926377148, error:ctc 0.9540000453125685, error:decision 0.0, error:output/output_prob 0.9460000449325889, loss 5445.7354, max_size:classes 29, max_size:data 844, mem_usage:GPU:0 3.6GB, num_seqs 23, 0.803 sec/step, elapsed 0:01:39, exp. remaining 0:01:37, complete 50.60%
pretrain epoch 5 'dev' eval, step 80, cost:ctc 1.5364648510209236, cost:output/output_prob 7.173555432554622, error:ctc 0.9512194767594337, error:decision 0.0, error:output/output_prob 0.9613820780068636, loss 4285.33, max_size:classes 27, max_size:data 826, mem_usage:GPU:0 3.6GB, num_seqs 24, 0.791 sec/step, elapsed 0:01:40, exp. remaining 0:01:34, complete 51.53%
pretrain epoch 5 'dev' eval, step 81, cost:ctc 3.094056705020421, cost:output/output_prob 7.186695806904936, error:ctc 0.9515789039433002, error:decision 0.0, error:output/output_prob 0.9431578516960144, loss 4883.3574, max_size:classes 25, max_size:data 861, mem_usage:GPU:0 3.6GB, num_seqs 23, 0.811 sec/step, elapsed 0:01:41, exp. remaining 0:01:32, complete 52.37%
pretrain epoch 5 'dev' eval, step 82, cost:ctc 4.255194200216749, cost:output/output_prob 7.15453292062017, error:ctc 0.9513184356037527, error:decision 0.0, error:output/output_prob 0.9533468331210315, loss 5624.9956, max_size:classes 26, max_size:data 818, mem_usage:GPU:0 3.6GB, num_seqs 24, 0.793 sec/step, elapsed 0:01:42, exp. remaining 0:01:29, complete 53.23%
pretrain epoch 5 'dev' eval, step 83, cost:ctc 3.723280739011983, cost:output/output_prob 6.955544073345891, error:ctc 0.950323948636651, error:decision 0.0, error:output/output_prob 0.950323948636651, loss 4944.296, max_size:classes 24, max_size:data 864, mem_usage:GPU:0 3.6GB, num_seqs 23, 0.801 sec/step, elapsed 0:01:42, exp. remaining 0:01:27, complete 54.17%
pretrain epoch 5 'dev' eval, step 84, cost:ctc 4.702557547700735, cost:output/output_prob 7.141349599328748, error:ctc 0.9484127531759441, error:decision 0.0, error:output/output_prob 0.9484127531759441, loss 5969.329, max_size:classes 23, max_size:data 762, mem_usage:GPU:0 3.6GB, num_seqs 26, 0.734 sec/step, elapsed 0:01:43, exp. remaining 0:01:24, complete 55.10%
pretrain epoch 5 'dev' eval, step 85, cost:ctc 1.7719067997329319, cost:output/output_prob 7.160768413323666, error:ctc 0.9514563309494406, error:decision 0.0, error:output/output_prob 0.9417475928785279, loss 4600.3276, max_size:classes 25, max_size:data 794, mem_usage:GPU:0 3.6GB, num_seqs 25, 0.764 sec/step, elapsed 0:01:44, exp. remaining 0:01:21, complete 56.03%
pretrain epoch 5 'dev' eval, step 86, cost:ctc 3.8511057884647926, cost:output/output_prob 7.247600779376171, error:ctc 0.9471365250647068, error:decision 0.0, error:output/output_prob 0.9537444543093443, loss 5038.813, max_size:classes 22, max_size:data 815, mem_usage:GPU:0 3.6GB, num_seqs 24, 0.766 sec/step, elapsed 0:01:45, exp. remaining 0:01:19, complete 57.00%
pretrain epoch 5 'dev' eval, step 87, cost:ctc 3.5369198418540577, cost:output/output_prob 6.994695901097373, error:ctc 0.9479167161043733, error:decision 0.0, error:output/output_prob 0.950000049546361, loss 5055.1753, max_size:classes 22, max_size:data 789, mem_usage:GPU:0 3.6GB, num_seqs 25, 0.746 sec/step, elapsed 0:01:45, exp. remaining 0:01:16, complete 58.00%
pretrain epoch 5 'dev' eval, step 88, cost:ctc 2.2385063068236377, cost:output/output_prob 7.373902194080556, error:ctc 0.9479553799610584, error:decision 0.0, error:output/output_prob 0.9665427403524517, loss 5171.4756, max_size:classes 24, max_size:data 708, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.707 sec/step, elapsed 0:01:46, exp. remaining 0:01:14, complete 58.90%
pretrain epoch 5 'dev' eval, step 89, cost:ctc 3.8794213920657508, cost:output/output_prob 7.235452345953603, error:ctc 0.947069966001436, error:decision 0.0, error:output/output_prob 0.9754253542050718, loss 5879.768, max_size:classes 24, max_size:data 696, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.689 sec/step, elapsed 0:01:47, exp. remaining 0:01:11, complete 59.93%
pretrain epoch 5 'dev' eval, step 90, cost:ctc 4.507671880697558, cost:output/output_prob 7.308976653337368, error:ctc 0.9440715927630663, error:decision 0.0, error:output/output_prob 0.9619686845690012, loss 5282.042, max_size:classes 23, max_size:data 777, mem_usage:GPU:0 3.6GB, num_seqs 25, 0.750 sec/step, elapsed 0:01:48, exp. remaining 0:01:09, complete 60.87%
pretrain epoch 5 'dev' eval, step 91, cost:ctc 3.0489893171007907, cost:output/output_prob 7.196367790744262, error:ctc 0.9446808211505413, error:decision 0.0, error:output/output_prob 0.9702127352356911, loss 4815.318, max_size:classes 21, max_size:data 751, mem_usage:GPU:0 3.6GB, num_seqs 26, 0.718 sec/step, elapsed 0:01:48, exp. remaining 0:01:06, complete 61.90%
pretrain epoch 5 'dev' eval, step 92, cost:ctc 1.902267030007323, cost:output/output_prob 7.0934799499852375, error:ctc 0.9450980951078236, error:decision 0.0, error:output/output_prob 0.9666667238343507, loss 4587.8306, max_size:classes 22, max_size:data 697, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.682 sec/step, elapsed 0:01:49, exp. remaining 0:01:04, complete 62.93%
pretrain epoch 5 'dev' eval, step 93, cost:ctc 2.241372323593737, cost:output/output_prob 7.197493746161911, error:ctc 0.9432048455346376, error:decision 0.0, error:output/output_prob 0.9655172182247043, loss 4653.3613, max_size:classes 20, max_size:data 687, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.675 sec/step, elapsed 0:01:50, exp. remaining 0:01:02, complete 63.73%
pretrain epoch 5 'dev' eval, step 94, cost:ctc 2.7051220487524006, cost:output/output_prob 7.02852531221356, error:ctc 0.9412997579202056, error:decision 0.0, error:output/output_prob 0.9580712458118796, loss 4642.95, max_size:classes 24, max_size:data 692, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.696 sec/step, elapsed 0:01:50, exp. remaining 0:01:00, complete 64.67%
pretrain epoch 5 'dev' eval, step 95, cost:ctc 2.166472227787665, cost:output/output_prob 7.0668102156842565, error:ctc 0.9421157669275999, error:decision 0.0, error:output/output_prob 0.9540918148122728, loss 4625.8745, max_size:classes 22, max_size:data 683, mem_usage:GPU:0 3.6GB, num_seqs 29, 0.686 sec/step, elapsed 0:01:51, exp. remaining 0:00:58, complete 65.73%
pretrain epoch 5 'dev' eval, step 96, cost:ctc 4.342367919578493, cost:output/output_prob 7.308555708180818, error:ctc 0.9419729475630446, error:decision 0.0, error:output/output_prob 0.9593810718506574, loss 6023.5273, max_size:classes 22, max_size:data 656, mem_usage:GPU:0 3.6GB, num_seqs 30, 0.662 sec/step, elapsed 0:01:52, exp. remaining 0:00:55, complete 66.73%
pretrain epoch 5 'dev' eval, step 97, cost:ctc 4.628287179878498, cost:output/output_prob 7.305351223285129, error:ctc 0.9370629577897489, error:decision 0.0, error:output/output_prob 0.9627039839979261, loss 5119.531, max_size:classes 20, max_size:data 728, mem_usage:GPU:0 3.6GB, num_seqs 27, 0.704 sec/step, elapsed 0:01:52, exp. remaining 0:00:53, complete 67.83%
pretrain epoch 5 'dev' eval, step 98, cost:ctc 3.405525072439133, cost:output/output_prob 7.054854269700854, error:ctc 0.9376257215626538, error:decision 0.0, error:output/output_prob 0.9637826622929424, loss 5198.8086, max_size:classes 20, max_size:data 623, mem_usage:GPU:0 3.6GB, num_seqs 31, 0.625 sec/step, elapsed 0:01:53, exp. remaining 0:00:50, complete 69.10%
pretrain epoch 5 'dev' eval, step 99, cost:ctc 4.6868938111822445, cost:output/output_prob 7.344657510284833, error:ctc 0.9370786612853408, error:decision 0.0, error:output/output_prob 0.9460674254223704, loss 5354.04, max_size:classes 21, max_size:data 713, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.702 sec/step, elapsed 0:01:54, exp. remaining 0:00:48, complete 70.33%
pretrain epoch 5 'dev' eval, step 100, cost:ctc 3.3601276042002155, cost:output/output_prob 7.287177525684001, error:ctc 0.9345991108566523, error:decision 0.0, error:output/output_prob 0.9683543834835291, loss 5046.8228, max_size:classes 19, max_size:data 637, mem_usage:GPU:0 3.6GB, num_seqs 31, 0.635 sec/step, elapsed 0:01:54, exp. remaining 0:00:46, complete 71.40%
pretrain epoch 5 'dev' eval, step 101, cost:ctc 4.771281994040464, cost:output/output_prob 7.230934372860247, error:ctc 0.935146419564262, error:decision 0.0, error:output/output_prob 0.9769874226767569, loss 5737.0596, max_size:classes 18, max_size:data 629, mem_usage:GPU:0 3.6GB, num_seqs 31, 0.631 sec/step, elapsed 0:01:55, exp. remaining 0:00:43, complete 72.60%
pretrain epoch 5 'dev' eval, step 102, cost:ctc 4.6545060425555675, cost:output/output_prob 7.428415338656008, error:ctc 0.9349593683145939, error:decision 0.0, error:output/output_prob 0.9783198027871548, loss 4458.5977, max_size:classes 18, max_size:data 805, mem_usage:GPU:0 3.6GB, num_seqs 24, 0.769 sec/step, elapsed 0:01:56, exp. remaining 0:00:41, complete 73.90%
pretrain epoch 5 'dev' eval, step 103, cost:ctc 4.44057481142039, cost:output/output_prob 7.148480021409796, error:ctc 0.9326923424378037, error:decision 0.0, error:output/output_prob 0.9615384973585606, loss 4821.047, max_size:classes 18, max_size:data 710, mem_usage:GPU:0 3.6GB, num_seqs 28, 0.687 sec/step, elapsed 0:01:56, exp. remaining 0:00:38, complete 75.10%
pretrain epoch 5 'dev' eval, step 104, cost:ctc 3.6963477125228223, cost:output/output_prob 7.0792970259620915, error:ctc 0.9334719399921596, error:decision 0.0, error:output/output_prob 0.9521829588338733, loss 5183.085, max_size:classes 20, max_size:data 611, mem_usage:GPU:0 3.6GB, num_seqs 32, 0.624 sec/step, elapsed 0:01:57, exp. remaining 0:00:36, complete 76.27%
pretrain epoch 5 'dev' eval, step 105, cost:ctc 4.303034307859832, cost:output/output_prob 6.93081728682472, error:ctc 0.9316629089880735, error:decision 0.0, error:output/output_prob 0.9612756664864719, loss 4931.6606, max_size:classes 19, max_size:data 659, mem_usage:GPU:0 3.6GB, num_seqs 30, 0.652 sec/step, elapsed 0:01:58, exp. remaining 0:00:34, complete 77.67%
pretrain epoch 5 'dev' eval, step 106, cost:ctc 3.249102338707189, cost:output/output_prob 6.9780413744622365, error:ctc 0.9293361771851778, error:decision 0.0, error:output/output_prob 0.9571734359487891, loss 4776.076, max_size:classes 18, max_size:data 606, mem_usage:GPU:0 3.6GB, num_seqs 33, 0.632 sec/step, elapsed 0:01:58, exp. remaining 0:00:31, complete 79.03%
pretrain epoch 5 'dev' eval, step 107, cost:ctc 3.169877239580927, cost:output/output_prob 7.17095584228835, error:ctc 0.9297597162658349, error:decision 0.0, error:output/output_prob 0.9593345780158415, loss 5594.3906, max_size:classes 22, max_size:data 520, mem_usage:GPU:0 3.6GB, num_seqs 38, 0.592 sec/step, elapsed 0:01:59, exp. remaining 0:00:29, complete 80.37%
pretrain epoch 5 'dev' eval, step 108, cost:ctc 4.8429228760625165, cost:output/output_prob 7.124790848723137, error:ctc 0.9249492678791285, error:decision 0.0, error:output/output_prob 0.9553752306383103, loss 5900.083, max_size:classes 22, max_size:data 539, mem_usage:GPU:0 3.6GB, num_seqs 37, 0.611 sec/step, elapsed 0:02:00, exp. remaining 0:00:26, complete 81.77%
pretrain epoch 5 'dev' eval, step 109, cost:ctc 3.8738865720824833, cost:output/output_prob 7.04211416271454, error:ctc 0.9227053015492857, error:decision 0.0, error:output/output_prob 0.9613526440225542, loss 4519.2246, max_size:classes 16, max_size:data 609, mem_usage:GPU:0 3.6GB, num_seqs 32, 0.610 sec/step, elapsed 0:02:00, exp. remaining 0:00:24, complete 83.07%
pretrain epoch 5 'dev' eval, step 110, cost:ctc 5.442140973791993, cost:output/output_prob 7.208451237916279, error:ctc 0.920000022277236, error:decision 0.0, error:output/output_prob 0.9600000232458115, loss 5692.7666, max_size:classes 15, max_size:data 553, mem_usage:GPU:0 3.6GB, num_seqs 36, 0.595 sec/step, elapsed 0:02:01, exp. remaining 0:00:22, complete 84.53%
pretrain epoch 5 'dev' eval, step 111, cost:ctc 4.757726713837144, cost:output/output_prob 7.111733039705655, error:ctc 0.9208924728445709, error:decision 0.0, error:output/output_prob 0.9634888207074255, loss 5851.6436, max_size:classes 17, max_size:data 508, mem_usage:GPU:0 3.6GB, num_seqs 39, 0.542 sec/step, elapsed 0:02:01, exp. remaining 0:00:20, complete 85.87%
pretrain epoch 5 'dev' eval, step 112, cost:ctc 4.151399389160986, cost:output/output_prob 6.956092408218694, error:ctc 0.9198218530509621, error:decision 0.0, error:output/output_prob 0.9599109410773963, loss 4987.2637, max_size:classes 17, max_size:data 510, mem_usage:GPU:0 3.6GB, num_seqs 36, 0.555 sec/step, elapsed 0:02:02, exp. remaining 0:00:17, complete 87.37%
pretrain epoch 5 'dev' eval, step 113, cost:ctc 3.400502034828321, cost:output/output_prob 7.186279069321699, error:ctc 0.9182242699898779, error:decision 0.0, error:output/output_prob 0.9836448286660014, loss 4531.1426, max_size:classes 16, max_size:data 571, mem_usage:GPU:0 3.6GB, num_seqs 35, 0.608 sec/step, elapsed 0:02:03, exp. remaining 0:00:15, complete 88.63%
pretrain epoch 5 'dev' eval, step 114, cost:ctc 4.2734644973869536, cost:output/output_prob 7.211373318891901, error:ctc 0.9135802192613482, error:decision 0.0, error:output/output_prob 0.9629629338160157, loss 5581.6313, max_size:classes 17, max_size:data 471, mem_usage:GPU:0 3.6GB, num_seqs 42, 0.519 sec/step, elapsed 0:02:03, exp. remaining 0:00:13, complete 90.17%
pretrain epoch 5 'dev' eval, step 115, cost:ctc 4.964374318682644, cost:output/output_prob 6.981160382730195, error:ctc 0.911447059828788, error:decision 0.0, error:output/output_prob 0.961123084416613, loss 5530.7827, max_size:classes 13, max_size:data 486, mem_usage:GPU:0 3.6GB, num_seqs 41, 0.521 sec/step, elapsed 0:02:04, exp. remaining 0:00:10, complete 91.87%
pretrain epoch 5 'dev' eval, step 116, cost:ctc 4.483261141801336, cost:output/output_prob 7.184014833075139, error:ctc 0.9074074141681194, error:decision 0.0, error:output/output_prob 0.9629629701375961, loss 5040.263, max_size:classes 14, max_size:data 495, mem_usage:GPU:0 3.6GB, num_seqs 40, 0.537 sec/step, elapsed 0:02:04, exp. remaining 0:00:08, complete 93.70%
pretrain epoch 5 'dev' eval, step 117, cost:ctc 3.55782896316839, cost:output/output_prob 6.920841201680787, error:ctc 0.9078947436064482, error:decision 0.0, error:output/output_prob 0.9692982528358698, loss 4778.2734, max_size:classes 17, max_size:data 471, mem_usage:GPU:0 3.6GB, num_seqs 42, 0.511 sec/step, elapsed 0:02:05, exp. remaining 0:00:06, complete 95.40%
pretrain epoch 5 'dev' eval, step 118, cost:ctc 4.649902928565268, cost:output/output_prob 7.01889668827215, error:ctc 0.9022556338459253, error:decision 0.0, error:output/output_prob 0.9774436033330858, loss 4655.851, max_size:classes 14, max_size:data 505, mem_usage:GPU:0 3.6GB, num_seqs 39, 0.532 sec/step, elapsed 0:02:05, exp. remaining 0:00:03, complete 97.20%
pretrain epoch 5 'dev' eval, step 119, cost:ctc 4.197297037916769, cost:output/output_prob 7.212145975622434, error:ctc 0.9013453368097544, error:decision 0.0, error:output/output_prob 0.9641256090253592, loss 5088.6113, max_size:classes 13, max_size:data 452, mem_usage:GPU:0 3.6GB, num_seqs 44, 0.502 sec/step, elapsed 0:02:06, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 120, cost:ctc 4.6657486107781665, cost:output/output_prob 6.980580859620034, error:ctc 0.8936169929802418, error:decision 0.0, error:output/output_prob 0.970744650112465, loss 4379.02, max_size:classes 12, max_size:data 498, mem_usage:GPU:0 3.6GB, num_seqs 40, 0.522 sec/step, elapsed 0:02:06, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 121, cost:ctc 4.978265574433749, cost:output/output_prob 7.135942691337505, error:ctc 0.8974943426437676, error:decision 0.0, error:output/output_prob 0.9703872841782868, loss 5318.137, max_size:classes 13, max_size:data 428, mem_usage:GPU:0 3.6GB, num_seqs 45, 0.476 sec/step, elapsed 0:02:07, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 122, cost:ctc 4.21156174113645, cost:output/output_prob 7.264304794966165, error:ctc 0.8917378871701658, error:decision 0.0, error:output/output_prob 0.9857549807056785, loss 4028.0293, max_size:classes 14, max_size:data 513, mem_usage:GPU:0 3.6GB, num_seqs 38, 0.555 sec/step, elapsed 0:02:07, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 123, cost:ctc 4.862087669082939, cost:output/output_prob 6.938686171725976, error:ctc 0.8838383830152452, error:decision 0.0, error:output/output_prob 0.9722222213167697, loss 4673.1064, max_size:classes 13, max_size:data 434, mem_usage:GPU:0 3.6GB, num_seqs 46, 0.479 sec/step, elapsed 0:02:08, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 124, cost:ctc 5.344239252787133, cost:output/output_prob 6.798270089511163, error:ctc 0.8779903983231634, error:decision 0.0, error:output/output_prob 0.9688994858879596, loss 5075.5693, max_size:classes 16, max_size:data 385, mem_usage:GPU:0 3.6GB, num_seqs 51, 0.456 sec/step, elapsed 0:02:08, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 125, cost:ctc 5.67015974904416, cost:output/output_prob 6.959273343442419, error:ctc 0.8720930200070143, error:decision 0.0, error:output/output_prob 0.9930232521146536, loss 5430.6562, max_size:classes 11, max_size:data 360, mem_usage:GPU:0 3.6GB, num_seqs 55, 0.439 sec/step, elapsed 0:02:09, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 126, cost:ctc inf, cost:output/output_prob 7.0828133313455055, error:ctc 0.8621621830388904, error:decision 0.0, error:output/output_prob 0.967567590996623, loss inf, max_size:classes 11, max_size:data 386, mem_usage:GPU:0 3.6GB, num_seqs 51, 0.449 sec/step, elapsed 0:02:09, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 127, cost:ctc 7.048650859655936, cost:output/output_prob 7.20399838260164, error:ctc 0.8439306169748306, error:decision 0.0, error:output/output_prob 0.9797687642276287, loss 4931.417, max_size:classes 11, max_size:data 366, mem_usage:GPU:0 3.6GB, num_seqs 54, 0.434 sec/step, elapsed 0:02:09, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 128, cost:ctc 7.012930463130033, cost:output/output_prob 7.310807647544607, error:ctc 0.8148148208856583, error:decision 0.0, error:output/output_prob 0.9876543283462524, loss 4640.891, max_size:classes 11, max_size:data 329, mem_usage:GPU:0 3.6GB, num_seqs 60, 0.413 sec/step, elapsed 0:02:10, exp. remaining 0:00:01, complete 99.20%
pretrain epoch 5 'dev' eval, step 129, cost:ctc 7.8893517861672535, cost:output/output_prob 7.343362780879374, error:ctc 0.7311827950179577, error:decision 0.0, error:output/output_prob 0.9999999990686774, loss 1416.6425, max_size:classes 5, max_size:data 288, mem_usage:GPU:0 3.6GB, num_seqs 25, 0.284 sec/step, elapsed 0:02:10, exp. remaining 0:00:01, complete 99.20%
Stats:
  mem_usage:GPU:0: Stats(mean=3.6GB, std_dev=0.0B, min=3.6GB, max=3.6GB, num_seqs=130, avg_data_len=1)
pretrain epoch 5 'dev' eval, finished after 130 steps, 0:02:10 elapsed (96.3% computing time)
dev: score ctc inf output/output_prob 7.218586979659966 error ctc 0.9532719262828919 decision 0.0 output/output_prob 0.9546152385091587
Ignoring score key 'dev_error_decision' because all epochs have the same value 0.0.
Ignoring score key 'dev_score_ctc' because all epochs have the same value inf.
Ignoring score key 'train_error_decision' because all epochs have the same value 0.0.
5 epochs stored so far and keeping all.
<LibriSpeechCorpus 'train' epoch=6>, epoch 6. No filter for this epoch.
Update config key 'max_seq_length' for epoch 6: {'classes': 75} -> {'classes': 60}
start pretrain epoch 6 with learning rate 0.0005777777777777778 ...
TF: log_dir: data/exp-returnn/train-2019-12-20-15-38-17
pretrain epoch 6, step 0, cost:ctc 5.2349793983839845, cost:output/output_prob 7.350149482878692, error:ctc 0.9676674304064363, error:decision 0.0, error:output/output_prob 0.9538106175605208, loss 5449.361, max_size:classes 35, max_size:data 1413, mem_usage:GPU:0 3.6GB, num_seqs 14, 2.762 sec/step, elapsed 0:00:03, exp. remaining 0:12:19, complete 0.46%
pretrain epoch 6, step 1, cost:ctc 5.667559866266686, cost:output/output_prob 7.8293768423473, error:ctc 0.9698924932163208, error:decision 0.0, error:output/output_prob 0.9526881917845457, loss 6276.075, max_size:classes 39, max_size:data 1425, mem_usage:GPU:0 3.6GB, num_seqs 14, 2.823 sec/step, elapsed 0:00:06, exp. remaining 0:10:22, complete 1.00%
pretrain epoch 6, step 2, cost:ctc 4.978691711366821, cost:output/output_prob 7.732380232660263, error:ctc 0.9708029120229186, error:decision 0.0, error:output/output_prob 0.9489051019772888, loss 5224.2505, max_size:classes 39, max_size:data 1665, mem_usage:GPU:0 3.6GB, num_seqs 12, 3.150 sec/step, elapsed 0:00:09, exp. remaining 0:14:20, complete 1.08%
pretrain epoch 6, step 3, cost:ctc 5.683669965211095, cost:output/output_prob 7.557573443659749, error:ctc 0.9714964793529361, error:decision 0.0, error:output/output_prob 0.9643705883063376, loss 5574.5635, max_size:classes 38, max_size:data 1584, mem_usage:GPU:0 3.6GB, num_seqs 12, 3.011 sec/step, elapsed 0:00:12, exp. remaining 0:17:25, complete 1.17%
pretrain epoch 6, step 4, cost:ctc 7.796838687544437, cost:output/output_prob 7.389888024932418, error:ctc 0.9710843574721366, error:decision 0.0, error:output/output_prob 0.942168694222346, loss 6302.491, max_size:classes 42, max_size:data 1630, mem_usage:GPU:0 3.6GB, num_seqs 12, 3.103 sec/step, elapsed 0:00:15, exp. remaining 0:20:10, complete 1.27%
pretrain epoch 6, step 5, cost:ctc 5.02469695511877, cost:output/output_prob 7.4541055856442995, error:ctc 0.9710467988625169, error:decision 0.0, error:output/output_prob 0.9755011419765651, loss 5602.9824, max_size:classes 42, max_size:data 1517, mem_usage:GPU:0 3.6GB, num_seqs 13, 2.962 sec/step, elapsed 0:00:18, exp. remaining 0:22:29, complete 1.35%
pretrain epoch 6, step 6, cost:ctc 8.000205908501528, cost:output/output_prob 7.676779335900505, error:ctc 0.9835293726064265, error:decision 0.0, error:output/output_prob 0.9788234904408455, loss 6662.7188, max_size:classes 40, max_size:data 1574, mem_usage:GPU:0 3.6GB, num_seqs 12, 3.022 sec/step, elapsed 0:00:21, exp. remaining 0:24:35, complete 1.44%
pretrain epoch 6, step 7, cost:ctc 4.158985160121119, cost:output/output_prob 7.427447408015723, error:ctc 0.9958592317998409, error:decision 0.0, error:output/output_prob 0.9751552976667881, loss 5596.247, max_size:classes 39, max_size:data 1487, mem_usage:GPU:0 3.6GB, num_seqs 13, 2.890 sec/step, elapsed 0:00:24, exp. remaining 0:26:18, complete 1.52%
pretrain epoch 6, step 8, cost:ctc 5.849038078675278, cost:output/output_prob 8.112596512539255, error:ctc 0.971830999944359, error:decision 0.0, error:output/output_prob 0.962441328447312, loss 5947.6562, max_size:classes 40, max_size:data 1651, mem_usage:GPU:0 3.6GB, num_seqs 12, 3.131 sec/step, elapsed 0:00:27, exp. remaining 0:28:05, complete 1.61%
pretrain epoch 6, step 9, cost:ctc 5.942078373674349, cost:output/output_prob 7.32019719271284, error:ctc 0.9715536218136549, error:decision 0.0, error:output/output_prob 0.9606127026490867, loss 6060.86, max_size:classes 43, max_size:data 1532, mem_usage:GPU:0 3.6GB, num_seqs 13, 2.984 sec/step, elapsed 0:00:30, exp. remaining 0:29:32, complete 1.69%
pretrain epoch 6, step 10, cost:ctc 6.12504252107442, cost:output/output_prob 7.244654790116556, error:ctc 0.9726651886012405, error:decision 0.0, error:output/output_prob 0.952164048794657, loss 5869.297, max_size:classes 41, max_size:data 1589, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.041 sec/step, elapsed 0:00:33, exp. remaining 0:30:53, complete 1.78%
pretrain epoch 6, step 11, cost:ctc 6.175750436384703, cost:output/output_prob 7.463707544268686, error:ctc 0.973273970419541, error:decision 0.0, error:output/output_prob 0.9710467988625169, loss 6124.116, max_size:classes 40, max_size:data 1622, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.066 sec/step, elapsed 0:00:36, exp. remaining 0:32:08, complete 1.86%
pretrain epoch 6, step 12, cost:ctc 7.793483495667374, cost:output/output_prob 7.520819684832361, error:ctc 0.9731959123164415, error:decision 0.0, error:output/output_prob 0.950515499105677, loss 7427.4365, max_size:classes 42, max_size:data 1512, mem_usage:GPU:0 3.7GB, num_seqs 13, 2.950 sec/step, elapsed 0:00:39, exp. remaining 0:33:11, complete 1.95%
pretrain epoch 6, step 13, cost:ctc 4.305020120274776, cost:output/output_prob 7.434876440624976, error:ctc 0.9737374177202582, error:decision 0.0, error:output/output_prob 0.9373737797141075, loss 5811.2485, max_size:classes 46, max_size:data 1511, mem_usage:GPU:0 3.7GB, num_seqs 13, 2.966 sec/step, elapsed 0:00:42, exp. remaining 0:34:01, complete 2.04%
pretrain epoch 6, step 14, cost:ctc 5.143828714474012, cost:output/output_prob 7.307362153454676, error:ctc 0.9520547550637275, error:decision 0.0, error:output/output_prob 0.9703195944894105, loss 5453.622, max_size:classes 40, max_size:data 1537, mem_usage:GPU:0 3.7GB, num_seqs 12, 2.952 sec/step, elapsed 0:00:45, exp. remaining 0:34:53, complete 2.13%
pretrain epoch 6, step 15, cost:ctc 5.355461405578353, cost:output/output_prob 7.27482723693538, error:ctc 0.9587852619588375, error:decision 0.0, error:output/output_prob 0.9761388413608074, loss 5822.563, max_size:classes 50, max_size:data 1618, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.148 sec/step, elapsed 0:00:48, exp. remaining 0:35:43, complete 2.22%
pretrain epoch 6, step 16, cost:ctc 7.717284832822315, cost:output/output_prob 7.290250614536262, error:ctc 0.975206570699811, error:decision 0.0, error:output/output_prob 0.9545454145409167, loss 7263.6475, max_size:classes 48, max_size:data 1565, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.036 sec/step, elapsed 0:00:51, exp. remaining 0:36:31, complete 2.30%
pretrain epoch 6, step 17, cost:ctc 5.390995524186451, cost:output/output_prob 7.235791225919002, error:ctc 0.9746300077531487, error:decision 0.0, error:output/output_prob 0.9682875131256878, loss 5972.47, max_size:classes 43, max_size:data 1605, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.081 sec/step, elapsed 0:00:54, exp. remaining 0:37:16, complete 2.39%
pretrain epoch 6, step 18, cost:ctc 8.197738389463666, cost:output/output_prob 7.713607015603884, error:ctc 0.9751552976667881, error:decision 0.0, error:output/output_prob 0.9730849042534828, loss 7685.1797, max_size:classes 45, max_size:data 1599, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.073 sec/step, elapsed 0:00:57, exp. remaining 0:37:59, complete 2.47%
pretrain epoch 6, step 19, cost:ctc inf, cost:output/output_prob 7.472228277229533, error:ctc 0.9749478294979781, error:decision 0.0, error:output/output_prob 0.9749478294979781, loss inf, max_size:classes 46, max_size:data 1557, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.022 sec/step, elapsed 0:01:00, exp. remaining 0:38:36, complete 2.56%
pretrain epoch 6, step 20, cost:ctc 5.923151426834352, cost:output/output_prob 7.452773079771987, error:ctc 0.9762846240773797, error:decision 0.0, error:output/output_prob 0.978260908741504, loss 6768.218, max_size:classes 55, max_size:data 1624, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.195 sec/step, elapsed 0:01:04, exp. remaining 0:39:17, complete 2.65%
pretrain epoch 6, step 21, cost:ctc 4.908284847899267, cost:output/output_prob 7.635726569624694, error:ctc 0.9748427337035537, error:decision 0.0, error:output/output_prob 0.9287211420014501, loss 5983.4937, max_size:classes 49, max_size:data 1547, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.028 sec/step, elapsed 0:01:07, exp. remaining 0:39:49, complete 2.73%
pretrain epoch 6, step 22, cost:ctc 4.566315501920286, cost:output/output_prob 7.422558967513566, error:ctc 0.9757462459383531, error:decision 0.0, error:output/output_prob 0.9701492311432957, loss 6426.037, max_size:classes 44, max_size:data 1482, mem_usage:GPU:0 3.7GB, num_seqs 13, 2.912 sec/step, elapsed 0:01:09, exp. remaining 0:40:15, complete 2.82%
pretrain epoch 6, step 23, cost:ctc 6.802658862757653, cost:output/output_prob 7.963779335178515, error:ctc 0.9536290038377047, error:decision 0.0, error:output/output_prob 0.9677419066429138, loss 7324.1533, max_size:classes 48, max_size:data 1598, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.104 sec/step, elapsed 0:01:13, exp. remaining 0:40:46, complete 2.90%
pretrain epoch 6, step 24, cost:ctc 2.8958851344710865, cost:output/output_prob 7.28736780444251, error:ctc 0.9547101627103983, error:decision 0.0, error:output/output_prob 0.9692029166035353, loss 5621.1553, max_size:classes 49, max_size:data 1508, mem_usage:GPU:0 3.7GB, num_seqs 13, 2.995 sec/step, elapsed 0:01:16, exp. remaining 0:41:11, complete 2.99%
pretrain epoch 6, step 25, cost:ctc 3.524171295631845, cost:output/output_prob 7.520743493670153, error:ctc 0.9598470290657133, error:decision 0.0, error:output/output_prob 0.9598470290657133, loss 5776.49, max_size:classes 49, max_size:data 1568, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.062 sec/step, elapsed 0:01:19, exp. remaining 0:41:37, complete 3.07%
pretrain epoch 6, step 26, cost:ctc 6.587998506251636, cost:output/output_prob 7.037313124457454, error:ctc 0.9559386743931099, error:decision 0.0, error:output/output_prob 0.9444444217951967, loss 7112.413, max_size:classes 50, max_size:data 1630, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.163 sec/step, elapsed 0:01:22, exp. remaining 0:42:04, complete 3.16%
pretrain epoch 6, step 27, cost:ctc 6.482972772052563, cost:output/output_prob 7.370030295722757, error:ctc 0.9616122578736396, error:decision 0.0, error:output/output_prob 0.9673704151064159, loss 7217.415, max_size:classes 54, max_size:data 1586, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.123 sec/step, elapsed 0:01:25, exp. remaining 0:42:35, complete 3.24%
pretrain epoch 6, step 28, cost:ctc 4.573151378859166, cost:output/output_prob 7.538793772056578, error:ctc 0.9776951565872877, error:decision 0.0, error:output/output_prob 0.9442379078827797, loss 6516.2266, max_size:classes 52, max_size:data 1578, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.113 sec/step, elapsed 0:01:28, exp. remaining 0:42:57, complete 3.32%
pretrain epoch 6, step 29, cost:ctc 2.6707985673133408, cost:output/output_prob 7.242204332965116, error:ctc 0.9748653739225119, error:decision 0.0, error:output/output_prob 0.9784560382831842, loss 5521.5425, max_size:classes 54, max_size:data 1596, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.133 sec/step, elapsed 0:01:31, exp. remaining 0:43:19, complete 3.41%
pretrain epoch 6, step 30, cost:ctc 6.065042898895741, cost:output/output_prob 7.26230445351402, error:ctc 0.9775701233884321, error:decision 0.0, error:output/output_prob 0.9682243287097664, loss 7130.131, max_size:classes 49, max_size:data 1612, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.138 sec/step, elapsed 0:01:34, exp. remaining 0:43:40, complete 3.49%
pretrain epoch 6, step 31, cost:ctc 7.103909191524308, cost:output/output_prob 7.41478191104133, error:ctc 0.9767891961382701, error:decision 0.0, error:output/output_prob 0.9651837799465283, loss 7506.163, max_size:classes 46, max_size:data 1587, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.065 sec/step, elapsed 0:01:37, exp. remaining 0:44:04, complete 3.57%
pretrain epoch 6, step 32, cost:ctc 3.059617006093106, cost:output/output_prob 7.124119903178411, error:ctc 0.9747292357496917, error:decision 0.0, error:output/output_prob 0.933212990523316, loss 5641.79, max_size:classes 56, max_size:data 1636, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.212 sec/step, elapsed 0:01:41, exp. remaining 0:44:24, complete 3.66%
pretrain epoch 6, step 33, cost:ctc inf, cost:output/output_prob 7.3529520820857215, error:ctc 0.9587813611142337, error:decision 0.0, error:output/output_prob 0.9426523288711905, loss inf, max_size:classes 52, max_size:data 1577, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.091 sec/step, elapsed 0:01:44, exp. remaining 0:44:41, complete 3.74%
pretrain epoch 6, step 34, cost:ctc 3.383265842293781, cost:output/output_prob 7.534104922156075, error:ctc 0.9597806492820382, error:decision 0.0, error:output/output_prob 0.9652651101350784, loss 5971.802, max_size:classes 56, max_size:data 1591, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.155 sec/step, elapsed 0:01:47, exp. remaining 0:44:58, complete 3.83%
pretrain epoch 6, step 35, cost:ctc 3.7686033581610445, cost:output/output_prob 7.436431796234274, error:ctc 0.9597197715193033, error:decision 0.0, error:output/output_prob 0.949211890809238, loss 6398.075, max_size:classes 55, max_size:data 1568, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.099 sec/step, elapsed 0:01:50, exp. remaining 0:45:13, complete 3.91%
pretrain epoch 6, step 36, cost:ctc 6.099841743150591, cost:output/output_prob 7.349004323242525, error:ctc 0.9587426669895649, error:decision 0.0, error:output/output_prob 0.933202391024679, loss 6845.4624, max_size:classes 49, max_size:data 1679, mem_usage:GPU:0 3.7GB, num_seqs 11, 3.208 sec/step, elapsed 0:01:53, exp. remaining 0:45:30, complete 4.00%
pretrain epoch 6, step 37, cost:ctc 3.4288990747938897, cost:output/output_prob 7.204402623774513, error:ctc 0.9423423651605844, error:decision 0.0, error:output/output_prob 0.9243243467062712, loss 5901.4824, max_size:classes 52, max_size:data 1576, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.096 sec/step, elapsed 0:01:56, exp. remaining 0:45:43, complete 4.08%
pretrain epoch 6, step 38, cost:ctc 4.744796775138411, cost:output/output_prob 7.5136412316315955, error:ctc 0.9465240414720029, error:decision 0.0, error:output/output_prob 0.957219228381291, loss 6876.984, max_size:classes 52, max_size:data 1638, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.226 sec/step, elapsed 0:01:59, exp. remaining 0:45:59, complete 4.17%
pretrain epoch 6, step 39, cost:ctc 4.191569570944921, cost:output/output_prob 7.254382405220895, error:ctc 0.945132739841938, error:decision 0.0, error:output/output_prob 0.9433628283441067, loss 6466.963, max_size:classes 56, max_size:data 1599, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.192 sec/step, elapsed 0:02:03, exp. remaining 0:46:13, complete 4.25%
pretrain epoch 6, step 40, cost:ctc 5.957474341082275, cost:output/output_prob 7.325082384460416, error:ctc 0.9444444989785552, error:decision 0.0, error:output/output_prob 0.9642857699654996, loss 6694.408, max_size:classes 51, max_size:data 1692, mem_usage:GPU:0 3.7GB, num_seqs 11, 3.252 sec/step, elapsed 0:02:06, exp. remaining 0:46:32, complete 4.33%
pretrain epoch 6, step 41, cost:ctc 3.1555618945095745, cost:output/output_prob 7.319636929264277, error:ctc 0.9583333404734731, error:decision 0.0, error:output/output_prob 0.9565972293494269, loss 6033.7144, max_size:classes 55, max_size:data 1579, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.132 sec/step, elapsed 0:02:09, exp. remaining 0:46:44, complete 4.42%
pretrain epoch 6, step 42, cost:ctc 3.265105758795926, cost:output/output_prob 7.257320820286623, error:ctc 0.9417808149009943, error:decision 0.0, error:output/output_prob 0.9845890337601304, loss 6145.097, max_size:classes 54, max_size:data 1631, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.208 sec/step, elapsed 0:02:12, exp. remaining 0:46:51, complete 4.51%
pretrain epoch 6, step 43, cost:ctc 3.390278598666953, cost:output/output_prob 7.6897765409525505, error:ctc 0.942238261224702, error:decision 0.0, error:output/output_prob 0.9675090191885829, loss 6138.3506, max_size:classes 52, max_size:data 1612, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.163 sec/step, elapsed 0:02:15, exp. remaining 0:47:02, complete 4.59%
pretrain epoch 6, step 44, cost:ctc 2.7810240119177934, cost:output/output_prob 7.3458736697627955, error:ctc 0.9494097935967147, error:decision 0.0, error:output/output_prob 0.9763912442140281, loss 6005.25, max_size:classes 55, max_size:data 1640, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.222 sec/step, elapsed 0:02:19, exp. remaining 0:47:10, complete 4.69%
pretrain epoch 6, step 45, cost:ctc 1.2432579735853153, cost:output/output_prob 7.365413495988833, error:ctc 0.9682804392650725, error:decision 0.0, error:output/output_prob 0.9766276844311507, loss 5156.594, max_size:classes 60, max_size:data 1601, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.216 sec/step, elapsed 0:02:22, exp. remaining 0:47:16, complete 4.78%
pretrain epoch 6, step 46, cost:ctc 2.4771935120308797, cost:output/output_prob 7.486650798282994, error:ctc 0.9593220225069672, error:decision 0.0, error:output/output_prob 0.9593220225069672, loss 5878.668, max_size:classes 57, max_size:data 1628, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.222 sec/step, elapsed 0:02:25, exp. remaining 0:47:23, complete 4.87%
pretrain epoch 6, step 47, cost:ctc 1.3800020488365448, cost:output/output_prob 7.0931572613978915, error:ctc 0.9718076286371797, error:decision 0.0, error:output/output_prob 0.9402985075721517, loss 5109.315, max_size:classes 56, max_size:data 1624, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.222 sec/step, elapsed 0:02:28, exp. remaining 0:47:33, complete 4.96%
pretrain epoch 6, step 48, cost:ctc 1.8714249522780335, cost:output/output_prob 7.529745748206551, error:ctc 0.972972996532917, error:decision 0.0, error:output/output_prob 0.9493243473116308, loss 5565.493, max_size:classes 55, max_size:data 1631, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.214 sec/step, elapsed 0:02:32, exp. remaining 0:47:38, complete 5.05%
pretrain epoch 6, step 49, cost:ctc 2.5482272864691993, cost:output/output_prob 7.229700034118309, error:ctc 0.9607842906843871, error:decision 0.0, error:output/output_prob 0.9500891037750989, loss 5485.4175, max_size:classes 58, max_size:data 1671, mem_usage:GPU:0 3.7GB, num_seqs 11, 3.287 sec/step, elapsed 0:02:35, exp. remaining 0:47:20, complete 5.18%
pretrain epoch 6, step 50, cost:ctc 0.6557505625521572, cost:output/output_prob 7.472431731301527, error:ctc 0.9625406832201407, error:decision 0.0, error:output/output_prob 0.9495113677112387, loss 4990.704, max_size:classes 59, max_size:data 1666, mem_usage:GPU:0 3.7GB, num_seqs 12, 3.298 sec/step, elapsed 0:02:38, exp. remaining 0:46:20, complete 5.40%
pretrain epoch 6, step 51, cost:ctc 1.2805146516430455, cost:output/output_prob 7.0126118703656175, error:ctc 0.9628433194011451, error:decision 0.0, error:output/output_prob 0.9450727212242782, loss 5133.4453, max_size:classes 58, max_size:data 1641, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.253 sec/step, elapsed 0:02:41, exp. remaining 0:46:22, complete 5.50%
pretrain epoch 6, step 52, cost:ctc 0.0, cost:output/output_prob 7.00298275434261, error:ctc 0.9481946863234042, error:decision 0.0, error:output/output_prob 0.9686028501018881, loss 4460.9, max_size:classes 60, max_size:data 1586, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.181 sec/step, elapsed 0:02:45, exp. remaining 0:46:20, complete 5.60%
pretrain epoch 6, step 53, cost:ctc 0.6432612142186044, cost:output/output_prob 7.262292004039067, error:ctc 0.9455999761121346, error:decision 0.0, error:output/output_prob 0.975999975344166, loss 4940.9707, max_size:classes 58, max_size:data 1633, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.240 sec/step, elapsed 0:02:48, exp. remaining 0:46:22, complete 5.70%
pretrain epoch 6, step 54, cost:ctc 0.0, cost:output/output_prob 7.542422906737556, error:ctc 0.9534883685410023, error:decision 0.0, error:output/output_prob 0.9534883685410023, loss 4864.863, max_size:classes 59, max_size:data 1632, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.242 sec/step, elapsed 0:02:51, exp. remaining 0:46:31, complete 5.79%
pretrain epoch 6, step 55, cost:ctc 1.3521790873109438, cost:output/output_prob 7.2991371235777365, error:ctc 0.9477020918857306, error:decision 0.0, error:output/output_prob 0.9793978140223771, loss 5458.9805, max_size:classes 57, max_size:data 1646, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.256 sec/step, elapsed 0:02:54, exp. remaining 0:46:40, complete 5.87%
pretrain epoch 6, step 56, cost:ctc 0.7850944017889462, cost:output/output_prob 7.986804994451689, error:ctc 0.9478991688229145, error:decision 0.0, error:output/output_prob 0.9630252193892376, loss 5219.2803, max_size:classes 58, max_size:data 1675, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.276 sec/step, elapsed 0:02:58, exp. remaining 0:46:49, complete 5.96%
pretrain epoch 6, step 57, cost:ctc 0.0, cost:output/output_prob 7.145174316842031, error:ctc 0.9483037390746176, error:decision 0.0, error:output/output_prob 0.9499192479997873, loss 4422.863, max_size:classes 59, max_size:data 1723, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.355 sec/step, elapsed 0:03:01, exp. remaining 0:46:59, complete 6.04%
pretrain epoch 6, step 58, cost:ctc 0.0, cost:output/output_prob 7.225935042306786, error:ctc 0.9510791276115923, error:decision 0.0, error:output/output_prob 0.9453237319830804, loss 5022.025, max_size:classes 60, max_size:data 1654, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.303 sec/step, elapsed 0:03:04, exp. remaining 0:47:12, complete 6.12%
pretrain epoch 6, step 59, cost:ctc 0.0, cost:output/output_prob 7.466074672111063, error:ctc 0.9538216702640057, error:decision 0.0, error:output/output_prob 0.9570063836872578, loss 4688.695, max_size:classes 60, max_size:data 1681, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.298 sec/step, elapsed 0:03:08, exp. remaining 0:47:24, complete 6.20%
pretrain epoch 6, step 60, cost:ctc 0.0, cost:output/output_prob 7.325973724231005, error:ctc 0.9668246568180621, error:decision 0.0, error:output/output_prob 0.9462875317549333, loss 4637.3413, max_size:classes 60, max_size:data 1642, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.238 sec/step, elapsed 0:03:11, exp. remaining 0:47:31, complete 6.29%
pretrain epoch 6, step 61, cost:ctc 0.0, cost:output/output_prob 7.041871974993229, error:ctc 0.9657422602176667, error:decision 0.0, error:output/output_prob 0.946166403591633, loss 4316.6675, max_size:classes 58, max_size:data 1704, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.316 sec/step, elapsed 0:03:14, exp. remaining 0:47:39, complete 6.37%
pretrain epoch 6, step 62, cost:ctc 0.6943302109894915, cost:output/output_prob 7.321662591942982, error:ctc 0.9631901616230607, error:decision 0.0, error:output/output_prob 0.9601226770319045, loss 5226.4272, max_size:classes 59, max_size:data 1639, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.260 sec/step, elapsed 0:03:17, exp. remaining 0:47:42, complete 6.46%
pretrain epoch 6, step 63, cost:ctc 0.0, cost:output/output_prob 7.602070176073994, error:ctc 0.966887416318059, error:decision 0.0, error:output/output_prob 0.9635761580429971, loss 4591.6504, max_size:classes 59, max_size:data 1677, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.292 sec/step, elapsed 0:03:21, exp. remaining 0:47:49, complete 6.55%
pretrain epoch 6, step 64, cost:ctc 0.0, cost:output/output_prob 7.369160282147392, error:ctc 0.9633027843665333, error:decision 0.0, error:output/output_prob 0.954128472134471, loss 4819.4307, max_size:classes 60, max_size:data 1611, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.223 sec/step, elapsed 0:03:24, exp. remaining 0:47:55, complete 6.63%
pretrain epoch 6, step 65, cost:ctc 0.6464729640981197, cost:output/output_prob 7.555394042170634, error:ctc 0.9633027843665333, error:decision 0.0, error:output/output_prob 0.9434251078637318, loss 5364.021, max_size:classes 59, max_size:data 1639, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.268 sec/step, elapsed 0:03:27, exp. remaining 0:48:01, complete 6.72%
pretrain epoch 6, step 66, cost:ctc 0.8083851758803391, cost:output/output_prob 7.375905359259377, error:ctc 0.9619047751184553, error:decision 0.0, error:output/output_prob 0.9444444574182853, loss 5156.103, max_size:classes 58, max_size:data 1658, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.285 sec/step, elapsed 0:03:30, exp. remaining 0:48:08, complete 6.81%
pretrain epoch 6, step 67, cost:ctc 0.925787783131689, cost:output/output_prob 7.4932979828160455, error:ctc 0.9658702772576362, error:decision 0.0, error:output/output_prob 0.9778156693791971, loss 4933.5845, max_size:classes 59, max_size:data 1675, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.281 sec/step, elapsed 0:03:34, exp. remaining 0:48:17, complete 6.88%
pretrain epoch 6, step 68, cost:ctc 2.2001918786540955, cost:output/output_prob 7.645773579063644, error:ctc 0.9664311028318481, error:decision 0.0, error:output/output_prob 0.9628975339001046, loss 5572.8164, max_size:classes 55, max_size:data 1667, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.234 sec/step, elapsed 0:03:37, exp. remaining 0:48:25, complete 6.96%
pretrain epoch 6, step 69, cost:ctc 2.6842953142971737, cost:output/output_prob 7.3379271552482805, error:ctc 0.9472843282856047, error:decision 0.0, error:output/output_prob 0.9664536570198834, loss 6273.911, max_size:classes 57, max_size:data 1588, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.178 sec/step, elapsed 0:03:40, exp. remaining 0:48:29, complete 7.05%
pretrain epoch 6, step 70, cost:ctc 2.132240539236818, cost:output/output_prob 7.293692723626691, error:ctc 0.9514563423581421, error:decision 0.0, error:output/output_prob 0.9822006799513474, loss 5825.2266, max_size:classes 56, max_size:data 1662, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.276 sec/step, elapsed 0:03:43, exp. remaining 0:48:38, complete 7.13%
pretrain epoch 6, step 71, cost:ctc 1.348816530338837, cost:output/output_prob 7.872799580655283, error:ctc 0.9473684281110764, error:decision 0.0, error:output/output_prob 0.9391447438392788, loss 5606.7427, max_size:classes 60, max_size:data 1614, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.218 sec/step, elapsed 0:03:47, exp. remaining 0:48:42, complete 7.21%
pretrain epoch 6, step 72, cost:ctc 3.4355838393280465, cost:output/output_prob 7.499135967897246, error:ctc 0.9432989826891571, error:decision 0.0, error:output/output_prob 0.9862543097697198, loss 6364.007, max_size:classes 55, max_size:data 1560, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.095 sec/step, elapsed 0:03:50, exp. remaining 0:48:44, complete 7.30%
pretrain epoch 6, step 73, cost:ctc 2.0608676014984724, cost:output/output_prob 7.926981093274435, error:ctc 0.9501718350220472, error:decision 0.0, error:output/output_prob 0.9415807696059346, loss 5812.9277, max_size:classes 54, max_size:data 1626, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.199 sec/step, elapsed 0:03:53, exp. remaining 0:48:48, complete 7.38%
pretrain epoch 6, step 74, cost:ctc 2.3740612766063407, cost:output/output_prob 7.474262513855592, error:ctc 0.9590443389024585, error:decision 0.0, error:output/output_prob 0.9488054313696921, loss 5771.118, max_size:classes 55, max_size:data 1551, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.086 sec/step, elapsed 0:03:56, exp. remaining 0:48:50, complete 7.47%
pretrain epoch 6, step 75, cost:ctc 3.1601826828572968, cost:output/output_prob 7.2151125089764605, error:ctc 0.961983471410349, error:decision 0.0, error:output/output_prob 0.9520661160349846, loss 6277.0537, max_size:classes 58, max_size:data 1631, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.230 sec/step, elapsed 0:03:59, exp. remaining 0:48:54, complete 7.55%
pretrain epoch 6, step 76, cost:ctc 1.3165854164905682, cost:output/output_prob 7.3749527401073465, error:ctc 0.9659498198889196, error:decision 0.0, error:output/output_prob 0.9623655905015767, loss 4849.8784, max_size:classes 54, max_size:data 1662, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.216 sec/step, elapsed 0:04:02, exp. remaining 0:48:57, complete 7.64%
pretrain epoch 6, step 77, cost:ctc 4.324932903584909, cost:output/output_prob 7.423923280073155, error:ctc 0.9595375894568862, error:decision 0.0, error:output/output_prob 0.947976895608008, loss 6097.6562, max_size:classes 53, max_size:data 1682, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.242 sec/step, elapsed 0:04:06, exp. remaining 0:49:01, complete 7.72%
pretrain epoch 6, step 78, cost:ctc 3.3317886524461073, cost:output/output_prob 7.528023271696611, error:ctc 0.9634551266208291, error:decision 0.0, error:output/output_prob 0.9551494789775461, loss 6537.607, max_size:classes 55, max_size:data 1663, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.282 sec/step, elapsed 0:04:09, exp. remaining 0:49:05, complete 7.81%
pretrain epoch 6, step 79, cost:ctc 4.228307246380609, cost:output/output_prob 7.270165937759997, error:ctc 0.9580952278338372, error:decision 0.0, error:output/output_prob 0.9866666560992597, loss 6036.698, max_size:classes 54, max_size:data 1679, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.248 sec/step, elapsed 0:04:12, exp. remaining 0:49:08, complete 7.89%
pretrain epoch 6, step 80, cost:ctc 3.101371250541547, cost:output/output_prob 7.32233248062272, error:ctc 0.9618717507692054, error:decision 0.0, error:output/output_prob 0.9549393417546526, loss 6014.477, max_size:classes 55, max_size:data 1610, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.175 sec/step, elapsed 0:04:15, exp. remaining 0:49:13, complete 7.97%
pretrain epoch 6, step 81, cost:ctc 2.539983857893162, cost:output/output_prob 7.66275143398866, error:ctc 0.9597197715193033, error:decision 0.0, error:output/output_prob 0.9754815925844014, loss 5825.7617, max_size:classes 57, max_size:data 1605, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.185 sec/step, elapsed 0:04:19, exp. remaining 0:49:16, complete 8.06%
pretrain epoch 6, step 82, cost:ctc 3.4225165103152904, cost:output/output_prob 7.560192187528515, error:ctc 0.9598540070001037, error:decision 0.0, error:output/output_prob 0.9671532770153136, loss 6018.5244, max_size:classes 49, max_size:data 1620, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.166 sec/step, elapsed 0:04:22, exp. remaining 0:49:18, complete 8.14%
pretrain epoch 6, step 83, cost:ctc 4.675673639288107, cost:output/output_prob 7.845637307149899, error:ctc 0.9615384507924317, error:decision 0.0, error:output/output_prob 0.9790209680795668, loss 7162.19, max_size:classes 55, max_size:data 1643, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.227 sec/step, elapsed 0:04:25, exp. remaining 0:49:20, complete 8.23%
pretrain epoch 6, step 84, cost:ctc 4.65580670057534, cost:output/output_prob 7.92795539326562, error:ctc 0.9585585817694664, error:decision 0.0, error:output/output_prob 0.9711711946874857, loss 6983.988, max_size:classes 49, max_size:data 1591, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.099 sec/step, elapsed 0:04:28, exp. remaining 0:49:21, complete 8.31%
pretrain epoch 6, step 85, cost:ctc 5.106611154312958, cost:output/output_prob 7.396149469819903, error:ctc 0.9653916151728481, error:decision 0.0, error:output/output_prob 0.9799635640811175, loss 6864.0156, max_size:classes 52, max_size:data 1627, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.185 sec/step, elapsed 0:04:31, exp. remaining 0:49:23, complete 8.40%
pretrain epoch 6, step 86, cost:ctc 4.631744799266016, cost:output/output_prob 7.426197321006839, error:ctc 0.9566037878394127, error:decision 0.0, error:output/output_prob 0.9716981276869774, loss 6390.709, max_size:classes 50, max_size:data 1643, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.203 sec/step, elapsed 0:04:34, exp. remaining 0:49:25, complete 8.48%
pretrain epoch 6, step 87, cost:ctc inf, cost:output/output_prob 8.079366021079295, error:ctc 0.9597806492820382, error:decision 0.0, error:output/output_prob 0.979890339076519, loss inf, max_size:classes 52, max_size:data 1620, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.190 sec/step, elapsed 0:04:38, exp. remaining 0:49:24, complete 8.58%
pretrain epoch 6, step 88, cost:ctc 3.716490977859564, cost:output/output_prob 7.5773366786689555, error:ctc 0.957249060156755, error:decision 0.0, error:output/output_prob 0.9609665322350337, loss 6076.079, max_size:classes 50, max_size:data 1609, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.150 sec/step, elapsed 0:04:41, exp. remaining 0:49:26, complete 8.66%
pretrain epoch 6, step 89, cost:ctc 6.553768006684663, cost:output/output_prob 7.70282034459035, error:ctc 0.9567900944966823, error:decision 0.0, error:output/output_prob 0.9423868027515709, loss 6928.702, max_size:classes 50, max_size:data 1682, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.232 sec/step, elapsed 0:04:44, exp. remaining 0:49:25, complete 8.75%
pretrain epoch 6, step 90, cost:ctc 5.768940195197757, cost:output/output_prob 7.241538026339016, error:ctc 0.9554731060052292, error:decision 0.0, error:output/output_prob 0.9313543674070389, loss 7012.6475, max_size:classes 49, max_size:data 1559, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.052 sec/step, elapsed 0:04:47, exp. remaining 0:49:25, complete 8.84%
pretrain epoch 6, step 91, cost:ctc 5.258188577782221, cost:output/output_prob 7.440334657404492, error:ctc 0.9564394224435091, error:decision 0.0, error:output/output_prob 0.94507578574121, loss 6704.8203, max_size:classes 49, max_size:data 1589, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.099 sec/step, elapsed 0:04:50, exp. remaining 0:49:23, complete 8.93%
pretrain epoch 6, step 92, cost:ctc 4.507719285108011, cost:output/output_prob 7.891183671128375, error:ctc 0.9592592422850431, error:decision 0.0, error:output/output_prob 0.9462962795514615, loss 6695.4077, max_size:classes 49, max_size:data 1572, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.067 sec/step, elapsed 0:04:53, exp. remaining 0:49:23, complete 9.02%
pretrain epoch 6, step 93, cost:ctc 5.2398122031680145, cost:output/output_prob 7.473847847206797, error:ctc 0.9604519593995063, error:decision 0.0, error:output/output_prob 0.9661016768077387, loss 6750.9536, max_size:classes 51, max_size:data 1591, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.113 sec/step, elapsed 0:04:56, exp. remaining 0:49:24, complete 9.10%
pretrain epoch 6, step 94, cost:ctc 4.728718962118791, cost:output/output_prob 7.590308464105248, error:ctc 0.9578543831594287, error:decision 0.0, error:output/output_prob 0.9827585971215739, loss 6430.532, max_size:classes 52, max_size:data 1593, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.112 sec/step, elapsed 0:04:59, exp. remaining 0:49:24, complete 9.19%
pretrain epoch 6, step 95, cost:ctc 5.862556063912905, cost:output/output_prob 8.266899447962714, error:ctc 0.9572815737919882, error:decision 0.0, error:output/output_prob 0.9611650690203533, loss 7276.6694, max_size:classes 49, max_size:data 1545, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.035 sec/step, elapsed 0:05:02, exp. remaining 0:49:24, complete 9.27%
pretrain epoch 6, step 96, cost:ctc 3.949879564956973, cost:output/output_prob 7.799547978838746, error:ctc 0.9603603836148977, error:decision 0.0, error:output/output_prob 0.9693693928420544, loss 6520.932, max_size:classes 48, max_size:data 1455, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.902 sec/step, elapsed 0:05:05, exp. remaining 0:49:22, complete 9.36%
pretrain epoch 6, step 97, cost:ctc 5.362063987566216, cost:output/output_prob 7.609587939762605, error:ctc 0.9566075075417757, error:decision 0.0, error:output/output_prob 0.9783037602901459, loss 6576.6274, max_size:classes 49, max_size:data 1576, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.084 sec/step, elapsed 0:05:08, exp. remaining 0:49:22, complete 9.44%
pretrain epoch 6, step 98, cost:ctc 5.373459596905036, cost:output/output_prob 7.242855483684308, error:ctc 0.960302480496466, error:decision 0.0, error:output/output_prob 0.9546314028557389, loss 6674.0303, max_size:classes 44, max_size:data 1509, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.968 sec/step, elapsed 0:05:11, exp. remaining 0:49:21, complete 9.53%
pretrain epoch 6, step 99, cost:ctc 3.3977301418522643, cost:output/output_prob 7.541015494897749, error:ctc 0.9760000463575125, error:decision 0.0, error:output/output_prob 0.9740000462625176, loss 5469.3726, max_size:classes 49, max_size:data 1576, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.081 sec/step, elapsed 0:05:15, exp. remaining 0:49:19, complete 9.62%
pretrain epoch 6, step 100, cost:ctc 3.5350257458333796, cost:output/output_prob 7.442662267532341, error:ctc 0.9758364205481483, error:decision 0.0, error:output/output_prob 0.9721189484698697, loss 5905.996, max_size:classes 50, max_size:data 1519, mem_usage:GPU:0 3.8GB, num_seqs 13, 3.023 sec/step, elapsed 0:05:18, exp. remaining 0:49:18, complete 9.71%
pretrain epoch 6, step 101, cost:ctc 5.427386818266314, cost:output/output_prob 7.4435913290308235, error:ctc 0.9756097197532654, error:decision 0.0, error:output/output_prob 0.9715446792542934, loss 6332.5215, max_size:classes 44, max_size:data 1609, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.100 sec/step, elapsed 0:05:21, exp. remaining 0:49:18, complete 9.79%
pretrain epoch 6, step 102, cost:ctc 6.546936376605572, cost:output/output_prob 7.7717828353430605, error:ctc 0.9750000508502126, error:decision 0.0, error:output/output_prob 0.9645833836402744, loss 6872.985, max_size:classes 46, max_size:data 1613, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.116 sec/step, elapsed 0:05:24, exp. remaining 0:49:18, complete 9.88%
pretrain epoch 6, step 103, cost:ctc 6.747813363651176, cost:output/output_prob 7.545896014687514, error:ctc 0.9754097815603018, error:decision 0.0, error:output/output_prob 0.959016339853406, loss 6975.3306, max_size:classes 43, max_size:data 1581, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.039 sec/step, elapsed 0:05:27, exp. remaining 0:49:15, complete 9.97%
pretrain epoch 6, step 104, cost:ctc 4.620005048989242, cost:output/output_prob 8.043697905975023, error:ctc 0.9566075075417757, error:decision 0.0, error:output/output_prob 0.9743589870631695, loss 6420.497, max_size:classes 47, max_size:data 1570, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.063 sec/step, elapsed 0:05:30, exp. remaining 0:49:15, complete 10.06%
pretrain epoch 6, step 105, cost:ctc 6.615190531886583, cost:output/output_prob 7.370572510128341, error:ctc 0.9553191186860204, error:decision 0.0, error:output/output_prob 0.9468084806576371, loss 6573.3086, max_size:classes 42, max_size:data 1541, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.973 sec/step, elapsed 0:05:33, exp. remaining 0:49:13, complete 10.14%
pretrain epoch 6, step 106, cost:ctc 5.881817850240623, cost:output/output_prob 7.413509657044415, error:ctc 0.95238097012043, error:decision 0.0, error:output/output_prob 0.9648033306002617, loss 6421.643, max_size:classes 50, max_size:data 1641, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.192 sec/step, elapsed 0:05:36, exp. remaining 0:49:14, complete 10.23%
pretrain epoch 6, step 107, cost:ctc 8.218077798191018, cost:output/output_prob 7.6117623433132735, error:ctc 0.9522726971190423, error:decision 0.0, error:output/output_prob 0.9749999691266567, loss 6965.13, max_size:classes 43, max_size:data 1585, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.061 sec/step, elapsed 0:05:39, exp. remaining 0:49:13, complete 10.31%
pretrain epoch 6, step 108, cost:ctc 3.9716041729647036, cost:output/output_prob 7.509518213724618, error:ctc 0.9534413195215166, error:decision 0.0, error:output/output_prob 0.9615384857170284, loss 5671.6743, max_size:classes 43, max_size:data 1491, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.923 sec/step, elapsed 0:05:42, exp. remaining 0:49:12, complete 10.40%
pretrain epoch 6, step 109, cost:ctc 7.571301120599401, cost:output/output_prob 7.3686283805909625, error:ctc 0.9559470973908901, error:decision 0.0, error:output/output_prob 0.9493391681462526, loss 6782.7285, max_size:classes 42, max_size:data 1635, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.134 sec/step, elapsed 0:05:45, exp. remaining 0:49:11, complete 10.48%
pretrain epoch 6, step 110, cost:ctc 5.830951366540603, cost:output/output_prob 7.545799408155972, error:ctc 0.9737991420552135, error:decision 0.0, error:output/output_prob 0.96506551746279, loss 6126.552, max_size:classes 44, max_size:data 1548, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.007 sec/step, elapsed 0:05:48, exp. remaining 0:49:08, complete 10.57%
pretrain epoch 6, step 111, cost:ctc 5.538283554245027, cost:output/output_prob 7.812086777706554, error:ctc 0.9733333569020033, error:decision 0.0, error:output/output_prob 0.9777778014540672, loss 6007.6665, max_size:classes 44, max_size:data 1625, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.139 sec/step, elapsed 0:05:51, exp. remaining 0:49:06, complete 10.67%
pretrain epoch 6, step 112, cost:ctc 6.467492734422194, cost:output/output_prob 7.62281424368075, error:ctc 0.9727462977170944, error:decision 0.0, error:output/output_prob 0.9475890658795834, loss 6721.0767, max_size:classes 42, max_size:data 1537, mem_usage:GPU:0 3.8GB, num_seqs 13, 3.007 sec/step, elapsed 0:05:54, exp. remaining 0:49:05, complete 10.75%
pretrain epoch 6, step 113, cost:ctc 6.046695895564994, cost:output/output_prob 7.239430234240331, error:ctc 0.9722222294658422, error:decision 0.0, error:output/output_prob 0.95370371080935, loss 5739.6064, max_size:classes 38, max_size:data 1566, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.993 sec/step, elapsed 0:05:57, exp. remaining 0:49:03, complete 10.84%
pretrain epoch 6, step 114, cost:ctc 7.838451043223699, cost:output/output_prob 7.301985485940634, error:ctc 0.9726026994176209, error:decision 0.0, error:output/output_prob 0.9657533846329898, loss 6631.5117, max_size:classes 41, max_size:data 1547, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.985 sec/step, elapsed 0:06:00, exp. remaining 0:48:57, complete 10.94%
pretrain epoch 6, step 115, cost:ctc 5.9310223356539495, cost:output/output_prob 7.229605765674592, error:ctc 0.971830999944359, error:decision 0.0, error:output/output_prob 0.94600940332748, loss 5606.4277, max_size:classes 39, max_size:data 1573, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.028 sec/step, elapsed 0:06:03, exp. remaining 0:48:52, complete 11.04%
pretrain epoch 6, step 116, cost:ctc 6.012696509029638, cost:output/output_prob 7.233899825715753, error:ctc 0.9707317082211375, error:decision 0.0, error:output/output_prob 0.9634146350435913, loss 5431.1045, max_size:classes 39, max_size:data 1540, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.959 sec/step, elapsed 0:06:06, exp. remaining 0:48:50, complete 11.12%
pretrain epoch 6, step 117, cost:ctc 6.793952704373396, cost:output/output_prob 7.481574774045498, error:ctc 0.969696968793869, error:decision 0.0, error:output/output_prob 0.9520202011335641, loss 5653.109, max_size:classes 40, max_size:data 1588, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.032 sec/step, elapsed 0:06:09, exp. remaining 0:48:47, complete 11.21%
pretrain epoch 6, step 118, cost:ctc 6.610099420844335, cost:output/output_prob 7.305571629124756, error:ctc 0.9680850757285953, error:decision 0.0, error:output/output_prob 0.9468084806576371, loss 5232.2925, max_size:classes 40, max_size:data 1646, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.124 sec/step, elapsed 0:06:12, exp. remaining 0:48:41, complete 11.32%
pretrain epoch 6, step 119, cost:ctc 7.708912082388906, cost:output/output_prob 7.545265706667806, error:ctc 0.9679802788887173, error:decision 0.0, error:output/output_prob 0.9679802788887173, loss 6193.1963, max_size:classes 38, max_size:data 1470, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.845 sec/step, elapsed 0:06:15, exp. remaining 0:48:24, complete 11.46%
pretrain epoch 6, step 120, cost:ctc 5.404738412209497, cost:output/output_prob 7.243991724966804, error:ctc 0.9692671406082809, error:decision 0.0, error:output/output_prob 0.9669030744116753, loss 5350.413, max_size:classes 35, max_size:data 1501, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.888 sec/step, elapsed 0:06:18, exp. remaining 0:48:12, complete 11.58%
pretrain epoch 6, step 121, cost:ctc 5.749426963841074, cost:output/output_prob 7.184182797738628, error:ctc 0.9668508660979568, error:decision 0.0, error:output/output_prob 0.9585635729599743, loss 4681.967, max_size:classes 36, max_size:data 1372, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.659 sec/step, elapsed 0:06:21, exp. remaining 0:47:50, complete 11.73%
pretrain epoch 6, step 122, cost:ctc 5.803930803871253, cost:output/output_prob 7.242026318892499, error:ctc 0.9661971491295844, error:decision 0.0, error:output/output_prob 0.9774647543672472, loss 4631.315, max_size:classes 36, max_size:data 1586, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.011 sec/step, elapsed 0:06:24, exp. remaining 0:47:26, complete 11.90%
pretrain epoch 6, step 123, cost:ctc 5.0459140244737455, cost:output/output_prob 7.103640070280677, error:ctc 0.966101736528799, error:decision 0.0, error:output/output_prob 0.9515738908667118, loss 5017.7656, max_size:classes 35, max_size:data 1417, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.769 sec/step, elapsed 0:06:27, exp. remaining 0:47:02, complete 12.06%
pretrain epoch 6, step 124, cost:ctc 4.533843375920753, cost:output/output_prob 6.983312425207259, error:ctc 0.9626666563563049, error:decision 0.0, error:output/output_prob 0.9386666566133499, loss 4318.9336, max_size:classes 31, max_size:data 1403, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.711 sec/step, elapsed 0:06:29, exp. remaining 0:46:33, complete 12.25%
pretrain epoch 6, step 125, cost:ctc 7.034259923321088, cost:output/output_prob 7.330772954130111, error:ctc 0.9621451294515282, error:decision 0.0, error:output/output_prob 0.9652997036464512, loss 4553.7153, max_size:classes 29, max_size:data 1583, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.938 sec/step, elapsed 0:06:32, exp. remaining 0:45:50, complete 12.49%
pretrain epoch 6, step 126, cost:ctc 5.948129401368931, cost:output/output_prob 7.608679966112504, error:ctc 0.9579288344830275, error:decision 0.0, error:output/output_prob 0.9644013266079128, loss 4189.0537, max_size:classes 29, max_size:data 1505, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.841 sec/step, elapsed 0:06:35, exp. remaining 0:45:01, complete 12.77%
pretrain epoch 6, step 127, cost:ctc 4.083821368684397, cost:output/output_prob 7.228764722686948, error:ctc 0.9579832158051432, error:decision 0.0, error:output/output_prob 0.9495798542629929, loss 4038.5933, max_size:classes 27, max_size:data 1322, mem_usage:GPU:0 3.8GB, num_seqs 15, 2.563 sec/step, elapsed 0:06:38, exp. remaining 0:44:34, complete 12.96%
pretrain epoch 6, step 128, cost:ctc inf, cost:output/output_prob 7.247485350235081, error:ctc 0.9552940796129405, error:decision 0.0, error:output/output_prob 0.9411764331161976, loss inf, max_size:classes 28, max_size:data 1021, mem_usage:GPU:0 3.8GB, num_seqs 19, 2.168 sec/step, elapsed 0:06:40, exp. remaining 0:44:02, complete 13.16%
pretrain epoch 6, step 129, cost:ctc 4.685957275675605, cost:output/output_prob 7.153036408519712, error:ctc 0.9525139385368676, error:decision 0.0, error:output/output_prob 0.9245809784624727, loss 4238.36, max_size:classes 27, max_size:data 1129, mem_usage:GPU:0 3.8GB, num_seqs 17, 2.325 sec/step, elapsed 0:06:42, exp. remaining 0:43:51, complete 13.27%
pretrain epoch 6, step 130, cost:ctc 5.262133521644955, cost:output/output_prob 7.077807348078977, error:ctc 0.9435483862180263, error:decision 0.0, error:output/output_prob 0.9569892464205623, loss 4590.458, max_size:classes 23, max_size:data 952, mem_usage:GPU:0 3.8GB, num_seqs 21, 2.040 sec/step, elapsed 0:06:44, exp. remaining 0:43:29, complete 13.43%
pretrain epoch 6, step 131, cost:ctc 4.04253145185703, cost:output/output_prob 7.296058872224648, error:ctc 0.9375000279396772, error:decision 0.0, error:output/output_prob 0.9375000279396772, loss 4354.0186, max_size:classes 18, max_size:data 804, mem_usage:GPU:0 3.8GB, num_seqs 24, 1.774 sec/step, elapsed 0:06:46, exp. remaining 0:43:15, complete 13.54%
pretrain epoch 6, step 132, cost:ctc 5.641414259864632, cost:output/output_prob 7.083097470735993, error:ctc 0.8885245909914374, error:decision 0.0, error:output/output_prob 0.94426229596138, loss 3880.976, max_size:classes 18, max_size:data 848, mem_usage:GPU:0 3.8GB, num_seqs 23, 1.835 sec/step, elapsed 0:06:48, exp. remaining 0:43:05, complete 13.64%
pretrain epoch 6, step 133, cost:ctc 5.103775132038038, cost:output/output_prob 6.935553006439989, error:ctc 0.8650519303046167, error:decision 0.0, error:output/output_prob 0.882352968910709, loss 3479.3657, max_size:classes 16, max_size:data 760, mem_usage:GPU:0 3.8GB, num_seqs 26, 1.695 sec/step, elapsed 0:06:50, exp. remaining 0:42:54, complete 13.74%
pretrain epoch 6, step 134, cost:ctc 5.256349897386144, cost:output/output_prob 6.581334085376511, error:ctc 0.8253968730568886, error:decision 0.0, error:output/output_prob 0.8571429066359997, loss 2983.0962, max_size:classes 10, max_size:data 569, mem_usage:GPU:0 3.8GB, num_seqs 35, 1.728 sec/step, elapsed 0:06:51, exp. remaining 0:42:46, complete 13.82%
pretrain epoch 6, step 135, cost:ctc 2.795517917420966, cost:output/output_prob 6.990948064249096, error:ctc 0.8578680027276278, error:decision 0.0, error:output/output_prob 0.8832487128674984, loss 3855.8677, max_size:classes 15, max_size:data 454, mem_usage:GPU:0 3.8GB, num_seqs 39, 1.414 sec/step, elapsed 0:06:53, exp. remaining 0:42:35, complete 13.92%
pretrain epoch 6, step 136, cost:ctc 5.692384607540191, cost:output/output_prob 7.167390286906084, error:ctc 0.9324675148818643, error:decision 0.0, error:output/output_prob 0.9298701123334469, loss 4951.0137, max_size:classes 22, max_size:data 743, mem_usage:GPU:0 3.8GB, num_seqs 26, 1.721 sec/step, elapsed 0:06:54, exp. remaining 0:42:26, complete 14.01%
pretrain epoch 6, step 137, cost:ctc 4.060556971581718, cost:output/output_prob 7.470646054971212, error:ctc 0.9412997579202056, error:decision 0.0, error:output/output_prob 0.9412997579202056, loss 5500.384, max_size:classes 21, max_size:data 675, mem_usage:GPU:0 3.8GB, num_seqs 28, 1.619 sec/step, elapsed 0:06:56, exp. remaining 0:42:18, complete 14.09%
pretrain epoch 6, step 138, cost:ctc 5.496984904182341, cost:output/output_prob 7.093487189233428, error:ctc 0.9496855018660425, error:decision 0.0, error:output/output_prob 0.9465408478863536, loss 4003.7703, max_size:classes 24, max_size:data 1239, mem_usage:GPU:0 3.8GB, num_seqs 16, 2.434 sec/step, elapsed 0:06:58, exp. remaining 0:42:13, complete 14.19%
pretrain epoch 6, step 139, cost:ctc 3.93117679392887, cost:output/output_prob 7.2233182369859605, error:ctc 0.9548254951369017, error:decision 0.0, error:output/output_prob 0.9507187188137323, loss 5432.239, max_size:classes 27, max_size:data 889, mem_usage:GPU:0 3.8GB, num_seqs 22, 1.956 sec/step, elapsed 0:07:00, exp. remaining 0:42:06, complete 14.28%
pretrain epoch 6, step 140, cost:ctc 4.656310918070005, cost:output/output_prob 7.224328368371516, error:ctc 0.9585491986945271, error:decision 0.0, error:output/output_prob 0.9274611165747046, loss 4585.927, max_size:classes 30, max_size:data 1203, mem_usage:GPU:0 3.8GB, num_seqs 16, 2.422 sec/step, elapsed 0:07:03, exp. remaining 0:42:03, complete 14.36%
pretrain epoch 6, step 141, cost:ctc 5.046733628529864, cost:output/output_prob 7.488361954493712, error:ctc 0.9604519791901112, error:decision 0.0, error:output/output_prob 0.9406779678538442, loss 4437.424, max_size:classes 31, max_size:data 1343, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.614 sec/step, elapsed 0:07:05, exp. remaining 0:42:01, complete 14.45%
pretrain epoch 6, step 142, cost:ctc 5.567426702291755, cost:output/output_prob 7.294755491046942, error:ctc 0.9619565396569669, error:decision 0.0, error:output/output_prob 0.948369582882151, loss 4733.283, max_size:classes 34, max_size:data 1376, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.704 sec/step, elapsed 0:07:08, exp. remaining 0:41:58, complete 14.54%
pretrain epoch 6, step 143, cost:ctc 6.45733804788199, cost:output/output_prob 7.169377243062513, error:ctc 0.9625000143423676, error:decision 0.0, error:output/output_prob 0.9656250143889338, loss 4360.549, max_size:classes 31, max_size:data 1578, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.946 sec/step, elapsed 0:07:11, exp. remaining 0:41:58, complete 14.63%
pretrain epoch 6, step 144, cost:ctc 5.989819971834152, cost:output/output_prob 7.091621912832011, error:ctc 0.964480847818777, error:decision 0.0, error:output/output_prob 0.9289617231115699, loss 4787.8076, max_size:classes 34, max_size:data 1512, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.888 sec/step, elapsed 0:07:14, exp. remaining 0:41:56, complete 14.72%
pretrain epoch 6, step 145, cost:ctc 3.592330019553316, cost:output/output_prob 6.886435049046895, error:ctc 0.9665809739381075, error:decision 0.0, error:output/output_prob 0.9511568094603717, loss 4076.2397, max_size:classes 35, max_size:data 1462, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.812 sec/step, elapsed 0:07:17, exp. remaining 0:41:54, complete 14.81%
pretrain epoch 6, step 146, cost:ctc 6.326493880875091, cost:output/output_prob 7.363150687356778, error:ctc 0.9686684221960603, error:decision 0.0, error:output/output_prob 0.9399477951228618, loss 5243.134, max_size:classes 39, max_size:data 1644, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.135 sec/step, elapsed 0:07:20, exp. remaining 0:41:55, complete 14.90%
pretrain epoch 6, step 147, cost:ctc 5.644802818250412, cost:output/output_prob 7.099769163690781, error:ctc 0.9667519102804364, error:decision 0.0, error:output/output_prob 0.9462915523909033, loss 4983.128, max_size:classes 39, max_size:data 1524, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.961 sec/step, elapsed 0:07:23, exp. remaining 0:41:55, complete 14.98%
pretrain epoch 6, step 148, cost:ctc 4.249723307365343, cost:output/output_prob 7.184397347704817, error:ctc 0.9684466109611094, error:decision 0.0, error:output/output_prob 0.9611650574952364, loss 4710.8574, max_size:classes 39, max_size:data 1427, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.781 sec/step, elapsed 0:07:26, exp. remaining 0:41:54, complete 15.07%
pretrain epoch 6, step 149, cost:ctc 5.8151197037318525, cost:output/output_prob 7.3913378056658985, error:ctc 0.967567590996623, error:decision 0.0, error:output/output_prob 0.9405405633151531, loss 4886.389, max_size:classes 35, max_size:data 1561, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.957 sec/step, elapsed 0:07:29, exp. remaining 0:41:54, complete 15.15%
pretrain epoch 6, step 150, cost:ctc 5.993226325108083, cost:output/output_prob 7.089018227496638, error:ctc 0.969696968793869, error:decision 0.0, error:output/output_prob 0.969696968793869, loss 5180.569, max_size:classes 35, max_size:data 1616, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.053 sec/step, elapsed 0:07:32, exp. remaining 0:41:53, complete 15.25%
pretrain epoch 6, step 151, cost:ctc 5.645338276593748, cost:output/output_prob 7.330811329683229, error:ctc 0.9702516719698906, error:decision 0.0, error:output/output_prob 0.9496567072346807, loss 5670.5776, max_size:classes 38, max_size:data 1445, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.837 sec/step, elapsed 0:07:35, exp. remaining 0:41:52, complete 15.33%
pretrain epoch 6, step 152, cost:ctc 5.931321665138739, cost:output/output_prob 7.096120184023051, error:ctc 0.9709443517494948, error:decision 0.0, error:output/output_prob 0.9588378136977554, loss 5380.333, max_size:classes 37, max_size:data 1543, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.943 sec/step, elapsed 0:07:37, exp. remaining 0:41:53, complete 15.41%
pretrain epoch 6, step 153, cost:ctc 4.709993178025911, cost:output/output_prob 7.079886212289466, error:ctc 0.9705882773268968, error:decision 0.0, error:output/output_prob 0.9570136161055416, loss 5211.1265, max_size:classes 39, max_size:data 1499, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.926 sec/step, elapsed 0:07:40, exp. remaining 0:41:53, complete 15.50%
pretrain epoch 6, step 154, cost:ctc 6.1626713635691885, cost:output/output_prob 7.290008521458276, error:ctc 0.9735771995037794, error:decision 0.0, error:output/output_prob 0.9654471185058355, loss 6618.7188, max_size:classes 41, max_size:data 1452, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.870 sec/step, elapsed 0:07:43, exp. remaining 0:41:52, complete 15.58%
pretrain epoch 6, step 155, cost:ctc 5.834709267844573, cost:output/output_prob 7.23654902974431, error:ctc 0.9725400013849139, error:decision 0.0, error:output/output_prob 0.945080048404634, loss 5712.14, max_size:classes 40, max_size:data 1619, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.087 sec/step, elapsed 0:07:46, exp. remaining 0:41:51, complete 15.67%
pretrain epoch 6, step 156, cost:ctc 7.690015514663514, cost:output/output_prob 7.09006325205587, error:ctc 0.9727272419258952, error:decision 0.0, error:output/output_prob 0.961363605922088, loss 6503.235, max_size:classes 42, max_size:data 1621, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.115 sec/step, elapsed 0:07:49, exp. remaining 0:41:50, complete 15.77%
pretrain epoch 6, step 157, cost:ctc 6.484607732173231, cost:output/output_prob 7.032117854294029, error:ctc 0.9726651886012405, error:decision 0.0, error:output/output_prob 0.9476082399487495, loss 5933.8423, max_size:classes 42, max_size:data 1584, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.049 sec/step, elapsed 0:07:52, exp. remaining 0:41:50, complete 15.85%
pretrain epoch 6, step 158, cost:ctc 7.008302375544417, cost:output/output_prob 7.120234370080425, error:ctc 0.9734513238072395, error:decision 0.0, error:output/output_prob 0.9557522088289261, loss 6386.0986, max_size:classes 46, max_size:data 1587, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.078 sec/step, elapsed 0:07:56, exp. remaining 0:41:51, complete 15.94%
pretrain epoch 6, step 159, cost:ctc 7.294701626233405, cost:output/output_prob 7.260710822221085, error:ctc 0.9732509993482381, error:decision 0.0, error:output/output_prob 0.9485596420709044, loss 7073.9307, max_size:classes 42, max_size:data 1536, mem_usage:GPU:0 3.8GB, num_seqs 13, 3.007 sec/step, elapsed 0:07:59, exp. remaining 0:41:51, complete 16.02%
pretrain epoch 6, step 160, cost:ctc 6.735000955942155, cost:output/output_prob 7.311323634602502, error:ctc 0.9736264187376946, error:decision 0.0, error:output/output_prob 0.9560440003406256, loss 6391.077, max_size:classes 41, max_size:data 1521, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.932 sec/step, elapsed 0:08:02, exp. remaining 0:41:50, complete 16.11%
pretrain epoch 6, step 161, cost:ctc 5.029307350047588, cost:output/output_prob 7.357156968118942, error:ctc 0.972839550115168, error:decision 0.0, error:output/output_prob 0.9679012782871722, loss 5016.5176, max_size:classes 40, max_size:data 1709, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.208 sec/step, elapsed 0:08:05, exp. remaining 0:41:51, complete 16.19%
pretrain epoch 6, step 162, cost:ctc 6.850505946478904, cost:output/output_prob 6.756577630870822, error:ctc 0.9745223431382328, error:decision 0.0, error:output/output_prob 0.9575372042600065, loss 6408.936, max_size:classes 43, max_size:data 1505, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.943 sec/step, elapsed 0:08:08, exp. remaining 0:41:50, complete 16.28%
pretrain epoch 6, step 163, cost:ctc 7.859114773636975, cost:output/output_prob 7.110742359682263, error:ctc 0.9733333569020033, error:decision 0.0, error:output/output_prob 0.9511111341416836, loss 6736.4355, max_size:classes 43, max_size:data 1601, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.079 sec/step, elapsed 0:08:11, exp. remaining 0:41:50, complete 16.36%
pretrain epoch 6, step 164, cost:ctc 6.657621410881802, cost:output/output_prob 7.0415301728627355, error:ctc 0.9745098615530878, error:decision 0.0, error:output/output_prob 0.9470588795375079, loss 6986.567, max_size:classes 43, max_size:data 1536, mem_usage:GPU:0 3.8GB, num_seqs 13, 3.005 sec/step, elapsed 0:08:14, exp. remaining 0:41:51, complete 16.44%
pretrain epoch 6, step 165, cost:ctc 5.655680455660331, cost:output/output_prob 6.959250441208496, error:ctc 0.9745596796274185, error:decision 0.0, error:output/output_prob 0.9667318910360336, loss 6446.2295, max_size:classes 42, max_size:data 1516, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.974 sec/step, elapsed 0:08:17, exp. remaining 0:41:52, complete 16.52%
pretrain epoch 6, step 166, cost:ctc 6.770916152482641, cost:output/output_prob 7.187336861310996, error:ctc 0.9758064225316048, error:decision 0.0, error:output/output_prob 0.9657257776707411, loss 6923.294, max_size:classes 44, max_size:data 1637, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.157 sec/step, elapsed 0:08:20, exp. remaining 0:41:53, complete 16.61%
pretrain epoch 6, step 167, cost:ctc 6.9111243482884674, cost:output/output_prob 6.976538872992933, error:ctc 0.9751552976667881, error:decision 0.0, error:output/output_prob 0.9503105767071247, loss 6707.741, max_size:classes 49, max_size:data 1633, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.188 sec/step, elapsed 0:08:23, exp. remaining 0:41:53, complete 16.69%
pretrain epoch 6, step 168, cost:ctc 5.8514017807354435, cost:output/output_prob 7.320395972322444, error:ctc 0.9753593767527491, error:decision 0.0, error:output/output_prob 0.9650924359448254, loss 6414.665, max_size:classes 47, max_size:data 1567, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.063 sec/step, elapsed 0:08:26, exp. remaining 0:41:53, complete 16.78%
pretrain epoch 6, step 169, cost:ctc 5.714446051585014, cost:output/output_prob 7.002455161231637, error:ctc 0.9762376542203128, error:decision 0.0, error:output/output_prob 0.9643564657308161, loss 6422.035, max_size:classes 49, max_size:data 1590, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.111 sec/step, elapsed 0:08:29, exp. remaining 0:41:53, complete 16.86%
pretrain epoch 6, step 170, cost:ctc 6.5384562009562615, cost:output/output_prob 7.068456762694552, error:ctc 0.9756592058110982, error:decision 0.0, error:output/output_prob 0.9492900380864739, loss 6708.208, max_size:classes 45, max_size:data 1592, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.084 sec/step, elapsed 0:08:32, exp. remaining 0:41:53, complete 16.95%
pretrain epoch 6, step 171, cost:ctc 6.01742020768711, cost:output/output_prob nan, error:ctc 0.9760000463575125, error:decision 0.0, error:output/output_prob 0.9760000463575125, loss nan, max_size:classes 47, max_size:data 1612, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.114 sec/step, elapsed 0:08:35, exp. remaining 0:41:52, complete 17.04%
pretrain epoch 6, step 172, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9771428466774522, error:decision 0.0, error:output/output_prob 0.9771428466774522, loss nan, max_size:classes 51, max_size:data 1569, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.968 sec/step, elapsed 0:08:38, exp. remaining 0:41:51, complete 17.12%
pretrain epoch 6, step 173, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9756097476929426, error:decision 0.0, error:output/output_prob 0.9756097476929426, loss nan, max_size:classes 45, max_size:data 1574, mem_usage:GPU:0 3.8GB, num_seqs 11, 2.911 sec/step, elapsed 0:08:41, exp. remaining 0:41:50, complete 17.21%
pretrain epoch 6, step 174, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9760348349809647, error:decision 0.0, error:output/output_prob 0.9760348349809647, loss nan, max_size:classes 44, max_size:data 1683, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.082 sec/step, elapsed 0:08:44, exp. remaining 0:41:48, complete 17.30%
pretrain epoch 6, step 175, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9776119175367056, error:decision 0.0, error:output/output_prob 0.9776119175367056, loss nan, max_size:classes 54, max_size:data 1622, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.064 sec/step, elapsed 0:08:47, exp. remaining 0:41:48, complete 17.39%
pretrain epoch 6, step 176, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9766990499338135, error:decision 0.0, error:output/output_prob 0.9766990499338135, loss nan, max_size:classes 48, max_size:data 1536, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.888 sec/step, elapsed 0:08:50, exp. remaining 0:41:48, complete 17.47%
pretrain epoch 6, step 177, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9773585051298141, error:decision 0.0, error:output/output_prob 0.9773585051298141, loss nan, max_size:classes 49, max_size:data 1586, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.995 sec/step, elapsed 0:08:53, exp. remaining 0:41:47, complete 17.55%
pretrain epoch 6, step 178, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9773585051298141, error:decision 0.0, error:output/output_prob 0.9773585051298141, loss nan, max_size:classes 49, max_size:data 1602, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.015 sec/step, elapsed 0:08:56, exp. remaining 0:41:48, complete 17.63%
pretrain epoch 6, step 179, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9780219818931073, error:decision 0.0, error:output/output_prob 0.9780219818931073, loss nan, max_size:classes 50, max_size:data 1575, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.979 sec/step, elapsed 0:08:59, exp. remaining 0:41:46, complete 17.72%
pretrain epoch 6, step 180, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9777015703730285, error:decision 0.0, error:output/output_prob 0.9777015703730285, loss nan, max_size:classes 49, max_size:data 1520, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.912 sec/step, elapsed 0:09:02, exp. remaining 0:41:45, complete 17.81%
pretrain epoch 6, step 181, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9774436336010695, error:decision 0.0, error:output/output_prob 0.9774436336010695, loss nan, max_size:classes 49, max_size:data 1662, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.118 sec/step, elapsed 0:09:05, exp. remaining 0:41:46, complete 17.89%
pretrain epoch 6, step 182, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9788732212036848, error:decision 0.0, error:output/output_prob 0.9788732212036848, loss nan, max_size:classes 52, max_size:data 1616, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.052 sec/step, elapsed 0:09:08, exp. remaining 0:41:45, complete 17.97%
pretrain epoch 6, step 183, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9782178523018956, error:decision 0.0, error:output/output_prob 0.9782178523018956, loss nan, max_size:classes 54, max_size:data 1673, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.132 sec/step, elapsed 0:09:12, exp. remaining 0:41:45, complete 18.06%
pretrain epoch 6, step 184, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9781818247865885, error:decision 0.0, error:output/output_prob 0.9781818247865885, loss nan, max_size:classes 49, max_size:data 1596, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.002 sec/step, elapsed 0:09:15, exp. remaining 0:41:45, complete 18.13%
pretrain epoch 6, step 185, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9788461547577754, error:decision 0.0, error:output/output_prob 0.9788461547577754, loss nan, max_size:classes 54, max_size:data 1687, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.170 sec/step, elapsed 0:09:18, exp. remaining 0:41:45, complete 18.22%
pretrain epoch 6, step 186, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.978378402069211, error:decision 0.0, error:output/output_prob 0.978378402069211, loss nan, max_size:classes 53, max_size:data 1590, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.036 sec/step, elapsed 0:09:21, exp. remaining 0:41:46, complete 18.30%
pretrain epoch 6, step 187, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9790874447207899, error:decision 0.0, error:output/output_prob 0.9790874447207899, loss nan, max_size:classes 51, max_size:data 1696, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.157 sec/step, elapsed 0:09:24, exp. remaining 0:41:46, complete 18.38%
pretrain epoch 6, step 188, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.978378402069211, error:decision 0.0, error:output/output_prob 0.978378402069211, loss nan, max_size:classes 54, max_size:data 1618, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.071 sec/step, elapsed 0:09:27, exp. remaining 0:41:45, complete 18.47%
pretrain epoch 6, step 189, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9782608877867459, error:decision 0.0, error:output/output_prob 0.9782608877867459, loss nan, max_size:classes 50, max_size:data 1577, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.995 sec/step, elapsed 0:09:30, exp. remaining 0:41:44, complete 18.55%
pretrain epoch 6, step 190, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9789271795889362, error:decision 0.0, error:output/output_prob 0.9789271795889362, loss nan, max_size:classes 53, max_size:data 1680, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.131 sec/step, elapsed 0:09:33, exp. remaining 0:41:43, complete 18.64%
pretrain epoch 6, step 191, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9796954113990068, error:decision 0.0, error:output/output_prob 0.9796954113990068, loss nan, max_size:classes 53, max_size:data 1661, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.130 sec/step, elapsed 0:09:36, exp. remaining 0:41:43, complete 18.72%
pretrain epoch 6, step 192, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9799331023823471, error:decision 0.0, error:output/output_prob 0.9799331023823471, loss nan, max_size:classes 54, max_size:data 1597, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.030 sec/step, elapsed 0:09:39, exp. remaining 0:41:42, complete 18.81%
pretrain epoch 6, step 193, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9794775891350581, error:decision 0.0, error:output/output_prob 0.9794775891350581, loss nan, max_size:classes 53, max_size:data 1683, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.156 sec/step, elapsed 0:09:42, exp. remaining 0:41:41, complete 18.90%
pretrain epoch 6, step 194, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9797297534532845, error:decision 0.0, error:output/output_prob 0.9797297534532845, loss nan, max_size:classes 54, max_size:data 1609, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.059 sec/step, elapsed 0:09:46, exp. remaining 0:41:39, complete 18.99%
pretrain epoch 6, step 195, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.979284350760281, error:decision 0.0, error:output/output_prob 0.979284350760281, loss nan, max_size:classes 55, max_size:data 1681, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.161 sec/step, elapsed 0:09:49, exp. remaining 0:41:38, complete 19.08%
pretrain epoch 6, step 196, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9798657763749361, error:decision 0.0, error:output/output_prob 0.9798657763749361, loss nan, max_size:classes 56, max_size:data 1622, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.100 sec/step, elapsed 0:09:52, exp. remaining 0:41:36, complete 19.17%
pretrain epoch 6, step 197, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9805194796063006, error:decision 0.0, error:output/output_prob 0.9805194796063006, loss nan, max_size:classes 58, max_size:data 1611, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.107 sec/step, elapsed 0:09:55, exp. remaining 0:41:36, complete 19.26%
pretrain epoch 6, step 198, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9803921682760119, error:decision 0.0, error:output/output_prob 0.9803921682760119, loss nan, max_size:classes 54, max_size:data 1605, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.051 sec/step, elapsed 0:09:58, exp. remaining 0:41:36, complete 19.34%
pretrain epoch 6, step 199, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9802306204801424, error:decision 0.0, error:output/output_prob 0.9802306204801424, loss nan, max_size:classes 58, max_size:data 1596, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.061 sec/step, elapsed 0:10:01, exp. remaining 0:41:29, complete 19.46%
pretrain epoch 6, step 200, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9811023585498333, error:decision 0.0, error:output/output_prob 0.9811023585498333, loss nan, max_size:classes 58, max_size:data 1587, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.050 sec/step, elapsed 0:10:04, exp. remaining 0:41:00, complete 19.73%
pretrain epoch 6, step 201, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9804559920448811, error:decision 0.0, error:output/output_prob 0.9804559920448811, loss nan, max_size:classes 56, max_size:data 1656, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.136 sec/step, elapsed 0:10:07, exp. remaining 0:40:57, complete 19.83%
pretrain epoch 6, step 202, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9808917343616486, error:decision 0.0, error:output/output_prob 0.9808917343616486, loss nan, max_size:classes 58, max_size:data 1647, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.155 sec/step, elapsed 0:10:10, exp. remaining 0:40:51, complete 19.95%
pretrain epoch 6, step 203, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9811023585498333, error:decision 0.0, error:output/output_prob 0.9811023585498333, loss nan, max_size:classes 58, max_size:data 1619, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.102 sec/step, elapsed 0:10:13, exp. remaining 0:40:50, complete 20.03%
pretrain epoch 6, step 204, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9808028023689984, error:decision 0.0, error:output/output_prob 0.9808028023689984, loss nan, max_size:classes 59, max_size:data 1676, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.180 sec/step, elapsed 0:10:17, exp. remaining 0:40:50, complete 20.12%
pretrain epoch 6, step 205, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9812924969010055, error:decision 0.0, error:output/output_prob 0.9812924969010055, loss nan, max_size:classes 58, max_size:data 1674, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.168 sec/step, elapsed 0:10:20, exp. remaining 0:40:49, complete 20.20%
pretrain epoch 6, step 206, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.982222220278345, error:decision 0.0, error:output/output_prob 0.982222220278345, loss nan, max_size:classes 60, max_size:data 1646, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.147 sec/step, elapsed 0:10:23, exp. remaining 0:40:48, complete 20.30%
pretrain epoch 6, step 207, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9824280976317823, error:decision 0.0, error:output/output_prob 0.9824280976317823, loss nan, max_size:classes 60, max_size:data 1714, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.233 sec/step, elapsed 0:10:26, exp. remaining 0:40:48, complete 20.38%
pretrain epoch 6, step 208, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9825673862360418, error:decision 0.0, error:output/output_prob 0.9825673862360418, loss nan, max_size:classes 60, max_size:data 1674, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.181 sec/step, elapsed 0:10:29, exp. remaining 0:40:47, complete 20.47%
pretrain epoch 6, step 209, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9826338333077729, error:decision 0.0, error:output/output_prob 0.9826338333077729, loss nan, max_size:classes 60, max_size:data 1648, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.145 sec/step, elapsed 0:10:32, exp. remaining 0:40:46, complete 20.55%
pretrain epoch 6, step 210, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9821428754366934, error:decision 0.0, error:output/output_prob 0.9821428754366934, loss nan, max_size:classes 59, max_size:data 1651, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.159 sec/step, elapsed 0:10:36, exp. remaining 0:40:46, complete 20.64%
pretrain epoch 6, step 211, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9820627786684781, error:decision 0.0, error:output/output_prob 0.9820627786684781, loss nan, max_size:classes 60, max_size:data 1643, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.150 sec/step, elapsed 0:10:39, exp. remaining 0:40:45, complete 20.72%
pretrain epoch 6, step 212, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9815100509440527, error:decision 0.0, error:output/output_prob 0.9815100509440527, loss nan, max_size:classes 59, max_size:data 1661, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.166 sec/step, elapsed 0:10:42, exp. remaining 0:40:45, complete 20.81%
pretrain epoch 6, step 213, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9811965895351024, error:decision 0.0, error:output/output_prob 0.9811965895351024, loss nan, max_size:classes 57, max_size:data 1682, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.182 sec/step, elapsed 0:10:45, exp. remaining 0:40:44, complete 20.89%
pretrain epoch 6, step 214, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9818456529173999, error:decision 0.0, error:output/output_prob 0.9818456529173999, loss nan, max_size:classes 60, max_size:data 1604, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.072 sec/step, elapsed 0:10:48, exp. remaining 0:40:43, complete 20.98%
pretrain epoch 6, step 215, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.981818150728941, error:decision 0.0, error:output/output_prob 0.981818150728941, loss nan, max_size:classes 58, max_size:data 1656, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.139 sec/step, elapsed 0:10:51, exp. remaining 0:40:43, complete 21.06%
pretrain epoch 6, step 216, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9811911990400404, error:decision 0.0, error:output/output_prob 0.9811911990400404, loss nan, max_size:classes 60, max_size:data 1661, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.165 sec/step, elapsed 0:10:55, exp. remaining 0:40:43, complete 21.14%
pretrain epoch 6, step 217, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9804241526871921, error:decision 0.0, error:output/output_prob 0.9804241526871921, loss nan, max_size:classes 58, max_size:data 1649, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.138 sec/step, elapsed 0:10:58, exp. remaining 0:40:42, complete 21.23%
pretrain epoch 6, step 218, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9810725746210665, error:decision 0.0, error:output/output_prob 0.9810725746210665, loss nan, max_size:classes 60, max_size:data 1645, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.148 sec/step, elapsed 0:11:01, exp. remaining 0:40:41, complete 21.31%
pretrain epoch 6, step 219, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9801652895985171, error:decision 0.0, error:output/output_prob 0.9801652895985171, loss nan, max_size:classes 59, max_size:data 1599, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.060 sec/step, elapsed 0:11:04, exp. remaining 0:40:40, complete 21.40%
pretrain epoch 6, step 220, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.979966582497582, error:decision 0.0, error:output/output_prob 0.979966582497582, loss nan, max_size:classes 55, max_size:data 1557, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.978 sec/step, elapsed 0:11:07, exp. remaining 0:40:39, complete 21.48%
pretrain epoch 6, step 221, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9803921682760119, error:decision 0.0, error:output/output_prob 0.9803921682760119, loss nan, max_size:classes 60, max_size:data 1579, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.039 sec/step, elapsed 0:11:10, exp. remaining 0:40:37, complete 21.57%
pretrain epoch 6, step 222, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9800332486629485, error:decision 0.0, error:output/output_prob 0.9800332486629485, loss nan, max_size:classes 55, max_size:data 1627, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.085 sec/step, elapsed 0:11:13, exp. remaining 0:40:36, complete 21.65%
pretrain epoch 6, step 223, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9794871878111736, error:decision 0.0, error:output/output_prob 0.9794871878111736, loss nan, max_size:classes 53, max_size:data 1646, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.096 sec/step, elapsed 0:11:16, exp. remaining 0:40:35, complete 21.74%
pretrain epoch 6, step 224, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9793233328964561, error:decision 0.0, error:output/output_prob 0.9793233328964561, loss nan, max_size:classes 52, max_size:data 1698, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.152 sec/step, elapsed 0:11:19, exp. remaining 0:40:34, complete 21.82%
pretrain epoch 6, step 225, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9791666739620268, error:decision 0.0, error:output/output_prob 0.9791666739620268, loss nan, max_size:classes 53, max_size:data 1590, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.008 sec/step, elapsed 0:11:22, exp. remaining 0:40:33, complete 21.91%
pretrain epoch 6, step 226, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9786096021998674, error:decision 0.0, error:output/output_prob 0.9786096021998674, loss nan, max_size:classes 51, max_size:data 1549, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.941 sec/step, elapsed 0:11:25, exp. remaining 0:40:31, complete 22.00%
pretrain epoch 6, step 227, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9791666739620268, error:decision 0.0, error:output/output_prob 0.9791666739620268, loss nan, max_size:classes 51, max_size:data 1645, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.096 sec/step, elapsed 0:11:28, exp. remaining 0:40:30, complete 22.08%
pretrain epoch 6, step 228, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9786476788576693, error:decision 0.0, error:output/output_prob 0.9786476788576693, loss nan, max_size:classes 51, max_size:data 1655, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.103 sec/step, elapsed 0:11:31, exp. remaining 0:40:30, complete 22.16%
pretrain epoch 6, step 229, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9785330764716491, error:decision 0.0, error:output/output_prob 0.9785330764716491, loss nan, max_size:classes 54, max_size:data 1626, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.088 sec/step, elapsed 0:11:34, exp. remaining 0:40:29, complete 22.24%
pretrain epoch 6, step 230, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9790576016530393, error:decision 0.0, error:output/output_prob 0.9790576016530393, loss nan, max_size:classes 51, max_size:data 1590, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.013 sec/step, elapsed 0:11:37, exp. remaining 0:40:27, complete 22.33%
pretrain epoch 6, step 231, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9784946227446198, error:decision 0.0, error:output/output_prob 0.9784946227446198, loss nan, max_size:classes 51, max_size:data 1661, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.120 sec/step, elapsed 0:11:41, exp. remaining 0:40:26, complete 22.42%
pretrain epoch 6, step 232, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9792746087769046, error:decision 0.0, error:output/output_prob 0.9792746087769046, loss nan, max_size:classes 56, max_size:data 1640, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.108 sec/step, elapsed 0:11:44, exp. remaining 0:40:25, complete 22.50%
pretrain epoch 6, step 233, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9782608877867459, error:decision 0.0, error:output/output_prob 0.9782608877867459, loss nan, max_size:classes 53, max_size:data 1548, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.942 sec/step, elapsed 0:11:47, exp. remaining 0:40:23, complete 22.59%
pretrain epoch 6, step 234, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9776951565872877, error:decision 0.0, error:output/output_prob 0.9776951565872877, loss nan, max_size:classes 50, max_size:data 1654, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.092 sec/step, elapsed 0:11:50, exp. remaining 0:40:21, complete 22.68%
pretrain epoch 6, step 235, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9783393440302461, error:decision 0.0, error:output/output_prob 0.9783393440302461, loss nan, max_size:classes 52, max_size:data 1612, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.051 sec/step, elapsed 0:11:53, exp. remaining 0:40:20, complete 22.76%
pretrain epoch 6, step 236, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9767891961382701, error:decision 0.0, error:output/output_prob 0.9767891961382701, loss nan, max_size:classes 49, max_size:data 1624, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.052 sec/step, elapsed 0:11:56, exp. remaining 0:40:18, complete 22.85%
pretrain epoch 6, step 237, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.978473573923111, error:decision 0.0, error:output/output_prob 0.978473573923111, loss nan, max_size:classes 51, max_size:data 1679, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.132 sec/step, elapsed 0:11:59, exp. remaining 0:40:17, complete 22.93%
pretrain epoch 6, step 238, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9778188666095957, error:decision 0.0, error:output/output_prob 0.9778188666095957, loss nan, max_size:classes 51, max_size:data 1582, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.994 sec/step, elapsed 0:12:02, exp. remaining 0:40:16, complete 23.02%
pretrain epoch 6, step 239, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9784172885119914, error:decision 0.0, error:output/output_prob 0.9784172885119914, loss nan, max_size:classes 55, max_size:data 1602, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.050 sec/step, elapsed 0:12:05, exp. remaining 0:40:13, complete 23.11%
pretrain epoch 6, step 240, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9774436336010695, error:decision 0.0, error:output/output_prob 0.9774436336010695, loss nan, max_size:classes 52, max_size:data 1617, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.048 sec/step, elapsed 0:12:08, exp. remaining 0:40:12, complete 23.20%
pretrain epoch 6, step 241, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9775701233884321, error:decision 0.0, error:output/output_prob 0.9775701233884321, loss nan, max_size:classes 50, max_size:data 1550, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.930 sec/step, elapsed 0:12:11, exp. remaining 0:40:10, complete 23.28%
pretrain epoch 6, step 242, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9770114708226173, error:decision 0.0, error:output/output_prob 0.9770114708226173, loss nan, max_size:classes 48, max_size:data 1547, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.908 sec/step, elapsed 0:12:14, exp. remaining 0:40:08, complete 23.37%
pretrain epoch 6, step 243, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9764918871223927, error:decision 0.0, error:output/output_prob 0.9764918871223927, loss nan, max_size:classes 49, max_size:data 1506, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.890 sec/step, elapsed 0:12:17, exp. remaining 0:40:06, complete 23.45%
pretrain epoch 6, step 244, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9762846240773797, error:decision 0.0, error:output/output_prob 0.9762846240773797, loss nan, max_size:classes 50, max_size:data 1661, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.106 sec/step, elapsed 0:12:20, exp. remaining 0:40:05, complete 23.54%
pretrain epoch 6, step 245, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9774011116242035, error:decision 0.0, error:output/output_prob 0.9774011116242035, loss nan, max_size:classes 54, max_size:data 1600, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.042 sec/step, elapsed 0:12:23, exp. remaining 0:40:03, complete 23.62%
pretrain epoch 6, step 246, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9772727563977242, error:decision 0.0, error:output/output_prob 0.9772727563977242, loss nan, max_size:classes 48, max_size:data 1582, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.967 sec/step, elapsed 0:12:26, exp. remaining 0:40:01, complete 23.71%
pretrain epoch 6, step 247, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9764243965037167, error:decision 0.0, error:output/output_prob 0.9764243965037167, loss nan, max_size:classes 50, max_size:data 1618, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.049 sec/step, elapsed 0:12:29, exp. remaining 0:39:59, complete 23.80%
pretrain epoch 6, step 248, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9764918871223927, error:decision 0.0, error:output/output_prob 0.9764918871223927, loss nan, max_size:classes 48, max_size:data 1513, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.888 sec/step, elapsed 0:12:32, exp. remaining 0:39:57, complete 23.89%
pretrain epoch 6, step 249, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9755601296201348, error:decision 0.0, error:output/output_prob 0.9755601296201348, loss nan, max_size:classes 46, max_size:data 1568, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.927 sec/step, elapsed 0:12:35, exp. remaining 0:39:55, complete 23.97%
pretrain epoch 6, step 250, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9753086124546826, error:decision 0.0, error:output/output_prob 0.9753086124546826, loss nan, max_size:classes 44, max_size:data 1549, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.879 sec/step, elapsed 0:12:38, exp. remaining 0:39:53, complete 24.06%
pretrain epoch 6, step 251, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9761905325576663, error:decision 0.0, error:output/output_prob 0.9761905325576663, loss nan, max_size:classes 45, max_size:data 1614, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.013 sec/step, elapsed 0:12:41, exp. remaining 0:39:51, complete 24.14%
pretrain epoch 6, step 252, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9745223431382328, error:decision 0.0, error:output/output_prob 0.9745223431382328, loss nan, max_size:classes 46, max_size:data 1569, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.939 sec/step, elapsed 0:12:44, exp. remaining 0:39:49, complete 24.23%
pretrain epoch 6, step 253, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9755601296201348, error:decision 0.0, error:output/output_prob 0.9755601296201348, loss nan, max_size:classes 48, max_size:data 1541, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.905 sec/step, elapsed 0:12:47, exp. remaining 0:39:47, complete 24.31%
pretrain epoch 6, step 254, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9748953725211321, error:decision 0.0, error:output/output_prob 0.9748953725211321, loss nan, max_size:classes 51, max_size:data 1623, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.062 sec/step, elapsed 0:12:50, exp. remaining 0:39:46, complete 24.40%
pretrain epoch 6, step 255, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9740259731188416, error:decision 0.0, error:output/output_prob 0.9740259731188416, loss nan, max_size:classes 42, max_size:data 1629, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.015 sec/step, elapsed 0:12:53, exp. remaining 0:39:44, complete 24.48%
pretrain epoch 6, step 256, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.974951847922057, error:decision 0.0, error:output/output_prob 0.974951847922057, loss nan, max_size:classes 47, max_size:data 1506, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.869 sec/step, elapsed 0:12:55, exp. remaining 0:39:41, complete 24.58%
pretrain epoch 6, step 257, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9733333569020033, error:decision 0.0, error:output/output_prob 0.9733333569020033, loss nan, max_size:classes 41, max_size:data 1562, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.889 sec/step, elapsed 0:12:58, exp. remaining 0:39:39, complete 24.66%
pretrain epoch 6, step 258, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9728507208637893, error:decision 0.0, error:output/output_prob 0.9728507208637893, loss nan, max_size:classes 44, max_size:data 1594, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.957 sec/step, elapsed 0:13:01, exp. remaining 0:39:36, complete 24.75%
pretrain epoch 6, step 259, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9741935685742645, error:decision 0.0, error:output/output_prob 0.9741935685742645, loss nan, max_size:classes 45, max_size:data 1584, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.942 sec/step, elapsed 0:13:04, exp. remaining 0:39:34, complete 24.84%
pretrain epoch 6, step 260, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9730337178334594, error:decision 0.0, error:output/output_prob 0.9730337178334594, loss nan, max_size:classes 41, max_size:data 1582, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.927 sec/step, elapsed 0:13:07, exp. remaining 0:39:31, complete 24.93%
pretrain epoch 6, step 261, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9729119869880378, error:decision 0.0, error:output/output_prob 0.9729119869880378, loss nan, max_size:classes 42, max_size:data 1567, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.908 sec/step, elapsed 0:13:10, exp. remaining 0:39:28, complete 25.02%
pretrain epoch 6, step 262, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9722863680217415, error:decision 0.0, error:output/output_prob 0.9722863680217415, loss nan, max_size:classes 42, max_size:data 1572, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.919 sec/step, elapsed 0:13:13, exp. remaining 0:39:25, complete 25.12%
pretrain epoch 6, step 263, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.971764667192474, error:decision 0.0, error:output/output_prob 0.971764667192474, loss nan, max_size:classes 39, max_size:data 1561, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.880 sec/step, elapsed 0:13:16, exp. remaining 0:39:20, complete 25.23%
pretrain epoch 6, step 264, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9724137894809246, error:decision 0.0, error:output/output_prob 0.9724137894809246, loss nan, max_size:classes 41, max_size:data 1610, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.974 sec/step, elapsed 0:13:19, exp. remaining 0:39:15, complete 25.34%
pretrain epoch 6, step 265, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.970786526799202, error:decision 0.0, error:output/output_prob 0.970786526799202, loss nan, max_size:classes 37, max_size:data 1452, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.704 sec/step, elapsed 0:13:22, exp. remaining 0:39:12, complete 25.42%
pretrain epoch 6, step 266, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9701492311432958, error:decision 0.0, error:output/output_prob 0.9701492311432958, loss nan, max_size:classes 40, max_size:data 1606, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.943 sec/step, elapsed 0:13:25, exp. remaining 0:39:03, complete 25.57%
pretrain epoch 6, step 267, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9703195944894105, error:decision 0.0, error:output/output_prob 0.9703195944894105, loss nan, max_size:classes 38, max_size:data 1513, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.819 sec/step, elapsed 0:13:27, exp. remaining 0:38:53, complete 25.71%
pretrain epoch 6, step 268, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9702233171556146, error:decision 0.0, error:output/output_prob 0.9702233171556146, loss nan, max_size:classes 46, max_size:data 1595, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.972 sec/step, elapsed 0:13:30, exp. remaining 0:38:43, complete 25.87%
pretrain epoch 6, step 269, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9691943489015102, error:decision 0.0, error:output/output_prob 0.9691943489015102, loss nan, max_size:classes 38, max_size:data 1512, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.828 sec/step, elapsed 0:13:33, exp. remaining 0:38:27, complete 26.07%
pretrain epoch 6, step 270, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9674185407347977, error:decision 0.0, error:output/output_prob 0.9674185407347977, loss nan, max_size:classes 34, max_size:data 1499, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.766 sec/step, elapsed 0:13:36, exp. remaining 0:38:11, complete 26.27%
pretrain epoch 6, step 271, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9657895150594413, error:decision 0.0, error:output/output_prob 0.9657895150594413, loss nan, max_size:classes 36, max_size:data 1492, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.765 sec/step, elapsed 0:13:39, exp. remaining 0:37:49, complete 26.53%
pretrain epoch 6, step 272, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9676768113858998, error:decision 0.0, error:output/output_prob 0.9676768113858998, loss nan, max_size:classes 40, max_size:data 1224, mem_usage:GPU:0 3.8GB, num_seqs 16, 2.417 sec/step, elapsed 0:13:41, exp. remaining 0:37:26, complete 26.78%
pretrain epoch 6, step 273, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9636804289184512, error:decision 0.0, error:output/output_prob 0.9636804289184512, loss nan, max_size:classes 34, max_size:data 1326, mem_usage:GPU:0 3.8GB, num_seqs 15, 2.546 sec/step, elapsed 0:13:44, exp. remaining 0:37:04, complete 27.04%
pretrain epoch 6, step 274, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9600000232458115, error:decision 0.0, error:output/output_prob 0.9600000232458115, loss nan, max_size:classes 30, max_size:data 1544, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.775 sec/step, elapsed 0:13:46, exp. remaining 0:36:50, complete 27.22%
pretrain epoch 6, step 275, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9592668497934937, error:decision 0.0, error:output/output_prob 0.9592668497934937, loss nan, max_size:classes 30, max_size:data 971, mem_usage:GPU:0 3.8GB, num_seqs 20, 1.988 sec/step, elapsed 0:13:48, exp. remaining 0:36:39, complete 27.37%
pretrain epoch 6, step 276, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9541484867222607, error:decision 0.0, error:output/output_prob 0.9541484867222607, loss nan, max_size:classes 26, max_size:data 926, mem_usage:GPU:0 3.8GB, num_seqs 21, 1.888 sec/step, elapsed 0:13:50, exp. remaining 0:36:30, complete 27.50%
pretrain epoch 6, step 277, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9482352563645691, error:decision 0.0, error:output/output_prob 0.9482352563645691, loss nan, max_size:classes 23, max_size:data 898, mem_usage:GPU:0 3.8GB, num_seqs 22, 1.832 sec/step, elapsed 0:13:52, exp. remaining 0:36:21, complete 27.62%
pretrain epoch 6, step 278, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.936794604640454, error:decision 0.0, error:output/output_prob 0.936794604640454, loss nan, max_size:classes 20, max_size:data 714, mem_usage:GPU:0 3.8GB, num_seqs 28, 1.569 sec/step, elapsed 0:13:54, exp. remaining 0:36:13, complete 27.73%
pretrain epoch 6, step 279, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.922437647357583, error:decision 0.0, error:output/output_prob 0.922437647357583, loss nan, max_size:classes 15, max_size:data 703, mem_usage:GPU:0 3.8GB, num_seqs 28, 1.510 sec/step, elapsed 0:13:55, exp. remaining 0:36:05, complete 27.84%
pretrain epoch 6, step 280, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9024390424601734, error:decision 0.0, error:output/output_prob 0.9024390424601734, loss nan, max_size:classes 15, max_size:data 499, mem_usage:GPU:0 3.8GB, num_seqs 36, 1.515 sec/step, elapsed 0:13:57, exp. remaining 0:35:59, complete 27.93%
pretrain epoch 6, step 281, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.8671586820855737, error:decision 0.0, error:output/output_prob 0.8671586820855737, loss nan, max_size:classes 11, max_size:data 552, mem_usage:GPU:0 3.8GB, num_seqs 36, 1.611 sec/step, elapsed 0:13:58, exp. remaining 0:35:53, complete 28.03%
pretrain epoch 6, step 282, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.908629423007369, error:decision 0.0, error:output/output_prob 0.908629423007369, loss nan, max_size:classes 16, max_size:data 524, mem_usage:GPU:0 3.8GB, num_seqs 36, 1.592 sec/step, elapsed 0:14:00, exp. remaining 0:35:46, complete 28.13%
pretrain epoch 6, step 283, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9299191168975085, error:decision 0.0, error:output/output_prob 0.9299191168975085, loss nan, max_size:classes 17, max_size:data 747, mem_usage:GPU:0 3.8GB, num_seqs 26, 1.570 sec/step, elapsed 0:14:01, exp. remaining 0:35:41, complete 28.23%
pretrain epoch 6, step 284, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9415041622705758, error:decision 0.0, error:output/output_prob 0.9415041622705758, loss nan, max_size:classes 21, max_size:data 933, mem_usage:GPU:0 3.8GB, num_seqs 21, 1.869 sec/step, elapsed 0:14:03, exp. remaining 0:35:36, complete 28.31%
pretrain epoch 6, step 285, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9492957412730902, error:decision 0.0, error:output/output_prob 0.9492957412730902, loss nan, max_size:classes 23, max_size:data 1103, mem_usage:GPU:0 3.8GB, num_seqs 18, 2.127 sec/step, elapsed 0:14:05, exp. remaining 0:35:31, complete 28.41%
pretrain epoch 6, step 286, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9556135917082428, error:decision 0.0, error:output/output_prob 0.9556135917082428, loss nan, max_size:classes 29, max_size:data 1011, mem_usage:GPU:0 3.8GB, num_seqs 17, 1.999 sec/step, elapsed 0:14:07, exp. remaining 0:35:27, complete 28.50%
pretrain epoch 6, step 287, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9574467781931162, error:decision 0.0, error:output/output_prob 0.9574467781931162, loss nan, max_size:classes 34, max_size:data 1236, mem_usage:GPU:0 3.8GB, num_seqs 16, 2.395 sec/step, elapsed 0:14:10, exp. remaining 0:35:24, complete 28.59%
pretrain epoch 6, step 288, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9622165872715412, error:decision 0.0, error:output/output_prob 0.9622165872715412, loss nan, max_size:classes 31, max_size:data 1298, mem_usage:GPU:0 3.8GB, num_seqs 15, 2.463 sec/step, elapsed 0:14:12, exp. remaining 0:35:21, complete 28.67%
pretrain epoch 6, step 289, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9633802478201687, error:decision 0.0, error:output/output_prob 0.9633802478201687, loss nan, max_size:classes 36, max_size:data 1474, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.736 sec/step, elapsed 0:14:15, exp. remaining 0:35:19, complete 28.76%
pretrain epoch 6, step 290, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9641943655442448, error:decision 0.0, error:output/output_prob 0.9641943655442448, loss nan, max_size:classes 31, max_size:data 1368, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.555 sec/step, elapsed 0:14:18, exp. remaining 0:35:16, complete 28.85%
pretrain epoch 6, step 291, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9651741068810225, error:decision 0.0, error:output/output_prob 0.9651741068810225, loss nan, max_size:classes 32, max_size:data 1347, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.532 sec/step, elapsed 0:14:20, exp. remaining 0:35:13, complete 28.94%
pretrain epoch 6, step 292, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9690476560499519, error:decision 0.0, error:output/output_prob 0.9690476560499519, loss nan, max_size:classes 35, max_size:data 1527, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.821 sec/step, elapsed 0:14:23, exp. remaining 0:35:11, complete 29.03%
pretrain epoch 6, step 293, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9702970143407583, error:decision 0.0, error:output/output_prob 0.9702970143407583, loss nan, max_size:classes 38, max_size:data 1546, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.840 sec/step, elapsed 0:14:26, exp. remaining 0:35:09, complete 29.11%
pretrain epoch 6, step 294, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.969696968793869, error:decision 0.0, error:output/output_prob 0.969696968793869, loss nan, max_size:classes 36, max_size:data 1407, mem_usage:GPU:0 3.8GB, num_seqs 14, 2.654 sec/step, elapsed 0:14:28, exp. remaining 0:35:07, complete 29.20%
pretrain epoch 6, step 295, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.970786526799202, error:decision 0.0, error:output/output_prob 0.970786526799202, loss nan, max_size:classes 39, max_size:data 1520, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.844 sec/step, elapsed 0:14:31, exp. remaining 0:35:05, complete 29.28%
pretrain epoch 6, step 296, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9710843574721366, error:decision 0.0, error:output/output_prob 0.9710843574721366, loss nan, max_size:classes 39, max_size:data 1544, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.848 sec/step, elapsed 0:14:34, exp. remaining 0:35:03, complete 29.37%
pretrain epoch 6, step 297, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9714286085218191, error:decision 0.0, error:output/output_prob 0.9714286085218191, loss nan, max_size:classes 41, max_size:data 1586, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.935 sec/step, elapsed 0:14:37, exp. remaining 0:35:01, complete 29.46%
pretrain epoch 6, step 298, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9722222294658422, error:decision 0.0, error:output/output_prob 0.9722222294658422, loss nan, max_size:classes 40, max_size:data 1589, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.929 sec/step, elapsed 0:14:40, exp. remaining 0:35:00, complete 29.54%
pretrain epoch 6, step 299, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9719827549997717, error:decision 0.0, error:output/output_prob 0.9719827549997717, loss nan, max_size:classes 43, max_size:data 1516, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.858 sec/step, elapsed 0:14:43, exp. remaining 0:34:58, complete 29.63%
pretrain epoch 6, step 300, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9708029120229186, error:decision 0.0, error:output/output_prob 0.9708029120229186, loss nan, max_size:classes 37, max_size:data 1576, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.893 sec/step, elapsed 0:14:46, exp. remaining 0:34:56, complete 29.71%
pretrain epoch 6, step 301, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9731404550839216, error:decision 0.0, error:output/output_prob 0.9731404550839216, loss nan, max_size:classes 49, max_size:data 1489, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.863 sec/step, elapsed 0:14:49, exp. remaining 0:34:54, complete 29.80%
pretrain epoch 6, step 302, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9727891290094705, error:decision 0.0, error:output/output_prob 0.9727891290094705, loss nan, max_size:classes 43, max_size:data 1584, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.944 sec/step, elapsed 0:14:52, exp. remaining 0:34:53, complete 29.88%
pretrain epoch 6, step 303, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9724770225584507, error:decision 0.0, error:output/output_prob 0.9724770225584507, loss nan, max_size:classes 41, max_size:data 1552, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.878 sec/step, elapsed 0:14:54, exp. remaining 0:34:51, complete 29.97%
pretrain epoch 6, step 304, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9744136689696461, error:decision 0.0, error:output/output_prob 0.9744136689696461, loss nan, max_size:classes 45, max_size:data 1599, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.981 sec/step, elapsed 0:14:57, exp. remaining 0:34:50, complete 30.05%
pretrain epoch 6, step 305, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9741935685742645, error:decision 0.0, error:output/output_prob 0.9741935685742645, loss nan, max_size:classes 47, max_size:data 1543, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.908 sec/step, elapsed 0:15:00, exp. remaining 0:34:48, complete 30.14%
pretrain epoch 6, step 306, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9747899658977985, error:decision 0.0, error:output/output_prob 0.9747899658977985, loss nan, max_size:classes 45, max_size:data 1575, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.943 sec/step, elapsed 0:15:03, exp. remaining 0:34:46, complete 30.22%
pretrain epoch 6, step 307, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9743040567263961, error:decision 0.0, error:output/output_prob 0.9743040567263961, loss nan, max_size:classes 42, max_size:data 1580, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.913 sec/step, elapsed 0:15:06, exp. remaining 0:34:44, complete 30.32%
pretrain epoch 6, step 308, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9746300077531487, error:decision 0.0, error:output/output_prob 0.9746300077531487, loss nan, max_size:classes 46, max_size:data 1535, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.881 sec/step, elapsed 0:15:09, exp. remaining 0:34:42, complete 30.40%
pretrain epoch 6, step 309, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9749478294979781, error:decision 0.0, error:output/output_prob 0.9749478294979781, loss nan, max_size:classes 44, max_size:data 1571, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.928 sec/step, elapsed 0:15:12, exp. remaining 0:34:40, complete 30.49%
pretrain epoch 6, step 310, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9760479026008397, error:decision 0.0, error:output/output_prob 0.9760479026008397, loss nan, max_size:classes 46, max_size:data 1597, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.980 sec/step, elapsed 0:15:15, exp. remaining 0:34:38, complete 30.58%
pretrain epoch 6, step 311, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9753593767527491, error:decision 0.0, error:output/output_prob 0.9753593767527491, loss nan, max_size:classes 52, max_size:data 1587, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.012 sec/step, elapsed 0:15:18, exp. remaining 0:34:37, complete 30.66%
pretrain epoch 6, step 312, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9759035781025887, error:decision 0.0, error:output/output_prob 0.9759035781025887, loss nan, max_size:classes 45, max_size:data 1656, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.074 sec/step, elapsed 0:15:21, exp. remaining 0:34:36, complete 30.74%
pretrain epoch 6, step 313, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9748953725211321, error:decision 0.0, error:output/output_prob 0.9748953725211321, loss nan, max_size:classes 44, max_size:data 1495, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.798 sec/step, elapsed 0:15:24, exp. remaining 0:34:34, complete 30.83%
pretrain epoch 6, step 314, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9747899658977985, error:decision 0.0, error:output/output_prob 0.9747899658977985, loss nan, max_size:classes 50, max_size:data 1570, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.984 sec/step, elapsed 0:15:27, exp. remaining 0:34:32, complete 30.91%
pretrain epoch 6, step 315, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9751037857495248, error:decision 0.0, error:output/output_prob 0.9751037857495248, loss nan, max_size:classes 49, max_size:data 1608, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.032 sec/step, elapsed 0:15:30, exp. remaining 0:34:31, complete 31.00%
pretrain epoch 6, step 316, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9762340318411589, error:decision 0.0, error:output/output_prob 0.9762340318411589, loss nan, max_size:classes 49, max_size:data 1517, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.884 sec/step, elapsed 0:15:33, exp. remaining 0:34:29, complete 31.08%
pretrain epoch 6, step 317, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9764243965037167, error:decision 0.0, error:output/output_prob 0.9764243965037167, loss nan, max_size:classes 46, max_size:data 1626, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.020 sec/step, elapsed 0:15:36, exp. remaining 0:34:27, complete 31.17%
pretrain epoch 6, step 318, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9769503236748278, error:decision 0.0, error:output/output_prob 0.9769503236748278, loss nan, max_size:classes 49, max_size:data 1516, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.907 sec/step, elapsed 0:15:39, exp. remaining 0:34:25, complete 31.25%
pretrain epoch 6, step 319, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9775280999019743, error:decision 0.0, error:output/output_prob 0.9775280999019743, loss nan, max_size:classes 50, max_size:data 1620, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.042 sec/step, elapsed 0:15:42, exp. remaining 0:34:24, complete 31.34%
pretrain epoch 6, step 320, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.976744172628969, error:decision 0.0, error:output/output_prob 0.976744172628969, loss nan, max_size:classes 48, max_size:data 1699, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.141 sec/step, elapsed 0:15:45, exp. remaining 0:34:23, complete 31.43%
pretrain epoch 6, step 321, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9773585051298141, error:decision 0.0, error:output/output_prob 0.9773585051298141, loss nan, max_size:classes 54, max_size:data 1633, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.103 sec/step, elapsed 0:15:48, exp. remaining 0:34:21, complete 31.51%
pretrain epoch 6, step 322, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9771863040514291, error:decision 0.0, error:output/output_prob 0.9771863040514291, loss nan, max_size:classes 53, max_size:data 1548, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.933 sec/step, elapsed 0:15:51, exp. remaining 0:34:19, complete 31.60%
pretrain epoch 6, step 323, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9786476788576693, error:decision 0.0, error:output/output_prob 0.9786476788576693, loss nan, max_size:classes 51, max_size:data 1604, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.015 sec/step, elapsed 0:15:54, exp. remaining 0:34:18, complete 31.68%
pretrain epoch 6, step 324, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9776536433491855, error:decision 0.0, error:output/output_prob 0.9776536433491855, loss nan, max_size:classes 51, max_size:data 1631, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.047 sec/step, elapsed 0:15:57, exp. remaining 0:34:16, complete 31.77%
pretrain epoch 6, step 325, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9773662255611271, error:decision 0.0, error:output/output_prob 0.9773662255611271, loss nan, max_size:classes 48, max_size:data 1680, mem_usage:GPU:0 3.8GB, num_seqs 11, 3.089 sec/step, elapsed 0:16:00, exp. remaining 0:34:15, complete 31.85%
pretrain epoch 6, step 326, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9777397187426686, error:decision 0.0, error:output/output_prob 0.9777397187426686, loss nan, max_size:classes 49, max_size:data 1538, mem_usage:GPU:0 3.8GB, num_seqs 13, 2.923 sec/step, elapsed 0:16:03, exp. remaining 0:34:13, complete 31.94%
pretrain epoch 6, step 327, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9768339584115892, error:decision 0.0, error:output/output_prob 0.9768339584115892, loss nan, max_size:classes 48, max_size:data 1606, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.000 sec/step, elapsed 0:16:06, exp. remaining 0:34:11, complete 32.02%
pretrain epoch 6, step 328, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9777365570189432, error:decision 0.0, error:output/output_prob 0.9777365570189432, loss nan, max_size:classes 50, max_size:data 1598, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.990 sec/step, elapsed 0:16:09, exp. remaining 0:34:10, complete 32.11%
pretrain epoch 6, step 329, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9770114708226173, error:decision 0.0, error:output/output_prob 0.9770114708226173, loss nan, max_size:classes 50, max_size:data 1601, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.998 sec/step, elapsed 0:16:12, exp. remaining 0:34:08, complete 32.19%
pretrain epoch 6, step 330, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9782608877867459, error:decision 0.0, error:output/output_prob 0.9782608877867459, loss nan, max_size:classes 52, max_size:data 1663, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.119 sec/step, elapsed 0:16:15, exp. remaining 0:34:06, complete 32.28%
pretrain epoch 6, step 331, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9784946227446198, error:decision 0.0, error:output/output_prob 0.9784946227446198, loss nan, max_size:classes 53, max_size:data 1661, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.138 sec/step, elapsed 0:16:18, exp. remaining 0:34:05, complete 32.36%
pretrain epoch 6, step 332, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9795221539679915, error:decision 0.0, error:output/output_prob 0.9795221539679915, loss nan, max_size:classes 59, max_size:data 1646, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.137 sec/step, elapsed 0:16:21, exp. remaining 0:34:04, complete 32.45%
pretrain epoch 6, step 333, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9783002054318786, error:decision 0.0, error:output/output_prob 0.9783002054318786, loss nan, max_size:classes 49, max_size:data 1652, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.087 sec/step, elapsed 0:16:25, exp. remaining 0:34:02, complete 32.53%
pretrain epoch 6, step 334, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9785330764716491, error:decision 0.0, error:output/output_prob 0.9785330764716491, loss nan, max_size:classes 53, max_size:data 1632, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.066 sec/step, elapsed 0:16:28, exp. remaining 0:34:00, complete 32.62%
pretrain epoch 6, step 335, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9792027733055875, error:decision 0.0, error:output/output_prob 0.9792027733055875, loss nan, max_size:classes 56, max_size:data 1613, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.069 sec/step, elapsed 0:16:31, exp. remaining 0:33:59, complete 32.71%
pretrain epoch 6, step 336, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9795918166637421, error:decision 0.0, error:output/output_prob 0.9795918166637421, loss nan, max_size:classes 56, max_size:data 1609, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.075 sec/step, elapsed 0:16:34, exp. remaining 0:33:57, complete 32.79%
pretrain epoch 6, step 337, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9797297534532845, error:decision 0.0, error:output/output_prob 0.9797297534532845, loss nan, max_size:classes 53, max_size:data 1557, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.959 sec/step, elapsed 0:16:37, exp. remaining 0:33:55, complete 32.88%
pretrain epoch 6, step 338, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9794871878111736, error:decision 0.0, error:output/output_prob 0.9794871878111736, loss nan, max_size:classes 51, max_size:data 1584, mem_usage:GPU:0 3.8GB, num_seqs 12, 2.990 sec/step, elapsed 0:16:40, exp. remaining 0:33:52, complete 32.98%
pretrain epoch 6, step 339, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9795221539679915, error:decision 0.0, error:output/output_prob 0.9795221539679915, loss nan, max_size:classes 54, max_size:data 1616, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.056 sec/step, elapsed 0:16:43, exp. remaining 0:33:49, complete 33.07%
pretrain epoch 6, step 340, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9798657763749361, error:decision 0.0, error:output/output_prob 0.9798657763749361, loss nan, max_size:classes 54, max_size:data 1576, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.016 sec/step, elapsed 0:16:46, exp. remaining 0:33:48, complete 33.15%
pretrain epoch 6, step 341, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9796954113990068, error:decision 0.0, error:output/output_prob 0.9796954113990068, loss nan, max_size:classes 54, max_size:data 1665, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.136 sec/step, elapsed 0:16:49, exp. remaining 0:33:48, complete 33.23%
pretrain epoch 6, step 342, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9802306204801424, error:decision 0.0, error:output/output_prob 0.9802306204801424, loss nan, max_size:classes 57, max_size:data 1600, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.054 sec/step, elapsed 0:16:52, exp. remaining 0:33:47, complete 33.31%
pretrain epoch 6, step 343, cost:ctc 0.0, cost:output/output_prob nan, error:ctc 0.9809523944277316, error:decision 0.0, error:output/output_prob 0.9809523944277316, loss nan, max_size:classes 60, max_size:data 1620, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.103 sec/step, elapsed 0:16:55, exp. remaining 0:33:44, complete 33.40%
pretrain epoch 6, step 344, cost:ctc nan, cost:output/output_prob nan, error:ctc 0.9802955727791414, error:decision 0.0, error:output/output_prob 0.9802955727791414, loss nan, max_size:classes 56, max_size:data 1616, mem_usage:GPU:0 3.8GB, num_seqs 12, 3.083 sec/step, elapsed 0:16:58, exp. remaining 0:33:41, complete 33.50%