Skip to content

Instantly share code, notes, and snippets.

@jeremypoulain
Created April 5, 2020 10:33
Show Gist options
  • Save jeremypoulain/8ca932a0fc5701578fc4adb127da7adf to your computer and use it in GitHub Desktop.
Save jeremypoulain/8ca932a0fc5701578fc4adb127da7adf to your computer and use it in GitHub Desktop.
RE2_pytorch_quora_logs
04/05/2020 10:10:00 TensorBoard activated.
04/05/2020 10:10:01 2 symbols found: 0 1
04/05/2020 10:10:37 vocab coverage 84164/107155 | OOV occurrences 29441/10247150 (0.2873%)
04/05/2020 10:10:37 Covered by pretrained vectors 98.9283%. outside pretrained: -lsb- -rsb- -lcb- -rcb- c# redmi demonetisation brexit demonetize quorans ...
04/05/2020 10:10:37 top words:
? the what is i how a to in do
04/05/2020 10:10:37 filtered words:
venturimeter meaww.com incident/event nus/ntu nc-obc theqot.com ezerzer labdoor.com habit/tactic italo-roman ... haskell/lisp comduction petrola hotjar robot-sounding massage/health existed/existing ideal/perfect moments/incidents hard-to-notice
04/05/2020 10:10:37 #classes: 2; #vocab: 84166
04/05/2020 10:11:20 trainable params: 2,806,406
04/05/2020 10:11:20 trainable params (exclude embeddings): 2,806,406
04/05/2020 10:11:20 { '__index__': 0,
'__parents__': ['default', 'data/quora'],
'__repeat__': 1,
'alignment': 'linear',
'batch_size': 256,
'beta1': 0.9,
'beta2': 0.999,
'blocks': 2,
'connection': 'aug',
'cuda': True,
'data_dir': 'data/quora',
'deterministic': True,
'dropout': 0.2,
'early_stopping': 10000,
'embedding_dim': 300,
'embedding_mode': 'freq',
'enc_layers': 2,
'encoder': 'cnn',
'epochs': 30,
'eval_epoch': True,
'eval_file': 'test',
'eval_per_samples': 12800,
'eval_per_samples_warmup': 512000,
'eval_per_updates': 50,
'eval_per_updates_warmup': 2000,
'eval_subset': None,
'eval_warmup_samples': 3584000,
'eval_warmup_steps': 14000,
'fix_embeddings': True,
'fusion': 'full',
'grad_clipping': 5,
'hidden_size': 200,
'kernel_sizes': [3],
'log_file': 'log.txt',
'log_per_samples': 5120,
'log_per_updates': 20,
'lower_case': True,
'lr': 0.0012,
'lr_decay_rate': 0.95,
'lr_decay_samples': 256000,
'lr_decay_steps': 1000,
'lr_warmup_samples': 0,
'lr_warmup_steps': 0,
'max_len': 100,
'max_loss': 999.0,
'max_vocab': 999999,
'metric': 'acc',
'min_df': 5,
'min_len': 1,
'min_lr': 6e-05,
'min_samples': 5120000,
'min_steps': 20000,
'multi_gpu': False,
'name': 'benchmark',
'num_classes': 2,
'num_vocab': 84166,
'output_dir': 'models/quora',
'padding': 0,
'prediction': 'symmetric',
'pretrained_embeddings': 'resources/glove.840B.300d.txt',
'resume': None,
'save': True,
'save_all': False,
'seed': None,
'sort_by_len': False,
'summary_dir': 'models/quora/benchmark',
'summary_per_logs': 20,
'summary_per_updates': 400,
'tensorboard': True,
'tolerance_samples': 2560000,
'watch_metrics': ['auc', 'f1', 'acc'],
'weight_decay': 0}
04/05/2020 10:11:20 train (384348) | test (10000)
04/05/2020 10:11:31 setup complete: 0:01:30s.
04/05/2020 10:11:31 Epoch: 1
04/05/2020 10:11:39 > epoch 1 updates 20 loss: 0.6129 lr: 0.0012 gnorm: 0.3204
04/05/2020 10:11:42 > epoch 1 updates 40 loss: 0.5590 lr: 0.0012 gnorm: 0.5190
04/05/2020 10:11:44 > epoch 1 updates 60 loss: 0.5125 lr: 0.0012 gnorm: 0.4509
04/05/2020 10:11:47 > epoch 1 updates 80 loss: 0.5519 lr: 0.0012 gnorm: 0.5193
04/05/2020 10:11:50 > epoch 1 updates 100 loss: 0.5170 lr: 0.0012 gnorm: 0.5010
04/05/2020 10:11:53 > epoch 1 updates 120 loss: 0.4369 lr: 0.0012 gnorm: 0.5084
04/05/2020 10:11:56 > epoch 1 updates 140 loss: 0.4143 lr: 0.0012 gnorm: 0.3607
04/05/2020 10:11:59 > epoch 1 updates 160 loss: 0.4343 lr: 0.0012 gnorm: 0.4609
04/05/2020 10:12:02 > epoch 1 updates 180 loss: 0.5052 lr: 0.0012 gnorm: 0.7038
04/05/2020 10:12:05 > epoch 1 updates 200 loss: 0.4192 lr: 0.0012 gnorm: 0.5136
04/05/2020 10:12:07 > epoch 1 updates 220 loss: 0.4465 lr: 0.0012 gnorm: 0.3839
04/05/2020 10:12:10 > epoch 1 updates 240 loss: 0.4804 lr: 0.0012 gnorm: 0.4894
04/05/2020 10:12:13 > epoch 1 updates 260 loss: 0.4286 lr: 0.0012 gnorm: 0.5273
04/05/2020 10:12:16 > epoch 1 updates 280 loss: 0.3773 lr: 0.0012 gnorm: 0.5240
04/05/2020 10:12:19 > epoch 1 updates 300 loss: 0.3934 lr: 0.0012 gnorm: 0.5372
04/05/2020 10:12:22 > epoch 1 updates 320 loss: 0.4602 lr: 0.0012 gnorm: 0.4881
04/05/2020 10:12:25 > epoch 1 updates 340 loss: 0.4397 lr: 0.0012 gnorm: 0.6432
04/05/2020 10:12:28 > epoch 1 updates 360 loss: 0.4017 lr: 0.0012 gnorm: 0.4039
04/05/2020 10:12:30 > epoch 1 updates 380 loss: 0.3990 lr: 0.0012 gnorm: 0.3750
04/05/2020 10:12:33 > epoch 1 updates 400 loss: 0.4197 lr: 0.0012 gnorm: 0.4276
04/05/2020 10:12:36 > epoch 1 updates 420 loss: 0.3813 lr: 0.0012 gnorm: 0.4041
04/05/2020 10:12:39 > epoch 1 updates 440 loss: 0.4158 lr: 0.0012 gnorm: 0.3928
04/05/2020 10:12:42 > epoch 1 updates 460 loss: 0.3659 lr: 0.0012 gnorm: 0.3847
04/05/2020 10:12:45 > epoch 1 updates 480 loss: 0.3544 lr: 0.0012 gnorm: 0.5223
04/05/2020 10:12:48 > epoch 1 updates 500 loss: 0.4272 lr: 0.0012 gnorm: 0.3978
04/05/2020 10:12:51 > epoch 1 updates 520 loss: 0.4221 lr: 0.0012 gnorm: 0.3509
04/05/2020 10:12:54 > epoch 1 updates 540 loss: 0.3502 lr: 0.0012 gnorm: 0.3582
04/05/2020 10:12:57 > epoch 1 updates 560 loss: 0.3796 lr: 0.0012 gnorm: 0.3811
04/05/2020 10:13:00 > epoch 1 updates 580 loss: 0.3099 lr: 0.0012 gnorm: 0.6178
04/05/2020 10:13:03 > epoch 1 updates 600 loss: 0.3896 lr: 0.0012 gnorm: 0.5176
04/05/2020 10:13:05 > epoch 1 updates 620 loss: 0.4224 lr: 0.0012 gnorm: 0.4361
04/05/2020 10:13:08 > epoch 1 updates 640 loss: 0.4298 lr: 0.0012 gnorm: 0.6531
04/05/2020 10:13:11 > epoch 1 updates 660 loss: 0.3843 lr: 0.0012 gnorm: 0.3145
04/05/2020 10:13:14 > epoch 1 updates 680 loss: 0.3677 lr: 0.0012 gnorm: 0.3452
04/05/2020 10:13:17 > epoch 1 updates 700 loss: 0.4335 lr: 0.0012 gnorm: 0.3583
04/05/2020 10:13:20 > epoch 1 updates 720 loss: 0.4280 lr: 0.0012 gnorm: 0.3159
04/05/2020 10:13:23 > epoch 1 updates 740 loss: 0.3619 lr: 0.0012 gnorm: 0.3547
04/05/2020 10:13:26 > epoch 1 updates 760 loss: 0.3839 lr: 0.0012 gnorm: 0.3353
04/05/2020 10:13:29 > epoch 1 updates 780 loss: 0.4456 lr: 0.0012 gnorm: 0.4153
04/05/2020 10:13:32 > epoch 1 updates 800 loss: 0.4155 lr: 0.0012 gnorm: 0.5086
04/05/2020 10:13:35 > epoch 1 updates 820 loss: 0.3987 lr: 0.0012 gnorm: 0.3636
04/05/2020 10:13:37 > epoch 1 updates 840 loss: 0.3865 lr: 0.0012 gnorm: 0.3651
04/05/2020 10:13:40 > epoch 1 updates 860 loss: 0.3380 lr: 0.0012 gnorm: 0.3954
04/05/2020 10:13:43 > epoch 1 updates 880 loss: 0.3272 lr: 0.0012 gnorm: 0.3625
04/05/2020 10:13:46 > epoch 1 updates 900 loss: 0.3442 lr: 0.0012 gnorm: 0.3687
04/05/2020 10:13:49 > epoch 1 updates 920 loss: 0.3518 lr: 0.0012 gnorm: 0.3450
04/05/2020 10:13:52 > epoch 1 updates 940 loss: 0.4200 lr: 0.0012 gnorm: 0.4724
04/05/2020 10:13:55 > epoch 1 updates 960 loss: 0.3458 lr: 0.0012 gnorm: 0.3578
04/05/2020 10:13:58 > epoch 1 updates 980 loss: 0.3367 lr: 0.0012 gnorm: 0.3640
04/05/2020 10:14:01 > epoch 1 updates 1000 loss: 0.3454 lr: 0.0012 gnorm: 0.3773
04/05/2020 10:14:03 > epoch 1 updates 1020 loss: 0.3307 lr: 0.0011 gnorm: 0.3280
04/05/2020 10:14:06 > epoch 1 updates 1040 loss: 0.3567 lr: 0.0011 gnorm: 0.3404
04/05/2020 10:14:09 > epoch 1 updates 1060 loss: 0.3687 lr: 0.0011 gnorm: 0.4031
04/05/2020 10:14:12 > epoch 1 updates 1080 loss: 0.3416 lr: 0.0011 gnorm: 0.3361
04/05/2020 10:14:15 > epoch 1 updates 1100 loss: 0.3159 lr: 0.0011 gnorm: 0.4082
04/05/2020 10:14:18 > epoch 1 updates 1120 loss: 0.3103 lr: 0.0011 gnorm: 0.3897
04/05/2020 10:14:21 > epoch 1 updates 1140 loss: 0.3953 lr: 0.0011 gnorm: 0.3875
04/05/2020 10:14:24 > epoch 1 updates 1160 loss: 0.3112 lr: 0.0011 gnorm: 0.3260
04/05/2020 10:14:27 > epoch 1 updates 1180 loss: 0.3593 lr: 0.0011 gnorm: 0.3574
04/05/2020 10:14:30 > epoch 1 updates 1200 loss: 0.3547 lr: 0.0011 gnorm: 0.4892
04/05/2020 10:14:33 > epoch 1 updates 1220 loss: 0.3523 lr: 0.0011 gnorm: 0.3727
04/05/2020 10:14:36 > epoch 1 updates 1240 loss: 0.4285 lr: 0.0011 gnorm: 0.4364
04/05/2020 10:14:39 > epoch 1 updates 1260 loss: 0.3815 lr: 0.0011 gnorm: 0.4695
04/05/2020 10:14:41 > epoch 1 updates 1280 loss: 0.3788 lr: 0.0011 gnorm: 0.3777
04/05/2020 10:14:44 > epoch 1 updates 1300 loss: 0.3183 lr: 0.0011 gnorm: 0.3155
04/05/2020 10:14:47 > epoch 1 updates 1320 loss: 0.3583 lr: 0.0011 gnorm: 0.3519
04/05/2020 10:14:50 > epoch 1 updates 1340 loss: 0.3304 lr: 0.0011 gnorm: 0.3554
04/05/2020 10:14:53 > epoch 1 updates 1360 loss: 0.3911 lr: 0.0011 gnorm: 0.3441
04/05/2020 10:14:56 > epoch 1 updates 1380 loss: 0.3309 lr: 0.0011 gnorm: 0.3393
04/05/2020 10:14:59 > epoch 1 updates 1400 loss: 0.3470 lr: 0.0011 gnorm: 0.5097
04/05/2020 10:15:02 > epoch 1 updates 1420 loss: 0.3391 lr: 0.0011 gnorm: 0.2989
04/05/2020 10:15:05 > epoch 1 updates 1440 loss: 0.3072 lr: 0.0011 gnorm: 0.3148
04/05/2020 10:15:08 > epoch 1 updates 1460 loss: 0.3139 lr: 0.0011 gnorm: 0.3166
04/05/2020 10:15:11 > epoch 1 updates 1480 loss: 0.3873 lr: 0.0011 gnorm: 0.3435
04/05/2020 10:15:14 > epoch 1 updates 1500 loss: 0.3339 lr: 0.0011 gnorm: 0.3091
04/05/2020 10:15:16 train loss: 0.3831 lr: 0.0012 gnorm: 0.4041 clip: 0
04/05/2020 10:15:16 valid loss: 0.3568 auc: 0.9177 f1: 0.8419 acc: 0.8370 [NEW BEST]
04/05/2020 10:15:16 Epoch: 2
04/05/2020 10:15:22 > epoch 2 updates 1520 loss: 0.3565 lr: 0.0011 gnorm: 0.4098
04/05/2020 10:15:25 > epoch 2 updates 1540 loss: 0.3317 lr: 0.0011 gnorm: 0.3548
04/05/2020 10:15:28 > epoch 2 updates 1560 loss: 0.3196 lr: 0.0011 gnorm: 0.3239
04/05/2020 10:15:31 > epoch 2 updates 1580 loss: 0.3172 lr: 0.0011 gnorm: 0.3339
04/05/2020 10:15:34 > epoch 2 updates 1600 loss: 0.3860 lr: 0.0011 gnorm: 0.6256
04/05/2020 10:15:37 > epoch 2 updates 1620 loss: 0.3270 lr: 0.0011 gnorm: 0.3011
04/05/2020 10:15:40 > epoch 2 updates 1640 loss: 0.3353 lr: 0.0011 gnorm: 0.3542
04/05/2020 10:15:43 > epoch 2 updates 1660 loss: 0.3274 lr: 0.0011 gnorm: 0.3826
04/05/2020 10:15:46 > epoch 2 updates 1680 loss: 0.3453 lr: 0.0011 gnorm: 0.4571
04/05/2020 10:15:49 > epoch 2 updates 1700 loss: 0.3461 lr: 0.0011 gnorm: 0.3377
04/05/2020 10:15:51 > epoch 2 updates 1720 loss: 0.3431 lr: 0.0011 gnorm: 0.5422
04/05/2020 10:15:54 > epoch 2 updates 1740 loss: 0.3321 lr: 0.0011 gnorm: 0.3397
04/05/2020 10:15:57 > epoch 2 updates 1760 loss: 0.2713 lr: 0.0011 gnorm: 0.3510
04/05/2020 10:16:00 > epoch 2 updates 1780 loss: 0.2922 lr: 0.0011 gnorm: 0.2921
04/05/2020 10:16:03 > epoch 2 updates 1800 loss: 0.3454 lr: 0.0011 gnorm: 0.3339
04/05/2020 10:16:06 > epoch 2 updates 1820 loss: 0.3372 lr: 0.0011 gnorm: 0.4105
04/05/2020 10:16:09 > epoch 2 updates 1840 loss: 0.3810 lr: 0.0011 gnorm: 0.3997
04/05/2020 10:16:12 > epoch 2 updates 1860 loss: 0.3540 lr: 0.0011 gnorm: 0.4351
04/05/2020 10:16:14 > epoch 2 updates 1880 loss: 0.4149 lr: 0.0011 gnorm: 0.5673
04/05/2020 10:16:17 > epoch 2 updates 1900 loss: 0.3658 lr: 0.0011 gnorm: 0.3478
04/05/2020 10:16:20 > epoch 2 updates 1920 loss: 0.3776 lr: 0.0011 gnorm: 0.3776
04/05/2020 10:16:23 > epoch 2 updates 1940 loss: 0.3359 lr: 0.0011 gnorm: 0.5745
04/05/2020 10:16:26 > epoch 2 updates 1960 loss: 0.3178 lr: 0.0011 gnorm: 0.3531
04/05/2020 10:16:29 > epoch 2 updates 1980 loss: 0.4005 lr: 0.0011 gnorm: 0.4948
04/05/2020 10:16:32 > epoch 2 updates 2000 loss: 0.3879 lr: 0.0011 gnorm: 0.4162
04/05/2020 10:16:35 train loss: 0.3468 lr: 0.0011 gnorm: 0.4060 clip: 0
04/05/2020 10:16:35 valid loss: 0.3533 auc: 0.9216 f1: 0.8467 acc: 0.8376 [NEW BEST]
04/05/2020 10:16:38 > epoch 2 updates 2020 loss: 0.3565 lr: 0.0011 gnorm: 0.4169
04/05/2020 10:16:41 > epoch 2 updates 2040 loss: 0.3478 lr: 0.0011 gnorm: 0.3054
04/05/2020 10:16:44 > epoch 2 updates 2060 loss: 0.3518 lr: 0.0011 gnorm: 0.3242
04/05/2020 10:16:47 > epoch 2 updates 2080 loss: 0.3020 lr: 0.0011 gnorm: 0.2808
04/05/2020 10:16:50 > epoch 2 updates 2100 loss: 0.3448 lr: 0.0011 gnorm: 0.3642
04/05/2020 10:16:52 > epoch 2 updates 2120 loss: 0.3033 lr: 0.0011 gnorm: 0.3101
04/05/2020 10:16:55 > epoch 2 updates 2140 loss: 0.3223 lr: 0.0011 gnorm: 0.3514
04/05/2020 10:16:58 > epoch 2 updates 2160 loss: 0.2710 lr: 0.0011 gnorm: 0.3044
04/05/2020 10:17:01 > epoch 2 updates 2180 loss: 0.3270 lr: 0.0011 gnorm: 0.4496
04/05/2020 10:17:04 > epoch 2 updates 2200 loss: 0.3162 lr: 0.0011 gnorm: 0.4129
04/05/2020 10:17:07 > epoch 2 updates 2220 loss: 0.3297 lr: 0.0011 gnorm: 0.3971
04/05/2020 10:17:10 > epoch 2 updates 2240 loss: 0.3003 lr: 0.0011 gnorm: 0.3359
04/05/2020 10:17:13 > epoch 2 updates 2260 loss: 0.3407 lr: 0.0011 gnorm: 0.3140
04/05/2020 10:17:16 > epoch 2 updates 2280 loss: 0.3322 lr: 0.0011 gnorm: 0.3039
04/05/2020 10:17:19 > epoch 2 updates 2300 loss: 0.3001 lr: 0.0011 gnorm: 0.3481
04/05/2020 10:17:22 > epoch 2 updates 2320 loss: 0.3820 lr: 0.0011 gnorm: 0.4099
04/05/2020 10:17:25 > epoch 2 updates 2340 loss: 0.3013 lr: 0.0011 gnorm: 0.3175
04/05/2020 10:17:28 > epoch 2 updates 2360 loss: 0.3086 lr: 0.0011 gnorm: 0.4090
04/05/2020 10:17:30 > epoch 2 updates 2380 loss: 0.3121 lr: 0.0011 gnorm: 0.3328
04/05/2020 10:17:33 > epoch 2 updates 2400 loss: 0.3311 lr: 0.0011 gnorm: 0.3839
04/05/2020 10:17:37 > epoch 2 updates 2420 loss: 0.3306 lr: 0.0011 gnorm: 0.3150
04/05/2020 10:17:39 > epoch 2 updates 2440 loss: 0.3359 lr: 0.0011 gnorm: 0.3372
04/05/2020 10:17:42 > epoch 2 updates 2460 loss: 0.3091 lr: 0.0011 gnorm: 0.3476
04/05/2020 10:17:45 > epoch 2 updates 2480 loss: 0.3602 lr: 0.0011 gnorm: 0.4395
04/05/2020 10:17:48 > epoch 2 updates 2500 loss: 0.3043 lr: 0.0011 gnorm: 0.3549
04/05/2020 10:17:51 > epoch 2 updates 2520 loss: 0.3556 lr: 0.0011 gnorm: 0.3975
04/05/2020 10:17:54 > epoch 2 updates 2540 loss: 0.3363 lr: 0.0011 gnorm: 0.4940
04/05/2020 10:17:57 > epoch 2 updates 2560 loss: 0.3195 lr: 0.0011 gnorm: 0.3205
04/05/2020 10:18:00 > epoch 2 updates 2580 loss: 0.2826 lr: 0.0011 gnorm: 0.3890
04/05/2020 10:18:03 > epoch 2 updates 2600 loss: 0.3467 lr: 0.0011 gnorm: 0.3428
04/05/2020 10:18:06 > epoch 2 updates 2620 loss: 0.3117 lr: 0.0011 gnorm: 0.3934
04/05/2020 10:18:09 > epoch 2 updates 2640 loss: 0.3207 lr: 0.0011 gnorm: 0.3903
04/05/2020 10:18:12 > epoch 2 updates 2660 loss: 0.2773 lr: 0.0011 gnorm: 0.2737
04/05/2020 10:18:15 > epoch 2 updates 2680 loss: 0.3750 lr: 0.0011 gnorm: 0.4213
04/05/2020 10:18:18 > epoch 2 updates 2700 loss: 0.2329 lr: 0.0011 gnorm: 0.3046
04/05/2020 10:18:21 > epoch 2 updates 2720 loss: 0.2906 lr: 0.0011 gnorm: 0.2538
04/05/2020 10:18:24 > epoch 2 updates 2740 loss: 0.3535 lr: 0.0011 gnorm: 0.3760
04/05/2020 10:18:27 > epoch 2 updates 2760 loss: 0.3255 lr: 0.0011 gnorm: 0.3911
04/05/2020 10:18:30 > epoch 2 updates 2780 loss: 0.3516 lr: 0.0011 gnorm: 0.3640
04/05/2020 10:18:33 > epoch 2 updates 2800 loss: 0.2423 lr: 0.0011 gnorm: 0.2867
04/05/2020 10:18:36 > epoch 2 updates 2820 loss: 0.3131 lr: 0.0011 gnorm: 0.2851
04/05/2020 10:18:38 > epoch 2 updates 2840 loss: 0.3408 lr: 0.0011 gnorm: 0.3383
04/05/2020 10:18:41 > epoch 2 updates 2860 loss: 0.3377 lr: 0.0011 gnorm: 0.3046
04/05/2020 10:18:44 > epoch 2 updates 2880 loss: 0.3341 lr: 0.0011 gnorm: 0.3856
04/05/2020 10:18:47 > epoch 2 updates 2900 loss: 0.2968 lr: 0.0011 gnorm: 0.3059
04/05/2020 10:18:50 > epoch 2 updates 2920 loss: 0.3024 lr: 0.0011 gnorm: 0.3104
04/05/2020 10:18:53 > epoch 2 updates 2940 loss: 0.3183 lr: 0.0011 gnorm: 0.4059
04/05/2020 10:18:56 > epoch 2 updates 2960 loss: 0.2756 lr: 0.0011 gnorm: 0.2997
04/05/2020 10:18:59 > epoch 2 updates 2980 loss: 0.2776 lr: 0.0011 gnorm: 0.3009
04/05/2020 10:19:02 > epoch 2 updates 3000 loss: 0.3005 lr: 0.0011 gnorm: 0.3018
04/05/2020 10:19:05 train loss: 0.3177 lr: 0.0011 gnorm: 0.3487 clip: 0
04/05/2020 10:19:05 valid loss: 0.3262 auc: 0.9321 f1: 0.8571 acc: 0.8526 [NEW BEST]
04/05/2020 10:19:05 Epoch: 3
04/05/2020 10:19:10 > epoch 3 updates 3020 loss: 0.3336 lr: 0.0010 gnorm: 0.3511
04/05/2020 10:19:13 > epoch 3 updates 3040 loss: 0.2615 lr: 0.0010 gnorm: 0.3624
04/05/2020 10:19:16 > epoch 3 updates 3060 loss: 0.3207 lr: 0.0010 gnorm: 0.4396
04/05/2020 10:19:19 > epoch 3 updates 3080 loss: 0.3249 lr: 0.0010 gnorm: 0.3321
04/05/2020 10:19:22 > epoch 3 updates 3100 loss: 0.2784 lr: 0.0010 gnorm: 0.3716
04/05/2020 10:19:25 > epoch 3 updates 3120 loss: 0.2639 lr: 0.0010 gnorm: 0.2996
04/05/2020 10:19:28 > epoch 3 updates 3140 loss: 0.2976 lr: 0.0010 gnorm: 0.2792
04/05/2020 10:19:31 > epoch 3 updates 3160 loss: 0.2773 lr: 0.0010 gnorm: 0.3399
04/05/2020 10:19:34 > epoch 3 updates 3180 loss: 0.2969 lr: 0.0010 gnorm: 0.3255
04/05/2020 10:19:37 > epoch 3 updates 3200 loss: 0.2437 lr: 0.0010 gnorm: 0.3178
04/05/2020 10:19:40 > epoch 3 updates 3220 loss: 0.2515 lr: 0.0010 gnorm: 0.2854
04/05/2020 10:19:43 > epoch 3 updates 3240 loss: 0.3277 lr: 0.0010 gnorm: 0.4221
04/05/2020 10:19:46 > epoch 3 updates 3260 loss: 0.3063 lr: 0.0010 gnorm: 0.4111
04/05/2020 10:19:49 > epoch 3 updates 3280 loss: 0.3151 lr: 0.0010 gnorm: 0.3111
04/05/2020 10:19:52 > epoch 3 updates 3300 loss: 0.3010 lr: 0.0010 gnorm: 0.3751
04/05/2020 10:19:55 > epoch 3 updates 3320 loss: 0.2827 lr: 0.0010 gnorm: 0.2746
04/05/2020 10:19:57 > epoch 3 updates 3340 loss: 0.2874 lr: 0.0010 gnorm: 0.3962
04/05/2020 10:20:00 > epoch 3 updates 3360 loss: 0.2524 lr: 0.0010 gnorm: 0.2946
04/05/2020 10:20:03 > epoch 3 updates 3380 loss: 0.2628 lr: 0.0010 gnorm: 0.3585
04/05/2020 10:20:06 > epoch 3 updates 3400 loss: 0.2824 lr: 0.0010 gnorm: 0.2968
04/05/2020 10:20:09 > epoch 3 updates 3420 loss: 0.2922 lr: 0.0010 gnorm: 0.3339
04/05/2020 10:20:12 > epoch 3 updates 3440 loss: 0.3057 lr: 0.0010 gnorm: 0.3711
04/05/2020 10:20:15 > epoch 3 updates 3460 loss: 0.2716 lr: 0.0010 gnorm: 0.2888
04/05/2020 10:20:18 > epoch 3 updates 3480 loss: 0.3069 lr: 0.0010 gnorm: 0.3012
04/05/2020 10:20:21 > epoch 3 updates 3500 loss: 0.2872 lr: 0.0010 gnorm: 0.3040
04/05/2020 10:20:24 > epoch 3 updates 3520 loss: 0.2867 lr: 0.0010 gnorm: 0.2611
04/05/2020 10:20:27 > epoch 3 updates 3540 loss: 0.2987 lr: 0.0010 gnorm: 0.2718
04/05/2020 10:20:30 > epoch 3 updates 3560 loss: 0.3396 lr: 0.0010 gnorm: 0.3296
04/05/2020 10:20:33 > epoch 3 updates 3580 loss: 0.2432 lr: 0.0010 gnorm: 0.3736
04/05/2020 10:20:36 > epoch 3 updates 3600 loss: 0.3099 lr: 0.0010 gnorm: 0.4108
04/05/2020 10:20:39 > epoch 3 updates 3620 loss: 0.2974 lr: 0.0010 gnorm: 0.2772
04/05/2020 10:20:42 > epoch 3 updates 3640 loss: 0.3162 lr: 0.0010 gnorm: 0.3191
04/05/2020 10:20:45 > epoch 3 updates 3660 loss: 0.2538 lr: 0.0010 gnorm: 0.2914
04/05/2020 10:20:48 > epoch 3 updates 3680 loss: 0.3062 lr: 0.0010 gnorm: 0.3132
04/05/2020 10:20:51 > epoch 3 updates 3700 loss: 0.3162 lr: 0.0010 gnorm: 0.4749
04/05/2020 10:20:54 > epoch 3 updates 3720 loss: 0.2750 lr: 0.0010 gnorm: 0.2844
04/05/2020 10:20:57 > epoch 3 updates 3740 loss: 0.2774 lr: 0.0010 gnorm: 0.2887
04/05/2020 10:21:00 > epoch 3 updates 3760 loss: 0.3103 lr: 0.0010 gnorm: 0.3087
04/05/2020 10:21:03 > epoch 3 updates 3780 loss: 0.2601 lr: 0.0010 gnorm: 0.3170
04/05/2020 10:21:05 > epoch 3 updates 3800 loss: 0.3044 lr: 0.0010 gnorm: 0.4074
04/05/2020 10:21:08 > epoch 3 updates 3820 loss: 0.3271 lr: 0.0010 gnorm: 0.3077
04/05/2020 10:21:11 > epoch 3 updates 3840 loss: 0.2693 lr: 0.0010 gnorm: 0.2840
04/05/2020 10:21:14 > epoch 3 updates 3860 loss: 0.2652 lr: 0.0010 gnorm: 0.2788
04/05/2020 10:21:17 > epoch 3 updates 3880 loss: 0.2768 lr: 0.0010 gnorm: 0.2639
04/05/2020 10:21:21 > epoch 3 updates 3900 loss: 0.3183 lr: 0.0010 gnorm: 0.2660
04/05/2020 10:21:23 > epoch 3 updates 3920 loss: 0.3068 lr: 0.0010 gnorm: 0.3898
04/05/2020 10:21:27 > epoch 3 updates 3940 loss: 0.2939 lr: 0.0010 gnorm: 0.3578
04/05/2020 10:21:30 > epoch 3 updates 3960 loss: 0.2650 lr: 0.0010 gnorm: 0.2807
04/05/2020 10:21:32 > epoch 3 updates 3980 loss: 0.2137 lr: 0.0010 gnorm: 0.3006
04/05/2020 10:21:35 > epoch 3 updates 4000 loss: 0.2825 lr: 0.0010 gnorm: 0.3646
04/05/2020 10:21:38 train loss: 0.2884 lr: 0.0010 gnorm: 0.3279 clip: 0
04/05/2020 10:21:38 valid loss: 0.3198 auc: 0.9364 f1: 0.8615 acc: 0.8608 [NEW BEST]
04/05/2020 10:21:41 > epoch 3 updates 4020 loss: 0.2700 lr: 9.7741e-04 gnorm: 0.3085
04/05/2020 10:21:44 > epoch 3 updates 4040 loss: 0.3259 lr: 9.7741e-04 gnorm: 0.3152
04/05/2020 10:21:47 > epoch 3 updates 4060 loss: 0.3027 lr: 9.7741e-04 gnorm: 0.3141
04/05/2020 10:21:49 > epoch 3 updates 4080 loss: 0.2958 lr: 9.7741e-04 gnorm: 0.3241
04/05/2020 10:21:52 > epoch 3 updates 4100 loss: 0.2425 lr: 9.7741e-04 gnorm: 0.2956
04/05/2020 10:21:55 > epoch 3 updates 4120 loss: 0.3249 lr: 9.7741e-04 gnorm: 0.3316
04/05/2020 10:21:58 > epoch 3 updates 4140 loss: 0.2764 lr: 9.7741e-04 gnorm: 0.2843
04/05/2020 10:22:01 > epoch 3 updates 4160 loss: 0.2890 lr: 9.7741e-04 gnorm: 0.3659
04/05/2020 10:22:04 > epoch 3 updates 4180 loss: 0.2328 lr: 9.7741e-04 gnorm: 0.2772
04/05/2020 10:22:07 > epoch 3 updates 4200 loss: 0.2997 lr: 9.7741e-04 gnorm: 0.3345
04/05/2020 10:22:10 > epoch 3 updates 4220 loss: 0.2704 lr: 9.7741e-04 gnorm: 0.3092
04/05/2020 10:22:13 > epoch 3 updates 4240 loss: 0.2777 lr: 9.7741e-04 gnorm: 0.2837
04/05/2020 10:22:15 > epoch 3 updates 4260 loss: 0.2340 lr: 9.7741e-04 gnorm: 0.2435
04/05/2020 10:22:18 > epoch 3 updates 4280 loss: 0.2772 lr: 9.7741e-04 gnorm: 0.3279
04/05/2020 10:22:21 > epoch 3 updates 4300 loss: 0.2788 lr: 9.7741e-04 gnorm: 0.2747
04/05/2020 10:22:24 > epoch 3 updates 4320 loss: 0.3112 lr: 9.7741e-04 gnorm: 0.3175
04/05/2020 10:22:27 > epoch 3 updates 4340 loss: 0.2566 lr: 9.7741e-04 gnorm: 0.2676
04/05/2020 10:22:30 > epoch 3 updates 4360 loss: 0.3481 lr: 9.7741e-04 gnorm: 0.4247
04/05/2020 10:22:33 > epoch 3 updates 4380 loss: 0.2676 lr: 9.7741e-04 gnorm: 0.3319
04/05/2020 10:22:36 > epoch 3 updates 4400 loss: 0.3470 lr: 9.7741e-04 gnorm: 0.4325
04/05/2020 10:22:39 > epoch 3 updates 4420 loss: 0.3125 lr: 9.7741e-04 gnorm: 0.3345
04/05/2020 10:22:42 > epoch 3 updates 4440 loss: 0.2996 lr: 9.7741e-04 gnorm: 0.3194
04/05/2020 10:22:45 > epoch 3 updates 4460 loss: 0.2640 lr: 9.7741e-04 gnorm: 0.2529
04/05/2020 10:22:48 > epoch 3 updates 4480 loss: 0.2904 lr: 9.7741e-04 gnorm: 0.3511
04/05/2020 10:22:51 > epoch 3 updates 4500 loss: 0.3889 lr: 9.7741e-04 gnorm: 0.3972
04/05/2020 10:22:54 train loss: 0.2921 lr: 9.7741e-04 gnorm: 0.3217 clip: 0
04/05/2020 10:22:54 valid loss: 0.3261 auc: 0.9359 f1: 0.8527 acc: 0.8557 [BEST: 0.8608]
04/05/2020 10:22:54 Epoch: 4
04/05/2020 10:23:00 > epoch 4 updates 4520 loss: 0.3190 lr: 9.7741e-04 gnorm: 0.5541
04/05/2020 10:23:03 > epoch 4 updates 4540 loss: 0.2720 lr: 9.7741e-04 gnorm: 0.3509
04/05/2020 10:23:06 > epoch 4 updates 4560 loss: 0.2503 lr: 9.7741e-04 gnorm: 0.3804
04/05/2020 10:23:08 > epoch 4 updates 4580 loss: 0.2584 lr: 9.7741e-04 gnorm: 0.2488
04/05/2020 10:23:11 > epoch 4 updates 4600 loss: 0.2797 lr: 9.7741e-04 gnorm: 0.2863
04/05/2020 10:23:14 > epoch 4 updates 4620 loss: 0.3185 lr: 9.7741e-04 gnorm: 0.4305
04/05/2020 10:23:17 > epoch 4 updates 4640 loss: 0.2780 lr: 9.7741e-04 gnorm: 0.3394
04/05/2020 10:23:20 > epoch 4 updates 4660 loss: 0.2730 lr: 9.7741e-04 gnorm: 0.3002
04/05/2020 10:23:23 > epoch 4 updates 4680 loss: 0.2388 lr: 9.7741e-04 gnorm: 0.2679
04/05/2020 10:23:26 > epoch 4 updates 4700 loss: 0.3028 lr: 9.7741e-04 gnorm: 0.3076
04/05/2020 10:23:29 > epoch 4 updates 4720 loss: 0.2498 lr: 9.7741e-04 gnorm: 0.2633
04/05/2020 10:23:32 > epoch 4 updates 4740 loss: 0.2697 lr: 9.7741e-04 gnorm: 0.3344
04/05/2020 10:23:35 > epoch 4 updates 4760 loss: 0.2506 lr: 9.7741e-04 gnorm: 0.2575
04/05/2020 10:23:38 > epoch 4 updates 4780 loss: 0.3211 lr: 9.7741e-04 gnorm: 0.3705
04/05/2020 10:23:41 > epoch 4 updates 4800 loss: 0.3477 lr: 9.7741e-04 gnorm: 0.4191
04/05/2020 10:23:44 > epoch 4 updates 4820 loss: 0.2525 lr: 9.7741e-04 gnorm: 0.3207
04/05/2020 10:23:47 > epoch 4 updates 4840 loss: 0.2954 lr: 9.7741e-04 gnorm: 0.3201
04/05/2020 10:23:50 > epoch 4 updates 4860 loss: 0.2496 lr: 9.7741e-04 gnorm: 0.2712
04/05/2020 10:23:53 > epoch 4 updates 4880 loss: 0.2763 lr: 9.7741e-04 gnorm: 0.3382
04/05/2020 10:23:56 > epoch 4 updates 4900 loss: 0.2920 lr: 9.7741e-04 gnorm: 0.2870
04/05/2020 10:23:58 > epoch 4 updates 4920 loss: 0.2160 lr: 9.7741e-04 gnorm: 0.2528
04/05/2020 10:24:01 > epoch 4 updates 4940 loss: 0.2429 lr: 9.7741e-04 gnorm: 0.2610
04/05/2020 10:24:04 > epoch 4 updates 4960 loss: 0.3160 lr: 9.7741e-04 gnorm: 0.3582
04/05/2020 10:24:07 > epoch 4 updates 4980 loss: 0.2619 lr: 9.7741e-04 gnorm: 0.3336
04/05/2020 10:24:10 > epoch 4 updates 5000 loss: 0.1828 lr: 9.7741e-04 gnorm: 0.2560
04/05/2020 10:24:13 > epoch 4 updates 5020 loss: 0.3312 lr: 9.2854e-04 gnorm: 0.3808
04/05/2020 10:24:16 > epoch 4 updates 5040 loss: 0.2516 lr: 9.2854e-04 gnorm: 0.2992
04/05/2020 10:24:19 > epoch 4 updates 5060 loss: 0.2483 lr: 9.2854e-04 gnorm: 0.3027
04/05/2020 10:24:22 > epoch 4 updates 5080 loss: 0.3289 lr: 9.2854e-04 gnorm: 0.4235
04/05/2020 10:24:25 > epoch 4 updates 5100 loss: 0.2643 lr: 9.2854e-04 gnorm: 0.2823
04/05/2020 10:24:28 > epoch 4 updates 5120 loss: 0.2581 lr: 9.2854e-04 gnorm: 0.3363
04/05/2020 10:24:31 > epoch 4 updates 5140 loss: 0.2711 lr: 9.2854e-04 gnorm: 0.3040
04/05/2020 10:24:34 > epoch 4 updates 5160 loss: 0.2430 lr: 9.2854e-04 gnorm: 0.2722
04/05/2020 10:24:37 > epoch 4 updates 5180 loss: 0.2737 lr: 9.2854e-04 gnorm: 0.2921
04/05/2020 10:24:40 > epoch 4 updates 5200 loss: 0.2521 lr: 9.2854e-04 gnorm: 0.2968
04/05/2020 10:24:43 > epoch 4 updates 5220 loss: 0.2565 lr: 9.2854e-04 gnorm: 0.3056
04/05/2020 10:24:46 > epoch 4 updates 5240 loss: 0.2169 lr: 9.2854e-04 gnorm: 0.2718
04/05/2020 10:24:49 > epoch 4 updates 5260 loss: 0.2128 lr: 9.2854e-04 gnorm: 0.2669
04/05/2020 10:24:52 > epoch 4 updates 5280 loss: 0.2170 lr: 9.2854e-04 gnorm: 0.3024
04/05/2020 10:24:55 > epoch 4 updates 5300 loss: 0.2878 lr: 9.2854e-04 gnorm: 0.3395
04/05/2020 10:24:58 > epoch 4 updates 5320 loss: 0.2178 lr: 9.2854e-04 gnorm: 0.2291
04/05/2020 10:25:01 > epoch 4 updates 5340 loss: 0.2555 lr: 9.2854e-04 gnorm: 0.2610
04/05/2020 10:25:04 > epoch 4 updates 5360 loss: 0.2406 lr: 9.2854e-04 gnorm: 0.3332
04/05/2020 10:25:07 > epoch 4 updates 5380 loss: 0.2565 lr: 9.2854e-04 gnorm: 0.3422
04/05/2020 10:25:10 > epoch 4 updates 5400 loss: 0.2845 lr: 9.2854e-04 gnorm: 0.3016
04/05/2020 10:25:13 > epoch 4 updates 5420 loss: 0.2402 lr: 9.2854e-04 gnorm: 0.2489
04/05/2020 10:25:16 > epoch 4 updates 5440 loss: 0.2816 lr: 9.2854e-04 gnorm: 0.3346
04/05/2020 10:25:19 > epoch 4 updates 5460 loss: 0.2504 lr: 9.2854e-04 gnorm: 0.3245
04/05/2020 10:25:22 > epoch 4 updates 5480 loss: 0.2917 lr: 9.2854e-04 gnorm: 0.2887
04/05/2020 10:25:25 > epoch 4 updates 5500 loss: 0.2743 lr: 9.2854e-04 gnorm: 0.3519
04/05/2020 10:25:28 > epoch 4 updates 5520 loss: 0.2435 lr: 9.2854e-04 gnorm: 0.2797
04/05/2020 10:25:31 > epoch 4 updates 5540 loss: 0.2815 lr: 9.2854e-04 gnorm: 0.3065
04/05/2020 10:25:33 > epoch 4 updates 5560 loss: 0.3032 lr: 9.2854e-04 gnorm: 0.2965
04/05/2020 10:25:37 > epoch 4 updates 5580 loss: 0.3092 lr: 9.2854e-04 gnorm: 0.3167
04/05/2020 10:25:39 > epoch 4 updates 5600 loss: 0.2454 lr: 9.2854e-04 gnorm: 0.2358
04/05/2020 10:25:42 > epoch 4 updates 5620 loss: 0.2738 lr: 9.2854e-04 gnorm: 0.3195
04/05/2020 10:25:45 > epoch 4 updates 5640 loss: 0.3458 lr: 9.2854e-04 gnorm: 0.4261
04/05/2020 10:25:48 > epoch 4 updates 5660 loss: 0.2812 lr: 9.2854e-04 gnorm: 0.3037
04/05/2020 10:25:51 > epoch 4 updates 5680 loss: 0.2167 lr: 9.2854e-04 gnorm: 0.2624
04/05/2020 10:25:54 > epoch 4 updates 5700 loss: 0.2724 lr: 9.2854e-04 gnorm: 0.3436
04/05/2020 10:25:57 > epoch 4 updates 5720 loss: 0.2575 lr: 9.2854e-04 gnorm: 0.3106
04/05/2020 10:26:00 > epoch 4 updates 5740 loss: 0.3171 lr: 9.2854e-04 gnorm: 0.3474
04/05/2020 10:26:02 > epoch 4 updates 5760 loss: 0.2542 lr: 9.2854e-04 gnorm: 0.3015
04/05/2020 10:26:05 > epoch 4 updates 5780 loss: 0.2704 lr: 9.2854e-04 gnorm: 0.3114
04/05/2020 10:26:08 > epoch 4 updates 5800 loss: 0.3250 lr: 9.2854e-04 gnorm: 0.3715
04/05/2020 10:26:11 > epoch 4 updates 5820 loss: 0.2827 lr: 9.2854e-04 gnorm: 0.3066
04/05/2020 10:26:14 > epoch 4 updates 5840 loss: 0.2874 lr: 9.2854e-04 gnorm: 0.3126
04/05/2020 10:26:17 > epoch 4 updates 5860 loss: 0.2076 lr: 9.2854e-04 gnorm: 0.2321
04/05/2020 10:26:20 > epoch 4 updates 5880 loss: 0.2617 lr: 9.2854e-04 gnorm: 0.3035
04/05/2020 10:26:23 > epoch 4 updates 5900 loss: 0.2846 lr: 9.2854e-04 gnorm: 0.3618
04/05/2020 10:26:26 > epoch 4 updates 5920 loss: 0.2546 lr: 9.2854e-04 gnorm: 0.3136
04/05/2020 10:26:29 > epoch 4 updates 5940 loss: 0.2935 lr: 9.2854e-04 gnorm: 0.2630
04/05/2020 10:26:32 > epoch 4 updates 5960 loss: 0.2588 lr: 9.2854e-04 gnorm: 0.2638
04/05/2020 10:26:34 > epoch 4 updates 5980 loss: 0.2446 lr: 9.2854e-04 gnorm: 0.2825
04/05/2020 10:26:37 > epoch 4 updates 6000 loss: 0.2758 lr: 9.2854e-04 gnorm: 0.2924
04/05/2020 10:26:40 train loss: 0.2687 lr: 9.4095e-04 gnorm: 0.3107 clip: 0
04/05/2020 10:26:40 valid loss: 0.2983 auc: 0.9436 f1: 0.8750 acc: 0.8695 [NEW BEST]
04/05/2020 10:26:43 valid loss: 0.2967 auc: 0.9437 f1: 0.8750 acc: 0.8712 [NEW BEST]
04/05/2020 10:26:43 Epoch: 5
04/05/2020 10:26:48 > epoch 5 updates 6020 loss: 0.1724 lr: 8.8211e-04 gnorm: 0.2864
04/05/2020 10:26:51 > epoch 5 updates 6040 loss: 0.2167 lr: 8.8211e-04 gnorm: 0.2647
04/05/2020 10:26:54 > epoch 5 updates 6060 loss: 0.2564 lr: 8.8211e-04 gnorm: 0.3292
04/05/2020 10:26:57 > epoch 5 updates 6080 loss: 0.2520 lr: 8.8211e-04 gnorm: 0.3006
04/05/2020 10:27:00 > epoch 5 updates 6100 loss: 0.2551 lr: 8.8211e-04 gnorm: 0.3039
04/05/2020 10:27:03 > epoch 5 updates 6120 loss: 0.2181 lr: 8.8211e-04 gnorm: 0.2969
04/05/2020 10:27:06 > epoch 5 updates 6140 loss: 0.2421 lr: 8.8211e-04 gnorm: 0.3359
04/05/2020 10:27:09 > epoch 5 updates 6160 loss: 0.2477 lr: 8.8211e-04 gnorm: 0.2934
04/05/2020 10:27:12 > epoch 5 updates 6180 loss: 0.2453 lr: 8.8211e-04 gnorm: 0.3601
04/05/2020 10:27:15 > epoch 5 updates 6200 loss: 0.2893 lr: 8.8211e-04 gnorm: 0.3731
04/05/2020 10:27:18 > epoch 5 updates 6220 loss: 0.2093 lr: 8.8211e-04 gnorm: 0.2749
04/05/2020 10:27:21 > epoch 5 updates 6240 loss: 0.1646 lr: 8.8211e-04 gnorm: 0.2773
04/05/2020 10:27:24 > epoch 5 updates 6260 loss: 0.2123 lr: 8.8211e-04 gnorm: 0.3537
04/05/2020 10:27:27 > epoch 5 updates 6280 loss: 0.2041 lr: 8.8211e-04 gnorm: 0.2652
04/05/2020 10:27:29 > epoch 5 updates 6300 loss: 0.2185 lr: 8.8211e-04 gnorm: 0.3041
04/05/2020 10:27:32 > epoch 5 updates 6320 loss: 0.2529 lr: 8.8211e-04 gnorm: 0.4192
04/05/2020 10:27:35 > epoch 5 updates 6340 loss: 0.2457 lr: 8.8211e-04 gnorm: 0.2993
04/05/2020 10:27:38 > epoch 5 updates 6360 loss: 0.2873 lr: 8.8211e-04 gnorm: 0.3315
04/05/2020 10:27:41 > epoch 5 updates 6380 loss: 0.2326 lr: 8.8211e-04 gnorm: 0.3118
04/05/2020 10:27:44 > epoch 5 updates 6400 loss: 0.2882 lr: 8.8211e-04 gnorm: 0.3592
04/05/2020 10:27:47 > epoch 5 updates 6420 loss: 0.2613 lr: 8.8211e-04 gnorm: 0.2731
04/05/2020 10:27:50 > epoch 5 updates 6440 loss: 0.1986 lr: 8.8211e-04 gnorm: 0.2527
04/05/2020 10:27:53 > epoch 5 updates 6460 loss: 0.2087 lr: 8.8211e-04 gnorm: 0.2886
04/05/2020 10:27:56 > epoch 5 updates 6480 loss: 0.2440 lr: 8.8211e-04 gnorm: 0.2528
04/05/2020 10:27:59 > epoch 5 updates 6500 loss: 0.2589 lr: 8.8211e-04 gnorm: 0.2810
04/05/2020 10:28:02 > epoch 5 updates 6520 loss: 0.2101 lr: 8.8211e-04 gnorm: 0.2682
04/05/2020 10:28:05 > epoch 5 updates 6540 loss: 0.2694 lr: 8.8211e-04 gnorm: 0.3242
04/05/2020 10:28:08 > epoch 5 updates 6560 loss: 0.3020 lr: 8.8211e-04 gnorm: 0.3477
04/05/2020 10:28:11 > epoch 5 updates 6580 loss: 0.2354 lr: 8.8211e-04 gnorm: 0.2813
04/05/2020 10:28:14 > epoch 5 updates 6600 loss: 0.2982 lr: 8.8211e-04 gnorm: 0.3124
04/05/2020 10:28:17 > epoch 5 updates 6620 loss: 0.2159 lr: 8.8211e-04 gnorm: 0.3464
04/05/2020 10:28:20 > epoch 5 updates 6640 loss: 0.2450 lr: 8.8211e-04 gnorm: 0.2583
04/05/2020 10:28:22 > epoch 5 updates 6660 loss: 0.2411 lr: 8.8211e-04 gnorm: 0.3014
04/05/2020 10:28:25 > epoch 5 updates 6680 loss: 0.2833 lr: 8.8211e-04 gnorm: 0.3152
04/05/2020 10:28:28 > epoch 5 updates 6700 loss: 0.2652 lr: 8.8211e-04 gnorm: 0.3174
04/05/2020 10:28:31 > epoch 5 updates 6720 loss: 0.1821 lr: 8.8211e-04 gnorm: 0.2193
04/05/2020 10:28:34 > epoch 5 updates 6740 loss: 0.2659 lr: 8.8211e-04 gnorm: 0.3063
04/05/2020 10:28:37 > epoch 5 updates 6760 loss: 0.2555 lr: 8.8211e-04 gnorm: 0.3173
04/05/2020 10:28:40 > epoch 5 updates 6780 loss: 0.2237 lr: 8.8211e-04 gnorm: 0.2959
04/05/2020 10:28:43 > epoch 5 updates 6800 loss: 0.2381 lr: 8.8211e-04 gnorm: 0.2586
04/05/2020 10:28:46 > epoch 5 updates 6820 loss: 0.2498 lr: 8.8211e-04 gnorm: 0.2631
04/05/2020 10:28:49 > epoch 5 updates 6840 loss: 0.2902 lr: 8.8211e-04 gnorm: 0.3218
04/05/2020 10:28:51 > epoch 5 updates 6860 loss: 0.2302 lr: 8.8211e-04 gnorm: 0.2512
04/05/2020 10:28:54 > epoch 5 updates 6880 loss: 0.2437 lr: 8.8211e-04 gnorm: 0.2855
04/05/2020 10:28:57 > epoch 5 updates 6900 loss: 0.2603 lr: 8.8211e-04 gnorm: 0.2811
04/05/2020 10:29:00 > epoch 5 updates 6920 loss: 0.2345 lr: 8.8211e-04 gnorm: 0.3192
04/05/2020 10:29:03 > epoch 5 updates 6940 loss: 0.2337 lr: 8.8211e-04 gnorm: 0.2758
04/05/2020 10:29:06 > epoch 5 updates 6960 loss: 0.2060 lr: 8.8211e-04 gnorm: 0.3292
04/05/2020 10:29:09 > epoch 5 updates 6980 loss: 0.2648 lr: 8.8211e-04 gnorm: 0.3032
04/05/2020 10:29:12 > epoch 5 updates 7000 loss: 0.2793 lr: 8.8211e-04 gnorm: 0.3297
04/05/2020 10:29:15 > epoch 5 updates 7020 loss: 0.3143 lr: 8.3800e-04 gnorm: 0.3315
04/05/2020 10:29:18 > epoch 5 updates 7040 loss: 0.1896 lr: 8.3800e-04 gnorm: 0.2432
04/05/2020 10:29:21 > epoch 5 updates 7060 loss: 0.2682 lr: 8.3800e-04 gnorm: 0.3642
04/05/2020 10:29:24 > epoch 5 updates 7080 loss: 0.2791 lr: 8.3800e-04 gnorm: 0.2624
04/05/2020 10:29:27 > epoch 5 updates 7100 loss: 0.2223 lr: 8.3800e-04 gnorm: 0.2478
04/05/2020 10:29:30 > epoch 5 updates 7120 loss: 0.2081 lr: 8.3800e-04 gnorm: 0.2408
04/05/2020 10:29:33 > epoch 5 updates 7140 loss: 0.2522 lr: 8.3800e-04 gnorm: 0.2804
04/05/2020 10:29:36 > epoch 5 updates 7160 loss: 0.2529 lr: 8.3800e-04 gnorm: 0.4084
04/05/2020 10:29:39 > epoch 5 updates 7180 loss: 0.2110 lr: 8.3800e-04 gnorm: 0.2299
04/05/2020 10:29:42 > epoch 5 updates 7200 loss: 0.2338 lr: 8.3800e-04 gnorm: 0.2655
04/05/2020 10:29:45 > epoch 5 updates 7220 loss: 0.2384 lr: 8.3800e-04 gnorm: 0.3024
04/05/2020 10:29:48 > epoch 5 updates 7240 loss: 0.2604 lr: 8.3800e-04 gnorm: 0.2767
04/05/2020 10:29:50 > epoch 5 updates 7260 loss: 0.2177 lr: 8.3800e-04 gnorm: 0.2633
04/05/2020 10:29:53 > epoch 5 updates 7280 loss: 0.2324 lr: 8.3800e-04 gnorm: 0.2683
04/05/2020 10:29:56 > epoch 5 updates 7300 loss: 0.2346 lr: 8.3800e-04 gnorm: 0.3401
04/05/2020 10:29:59 > epoch 5 updates 7320 loss: 0.2376 lr: 8.3800e-04 gnorm: 0.2702
04/05/2020 10:30:02 > epoch 5 updates 7340 loss: 0.2191 lr: 8.3800e-04 gnorm: 0.2838
04/05/2020 10:30:05 > epoch 5 updates 7360 loss: 0.2201 lr: 8.3800e-04 gnorm: 0.2576
04/05/2020 10:30:08 > epoch 5 updates 7380 loss: 0.1910 lr: 8.3800e-04 gnorm: 0.2525
04/05/2020 10:30:11 > epoch 5 updates 7400 loss: 0.2168 lr: 8.3800e-04 gnorm: 0.2670
04/05/2020 10:30:14 > epoch 5 updates 7420 loss: 0.2597 lr: 8.3800e-04 gnorm: 0.3181
04/05/2020 10:30:17 > epoch 5 updates 7440 loss: 0.3110 lr: 8.3800e-04 gnorm: 0.3175
04/05/2020 10:30:20 > epoch 5 updates 7460 loss: 0.2419 lr: 8.3800e-04 gnorm: 0.2485
04/05/2020 10:30:23 > epoch 5 updates 7480 loss: 0.2375 lr: 8.3800e-04 gnorm: 0.3159
04/05/2020 10:30:26 > epoch 5 updates 7500 loss: 0.2622 lr: 8.3800e-04 gnorm: 0.2902
04/05/2020 10:30:30 train loss: 0.2419 lr: 8.6360e-04 gnorm: 0.2949 clip: 0
04/05/2020 10:30:30 valid loss: 0.2925 auc: 0.9455 f1: 0.8761 acc: 0.8731 [NEW BEST]
04/05/2020 10:30:30 Epoch: 6
04/05/2020 10:30:34 > epoch 6 updates 7520 loss: 0.2483 lr: 8.3800e-04 gnorm: 0.3056
04/05/2020 10:30:37 > epoch 6 updates 7540 loss: 0.2260 lr: 8.3800e-04 gnorm: 0.3100
04/05/2020 10:30:40 > epoch 6 updates 7560 loss: 0.2053 lr: 8.3800e-04 gnorm: 0.2845
04/05/2020 10:30:43 > epoch 6 updates 7580 loss: 0.2407 lr: 8.3800e-04 gnorm: 0.3121
04/05/2020 10:30:46 > epoch 6 updates 7600 loss: 0.2141 lr: 8.3800e-04 gnorm: 0.2810
04/05/2020 10:30:49 > epoch 6 updates 7620 loss: 0.2392 lr: 8.3800e-04 gnorm: 0.2803
04/05/2020 10:30:52 > epoch 6 updates 7640 loss: 0.1827 lr: 8.3800e-04 gnorm: 0.2647
04/05/2020 10:30:55 > epoch 6 updates 7660 loss: 0.2437 lr: 8.3800e-04 gnorm: 0.2889
04/05/2020 10:30:58 > epoch 6 updates 7680 loss: 0.2646 lr: 8.3800e-04 gnorm: 0.3070
04/05/2020 10:31:01 > epoch 6 updates 7700 loss: 0.2212 lr: 8.3800e-04 gnorm: 0.2821
04/05/2020 10:31:04 > epoch 6 updates 7720 loss: 0.2050 lr: 8.3800e-04 gnorm: 0.2818
04/05/2020 10:31:07 > epoch 6 updates 7740 loss: 0.2055 lr: 8.3800e-04 gnorm: 0.3912
04/05/2020 10:31:10 > epoch 6 updates 7760 loss: 0.2160 lr: 8.3800e-04 gnorm: 0.2900
04/05/2020 10:31:13 > epoch 6 updates 7780 loss: 0.1545 lr: 8.3800e-04 gnorm: 0.2603
04/05/2020 10:31:15 > epoch 6 updates 7800 loss: 0.2335 lr: 8.3800e-04 gnorm: 0.2842
04/05/2020 10:31:18 > epoch 6 updates 7820 loss: 0.3122 lr: 8.3800e-04 gnorm: 0.3908
04/05/2020 10:31:21 > epoch 6 updates 7840 loss: 0.2333 lr: 8.3800e-04 gnorm: 0.2849
04/05/2020 10:31:24 > epoch 6 updates 7860 loss: 0.2357 lr: 8.3800e-04 gnorm: 0.2877
04/05/2020 10:31:27 > epoch 6 updates 7880 loss: 0.2247 lr: 8.3800e-04 gnorm: 0.3379
04/05/2020 10:31:30 > epoch 6 updates 7900 loss: 0.2070 lr: 8.3800e-04 gnorm: 0.2803
04/05/2020 10:31:33 > epoch 6 updates 7920 loss: 0.2381 lr: 8.3800e-04 gnorm: 0.2914
04/05/2020 10:31:36 > epoch 6 updates 7940 loss: 0.2892 lr: 8.3800e-04 gnorm: 0.3856
04/05/2020 10:31:39 > epoch 6 updates 7960 loss: 0.2193 lr: 8.3800e-04 gnorm: 0.2746
04/05/2020 10:31:42 > epoch 6 updates 7980 loss: 0.2537 lr: 8.3800e-04 gnorm: 0.3434
04/05/2020 10:31:45 > epoch 6 updates 8000 loss: 0.3235 lr: 8.3800e-04 gnorm: 0.3837
04/05/2020 10:31:47 train loss: 0.2344 lr: 8.3800e-04 gnorm: 0.3084 clip: 0
04/05/2020 10:31:47 valid loss: 0.3014 auc: 0.9444 f1: 0.8761 acc: 0.8706 [BEST: 0.8731]
04/05/2020 10:31:50 > epoch 6 updates 8020 loss: 0.2329 lr: 7.9610e-04 gnorm: 0.3041
04/05/2020 10:31:53 > epoch 6 updates 8040 loss: 0.2072 lr: 7.9610e-04 gnorm: 0.3180
04/05/2020 10:31:56 > epoch 6 updates 8060 loss: 0.1475 lr: 7.9610e-04 gnorm: 0.2465
04/05/2020 10:31:59 > epoch 6 updates 8080 loss: 0.2772 lr: 7.9610e-04 gnorm: 0.3267
04/05/2020 10:32:02 > epoch 6 updates 8100 loss: 0.2951 lr: 7.9610e-04 gnorm: 0.3493
04/05/2020 10:32:04 > epoch 6 updates 8120 loss: 0.2314 lr: 7.9610e-04 gnorm: 0.2436
04/05/2020 10:32:07 > epoch 6 updates 8140 loss: 0.2222 lr: 7.9610e-04 gnorm: 0.2760
04/05/2020 10:32:10 > epoch 6 updates 8160 loss: 0.2423 lr: 7.9610e-04 gnorm: 0.3286
04/05/2020 10:32:13 > epoch 6 updates 8180 loss: 0.2431 lr: 7.9610e-04 gnorm: 0.3219
04/05/2020 10:32:16 > epoch 6 updates 8200 loss: 0.2535 lr: 7.9610e-04 gnorm: 0.3033
04/05/2020 10:32:19 > epoch 6 updates 8220 loss: 0.2132 lr: 7.9610e-04 gnorm: 0.2682
04/05/2020 10:32:22 > epoch 6 updates 8240 loss: 0.2224 lr: 7.9610e-04 gnorm: 0.2976
04/05/2020 10:32:25 > epoch 6 updates 8260 loss: 0.2257 lr: 7.9610e-04 gnorm: 0.3354
04/05/2020 10:32:28 > epoch 6 updates 8280 loss: 0.2410 lr: 7.9610e-04 gnorm: 0.2872
04/05/2020 10:32:31 > epoch 6 updates 8300 loss: 0.2502 lr: 7.9610e-04 gnorm: 0.3228
04/05/2020 10:32:34 > epoch 6 updates 8320 loss: 0.2676 lr: 7.9610e-04 gnorm: 0.2852
04/05/2020 10:32:36 > epoch 6 updates 8340 loss: 0.2013 lr: 7.9610e-04 gnorm: 0.4286
04/05/2020 10:32:39 > epoch 6 updates 8360 loss: 0.2355 lr: 7.9610e-04 gnorm: 0.3012
04/05/2020 10:32:42 > epoch 6 updates 8380 loss: 0.2696 lr: 7.9610e-04 gnorm: 0.3210
04/05/2020 10:32:45 > epoch 6 updates 8400 loss: 0.2326 lr: 7.9610e-04 gnorm: 0.4008
04/05/2020 10:32:48 > epoch 6 updates 8420 loss: 0.2213 lr: 7.9610e-04 gnorm: 0.2829
04/05/2020 10:32:51 > epoch 6 updates 8440 loss: 0.2472 lr: 7.9610e-04 gnorm: 0.3142
04/05/2020 10:32:54 > epoch 6 updates 8460 loss: 0.2640 lr: 7.9610e-04 gnorm: 0.3023
04/05/2020 10:32:57 > epoch 6 updates 8480 loss: 0.2152 lr: 7.9610e-04 gnorm: 0.3197
04/05/2020 10:33:00 > epoch 6 updates 8500 loss: 0.2810 lr: 7.9610e-04 gnorm: 0.3135
04/05/2020 10:33:03 > epoch 6 updates 8520 loss: 0.2793 lr: 7.9610e-04 gnorm: 0.3311
04/05/2020 10:33:06 > epoch 6 updates 8540 loss: 0.2093 lr: 7.9610e-04 gnorm: 0.2492
04/05/2020 10:33:09 > epoch 6 updates 8560 loss: 0.2310 lr: 7.9610e-04 gnorm: 0.3101
04/05/2020 10:33:12 > epoch 6 updates 8580 loss: 0.2164 lr: 7.9610e-04 gnorm: 0.2840
04/05/2020 10:33:14 > epoch 6 updates 8600 loss: 0.2638 lr: 7.9610e-04 gnorm: 0.3766
04/05/2020 10:33:17 > epoch 6 updates 8620 loss: 0.2455 lr: 7.9610e-04 gnorm: 0.3258
04/05/2020 10:33:20 > epoch 6 updates 8640 loss: 0.2166 lr: 7.9610e-04 gnorm: 0.2485
04/05/2020 10:33:23 > epoch 6 updates 8660 loss: 0.1953 lr: 7.9610e-04 gnorm: 0.2752
04/05/2020 10:33:26 > epoch 6 updates 8680 loss: 0.3124 lr: 7.9610e-04 gnorm: 0.3623
04/05/2020 10:33:29 > epoch 6 updates 8700 loss: 0.2483 lr: 7.9610e-04 gnorm: 0.2837
04/05/2020 10:33:32 > epoch 6 updates 8720 loss: 0.2144 lr: 7.9610e-04 gnorm: 0.2841
04/05/2020 10:33:35 > epoch 6 updates 8740 loss: 0.2336 lr: 7.9610e-04 gnorm: 0.2835
04/05/2020 10:33:38 > epoch 6 updates 8760 loss: 0.2847 lr: 7.9610e-04 gnorm: 0.3162
04/05/2020 10:33:41 > epoch 6 updates 8780 loss: 0.2366 lr: 7.9610e-04 gnorm: 0.2800
04/05/2020 10:33:44 > epoch 6 updates 8800 loss: 0.2503 lr: 7.9610e-04 gnorm: 0.2588
04/05/2020 10:33:47 > epoch 6 updates 8820 loss: 0.2070 lr: 7.9610e-04 gnorm: 0.2507
04/05/2020 10:33:50 > epoch 6 updates 8840 loss: 0.1848 lr: 7.9610e-04 gnorm: 0.2781
04/05/2020 10:33:53 > epoch 6 updates 8860 loss: 0.2313 lr: 7.9610e-04 gnorm: 0.2638
04/05/2020 10:33:55 > epoch 6 updates 8880 loss: 0.2803 lr: 7.9610e-04 gnorm: 0.3291
04/05/2020 10:33:58 > epoch 6 updates 8900 loss: 0.2518 lr: 7.9610e-04 gnorm: 0.2992
04/05/2020 10:34:01 > epoch 6 updates 8920 loss: 0.2273 lr: 7.9610e-04 gnorm: 0.2296
04/05/2020 10:34:05 > epoch 6 updates 8940 loss: 0.2855 lr: 7.9610e-04 gnorm: 0.3888
04/05/2020 10:34:08 > epoch 6 updates 8960 loss: 0.2375 lr: 7.9610e-04 gnorm: 0.3266
04/05/2020 10:34:11 > epoch 6 updates 8980 loss: 0.2751 lr: 7.9610e-04 gnorm: 0.3369
04/05/2020 10:34:13 > epoch 6 updates 9000 loss: 0.2057 lr: 7.9610e-04 gnorm: 0.2337
04/05/2020 10:34:17 train loss: 0.2398 lr: 7.9610e-04 gnorm: 0.3033 clip: 0
04/05/2020 10:34:17 valid loss: 0.2946 auc: 0.9462 f1: 0.8759 acc: 0.8717 [BEST: 0.8731]
04/05/2020 10:34:17 Epoch: 7
04/05/2020 10:34:21 > epoch 7 updates 9020 loss: 0.2025 lr: 7.5630e-04 gnorm: 0.2474
04/05/2020 10:34:24 > epoch 7 updates 9040 loss: 0.2879 lr: 7.5630e-04 gnorm: 0.4639
04/05/2020 10:34:27 > epoch 7 updates 9060 loss: 0.2147 lr: 7.5630e-04 gnorm: 0.3111
04/05/2020 10:34:30 > epoch 7 updates 9080 loss: 0.1820 lr: 7.5630e-04 gnorm: 0.3254
04/05/2020 10:34:33 > epoch 7 updates 9100 loss: 0.2807 lr: 7.5630e-04 gnorm: 0.3769
04/05/2020 10:34:36 > epoch 7 updates 9120 loss: 0.2267 lr: 7.5630e-04 gnorm: 0.3317
04/05/2020 10:34:39 > epoch 7 updates 9140 loss: 0.2542 lr: 7.5630e-04 gnorm: 0.3070
04/05/2020 10:34:42 > epoch 7 updates 9160 loss: 0.2281 lr: 7.5630e-04 gnorm: 0.3040
04/05/2020 10:34:45 > epoch 7 updates 9180 loss: 0.2446 lr: 7.5630e-04 gnorm: 0.3153
04/05/2020 10:34:48 > epoch 7 updates 9200 loss: 0.1853 lr: 7.5630e-04 gnorm: 0.2817
04/05/2020 10:34:51 > epoch 7 updates 9220 loss: 0.2543 lr: 7.5630e-04 gnorm: 0.3453
04/05/2020 10:34:54 > epoch 7 updates 9240 loss: 0.1661 lr: 7.5630e-04 gnorm: 0.3405
04/05/2020 10:34:57 > epoch 7 updates 9260 loss: 0.1980 lr: 7.5630e-04 gnorm: 0.3472
04/05/2020 10:35:00 > epoch 7 updates 9280 loss: 0.2196 lr: 7.5630e-04 gnorm: 0.2693
04/05/2020 10:35:03 > epoch 7 updates 9300 loss: 0.2177 lr: 7.5630e-04 gnorm: 0.3010
04/05/2020 10:35:06 > epoch 7 updates 9320 loss: 0.2252 lr: 7.5630e-04 gnorm: 0.3031
04/05/2020 10:35:09 > epoch 7 updates 9340 loss: 0.1346 lr: 7.5630e-04 gnorm: 0.2289
04/05/2020 10:35:12 > epoch 7 updates 9360 loss: 0.2192 lr: 7.5630e-04 gnorm: 0.2773
04/05/2020 10:35:15 > epoch 7 updates 9380 loss: 0.1561 lr: 7.5630e-04 gnorm: 0.2289
04/05/2020 10:35:18 > epoch 7 updates 9400 loss: 0.2057 lr: 7.5630e-04 gnorm: 0.2850
04/05/2020 10:35:21 > epoch 7 updates 9420 loss: 0.2313 lr: 7.5630e-04 gnorm: 0.2667
04/05/2020 10:35:24 > epoch 7 updates 9440 loss: 0.2245 lr: 7.5630e-04 gnorm: 0.3852
04/05/2020 10:35:27 > epoch 7 updates 9460 loss: 0.2277 lr: 7.5630e-04 gnorm: 0.2925
04/05/2020 10:35:30 > epoch 7 updates 9480 loss: 0.2101 lr: 7.5630e-04 gnorm: 0.3165
04/05/2020 10:35:33 > epoch 7 updates 9500 loss: 0.2387 lr: 7.5630e-04 gnorm: 0.3417
04/05/2020 10:35:36 > epoch 7 updates 9520 loss: 0.2105 lr: 7.5630e-04 gnorm: 0.3060
04/05/2020 10:35:39 > epoch 7 updates 9540 loss: 0.1946 lr: 7.5630e-04 gnorm: 0.3013
04/05/2020 10:35:42 > epoch 7 updates 9560 loss: 0.1678 lr: 7.5630e-04 gnorm: 0.2727
04/05/2020 10:35:45 > epoch 7 updates 9580 loss: 0.1922 lr: 7.5630e-04 gnorm: 0.3206
04/05/2020 10:35:48 > epoch 7 updates 9600 loss: 0.1639 lr: 7.5630e-04 gnorm: 0.2748
04/05/2020 10:35:50 > epoch 7 updates 9620 loss: 0.2477 lr: 7.5630e-04 gnorm: 0.3351
04/05/2020 10:35:53 > epoch 7 updates 9640 loss: 0.2522 lr: 7.5630e-04 gnorm: 0.3611
04/05/2020 10:35:56 > epoch 7 updates 9660 loss: 0.2117 lr: 7.5630e-04 gnorm: 0.3852
04/05/2020 10:35:59 > epoch 7 updates 9680 loss: 0.2151 lr: 7.5630e-04 gnorm: 0.3101
04/05/2020 10:36:02 > epoch 7 updates 9700 loss: 0.2032 lr: 7.5630e-04 gnorm: 0.2617
04/05/2020 10:36:05 > epoch 7 updates 9720 loss: 0.2686 lr: 7.5630e-04 gnorm: 0.3647
04/05/2020 10:36:08 > epoch 7 updates 9740 loss: 0.2817 lr: 7.5630e-04 gnorm: 0.3764
04/05/2020 10:36:11 > epoch 7 updates 9760 loss: 0.2942 lr: 7.5630e-04 gnorm: 0.3397
04/05/2020 10:36:14 > epoch 7 updates 9780 loss: 0.2551 lr: 7.5630e-04 gnorm: 0.3492
04/05/2020 10:36:17 > epoch 7 updates 9800 loss: 0.2192 lr: 7.5630e-04 gnorm: 0.3205
04/05/2020 10:36:20 > epoch 7 updates 9820 loss: 0.2288 lr: 7.5630e-04 gnorm: 0.3464
04/05/2020 10:36:23 > epoch 7 updates 9840 loss: 0.2224 lr: 7.5630e-04 gnorm: 0.2896
04/05/2020 10:36:26 > epoch 7 updates 9860 loss: 0.1807 lr: 7.5630e-04 gnorm: 0.2476
04/05/2020 10:36:28 > epoch 7 updates 9880 loss: 0.2154 lr: 7.5630e-04 gnorm: 0.2930
04/05/2020 10:36:31 > epoch 7 updates 9900 loss: 0.2695 lr: 7.5630e-04 gnorm: 0.3402
04/05/2020 10:36:34 > epoch 7 updates 9920 loss: 0.2348 lr: 7.5630e-04 gnorm: 0.3710
04/05/2020 10:36:37 > epoch 7 updates 9940 loss: 0.2726 lr: 7.5630e-04 gnorm: 0.3701
04/05/2020 10:36:40 > epoch 7 updates 9960 loss: 0.1850 lr: 7.5630e-04 gnorm: 0.2218
04/05/2020 10:36:43 > epoch 7 updates 9980 loss: 0.2146 lr: 7.5630e-04 gnorm: 0.3439
04/05/2020 10:36:46 > epoch 7 updates 10000 loss: 0.1983 lr: 7.5630e-04 gnorm: 0.3988
04/05/2020 10:36:48 train loss: 0.2211 lr: 7.5630e-04 gnorm: 0.3186 clip: 0
04/05/2020 10:36:48 valid loss: 0.2768 auc: 0.9516 f1: 0.8822 acc: 0.8797 [NEW BEST]
04/05/2020 10:36:51 > epoch 7 updates 10020 loss: 0.2338 lr: 7.1848e-04 gnorm: 0.2924
04/05/2020 10:36:54 > epoch 7 updates 10040 loss: 0.1848 lr: 7.1848e-04 gnorm: 0.2984
04/05/2020 10:36:57 > epoch 7 updates 10060 loss: 0.2033 lr: 7.1848e-04 gnorm: 0.2609
04/05/2020 10:37:00 > epoch 7 updates 10080 loss: 0.2650 lr: 7.1848e-04 gnorm: 0.3020
04/05/2020 10:37:03 > epoch 7 updates 10100 loss: 0.2196 lr: 7.1848e-04 gnorm: 0.2901
04/05/2020 10:37:06 > epoch 7 updates 10120 loss: 0.2231 lr: 7.1848e-04 gnorm: 0.2928
04/05/2020 10:37:09 > epoch 7 updates 10140 loss: 0.2266 lr: 7.1848e-04 gnorm: 0.3436
04/05/2020 10:37:12 > epoch 7 updates 10160 loss: 0.2301 lr: 7.1848e-04 gnorm: 0.3211
04/05/2020 10:37:14 > epoch 7 updates 10180 loss: 0.1943 lr: 7.1848e-04 gnorm: 0.2853
04/05/2020 10:37:17 > epoch 7 updates 10200 loss: 0.2009 lr: 7.1848e-04 gnorm: 0.3029
04/05/2020 10:37:20 > epoch 7 updates 10220 loss: 0.2180 lr: 7.1848e-04 gnorm: 0.3342
04/05/2020 10:37:23 > epoch 7 updates 10240 loss: 0.1932 lr: 7.1848e-04 gnorm: 0.2829
04/05/2020 10:37:26 > epoch 7 updates 10260 loss: 0.2386 lr: 7.1848e-04 gnorm: 0.3561
04/05/2020 10:37:29 > epoch 7 updates 10280 loss: 0.1970 lr: 7.1848e-04 gnorm: 0.3333
04/05/2020 10:37:32 > epoch 7 updates 10300 loss: 0.2730 lr: 7.1848e-04 gnorm: 0.3365
04/05/2020 10:37:35 > epoch 7 updates 10320 loss: 0.2048 lr: 7.1848e-04 gnorm: 0.2707
04/05/2020 10:37:37 > epoch 7 updates 10340 loss: 0.2254 lr: 7.1848e-04 gnorm: 0.2590
04/05/2020 10:37:40 > epoch 7 updates 10360 loss: 0.2127 lr: 7.1848e-04 gnorm: 0.2942
04/05/2020 10:37:43 > epoch 7 updates 10380 loss: 0.1967 lr: 7.1848e-04 gnorm: 0.3186
04/05/2020 10:37:46 > epoch 7 updates 10400 loss: 0.1813 lr: 7.1848e-04 gnorm: 0.2505
04/05/2020 10:37:49 > epoch 7 updates 10420 loss: 0.2131 lr: 7.1848e-04 gnorm: 0.3690
04/05/2020 10:37:52 > epoch 7 updates 10440 loss: 0.2543 lr: 7.1848e-04 gnorm: 0.3480
04/05/2020 10:37:55 > epoch 7 updates 10460 loss: 0.2255 lr: 7.1848e-04 gnorm: 0.3301
04/05/2020 10:37:58 > epoch 7 updates 10480 loss: 0.2443 lr: 7.1848e-04 gnorm: 0.3031
04/05/2020 10:38:01 > epoch 7 updates 10500 loss: 0.1864 lr: 7.1848e-04 gnorm: 0.2524
04/05/2020 10:38:04 train loss: 0.2178 lr: 7.1848e-04 gnorm: 0.3053 clip: 0
04/05/2020 10:38:04 valid loss: 0.2804 auc: 0.9508 f1: 0.8814 acc: 0.8769 [BEST: 0.8797]
04/05/2020 10:38:04 Epoch: 8
04/05/2020 10:38:09 > epoch 8 updates 10520 loss: 0.1549 lr: 7.1848e-04 gnorm: 0.2393
04/05/2020 10:38:12 > epoch 8 updates 10540 loss: 0.2027 lr: 7.1848e-04 gnorm: 0.3706
04/05/2020 10:38:15 > epoch 8 updates 10560 loss: 0.2000 lr: 7.1848e-04 gnorm: 0.2948
04/05/2020 10:38:18 > epoch 8 updates 10580 loss: 0.2128 lr: 7.1848e-04 gnorm: 0.3658
04/05/2020 10:38:21 > epoch 8 updates 10600 loss: 0.2179 lr: 7.1848e-04 gnorm: 0.3506
04/05/2020 10:38:24 > epoch 8 updates 10620 loss: 0.1524 lr: 7.1848e-04 gnorm: 0.2406
04/05/2020 10:38:27 > epoch 8 updates 10640 loss: 0.1736 lr: 7.1848e-04 gnorm: 0.3041
04/05/2020 10:38:30 > epoch 8 updates 10660 loss: 0.1950 lr: 7.1848e-04 gnorm: 0.3274
04/05/2020 10:38:33 > epoch 8 updates 10680 loss: 0.1930 lr: 7.1848e-04 gnorm: 0.2740
04/05/2020 10:38:36 > epoch 8 updates 10700 loss: 0.1885 lr: 7.1848e-04 gnorm: 0.3446
04/05/2020 10:38:39 > epoch 8 updates 10720 loss: 0.2299 lr: 7.1848e-04 gnorm: 0.4243
04/05/2020 10:38:42 > epoch 8 updates 10740 loss: 0.1921 lr: 7.1848e-04 gnorm: 0.3160
04/05/2020 10:38:45 > epoch 8 updates 10760 loss: 0.1815 lr: 7.1848e-04 gnorm: 0.2862
04/05/2020 10:38:48 > epoch 8 updates 10780 loss: 0.1654 lr: 7.1848e-04 gnorm: 0.3130
04/05/2020 10:38:50 > epoch 8 updates 10800 loss: 0.2233 lr: 7.1848e-04 gnorm: 0.2809
04/05/2020 10:38:53 > epoch 8 updates 10820 loss: 0.2142 lr: 7.1848e-04 gnorm: 0.3780
04/05/2020 10:38:56 > epoch 8 updates 10840 loss: 0.2066 lr: 7.1848e-04 gnorm: 0.3321
04/05/2020 10:38:59 > epoch 8 updates 10860 loss: 0.2147 lr: 7.1848e-04 gnorm: 0.2786
04/05/2020 10:39:02 > epoch 8 updates 10880 loss: 0.2000 lr: 7.1848e-04 gnorm: 0.2561
04/05/2020 10:39:05 > epoch 8 updates 10900 loss: 0.1727 lr: 7.1848e-04 gnorm: 0.2708
04/05/2020 10:39:08 > epoch 8 updates 10920 loss: 0.2701 lr: 7.1848e-04 gnorm: 0.3958
04/05/2020 10:39:11 > epoch 8 updates 10940 loss: 0.2424 lr: 7.1848e-04 gnorm: 0.3480
04/05/2020 10:39:14 > epoch 8 updates 10960 loss: 0.2348 lr: 7.1848e-04 gnorm: 0.3483
04/05/2020 10:39:17 > epoch 8 updates 10980 loss: 0.2523 lr: 7.1848e-04 gnorm: 0.3725
04/05/2020 10:39:20 > epoch 8 updates 11000 loss: 0.1939 lr: 7.1848e-04 gnorm: 0.3058
04/05/2020 10:39:23 > epoch 8 updates 11020 loss: 0.1225 lr: 6.8256e-04 gnorm: 0.2385
04/05/2020 10:39:26 > epoch 8 updates 11040 loss: 0.1668 lr: 6.8256e-04 gnorm: 0.2714
04/05/2020 10:39:29 > epoch 8 updates 11060 loss: 0.2131 lr: 6.8256e-04 gnorm: 0.2906
04/05/2020 10:39:32 > epoch 8 updates 11080 loss: 0.1920 lr: 6.8256e-04 gnorm: 0.3341
04/05/2020 10:39:35 > epoch 8 updates 11100 loss: 0.1821 lr: 6.8256e-04 gnorm: 0.2842
04/05/2020 10:39:38 > epoch 8 updates 11120 loss: 0.2478 lr: 6.8256e-04 gnorm: 0.3154
04/05/2020 10:39:40 > epoch 8 updates 11140 loss: 0.1854 lr: 6.8256e-04 gnorm: 0.2987
04/05/2020 10:39:43 > epoch 8 updates 11160 loss: 0.2260 lr: 6.8256e-04 gnorm: 0.3020
04/05/2020 10:39:46 > epoch 8 updates 11180 loss: 0.1798 lr: 6.8256e-04 gnorm: 0.2717
04/05/2020 10:39:49 > epoch 8 updates 11200 loss: 0.2340 lr: 6.8256e-04 gnorm: 0.3354
04/05/2020 10:39:52 > epoch 8 updates 11220 loss: 0.1802 lr: 6.8256e-04 gnorm: 0.3205
04/05/2020 10:39:55 > epoch 8 updates 11240 loss: 0.2372 lr: 6.8256e-04 gnorm: 0.4055
04/05/2020 10:39:58 > epoch 8 updates 11260 loss: 0.2002 lr: 6.8256e-04 gnorm: 0.3595
04/05/2020 10:40:01 > epoch 8 updates 11280 loss: 0.2249 lr: 6.8256e-04 gnorm: 0.2797
04/05/2020 10:40:04 > epoch 8 updates 11300 loss: 0.1635 lr: 6.8256e-04 gnorm: 0.2482
04/05/2020 10:40:07 > epoch 8 updates 11320 loss: 0.2081 lr: 6.8256e-04 gnorm: 0.3440
04/05/2020 10:40:09 > epoch 8 updates 11340 loss: 0.2160 lr: 6.8256e-04 gnorm: 0.3118
04/05/2020 10:40:13 > epoch 8 updates 11360 loss: 0.2441 lr: 6.8256e-04 gnorm: 0.3369
04/05/2020 10:40:15 > epoch 8 updates 11380 loss: 0.2188 lr: 6.8256e-04 gnorm: 0.3069
04/05/2020 10:40:18 > epoch 8 updates 11400 loss: 0.2389 lr: 6.8256e-04 gnorm: 0.3864
04/05/2020 10:40:21 > epoch 8 updates 11420 loss: 0.2291 lr: 6.8256e-04 gnorm: 0.3227
04/05/2020 10:40:24 > epoch 8 updates 11440 loss: 0.1952 lr: 6.8256e-04 gnorm: 0.3408
04/05/2020 10:40:27 > epoch 8 updates 11460 loss: 0.2104 lr: 6.8256e-04 gnorm: 0.3029
04/05/2020 10:40:30 > epoch 8 updates 11480 loss: 0.1767 lr: 6.8256e-04 gnorm: 0.2930
04/05/2020 10:40:33 > epoch 8 updates 11500 loss: 0.2105 lr: 6.8256e-04 gnorm: 0.3199
04/05/2020 10:40:36 > epoch 8 updates 11520 loss: 0.2233 lr: 6.8256e-04 gnorm: 0.3447
04/05/2020 10:40:39 > epoch 8 updates 11540 loss: 0.2902 lr: 6.8256e-04 gnorm: 0.3819
04/05/2020 10:40:42 > epoch 8 updates 11560 loss: 0.1677 lr: 6.8256e-04 gnorm: 0.2892
04/05/2020 10:40:45 > epoch 8 updates 11580 loss: 0.1937 lr: 6.8256e-04 gnorm: 0.3055
04/05/2020 10:40:47 > epoch 8 updates 11600 loss: 0.2181 lr: 6.8256e-04 gnorm: 0.2921
04/05/2020 10:40:50 > epoch 8 updates 11620 loss: 0.1832 lr: 6.8256e-04 gnorm: 0.2725
04/05/2020 10:40:53 > epoch 8 updates 11640 loss: 0.2392 lr: 6.8256e-04 gnorm: 0.3012
04/05/2020 10:40:56 > epoch 8 updates 11660 loss: 0.1661 lr: 6.8256e-04 gnorm: 0.2465
04/05/2020 10:40:59 > epoch 8 updates 11680 loss: 0.2426 lr: 6.8256e-04 gnorm: 0.3524
04/05/2020 10:41:02 > epoch 8 updates 11700 loss: 0.1912 lr: 6.8256e-04 gnorm: 0.2715
04/05/2020 10:41:05 > epoch 8 updates 11720 loss: 0.1739 lr: 6.8256e-04 gnorm: 0.2928
04/05/2020 10:41:08 > epoch 8 updates 11740 loss: 0.2048 lr: 6.8256e-04 gnorm: 0.2999
04/05/2020 10:41:11 > epoch 8 updates 11760 loss: 0.2072 lr: 6.8256e-04 gnorm: 0.3155
04/05/2020 10:41:14 > epoch 8 updates 11780 loss: 0.2287 lr: 6.8256e-04 gnorm: 0.3267
04/05/2020 10:41:17 > epoch 8 updates 11800 loss: 0.2398 lr: 6.8256e-04 gnorm: 0.3174
04/05/2020 10:41:20 > epoch 8 updates 11820 loss: 0.1441 lr: 6.8256e-04 gnorm: 0.2732
04/05/2020 10:41:23 > epoch 8 updates 11840 loss: 0.1992 lr: 6.8256e-04 gnorm: 0.2906
04/05/2020 10:41:26 > epoch 8 updates 11860 loss: 0.2210 lr: 6.8256e-04 gnorm: 0.3863
04/05/2020 10:41:29 > epoch 8 updates 11880 loss: 0.2149 lr: 6.8256e-04 gnorm: 0.3614
04/05/2020 10:41:32 > epoch 8 updates 11900 loss: 0.1807 lr: 6.8256e-04 gnorm: 0.2842
04/05/2020 10:41:35 > epoch 8 updates 11920 loss: 0.2064 lr: 6.8256e-04 gnorm: 0.3270
04/05/2020 10:41:38 > epoch 8 updates 11940 loss: 0.1949 lr: 6.8256e-04 gnorm: 0.3070
04/05/2020 10:41:41 > epoch 8 updates 11960 loss: 0.1673 lr: 6.8256e-04 gnorm: 0.2770
04/05/2020 10:41:44 > epoch 8 updates 11980 loss: 0.2186 lr: 6.8256e-04 gnorm: 0.3147
04/05/2020 10:41:47 > epoch 8 updates 12000 loss: 0.1994 lr: 6.8256e-04 gnorm: 0.2894
04/05/2020 10:41:49 train loss: 0.2044 lr: 6.9168e-04 gnorm: 0.3135 clip: 0
04/05/2020 10:41:49 valid loss: 0.2842 auc: 0.9511 f1: 0.8834 acc: 0.8808 [NEW BEST]
04/05/2020 10:41:53 valid loss: 0.2856 auc: 0.9518 f1: 0.8795 acc: 0.8802 [BEST: 0.8808]
04/05/2020 10:41:53 Epoch: 9
04/05/2020 10:41:57 > epoch 9 updates 12020 loss: 0.1558 lr: 6.4843e-04 gnorm: 0.2288
04/05/2020 10:42:00 > epoch 9 updates 12040 loss: 0.1521 lr: 6.4843e-04 gnorm: 0.2867
04/05/2020 10:42:03 > epoch 9 updates 12060 loss: 0.2413 lr: 6.4843e-04 gnorm: 0.3853
04/05/2020 10:42:06 > epoch 9 updates 12080 loss: 0.2446 lr: 6.4843e-04 gnorm: 0.4045
04/05/2020 10:42:09 > epoch 9 updates 12100 loss: 0.1610 lr: 6.4843e-04 gnorm: 0.3079
04/05/2020 10:42:12 > epoch 9 updates 12120 loss: 0.1693 lr: 6.4843e-04 gnorm: 0.2937
04/05/2020 10:42:15 > epoch 9 updates 12140 loss: 0.2051 lr: 6.4843e-04 gnorm: 0.2769
04/05/2020 10:42:18 > epoch 9 updates 12160 loss: 0.1874 lr: 6.4843e-04 gnorm: 0.2799
04/05/2020 10:42:21 > epoch 9 updates 12180 loss: 0.1738 lr: 6.4843e-04 gnorm: 0.3163
04/05/2020 10:42:24 > epoch 9 updates 12200 loss: 0.1975 lr: 6.4843e-04 gnorm: 0.3007
04/05/2020 10:42:27 > epoch 9 updates 12220 loss: 0.1641 lr: 6.4843e-04 gnorm: 0.3416
04/05/2020 10:42:29 > epoch 9 updates 12240 loss: 0.1777 lr: 6.4843e-04 gnorm: 0.3136
04/05/2020 10:42:32 > epoch 9 updates 12260 loss: 0.2277 lr: 6.4843e-04 gnorm: 0.3632
04/05/2020 10:42:35 > epoch 9 updates 12280 loss: 0.2048 lr: 6.4843e-04 gnorm: 0.3160
04/05/2020 10:42:38 > epoch 9 updates 12300 loss: 0.1802 lr: 6.4843e-04 gnorm: 0.3157
04/05/2020 10:42:41 > epoch 9 updates 12320 loss: 0.1524 lr: 6.4843e-04 gnorm: 0.3314
04/05/2020 10:42:44 > epoch 9 updates 12340 loss: 0.1493 lr: 6.4843e-04 gnorm: 0.3292
04/05/2020 10:42:47 > epoch 9 updates 12360 loss: 0.1531 lr: 6.4843e-04 gnorm: 0.2798
04/05/2020 10:42:50 > epoch 9 updates 12380 loss: 0.1935 lr: 6.4843e-04 gnorm: 0.4169
04/05/2020 10:42:53 > epoch 9 updates 12400 loss: 0.1680 lr: 6.4843e-04 gnorm: 0.2830
04/05/2020 10:42:56 > epoch 9 updates 12420 loss: 0.1954 lr: 6.4843e-04 gnorm: 0.3841
04/05/2020 10:42:59 > epoch 9 updates 12440 loss: 0.2634 lr: 6.4843e-04 gnorm: 0.4117
04/05/2020 10:43:02 > epoch 9 updates 12460 loss: 0.1691 lr: 6.4843e-04 gnorm: 0.3381
04/05/2020 10:43:05 > epoch 9 updates 12480 loss: 0.2168 lr: 6.4843e-04 gnorm: 0.3545
04/05/2020 10:43:08 > epoch 9 updates 12500 loss: 0.1855 lr: 6.4843e-04 gnorm: 0.2712
04/05/2020 10:43:11 > epoch 9 updates 12520 loss: 0.1509 lr: 6.4843e-04 gnorm: 0.3150
04/05/2020 10:43:14 > epoch 9 updates 12540 loss: 0.1723 lr: 6.4843e-04 gnorm: 0.3053
04/05/2020 10:43:16 > epoch 9 updates 12560 loss: 0.2208 lr: 6.4843e-04 gnorm: 0.3586
04/05/2020 10:43:19 > epoch 9 updates 12580 loss: 0.2379 lr: 6.4843e-04 gnorm: 0.3260
04/05/2020 10:43:22 > epoch 9 updates 12600 loss: 0.2432 lr: 6.4843e-04 gnorm: 0.4092
04/05/2020 10:43:25 > epoch 9 updates 12620 loss: 0.2539 lr: 6.4843e-04 gnorm: 0.3811
04/05/2020 10:43:28 > epoch 9 updates 12640 loss: 0.1638 lr: 6.4843e-04 gnorm: 0.2784
04/05/2020 10:43:31 > epoch 9 updates 12660 loss: 0.2239 lr: 6.4843e-04 gnorm: 0.3808
04/05/2020 10:43:34 > epoch 9 updates 12680 loss: 0.2091 lr: 6.4843e-04 gnorm: 0.3220
04/05/2020 10:43:37 > epoch 9 updates 12700 loss: 0.2100 lr: 6.4843e-04 gnorm: 0.3134
04/05/2020 10:43:40 > epoch 9 updates 12720 loss: 0.2006 lr: 6.4843e-04 gnorm: 0.3151
04/05/2020 10:43:43 > epoch 9 updates 12740 loss: 0.1481 lr: 6.4843e-04 gnorm: 0.2835
04/05/2020 10:43:46 > epoch 9 updates 12760 loss: 0.1975 lr: 6.4843e-04 gnorm: 0.2934
04/05/2020 10:43:49 > epoch 9 updates 12780 loss: 0.2318 lr: 6.4843e-04 gnorm: 0.3799
04/05/2020 10:43:52 > epoch 9 updates 12800 loss: 0.2053 lr: 6.4843e-04 gnorm: 0.3733
04/05/2020 10:43:55 > epoch 9 updates 12820 loss: 0.1808 lr: 6.4843e-04 gnorm: 0.3343
04/05/2020 10:43:58 > epoch 9 updates 12840 loss: 0.2050 lr: 6.4843e-04 gnorm: 0.3927
04/05/2020 10:44:01 > epoch 9 updates 12860 loss: 0.1493 lr: 6.4843e-04 gnorm: 0.2493
04/05/2020 10:44:04 > epoch 9 updates 12880 loss: 0.1852 lr: 6.4843e-04 gnorm: 0.3468
04/05/2020 10:44:07 > epoch 9 updates 12900 loss: 0.2096 lr: 6.4843e-04 gnorm: 0.3314
04/05/2020 10:44:10 > epoch 9 updates 12920 loss: 0.1808 lr: 6.4843e-04 gnorm: 0.3212
04/05/2020 10:44:13 > epoch 9 updates 12940 loss: 0.2472 lr: 6.4843e-04 gnorm: 0.3411
04/05/2020 10:44:16 > epoch 9 updates 12960 loss: 0.1769 lr: 6.4843e-04 gnorm: 0.3164
04/05/2020 10:44:19 > epoch 9 updates 12980 loss: 0.2997 lr: 6.4843e-04 gnorm: 0.4907
04/05/2020 10:44:22 > epoch 9 updates 13000 loss: 0.2860 lr: 6.4843e-04 gnorm: 0.3607
04/05/2020 10:44:24 > epoch 9 updates 13020 loss: 0.2223 lr: 6.1601e-04 gnorm: 0.3012
04/05/2020 10:44:27 > epoch 9 updates 13040 loss: 0.1941 lr: 6.1601e-04 gnorm: 0.4181
04/05/2020 10:44:30 > epoch 9 updates 13060 loss: 0.1780 lr: 6.1601e-04 gnorm: 0.2746
04/05/2020 10:44:33 > epoch 9 updates 13080 loss: 0.1702 lr: 6.1601e-04 gnorm: 0.2998
04/05/2020 10:44:36 > epoch 9 updates 13100 loss: 0.2250 lr: 6.1601e-04 gnorm: 0.3615
04/05/2020 10:44:39 > epoch 9 updates 13120 loss: 0.2050 lr: 6.1601e-04 gnorm: 0.3505
04/05/2020 10:44:42 > epoch 9 updates 13140 loss: 0.1765 lr: 6.1601e-04 gnorm: 0.3211
04/05/2020 10:44:45 > epoch 9 updates 13160 loss: 0.2107 lr: 6.1601e-04 gnorm: 0.3682
04/05/2020 10:44:48 > epoch 9 updates 13180 loss: 0.1954 lr: 6.1601e-04 gnorm: 0.4444
04/05/2020 10:44:51 > epoch 9 updates 13200 loss: 0.2560 lr: 6.1601e-04 gnorm: 0.3913
04/05/2020 10:44:54 > epoch 9 updates 13220 loss: 0.1691 lr: 6.1601e-04 gnorm: 0.2895
04/05/2020 10:44:57 > epoch 9 updates 13240 loss: 0.1989 lr: 6.1601e-04 gnorm: 0.3128
04/05/2020 10:45:00 > epoch 9 updates 13260 loss: 0.1931 lr: 6.1601e-04 gnorm: 0.2970
04/05/2020 10:45:03 > epoch 9 updates 13280 loss: 0.2076 lr: 6.1601e-04 gnorm: 0.3065
04/05/2020 10:45:06 > epoch 9 updates 13300 loss: 0.1973 lr: 6.1601e-04 gnorm: 0.3240
04/05/2020 10:45:08 > epoch 9 updates 13320 loss: 0.2235 lr: 6.1601e-04 gnorm: 0.3557
04/05/2020 10:45:11 > epoch 9 updates 13340 loss: 0.1767 lr: 6.1601e-04 gnorm: 0.3161
04/05/2020 10:45:14 > epoch 9 updates 13360 loss: 0.2609 lr: 6.1601e-04 gnorm: 0.4437
04/05/2020 10:45:17 > epoch 9 updates 13380 loss: 0.1670 lr: 6.1601e-04 gnorm: 0.2990
04/05/2020 10:45:20 > epoch 9 updates 13400 loss: 0.2343 lr: 6.1601e-04 gnorm: 0.3209
04/05/2020 10:45:23 > epoch 9 updates 13420 loss: 0.2426 lr: 6.1601e-04 gnorm: 0.3321
04/05/2020 10:45:26 > epoch 9 updates 13440 loss: 0.1661 lr: 6.1601e-04 gnorm: 0.2844
04/05/2020 10:45:29 > epoch 9 updates 13460 loss: 0.1892 lr: 6.1601e-04 gnorm: 0.3250
04/05/2020 10:45:32 > epoch 9 updates 13480 loss: 0.1410 lr: 6.1601e-04 gnorm: 0.2295
04/05/2020 10:45:35 > epoch 9 updates 13500 loss: 0.1265 lr: 6.1601e-04 gnorm: 0.2489
04/05/2020 10:45:40 train loss: 0.1981 lr: 6.3483e-04 gnorm: 0.3316 clip: 0
04/05/2020 10:45:40 valid loss: 0.2792 auc: 0.9526 f1: 0.8872 acc: 0.8843 [NEW BEST]
04/05/2020 10:45:40 Epoch: 10
04/05/2020 10:45:45 > epoch 10 updates 13520 loss: 0.1972 lr: 6.1601e-04 gnorm: 0.3649
04/05/2020 10:45:48 > epoch 10 updates 13540 loss: 0.1850 lr: 6.1601e-04 gnorm: 0.2979
04/05/2020 10:45:51 > epoch 10 updates 13560 loss: 0.1526 lr: 6.1601e-04 gnorm: 0.3366
04/05/2020 10:45:54 > epoch 10 updates 13580 loss: 0.1946 lr: 6.1601e-04 gnorm: 0.3318
04/05/2020 10:45:57 > epoch 10 updates 13600 loss: 0.1773 lr: 6.1601e-04 gnorm: 0.3263
04/05/2020 10:46:01 > epoch 10 updates 13620 loss: 0.1315 lr: 6.1601e-04 gnorm: 0.2852
04/05/2020 10:46:04 > epoch 10 updates 13640 loss: 0.1876 lr: 6.1601e-04 gnorm: 0.3301
04/05/2020 10:46:07 > epoch 10 updates 13660 loss: 0.1878 lr: 6.1601e-04 gnorm: 0.4295
04/05/2020 10:46:10 > epoch 10 updates 13680 loss: 0.1628 lr: 6.1601e-04 gnorm: 0.2813
04/05/2020 10:46:13 > epoch 10 updates 13700 loss: 0.1726 lr: 6.1601e-04 gnorm: 0.3209
04/05/2020 10:46:15 > epoch 10 updates 13720 loss: 0.1824 lr: 6.1601e-04 gnorm: 0.2492
04/05/2020 10:46:18 > epoch 10 updates 13740 loss: 0.1599 lr: 6.1601e-04 gnorm: 0.2874
04/05/2020 10:46:21 > epoch 10 updates 13760 loss: 0.2299 lr: 6.1601e-04 gnorm: 0.3928
04/05/2020 10:46:24 > epoch 10 updates 13780 loss: 0.1621 lr: 6.1601e-04 gnorm: 0.4121
04/05/2020 10:46:27 > epoch 10 updates 13800 loss: 0.1792 lr: 6.1601e-04 gnorm: 0.3964
04/05/2020 10:46:30 > epoch 10 updates 13820 loss: 0.1997 lr: 6.1601e-04 gnorm: 0.3123
04/05/2020 10:46:33 > epoch 10 updates 13840 loss: 0.1384 lr: 6.1601e-04 gnorm: 0.2914
04/05/2020 10:46:36 > epoch 10 updates 13860 loss: 0.1960 lr: 6.1601e-04 gnorm: 0.3827
04/05/2020 10:46:39 > epoch 10 updates 13880 loss: 0.1948 lr: 6.1601e-04 gnorm: 0.3475
04/05/2020 10:46:42 > epoch 10 updates 13900 loss: 0.1496 lr: 6.1601e-04 gnorm: 0.4057
04/05/2020 10:46:45 > epoch 10 updates 13920 loss: 0.1937 lr: 6.1601e-04 gnorm: 0.3632
04/05/2020 10:46:48 > epoch 10 updates 13940 loss: 0.1812 lr: 6.1601e-04 gnorm: 0.2961
04/05/2020 10:46:51 > epoch 10 updates 13960 loss: 0.1789 lr: 6.1601e-04 gnorm: 0.3597
04/05/2020 10:46:54 > epoch 10 updates 13980 loss: 0.1564 lr: 6.1601e-04 gnorm: 0.3262
04/05/2020 10:46:56 > epoch 10 updates 14000 loss: 0.1908 lr: 6.1601e-04 gnorm: 0.2837
04/05/2020 10:46:58 train loss: 0.1777 lr: 6.1601e-04 gnorm: 0.3367 clip: 0
04/05/2020 10:46:58 valid loss: 0.2889 auc: 0.9509 f1: 0.8841 acc: 0.8811 [BEST: 0.8843]
04/05/2020 10:47:01 > epoch 10 updates 14020 loss: 0.2824 lr: 5.8521e-04 gnorm: 0.4273
04/05/2020 10:47:04 > epoch 10 updates 14040 loss: 0.1467 lr: 5.8521e-04 gnorm: 0.2622
04/05/2020 10:47:08 train loss: 0.2142 lr: 5.8521e-04 gnorm: 0.3443 clip: 0
04/05/2020 10:47:08 valid loss: 0.2938 auc: 0.9516 f1: 0.8839 acc: 0.8801 [BEST: 0.8843]
04/05/2020 10:47:09 > epoch 10 updates 14060 loss: 0.1454 lr: 5.8521e-04 gnorm: 0.3065
04/05/2020 10:47:12 > epoch 10 updates 14080 loss: 0.1763 lr: 5.8521e-04 gnorm: 0.3270
04/05/2020 10:47:15 > epoch 10 updates 14100 loss: 0.1489 lr: 5.8521e-04 gnorm: 0.3032
04/05/2020 10:47:17 train loss: 0.1569 lr: 5.8521e-04 gnorm: 0.3122 clip: 0
04/05/2020 10:47:17 valid loss: 0.2825 auc: 0.9525 f1: 0.8844 acc: 0.8824 [BEST: 0.8843]
04/05/2020 10:47:20 > epoch 10 updates 14120 loss: 0.1326 lr: 5.8521e-04 gnorm: 0.2638
04/05/2020 10:47:23 > epoch 10 updates 14140 loss: 0.1308 lr: 5.8521e-04 gnorm: 0.3086
04/05/2020 10:47:26 train loss: 0.1317 lr: 5.8521e-04 gnorm: 0.2863 clip: 0
04/05/2020 10:47:26 valid loss: 0.2839 auc: 0.9521 f1: 0.8866 acc: 0.8842 [BEST: 0.8843]
04/05/2020 10:47:28 > epoch 10 updates 14160 loss: 0.1419 lr: 5.8521e-04 gnorm: 0.2511
04/05/2020 10:47:31 > epoch 10 updates 14180 loss: 0.2080 lr: 5.8521e-04 gnorm: 0.3615
04/05/2020 10:47:34 > epoch 10 updates 14200 loss: 0.2297 lr: 5.8521e-04 gnorm: 0.4015
04/05/2020 10:47:36 train loss: 0.1935 lr: 5.8521e-04 gnorm: 0.3385 clip: 0
04/05/2020 10:47:36 valid loss: 0.2882 auc: 0.9521 f1: 0.8848 acc: 0.8816 [BEST: 0.8843]
04/05/2020 10:47:39 > epoch 10 updates 14220 loss: 0.1725 lr: 5.8521e-04 gnorm: 0.2923
04/05/2020 10:47:42 > epoch 10 updates 14240 loss: 0.2056 lr: 5.8521e-04 gnorm: 0.3687
04/05/2020 10:47:45 train loss: 0.1891 lr: 5.8521e-04 gnorm: 0.3307 clip: 0
04/05/2020 10:47:45 valid loss: 0.2869 auc: 0.9518 f1: 0.8850 acc: 0.8836 [BEST: 0.8843]
04/05/2020 10:47:46 > epoch 10 updates 14260 loss: 0.1605 lr: 5.8521e-04 gnorm: 0.2351
04/05/2020 10:47:49 > epoch 10 updates 14280 loss: 0.2310 lr: 5.8521e-04 gnorm: 0.4069
04/05/2020 10:47:52 > epoch 10 updates 14300 loss: 0.1856 lr: 5.8521e-04 gnorm: 0.2994
04/05/2020 10:47:54 train loss: 0.1924 lr: 5.8521e-04 gnorm: 0.3140 clip: 0
04/05/2020 10:47:54 valid loss: 0.2709 auc: 0.9562 f1: 0.8904 acc: 0.8877 [NEW BEST]
04/05/2020 10:47:57 > epoch 10 updates 14320 loss: 0.1564 lr: 5.8521e-04 gnorm: 0.2730
04/05/2020 10:48:00 > epoch 10 updates 14340 loss: 0.1742 lr: 5.8521e-04 gnorm: 0.3047
04/05/2020 10:48:04 train loss: 0.1653 lr: 5.8521e-04 gnorm: 0.2889 clip: 0
04/05/2020 10:48:04 valid loss: 0.2922 auc: 0.9514 f1: 0.8815 acc: 0.8806 [BEST: 0.8877]
04/05/2020 10:48:05 > epoch 10 updates 14360 loss: 0.1436 lr: 5.8521e-04 gnorm: 0.2616
04/05/2020 10:48:08 > epoch 10 updates 14380 loss: 0.1721 lr: 5.8521e-04 gnorm: 0.2909
04/05/2020 10:48:11 > epoch 10 updates 14400 loss: 0.1813 lr: 5.8521e-04 gnorm: 0.2741
04/05/2020 10:48:13 train loss: 0.1658 lr: 5.8521e-04 gnorm: 0.2756 clip: 0
04/05/2020 10:48:13 valid loss: 0.2877 auc: 0.9512 f1: 0.8842 acc: 0.8812 [BEST: 0.8877]
04/05/2020 10:48:16 > epoch 10 updates 14420 loss: 0.1880 lr: 5.8521e-04 gnorm: 0.3220
04/05/2020 10:48:19 > epoch 10 updates 14440 loss: 0.1362 lr: 5.8521e-04 gnorm: 0.3348
04/05/2020 10:48:22 train loss: 0.1620 lr: 5.8521e-04 gnorm: 0.3285 clip: 0
04/05/2020 10:48:22 valid loss: 0.2808 auc: 0.9539 f1: 0.8876 acc: 0.8860 [BEST: 0.8877]
04/05/2020 10:48:24 > epoch 10 updates 14460 loss: 0.1858 lr: 5.8521e-04 gnorm: 0.3802
04/05/2020 10:48:27 > epoch 10 updates 14480 loss: 0.1960 lr: 5.8521e-04 gnorm: 0.4059
04/05/2020 10:48:30 > epoch 10 updates 14500 loss: 0.2433 lr: 5.8521e-04 gnorm: 0.3530
04/05/2020 10:48:32 train loss: 0.2086 lr: 5.8521e-04 gnorm: 0.3796 clip: 0
04/05/2020 10:48:32 valid loss: 0.2812 auc: 0.9536 f1: 0.8887 acc: 0.8861 [BEST: 0.8877]
04/05/2020 10:48:35 > epoch 10 updates 14520 loss: 0.2014 lr: 5.8521e-04 gnorm: 0.3278
04/05/2020 10:48:38 > epoch 10 updates 14540 loss: 0.1392 lr: 5.8521e-04 gnorm: 0.2532
04/05/2020 10:48:41 train loss: 0.1701 lr: 5.8521e-04 gnorm: 0.2903 clip: 0
04/05/2020 10:48:41 valid loss: 0.2862 auc: 0.9506 f1: 0.8871 acc: 0.8824 [BEST: 0.8877]
04/05/2020 10:48:43 > epoch 10 updates 14560 loss: 0.1836 lr: 5.8521e-04 gnorm: 0.3304
04/05/2020 10:48:46 > epoch 10 updates 14580 loss: 0.1940 lr: 5.8521e-04 gnorm: 0.3655
04/05/2020 10:48:49 > epoch 10 updates 14600 loss: 0.1168 lr: 5.8521e-04 gnorm: 0.2495
04/05/2020 10:48:50 train loss: 0.1646 lr: 5.8521e-04 gnorm: 0.3149 clip: 0
04/05/2020 10:48:50 valid loss: 0.2755 auc: 0.9555 f1: 0.8885 acc: 0.8863 [BEST: 0.8877]
04/05/2020 10:48:53 > epoch 10 updates 14620 loss: 0.1841 lr: 5.8521e-04 gnorm: 0.3293
04/05/2020 10:48:56 > epoch 10 updates 14640 loss: 0.2315 lr: 5.8521e-04 gnorm: 0.4296
04/05/2020 10:49:00 train loss: 0.2079 lr: 5.8521e-04 gnorm: 0.3797 clip: 0
04/05/2020 10:49:00 valid loss: 0.2798 auc: 0.9550 f1: 0.8863 acc: 0.8859 [BEST: 0.8877]
04/05/2020 10:49:01 > epoch 10 updates 14660 loss: 0.2232 lr: 5.8521e-04 gnorm: 0.3220
04/05/2020 10:49:04 > epoch 10 updates 14680 loss: 0.1250 lr: 5.8521e-04 gnorm: 0.2420
04/05/2020 10:49:07 > epoch 10 updates 14700 loss: 0.1021 lr: 5.8521e-04 gnorm: 0.2439
04/05/2020 10:49:09 train loss: 0.1497 lr: 5.8521e-04 gnorm: 0.2690 clip: 0
04/05/2020 10:49:09 valid loss: 0.2854 auc: 0.9518 f1: 0.8861 acc: 0.8838 [BEST: 0.8877]
04/05/2020 10:49:12 > epoch 10 updates 14720 loss: 0.1767 lr: 5.8521e-04 gnorm: 0.2586
04/05/2020 10:49:15 > epoch 10 updates 14740 loss: 0.1684 lr: 5.8521e-04 gnorm: 0.3023
04/05/2020 10:49:19 train loss: 0.1725 lr: 5.8521e-04 gnorm: 0.2806 clip: 0
04/05/2020 10:49:19 valid loss: 0.2807 auc: 0.9543 f1: 0.8850 acc: 0.8846 [BEST: 0.8877]
04/05/2020 10:49:20 > epoch 10 updates 14760 loss: 0.1753 lr: 5.8521e-04 gnorm: 0.3035
04/05/2020 10:49:23 > epoch 10 updates 14780 loss: 0.1751 lr: 5.8521e-04 gnorm: 0.2911
04/05/2020 10:49:26 > epoch 10 updates 14800 loss: 0.2048 lr: 5.8521e-04 gnorm: 0.3079
04/05/2020 10:49:28 train loss: 0.1851 lr: 5.8521e-04 gnorm: 0.3008 clip: 0
04/05/2020 10:49:28 valid loss: 0.2942 auc: 0.9489 f1: 0.8837 acc: 0.8787 [BEST: 0.8877]
04/05/2020 10:49:31 > epoch 10 updates 14820 loss: 0.2318 lr: 5.8521e-04 gnorm: 0.3932
04/05/2020 10:49:34 > epoch 10 updates 14840 loss: 0.1472 lr: 5.8521e-04 gnorm: 0.2803
04/05/2020 10:49:38 train loss: 0.1893 lr: 5.8521e-04 gnorm: 0.3364 clip: 0
04/05/2020 10:49:38 valid loss: 0.2726 auc: 0.9561 f1: 0.8918 acc: 0.8881 [NEW BEST]
04/05/2020 10:49:39 > epoch 10 updates 14860 loss: 0.1908 lr: 5.8521e-04 gnorm: 0.4228
04/05/2020 10:49:43 > epoch 10 updates 14880 loss: 0.1763 lr: 5.8521e-04 gnorm: 0.2683
04/05/2020 10:49:45 > epoch 10 updates 14900 loss: 0.1392 lr: 5.8521e-04 gnorm: 0.2939
04/05/2020 10:49:47 train loss: 0.1686 lr: 5.8521e-04 gnorm: 0.3279 clip: 0
04/05/2020 10:49:47 valid loss: 0.2851 auc: 0.9517 f1: 0.8839 acc: 0.8815 [BEST: 0.8881]
04/05/2020 10:49:50 > epoch 10 updates 14920 loss: 0.2363 lr: 5.8521e-04 gnorm: 0.3831
04/05/2020 10:49:53 > epoch 10 updates 14940 loss: 0.1795 lr: 5.8521e-04 gnorm: 0.2793
04/05/2020 10:49:57 train loss: 0.2077 lr: 5.8521e-04 gnorm: 0.3309 clip: 0
04/05/2020 10:49:57 valid loss: 0.2765 auc: 0.9550 f1: 0.8892 acc: 0.8869 [BEST: 0.8881]
04/05/2020 10:49:58 > epoch 10 updates 14960 loss: 0.1652 lr: 5.8521e-04 gnorm: 0.3169
04/05/2020 10:50:01 > epoch 10 updates 14980 loss: 0.1816 lr: 5.8521e-04 gnorm: 0.3177
04/05/2020 10:50:04 > epoch 10 updates 15000 loss: 0.2227 lr: 5.8521e-04 gnorm: 0.3508
04/05/2020 10:50:06 train loss: 0.1900 lr: 5.8521e-04 gnorm: 0.3286 clip: 0
04/05/2020 10:50:06 valid loss: 0.2836 auc: 0.9534 f1: 0.8854 acc: 0.8818 [BEST: 0.8881]
04/05/2020 10:50:09 > epoch 10 updates 15020 loss: 0.0838 lr: 5.5595e-04 gnorm: 0.3846
04/05/2020 10:50:11 train loss: 0.0838 lr: 5.5595e-04 gnorm: 0.3846 clip: 0
04/05/2020 10:50:11 valid loss: 0.2768 auc: 0.9546 f1: 0.8868 acc: 0.8842 [BEST: 0.8881]
04/05/2020 10:50:11 Epoch: 11
04/05/2020 10:50:17 > epoch 11 updates 15040 loss: 0.1724 lr: 5.5595e-04 gnorm: 0.3270
04/05/2020 10:50:20 train loss: 0.1724 lr: 5.5595e-04 gnorm: 0.3270 clip: 0
04/05/2020 10:50:20 valid loss: 0.2951 auc: 0.9524 f1: 0.8824 acc: 0.8820 [BEST: 0.8881]
04/05/2020 10:50:22 > epoch 11 updates 15060 loss: 0.1645 lr: 5.5595e-04 gnorm: 0.3042
04/05/2020 10:50:25 > epoch 11 updates 15080 loss: 0.1788 lr: 5.5595e-04 gnorm: 0.3384
04/05/2020 10:50:28 > epoch 11 updates 15100 loss: 0.1646 lr: 5.5595e-04 gnorm: 0.2922
04/05/2020 10:50:30 train loss: 0.1693 lr: 5.5595e-04 gnorm: 0.3115 clip: 0
04/05/2020 10:50:30 valid loss: 0.2899 auc: 0.9519 f1: 0.8846 acc: 0.8830 [BEST: 0.8881]
04/05/2020 10:50:33 > epoch 11 updates 15120 loss: 0.1534 lr: 5.5595e-04 gnorm: 0.3206
04/05/2020 10:50:36 > epoch 11 updates 15140 loss: 0.1772 lr: 5.5595e-04 gnorm: 0.3519
04/05/2020 10:50:39 train loss: 0.1654 lr: 5.5595e-04 gnorm: 0.3363 clip: 0
04/05/2020 10:50:39 valid loss: 0.2919 auc: 0.9526 f1: 0.8852 acc: 0.8831 [BEST: 0.8881]
04/05/2020 10:50:40 > epoch 11 updates 15160 loss: 0.1639 lr: 5.5595e-04 gnorm: 0.3317
04/05/2020 10:50:43 > epoch 11 updates 15180 loss: 0.1507 lr: 5.5595e-04 gnorm: 0.2630
04/05/2020 10:50:46 > epoch 11 updates 15200 loss: 0.1451 lr: 5.5595e-04 gnorm: 0.2819
04/05/2020 10:50:48 train loss: 0.1532 lr: 5.5595e-04 gnorm: 0.2920 clip: 0
04/05/2020 10:50:48 valid loss: 0.2853 auc: 0.9535 f1: 0.8891 acc: 0.8871 [BEST: 0.8881]
04/05/2020 10:50:51 > epoch 11 updates 15220 loss: 0.1469 lr: 5.5595e-04 gnorm: 0.2885
04/05/2020 10:50:54 > epoch 11 updates 15240 loss: 0.1901 lr: 5.5595e-04 gnorm: 0.3602
04/05/2020 10:50:58 train loss: 0.1686 lr: 5.5595e-04 gnorm: 0.3245 clip: 0
04/05/2020 10:50:58 valid loss: 0.2842 auc: 0.9535 f1: 0.8870 acc: 0.8848 [BEST: 0.8881]
04/05/2020 10:50:59 > epoch 11 updates 15260 loss: 0.1483 lr: 5.5595e-04 gnorm: 0.3261
04/05/2020 10:51:02 > epoch 11 updates 15280 loss: 0.1865 lr: 5.5595e-04 gnorm: 0.3602
04/05/2020 10:51:05 > epoch 11 updates 15300 loss: 0.1417 lr: 5.5595e-04 gnorm: 0.3270
04/05/2020 10:51:07 train loss: 0.1588 lr: 5.5595e-04 gnorm: 0.3378 clip: 0
04/05/2020 10:51:07 valid loss: 0.2881 auc: 0.9537 f1: 0.8865 acc: 0.8848 [BEST: 0.8881]
04/05/2020 10:51:10 > epoch 11 updates 15320 loss: 0.1732 lr: 5.5595e-04 gnorm: 0.3679
04/05/2020 10:51:13 > epoch 11 updates 15340 loss: 0.1714 lr: 5.5595e-04 gnorm: 0.3680
04/05/2020 10:51:16 train loss: 0.1723 lr: 5.5595e-04 gnorm: 0.3679 clip: 0
04/05/2020 10:51:16 valid loss: 0.2959 auc: 0.9515 f1: 0.8813 acc: 0.8799 [BEST: 0.8881]
04/05/2020 10:51:18 > epoch 11 updates 15360 loss: 0.1562 lr: 5.5595e-04 gnorm: 0.2797
04/05/2020 10:51:21 > epoch 11 updates 15380 loss: 0.1216 lr: 5.5595e-04 gnorm: 0.3088
04/05/2020 10:51:24 > epoch 11 updates 15400 loss: 0.1966 lr: 5.5595e-04 gnorm: 0.3496
04/05/2020 10:51:26 train loss: 0.1583 lr: 5.5595e-04 gnorm: 0.3129 clip: 0
04/05/2020 10:51:26 valid loss: 0.2999 auc: 0.9517 f1: 0.8836 acc: 0.8808 [BEST: 0.8881]
04/05/2020 10:51:29 > epoch 11 updates 15420 loss: 0.1392 lr: 5.5595e-04 gnorm: 0.3545
04/05/2020 10:51:32 > epoch 11 updates 15440 loss: 0.1051 lr: 5.5595e-04 gnorm: 0.2715
04/05/2020 10:51:35 train loss: 0.1221 lr: 5.5595e-04 gnorm: 0.3128 clip: 0
04/05/2020 10:51:35 valid loss: 0.3034 auc: 0.9507 f1: 0.8812 acc: 0.8793 [BEST: 0.8881]
04/05/2020 10:51:36 > epoch 11 updates 15460 loss: 0.1590 lr: 5.5595e-04 gnorm: 0.3816
04/05/2020 10:51:40 > epoch 11 updates 15480 loss: 0.1720 lr: 5.5595e-04 gnorm: 0.3006
04/05/2020 10:51:43 > epoch 11 updates 15500 loss: 0.2133 lr: 5.5595e-04 gnorm: 0.3854
04/05/2020 10:51:44 train loss: 0.1816 lr: 5.5595e-04 gnorm: 0.3559 clip: 0
04/05/2020 10:51:44 valid loss: 0.2950 auc: 0.9524 f1: 0.8862 acc: 0.8831 [BEST: 0.8881]
04/05/2020 10:51:47 > epoch 11 updates 15520 loss: 0.1517 lr: 5.5595e-04 gnorm: 0.2712
04/05/2020 10:51:50 > epoch 11 updates 15540 loss: 0.2577 lr: 5.5595e-04 gnorm: 0.4695
04/05/2020 10:51:54 train loss: 0.2050 lr: 5.5595e-04 gnorm: 0.3708 clip: 0
04/05/2020 10:51:54 valid loss: 0.2923 auc: 0.9510 f1: 0.8837 acc: 0.8797 [BEST: 0.8881]
04/05/2020 10:51:55 > epoch 11 updates 15560 loss: 0.1844 lr: 5.5595e-04 gnorm: 0.3337
04/05/2020 10:51:58 > epoch 11 updates 15580 loss: 0.1544 lr: 5.5595e-04 gnorm: 0.2954
04/05/2020 10:52:01 > epoch 11 updates 15600 loss: 0.1496 lr: 5.5595e-04 gnorm: 0.3017
04/05/2020 10:52:03 train loss: 0.1627 lr: 5.5595e-04 gnorm: 0.3102 clip: 0
04/05/2020 10:52:03 valid loss: 0.2904 auc: 0.9533 f1: 0.8846 acc: 0.8835 [BEST: 0.8881]
04/05/2020 10:52:06 > epoch 11 updates 15620 loss: 0.1453 lr: 5.5595e-04 gnorm: 0.2755
04/05/2020 10:52:09 > epoch 11 updates 15640 loss: 0.1559 lr: 5.5595e-04 gnorm: 0.3399
04/05/2020 10:52:12 train loss: 0.1507 lr: 5.5595e-04 gnorm: 0.3078 clip: 0
04/05/2020 10:52:12 valid loss: 0.2869 auc: 0.9529 f1: 0.8887 acc: 0.8864 [BEST: 0.8881]
04/05/2020 10:52:14 > epoch 11 updates 15660 loss: 0.1971 lr: 5.5595e-04 gnorm: 0.4491
04/05/2020 10:52:17 > epoch 11 updates 15680 loss: 0.1588 lr: 5.5595e-04 gnorm: 0.3362
04/05/2020 10:52:20 > epoch 11 updates 15700 loss: 0.1917 lr: 5.5595e-04 gnorm: 0.3936
04/05/2020 10:52:22 train loss: 0.1825 lr: 5.5595e-04 gnorm: 0.3928 clip: 0
04/05/2020 10:52:22 valid loss: 0.2846 auc: 0.9543 f1: 0.8899 acc: 0.8864 [BEST: 0.8881]
04/05/2020 10:52:25 > epoch 11 updates 15720 loss: 0.1829 lr: 5.5595e-04 gnorm: 0.3563
04/05/2020 10:52:28 > epoch 11 updates 15740 loss: 0.2351 lr: 5.5595e-04 gnorm: 0.4191
04/05/2020 10:52:31 train loss: 0.2091 lr: 5.5595e-04 gnorm: 0.3878 clip: 0
04/05/2020 10:52:31 valid loss: 0.2820 auc: 0.9539 f1: 0.8891 acc: 0.8865 [BEST: 0.8881]
04/05/2020 10:52:33 > epoch 11 updates 15760 loss: 0.1870 lr: 5.5595e-04 gnorm: 0.3306
04/05/2020 10:52:36 > epoch 11 updates 15780 loss: 0.1630 lr: 5.5595e-04 gnorm: 0.2794
04/05/2020 10:52:38 > epoch 11 updates 15800 loss: 0.1417 lr: 5.5595e-04 gnorm: 0.3027
04/05/2020 10:52:40 train loss: 0.1637 lr: 5.5595e-04 gnorm: 0.3041 clip: 0
04/05/2020 10:52:40 valid loss: 0.2849 auc: 0.9538 f1: 0.8884 acc: 0.8860 [BEST: 0.8881]
04/05/2020 10:52:43 > epoch 11 updates 15820 loss: 0.2379 lr: 5.5595e-04 gnorm: 0.4020
04/05/2020 10:52:46 > epoch 11 updates 15840 loss: 0.1548 lr: 5.5595e-04 gnorm: 0.2939
04/05/2020 10:52:50 train loss: 0.1961 lr: 5.5595e-04 gnorm: 0.3476 clip: 0
04/05/2020 10:52:50 valid loss: 0.2905 auc: 0.9519 f1: 0.8891 acc: 0.8845 [BEST: 0.8881]
04/05/2020 10:52:51 > epoch 11 updates 15860 loss: 0.2028 lr: 5.5595e-04 gnorm: 0.4662
04/05/2020 10:52:54 > epoch 11 updates 15880 loss: 0.2271 lr: 5.5595e-04 gnorm: 0.3414
04/05/2020 10:52:57 > epoch 11 updates 15900 loss: 0.2072 lr: 5.5595e-04 gnorm: 0.3978
04/05/2020 10:52:59 train loss: 0.2124 lr: 5.5595e-04 gnorm: 0.4016 clip: 0
04/05/2020 10:52:59 valid loss: 0.2823 auc: 0.9535 f1: 0.8895 acc: 0.8864 [BEST: 0.8881]
04/05/2020 10:53:02 > epoch 11 updates 15920 loss: 0.2129 lr: 5.5595e-04 gnorm: 0.3332
04/05/2020 10:53:05 > epoch 11 updates 15940 loss: 0.1986 lr: 5.5595e-04 gnorm: 0.3054
04/05/2020 10:53:08 train loss: 0.2057 lr: 5.5595e-04 gnorm: 0.3192 clip: 0
04/05/2020 10:53:08 valid loss: 0.2868 auc: 0.9515 f1: 0.8869 acc: 0.8844 [BEST: 0.8881]
04/05/2020 10:53:10 > epoch 11 updates 15960 loss: 0.1200 lr: 5.5595e-04 gnorm: 0.2490
04/05/2020 10:53:13 > epoch 11 updates 15980 loss: 0.1393 lr: 5.5595e-04 gnorm: 0.2737
04/05/2020 10:53:16 > epoch 11 updates 16000 loss: 0.1628 lr: 5.5595e-04 gnorm: 0.2824
04/05/2020 10:53:18 train loss: 0.1408 lr: 5.5595e-04 gnorm: 0.2685 clip: 0
04/05/2020 10:53:18 valid loss: 0.2925 auc: 0.9507 f1: 0.8854 acc: 0.8820 [BEST: 0.8881]
04/05/2020 10:53:21 > epoch 11 updates 16020 loss: 0.1585 lr: 5.2815e-04 gnorm: 0.3826
04/05/2020 10:53:24 > epoch 11 updates 16040 loss: 0.1511 lr: 5.2815e-04 gnorm: 0.2855
04/05/2020 10:53:27 train loss: 0.1548 lr: 5.2815e-04 gnorm: 0.3338 clip: 0
04/05/2020 10:53:27 valid loss: 0.2902 auc: 0.9529 f1: 0.8865 acc: 0.8848 [BEST: 0.8881]
04/05/2020 10:53:29 > epoch 11 updates 16060 loss: 0.2368 lr: 5.2815e-04 gnorm: 0.4108
04/05/2020 10:53:31 > epoch 11 updates 16080 loss: 0.1955 lr: 5.2815e-04 gnorm: 0.3602
04/05/2020 10:53:34 > epoch 11 updates 16100 loss: 0.1429 lr: 5.2815e-04 gnorm: 0.3163
04/05/2020 10:53:37 train loss: 0.1914 lr: 5.2815e-04 gnorm: 0.3621 clip: 0
04/05/2020 10:53:37 valid loss: 0.2829 auc: 0.9543 f1: 0.8903 acc: 0.8886 [NEW BEST]
04/05/2020 10:53:40 > epoch 11 updates 16120 loss: 0.1891 lr: 5.2815e-04 gnorm: 0.3374
04/05/2020 10:53:43 > epoch 11 updates 16140 loss: 0.1881 lr: 5.2815e-04 gnorm: 0.3357
04/05/2020 10:53:46 train loss: 0.1886 lr: 5.2815e-04 gnorm: 0.3366 clip: 0
04/05/2020 10:53:46 valid loss: 0.2826 auc: 0.9525 f1: 0.8888 acc: 0.8862 [BEST: 0.8886]
04/05/2020 10:53:48 > epoch 11 updates 16160 loss: 0.1830 lr: 5.2815e-04 gnorm: 0.3971
04/05/2020 10:53:51 > epoch 11 updates 16180 loss: 0.2280 lr: 5.2815e-04 gnorm: 0.4731
04/05/2020 10:53:53 > epoch 11 updates 16200 loss: 0.1776 lr: 5.2815e-04 gnorm: 0.3030
04/05/2020 10:53:56 train loss: 0.1962 lr: 5.2815e-04 gnorm: 0.3907 clip: 0
04/05/2020 10:53:56 valid loss: 0.2788 auc: 0.9546 f1: 0.8907 acc: 0.8870 [BEST: 0.8886]
04/05/2020 10:53:59 > epoch 11 updates 16220 loss: 0.1733 lr: 5.2815e-04 gnorm: 0.2710
04/05/2020 10:54:02 > epoch 11 updates 16240 loss: 0.2028 lr: 5.2815e-04 gnorm: 0.3461
04/05/2020 10:54:05 train loss: 0.1881 lr: 5.2815e-04 gnorm: 0.3087 clip: 0
04/05/2020 10:54:05 valid loss: 0.2822 auc: 0.9535 f1: 0.8888 acc: 0.8860 [BEST: 0.8886]
04/05/2020 10:54:07 > epoch 11 updates 16260 loss: 0.1269 lr: 5.2815e-04 gnorm: 0.2559
04/05/2020 10:54:10 > epoch 11 updates 16280 loss: 0.1596 lr: 5.2815e-04 gnorm: 0.2420
04/05/2020 10:54:13 > epoch 11 updates 16300 loss: 0.1764 lr: 5.2815e-04 gnorm: 0.2808
04/05/2020 10:54:15 train loss: 0.1545 lr: 5.2815e-04 gnorm: 0.2596 clip: 0
04/05/2020 10:54:15 valid loss: 0.2813 auc: 0.9532 f1: 0.8877 acc: 0.8865 [BEST: 0.8886]
04/05/2020 10:54:17 > epoch 11 updates 16320 loss: 0.2331 lr: 5.2815e-04 gnorm: 0.3305
04/05/2020 10:54:20 > epoch 11 updates 16340 loss: 0.1576 lr: 5.2815e-04 gnorm: 0.3250
04/05/2020 10:54:24 train loss: 0.1952 lr: 5.2815e-04 gnorm: 0.3277 clip: 0
04/05/2020 10:54:24 valid loss: 0.2826 auc: 0.9527 f1: 0.8879 acc: 0.8853 [BEST: 0.8886]
04/05/2020 10:54:25 > epoch 11 updates 16360 loss: 0.1764 lr: 5.2815e-04 gnorm: 0.2921
04/05/2020 10:54:28 > epoch 11 updates 16380 loss: 0.2350 lr: 5.2815e-04 gnorm: 0.3702
04/05/2020 10:54:31 > epoch 11 updates 16400 loss: 0.2210 lr: 5.2815e-04 gnorm: 0.4225
04/05/2020 10:54:33 train loss: 0.2110 lr: 5.2815e-04 gnorm: 0.3620 clip: 0
04/05/2020 10:54:33 valid loss: 0.2911 auc: 0.9520 f1: 0.8869 acc: 0.8839 [BEST: 0.8886]
04/05/2020 10:54:36 > epoch 11 updates 16420 loss: 0.1427 lr: 5.2815e-04 gnorm: 0.2972
04/05/2020 10:54:39 > epoch 11 updates 16440 loss: 0.1624 lr: 5.2815e-04 gnorm: 0.3123
04/05/2020 10:54:42 train loss: 0.1526 lr: 5.2815e-04 gnorm: 0.3048 clip: 0
04/05/2020 10:54:42 valid loss: 0.2917 auc: 0.9515 f1: 0.8835 acc: 0.8815 [BEST: 0.8886]
04/05/2020 10:54:44 > epoch 11 updates 16460 loss: 0.1715 lr: 5.2815e-04 gnorm: 0.3080
04/05/2020 10:54:47 > epoch 11 updates 16480 loss: 0.1528 lr: 5.2815e-04 gnorm: 0.2965
04/05/2020 10:54:49 > epoch 11 updates 16500 loss: 0.1427 lr: 5.2815e-04 gnorm: 0.2918
04/05/2020 10:54:51 train loss: 0.1556 lr: 5.2815e-04 gnorm: 0.2987 clip: 0
04/05/2020 10:54:51 valid loss: 0.2889 auc: 0.9518 f1: 0.8852 acc: 0.8827 [BEST: 0.8886]
04/05/2020 10:54:54 > epoch 11 updates 16520 loss: 0.1575 lr: 5.2815e-04 gnorm: 0.3478
04/05/2020 10:54:56 train loss: 0.1575 lr: 5.2815e-04 gnorm: 0.3478 clip: 0
04/05/2020 10:54:56 valid loss: 0.2890 auc: 0.9531 f1: 0.8830 acc: 0.8826 [BEST: 0.8886]
04/05/2020 10:54:56 Epoch: 12
04/05/2020 10:55:02 > epoch 12 updates 16540 loss: 0.2070 lr: 5.2815e-04 gnorm: 0.3162
04/05/2020 10:55:06 train loss: 0.2070 lr: 5.2815e-04 gnorm: 0.3162 clip: 0
04/05/2020 10:55:06 valid loss: 0.2877 auc: 0.9525 f1: 0.8876 acc: 0.8846 [BEST: 0.8886]
04/05/2020 10:55:07 > epoch 12 updates 16560 loss: 0.2002 lr: 5.2815e-04 gnorm: 0.3683
04/05/2020 10:55:10 > epoch 12 updates 16580 loss: 0.1880 lr: 5.2815e-04 gnorm: 0.3229
04/05/2020 10:55:13 > epoch 12 updates 16600 loss: 0.1471 lr: 5.2815e-04 gnorm: 0.3512
04/05/2020 10:55:15 train loss: 0.1783 lr: 5.2815e-04 gnorm: 0.3474 clip: 0
04/05/2020 10:55:15 valid loss: 0.2925 auc: 0.9530 f1: 0.8871 acc: 0.8849 [BEST: 0.8886]
04/05/2020 10:55:18 > epoch 12 updates 16620 loss: 0.2004 lr: 5.2815e-04 gnorm: 0.3642
04/05/2020 10:55:21 > epoch 12 updates 16640 loss: 0.1843 lr: 5.2815e-04 gnorm: 0.3426
04/05/2020 10:55:24 train loss: 0.1923 lr: 5.2815e-04 gnorm: 0.3534 clip: 0
04/05/2020 10:55:24 valid loss: 0.2917 auc: 0.9529 f1: 0.8861 acc: 0.8837 [BEST: 0.8886]
04/05/2020 10:55:26 > epoch 12 updates 16660 loss: 0.1808 lr: 5.2815e-04 gnorm: 0.3404
04/05/2020 10:55:29 > epoch 12 updates 16680 loss: 0.1212 lr: 5.2815e-04 gnorm: 0.2268
04/05/2020 10:55:32 > epoch 12 updates 16700 loss: 0.1798 lr: 5.2815e-04 gnorm: 0.3824
04/05/2020 10:55:34 train loss: 0.1606 lr: 5.2815e-04 gnorm: 0.3167 clip: 0
04/05/2020 10:55:34 valid loss: 0.2997 auc: 0.9519 f1: 0.8842 acc: 0.8821 [BEST: 0.8886]
04/05/2020 10:55:36 > epoch 12 updates 16720 loss: 0.1492 lr: 5.2815e-04 gnorm: 0.3124
04/05/2020 10:55:39 > epoch 12 updates 16740 loss: 0.1768 lr: 5.2815e-04 gnorm: 0.3051
04/05/2020 10:55:43 train loss: 0.1631 lr: 5.2815e-04 gnorm: 0.3087 clip: 0
04/05/2020 10:55:43 valid loss: 0.2875 auc: 0.9536 f1: 0.8884 acc: 0.8856 [BEST: 0.8886]
04/05/2020 10:55:44 > epoch 12 updates 16760 loss: 0.1244 lr: 5.2815e-04 gnorm: 0.2672
04/05/2020 10:55:47 > epoch 12 updates 16780 loss: 0.1694 lr: 5.2815e-04 gnorm: 0.3480
04/05/2020 10:55:50 > epoch 12 updates 16800 loss: 0.1713 lr: 5.2815e-04 gnorm: 0.3653
04/05/2020 10:55:52 train loss: 0.1552 lr: 5.2815e-04 gnorm: 0.3272 clip: 0
04/05/2020 10:55:52 valid loss: 0.3046 auc: 0.9527 f1: 0.8880 acc: 0.8825 [BEST: 0.8886]
04/05/2020 10:55:55 > epoch 12 updates 16820 loss: 0.1813 lr: 5.2815e-04 gnorm: 0.3488
04/05/2020 10:55:58 > epoch 12 updates 16840 loss: 0.1410 lr: 5.2815e-04 gnorm: 0.3123
04/05/2020 10:56:01 train loss: 0.1610 lr: 5.2815e-04 gnorm: 0.3304 clip: 0
04/05/2020 10:56:01 valid loss: 0.2868 auc: 0.9560 f1: 0.8914 acc: 0.8881 [BEST: 0.8886]
04/05/2020 10:56:03 > epoch 12 updates 16860 loss: 0.1225 lr: 5.2815e-04 gnorm: 0.2612
04/05/2020 10:56:06 > epoch 12 updates 16880 loss: 0.1603 lr: 5.2815e-04 gnorm: 0.3239
04/05/2020 10:56:09 > epoch 12 updates 16900 loss: 0.1898 lr: 5.2815e-04 gnorm: 0.3676
04/05/2020 10:56:11 train loss: 0.1578 lr: 5.2815e-04 gnorm: 0.3179 clip: 0
04/05/2020 10:56:11 valid loss: 0.2970 auc: 0.9521 f1: 0.8870 acc: 0.8844 [BEST: 0.8886]
04/05/2020 10:56:13 > epoch 12 updates 16920 loss: 0.1115 lr: 5.2815e-04 gnorm: 0.2507
04/05/2020 10:56:16 > epoch 12 updates 16940 loss: 0.1613 lr: 5.2815e-04 gnorm: 0.3271
04/05/2020 10:56:20 train loss: 0.1365 lr: 5.2815e-04 gnorm: 0.2891 clip: 0
04/05/2020 10:56:20 valid loss: 0.2947 auc: 0.9542 f1: 0.8888 acc: 0.8848 [BEST: 0.8886]
04/05/2020 10:56:21 > epoch 12 updates 16960 loss: 0.1398 lr: 5.2815e-04 gnorm: 0.3389
04/05/2020 10:56:24 > epoch 12 updates 16980 loss: 0.1222 lr: 5.2815e-04 gnorm: 0.3281
04/05/2020 10:56:27 > epoch 12 updates 17000 loss: 0.1262 lr: 5.2815e-04 gnorm: 0.2792
04/05/2020 10:56:29 train loss: 0.1294 lr: 5.2815e-04 gnorm: 0.3152 clip: 0
04/05/2020 10:56:29 valid loss: 0.2985 auc: 0.9546 f1: 0.8826 acc: 0.8836 [BEST: 0.8886]
04/05/2020 10:56:32 > epoch 12 updates 17020 loss: 0.1470 lr: 5.0174e-04 gnorm: 0.3159
04/05/2020 10:56:35 > epoch 12 updates 17040 loss: 0.1042 lr: 5.0174e-04 gnorm: 0.2339
04/05/2020 10:56:38 train loss: 0.1255 lr: 5.0174e-04 gnorm: 0.2747 clip: 0
04/05/2020 10:56:38 valid loss: 0.2958 auc: 0.9523 f1: 0.8869 acc: 0.8849 [BEST: 0.8886]
04/05/2020 10:56:40 > epoch 12 updates 17060 loss: 0.1560 lr: 5.0174e-04 gnorm: 0.4365
04/05/2020 10:56:43 > epoch 12 updates 17080 loss: 0.1800 lr: 5.0174e-04 gnorm: 0.3925
04/05/2020 10:56:46 > epoch 12 updates 17100 loss: 0.1742 lr: 5.0174e-04 gnorm: 0.3778
04/05/2020 10:56:48 train loss: 0.1701 lr: 5.0174e-04 gnorm: 0.4021 clip: 0
04/05/2020 10:56:48 valid loss: 0.2961 auc: 0.9530 f1: 0.8888 acc: 0.8853 [BEST: 0.8886]
04/05/2020 10:56:51 > epoch 12 updates 17120 loss: 0.1100 lr: 5.0174e-04 gnorm: 0.3127
04/05/2020 10:56:54 > epoch 12 updates 17140 loss: 0.2162 lr: 5.0174e-04 gnorm: 0.4032
04/05/2020 10:56:57 train loss: 0.1634 lr: 5.0174e-04 gnorm: 0.3582 clip: 0
04/05/2020 10:56:57 valid loss: 0.2819 auc: 0.9555 f1: 0.8899 acc: 0.8868 [BEST: 0.8886]
04/05/2020 10:56:59 > epoch 12 updates 17160 loss: 0.1353 lr: 5.0174e-04 gnorm: 0.3537
04/05/2020 10:57:02 > epoch 12 updates 17180 loss: 0.1865 lr: 5.0174e-04 gnorm: 0.3135
04/05/2020 10:57:05 > epoch 12 updates 17200 loss: 0.1557 lr: 5.0174e-04 gnorm: 0.3452
04/05/2020 10:57:07 train loss: 0.1592 lr: 5.0174e-04 gnorm: 0.3374 clip: 0
04/05/2020 10:57:07 valid loss: 0.2958 auc: 0.9539 f1: 0.8886 acc: 0.8854 [BEST: 0.8886]
04/05/2020 10:57:10 > epoch 12 updates 17220 loss: 0.1518 lr: 5.0174e-04 gnorm: 0.3584
04/05/2020 10:57:12 > epoch 12 updates 17240 loss: 0.1574 lr: 5.0174e-04 gnorm: 0.3204
04/05/2020 10:57:16 train loss: 0.1546 lr: 5.0174e-04 gnorm: 0.3393 clip: 0
04/05/2020 10:57:16 valid loss: 0.2955 auc: 0.9558 f1: 0.8908 acc: 0.8867 [BEST: 0.8886]
04/05/2020 10:57:17 > epoch 12 updates 17260 loss: 0.1621 lr: 5.0174e-04 gnorm: 0.3184
04/05/2020 10:57:20 > epoch 12 updates 17280 loss: 0.1385 lr: 5.0174e-04 gnorm: 0.2667
04/05/2020 10:57:23 > epoch 12 updates 17300 loss: 0.1739 lr: 5.0174e-04 gnorm: 0.3780
04/05/2020 10:57:25 train loss: 0.1582 lr: 5.0174e-04 gnorm: 0.3212 clip: 0
04/05/2020 10:57:25 valid loss: 0.2910 auc: 0.9542 f1: 0.8868 acc: 0.8853 [BEST: 0.8886]
04/05/2020 10:57:28 > epoch 12 updates 17320 loss: 0.1714 lr: 5.0174e-04 gnorm: 0.3601
04/05/2020 10:57:31 > epoch 12 updates 17340 loss: 0.1701 lr: 5.0174e-04 gnorm: 0.3143
04/05/2020 10:57:34 train loss: 0.1707 lr: 5.0174e-04 gnorm: 0.3371 clip: 0
04/05/2020 10:57:34 valid loss: 0.2916 auc: 0.9538 f1: 0.8850 acc: 0.8839 [BEST: 0.8886]
04/05/2020 10:57:36 > epoch 12 updates 17360 loss: 0.1278 lr: 5.0174e-04 gnorm: 0.2894
04/05/2020 10:57:39 > epoch 12 updates 17380 loss: 0.1560 lr: 5.0174e-04 gnorm: 0.3102
04/05/2020 10:57:42 > epoch 12 updates 17400 loss: 0.1315 lr: 5.0174e-04 gnorm: 0.3777
04/05/2020 10:57:44 train loss: 0.1385 lr: 5.0174e-04 gnorm: 0.3260 clip: 0
04/05/2020 10:57:44 valid loss: 0.2865 auc: 0.9548 f1: 0.8874 acc: 0.8856 [BEST: 0.8886]
04/05/2020 10:57:46 > epoch 12 updates 17420 loss: 0.1701 lr: 5.0174e-04 gnorm: 0.3433
04/05/2020 10:57:49 > epoch 12 updates 17440 loss: 0.1506 lr: 5.0174e-04 gnorm: 0.3096
04/05/2020 10:57:53 train loss: 0.1603 lr: 5.0174e-04 gnorm: 0.3264 clip: 0
04/05/2020 10:57:53 valid loss: 0.2863 auc: 0.9524 f1: 0.8880 acc: 0.8849 [BEST: 0.8886]
04/05/2020 10:57:54 > epoch 12 updates 17460 loss: 0.1761 lr: 5.0174e-04 gnorm: 0.3291
04/05/2020 10:57:57 > epoch 12 updates 17480 loss: 0.1584 lr: 5.0174e-04 gnorm: 0.3074
04/05/2020 10:58:00 > epoch 12 updates 17500 loss: 0.1813 lr: 5.0174e-04 gnorm: 0.3069
04/05/2020 10:58:02 train loss: 0.1719 lr: 5.0174e-04 gnorm: 0.3144 clip: 0
04/05/2020 10:58:02 valid loss: 0.2819 auc: 0.9544 f1: 0.8880 acc: 0.8863 [BEST: 0.8886]
04/05/2020 10:58:05 > epoch 12 updates 17520 loss: 0.1227 lr: 5.0174e-04 gnorm: 0.2450
04/05/2020 10:58:08 > epoch 12 updates 17540 loss: 0.1503 lr: 5.0174e-04 gnorm: 0.2727
04/05/2020 10:58:12 train loss: 0.1366 lr: 5.0174e-04 gnorm: 0.2589 clip: 0
04/05/2020 10:58:12 valid loss: 0.2876 auc: 0.9540 f1: 0.8854 acc: 0.8840 [BEST: 0.8886]
04/05/2020 10:58:13 > epoch 12 updates 17560 loss: 0.1692 lr: 5.0174e-04 gnorm: 0.3078
04/05/2020 10:58:16 > epoch 12 updates 17580 loss: 0.1397 lr: 5.0174e-04 gnorm: 0.2747
04/05/2020 10:58:19 > epoch 12 updates 17600 loss: 0.1432 lr: 5.0174e-04 gnorm: 0.3298
04/05/2020 10:58:21 train loss: 0.1506 lr: 5.0174e-04 gnorm: 0.3042 clip: 0
04/05/2020 10:58:21 valid loss: 0.2934 auc: 0.9531 f1: 0.8853 acc: 0.8826 [BEST: 0.8886]
04/05/2020 10:58:24 > epoch 12 updates 17620 loss: 0.2040 lr: 5.0174e-04 gnorm: 0.3940
04/05/2020 10:58:27 > epoch 12 updates 17640 loss: 0.1728 lr: 5.0174e-04 gnorm: 0.4326
04/05/2020 10:58:30 train loss: 0.1884 lr: 5.0174e-04 gnorm: 0.4134 clip: 0
04/05/2020 10:58:30 valid loss: 0.2844 auc: 0.9528 f1: 0.8864 acc: 0.8844 [BEST: 0.8886]
04/05/2020 10:58:31 > epoch 12 updates 17660 loss: 0.1864 lr: 5.0174e-04 gnorm: 0.2961
04/05/2020 10:58:34 > epoch 12 updates 17680 loss: 0.1195 lr: 5.0174e-04 gnorm: 0.2709
04/05/2020 10:58:37 > epoch 12 updates 17700 loss: 0.1888 lr: 5.0174e-04 gnorm: 0.3864
04/05/2020 10:58:39 train loss: 0.1649 lr: 5.0174e-04 gnorm: 0.3181 clip: 0
04/05/2020 10:58:39 valid loss: 0.2884 auc: 0.9533 f1: 0.8880 acc: 0.8852 [BEST: 0.8886]
04/05/2020 10:58:42 > epoch 12 updates 17720 loss: 0.1451 lr: 5.0174e-04 gnorm: 0.2847
04/05/2020 10:58:45 > epoch 12 updates 17740 loss: 0.1596 lr: 5.0174e-04 gnorm: 0.3467
04/05/2020 10:58:48 train loss: 0.1524 lr: 5.0174e-04 gnorm: 0.3158 clip: 0
04/05/2020 10:58:48 valid loss: 0.2915 auc: 0.9512 f1: 0.8844 acc: 0.8812 [BEST: 0.8886]
04/05/2020 10:58:50 > epoch 12 updates 17760 loss: 0.1766 lr: 5.0174e-04 gnorm: 0.3469
04/05/2020 10:58:53 > epoch 12 updates 17780 loss: 0.1694 lr: 5.0174e-04 gnorm: 0.3835
04/05/2020 10:58:56 > epoch 12 updates 17800 loss: 0.1840 lr: 5.0174e-04 gnorm: 0.4303
04/05/2020 10:58:57 train loss: 0.1767 lr: 5.0174e-04 gnorm: 0.3872 clip: 0
04/05/2020 10:58:57 valid loss: 0.2945 auc: 0.9524 f1: 0.8818 acc: 0.8818 [BEST: 0.8886]
04/05/2020 10:59:00 > epoch 12 updates 17820 loss: 0.1703 lr: 5.0174e-04 gnorm: 0.3260
04/05/2020 10:59:03 > epoch 12 updates 17840 loss: 0.2210 lr: 5.0174e-04 gnorm: 0.3707
04/05/2020 10:59:07 train loss: 0.1958 lr: 5.0174e-04 gnorm: 0.3485 clip: 0
04/05/2020 10:59:07 valid loss: 0.2920 auc: 0.9520 f1: 0.8847 acc: 0.8811 [BEST: 0.8886]
04/05/2020 10:59:08 > epoch 12 updates 17860 loss: 0.1470 lr: 5.0174e-04 gnorm: 0.2917
04/05/2020 10:59:11 > epoch 12 updates 17880 loss: 0.1270 lr: 5.0174e-04 gnorm: 0.2466
04/05/2020 10:59:14 > epoch 12 updates 17900 loss: 0.1512 lr: 5.0174e-04 gnorm: 0.3215
04/05/2020 10:59:16 train loss: 0.1417 lr: 5.0174e-04 gnorm: 0.2867 clip: 0
04/05/2020 10:59:16 valid loss: 0.2901 auc: 0.9539 f1: 0.8891 acc: 0.8858 [BEST: 0.8886]
04/05/2020 10:59:19 > epoch 12 updates 17920 loss: 0.1939 lr: 5.0174e-04 gnorm: 0.4121
04/05/2020 10:59:22 > epoch 12 updates 17940 loss: 0.1594 lr: 5.0174e-04 gnorm: 0.3079
04/05/2020 10:59:25 train loss: 0.1766 lr: 5.0174e-04 gnorm: 0.3597 clip: 0
04/05/2020 10:59:25 valid loss: 0.2832 auc: 0.9539 f1: 0.8900 acc: 0.8882 [BEST: 0.8886]
04/05/2020 10:59:27 > epoch 12 updates 17960 loss: 0.1488 lr: 5.0174e-04 gnorm: 0.3036
04/05/2020 10:59:30 > epoch 12 updates 17980 loss: 0.1586 lr: 5.0174e-04 gnorm: 0.3300
04/05/2020 10:59:33 > epoch 12 updates 18000 loss: 0.1296 lr: 5.0174e-04 gnorm: 0.2373
04/05/2020 10:59:35 train loss: 0.1456 lr: 5.0174e-04 gnorm: 0.2901 clip: 0
04/05/2020 10:59:35 valid loss: 0.2829 auc: 0.9542 f1: 0.8894 acc: 0.8861 [BEST: 0.8886]
04/05/2020 10:59:38 > epoch 12 updates 18020 loss: 0.1469 lr: 4.7666e-04 gnorm: 0.2444
04/05/2020 10:59:40 train loss: 0.1469 lr: 4.7666e-04 gnorm: 0.2444 clip: 0
04/05/2020 10:59:40 valid loss: 0.2849 auc: 0.9536 f1: 0.8886 acc: 0.8854 [BEST: 0.8886]
04/05/2020 10:59:40 Epoch: 13
04/05/2020 10:59:46 > epoch 13 updates 18040 loss: 0.1183 lr: 4.7666e-04 gnorm: 0.2860
04/05/2020 10:59:50 train loss: 0.1183 lr: 4.7666e-04 gnorm: 0.2860 clip: 0
04/05/2020 10:59:50 valid loss: 0.2986 auc: 0.9514 f1: 0.8859 acc: 0.8829 [BEST: 0.8886]
04/05/2020 10:59:51 > epoch 13 updates 18060 loss: 0.1337 lr: 4.7666e-04 gnorm: 0.3338
04/05/2020 10:59:54 > epoch 13 updates 18080 loss: 0.1376 lr: 4.7666e-04 gnorm: 0.3473
04/05/2020 10:59:57 > epoch 13 updates 18100 loss: 0.1892 lr: 4.7666e-04 gnorm: 0.3616
04/05/2020 10:59:59 train loss: 0.1537 lr: 4.7666e-04 gnorm: 0.3477 clip: 0
04/05/2020 10:59:59 valid loss: 0.3107 auc: 0.9488 f1: 0.8783 acc: 0.8778 [BEST: 0.8886]
04/05/2020 11:00:02 > epoch 13 updates 18120 loss: 0.0897 lr: 4.7666e-04 gnorm: 0.2135
04/05/2020 11:00:05 > epoch 13 updates 18140 loss: 0.1471 lr: 4.7666e-04 gnorm: 0.2721
04/05/2020 11:00:09 train loss: 0.1185 lr: 4.7666e-04 gnorm: 0.2430 clip: 0
04/05/2020 11:00:09 valid loss: 0.2971 auc: 0.9525 f1: 0.8860 acc: 0.8832 [BEST: 0.8886]
04/05/2020 11:00:10 > epoch 13 updates 18160 loss: 0.1414 lr: 4.7666e-04 gnorm: 0.3313
04/05/2020 11:00:13 > epoch 13 updates 18180 loss: 0.1432 lr: 4.7666e-04 gnorm: 0.3697
04/05/2020 11:00:16 > epoch 13 updates 18200 loss: 0.1073 lr: 4.7666e-04 gnorm: 0.2575
04/05/2020 11:00:18 train loss: 0.1305 lr: 4.7666e-04 gnorm: 0.3193 clip: 0
04/05/2020 11:00:18 valid loss: 0.2903 auc: 0.9531 f1: 0.8912 acc: 0.8882 [BEST: 0.8886]
04/05/2020 11:00:21 > epoch 13 updates 18220 loss: 0.0987 lr: 4.7666e-04 gnorm: 0.2927
04/05/2020 11:00:24 > epoch 13 updates 18240 loss: 0.1446 lr: 4.7666e-04 gnorm: 0.3270
04/05/2020 11:00:27 train loss: 0.1218 lr: 4.7666e-04 gnorm: 0.3099 clip: 0
04/05/2020 11:00:27 valid loss: 0.2918 auc: 0.9544 f1: 0.8843 acc: 0.8839 [BEST: 0.8886]
04/05/2020 11:00:29 > epoch 13 updates 18260 loss: 0.1949 lr: 4.7666e-04 gnorm: 0.3430
04/05/2020 11:00:32 > epoch 13 updates 18280 loss: 0.1384 lr: 4.7666e-04 gnorm: 0.3203
04/05/2020 11:00:35 > epoch 13 updates 18300 loss: 0.1999 lr: 4.7666e-04 gnorm: 0.4320
04/05/2020 11:00:37 train loss: 0.1778 lr: 4.7666e-04 gnorm: 0.3654 clip: 0
04/05/2020 11:00:37 valid loss: 0.3017 auc: 0.9528 f1: 0.8863 acc: 0.8843 [BEST: 0.8886]
04/05/2020 11:00:39 > epoch 13 updates 18320 loss: 0.1263 lr: 4.7666e-04 gnorm: 0.2841
04/05/2020 11:00:43 > epoch 13 updates 18340 loss: 0.1831 lr: 4.7666e-04 gnorm: 0.3561
04/05/2020 11:00:46 train loss: 0.1548 lr: 4.7666e-04 gnorm: 0.3203 clip: 0
04/05/2020 11:00:46 valid loss: 0.2941 auc: 0.9541 f1: 0.8873 acc: 0.8858 [BEST: 0.8886]
04/05/2020 11:00:47 > epoch 13 updates 18360 loss: 0.1482 lr: 4.7666e-04 gnorm: 0.3296
04/05/2020 11:00:50 > epoch 13 updates 18380 loss: 0.1693 lr: 4.7666e-04 gnorm: 0.3434
04/05/2020 11:00:53 > epoch 13 updates 18400 loss: 0.1218 lr: 4.7666e-04 gnorm: 0.3331
04/05/2020 11:00:55 train loss: 0.1463 lr: 4.7666e-04 gnorm: 0.3354 clip: 0
04/05/2020 11:00:55 valid loss: 0.3011 auc: 0.9517 f1: 0.8848 acc: 0.8831 [BEST: 0.8886]
04/05/2020 11:00:58 > epoch 13 updates 18420 loss: 0.1327 lr: 4.7666e-04 gnorm: 0.3010
04/05/2020 11:01:01 > epoch 13 updates 18440 loss: 0.1851 lr: 4.7666e-04 gnorm: 0.4091
04/05/2020 11:01:04 train loss: 0.1590 lr: 4.7666e-04 gnorm: 0.3553 clip: 0
04/05/2020 11:01:04 valid loss: 0.3066 auc: 0.9514 f1: 0.8829 acc: 0.8820 [BEST: 0.8886]
04/05/2020 11:01:06 > epoch 13 updates 18460 loss: 0.1370 lr: 4.7666e-04 gnorm: 0.4075
04/05/2020 11:01:09 > epoch 13 updates 18480 loss: 0.1025 lr: 4.7666e-04 gnorm: 0.2638
04/05/2020 11:01:12 > epoch 13 updates 18500 loss: 0.1839 lr: 4.7666e-04 gnorm: 0.3592
04/05/2020 11:01:14 train loss: 0.1413 lr: 4.7666e-04 gnorm: 0.3434 clip: 0
04/05/2020 11:01:14 valid loss: 0.2970 auc: 0.9531 f1: 0.8890 acc: 0.8859 [BEST: 0.8886]
04/05/2020 11:01:17 > epoch 13 updates 18520 loss: 0.1613 lr: 4.7666e-04 gnorm: 0.3227
04/05/2020 11:01:20 > epoch 13 updates 18540 loss: 0.1139 lr: 4.7666e-04 gnorm: 0.2854
04/05/2020 11:01:23 train loss: 0.1375 lr: 4.7666e-04 gnorm: 0.3040 clip: 0
04/05/2020 11:01:23 valid loss: 0.2965 auc: 0.9543 f1: 0.8890 acc: 0.8868 [BEST: 0.8886]
04/05/2020 11:01:25 > epoch 13 updates 18560 loss: 0.1807 lr: 4.7666e-04 gnorm: 0.4028
04/05/2020 11:01:28 > epoch 13 updates 18580 loss: 0.1499 lr: 4.7666e-04 gnorm: 0.3726
04/05/2020 11:01:31 > epoch 13 updates 18600 loss: 0.1452 lr: 4.7666e-04 gnorm: 0.3910
04/05/2020 11:01:33 train loss: 0.1585 lr: 4.7666e-04 gnorm: 0.3887 clip: 0
04/05/2020 11:01:33 valid loss: 0.2992 auc: 0.9539 f1: 0.8874 acc: 0.8848 [BEST: 0.8886]
04/05/2020 11:01:36 > epoch 13 updates 18620 loss: 0.1873 lr: 4.7666e-04 gnorm: 0.4525
04/05/2020 11:01:39 > epoch 13 updates 18640 loss: 0.1561 lr: 4.7666e-04 gnorm: 0.4023
04/05/2020 11:01:42 train loss: 0.1716 lr: 4.7666e-04 gnorm: 0.4273 clip: 0
04/05/2020 11:01:42 valid loss: 0.2946 auc: 0.9522 f1: 0.8854 acc: 0.8830 [BEST: 0.8886]
04/05/2020 11:01:44 > epoch 13 updates 18660 loss: 0.1450 lr: 4.7666e-04 gnorm: 0.3130
04/05/2020 11:01:47 > epoch 13 updates 18680 loss: 0.0883 lr: 4.7666e-04 gnorm: 0.2891
04/05/2020 11:01:50 > epoch 13 updates 18700 loss: 0.2181 lr: 4.7666e-04 gnorm: 0.3870
04/05/2020 11:01:52 train loss: 0.1507 lr: 4.7666e-04 gnorm: 0.3300 clip: 0
04/05/2020 11:01:52 valid loss: 0.2911 auc: 0.9535 f1: 0.8902 acc: 0.8877 [BEST: 0.8886]
04/05/2020 11:01:54 > epoch 13 updates 18720 loss: 0.1537 lr: 4.7666e-04 gnorm: 0.4009
04/05/2020 11:01:57 > epoch 13 updates 18740 loss: 0.1538 lr: 4.7666e-04 gnorm: 0.3710
04/05/2020 11:02:01 train loss: 0.1538 lr: 4.7666e-04 gnorm: 0.3859 clip: 0
04/05/2020 11:02:01 valid loss: 0.2945 auc: 0.9542 f1: 0.8896 acc: 0.8877 [BEST: 0.8886]
04/05/2020 11:02:02 > epoch 13 updates 18760 loss: 0.1428 lr: 4.7666e-04 gnorm: 0.3892
04/05/2020 11:02:05 > epoch 13 updates 18780 loss: 0.1624 lr: 4.7666e-04 gnorm: 0.3184
04/05/2020 11:02:08 > epoch 13 updates 18800 loss: 0.1903 lr: 4.7666e-04 gnorm: 0.3492
04/05/2020 11:02:10 train loss: 0.1653 lr: 4.7666e-04 gnorm: 0.3521 clip: 0
04/05/2020 11:02:10 valid loss: 0.2968 auc: 0.9521 f1: 0.8885 acc: 0.8859 [BEST: 0.8886]
04/05/2020 11:02:13 > epoch 13 updates 18820 loss: 0.1366 lr: 4.7666e-04 gnorm: 0.2989
04/05/2020 11:02:16 > epoch 13 updates 18840 loss: 0.1188 lr: 4.7666e-04 gnorm: 0.3473
04/05/2020 11:02:19 train loss: 0.1276 lr: 4.7666e-04 gnorm: 0.3232 clip: 0
04/05/2020 11:02:19 valid loss: 0.2884 auc: 0.9530 f1: 0.8881 acc: 0.8858 [BEST: 0.8886]
04/05/2020 11:02:21 > epoch 13 updates 18860 loss: 0.1521 lr: 4.7666e-04 gnorm: 0.3163
04/05/2020 11:02:24 > epoch 13 updates 18880 loss: 0.0885 lr: 4.7666e-04 gnorm: 0.2317
04/05/2020 11:02:27 > epoch 13 updates 18900 loss: 0.1486 lr: 4.7666e-04 gnorm: 0.3718
04/05/2020 11:02:29 train loss: 0.1298 lr: 4.7666e-04 gnorm: 0.3068 clip: 0
04/05/2020 11:02:29 valid loss: 0.3000 auc: 0.9510 f1: 0.8885 acc: 0.8855 [BEST: 0.8886]
04/05/2020 11:02:32 > epoch 13 updates 18920 loss: 0.1073 lr: 4.7666e-04 gnorm: 0.2913
04/05/2020 11:02:34 > epoch 13 updates 18940 loss: 0.1246 lr: 4.7666e-04 gnorm: 0.3495
04/05/2020 11:02:38 train loss: 0.1160 lr: 4.7666e-04 gnorm: 0.3205 clip: 0
04/05/2020 11:02:38 valid loss: 0.2886 auc: 0.9544 f1: 0.8884 acc: 0.8866 [BEST: 0.8886]
04/05/2020 11:02:39 > epoch 13 updates 18960 loss: 0.1297 lr: 4.7666e-04 gnorm: 0.3007
04/05/2020 11:02:42 > epoch 13 updates 18980 loss: 0.1849 lr: 4.7666e-04 gnorm: 0.3911
04/05/2020 11:02:45 > epoch 13 updates 19000 loss: 0.1802 lr: 4.7666e-04 gnorm: 0.3473
04/05/2020 11:02:47 train loss: 0.1651 lr: 4.7666e-04 gnorm: 0.3465 clip: 0
04/05/2020 11:02:47 valid loss: 0.3005 auc: 0.9517 f1: 0.8878 acc: 0.8861 [BEST: 0.8886]
04/05/2020 11:02:51 > epoch 13 updates 19020 loss: 0.1392 lr: 4.5282e-04 gnorm: 0.2872
04/05/2020 11:02:54 > epoch 13 updates 19040 loss: 0.1900 lr: 4.5282e-04 gnorm: 0.3172
04/05/2020 11:02:57 train loss: 0.1647 lr: 4.5282e-04 gnorm: 0.3023 clip: 0
04/05/2020 11:02:57 valid loss: 0.2900 auc: 0.9540 f1: 0.8903 acc: 0.8881 [BEST: 0.8886]
04/05/2020 11:02:59 > epoch 13 updates 19060 loss: 0.1652 lr: 4.5282e-04 gnorm: 0.3175
04/05/2020 11:03:02 > epoch 13 updates 19080 loss: 0.1867 lr: 4.5282e-04 gnorm: 0.3529
04/05/2020 11:03:04 > epoch 13 updates 19100 loss: 0.1407 lr: 4.5282e-04 gnorm: 0.2893
04/05/2020 11:03:06 train loss: 0.1641 lr: 4.5282e-04 gnorm: 0.3198 clip: 0
04/05/2020 11:03:06 valid loss: 0.2972 auc: 0.9528 f1: 0.8878 acc: 0.8851 [BEST: 0.8886]
04/05/2020 11:03:10 > epoch 13 updates 19120 loss: 0.1962 lr: 4.5282e-04 gnorm: 0.4062
04/05/2020 11:03:12 > epoch 13 updates 19140 loss: 0.1519 lr: 4.5282e-04 gnorm: 0.3536
04/05/2020 11:03:16 train loss: 0.1740 lr: 4.5282e-04 gnorm: 0.3797 clip: 0
04/05/2020 11:03:16 valid loss: 0.2921 auc: 0.9534 f1: 0.8900 acc: 0.8874 [BEST: 0.8886]
04/05/2020 11:03:17 > epoch 13 updates 19160 loss: 0.1371 lr: 4.5282e-04 gnorm: 0.2862
04/05/2020 11:03:20 > epoch 13 updates 19180 loss: 0.1426 lr: 4.5282e-04 gnorm: 0.3049
04/05/2020 11:03:23 > epoch 13 updates 19200 loss: 0.1542 lr: 4.5282e-04 gnorm: 0.3328
04/05/2020 11:03:25 train loss: 0.1447 lr: 4.5282e-04 gnorm: 0.3081 clip: 0
04/05/2020 11:03:25 valid loss: 0.2863 auc: 0.9537 f1: 0.8875 acc: 0.8855 [BEST: 0.8886]
04/05/2020 11:03:28 > epoch 13 updates 19220 loss: 0.1252 lr: 4.5282e-04 gnorm: 0.3277
04/05/2020 11:03:31 > epoch 13 updates 19240 loss: 0.1055 lr: 4.5282e-04 gnorm: 0.2421
04/05/2020 11:03:34 train loss: 0.1153 lr: 4.5282e-04 gnorm: 0.2847 clip: 0
04/05/2020 11:03:34 valid loss: 0.2964 auc: 0.9528 f1: 0.8880 acc: 0.8847 [BEST: 0.8886]
04/05/2020 11:03:36 > epoch 13 updates 19260 loss: 0.1616 lr: 4.5282e-04 gnorm: 0.3012
04/05/2020 11:03:39 > epoch 13 updates 19280 loss: 0.1246 lr: 4.5282e-04 gnorm: 0.3159
04/05/2020 11:03:42 > epoch 13 updates 19300 loss: 0.1935 lr: 4.5282e-04 gnorm: 0.5002
04/05/2020 11:03:44 train loss: 0.1600 lr: 4.5282e-04 gnorm: 0.3731 clip: 0
04/05/2020 11:03:44 valid loss: 0.2860 auc: 0.9561 f1: 0.8900 acc: 0.8876 [BEST: 0.8886]
04/05/2020 11:03:47 > epoch 13 updates 19320 loss: 0.1315 lr: 4.5282e-04 gnorm: 0.2696
04/05/2020 11:03:50 > epoch 13 updates 19340 loss: 0.1790 lr: 4.5282e-04 gnorm: 0.3482
04/05/2020 11:03:53 train loss: 0.1554 lr: 4.5282e-04 gnorm: 0.3091 clip: 0
04/05/2020 11:03:53 valid loss: 0.2847 auc: 0.9543 f1: 0.8903 acc: 0.8880 [BEST: 0.8886]
04/05/2020 11:03:54 > epoch 13 updates 19360 loss: 0.2041 lr: 4.5282e-04 gnorm: 0.3834
04/05/2020 11:03:57 > epoch 13 updates 19380 loss: 0.1964 lr: 4.5282e-04 gnorm: 0.4091
04/05/2020 11:04:00 > epoch 13 updates 19400 loss: 0.1787 lr: 4.5282e-04 gnorm: 0.3314
04/05/2020 11:04:02 train loss: 0.1929 lr: 4.5282e-04 gnorm: 0.3745 clip: 0
04/05/2020 11:04:02 valid loss: 0.2932 auc: 0.9544 f1: 0.8897 acc: 0.8879 [BEST: 0.8886]
04/05/2020 11:04:05 > epoch 13 updates 19420 loss: 0.1812 lr: 4.5282e-04 gnorm: 0.3352
04/05/2020 11:04:08 > epoch 13 updates 19440 loss: 0.1643 lr: 4.5282e-04 gnorm: 0.3637
04/05/2020 11:04:12 train loss: 0.1727 lr: 4.5282e-04 gnorm: 0.3495 clip: 0
04/05/2020 11:04:12 valid loss: 0.2952 auc: 0.9534 f1: 0.8906 acc: 0.8865 [BEST: 0.8886]
04/05/2020 11:04:13 > epoch 13 updates 19460 loss: 0.1940 lr: 4.5282e-04 gnorm: 0.3881
04/05/2020 11:04:16 > epoch 13 updates 19480 loss: 0.1659 lr: 4.5282e-04 gnorm: 0.3275
04/05/2020 11:04:19 > epoch 13 updates 19500 loss: 0.1250 lr: 4.5282e-04 gnorm: 0.3175
04/05/2020 11:04:21 train loss: 0.1614 lr: 4.5282e-04 gnorm: 0.3441 clip: 0
04/05/2020 11:04:21 valid loss: 0.2917 auc: 0.9535 f1: 0.8903 acc: 0.8875 [BEST: 0.8886]
04/05/2020 11:04:24 > epoch 13 updates 19520 loss: 0.1787 lr: 4.5282e-04 gnorm: 0.3666
04/05/2020 11:04:26 train loss: 0.1787 lr: 4.5282e-04 gnorm: 0.3666 clip: 0
04/05/2020 11:04:26 valid loss: 0.2875 auc: 0.9552 f1: 0.8876 acc: 0.8871 [BEST: 0.8886]
04/05/2020 11:04:26 Epoch: 14
04/05/2020 11:04:32 > epoch 14 updates 19540 loss: 0.1380 lr: 4.5282e-04 gnorm: 0.2937
04/05/2020 11:04:35 train loss: 0.1380 lr: 4.5282e-04 gnorm: 0.2937 clip: 0
04/05/2020 11:04:35 valid loss: 0.2878 auc: 0.9548 f1: 0.8908 acc: 0.8884 [BEST: 0.8886]
04/05/2020 11:04:36 > epoch 14 updates 19560 loss: 0.1047 lr: 4.5282e-04 gnorm: 0.2517
04/05/2020 11:04:39 > epoch 14 updates 19580 loss: 0.1511 lr: 4.5282e-04 gnorm: 0.2882
04/05/2020 11:04:42 > epoch 14 updates 19600 loss: 0.1154 lr: 4.5282e-04 gnorm: 0.3059
04/05/2020 11:04:44 train loss: 0.1238 lr: 4.5282e-04 gnorm: 0.2821 clip: 0
04/05/2020 11:04:44 valid loss: 0.2926 auc: 0.9553 f1: 0.8892 acc: 0.8875 [BEST: 0.8886]
04/05/2020 11:04:47 > epoch 14 updates 19620 loss: 0.1806 lr: 4.5282e-04 gnorm: 0.4246
04/05/2020 11:04:50 > epoch 14 updates 19640 loss: 0.1345 lr: 4.5282e-04 gnorm: 0.3428
04/05/2020 11:04:54 train loss: 0.1574 lr: 4.5282e-04 gnorm: 0.3835 clip: 0
04/05/2020 11:04:54 valid loss: 0.3080 auc: 0.9531 f1: 0.8875 acc: 0.8857 [BEST: 0.8886]
04/05/2020 11:04:55 > epoch 14 updates 19660 loss: 0.1846 lr: 4.5282e-04 gnorm: 0.4230
04/05/2020 11:04:58 > epoch 14 updates 19680 loss: 0.1190 lr: 4.5282e-04 gnorm: 0.2669
04/05/2020 11:05:01 > epoch 14 updates 19700 loss: 0.1281 lr: 4.5282e-04 gnorm: 0.3176
04/05/2020 11:05:03 train loss: 0.1437 lr: 4.5282e-04 gnorm: 0.3354 clip: 0
04/05/2020 11:05:03 valid loss: 0.3062 auc: 0.9537 f1: 0.8861 acc: 0.8855 [BEST: 0.8886]
04/05/2020 11:05:06 > epoch 14 updates 19720 loss: 0.1446 lr: 4.5282e-04 gnorm: 0.3455
04/05/2020 11:05:09 > epoch 14 updates 19740 loss: 0.1761 lr: 4.5282e-04 gnorm: 0.3274
04/05/2020 11:05:12 train loss: 0.1604 lr: 4.5282e-04 gnorm: 0.3364 clip: 0
04/05/2020 11:05:12 valid loss: 0.2947 auc: 0.9534 f1: 0.8857 acc: 0.8846 [BEST: 0.8886]
04/05/2020 11:05:14 > epoch 14 updates 19760 loss: 0.1306 lr: 4.5282e-04 gnorm: 0.3236
04/05/2020 11:05:17 > epoch 14 updates 19780 loss: 0.1341 lr: 4.5282e-04 gnorm: 0.2969
04/05/2020 11:05:20 > epoch 14 updates 19800 loss: 0.1573 lr: 4.5282e-04 gnorm: 0.4212
04/05/2020 11:05:22 train loss: 0.1408 lr: 4.5282e-04 gnorm: 0.3476 clip: 0
04/05/2020 11:05:22 valid loss: 0.2987 auc: 0.9546 f1: 0.8918 acc: 0.8888 [NEW BEST]
04/05/2020 11:05:25 > epoch 14 updates 19820 loss: 0.1638 lr: 4.5282e-04 gnorm: 0.4080
04/05/2020 11:05:28 > epoch 14 updates 19840 loss: 0.1279 lr: 4.5282e-04 gnorm: 0.3326
04/05/2020 11:05:31 train loss: 0.1457 lr: 4.5282e-04 gnorm: 0.3701 clip: 0
04/05/2020 11:05:31 valid loss: 0.3014 auc: 0.9539 f1: 0.8866 acc: 0.8865 [BEST: 0.8888]
04/05/2020 11:05:33 > epoch 14 updates 19860 loss: 0.1299 lr: 4.5282e-04 gnorm: 0.3861
04/05/2020 11:05:36 > epoch 14 updates 19880 loss: 0.1613 lr: 4.5282e-04 gnorm: 0.4092
04/05/2020 11:05:38 > epoch 14 updates 19900 loss: 0.1272 lr: 4.5282e-04 gnorm: 0.3461
04/05/2020 11:05:40 train loss: 0.1395 lr: 4.5282e-04 gnorm: 0.3803 clip: 0
04/05/2020 11:05:40 valid loss: 0.2974 auc: 0.9541 f1: 0.8901 acc: 0.8885 [BEST: 0.8888]
04/05/2020 11:05:43 > epoch 14 updates 19920 loss: 0.1704 lr: 4.5282e-04 gnorm: 0.4540
04/05/2020 11:05:46 > epoch 14 updates 19940 loss: 0.1501 lr: 4.5282e-04 gnorm: 0.3549
04/05/2020 11:05:50 train loss: 0.1602 lr: 4.5282e-04 gnorm: 0.4042 clip: 0
04/05/2020 11:05:50 valid loss: 0.3003 auc: 0.9538 f1: 0.8891 acc: 0.8872 [BEST: 0.8888]
04/05/2020 11:05:51 > epoch 14 updates 19960 loss: 0.1136 lr: 4.5282e-04 gnorm: 0.2929
04/05/2020 11:05:54 > epoch 14 updates 19980 loss: 0.1314 lr: 4.5282e-04 gnorm: 0.3733
04/05/2020 11:05:57 > epoch 14 updates 20000 loss: 0.1467 lr: 4.5282e-04 gnorm: 0.3711
04/05/2020 11:05:59 train loss: 0.1307 lr: 4.5282e-04 gnorm: 0.3460 clip: 0
04/05/2020 11:05:59 valid loss: 0.2984 auc: 0.9535 f1: 0.8896 acc: 0.8862 [BEST: 0.8888]
04/05/2020 11:06:02 > epoch 14 updates 20020 loss: 0.1216 lr: 4.3018e-04 gnorm: 0.4210
04/05/2020 11:06:05 > epoch 14 updates 20040 loss: 0.1454 lr: 4.3018e-04 gnorm: 0.3505
04/05/2020 11:06:09 train loss: 0.1336 lr: 4.3018e-04 gnorm: 0.3856 clip: 0
04/05/2020 11:06:09 valid loss: 0.3051 auc: 0.9525 f1: 0.8865 acc: 0.8851 [BEST: 0.8888]
04/05/2020 11:06:10 > epoch 14 updates 20060 loss: 0.1336 lr: 4.3018e-04 gnorm: 0.3449
04/05/2020 11:06:13 > epoch 14 updates 20080 loss: 0.1256 lr: 4.3018e-04 gnorm: 0.3188
04/05/2020 11:06:16 > epoch 14 updates 20100 loss: 0.1200 lr: 4.3018e-04 gnorm: 0.3443
04/05/2020 11:06:18 train loss: 0.1263 lr: 4.3018e-04 gnorm: 0.3360 clip: 0
04/05/2020 11:06:18 valid loss: 0.3146 auc: 0.9499 f1: 0.8846 acc: 0.8801 [BEST: 0.8888]
04/05/2020 11:06:21 > epoch 14 updates 20120 loss: 0.1166 lr: 4.3018e-04 gnorm: 0.3405
04/05/2020 11:06:24 > epoch 14 updates 20140 loss: 0.1066 lr: 4.3018e-04 gnorm: 0.3980
04/05/2020 11:06:27 train loss: 0.1116 lr: 4.3018e-04 gnorm: 0.3694 clip: 0
04/05/2020 11:06:27 valid loss: 0.2954 auc: 0.9530 f1: 0.8903 acc: 0.8880 [BEST: 0.8888]
04/05/2020 11:06:29 > epoch 14 updates 20160 loss: 0.1616 lr: 4.3018e-04 gnorm: 0.3517
04/05/2020 11:06:32 > epoch 14 updates 20180 loss: 0.1119 lr: 4.3018e-04 gnorm: 0.2741
04/05/2020 11:06:34 > epoch 14 updates 20200 loss: 0.1603 lr: 4.3018e-04 gnorm: 0.3109
04/05/2020 11:06:36 train loss: 0.1446 lr: 4.3018e-04 gnorm: 0.3121 clip: 0
04/05/2020 11:06:36 valid loss: 0.2982 auc: 0.9531 f1: 0.8903 acc: 0.8883 [BEST: 0.8888]
04/05/2020 11:06:39 > epoch 14 updates 20220 loss: 0.1525 lr: 4.3018e-04 gnorm: 0.3477
04/05/2020 11:06:42 > epoch 14 updates 20240 loss: 0.1991 lr: 4.3018e-04 gnorm: 0.4517
04/05/2020 11:06:46 train loss: 0.1759 lr: 4.3018e-04 gnorm: 0.4000 clip: 0
04/05/2020 11:06:46 valid loss: 0.3043 auc: 0.9529 f1: 0.8892 acc: 0.8876 [BEST: 0.8888]
04/05/2020 11:06:47 > epoch 14 updates 20260 loss: 0.1871 lr: 4.3018e-04 gnorm: 0.3831
04/05/2020 11:06:50 > epoch 14 updates 20280 loss: 0.1106 lr: 4.3018e-04 gnorm: 0.2767
04/05/2020 11:06:53 > epoch 14 updates 20300 loss: 0.1438 lr: 4.3018e-04 gnorm: 0.3304
04/05/2020 11:06:55 train loss: 0.1470 lr: 4.3018e-04 gnorm: 0.3299 clip: 0
04/05/2020 11:06:55 valid loss: 0.2982 auc: 0.9526 f1: 0.8883 acc: 0.8865 [BEST: 0.8888]
04/05/2020 11:06:58 > epoch 14 updates 20320 loss: 0.1406 lr: 4.3018e-04 gnorm: 0.3686
04/05/2020 11:07:01 > epoch 14 updates 20340 loss: 0.1313 lr: 4.3018e-04 gnorm: 0.3122
04/05/2020 11:07:04 train loss: 0.1359 lr: 4.3018e-04 gnorm: 0.3403 clip: 0
04/05/2020 11:07:04 valid loss: 0.2967 auc: 0.9532 f1: 0.8879 acc: 0.8863 [BEST: 0.8888]
04/05/2020 11:07:06 > epoch 14 updates 20360 loss: 0.1499 lr: 4.3018e-04 gnorm: 0.3482
04/05/2020 11:07:09 > epoch 14 updates 20380 loss: 0.1780 lr: 4.3018e-04 gnorm: 0.4202
04/05/2020 11:07:12 > epoch 14 updates 20400 loss: 0.1613 lr: 4.3018e-04 gnorm: 0.3225
04/05/2020 11:07:14 train loss: 0.1631 lr: 4.3018e-04 gnorm: 0.3636 clip: 0
04/05/2020 11:07:14 valid loss: 0.2899 auc: 0.9538 f1: 0.8918 acc: 0.8898 [NEW BEST]
04/05/2020 11:07:17 > epoch 14 updates 20420 loss: 0.1607 lr: 4.3018e-04 gnorm: 0.3719
04/05/2020 11:07:20 > epoch 14 updates 20440 loss: 0.1527 lr: 4.3018e-04 gnorm: 0.3465
04/05/2020 11:07:24 train loss: 0.1567 lr: 4.3018e-04 gnorm: 0.3591 clip: 0
04/05/2020 11:07:24 valid loss: 0.2936 auc: 0.9529 f1: 0.8882 acc: 0.8868 [BEST: 0.8898]
04/05/2020 11:07:25 > epoch 14 updates 20460 loss: 0.1833 lr: 4.3018e-04 gnorm: 0.4078
04/05/2020 11:07:28 > epoch 14 updates 20480 loss: 0.1398 lr: 4.3018e-04 gnorm: 0.3636
04/05/2020 11:07:31 > epoch 14 updates 20500 loss: 0.1692 lr: 4.3018e-04 gnorm: 0.4677
04/05/2020 11:07:33 train loss: 0.1641 lr: 4.3018e-04 gnorm: 0.4132 clip: 0
04/05/2020 11:07:33 valid loss: 0.2933 auc: 0.9534 f1: 0.8903 acc: 0.8875 [BEST: 0.8898]
04/05/2020 11:07:36 > epoch 14 updates 20520 loss: 0.2354 lr: 4.3018e-04 gnorm: 0.4041
04/05/2020 11:07:39 > epoch 14 updates 20540 loss: 0.1257 lr: 4.3018e-04 gnorm: 0.2975
04/05/2020 11:07:42 train loss: 0.1803 lr: 4.3018e-04 gnorm: 0.3505 clip: 0
04/05/2020 11:07:42 valid loss: 0.2976 auc: 0.9536 f1: 0.8928 acc: 0.8892 [BEST: 0.8898]
04/05/2020 11:07:44 > epoch 14 updates 20560 loss: 0.1752 lr: 4.3018e-04 gnorm: 0.3823
04/05/2020 11:07:46 > epoch 14 updates 20580 loss: 0.1199 lr: 4.3018e-04 gnorm: 0.3146
04/05/2020 11:07:50 > epoch 14 updates 20600 loss: 0.2102 lr: 4.3018e-04 gnorm: 0.3945
04/05/2020 11:07:52 train loss: 0.1685 lr: 4.3018e-04 gnorm: 0.3638 clip: 0
04/05/2020 11:07:52 valid loss: 0.2937 auc: 0.9540 f1: 0.8921 acc: 0.8900 [NEW BEST]
04/05/2020 11:07:55 > epoch 14 updates 20620 loss: 0.1090 lr: 4.3018e-04 gnorm: 0.2928
04/05/2020 11:07:58 > epoch 14 updates 20640 loss: 0.1674 lr: 4.3018e-04 gnorm: 0.4231
04/05/2020 11:08:01 train loss: 0.1384 lr: 4.3018e-04 gnorm: 0.3583 clip: 0
04/05/2020 11:08:01 valid loss: 0.2997 auc: 0.9531 f1: 0.8914 acc: 0.8876 [BEST: 0.8900]
04/05/2020 11:08:03 > epoch 14 updates 20660 loss: 0.1328 lr: 4.3018e-04 gnorm: 0.3073
04/05/2020 11:08:06 > epoch 14 updates 20680 loss: 0.1747 lr: 4.3018e-04 gnorm: 0.3902
04/05/2020 11:08:09 > epoch 14 updates 20700 loss: 0.1192 lr: 4.3018e-04 gnorm: 0.2586
04/05/2020 11:08:11 train loss: 0.1422 lr: 4.3018e-04 gnorm: 0.3186 clip: 0
04/05/2020 11:08:11 valid loss: 0.2977 auc: 0.9535 f1: 0.8891 acc: 0.8862 [BEST: 0.8900]
04/05/2020 11:08:13 > epoch 14 updates 20720 loss: 0.1431 lr: 4.3018e-04 gnorm: 0.3522
04/05/2020 11:08:16 > epoch 14 updates 20740 loss: 0.1300 lr: 4.3018e-04 gnorm: 0.3774
04/05/2020 11:08:20 train loss: 0.1365 lr: 4.3018e-04 gnorm: 0.3648 clip: 0
04/05/2020 11:08:20 valid loss: 0.2952 auc: 0.9533 f1: 0.8903 acc: 0.8880 [BEST: 0.8900]
04/05/2020 11:08:21 > epoch 14 updates 20760 loss: 0.1648 lr: 4.3018e-04 gnorm: 0.3574
04/05/2020 11:08:24 > epoch 14 updates 20780 loss: 0.1426 lr: 4.3018e-04 gnorm: 0.3843
04/05/2020 11:08:27 > epoch 14 updates 20800 loss: 0.1481 lr: 4.3018e-04 gnorm: 0.3289
04/05/2020 11:08:29 train loss: 0.1518 lr: 4.3018e-04 gnorm: 0.3568 clip: 0
04/05/2020 11:08:29 valid loss: 0.2902 auc: 0.9541 f1: 0.8914 acc: 0.8887 [BEST: 0.8900]
04/05/2020 11:08:32 > epoch 14 updates 20820 loss: 0.2148 lr: 4.3018e-04 gnorm: 0.3841
04/05/2020 11:08:35 > epoch 14 updates 20840 loss: 0.1552 lr: 4.3018e-04 gnorm: 0.3562
04/05/2020 11:08:39 train loss: 0.1848 lr: 4.3018e-04 gnorm: 0.3701 clip: 0
04/05/2020 11:08:39 valid loss: 0.2952 auc: 0.9520 f1: 0.8893 acc: 0.8858 [BEST: 0.8900]
04/05/2020 11:08:40 > epoch 14 updates 20860 loss: 0.1147 lr: 4.3018e-04 gnorm: 0.2545
04/05/2020 11:08:43 > epoch 14 updates 20880 loss: 0.1269 lr: 4.3018e-04 gnorm: 0.3369
04/05/2020 11:08:46 > epoch 14 updates 20900 loss: 0.2114 lr: 4.3018e-04 gnorm: 0.3560
04/05/2020 11:08:48 train loss: 0.1513 lr: 4.3018e-04 gnorm: 0.3161 clip: 0
04/05/2020 11:08:48 valid loss: 0.2977 auc: 0.9521 f1: 0.8875 acc: 0.8859 [BEST: 0.8900]
04/05/2020 11:08:51 > epoch 14 updates 20920 loss: 0.1907 lr: 4.3018e-04 gnorm: 0.3512
04/05/2020 11:08:54 > epoch 14 updates 20940 loss: 0.1428 lr: 4.3018e-04 gnorm: 0.3107
04/05/2020 11:08:57 train loss: 0.1666 lr: 4.3018e-04 gnorm: 0.3308 clip: 0
04/05/2020 11:08:57 valid loss: 0.2927 auc: 0.9541 f1: 0.8908 acc: 0.8884 [BEST: 0.8900]
04/05/2020 11:08:58 > epoch 14 updates 20960 loss: 0.1560 lr: 4.3018e-04 gnorm: 0.4364
04/05/2020 11:09:01 > epoch 14 updates 20980 loss: 0.1682 lr: 4.3018e-04 gnorm: 0.3435
04/05/2020 11:09:04 > epoch 14 updates 21000 loss: 0.1348 lr: 4.3018e-04 gnorm: 0.2825
04/05/2020 11:09:06 train loss: 0.1529 lr: 4.3018e-04 gnorm: 0.3536 clip: 0
04/05/2020 11:09:06 valid loss: 0.2885 auc: 0.9555 f1: 0.8944 acc: 0.8916 [NEW BEST]
04/05/2020 11:09:10 > epoch 14 updates 21020 loss: 0.1259 lr: 4.0867e-04 gnorm: 0.3094
04/05/2020 11:09:13 train loss: 0.1259 lr: 4.0867e-04 gnorm: 0.3094 clip: 0
04/05/2020 11:09:13 valid loss: 0.2968 auc: 0.9536 f1: 0.8909 acc: 0.8875 [BEST: 0.8916]
04/05/2020 11:09:13 Epoch: 15
04/05/2020 11:09:18 > epoch 15 updates 21040 loss: 0.1968 lr: 4.0867e-04 gnorm: 0.4318
04/05/2020 11:09:22 train loss: 0.1968 lr: 4.0867e-04 gnorm: 0.4318 clip: 0
04/05/2020 11:09:22 valid loss: 0.2920 auc: 0.9541 f1: 0.8907 acc: 0.8877 [BEST: 0.8916]
04/05/2020 11:09:23 > epoch 15 updates 21060 loss: 0.1276 lr: 4.0867e-04 gnorm: 0.4040
04/05/2020 11:09:26 > epoch 15 updates 21080 loss: 0.1511 lr: 4.0867e-04 gnorm: 0.3515
04/05/2020 11:09:29 > epoch 15 updates 21100 loss: 0.1464 lr: 4.0867e-04 gnorm: 0.3353
04/05/2020 11:09:31 train loss: 0.1417 lr: 4.0867e-04 gnorm: 0.3634 clip: 0
04/05/2020 11:09:31 valid loss: 0.3012 auc: 0.9549 f1: 0.8900 acc: 0.8884 [BEST: 0.8916]
04/05/2020 11:09:34 > epoch 15 updates 21120 loss: 0.1337 lr: 4.0867e-04 gnorm: 0.3465
04/05/2020 11:09:36 > epoch 15 updates 21140 loss: 0.0902 lr: 4.0867e-04 gnorm: 0.2890
04/05/2020 11:09:40 train loss: 0.1118 lr: 4.0867e-04 gnorm: 0.3176 clip: 0
04/05/2020 11:09:40 valid loss: 0.3068 auc: 0.9522 f1: 0.8896 acc: 0.8872 [BEST: 0.8916]
04/05/2020 11:09:41 > epoch 15 updates 21160 loss: 0.1284 lr: 4.0867e-04 gnorm: 0.2894
04/05/2020 11:09:44 > epoch 15 updates 21180 loss: 0.1194 lr: 4.0867e-04 gnorm: 0.3226
04/05/2020 11:09:47 > epoch 15 updates 21200 loss: 0.1461 lr: 4.0867e-04 gnorm: 0.3955
04/05/2020 11:09:49 train loss: 0.1313 lr: 4.0867e-04 gnorm: 0.3362 clip: 0
04/05/2020 11:09:49 valid loss: 0.3028 auc: 0.9531 f1: 0.8909 acc: 0.8890 [BEST: 0.8916]
04/05/2020 11:09:52 > epoch 15 updates 21220 loss: 0.1367 lr: 4.0867e-04 gnorm: 0.4374
04/05/2020 11:09:55 > epoch 15 updates 21240 loss: 0.1598 lr: 4.0867e-04 gnorm: 0.3870
04/05/2020 11:09:59 train loss: 0.1483 lr: 4.0867e-04 gnorm: 0.4121 clip: 0
04/05/2020 11:09:59 valid loss: 0.3049 auc: 0.9522 f1: 0.8907 acc: 0.8885 [BEST: 0.8916]
04/05/2020 11:10:00 > epoch 15 updates 21260 loss: 0.1491 lr: 4.0867e-04 gnorm: 0.3148
04/05/2020 11:10:03 > epoch 15 updates 21280 loss: 0.1650 lr: 4.0867e-04 gnorm: 0.4324
04/05/2020 11:10:06 > epoch 15 updates 21300 loss: 0.1292 lr: 4.0867e-04 gnorm: 0.3397
04/05/2020 11:10:08 train loss: 0.1477 lr: 4.0867e-04 gnorm: 0.3624 clip: 0
04/05/2020 11:10:08 valid loss: 0.2987 auc: 0.9535 f1: 0.8929 acc: 0.8904 [BEST: 0.8916]
04/05/2020 11:10:11 > epoch 15 updates 21320 loss: 0.0939 lr: 4.0867e-04 gnorm: 0.3358
04/05/2020 11:10:14 > epoch 15 updates 21340 loss: 0.1015 lr: 4.0867e-04 gnorm: 0.3271
04/05/2020 11:10:17 train loss: 0.0977 lr: 4.0867e-04 gnorm: 0.3315 clip: 0
04/05/2020 11:10:17 valid loss: 0.3134 auc: 0.9516 f1: 0.8861 acc: 0.8856 [BEST: 0.8916]
04/05/2020 11:10:19 > epoch 15 updates 21360 loss: 0.1566 lr: 4.0867e-04 gnorm: 0.3364
04/05/2020 11:10:22 > epoch 15 updates 21380 loss: 0.1486 lr: 4.0867e-04 gnorm: 0.3107
04/05/2020 11:10:24 > epoch 15 updates 21400 loss: 0.1438 lr: 4.0867e-04 gnorm: 0.3665
04/05/2020 11:10:26 train loss: 0.1496 lr: 4.0867e-04 gnorm: 0.3380 clip: 0
04/05/2020 11:10:26 valid loss: 0.3057 auc: 0.9528 f1: 0.8885 acc: 0.8868 [BEST: 0.8916]
04/05/2020 11:10:29 > epoch 15 updates 21420 loss: 0.1340 lr: 4.0867e-04 gnorm: 0.3178
04/05/2020 11:10:32 > epoch 15 updates 21440 loss: 0.1405 lr: 4.0867e-04 gnorm: 0.3563
04/05/2020 11:10:35 train loss: 0.1373 lr: 4.0867e-04 gnorm: 0.3371 clip: 0
04/05/2020 11:10:35 valid loss: 0.3117 auc: 0.9511 f1: 0.8871 acc: 0.8841 [BEST: 0.8916]
04/05/2020 11:10:37 > epoch 15 updates 21460 loss: 0.1219 lr: 4.0867e-04 gnorm: 0.2859
04/05/2020 11:10:40 > epoch 15 updates 21480 loss: 0.1066 lr: 4.0867e-04 gnorm: 0.2633
04/05/2020 11:10:43 > epoch 15 updates 21500 loss: 0.1867 lr: 4.0867e-04 gnorm: 0.3900
04/05/2020 11:10:45 train loss: 0.1386 lr: 4.0867e-04 gnorm: 0.3134 clip: 0
04/05/2020 11:10:45 valid loss: 0.3077 auc: 0.9522 f1: 0.8895 acc: 0.8873 [BEST: 0.8916]
04/05/2020 11:10:48 > epoch 15 updates 21520 loss: 0.1439 lr: 4.0867e-04 gnorm: 0.4122
04/05/2020 11:10:51 > epoch 15 updates 21540 loss: 0.1770 lr: 4.0867e-04 gnorm: 0.4341
04/05/2020 11:10:54 train loss: 0.1605 lr: 4.0867e-04 gnorm: 0.4232 clip: 0
04/05/2020 11:10:54 valid loss: 0.2968 auc: 0.9553 f1: 0.8927 acc: 0.8915 [BEST: 0.8916]
04/05/2020 11:10:56 > epoch 15 updates 21560 loss: 0.1303 lr: 4.0867e-04 gnorm: 0.2746
04/05/2020 11:10:59 > epoch 15 updates 21580 loss: 0.1247 lr: 4.0867e-04 gnorm: 0.3198
04/05/2020 11:11:02 > epoch 15 updates 21600 loss: 0.1145 lr: 4.0867e-04 gnorm: 0.3261
04/05/2020 11:11:04 train loss: 0.1231 lr: 4.0867e-04 gnorm: 0.3070 clip: 0
04/05/2020 11:11:04 valid loss: 0.3039 auc: 0.9510 f1: 0.8886 acc: 0.8844 [BEST: 0.8916]
04/05/2020 11:11:07 > epoch 15 updates 21620 loss: 0.1363 lr: 4.0867e-04 gnorm: 0.3659
04/05/2020 11:11:10 > epoch 15 updates 21640 loss: 0.1878 lr: 4.0867e-04 gnorm: 0.4832
04/05/2020 11:11:13 train loss: 0.1622 lr: 4.0867e-04 gnorm: 0.4249 clip: 0
04/05/2020 11:11:13 valid loss: 0.2966 auc: 0.9547 f1: 0.8917 acc: 0.8904 [BEST: 0.8916]
04/05/2020 11:11:15 > epoch 15 updates 21660 loss: 0.1460 lr: 4.0867e-04 gnorm: 0.4164
04/05/2020 11:11:18 > epoch 15 updates 21680 loss: 0.1131 lr: 4.0867e-04 gnorm: 0.2702
04/05/2020 11:11:20 > epoch 15 updates 21700 loss: 0.1716 lr: 4.0867e-04 gnorm: 0.3677
04/05/2020 11:11:22 train loss: 0.1436 lr: 4.0867e-04 gnorm: 0.3513 clip: 0
04/05/2020 11:11:22 valid loss: 0.3059 auc: 0.9528 f1: 0.8907 acc: 0.8884 [BEST: 0.8916]
04/05/2020 11:11:25 > epoch 15 updates 21720 loss: 0.1692 lr: 4.0867e-04 gnorm: 0.3882
04/05/2020 11:11:29 > epoch 15 updates 21740 loss: 0.0998 lr: 4.0867e-04 gnorm: 0.2665
04/05/2020 11:11:32 train loss: 0.1343 lr: 4.0867e-04 gnorm: 0.3271 clip: 0
04/05/2020 11:11:32 valid loss: 0.2943 auc: 0.9554 f1: 0.8966 acc: 0.8934 [NEW BEST]
04/05/2020 11:11:34 > epoch 15 updates 21760 loss: 0.1412 lr: 4.0867e-04 gnorm: 0.3055
04/05/2020 11:11:37 > epoch 15 updates 21780 loss: 0.1446 lr: 4.0867e-04 gnorm: 0.3719
04/05/2020 11:11:40 > epoch 15 updates 21800 loss: 0.1723 lr: 4.0867e-04 gnorm: 0.4331
04/05/2020 11:11:42 train loss: 0.1528 lr: 4.0867e-04 gnorm: 0.3706 clip: 0
04/05/2020 11:11:42 valid loss: 0.2979 auc: 0.9540 f1: 0.8896 acc: 0.8882 [BEST: 0.8934]
04/05/2020 11:11:45 > epoch 15 updates 21820 loss: 0.1279 lr: 4.0867e-04 gnorm: 0.3717
04/05/2020 11:11:48 > epoch 15 updates 21840 loss: 0.1508 lr: 4.0867e-04 gnorm: 0.3390
04/05/2020 11:11:51 train loss: 0.1394 lr: 4.0867e-04 gnorm: 0.3553 clip: 0
04/05/2020 11:11:51 valid loss: 0.2997 auc: 0.9543 f1: 0.8912 acc: 0.8893 [BEST: 0.8934]
04/05/2020 11:11:53 > epoch 15 updates 21860 loss: 0.1015 lr: 4.0867e-04 gnorm: 0.3680
04/05/2020 11:11:55 > epoch 15 updates 21880 loss: 0.1328 lr: 4.0867e-04 gnorm: 0.3447
04/05/2020 11:11:58 > epoch 15 updates 21900 loss: 0.1316 lr: 4.0867e-04 gnorm: 0.3157
04/05/2020 11:12:00 train loss: 0.1221 lr: 4.0867e-04 gnorm: 0.3426 clip: 0
04/05/2020 11:12:00 valid loss: 0.2946 auc: 0.9549 f1: 0.8919 acc: 0.8900 [BEST: 0.8934]
04/05/2020 11:12:03 > epoch 15 updates 21920 loss: 0.1449 lr: 4.0867e-04 gnorm: 0.3814
04/05/2020 11:12:06 > epoch 15 updates 21940 loss: 0.1522 lr: 4.0867e-04 gnorm: 0.3738
04/05/2020 11:12:10 train loss: 0.1486 lr: 4.0867e-04 gnorm: 0.3776 clip: 0
04/05/2020 11:12:10 valid loss: 0.2961 auc: 0.9540 f1: 0.8933 acc: 0.8911 [BEST: 0.8934]
04/05/2020 11:12:11 > epoch 15 updates 21960 loss: 0.1266 lr: 4.0867e-04 gnorm: 0.3371
04/05/2020 11:12:14 > epoch 15 updates 21980 loss: 0.1535 lr: 4.0867e-04 gnorm: 0.2957
04/05/2020 11:12:17 > epoch 15 updates 22000 loss: 0.1237 lr: 4.0867e-04 gnorm: 0.2706
04/05/2020 11:12:19 train loss: 0.1346 lr: 4.0867e-04 gnorm: 0.3009 clip: 0
04/05/2020 11:12:19 valid loss: 0.3011 auc: 0.9511 f1: 0.8877 acc: 0.8847 [BEST: 0.8934]
04/05/2020 11:12:22 > epoch 15 updates 22020 loss: 0.1354 lr: 3.8824e-04 gnorm: 0.3652
04/05/2020 11:12:25 > epoch 15 updates 22040 loss: 0.1767 lr: 3.8824e-04 gnorm: 0.3659
04/05/2020 11:12:28 train loss: 0.1562 lr: 3.8824e-04 gnorm: 0.3655 clip: 0
04/05/2020 11:12:28 valid loss: 0.3022 auc: 0.9526 f1: 0.8896 acc: 0.8873 [BEST: 0.8934]
04/05/2020 11:12:30 > epoch 15 updates 22060 loss: 0.1456 lr: 3.8824e-04 gnorm: 0.3363
04/05/2020 11:12:33 > epoch 15 updates 22080 loss: 0.1151 lr: 3.8824e-04 gnorm: 0.3061
04/05/2020 11:12:36 > epoch 15 updates 22100 loss: 0.1960 lr: 3.8824e-04 gnorm: 0.4150
04/05/2020 11:12:38 train loss: 0.1524 lr: 3.8824e-04 gnorm: 0.3527 clip: 0
04/05/2020 11:12:38 valid loss: 0.3057 auc: 0.9530 f1: 0.8901 acc: 0.8876 [BEST: 0.8934]
04/05/2020 11:12:41 > epoch 15 updates 22120 loss: 0.1635 lr: 3.8824e-04 gnorm: 0.4147
04/05/2020 11:12:44 > epoch 15 updates 22140 loss: 0.1780 lr: 3.8824e-04 gnorm: 0.4016
04/05/2020 11:12:47 train loss: 0.1708 lr: 3.8824e-04 gnorm: 0.4081 clip: 0
04/05/2020 11:12:47 valid loss: 0.2987 auc: 0.9532 f1: 0.8921 acc: 0.8896 [BEST: 0.8934]
04/05/2020 11:12:48 > epoch 15 updates 22160 loss: 0.1041 lr: 3.8824e-04 gnorm: 0.2491
04/05/2020 11:12:51 > epoch 15 updates 22180 loss: 0.1457 lr: 3.8824e-04 gnorm: 0.4251
04/05/2020 11:12:54 > epoch 15 updates 22200 loss: 0.1582 lr: 3.8824e-04 gnorm: 0.3401
04/05/2020 11:12:56 train loss: 0.1362 lr: 3.8824e-04 gnorm: 0.3384 clip: 0
04/05/2020 11:12:56 valid loss: 0.3086 auc: 0.9525 f1: 0.8919 acc: 0.8894 [BEST: 0.8934]
04/05/2020 11:12:59 > epoch 15 updates 22220 loss: 0.1373 lr: 3.8824e-04 gnorm: 0.3416
04/05/2020 11:13:02 > epoch 15 updates 22240 loss: 0.1246 lr: 3.8824e-04 gnorm: 0.3429
04/05/2020 11:13:05 train loss: 0.1309 lr: 3.8824e-04 gnorm: 0.3423 clip: 0
04/05/2020 11:13:05 valid loss: 0.3082 auc: 0.9512 f1: 0.8874 acc: 0.8840 [BEST: 0.8934]
04/05/2020 11:13:07 > epoch 15 updates 22260 loss: 0.1708 lr: 3.8824e-04 gnorm: 0.3831
04/05/2020 11:13:10 > epoch 15 updates 22280 loss: 0.1419 lr: 3.8824e-04 gnorm: 0.3277
04/05/2020 11:13:13 > epoch 15 updates 22300 loss: 0.1201 lr: 3.8824e-04 gnorm: 0.3078
04/05/2020 11:13:15 train loss: 0.1441 lr: 3.8824e-04 gnorm: 0.3393 clip: 0
04/05/2020 11:13:15 valid loss: 0.3089 auc: 0.9522 f1: 0.8871 acc: 0.8862 [BEST: 0.8934]
04/05/2020 11:13:18 > epoch 15 updates 22320 loss: 0.1469 lr: 3.8824e-04 gnorm: 0.3102
04/05/2020 11:13:21 > epoch 15 updates 22340 loss: 0.1304 lr: 3.8824e-04 gnorm: 0.2902
04/05/2020 11:13:24 train loss: 0.1386 lr: 3.8824e-04 gnorm: 0.3002 clip: 0
04/05/2020 11:13:24 valid loss: 0.2993 auc: 0.9531 f1: 0.8905 acc: 0.8886 [BEST: 0.8934]
04/05/2020 11:13:26 > epoch 15 updates 22360 loss: 0.1437 lr: 3.8824e-04 gnorm: 0.3265
04/05/2020 11:13:28 > epoch 15 updates 22380 loss: 0.1313 lr: 3.8824e-04 gnorm: 0.3231
04/05/2020 11:13:31 > epoch 15 updates 22400 loss: 0.1435 lr: 3.8824e-04 gnorm: 0.3892
04/05/2020 11:13:33 train loss: 0.1395 lr: 3.8824e-04 gnorm: 0.3465 clip: 0
04/05/2020 11:13:33 valid loss: 0.2948 auc: 0.9543 f1: 0.8921 acc: 0.8900 [BEST: 0.8934]
04/05/2020 11:13:36 > epoch 15 updates 22420 loss: 0.1240 lr: 3.8824e-04 gnorm: 0.2888
04/05/2020 11:13:39 > epoch 15 updates 22440 loss: 0.1746 lr: 3.8824e-04 gnorm: 0.3905
04/05/2020 11:13:43 train loss: 0.1494 lr: 3.8824e-04 gnorm: 0.3399 clip: 0
04/05/2020 11:13:43 valid loss: 0.3023 auc: 0.9540 f1: 0.8912 acc: 0.8896 [BEST: 0.8934]
04/05/2020 11:13:44 > epoch 15 updates 22460 loss: 0.1337 lr: 3.8824e-04 gnorm: 0.3069
04/05/2020 11:13:47 > epoch 15 updates 22480 loss: 0.0924 lr: 3.8824e-04 gnorm: 0.3428
04/05/2020 11:13:50 > epoch 15 updates 22500 loss: 0.1168 lr: 3.8824e-04 gnorm: 0.2786
04/05/2020 11:13:52 train loss: 0.1142 lr: 3.8824e-04 gnorm: 0.3094 clip: 0
04/05/2020 11:13:52 valid loss: 0.3003 auc: 0.9530 f1: 0.8910 acc: 0.8890 [BEST: 0.8934]
04/05/2020 11:13:55 > epoch 15 updates 22520 loss: 0.1718 lr: 3.8824e-04 gnorm: 0.4230
04/05/2020 11:13:58 train loss: 0.1718 lr: 3.8824e-04 gnorm: 0.4230 clip: 0
04/05/2020 11:13:58 valid loss: 0.2955 auc: 0.9536 f1: 0.8922 acc: 0.8900 [BEST: 0.8934]
04/05/2020 11:13:58 Epoch: 16
04/05/2020 11:14:02 > epoch 16 updates 22540 loss: 0.1198 lr: 3.8824e-04 gnorm: 0.3203
04/05/2020 11:14:06 train loss: 0.1198 lr: 3.8824e-04 gnorm: 0.3203 clip: 0
04/05/2020 11:14:06 valid loss: 0.3035 auc: 0.9531 f1: 0.8915 acc: 0.8891 [BEST: 0.8934]
04/05/2020 11:14:07 > epoch 16 updates 22560 loss: 0.1296 lr: 3.8824e-04 gnorm: 0.3707
04/05/2020 11:14:10 > epoch 16 updates 22580 loss: 0.1328 lr: 3.8824e-04 gnorm: 0.3191
04/05/2020 11:14:13 > epoch 16 updates 22600 loss: 0.1396 lr: 3.8824e-04 gnorm: 0.3126
04/05/2020 11:14:15 train loss: 0.1341 lr: 3.8824e-04 gnorm: 0.3339 clip: 0
04/05/2020 11:14:15 valid loss: 0.3048 auc: 0.9542 f1: 0.8924 acc: 0.8897 [BEST: 0.8934]
04/05/2020 11:14:18 > epoch 16 updates 22620 loss: 0.1133 lr: 3.8824e-04 gnorm: 0.3345
04/05/2020 11:14:21 > epoch 16 updates 22640 loss: 0.1365 lr: 3.8824e-04 gnorm: 0.3441
04/05/2020 11:14:24 train loss: 0.1250 lr: 3.8824e-04 gnorm: 0.3393 clip: 0
04/05/2020 11:14:24 valid loss: 0.3076 auc: 0.9544 f1: 0.8932 acc: 0.8909 [BEST: 0.8934]
04/05/2020 11:14:26 > epoch 16 updates 22660 loss: 0.1567 lr: 3.8824e-04 gnorm: 0.3694
04/05/2020 11:14:29 > epoch 16 updates 22680 loss: 0.0778 lr: 3.8824e-04 gnorm: 0.2760
04/05/2020 11:14:32 > epoch 16 updates 22700 loss: 0.1062 lr: 3.8824e-04 gnorm: 0.3264
04/05/2020 11:14:34 train loss: 0.1134 lr: 3.8824e-04 gnorm: 0.3238 clip: 0
04/05/2020 11:14:34 valid loss: 0.3013 auc: 0.9545 f1: 0.8942 acc: 0.8916 [BEST: 0.8934]
04/05/2020 11:14:37 > epoch 16 updates 22720 loss: 0.1310 lr: 3.8824e-04 gnorm: 0.3556
04/05/2020 11:14:39 > epoch 16 updates 22740 loss: 0.1120 lr: 3.8824e-04 gnorm: 0.3415
04/05/2020 11:14:43 train loss: 0.1214 lr: 3.8824e-04 gnorm: 0.3485 clip: 0
04/05/2020 11:14:43 valid loss: 0.3106 auc: 0.9514 f1: 0.8872 acc: 0.8857 [BEST: 0.8934]
04/05/2020 11:14:44 > epoch 16 updates 22760 loss: 0.0896 lr: 3.8824e-04 gnorm: 0.2635
04/05/2020 11:14:47 > epoch 16 updates 22780 loss: 0.1069 lr: 3.8824e-04 gnorm: 0.2815
04/05/2020 11:14:50 > epoch 16 updates 22800 loss: 0.1289 lr: 3.8824e-04 gnorm: 0.3502
04/05/2020 11:14:52 train loss: 0.1086 lr: 3.8824e-04 gnorm: 0.2987 clip: 0
04/05/2020 11:14:52 valid loss: 0.3153 auc: 0.9530 f1: 0.8880 acc: 0.8860 [BEST: 0.8934]
04/05/2020 11:14:55 > epoch 16 updates 22820 loss: 0.1844 lr: 3.8824e-04 gnorm: 0.4792
04/05/2020 11:14:58 > epoch 16 updates 22840 loss: 0.1315 lr: 3.8824e-04 gnorm: 0.3049
04/05/2020 11:15:01 train loss: 0.1578 lr: 3.8824e-04 gnorm: 0.3916 clip: 0
04/05/2020 11:15:01 valid loss: 0.3076 auc: 0.9535 f1: 0.8889 acc: 0.8874 [BEST: 0.8934]
04/05/2020 11:15:03 > epoch 16 updates 22860 loss: 0.1378 lr: 3.8824e-04 gnorm: 0.3187
04/05/2020 11:15:06 > epoch 16 updates 22880 loss: 0.2274 lr: 3.8824e-04 gnorm: 0.4176
04/05/2020 11:15:09 > epoch 16 updates 22900 loss: 0.1155 lr: 3.8824e-04 gnorm: 0.2998
04/05/2020 11:15:11 train loss: 0.1602 lr: 3.8824e-04 gnorm: 0.3453 clip: 0
04/05/2020 11:15:11 valid loss: 0.3082 auc: 0.9531 f1: 0.8875 acc: 0.8863 [BEST: 0.8934]
04/05/2020 11:15:14 > epoch 16 updates 22920 loss: 0.1010 lr: 3.8824e-04 gnorm: 0.3202
04/05/2020 11:15:16 > epoch 16 updates 22940 loss: 0.1032 lr: 3.8824e-04 gnorm: 0.3266
04/05/2020 11:15:20 train loss: 0.1021 lr: 3.8824e-04 gnorm: 0.3234 clip: 0
04/05/2020 11:15:20 valid loss: 0.3090 auc: 0.9534 f1: 0.8887 acc: 0.8872 [BEST: 0.8934]
04/05/2020 11:15:21 > epoch 16 updates 22960 loss: 0.0833 lr: 3.8824e-04 gnorm: 0.2834
04/05/2020 11:15:24 > epoch 16 updates 22980 loss: 0.1797 lr: 3.8824e-04 gnorm: 0.4341
04/05/2020 11:15:27 > epoch 16 updates 23000 loss: 0.1154 lr: 3.8824e-04 gnorm: 0.2785
04/05/2020 11:15:29 train loss: 0.1263 lr: 3.8824e-04 gnorm: 0.3320 clip: 0
04/05/2020 11:15:29 valid loss: 0.3038 auc: 0.9517 f1: 0.8903 acc: 0.8878 [BEST: 0.8934]
04/05/2020 11:15:32 > epoch 16 updates 23020 loss: 0.0942 lr: 3.6883e-04 gnorm: 0.2883
04/05/2020 11:15:35 > epoch 16 updates 23040 loss: 0.1651 lr: 3.6883e-04 gnorm: 0.4404
04/05/2020 11:15:38 train loss: 0.1298 lr: 3.6883e-04 gnorm: 0.3647 clip: 0
04/05/2020 11:15:38 valid loss: 0.3094 auc: 0.9523 f1: 0.8895 acc: 0.8871 [BEST: 0.8934]
04/05/2020 11:15:40 > epoch 16 updates 23060 loss: 0.1424 lr: 3.6883e-04 gnorm: 0.3870
04/05/2020 11:15:43 > epoch 16 updates 23080 loss: 0.1074 lr: 3.6883e-04 gnorm: 0.3627
04/05/2020 11:15:46 > epoch 16 updates 23100 loss: 0.1957 lr: 3.6883e-04 gnorm: 0.5109
04/05/2020 11:15:48 train loss: 0.1487 lr: 3.6883e-04 gnorm: 0.4206 clip: 0
04/05/2020 11:15:48 valid loss: 0.3117 auc: 0.9523 f1: 0.8887 acc: 0.8867 [BEST: 0.8934]
04/05/2020 11:15:51 > epoch 16 updates 23120 loss: 0.1269 lr: 3.6883e-04 gnorm: 0.3567
04/05/2020 11:15:54 > epoch 16 updates 23140 loss: 0.1250 lr: 3.6883e-04 gnorm: 0.3470
04/05/2020 11:15:57 train loss: 0.1260 lr: 3.6883e-04 gnorm: 0.3518 clip: 0
04/05/2020 11:15:57 valid loss: 0.3019 auc: 0.9538 f1: 0.8898 acc: 0.8885 [BEST: 0.8934]
04/05/2020 11:15:59 > epoch 16 updates 23160 loss: 0.0889 lr: 3.6883e-04 gnorm: 0.2892
04/05/2020 11:16:02 > epoch 16 updates 23180 loss: 0.1477 lr: 3.6883e-04 gnorm: 0.3835
04/05/2020 11:16:05 > epoch 16 updates 23200 loss: 0.1353 lr: 3.6883e-04 gnorm: 0.3041
04/05/2020 11:16:07 train loss: 0.1241 lr: 3.6883e-04 gnorm: 0.3256 clip: 0
04/05/2020 11:16:07 valid loss: 0.3078 auc: 0.9537 f1: 0.8874 acc: 0.8868 [BEST: 0.8934]
04/05/2020 11:16:10 > epoch 16 updates 23220 loss: 0.1676 lr: 3.6883e-04 gnorm: 0.4528
04/05/2020 11:16:12 > epoch 16 updates 23240 loss: 0.0731 lr: 3.6883e-04 gnorm: 0.2283
04/05/2020 11:16:16 train loss: 0.1201 lr: 3.6883e-04 gnorm: 0.3400 clip: 0
04/05/2020 11:16:16 valid loss: 0.3099 auc: 0.9529 f1: 0.8906 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:16:17 > epoch 16 updates 23260 loss: 0.1411 lr: 3.6883e-04 gnorm: 0.3469
04/05/2020 11:16:20 > epoch 16 updates 23280 loss: 0.1834 lr: 3.6883e-04 gnorm: 0.4375
04/05/2020 11:16:23 > epoch 16 updates 23300 loss: 0.1209 lr: 3.6883e-04 gnorm: 0.3209
04/05/2020 11:16:25 train loss: 0.1484 lr: 3.6883e-04 gnorm: 0.3684 clip: 0
04/05/2020 11:16:25 valid loss: 0.3016 auc: 0.9545 f1: 0.8934 acc: 0.8898 [BEST: 0.8934]
04/05/2020 11:16:28 > epoch 16 updates 23320 loss: 0.1125 lr: 3.6883e-04 gnorm: 0.3496
04/05/2020 11:16:31 > epoch 16 updates 23340 loss: 0.1232 lr: 3.6883e-04 gnorm: 0.3115
04/05/2020 11:16:34 train loss: 0.1179 lr: 3.6883e-04 gnorm: 0.3305 clip: 0
04/05/2020 11:16:34 valid loss: 0.3045 auc: 0.9538 f1: 0.8919 acc: 0.8899 [BEST: 0.8934]
04/05/2020 11:16:36 > epoch 16 updates 23360 loss: 0.1091 lr: 3.6883e-04 gnorm: 0.3470
04/05/2020 11:16:39 > epoch 16 updates 23380 loss: 0.1295 lr: 3.6883e-04 gnorm: 0.2633
04/05/2020 11:16:42 > epoch 16 updates 23400 loss: 0.1769 lr: 3.6883e-04 gnorm: 0.4232
04/05/2020 11:16:44 train loss: 0.1387 lr: 3.6883e-04 gnorm: 0.3448 clip: 0
04/05/2020 11:16:44 valid loss: 0.3042 auc: 0.9544 f1: 0.8926 acc: 0.8896 [BEST: 0.8934]
04/05/2020 11:16:46 > epoch 16 updates 23420 loss: 0.0957 lr: 3.6883e-04 gnorm: 0.3276
04/05/2020 11:16:49 > epoch 16 updates 23440 loss: 0.1675 lr: 3.6883e-04 gnorm: 0.4167
04/05/2020 11:16:53 train loss: 0.1318 lr: 3.6883e-04 gnorm: 0.3724 clip: 0
04/05/2020 11:16:53 valid loss: 0.3004 auc: 0.9540 f1: 0.8910 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:16:54 > epoch 16 updates 23460 loss: 0.1449 lr: 3.6883e-04 gnorm: 0.3195
04/05/2020 11:16:57 > epoch 16 updates 23480 loss: 0.1371 lr: 3.6883e-04 gnorm: 0.3243
04/05/2020 11:17:00 > epoch 16 updates 23500 loss: 0.1499 lr: 3.6883e-04 gnorm: 0.4417
04/05/2020 11:17:02 train loss: 0.1440 lr: 3.6883e-04 gnorm: 0.3623 clip: 0
04/05/2020 11:17:02 valid loss: 0.3016 auc: 0.9547 f1: 0.8887 acc: 0.8878 [BEST: 0.8934]
04/05/2020 11:17:05 > epoch 16 updates 23520 loss: 0.1770 lr: 3.6883e-04 gnorm: 0.4511
04/05/2020 11:17:08 > epoch 16 updates 23540 loss: 0.1179 lr: 3.6883e-04 gnorm: 0.3051
04/05/2020 11:17:11 train loss: 0.1473 lr: 3.6883e-04 gnorm: 0.3778 clip: 0
04/05/2020 11:17:11 valid loss: 0.3039 auc: 0.9542 f1: 0.8887 acc: 0.8875 [BEST: 0.8934]
04/05/2020 11:17:13 > epoch 16 updates 23560 loss: 0.1300 lr: 3.6883e-04 gnorm: 0.3611
04/05/2020 11:17:15 > epoch 16 updates 23580 loss: 0.1585 lr: 3.6883e-04 gnorm: 0.5027
04/05/2020 11:17:18 > epoch 16 updates 23600 loss: 0.1313 lr: 3.6883e-04 gnorm: 0.3645
04/05/2020 11:17:20 train loss: 0.1399 lr: 3.6883e-04 gnorm: 0.4095 clip: 0
04/05/2020 11:17:20 valid loss: 0.3052 auc: 0.9533 f1: 0.8921 acc: 0.8893 [BEST: 0.8934]
04/05/2020 11:17:23 > epoch 16 updates 23620 loss: 0.1086 lr: 3.6883e-04 gnorm: 0.3863
04/05/2020 11:17:26 > epoch 16 updates 23640 loss: 0.1597 lr: 3.6883e-04 gnorm: 0.3649
04/05/2020 11:17:30 train loss: 0.1343 lr: 3.6883e-04 gnorm: 0.3755 clip: 0
04/05/2020 11:17:30 valid loss: 0.3055 auc: 0.9526 f1: 0.8903 acc: 0.8875 [BEST: 0.8934]
04/05/2020 11:17:31 > epoch 16 updates 23660 loss: 0.1315 lr: 3.6883e-04 gnorm: 0.3614
04/05/2020 11:17:34 > epoch 16 updates 23680 loss: 0.1610 lr: 3.6883e-04 gnorm: 0.3924
04/05/2020 11:17:37 > epoch 16 updates 23700 loss: 0.1203 lr: 3.6883e-04 gnorm: 0.3382
04/05/2020 11:17:39 train loss: 0.1375 lr: 3.6883e-04 gnorm: 0.3639 clip: 0
04/05/2020 11:17:39 valid loss: 0.2978 auc: 0.9544 f1: 0.8890 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:17:42 > epoch 16 updates 23720 loss: 0.1445 lr: 3.6883e-04 gnorm: 0.3604
04/05/2020 11:17:45 > epoch 16 updates 23740 loss: 0.1515 lr: 3.6883e-04 gnorm: 0.3483
04/05/2020 11:17:48 train loss: 0.1480 lr: 3.6883e-04 gnorm: 0.3543 clip: 0
04/05/2020 11:17:48 valid loss: 0.2982 auc: 0.9538 f1: 0.8890 acc: 0.8871 [BEST: 0.8934]
04/05/2020 11:17:50 > epoch 16 updates 23760 loss: 0.1530 lr: 3.6883e-04 gnorm: 0.4246
04/05/2020 11:17:53 > epoch 16 updates 23780 loss: 0.1248 lr: 3.6883e-04 gnorm: 0.3328
04/05/2020 11:17:56 > epoch 16 updates 23800 loss: 0.1309 lr: 3.6883e-04 gnorm: 0.3066
04/05/2020 11:17:58 train loss: 0.1361 lr: 3.6883e-04 gnorm: 0.3543 clip: 0
04/05/2020 11:17:58 valid loss: 0.2952 auc: 0.9539 f1: 0.8928 acc: 0.8894 [BEST: 0.8934]
04/05/2020 11:18:01 > epoch 16 updates 23820 loss: 0.2161 lr: 3.6883e-04 gnorm: 0.4951
04/05/2020 11:18:04 > epoch 16 updates 23840 loss: 0.1161 lr: 3.6883e-04 gnorm: 0.2838
04/05/2020 11:18:07 train loss: 0.1659 lr: 3.6883e-04 gnorm: 0.3889 clip: 0
04/05/2020 11:18:07 valid loss: 0.3071 auc: 0.9521 f1: 0.8883 acc: 0.8858 [BEST: 0.8934]
04/05/2020 11:18:09 > epoch 16 updates 23860 loss: 0.1312 lr: 3.6883e-04 gnorm: 0.3100
04/05/2020 11:18:12 > epoch 16 updates 23880 loss: 0.1551 lr: 3.6883e-04 gnorm: 0.4519
04/05/2020 11:18:15 > epoch 16 updates 23900 loss: 0.1534 lr: 3.6883e-04 gnorm: 0.3266
04/05/2020 11:18:17 train loss: 0.1467 lr: 3.6883e-04 gnorm: 0.3629 clip: 0
04/05/2020 11:18:17 valid loss: 0.3028 auc: 0.9531 f1: 0.8899 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:18:19 > epoch 16 updates 23920 loss: 0.2208 lr: 3.6883e-04 gnorm: 0.4423
04/05/2020 11:18:22 > epoch 16 updates 23940 loss: 0.1042 lr: 3.6883e-04 gnorm: 0.2852
04/05/2020 11:18:26 train loss: 0.1622 lr: 3.6883e-04 gnorm: 0.3634 clip: 0
04/05/2020 11:18:26 valid loss: 0.3043 auc: 0.9531 f1: 0.8904 acc: 0.8869 [BEST: 0.8934]
04/05/2020 11:18:27 > epoch 16 updates 23960 loss: 0.1525 lr: 3.6883e-04 gnorm: 0.3446
04/05/2020 11:18:30 > epoch 16 updates 23980 loss: 0.1196 lr: 3.6883e-04 gnorm: 0.3345
04/05/2020 11:18:33 > epoch 16 updates 24000 loss: 0.1477 lr: 3.6883e-04 gnorm: 0.2950
04/05/2020 11:18:35 train loss: 0.1399 lr: 3.6883e-04 gnorm: 0.3246 clip: 0
04/05/2020 11:18:35 valid loss: 0.2991 auc: 0.9538 f1: 0.8902 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:18:38 > epoch 16 updates 24020 loss: 0.1629 lr: 3.5039e-04 gnorm: 0.4818
04/05/2020 11:18:42 train loss: 0.1629 lr: 3.5039e-04 gnorm: 0.4818 clip: 0
04/05/2020 11:18:42 valid loss: 0.3072 auc: 0.9526 f1: 0.8895 acc: 0.8850 [BEST: 0.8934]
04/05/2020 11:18:42 Epoch: 17
04/05/2020 11:18:47 > epoch 17 updates 24040 loss: 0.0875 lr: 3.5039e-04 gnorm: 0.2674
04/05/2020 11:18:50 train loss: 0.0875 lr: 3.5039e-04 gnorm: 0.2674 clip: 0
04/05/2020 11:18:50 valid loss: 0.3077 auc: 0.9531 f1: 0.8897 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:18:52 > epoch 17 updates 24060 loss: 0.0965 lr: 3.5039e-04 gnorm: 0.2226
04/05/2020 11:18:55 > epoch 17 updates 24080 loss: 0.1119 lr: 3.5039e-04 gnorm: 0.3476
04/05/2020 11:18:58 > epoch 17 updates 24100 loss: 0.1302 lr: 3.5039e-04 gnorm: 0.3660
04/05/2020 11:19:00 train loss: 0.1130 lr: 3.5039e-04 gnorm: 0.3126 clip: 0
04/05/2020 11:19:00 valid loss: 0.3130 auc: 0.9527 f1: 0.8915 acc: 0.8877 [BEST: 0.8934]
04/05/2020 11:19:03 > epoch 17 updates 24120 loss: 0.1321 lr: 3.5039e-04 gnorm: 0.3154
04/05/2020 11:19:06 > epoch 17 updates 24140 loss: 0.1191 lr: 3.5039e-04 gnorm: 0.3649
04/05/2020 11:19:09 train loss: 0.1256 lr: 3.5039e-04 gnorm: 0.3403 clip: 0
04/05/2020 11:19:09 valid loss: 0.3163 auc: 0.9524 f1: 0.8890 acc: 0.8862 [BEST: 0.8934]
04/05/2020 11:19:11 > epoch 17 updates 24160 loss: 0.1218 lr: 3.5039e-04 gnorm: 0.3087
04/05/2020 11:19:13 > epoch 17 updates 24180 loss: 0.1623 lr: 3.5039e-04 gnorm: 0.4519
04/05/2020 11:19:16 > epoch 17 updates 24200 loss: 0.1088 lr: 3.5039e-04 gnorm: 0.3335
04/05/2020 11:19:18 train loss: 0.1309 lr: 3.5039e-04 gnorm: 0.3648 clip: 0
04/05/2020 11:19:18 valid loss: 0.3220 auc: 0.9530 f1: 0.8909 acc: 0.8879 [BEST: 0.8934]
04/05/2020 11:19:21 > epoch 17 updates 24220 loss: 0.0819 lr: 3.5039e-04 gnorm: 0.3060
04/05/2020 11:19:24 > epoch 17 updates 24240 loss: 0.1590 lr: 3.5039e-04 gnorm: 0.3556
04/05/2020 11:19:27 train loss: 0.1207 lr: 3.5039e-04 gnorm: 0.3310 clip: 0
04/05/2020 11:19:27 valid loss: 0.3085 auc: 0.9535 f1: 0.8897 acc: 0.8880 [BEST: 0.8934]
04/05/2020 11:19:29 > epoch 17 updates 24260 loss: 0.1445 lr: 3.5039e-04 gnorm: 0.4192
04/05/2020 11:19:32 > epoch 17 updates 24280 loss: 0.0927 lr: 3.5039e-04 gnorm: 0.2819
04/05/2020 11:19:35 > epoch 17 updates 24300 loss: 0.1691 lr: 3.5039e-04 gnorm: 0.3980
04/05/2020 11:19:37 train loss: 0.1355 lr: 3.5039e-04 gnorm: 0.3663 clip: 0
04/05/2020 11:19:37 valid loss: 0.3113 auc: 0.9542 f1: 0.8921 acc: 0.8897 [BEST: 0.8934]
04/05/2020 11:19:40 > epoch 17 updates 24320 loss: 0.1551 lr: 3.5039e-04 gnorm: 0.4065
04/05/2020 11:19:42 > epoch 17 updates 24340 loss: 0.0985 lr: 3.5039e-04 gnorm: 0.3639
04/05/2020 11:19:46 train loss: 0.1267 lr: 3.5039e-04 gnorm: 0.3851 clip: 0
04/05/2020 11:19:46 valid loss: 0.3143 auc: 0.9531 f1: 0.8917 acc: 0.8884 [BEST: 0.8934]
04/05/2020 11:19:47 > epoch 17 updates 24360 loss: 0.1068 lr: 3.5039e-04 gnorm: 0.4075
04/05/2020 11:19:50 > epoch 17 updates 24380 loss: 0.1410 lr: 3.5039e-04 gnorm: 0.4585
04/05/2020 11:19:53 > epoch 17 updates 24400 loss: 0.1193 lr: 3.5039e-04 gnorm: 0.3555
04/05/2020 11:19:55 train loss: 0.1224 lr: 3.5039e-04 gnorm: 0.4070 clip: 0
04/05/2020 11:19:55 valid loss: 0.3191 auc: 0.9522 f1: 0.8878 acc: 0.8858 [BEST: 0.8934]
04/05/2020 11:19:58 > epoch 17 updates 24420 loss: 0.1245 lr: 3.5039e-04 gnorm: 0.3466
04/05/2020 11:20:01 > epoch 17 updates 24440 loss: 0.1471 lr: 3.5039e-04 gnorm: 0.3619
04/05/2020 11:20:04 train loss: 0.1358 lr: 3.5039e-04 gnorm: 0.3543 clip: 0
04/05/2020 11:20:04 valid loss: 0.3126 auc: 0.9526 f1: 0.8887 acc: 0.8864 [BEST: 0.8934]
04/05/2020 11:20:06 > epoch 17 updates 24460 loss: 0.1195 lr: 3.5039e-04 gnorm: 0.2986
04/05/2020 11:20:09 > epoch 17 updates 24480 loss: 0.1369 lr: 3.5039e-04 gnorm: 0.3486
04/05/2020 11:20:11 > epoch 17 updates 24500 loss: 0.1748 lr: 3.5039e-04 gnorm: 0.4214
04/05/2020 11:20:13 train loss: 0.1439 lr: 3.5039e-04 gnorm: 0.3566 clip: 0
04/05/2020 11:20:13 valid loss: 0.3149 auc: 0.9525 f1: 0.8903 acc: 0.8884 [BEST: 0.8934]
04/05/2020 11:20:16 > epoch 17 updates 24520 loss: 0.1549 lr: 3.5039e-04 gnorm: 0.4005
04/05/2020 11:20:19 > epoch 17 updates 24540 loss: 0.0988 lr: 3.5039e-04 gnorm: 0.3193
04/05/2020 11:20:22 train loss: 0.1267 lr: 3.5039e-04 gnorm: 0.3597 clip: 0
04/05/2020 11:20:22 valid loss: 0.3168 auc: 0.9543 f1: 0.8931 acc: 0.8906 [BEST: 0.8934]
04/05/2020 11:20:24 > epoch 17 updates 24560 loss: 0.1102 lr: 3.5039e-04 gnorm: 0.3698
04/05/2020 11:20:27 > epoch 17 updates 24580 loss: 0.1969 lr: 3.5039e-04 gnorm: 0.5989
04/05/2020 11:20:30 > epoch 17 updates 24600 loss: 0.0999 lr: 3.5039e-04 gnorm: 0.3216
04/05/2020 11:20:32 train loss: 0.1356 lr: 3.5039e-04 gnorm: 0.4300 clip: 0
04/05/2020 11:20:32 valid loss: 0.3135 auc: 0.9522 f1: 0.8888 acc: 0.8870 [BEST: 0.8934]
04/05/2020 11:20:35 > epoch 17 updates 24620 loss: 0.1390 lr: 3.5039e-04 gnorm: 0.3863
04/05/2020 11:20:38 > epoch 17 updates 24640 loss: 0.1410 lr: 3.5039e-04 gnorm: 0.3534
04/05/2020 11:20:41 train loss: 0.1400 lr: 3.5039e-04 gnorm: 0.3698 clip: 0
04/05/2020 11:20:41 valid loss: 0.3202 auc: 0.9516 f1: 0.8866 acc: 0.8851 [BEST: 0.8934]
04/05/2020 11:20:43 > epoch 17 updates 24660 loss: 0.0858 lr: 3.5039e-04 gnorm: 0.2566
04/05/2020 11:20:45 > epoch 17 updates 24680 loss: 0.1028 lr: 3.5039e-04 gnorm: 0.3175
04/05/2020 11:20:48 > epoch 17 updates 24700 loss: 0.1393 lr: 3.5039e-04 gnorm: 0.3443
04/05/2020 11:20:50 train loss: 0.1095 lr: 3.5039e-04 gnorm: 0.3064 clip: 0
04/05/2020 11:20:50 valid loss: 0.3226 auc: 0.9515 f1: 0.8891 acc: 0.8868 [BEST: 0.8934]
04/05/2020 11:20:53 > epoch 17 updates 24720 loss: 0.1382 lr: 3.5039e-04 gnorm: 0.2875
04/05/2020 11:20:56 > epoch 17 updates 24740 loss: 0.1351 lr: 3.5039e-04 gnorm: 0.4286
04/05/2020 11:21:00 train loss: 0.1366 lr: 3.5039e-04 gnorm: 0.3584 clip: 0
04/05/2020 11:21:00 valid loss: 0.3050 auc: 0.9546 f1: 0.8894 acc: 0.8878 [BEST: 0.8934]
04/05/2020 11:21:01 > epoch 17 updates 24760 loss: 0.1314 lr: 3.5039e-04 gnorm: 0.3158
04/05/2020 11:21:04 > epoch 17 updates 24780 loss: 0.1299 lr: 3.5039e-04 gnorm: 0.3176
04/05/2020 11:21:07 > epoch 17 updates 24800 loss: 0.1222 lr: 3.5039e-04 gnorm: 0.3285
04/05/2020 11:21:09 train loss: 0.1278 lr: 3.5039e-04 gnorm: 0.3207 clip: 0
04/05/2020 11:21:09 valid loss: 0.3075 auc: 0.9538 f1: 0.8912 acc: 0.8885 [BEST: 0.8934]
04/05/2020 11:21:11 > epoch 17 updates 24820 loss: 0.1068 lr: 3.5039e-04 gnorm: 0.3681
04/05/2020 11:21:14 > epoch 17 updates 24840 loss: 0.1360 lr: 3.5039e-04 gnorm: 0.3795
04/05/2020 11:21:18 train loss: 0.1215 lr: 3.5039e-04 gnorm: 0.3739 clip: 0
04/05/2020 11:21:18 valid loss: 0.3062 auc: 0.9552 f1: 0.8901 acc: 0.8887 [BEST: 0.8934]
04/05/2020 11:21:19 > epoch 17 updates 24860 loss: 0.1334 lr: 3.5039e-04 gnorm: 0.3198
04/05/2020 11:21:22 > epoch 17 updates 24880 loss: 0.1315 lr: 3.5039e-04 gnorm: 0.3931
04/05/2020 11:21:25 > epoch 17 updates 24900 loss: 0.0926 lr: 3.5039e-04 gnorm: 0.2765
04/05/2020 11:21:27 train loss: 0.1190 lr: 3.5039e-04 gnorm: 0.3296 clip: 0
04/05/2020 11:21:27 valid loss: 0.3083 auc: 0.9543 f1: 0.8871 acc: 0.8863 [BEST: 0.8934]
04/05/2020 11:21:30 > epoch 17 updates 24920 loss: 0.1276 lr: 3.5039e-04 gnorm: 0.3552
04/05/2020 11:21:33 > epoch 17 updates 24940 loss: 0.1719 lr: 3.5039e-04 gnorm: 0.5312
04/05/2020 11:21:36 train loss: 0.1499 lr: 3.5039e-04 gnorm: 0.4436 clip: 0
04/05/2020 11:21:36 valid loss: 0.3181 auc: 0.9515 f1: 0.8865 acc: 0.8846 [BEST: 0.8934]
04/05/2020 11:21:38 > epoch 17 updates 24960 loss: 0.1279 lr: 3.5039e-04 gnorm: 0.3099
04/05/2020 11:21:41 > epoch 17 updates 24980 loss: 0.1210 lr: 3.5039e-04 gnorm: 0.3440
04/05/2020 11:21:43 > epoch 17 updates 25000 loss: 0.1245 lr: 3.5039e-04 gnorm: 0.3777
04/05/2020 11:21:45 train loss: 0.1245 lr: 3.5039e-04 gnorm: 0.3441 clip: 0
04/05/2020 11:21:45 valid loss: 0.3152 auc: 0.9523 f1: 0.8875 acc: 0.8857 [BEST: 0.8934]
04/05/2020 11:21:48 > epoch 17 updates 25020 loss: 0.1577 lr: 3.3287e-04 gnorm: 0.4414
04/05/2020 11:21:51 > epoch 17 updates 25040 loss: 0.1301 lr: 3.3287e-04 gnorm: 0.3451
04/05/2020 11:21:55 train loss: 0.1438 lr: 3.3287e-04 gnorm: 0.3930 clip: 0
04/05/2020 11:21:55 valid loss: 0.3115 auc: 0.9522 f1: 0.8865 acc: 0.8846 [BEST: 0.8934]
04/05/2020 11:21:56 > epoch 17 updates 25060 loss: 0.0952 lr: 3.3287e-04 gnorm: 0.2517
04/05/2020 11:21:59 > epoch 17 updates 25080 loss: 0.1604 lr: 3.3287e-04 gnorm: 0.4217
04/05/2020 11:22:02 > epoch 17 updates 25100 loss: 0.1495 lr: 3.3287e-04 gnorm: 0.4093
04/05/2020 11:22:04 train loss: 0.1352 lr: 3.3287e-04 gnorm: 0.3614 clip: 0
04/05/2020 11:22:04 valid loss: 0.3126 auc: 0.9522 f1: 0.8880 acc: 0.8857 [BEST: 0.8934]
04/05/2020 11:22:07 > epoch 17 updates 25120 loss: 0.1565 lr: 3.3287e-04 gnorm: 0.3708
04/05/2020 11:22:10 > epoch 17 updates 25140 loss: 0.1433 lr: 3.3287e-04 gnorm: 0.3637
04/05/2020 11:22:13 train loss: 0.1498 lr: 3.3287e-04 gnorm: 0.3672 clip: 0
04/05/2020 11:22:13 valid loss: 0.3101 auc: 0.9536 f1: 0.8894 acc: 0.8867 [BEST: 0.8934]
04/05/2020 11:22:15 > epoch 17 updates 25160 loss: 0.1716 lr: 3.3287e-04 gnorm: 0.3618
04/05/2020 11:22:18 > epoch 17 updates 25180 loss: 0.1625 lr: 3.3287e-04 gnorm: 0.4132
04/05/2020 11:22:21 > epoch 17 updates 25200 loss: 0.1301 lr: 3.3287e-04 gnorm: 0.3223
04/05/2020 11:22:23 train loss: 0.1546 lr: 3.3287e-04 gnorm: 0.3656 clip: 0
04/05/2020 11:22:23 valid loss: 0.3057 auc: 0.9557 f1: 0.8919 acc: 0.8905 [BEST: 0.8934]
04/05/2020 11:22:26 > epoch 17 updates 25220 loss: 0.1742 lr: 3.3287e-04 gnorm: 0.3818
04/05/2020 11:22:29 > epoch 17 updates 25240 loss: 0.1017 lr: 3.3287e-04 gnorm: 0.2789
04/05/2020 11:22:32 train loss: 0.1378 lr: 3.3287e-04 gnorm: 0.3301 clip: 0
04/05/2020 11:22:32 valid loss: 0.3015 auc: 0.9555 f1: 0.8916 acc: 0.8902 [BEST: 0.8934]
04/05/2020 11:22:34 > epoch 17 updates 25260 loss: 0.1129 lr: 3.3287e-04 gnorm: 0.3766
04/05/2020 11:22:37 > epoch 17 updates 25280 loss: 0.1108 lr: 3.3287e-04 gnorm: 0.3607
04/05/2020 11:22:40 > epoch 17 updates 25300 loss: 0.1757 lr: 3.3287e-04 gnorm: 0.4141
04/05/2020 11:22:42 train loss: 0.1333 lr: 3.3287e-04 gnorm: 0.3839 clip: 0
04/05/2020 11:22:42 valid loss: 0.3040 auc: 0.9547 f1: 0.8914 acc: 0.8896 [BEST: 0.8934]
04/05/2020 11:22:45 > epoch 17 updates 25320 loss: 0.1334 lr: 3.3287e-04 gnorm: 0.3279
04/05/2020 11:22:48 > epoch 17 updates 25340 loss: 0.1413 lr: 3.3287e-04 gnorm: 0.3775
04/05/2020 11:22:51 train loss: 0.1373 lr: 3.3287e-04 gnorm: 0.3528 clip: 0
04/05/2020 11:22:51 valid loss: 0.2997 auc: 0.9542 f1: 0.8930 acc: 0.8904 [BEST: 0.8934]
04/05/2020 11:22:53 > epoch 17 updates 25360 loss: 0.0938 lr: 3.3287e-04 gnorm: 0.3479
04/05/2020 11:22:56 > epoch 17 updates 25380 loss: 0.1365 lr: 3.3287e-04 gnorm: 0.3748
04/05/2020 11:22:58 > epoch 17 updates 25400 loss: 0.1229 lr: 3.3287e-04 gnorm: 0.2900
04/05/2020 11:23:00 train loss: 0.1178 lr: 3.3287e-04 gnorm: 0.3374 clip: 0
04/05/2020 11:23:00 valid loss: 0.3052 auc: 0.9559 f1: 0.8908 acc: 0.8890 [BEST: 0.8934]
04/05/2020 11:23:03 > epoch 17 updates 25420 loss: 0.1172 lr: 3.3287e-04 gnorm: 0.3312
04/05/2020 11:23:06 > epoch 17 updates 25440 loss: 0.1691 lr: 3.3287e-04 gnorm: 0.3750
04/05/2020 11:23:10 train loss: 0.1433 lr: 3.3287e-04 gnorm: 0.3532 clip: 0
04/05/2020 11:23:10 valid loss: 0.3019 auc: 0.9544 f1: 0.8893 acc: 0.8878 [BEST: 0.8934]
04/05/2020 11:23:11 > epoch 17 updates 25460 loss: 0.1271 lr: 3.3287e-04 gnorm: 0.2939
04/05/2020 11:23:14 > epoch 17 updates 25480 loss: 0.1131 lr: 3.3287e-04 gnorm: 0.3054
04/05/2020 11:23:17 > epoch 17 updates 25500 loss: 0.1453 lr: 3.3287e-04 gnorm: 0.3936
04/05/2020 11:23:19 train loss: 0.1286 lr: 3.3287e-04 gnorm: 0.3313 clip: 0
04/05/2020 11:23:19 valid loss: 0.3104 auc: 0.9528 f1: 0.8915 acc: 0.8879 [BEST: 0.8934]
04/05/2020 11:23:22 > epoch 17 updates 25520 loss: 0.1145 lr: 3.3287e-04 gnorm: 0.3091
04/05/2020 11:23:26 train loss: 0.1145 lr: 3.3287e-04 gnorm: 0.3091 clip: 0
04/05/2020 11:23:26 valid loss: 0.3057 auc: 0.9541 f1: 0.8929 acc: 0.8909 [BEST: 0.8934]
04/05/2020 11:23:26 Epoch: 18
04/05/2020 11:23:30 > epoch 18 updates 25540 loss: 0.1068 lr: 3.3287e-04 gnorm: 0.3747
04/05/2020 11:23:34 train loss: 0.1068 lr: 3.3287e-04 gnorm: 0.3747 clip: 0
04/05/2020 11:23:34 valid loss: 0.3105 auc: 0.9533 f1: 0.8913 acc: 0.8887 [BEST: 0.8934]
04/05/2020 11:23:35 > epoch 18 updates 25560 loss: 0.1316 lr: 3.3287e-04 gnorm: 0.4107
04/05/2020 11:23:38 > epoch 18 updates 25580 loss: 0.1565 lr: 3.3287e-04 gnorm: 0.3656
04/05/2020 11:23:41 > epoch 18 updates 25600 loss: 0.0768 lr: 3.3287e-04 gnorm: 0.2596
04/05/2020 11:23:43 train loss: 0.1214 lr: 3.3287e-04 gnorm: 0.3448 clip: 0
04/05/2020 11:23:43 valid loss: 0.3153 auc: 0.9523 f1: 0.8900 acc: 0.8870 [BEST: 0.8934]
04/05/2020 11:23:46 > epoch 18 updates 25620 loss: 0.0988 lr: 3.3287e-04 gnorm: 0.2884
04/05/2020 11:23:49 > epoch 18 updates 25640 loss: 0.1200 lr: 3.3287e-04 gnorm: 0.3915
04/05/2020 11:23:52 train loss: 0.1095 lr: 3.3287e-04 gnorm: 0.3402 clip: 0
04/05/2020 11:23:52 valid loss: 0.3132 auc: 0.9531 f1: 0.8894 acc: 0.8885 [BEST: 0.8934]
04/05/2020 11:23:54 > epoch 18 updates 25660 loss: 0.1172 lr: 3.3287e-04 gnorm: 0.3508
04/05/2020 11:23:56 > epoch 18 updates 25680 loss: 0.1228 lr: 3.3287e-04 gnorm: 0.4017
04/05/2020 11:23:59 > epoch 18 updates 25700 loss: 0.1064 lr: 3.3287e-04 gnorm: 0.3205
04/05/2020 11:24:01 train loss: 0.1155 lr: 3.3287e-04 gnorm: 0.3575 clip: 0
04/05/2020 11:24:01 valid loss: 0.3172 auc: 0.9531 f1: 0.8916 acc: 0.8895 [BEST: 0.8934]
04/05/2020 11:24:04 > epoch 18 updates 25720 loss: 0.1449 lr: 3.3287e-04 gnorm: 0.3700
04/05/2020 11:24:07 > epoch 18 updates 25740 loss: 0.1058 lr: 3.3287e-04 gnorm: 0.3392
04/05/2020 11:24:11 train loss: 0.1252 lr: 3.3287e-04 gnorm: 0.3545 clip: 0
04/05/2020 11:24:11 valid loss: 0.3158 auc: 0.9532 f1: 0.8921 acc: 0.8889 [BEST: 0.8934]
04/05/2020 11:24:12 > epoch 18 updates 25760 loss: 0.0921 lr: 3.3287e-04 gnorm: 0.3710
04/05/2020 11:24:15 > epoch 18 updates 25780 loss: 0.0694 lr: 3.3287e-04 gnorm: 0.3038
04/05/2020 11:24:18 > epoch 18 updates 25800 loss: 0.1355 lr: 3.3287e-04 gnorm: 0.4763
04/05/2020 11:24:20 train loss: 0.0992 lr: 3.3287e-04 gnorm: 0.3840 clip: 0
04/05/2020 11:24:20 valid loss: 0.3225 auc: 0.9535 f1: 0.8886 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:24:23 > epoch 18 updates 25820 loss: 0.1210 lr: 3.3287e-04 gnorm: 0.3467
04/05/2020 11:24:26 > epoch 18 updates 25840 loss: 0.1486 lr: 3.3287e-04 gnorm: 0.4001
04/05/2020 11:24:30 train loss: 0.1349 lr: 3.3287e-04 gnorm: 0.3735 clip: 0
04/05/2020 11:24:30 valid loss: 0.3141 auc: 0.9551 f1: 0.8892 acc: 0.8890 [BEST: 0.8934]
04/05/2020 11:24:31 > epoch 18 updates 25860 loss: 0.1399 lr: 3.3287e-04 gnorm: 0.3375
04/05/2020 11:24:34 > epoch 18 updates 25880 loss: 0.0994 lr: 3.3287e-04 gnorm: 0.3403
04/05/2020 11:24:37 > epoch 18 updates 25900 loss: 0.1780 lr: 3.3287e-04 gnorm: 0.3720
04/05/2020 11:24:39 train loss: 0.1392 lr: 3.3287e-04 gnorm: 0.3501 clip: 0
04/05/2020 11:24:39 valid loss: 0.3314 auc: 0.9518 f1: 0.8888 acc: 0.8855 [BEST: 0.8934]
04/05/2020 11:24:42 > epoch 18 updates 25920 loss: 0.1402 lr: 3.3287e-04 gnorm: 0.4606
04/05/2020 11:24:45 > epoch 18 updates 25940 loss: 0.1148 lr: 3.3287e-04 gnorm: 0.4028
04/05/2020 11:24:48 train loss: 0.1275 lr: 3.3287e-04 gnorm: 0.4315 clip: 0
04/05/2020 11:24:48 valid loss: 0.3019 auc: 0.9543 f1: 0.8923 acc: 0.8905 [BEST: 0.8934]
04/05/2020 11:24:50 > epoch 18 updates 25960 loss: 0.1189 lr: 3.3287e-04 gnorm: 0.3361
04/05/2020 11:24:53 > epoch 18 updates 25980 loss: 0.1479 lr: 3.3287e-04 gnorm: 0.3645
04/05/2020 11:24:56 > epoch 18 updates 26000 loss: 0.1301 lr: 3.3287e-04 gnorm: 0.3979
04/05/2020 11:24:58 train loss: 0.1323 lr: 3.3287e-04 gnorm: 0.3664 clip: 0
04/05/2020 11:24:58 valid loss: 0.3100 auc: 0.9548 f1: 0.8928 acc: 0.8907 [BEST: 0.8934]
04/05/2020 11:25:01 > epoch 18 updates 26020 loss: 0.1227 lr: 3.1622e-04 gnorm: 0.3036
04/05/2020 11:25:04 > epoch 18 updates 26040 loss: 0.1152 lr: 3.1622e-04 gnorm: 0.3788
04/05/2020 11:25:08 train loss: 0.1189 lr: 3.1622e-04 gnorm: 0.3414 clip: 0
04/05/2020 11:25:08 valid loss: 0.3113 auc: 0.9540 f1: 0.8914 acc: 0.8895 [BEST: 0.8934]
04/05/2020 11:25:09 > epoch 18 updates 26060 loss: 0.1397 lr: 3.1622e-04 gnorm: 0.4424
04/05/2020 11:25:12 > epoch 18 updates 26080 loss: 0.0783 lr: 3.1622e-04 gnorm: 0.2881
04/05/2020 11:25:15 > epoch 18 updates 26100 loss: 0.0961 lr: 3.1622e-04 gnorm: 0.3685
04/05/2020 11:25:17 train loss: 0.1046 lr: 3.1622e-04 gnorm: 0.3661 clip: 0
04/05/2020 11:25:17 valid loss: 0.3116 auc: 0.9547 f1: 0.8925 acc: 0.8908 [BEST: 0.8934]
04/05/2020 11:25:20 > epoch 18 updates 26120 loss: 0.1355 lr: 3.1622e-04 gnorm: 0.4206
04/05/2020 11:25:23 > epoch 18 updates 26140 loss: 0.1386 lr: 3.1622e-04 gnorm: 0.4527
04/05/2020 11:25:26 train loss: 0.1371 lr: 3.1622e-04 gnorm: 0.4367 clip: 0
04/05/2020 11:25:26 valid loss: 0.3185 auc: 0.9539 f1: 0.8909 acc: 0.8878 [BEST: 0.8934]
04/05/2020 11:25:27 > epoch 18 updates 26160 loss: 0.1087 lr: 3.1622e-04 gnorm: 0.4092
04/05/2020 11:25:30 > epoch 18 updates 26180 loss: 0.1474 lr: 3.1622e-04 gnorm: 0.4006
04/05/2020 11:25:34 > epoch 18 updates 26200 loss: 0.1290 lr: 3.1622e-04 gnorm: 0.3350
04/05/2020 11:25:35 train loss: 0.1285 lr: 3.1622e-04 gnorm: 0.3813 clip: 0
04/05/2020 11:25:35 valid loss: 0.3115 auc: 0.9536 f1: 0.8901 acc: 0.8882 [BEST: 0.8934]
04/05/2020 11:25:38 > epoch 18 updates 26220 loss: 0.1534 lr: 3.1622e-04 gnorm: 0.4173
04/05/2020 11:25:41 > epoch 18 updates 26240 loss: 0.0971 lr: 3.1622e-04 gnorm: 0.2764
04/05/2020 11:25:45 train loss: 0.1251 lr: 3.1622e-04 gnorm: 0.3465 clip: 0
04/05/2020 11:25:45 valid loss: 0.3118 auc: 0.9547 f1: 0.8930 acc: 0.8905 [BEST: 0.8934]
04/05/2020 11:25:46 > epoch 18 updates 26260 loss: 0.0910 lr: 3.1622e-04 gnorm: 0.3007
04/05/2020 11:25:49 > epoch 18 updates 26280 loss: 0.1002 lr: 3.1622e-04 gnorm: 0.3043
04/05/2020 11:25:52 > epoch 18 updates 26300 loss: 0.1617 lr: 3.1622e-04 gnorm: 0.3649
04/05/2020 11:25:54 train loss: 0.1179 lr: 3.1622e-04 gnorm: 0.3235 clip: 0
04/05/2020 11:25:54 valid loss: 0.3037 auc: 0.9544 f1: 0.8904 acc: 0.8889 [BEST: 0.8934]
04/05/2020 11:25:57 > epoch 18 updates 26320 loss: 0.1037 lr: 3.1622e-04 gnorm: 0.3598
04/05/2020 11:26:00 > epoch 18 updates 26340 loss: 0.1315 lr: 3.1622e-04 gnorm: 0.3902
04/05/2020 11:26:03 train loss: 0.1177 lr: 3.1622e-04 gnorm: 0.3751 clip: 0
04/05/2020 11:26:03 valid loss: 0.3063 auc: 0.9554 f1: 0.8904 acc: 0.8893 [BEST: 0.8934]
04/05/2020 11:26:05 > epoch 18 updates 26360 loss: 0.1151 lr: 3.1622e-04 gnorm: 0.3607
04/05/2020 11:26:08 > epoch 18 updates 26380 loss: 0.1410 lr: 3.1622e-04 gnorm: 0.3748
04/05/2020 11:26:11 > epoch 18 updates 26400 loss: 0.1253 lr: 3.1622e-04 gnorm: 0.3212
04/05/2020 11:26:13 train loss: 0.1272 lr: 3.1622e-04 gnorm: 0.3521 clip: 0
04/05/2020 11:26:13 valid loss: 0.3057 auc: 0.9541 f1: 0.8896 acc: 0.8877 [BEST: 0.8934]
04/05/2020 11:26:15 > epoch 18 updates 26420 loss: 0.1068 lr: 3.1622e-04 gnorm: 0.3714
04/05/2020 11:26:19 > epoch 18 updates 26440 loss: 0.1633 lr: 3.1622e-04 gnorm: 0.4198
04/05/2020 11:26:22 train loss: 0.1352 lr: 3.1622e-04 gnorm: 0.3957 clip: 0
04/05/2020 11:26:22 valid loss: 0.3084 auc: 0.9545 f1: 0.8907 acc: 0.8892 [BEST: 0.8934]
04/05/2020 11:26:23 > epoch 18 updates 26460 loss: 0.1099 lr: 3.1622e-04 gnorm: 0.3910
04/05/2020 11:26:26 > epoch 18 updates 26480 loss: 0.1313 lr: 3.1622e-04 gnorm: 0.3739
04/05/2020 11:26:29 > epoch 18 updates 26500 loss: 0.1094 lr: 3.1622e-04 gnorm: 0.4214
04/05/2020 11:26:31 train loss: 0.1168 lr: 3.1622e-04 gnorm: 0.3955 clip: 0
04/05/2020 11:26:31 valid loss: 0.3097 auc: 0.9557 f1: 0.8924 acc: 0.8900 [BEST: 0.8934]
04/05/2020 11:26:34 > epoch 18 updates 26520 loss: 0.1184 lr: 3.1622e-04 gnorm: 0.3369
04/05/2020 11:26:37 > epoch 18 updates 26540 loss: 0.1458 lr: 3.1622e-04 gnorm: 0.4051
04/05/2020 11:26:40 train loss: 0.1321 lr: 3.1622e-04 gnorm: 0.3712 clip: 0
04/05/2020 11:26:40 valid loss: 0.3134 auc: 0.9536 f1: 0.8904 acc: 0.8877 [BEST: 0.8934]
04/05/2020 11:26:42 > epoch 18 updates 26560 loss: 0.1260 lr: 3.1622e-04 gnorm: 0.4374
04/05/2020 11:26:45 > epoch 18 updates 26580 loss: 0.1044 lr: 3.1622e-04 gnorm: 0.3284
04/05/2020 11:26:47 > epoch 18 updates 26600 loss: 0.0878 lr: 3.1622e-04 gnorm: 0.2737
04/05/2020 11:26:49 train loss: 0.1060 lr: 3.1622e-04 gnorm: 0.3460 clip: 0
04/05/2020 11:26:49 valid loss: 0.3073 auc: 0.9538 f1: 0.8913 acc: 0.8888 [BEST: 0.8934]
04/05/2020 11:26:52 > epoch 18 updates 26620 loss: 0.0931 lr: 3.1622e-04 gnorm: 0.2731
04/05/2020 11:26:55 > epoch 18 updates 26640 loss: 0.1292 lr: 3.1622e-04 gnorm: 0.3957
04/05/2020 11:26:59 train loss: 0.1112 lr: 3.1622e-04 gnorm: 0.3347 clip: 0
04/05/2020 11:26:59 valid loss: 0.3054 auc: 0.9555 f1: 0.8923 acc: 0.8905 [BEST: 0.8934]
04/05/2020 11:27:00 > epoch 18 updates 26660 loss: 0.1140 lr: 3.1622e-04 gnorm: 0.3081
04/05/2020 11:27:03 > epoch 18 updates 26680 loss: 0.1371 lr: 3.1622e-04 gnorm: 0.3710
04/05/2020 11:27:06 > epoch 18 updates 26700 loss: 0.1360 lr: 3.1622e-04 gnorm: 0.3130
04/05/2020 11:27:08 train loss: 0.1291 lr: 3.1622e-04 gnorm: 0.3307 clip: 0
04/05/2020 11:27:08 valid loss: 0.3053 auc: 0.9535 f1: 0.8913 acc: 0.8889 [BEST: 0.8934]
04/05/2020 11:27:11 > epoch 18 updates 26720 loss: 0.1380 lr: 3.1622e-04 gnorm: 0.3554
04/05/2020 11:27:14 > epoch 18 updates 26740 loss: 0.1349 lr: 3.1622e-04 gnorm: 0.5414
04/05/2020 11:27:17 train loss: 0.1364 lr: 3.1622e-04 gnorm: 0.4489 clip: 0
04/05/2020 11:27:17 valid loss: 0.3068 auc: 0.9556 f1: 0.8937 acc: 0.8913 [BEST: 0.8934]
04/05/2020 11:27:19 > epoch 18 updates 26760 loss: 0.1232 lr: 3.1622e-04 gnorm: 0.3487
04/05/2020 11:27:22 > epoch 18 updates 26780 loss: 0.1713 lr: 3.1622e-04 gnorm: 0.4967
04/05/2020 11:27:25 > epoch 18 updates 26800 loss: 0.0920 lr: 3.1622e-04 gnorm: 0.3263
04/05/2020 11:27:27 train loss: 0.1288 lr: 3.1622e-04 gnorm: 0.3905 clip: 0
04/05/2020 11:27:27 valid loss: 0.3130 auc: 0.9539 f1: 0.8901 acc: 0.8892 [BEST: 0.8934]
04/05/2020 11:27:30 > epoch 18 updates 26820 loss: 0.1184 lr: 3.1622e-04 gnorm: 0.2680
04/05/2020 11:27:33 > epoch 18 updates 26840 loss: 0.1098 lr: 3.1622e-04 gnorm: 0.3864
04/05/2020 11:27:36 train loss: 0.1141 lr: 3.1622e-04 gnorm: 0.3275 clip: 0
04/05/2020 11:27:36 valid loss: 0.3156 auc: 0.9528 f1: 0.8921 acc: 0.8901 [BEST: 0.8934]
04/05/2020 11:27:37 > epoch 18 updates 26860 loss: 0.1034 lr: 3.1622e-04 gnorm: 0.3254
04/05/2020 11:27:40 > epoch 18 updates 26880 loss: 0.1144 lr: 3.1622e-04 gnorm: 0.3548
04/05/2020 11:27:43 > epoch 18 updates 26900 loss: 0.1219 lr: 3.1622e-04 gnorm: 0.4683
04/05/2020 11:27:45 train loss: 0.1133 lr: 3.1622e-04 gnorm: 0.3833 clip: 0
04/05/2020 11:27:45 valid loss: 0.3076 auc: 0.9548 f1: 0.8918 acc: 0.8902 [BEST: 0.8934]
04/05/2020 11:27:48 > epoch 18 updates 26920 loss: 0.1885 lr: 3.1622e-04 gnorm: 0.4632
04/05/2020 11:27:51 > epoch 18 updates 26940 loss: 0.1360 lr: 3.1622e-04 gnorm: 0.3348
04/05/2020 11:27:54 train loss: 0.1622 lr: 3.1622e-04 gnorm: 0.3987 clip: 0
04/05/2020 11:27:54 valid loss: 0.2986 auc: 0.9558 f1: 0.8923 acc: 0.8906 [BEST: 0.8934]
04/05/2020 11:27:56 > epoch 18 updates 26960 loss: 0.1342 lr: 3.1622e-04 gnorm: 0.3501
04/05/2020 11:27:59 > epoch 18 updates 26980 loss: 0.1047 lr: 3.1622e-04 gnorm: 0.3032
04/05/2020 11:28:02 > epoch 18 updates 27000 loss: 0.1126 lr: 3.1622e-04 gnorm: 0.4229
04/05/2020 11:28:04 train loss: 0.1171 lr: 3.1622e-04 gnorm: 0.3590 clip: 0
04/05/2020 11:28:04 valid loss: 0.3084 auc: 0.9548 f1: 0.8944 acc: 0.8919 [BEST: 0.8934]
04/05/2020 11:28:06 > epoch 18 updates 27020 loss: 0.1127 lr: 3.0041e-04 gnorm: 0.3660
04/05/2020 11:28:11 train loss: 0.1127 lr: 3.0041e-04 gnorm: 0.3660 clip: 0
04/05/2020 11:28:11 valid loss: 0.3091 auc: 0.9538 f1: 0.8906 acc: 0.8892 [BEST: 0.8934]
04/05/2020 11:28:11 Epoch: 19
04/05/2020 11:28:15 > epoch 19 updates 27040 loss: 0.1087 lr: 3.0041e-04 gnorm: 0.3706
04/05/2020 11:28:19 train loss: 0.1087 lr: 3.0041e-04 gnorm: 0.3706 clip: 0
04/05/2020 11:28:19 valid loss: 0.3061 auc: 0.9541 f1: 0.8913 acc: 0.8890 [BEST: 0.8934]
04/05/2020 11:28:20 > epoch 19 updates 27060 loss: 0.1371 lr: 3.0041e-04 gnorm: 0.3348
04/05/2020 11:28:23 > epoch 19 updates 27080 loss: 0.0953 lr: 3.0041e-04 gnorm: 0.3596
04/05/2020 11:28:26 > epoch 19 updates 27100 loss: 0.0858 lr: 3.0041e-04 gnorm: 0.3253
04/05/2020 11:28:28 train loss: 0.1059 lr: 3.0041e-04 gnorm: 0.3399 clip: 0
04/05/2020 11:28:28 valid loss: 0.3236 auc: 0.9542 f1: 0.8919 acc: 0.8890 [BEST: 0.8934]
04/05/2020 11:28:31 > epoch 19 updates 27120 loss: 0.1045 lr: 3.0041e-04 gnorm: 0.3594
04/05/2020 11:28:34 > epoch 19 updates 27140 loss: 0.1069 lr: 3.0041e-04 gnorm: 0.2920
04/05/2020 11:28:37 train loss: 0.1057 lr: 3.0041e-04 gnorm: 0.3255 clip: 0
04/05/2020 11:28:37 valid loss: 0.3153 auc: 0.9539 f1: 0.8885 acc: 0.8876 [BEST: 0.8934]
04/05/2020 11:28:39 > epoch 19 updates 27160 loss: 0.1198 lr: 3.0041e-04 gnorm: 0.3279
04/05/2020 11:28:42 > epoch 19 updates 27180 loss: 0.0813 lr: 3.0041e-04 gnorm: 0.3529
04/05/2020 11:28:45 > epoch 19 updates 27200 loss: 0.1126 lr: 3.0041e-04 gnorm: 0.3970
04/05/2020 11:28:47 train loss: 0.1045 lr: 3.0041e-04 gnorm: 0.3595 clip: 0
04/05/2020 11:28:47 valid loss: 0.3280 auc: 0.9516 f1: 0.8885 acc: 0.8871 [BEST: 0.8934]
04/05/2020 11:28:49 > epoch 19 updates 27220 loss: 0.1310 lr: 3.0041e-04 gnorm: 0.5006
04/05/2020 11:28:52 > epoch 19 updates 27240 loss: 0.1179 lr: 3.0041e-04 gnorm: 0.4293
04/05/2020 11:28:56 train loss: 0.1244 lr: 3.0041e-04 gnorm: 0.4648 clip: 0
04/05/2020 11:28:56 valid loss: 0.3295 auc: 0.9544 f1: 0.8929 acc: 0.8904 [BEST: 0.8934]
04/05/2020 11:28:57 > epoch 19 updates 27260 loss: 0.1860 lr: 3.0041e-04 gnorm: 0.5227
04/05/2020 11:29:00 > epoch 19 updates 27280 loss: 0.1234 lr: 3.0041e-04 gnorm: 0.3502
04/05/2020 11:29:03 > epoch 19 updates 27300 loss: 0.1123 lr: 3.0041e-04 gnorm: 0.3477
04/05/2020 11:29:05 train loss: 0.1403 lr: 3.0041e-04 gnorm: 0.4062 clip: 0
04/05/2020 11:29:05 valid loss: 0.3196 auc: 0.9540 f1: 0.8915 acc: 0.8891 [BEST: 0.8934]
04/05/2020 11:29:08 > epoch 19 updates 27320 loss: 0.0976 lr: 3.0041e-04 gnorm: 0.3067
04/05/2020 11:29:11 > epoch 19 updates 27340 loss: 0.0791 lr: 3.0041e-04 gnorm: 0.3018
04/05/2020 11:29:14 train loss: 0.0883 lr: 3.0041e-04 gnorm: 0.3042 clip: 0
04/05/2020 11:29:14 valid loss: 0.3242 auc: 0.9528 f1: 0.8908 acc: 0.8891 [BEST: 0.8934]
04/05/2020 11:29:16 > epoch 19 updates 27360 loss: 0.1151 lr: 3.0041e-04 gnorm: 0.3799
04/05/2020 11:29:19 > epoch 19 updates 27380 loss: 0.0887 lr: 3.0041e-04 gnorm: 0.3120
04/05/2020 11:29:21 > epoch 19 updates 27400 loss: 0.1368 lr: 3.0041e-04 gnorm: 0.3999
04/05/2020 11:29:23 train loss: 0.1136 lr: 3.0041e-04 gnorm: 0.3640 clip: 0
04/05/2020 11:29:23 valid loss: 0.3245 auc: 0.9530 f1: 0.8907 acc: 0.8883 [BEST: 0.8934]
04/05/2020 11:29:26 > epoch 19 updates 27420 loss: 0.1242 lr: 3.0041e-04 gnorm: 0.3405
04/05/2020 11:29:29 > epoch 19 updates 27440 loss: 0.0949 lr: 3.0041e-04 gnorm: 0.3054
04/05/2020 11:29:33 train loss: 0.1095 lr: 3.0041e-04 gnorm: 0.3229 clip: 0
04/05/2020 11:29:33 valid loss: 0.3180 auc: 0.9530 f1: 0.8878 acc: 0.8864 [BEST: 0.8934]
04/05/2020 11:29:34 > epoch 19 updates 27460 loss: 0.1085 lr: 3.0041e-04 gnorm: 0.3593
04/05/2020 11:29:37 > epoch 19 updates 27480 loss: 0.0939 lr: 3.0041e-04 gnorm: 0.3686
04/05/2020 11:29:40 > epoch 19 updates 27500 loss: 0.1156 lr: 3.0041e-04 gnorm: 0.4084
04/05/2020 11:29:42 train loss: 0.1060 lr: 3.0041e-04 gnorm: 0.3789 clip: 0
04/05/2020 11:29:42 valid loss: 0.3194 auc: 0.9536 f1: 0.8905 acc: 0.8887 [BEST: 0.8934]
04/05/2020 11:29:45 > epoch 19 updates 27520 loss: 0.0987 lr: 3.0041e-04 gnorm: 0.3439
04/05/2020 11:29:48 > epoch 19 updates 27540 loss: 0.0979 lr: 3.0041e-04 gnorm: 0.3137
04/05/2020 11:29:51 train loss: 0.0983 lr: 3.0041e-04 gnorm: 0.3287 clip: 0
04/05/2020 11:29:51 valid loss: 0.3134 auc: 0.9533 f1: 0.8889 acc: 0.8879 [BEST: 0.8934]
04/05/2020 11:29:53 > epoch 19 updates 27560 loss: 0.1461 lr: 3.0041e-04 gnorm: 0.5267
04/05/2020 11:29:56 > epoch 19 updates 27580 loss: 0.1110 lr: 3.0041e-04 gnorm: 0.3326
04/05/2020 11:29:59 > epoch 19 updates 27600 loss: 0.1574 lr: 3.0041e-04 gnorm: 0.3636
04/05/2020 11:30:01 train loss: 0.1382 lr: 3.0041e-04 gnorm: 0.4071 clip: 0
04/05/2020 11:30:01 valid loss: 0.3149 auc: 0.9533 f1: 0.8896 acc: 0.8877 [BEST: 0.8934]
04/05/2020 11:30:04 > epoch 19 updates 27620 loss: 0.1373 lr: 3.0041e-04 gnorm: 0.4128
04/05/2020 11:30:07 > epoch 19 updates 27640 loss: 0.1161 lr: 3.0041e-04 gnorm: 0.3912
04/05/2020 11:30:10 train loss: 0.1266 lr: 3.0041e-04 gnorm: 0.4020 clip: 0
04/05/2020 11:30:10 valid loss: 0.3059 auc: 0.9548 f1: 0.8918 acc: 0.8896 [BEST: 0.8934]
04/05/2020 11:30:12 > epoch 19 updates 27660 loss: 0.0861 lr: 3.0041e-04 gnorm: 0.2463
04/05/2020 11:30:14 > epoch 19 updates 27680 loss: 0.0971 lr: 3.0041e-04 gnorm: 0.3115
04/05/2020 11:30:17 > epoch 19 updates 27700 loss: 0.1065 lr: 3.0041e-04 gnorm: 0.3541
04/05/2020 11:30:19 train loss: 0.0967 lr: 3.0041e-04 gnorm: 0.3043 clip: 0
04/05/2020 11:30:19 valid loss: 0.3073 auc: 0.9554 f1: 0.8948 acc: 0.8928 [BEST: 0.8934]
04/05/2020 11:30:22 > epoch 19 updates 27720 loss: 0.0957 lr: 3.0041e-04 gnorm: 0.3734
04/05/2020 11:30:25 > epoch 19 updates 27740 loss: 0.1510 lr: 3.0041e-04 gnorm: 0.4239
04/05/2020 11:30:29 train loss: 0.1235 lr: 3.0041e-04 gnorm: 0.3988 clip: 0
04/05/2020 11:30:29 valid loss: 0.3109 auc: 0.9546 f1: 0.8934 acc: 0.8913 [BEST: 0.8934]
04/05/2020 11:30:30 > epoch 19 updates 27760 loss: 0.1192 lr: 3.0041e-04 gnorm: 0.3387
04/05/2020 11:30:33 > epoch 19 updates 27780 loss: 0.1383 lr: 3.0041e-04 gnorm: 0.3644
04/05/2020 11:30:36 > epoch 19 updates 27800 loss: 0.1155 lr: 3.0041e-04 gnorm: 0.4008
04/05/2020 11:30:38 train loss: 0.1243 lr: 3.0041e-04 gnorm: 0.3682 clip: 0
04/05/2020 11:30:38 valid loss: 0.3176 auc: 0.9536 f1: 0.8919 acc: 0.8887 [BEST: 0.8934]
04/05/2020 11:30:41 > epoch 19 updates 27820 loss: 0.0874 lr: 3.0041e-04 gnorm: 0.3090
04/05/2020 11:30:44 > epoch 19 updates 27840 loss: 0.1338 lr: 3.0041e-04 gnorm: 0.4304
04/05/2020 11:30:47 train loss: 0.1107 lr: 3.0041e-04 gnorm: 0.3700 clip: 0
04/05/2020 11:30:47 valid loss: 0.3080 auc: 0.9548 f1: 0.8921 acc: 0.8902 [BEST: 0.8934]
04/05/2020 11:30:48 > epoch 19 updates 27860 loss: 0.1202 lr: 3.0041e-04 gnorm: 0.3471
04/05/2020 11:30:51 > epoch 19 updates 27880 loss: 0.1042 lr: 3.0041e-04 gnorm: 0.2936
04/05/2020 11:30:54 > epoch 19 updates 27900 loss: 0.0955 lr: 3.0041e-04 gnorm: 0.3031
04/05/2020 11:30:56 train loss: 0.1066 lr: 3.0041e-04 gnorm: 0.3145 clip: 0
04/05/2020 11:30:56 valid loss: 0.3171 auc: 0.9536 f1: 0.8930 acc: 0.8902 [BEST: 0.8934]
04/05/2020 11:30:59 > epoch 19 updates 27920 loss: 0.1242 lr: 3.0041e-04 gnorm: 0.3349
04/05/2020 11:31:02 > epoch 19 updates 27940 loss: 0.0856 lr: 3.0041e-04 gnorm: 0.2839
04/05/2020 11:31:06 train loss: 0.1048 lr: 3.0041e-04 gnorm: 0.3093 clip: 0
04/05/2020 11:31:06 valid loss: 0.3183 auc: 0.9541 f1: 0.8920 acc: 0.8902 [BEST: 0.8934]
04/05/2020 11:31:07 > epoch 19 updates 27960 loss: 0.1307 lr: 3.0041e-04 gnorm: 0.3853
04/05/2020 11:31:10 > epoch 19 updates 27980 loss: 0.0895 lr: 3.0041e-04 gnorm: 0.3304
04/05/2020 11:31:13 > epoch 19 updates 28000 loss: 0.1194 lr: 3.0041e-04 gnorm: 0.3941
04/05/2020 11:31:15 train loss: 0.1131 lr: 3.0041e-04 gnorm: 0.3700 clip: 0
04/05/2020 11:31:15 valid loss: 0.3143 auc: 0.9547 f1: 0.8911 acc: 0.8895 [BEST: 0.8934]
04/05/2020 11:31:18 > epoch 19 updates 28020 loss: 0.1212 lr: 2.8539e-04 gnorm: 0.3151
04/05/2020 11:31:21 > epoch 19 updates 28040 loss: 0.1001 lr: 2.8539e-04 gnorm: 0.3378
04/05/2020 11:31:25 train loss: 0.1106 lr: 2.8539e-04 gnorm: 0.3265 clip: 0
04/05/2020 11:31:25 valid loss: 0.3225 auc: 0.9536 f1: 0.8926 acc: 0.8896 [BEST: 0.8934]
04/05/2020 11:31:26 > epoch 19 updates 28060 loss: 0.1070 lr: 2.8539e-04 gnorm: 0.3196
04/05/2020 11:31:29 > epoch 19 updates 28080 loss: 0.1314 lr: 2.8539e-04 gnorm: 0.4346
04/05/2020 11:31:32 > epoch 19 updates 28100 loss: 0.0929 lr: 2.8539e-04 gnorm: 0.2552
04/05/2020 11:31:34 train loss: 0.1104 lr: 2.8539e-04 gnorm: 0.3362 clip: 0
04/05/2020 11:31:34 valid loss: 0.3230 auc: 0.9520 f1: 0.8908 acc: 0.8875 [BEST: 0.8934]
04/05/2020 11:31:37 > epoch 19 updates 28120 loss: 0.1804 lr: 2.8539e-04 gnorm: 0.4090
04/05/2020 11:31:40 > epoch 19 updates 28140 loss: 0.1216 lr: 2.8539e-04 gnorm: 0.3919
04/05/2020 11:31:43 train loss: 0.1508 lr: 2.8539e-04 gnorm: 0.4004 clip: 0
04/05/2020 11:31:43 valid loss: 0.3100 auc: 0.9547 f1: 0.8918 acc: 0.8899 [BEST: 0.8934]
04/05/2020 11:31:45 > epoch 19 updates 28160 loss: 0.0881 lr: 2.8539e-04 gnorm: 0.2830
04/05/2020 11:31:48 > epoch 19 updates 28180 loss: 0.1042 lr: 2.8539e-04 gnorm: 0.4499
04/05/2020 11:31:51 > epoch 19 updates 28200 loss: 0.1432 lr: 2.8539e-04 gnorm: 0.5044
04/05/2020 11:31:53 train loss: 0.1120 lr: 2.8539e-04 gnorm: 0.4132 clip: 0
04/05/2020 11:31:53 valid loss: 0.3155 auc: 0.9547 f1: 0.8879 acc: 0.8873 [BEST: 0.8934]
04/05/2020 11:31:55 > epoch 19 updates 28220 loss: 0.1059 lr: 2.8539e-04 gnorm: 0.3430
04/05/2020 11:31:58 > epoch 19 updates 28240 loss: 0.1124 lr: 2.8539e-04 gnorm: 0.3603
04/05/2020 11:32:02 train loss: 0.1092 lr: 2.8539e-04 gnorm: 0.3517 clip: 0
04/05/2020 11:32:02 valid loss: 0.3149 auc: 0.9553 f1: 0.8879 acc: 0.8877 [BEST: 0.8934]
04/05/2020 11:32:03 > epoch 19 updates 28260 loss: 0.0755 lr: 2.8539e-04 gnorm: 0.2467
04/05/2020 11:32:06 > epoch 19 updates 28280 loss: 0.0763 lr: 2.8539e-04 gnorm: 0.2660
04/05/2020 11:32:09 > epoch 19 updates 28300 loss: 0.1355 lr: 2.8539e-04 gnorm: 0.3706
04/05/2020 11:32:11 train loss: 0.0960 lr: 2.8539e-04 gnorm: 0.2949 clip: 0
04/05/2020 11:32:11 valid loss: 0.3136 auc: 0.9550 f1: 0.8897 acc: 0.8885 [BEST: 0.8934]
04/05/2020 11:32:14 > epoch 19 updates 28320 loss: 0.1413 lr: 2.8539e-04 gnorm: 0.3509
04/05/2020 11:32:17 > epoch 19 updates 28340 loss: 0.0990 lr: 2.8539e-04 gnorm: 0.3311
04/05/2020 11:32:21 train loss: 0.1200 lr: 2.8539e-04 gnorm: 0.3409 clip: 0
04/05/2020 11:32:21 valid loss: 0.3179 auc: 0.9534 f1: 0.8931 acc: 0.8904 [BEST: 0.8934]
04/05/2020 11:32:22 > epoch 19 updates 28360 loss: 0.1320 lr: 2.8539e-04 gnorm: 0.3872
04/05/2020 11:32:25 > epoch 19 updates 28380 loss: 0.1223 lr: 2.8539e-04 gnorm: 0.3361
04/05/2020 11:32:28 > epoch 19 updates 28400 loss: 0.1901 lr: 2.8539e-04 gnorm: 0.4472
04/05/2020 11:32:30 train loss: 0.1483 lr: 2.8539e-04 gnorm: 0.3904 clip: 0
04/05/2020 11:32:30 valid loss: 0.3142 auc: 0.9548 f1: 0.8942 acc: 0.8917 [BEST: 0.8934]
04/05/2020 11:32:33 > epoch 19 updates 28420 loss: 0.1961 lr: 2.8539e-04 gnorm: 0.4972
04/05/2020 11:32:36 > epoch 19 updates 28440 loss: 0.1517 lr: 2.8539e-04 gnorm: 0.3998
04/05/2020 11:32:39 train loss: 0.1738 lr: 2.8539e-04 gnorm: 0.4483 clip: 0
04/05/2020 11:32:39 valid loss: 0.3039 auc: 0.9562 f1: 0.8915 acc: 0.8908 [BEST: 0.8934]
04/05/2020 11:32:41 > epoch 19 updates 28460 loss: 0.1152 lr: 2.8539e-04 gnorm: 0.3195
04/05/2020 11:32:43 > epoch 19 updates 28480 loss: 0.1164 lr: 2.8539e-04 gnorm: 0.4442
04/05/2020 11:32:46 > epoch 19 updates 28500 loss: 0.0996 lr: 2.8539e-04 gnorm: 0.4326
04/05/2020 11:32:48 train loss: 0.1103 lr: 2.8539e-04 gnorm: 0.3991 clip: 0
04/05/2020 11:32:48 valid loss: 0.3173 auc: 0.9544 f1: 0.8933 acc: 0.8915 [BEST: 0.8934]
04/05/2020 11:32:51 > epoch 19 updates 28520 loss: 0.1214 lr: 2.8539e-04 gnorm: 0.3551
04/05/2020 11:32:56 train loss: 0.1214 lr: 2.8539e-04 gnorm: 0.3551 clip: 0
04/05/2020 11:32:56 valid loss: 0.3149 auc: 0.9547 f1: 0.8923 acc: 0.8905 [BEST: 0.8934]
04/05/2020 11:32:56 Epoch: 20
04/05/2020 11:32:59 > epoch 20 updates 28540 loss: 0.0824 lr: 2.8539e-04 gnorm: 0.3189
04/05/2020 11:33:03 train loss: 0.0824 lr: 2.8539e-04 gnorm: 0.3189 clip: 0
04/05/2020 11:33:03 valid loss: 0.3137 auc: 0.9539 f1: 0.8935 acc: 0.8908 [BEST: 0.8934]
04/05/2020 11:33:04 > epoch 20 updates 28560 loss: 0.0990 lr: 2.8539e-04 gnorm: 0.3127
04/05/2020 11:33:07 > epoch 20 updates 28580 loss: 0.0992 lr: 2.8539e-04 gnorm: 0.3081
04/05/2020 11:33:10 > epoch 20 updates 28600 loss: 0.0849 lr: 2.8539e-04 gnorm: 0.3748
04/05/2020 11:33:12 train loss: 0.0943 lr: 2.8539e-04 gnorm: 0.3321 clip: 0
04/05/2020 11:33:12 valid loss: 0.3248 auc: 0.9545 f1: 0.8914 acc: 0.8900 [BEST: 0.8934]
04/05/2020 11:33:15 > epoch 20 updates 28620 loss: 0.1196 lr: 2.8539e-04 gnorm: 0.3937
04/05/2020 11:33:18 > epoch 20 updates 28640 loss: 0.1219 lr: 2.8539e-04 gnorm: 0.4781
04/05/2020 11:33:22 train loss: 0.1208 lr: 2.8539e-04 gnorm: 0.4361 clip: 0
04/05/2020 11:33:22 valid loss: 0.3213 auc: 0.9530 f1: 0.8910 acc: 0.8891 [BEST: 0.8934]
04/05/2020 11:33:24 > epoch 20 updates 28660 loss: 0.1507 lr: 2.8539e-04 gnorm: 0.3843
04/05/2020 11:33:27 > epoch 20 updates 28680 loss: 0.0677 lr: 2.8539e-04 gnorm: 0.2711
04/05/2020 11:33:29 > epoch 20 updates 28700 loss: 0.1152 lr: 2.8539e-04 gnorm: 0.3939
04/05/2020 11:33:31 train loss: 0.1111 lr: 2.8539e-04 gnorm: 0.3498 clip: 0
04/05/2020 11:33:31 valid loss: 0.3362 auc: 0.9531 f1: 0.8909 acc: 0.8885 [BEST: 0.8934]
04/05/2020 11:33:35 > epoch 20 updates 28720 loss: 0.0823 lr: 2.8539e-04 gnorm: 0.3629
04/05/2020 11:33:38 > epoch 20 updates 28740 loss: 0.1302 lr: 2.8539e-04 gnorm: 0.3711
04/05/2020 11:33:41 train loss: 0.1064 lr: 2.8539e-04 gnorm: 0.3670 clip: 0
04/05/2020 11:33:41 valid loss: 0.3247 auc: 0.9531 f1: 0.8929 acc: 0.8906 [BEST: 0.8934]
04/05/2020 11:33:42 > epoch 20 updates 28760 loss: 0.1317 lr: 2.8539e-04 gnorm: 0.3927
04/05/2020 11:33:45 > epoch 20 updates 28780 loss: 0.1176 lr: 2.8539e-04 gnorm: 0.3247
04/05/2020 11:33:48 > epoch 20 updates 28800 loss: 0.1091 lr: 2.8539e-04 gnorm: 0.3130
04/05/2020 11:33:50 train loss: 0.1194 lr: 2.8539e-04 gnorm: 0.3432 clip: 0
04/05/2020 11:33:50 valid loss: 0.3179 auc: 0.9552 f1: 0.8915 acc: 0.8899 [BEST: 0.8934]
04/05/2020 11:33:53 > epoch 20 updates 28820 loss: 0.1265 lr: 2.8539e-04 gnorm: 0.4075
04/05/2020 11:33:56 > epoch 20 updates 28840 loss: 0.0849 lr: 2.8539e-04 gnorm: 0.3996
04/05/2020 11:34:00 train loss: 0.1056 lr: 2.8539e-04 gnorm: 0.4035 clip: 0
04/05/2020 11:34:00 valid loss: 0.3326 auc: 0.9547 f1: 0.8882 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:34:01 > epoch 20 updates 28860 loss: 0.0801 lr: 2.8539e-04 gnorm: 0.2896
04/05/2020 11:34:04 > epoch 20 updates 28880 loss: 0.1156 lr: 2.8539e-04 gnorm: 0.4558
04/05/2020 11:34:07 > epoch 20 updates 28900 loss: 0.1766 lr: 2.8539e-04 gnorm: 0.5871
04/05/2020 11:34:09 train loss: 0.1244 lr: 2.8539e-04 gnorm: 0.4452 clip: 0
04/05/2020 11:34:09 valid loss: 0.3294 auc: 0.9527 f1: 0.8891 acc: 0.8878 [BEST: 0.8934]
04/05/2020 11:34:12 > epoch 20 updates 28920 loss: 0.1599 lr: 2.8539e-04 gnorm: 0.4262
04/05/2020 11:34:15 > epoch 20 updates 28940 loss: 0.1028 lr: 2.8539e-04 gnorm: 0.3767
04/05/2020 11:34:18 train loss: 0.1312 lr: 2.8539e-04 gnorm: 0.4013 clip: 0
04/05/2020 11:34:18 valid loss: 0.3279 auc: 0.9524 f1: 0.8899 acc: 0.8873 [BEST: 0.8934]
04/05/2020 11:34:19 > epoch 20 updates 28960 loss: 0.1232 lr: 2.8539e-04 gnorm: 0.4070
04/05/2020 11:34:22 > epoch 20 updates 28980 loss: 0.1496 lr: 2.8539e-04 gnorm: 0.5085
04/05/2020 11:34:25 > epoch 20 updates 29000 loss: 0.0870 lr: 2.8539e-04 gnorm: 0.3382
04/05/2020 11:34:27 train loss: 0.1198 lr: 2.8539e-04 gnorm: 0.4177 clip: 0
04/05/2020 11:34:27 valid loss: 0.3325 auc: 0.9507 f1: 0.8867 acc: 0.8841 [BEST: 0.8934]
04/05/2020 11:34:30 > epoch 20 updates 29020 loss: 0.0894 lr: 2.7112e-04 gnorm: 0.2821
04/05/2020 11:34:33 > epoch 20 updates 29040 loss: 0.1139 lr: 2.7112e-04 gnorm: 0.3619
04/05/2020 11:34:36 train loss: 0.1017 lr: 2.7112e-04 gnorm: 0.3222 clip: 0
04/05/2020 11:34:36 valid loss: 0.3164 auc: 0.9542 f1: 0.8928 acc: 0.8905 [BEST: 0.8934]
04/05/2020 11:34:38 > epoch 20 updates 29060 loss: 0.0938 lr: 2.7112e-04 gnorm: 0.3060
04/05/2020 11:34:41 > epoch 20 updates 29080 loss: 0.0918 lr: 2.7112e-04 gnorm: 0.4157
04/05/2020 11:34:44 > epoch 20 updates 29100 loss: 0.1339 lr: 2.7112e-04 gnorm: 0.5181
04/05/2020 11:34:46 train loss: 0.1066 lr: 2.7112e-04 gnorm: 0.4140 clip: 0
04/05/2020 11:34:46 valid loss: 0.3237 auc: 0.9546 f1: 0.8924 acc: 0.8904 [BEST: 0.8934]
04/05/2020 11:34:49 > epoch 20 updates 29120 loss: 0.1366 lr: 2.7112e-04 gnorm: 0.4761
04/05/2020 11:34:52 > epoch 20 updates 29140 loss: 0.0977 lr: 2.7112e-04 gnorm: 0.2958
04/05/2020 11:34:55 train loss: 0.1171 lr: 2.7112e-04 gnorm: 0.3855 clip: 0
04/05/2020 11:34:55 valid loss: 0.3203 auc: 0.9530 f1: 0.8877 acc: 0.8870 [BEST: 0.8934]
04/05/2020 11:34:57 > epoch 20 updates 29160 loss: 0.1453 lr: 2.7112e-04 gnorm: 0.4529
04/05/2020 11:35:00 > epoch 20 updates 29180 loss: 0.1291 lr: 2.7112e-04 gnorm: 0.3695
04/05/2020 11:35:03 > epoch 20 updates 29200 loss: 0.0649 lr: 2.7112e-04 gnorm: 0.2191
04/05/2020 11:35:05 train loss: 0.1128 lr: 2.7112e-04 gnorm: 0.3464 clip: 0
04/05/2020 11:35:05 valid loss: 0.3206 auc: 0.9533 f1: 0.8892 acc: 0.8874 [BEST: 0.8934]
04/05/2020 11:35:08 > epoch 20 updates 29220 loss: 0.1124 lr: 2.7112e-04 gnorm: 0.3698
04/05/2020 11:35:11 > epoch 20 updates 29240 loss: 0.0679 lr: 2.7112e-04 gnorm: 0.2907
04/05/2020 11:35:14 train loss: 0.0900 lr: 2.7112e-04 gnorm: 0.3300 clip: 0
04/05/2020 11:35:14 valid loss: 0.3195 auc: 0.9557 f1: 0.8922 acc: 0.8909 [BEST: 0.8934]
04/05/2020 11:35:16 > epoch 20 updates 29260 loss: 0.1560 lr: 2.7112e-04 gnorm: 0.4660
04/05/2020 11:35:19 > epoch 20 updates 29280 loss: 0.0851 lr: 2.7112e-04 gnorm: 0.3094
04/05/2020 11:35:22 > epoch 20 updates 29300 loss: 0.0920 lr: 2.7112e-04 gnorm: 0.2613
04/05/2020 11:35:24 train loss: 0.1108 lr: 2.7112e-04 gnorm: 0.3449 clip: 0
04/05/2020 11:35:24 valid loss: 0.3164 auc: 0.9551 f1: 0.8931 acc: 0.8907 [BEST: 0.8934]
04/05/2020 11:35:27 > epoch 20 updates 29320 loss: 0.1088 lr: 2.7112e-04 gnorm: 0.3922
04/05/2020 11:35:30 > epoch 20 updates 29340 loss: 0.0878 lr: 2.7112e-04 gnorm: 0.2693
04/05/2020 11:35:33 train loss: 0.0982 lr: 2.7112e-04 gnorm: 0.3304 clip: 0
04/05/2020 11:35:33 valid loss: 0.3163 auc: 0.9535 f1: 0.8900 acc: 0.8887 [BEST: 0.8934]
04/05/2020 11:35:35 > epoch 20 updates 29360 loss: 0.1243 lr: 2.7112e-04 gnorm: 0.3432
04/05/2020 11:35:38 > epoch 20 updates 29380 loss: 0.1341 lr: 2.7112e-04 gnorm: 0.4189
04/05/2020 11:35:40 > epoch 20 updates 29400 loss: 0.1380 lr: 2.7112e-04 gnorm: 0.4208
04/05/2020 11:35:42 train loss: 0.1322 lr: 2.7112e-04 gnorm: 0.3946 clip: 0
04/05/2020 11:35:42 valid loss: 0.3166 auc: 0.9549 f1: 0.8929 acc: 0.8904 [BEST: 0.8934]
04/05/2020 11:35:45 > epoch 20 updates 29420 loss: 0.1181 lr: 2.7112e-04 gnorm: 0.3084
04/05/2020 11:35:48 > epoch 20 updates 29440 loss: 0.1259 lr: 2.7112e-04 gnorm: 0.4711
04/05/2020 11:35:51 train loss: 0.1220 lr: 2.7112e-04 gnorm: 0.3902 clip: 0
04/05/2020 11:35:51 valid loss: 0.3101 auc: 0.9557 f1: 0.8944 acc: 0.8923 [BEST: 0.8934]
04/05/2020 11:35:53 > epoch 20 updates 29460 loss: 0.0978 lr: 2.7112e-04 gnorm: 0.3935
04/05/2020 11:35:56 > epoch 20 updates 29480 loss: 0.0842 lr: 2.7112e-04 gnorm: 0.3367
04/05/2020 11:35:59 > epoch 20 updates 29500 loss: 0.1399 lr: 2.7112e-04 gnorm: 0.5133
04/05/2020 11:36:01 train loss: 0.1075 lr: 2.7112e-04 gnorm: 0.4149 clip: 0
04/05/2020 11:36:01 valid loss: 0.3174 auc: 0.9547 f1: 0.8910 acc: 0.8891 [BEST: 0.8934]
04/05/2020 11:36:04 > epoch 20 updates 29520 loss: 0.1471 lr: 2.7112e-04 gnorm: 0.4345
04/05/2020 11:36:07 > epoch 20 updates 29540 loss: 0.1303 lr: 2.7112e-04 gnorm: 0.4490
04/05/2020 11:36:10 train loss: 0.1386 lr: 2.7112e-04 gnorm: 0.4418 clip: 0
04/05/2020 11:36:10 valid loss: 0.3157 auc: 0.9547 f1: 0.8892 acc: 0.8881 [BEST: 0.8934]
04/05/2020 11:36:11 > epoch 20 updates 29560 loss: 0.1040 lr: 2.7112e-04 gnorm: 0.3651
04/05/2020 11:36:14 > epoch 20 updates 29580 loss: 0.0834 lr: 2.7112e-04 gnorm: 0.3086
04/05/2020 11:36:17 > epoch 20 updates 29600 loss: 0.1364 lr: 2.7112e-04 gnorm: 0.3962
04/05/2020 11:36:19 train loss: 0.1080 lr: 2.7112e-04 gnorm: 0.3567 clip: 0
04/05/2020 11:36:19 valid loss: 0.3173 auc: 0.9556 f1: 0.8945 acc: 0.8921 [BEST: 0.8934]
04/05/2020 11:36:22 > epoch 20 updates 29620 loss: 0.1394 lr: 2.7112e-04 gnorm: 0.4210
04/05/2020 11:36:25 > epoch 20 updates 29640 loss: 0.1405 lr: 2.7112e-04 gnorm: 0.3452
04/05/2020 11:36:28 train loss: 0.1400 lr: 2.7112e-04 gnorm: 0.3829 clip: 0
04/05/2020 11:36:28 valid loss: 0.3237 auc: 0.9531 f1: 0.8914 acc: 0.8885 [BEST: 0.8934]
04/05/2020 11:36:30 > epoch 20 updates 29660 loss: 0.1128 lr: 2.7112e-04 gnorm: 0.3747
04/05/2020 11:36:33 > epoch 20 updates 29680 loss: 0.0726 lr: 2.7112e-04 gnorm: 0.2638
04/05/2020 11:36:36 > epoch 20 updates 29700 loss: 0.0976 lr: 2.7112e-04 gnorm: 0.3119
04/05/2020 11:36:38 train loss: 0.0943 lr: 2.7112e-04 gnorm: 0.3166 clip: 0
04/05/2020 11:36:38 valid loss: 0.3051 auc: 0.9552 f1: 0.8946 acc: 0.8923 [BEST: 0.8934]
04/05/2020 11:36:40 > epoch 20 updates 29720 loss: 0.1339 lr: 2.7112e-04 gnorm: 0.3600
04/05/2020 11:36:43 > epoch 20 updates 29740 loss: 0.1109 lr: 2.7112e-04 gnorm: 0.4951
04/05/2020 11:36:47 train loss: 0.1223 lr: 2.7112e-04 gnorm: 0.4279 clip: 0
04/05/2020 11:36:47 valid loss: 0.3122 auc: 0.9555 f1: 0.8937 acc: 0.8922 [BEST: 0.8934]
04/05/2020 11:36:48 > epoch 20 updates 29760 loss: 0.1397 lr: 2.7112e-04 gnorm: 0.4049
04/05/2020 11:36:51 > epoch 20 updates 29780 loss: 0.1417 lr: 2.7112e-04 gnorm: 0.4249
04/05/2020 11:36:54 > epoch 20 updates 29800 loss: 0.1334 lr: 2.7112e-04 gnorm: 0.3977
04/05/2020 11:36:56 train loss: 0.1382 lr: 2.7112e-04 gnorm: 0.4092 clip: 0
04/05/2020 11:36:56 valid loss: 0.3102 auc: 0.9554 f1: 0.8936 acc: 0.8921 [BEST: 0.8934]
04/05/2020 11:36:59 > epoch 20 updates 29820 loss: 0.1240 lr: 2.7112e-04 gnorm: 0.3672
04/05/2020 11:37:01 > epoch 20 updates 29840 loss: 0.0911 lr: 2.7112e-04 gnorm: 0.2876
04/05/2020 11:37:05 train loss: 0.1075 lr: 2.7112e-04 gnorm: 0.3272 clip: 0
04/05/2020 11:37:05 valid loss: 0.3067 auc: 0.9564 f1: 0.8946 acc: 0.8933 [BEST: 0.8934]
04/05/2020 11:37:06 > epoch 20 updates 29860 loss: 0.1377 lr: 2.7112e-04 gnorm: 0.3743
04/05/2020 11:37:09 > epoch 20 updates 29880 loss: 0.1449 lr: 2.7112e-04 gnorm: 0.3550
04/05/2020 11:37:12 > epoch 20 updates 29900 loss: 0.1333 lr: 2.7112e-04 gnorm: 0.4037
04/05/2020 11:37:14 train loss: 0.1386 lr: 2.7112e-04 gnorm: 0.3778 clip: 0
04/05/2020 11:37:14 valid loss: 0.3187 auc: 0.9539 f1: 0.8932 acc: 0.8907 [BEST: 0.8934]
04/05/2020 11:37:17 > epoch 20 updates 29920 loss: 0.1095 lr: 2.7112e-04 gnorm: 0.5050
04/05/2020 11:37:20 > epoch 20 updates 29940 loss: 0.0941 lr: 2.7112e-04 gnorm: 0.2996
04/05/2020 11:37:24 train loss: 0.1017 lr: 2.7112e-04 gnorm: 0.4017 clip: 0
04/05/2020 11:37:24 valid loss: 0.3160 auc: 0.9553 f1: 0.8935 acc: 0.8919 [BEST: 0.8934]
04/05/2020 11:37:25 > epoch 20 updates 29960 loss: 0.1343 lr: 2.7112e-04 gnorm: 0.3826
04/05/2020 11:37:28 > epoch 20 updates 29980 loss: 0.1465 lr: 2.7112e-04 gnorm: 0.4049
04/05/2020 11:37:31 > epoch 20 updates 30000 loss: 0.0751 lr: 2.7112e-04 gnorm: 0.3198
04/05/2020 11:37:33 train loss: 0.1184 lr: 2.7112e-04 gnorm: 0.3689 clip: 0
04/05/2020 11:37:33 valid loss: 0.3203 auc: 0.9542 f1: 0.8935 acc: 0.8910 [BEST: 0.8934]
04/05/2020 11:37:36 > epoch 20 updates 30020 loss: 0.1183 lr: 2.5757e-04 gnorm: 0.5212
04/05/2020 11:37:39 > epoch 20 updates 30040 loss: 0.0963 lr: 2.5757e-04 gnorm: 0.8671
04/05/2020 11:37:41 train loss: 0.1072 lr: 2.5757e-04 gnorm: 0.6950 clip: 0
04/05/2020 11:37:41 valid loss: 0.3197 auc: 0.9541 f1: 0.8935 acc: 0.8913 [BEST: 0.8934]
04/05/2020 11:37:41 Epoch: 21
04/05/2020 11:37:48 valid loss: 0.3173 auc: 0.9552 f1: 0.8952 acc: 0.8929 [BEST: 0.8934]
04/05/2020 11:37:49 > epoch 21 updates 30060 loss: 0.1068 lr: 2.5757e-04 gnorm: 0.3436
04/05/2020 11:37:52 > epoch 21 updates 30080 loss: 0.1120 lr: 2.5757e-04 gnorm: 0.3455
04/05/2020 11:37:55 > epoch 21 updates 30100 loss: 0.0885 lr: 2.5757e-04 gnorm: 0.3331
04/05/2020 11:37:57 train loss: 0.1023 lr: 2.5757e-04 gnorm: 0.3407 clip: 0
04/05/2020 11:37:57 valid loss: 0.3256 auc: 0.9561 f1: 0.8954 acc: 0.8940 [NEW BEST]
04/05/2020 11:38:00 > epoch 21 updates 30120 loss: 0.1013 lr: 2.5757e-04 gnorm: 0.3051
04/05/2020 11:38:03 > epoch 21 updates 30140 loss: 0.0886 lr: 2.5757e-04 gnorm: 0.3729
04/05/2020 11:38:06 train loss: 0.0949 lr: 2.5757e-04 gnorm: 0.3392 clip: 0
04/05/2020 11:38:06 valid loss: 0.3351 auc: 0.9533 f1: 0.8921 acc: 0.8902 [BEST: 0.8940]
04/05/2020 11:38:08 > epoch 21 updates 30160 loss: 0.1314 lr: 2.5757e-04 gnorm: 0.4494
04/05/2020 11:38:11 > epoch 21 updates 30180 loss: 0.0751 lr: 2.5757e-04 gnorm: 0.2608
04/05/2020 11:38:14 > epoch 21 updates 30200 loss: 0.1243 lr: 2.5757e-04 gnorm: 0.3971
04/05/2020 11:38:16 train loss: 0.1102 lr: 2.5757e-04 gnorm: 0.3689 clip: 0
04/05/2020 11:38:16 valid loss: 0.3227 auc: 0.9551 f1: 0.8926 acc: 0.8912 [BEST: 0.8940]
04/05/2020 11:38:19 > epoch 21 updates 30220 loss: 0.0848 lr: 2.5757e-04 gnorm: 0.2968
04/05/2020 11:38:21 > epoch 21 updates 30240 loss: 0.1347 lr: 2.5757e-04 gnorm: 0.4115
04/05/2020 11:38:25 train loss: 0.1099 lr: 2.5757e-04 gnorm: 0.3545 clip: 0
04/05/2020 11:38:25 valid loss: 0.3308 auc: 0.9544 f1: 0.8932 acc: 0.8914 [BEST: 0.8940]
04/05/2020 11:38:26 > epoch 21 updates 30260 loss: 0.0715 lr: 2.5757e-04 gnorm: 0.2854
04/05/2020 11:38:29 > epoch 21 updates 30280 loss: 0.1286 lr: 2.5757e-04 gnorm: 0.3559
04/05/2020 11:38:32 > epoch 21 updates 30300 loss: 0.1402 lr: 2.5757e-04 gnorm: 0.4389
04/05/2020 11:38:34 train loss: 0.1137 lr: 2.5757e-04 gnorm: 0.3605 clip: 0
04/05/2020 11:38:34 valid loss: 0.3173 auc: 0.9547 f1: 0.8930 acc: 0.8919 [BEST: 0.8940]
04/05/2020 11:38:37 > epoch 21 updates 30320 loss: 0.0935 lr: 2.5757e-04 gnorm: 0.4644
04/05/2020 11:38:40 > epoch 21 updates 30340 loss: 0.1103 lr: 2.5757e-04 gnorm: 0.3135
04/05/2020 11:38:44 train loss: 0.1020 lr: 2.5757e-04 gnorm: 0.3886 clip: 0
04/05/2020 11:38:44 valid loss: 0.3292 auc: 0.9533 f1: 0.8931 acc: 0.8906 [BEST: 0.8940]
04/05/2020 11:38:45 > epoch 21 updates 30360 loss: 0.0960 lr: 2.5757e-04 gnorm: 0.3061
04/05/2020 11:38:48 > epoch 21 updates 30380 loss: 0.1491 lr: 2.5757e-04 gnorm: 0.3963
04/05/2020 11:38:51 > epoch 21 updates 30400 loss: 0.0641 lr: 2.5757e-04 gnorm: 0.2564
04/05/2020 11:38:53 train loss: 0.1030 lr: 2.5757e-04 gnorm: 0.3195 clip: 0
04/05/2020 11:38:53 valid loss: 0.3261 auc: 0.9540 f1: 0.8921 acc: 0.8905 [BEST: 0.8940]
04/05/2020 11:38:56 > epoch 21 updates 30420 loss: 0.1059 lr: 2.5757e-04 gnorm: 0.3923
04/05/2020 11:38:59 > epoch 21 updates 30440 loss: 0.0956 lr: 2.5757e-04 gnorm: 0.3746
04/05/2020 11:39:02 train loss: 0.1007 lr: 2.5757e-04 gnorm: 0.3834 clip: 0
04/05/2020 11:39:02 valid loss: 0.3283 auc: 0.9542 f1: 0.8901 acc: 0.8894 [BEST: 0.8940]
04/05/2020 11:39:04 > epoch 21 updates 30460 loss: 0.1123 lr: 2.5757e-04 gnorm: 0.4203
04/05/2020 11:39:06 > epoch 21 updates 30480 loss: 0.1318 lr: 2.5757e-04 gnorm: 0.3970
04/05/2020 11:39:09 > epoch 21 updates 30500 loss: 0.1265 lr: 2.5757e-04 gnorm: 0.3734
04/05/2020 11:39:11 train loss: 0.1236 lr: 2.5757e-04 gnorm: 0.3968 clip: 0
04/05/2020 11:39:11 valid loss: 0.3254 auc: 0.9541 f1: 0.8921 acc: 0.8907 [BEST: 0.8940]
04/05/2020 11:39:14 > epoch 21 updates 30520 loss: 0.1098 lr: 2.5757e-04 gnorm: 0.3623
04/05/2020 11:39:17 > epoch 21 updates 30540 loss: 0.0926 lr: 2.5757e-04 gnorm: 0.3458
04/05/2020 11:39:20 train loss: 0.1012 lr: 2.5757e-04 gnorm: 0.3540 clip: 0
04/05/2020 11:39:20 valid loss: 0.3211 auc: 0.9549 f1: 0.8912 acc: 0.8892 [BEST: 0.8940]
04/05/2020 11:39:22 > epoch 21 updates 30560 loss: 0.0937 lr: 2.5757e-04 gnorm: 0.3129
04/05/2020 11:39:25 > epoch 21 updates 30580 loss: 0.1386 lr: 2.5757e-04 gnorm: 0.3579
04/05/2020 11:39:28 > epoch 21 updates 30600 loss: 0.1381 lr: 2.5757e-04 gnorm: 0.4174
04/05/2020 11:39:30 train loss: 0.1236 lr: 2.5757e-04 gnorm: 0.3631 clip: 0
04/05/2020 11:39:30 valid loss: 0.3262 auc: 0.9547 f1: 0.8932 acc: 0.8912 [BEST: 0.8940]
04/05/2020 11:39:33 > epoch 21 updates 30620 loss: 0.1230 lr: 2.5757e-04 gnorm: 0.3896
04/05/2020 11:39:36 > epoch 21 updates 30640 loss: 0.0868 lr: 2.5757e-04 gnorm: 0.3555
04/05/2020 11:39:39 train loss: 0.1048 lr: 2.5757e-04 gnorm: 0.3725 clip: 0
04/05/2020 11:39:39 valid loss: 0.3169 auc: 0.9544 f1: 0.8912 acc: 0.8896 [BEST: 0.8940]
04/05/2020 11:39:40 > epoch 21 updates 30660 loss: 0.1034 lr: 2.5757e-04 gnorm: 0.4240
04/05/2020 11:39:43 > epoch 21 updates 30680 loss: 0.0934 lr: 2.5757e-04 gnorm: 0.3017
04/05/2020 11:39:46 > epoch 21 updates 30700 loss: 0.1185 lr: 2.5757e-04 gnorm: 0.4085
04/05/2020 11:39:48 train loss: 0.1051 lr: 2.5757e-04 gnorm: 0.3780 clip: 0
04/05/2020 11:39:48 valid loss: 0.3215 auc: 0.9553 f1: 0.8925 acc: 0.8915 [BEST: 0.8940]
04/05/2020 11:39:51 > epoch 21 updates 30720 loss: 0.0965 lr: 2.5757e-04 gnorm: 0.3094
04/05/2020 11:39:54 > epoch 21 updates 30740 loss: 0.1640 lr: 2.5757e-04 gnorm: 0.4847
04/05/2020 11:39:57 train loss: 0.1304 lr: 2.5757e-04 gnorm: 0.3975 clip: 0
04/05/2020 11:39:57 valid loss: 0.3183 auc: 0.9551 f1: 0.8941 acc: 0.8918 [BEST: 0.8940]
04/05/2020 11:39:59 > epoch 21 updates 30760 loss: 0.0955 lr: 2.5757e-04 gnorm: 0.3274
04/05/2020 11:40:02 > epoch 21 updates 30780 loss: 0.1189 lr: 2.5757e-04 gnorm: 0.3183
04/05/2020 11:40:05 > epoch 21 updates 30800 loss: 0.1028 lr: 2.5757e-04 gnorm: 0.4237
04/05/2020 11:40:07 train loss: 0.1058 lr: 2.5757e-04 gnorm: 0.3568 clip: 0
04/05/2020 11:40:07 valid loss: 0.3206 auc: 0.9560 f1: 0.8941 acc: 0.8915 [BEST: 0.8940]
04/05/2020 11:40:10 > epoch 21 updates 30820 loss: 0.0731 lr: 2.5757e-04 gnorm: 0.3433
04/05/2020 11:40:13 > epoch 21 updates 30840 loss: 0.1226 lr: 2.5757e-04 gnorm: 0.3948
04/05/2020 11:40:16 train loss: 0.0979 lr: 2.5757e-04 gnorm: 0.3692 clip: 0
04/05/2020 11:40:16 valid loss: 0.3281 auc: 0.9546 f1: 0.8941 acc: 0.8913 [BEST: 0.8940]
04/05/2020 11:40:18 > epoch 21 updates 30860 loss: 0.1147 lr: 2.5757e-04 gnorm: 0.4158
04/05/2020 11:40:20 > epoch 21 updates 30880 loss: 0.1222 lr: 2.5757e-04 gnorm: 0.4001
04/05/2020 11:40:23 > epoch 21 updates 30900 loss: 0.1166 lr: 2.5757e-04 gnorm: 0.3575
04/05/2020 11:40:25 train loss: 0.1178 lr: 2.5757e-04 gnorm: 0.3909 clip: 0
04/05/2020 11:40:25 valid loss: 0.3246 auc: 0.9543 f1: 0.8914 acc: 0.8906 [BEST: 0.8940]
04/05/2020 11:40:28 > epoch 21 updates 30920 loss: 0.1317 lr: 2.5757e-04 gnorm: 0.4210
04/05/2020 11:40:31 > epoch 21 updates 30940 loss: 0.0935 lr: 2.5757e-04 gnorm: 0.3272
04/05/2020 11:40:35 train loss: 0.1125 lr: 2.5757e-04 gnorm: 0.3738 clip: 0
04/05/2020 11:40:35 valid loss: 0.3231 auc: 0.9535 f1: 0.8900 acc: 0.8888 [BEST: 0.8940]
04/05/2020 11:40:36 > epoch 21 updates 30960 loss: 0.0620 lr: 2.5757e-04 gnorm: 0.2349
04/05/2020 11:40:39 > epoch 21 updates 30980 loss: 0.1112 lr: 2.5757e-04 gnorm: 0.3542
04/05/2020 11:40:42 > epoch 21 updates 31000 loss: 0.1212 lr: 2.5757e-04 gnorm: 0.3131
04/05/2020 11:40:44 train loss: 0.0983 lr: 2.5757e-04 gnorm: 0.3010 clip: 0
04/05/2020 11:40:44 valid loss: 0.3180 auc: 0.9549 f1: 0.8938 acc: 0.8917 [BEST: 0.8940]
04/05/2020 11:40:47 > epoch 21 updates 31020 loss: 0.0989 lr: 2.4469e-04 gnorm: 0.3636
04/05/2020 11:40:50 > epoch 21 updates 31040 loss: 0.1858 lr: 2.4469e-04 gnorm: 0.4735
04/05/2020 11:40:53 train loss: 0.1426 lr: 2.4469e-04 gnorm: 0.4188 clip: 0
04/05/2020 11:40:53 valid loss: 0.3196 auc: 0.9553 f1: 0.8932 acc: 0.8920 [BEST: 0.8940]
04/05/2020 11:40:55 > epoch 21 updates 31060 loss: 0.1141 lr: 2.4469e-04 gnorm: 0.3890
04/05/2020 11:40:58 > epoch 21 updates 31080 loss: 0.1115 lr: 2.4469e-04 gnorm: 0.3507
04/05/2020 11:41:01 > epoch 21 updates 31100 loss: 0.0941 lr: 2.4469e-04 gnorm: 0.2970
04/05/2020 11:41:03 train loss: 0.1065 lr: 2.4469e-04 gnorm: 0.3453 clip: 0
04/05/2020 11:41:03 valid loss: 0.3239 auc: 0.9544 f1: 0.8925 acc: 0.8910 [BEST: 0.8940]
04/05/2020 11:41:06 > epoch 21 updates 31120 loss: 0.1284 lr: 2.4469e-04 gnorm: 0.3784
04/05/2020 11:41:09 > epoch 21 updates 31140 loss: 0.0806 lr: 2.4469e-04 gnorm: 0.3644
04/05/2020 11:41:12 train loss: 0.1044 lr: 2.4469e-04 gnorm: 0.3714 clip: 0
04/05/2020 11:41:12 valid loss: 0.3226 auc: 0.9544 f1: 0.8938 acc: 0.8925 [BEST: 0.8940]
04/05/2020 11:41:13 > epoch 21 updates 31160 loss: 0.1488 lr: 2.4469e-04 gnorm: 0.3958
04/05/2020 11:41:16 > epoch 21 updates 31180 loss: 0.1038 lr: 2.4469e-04 gnorm: 0.3924
04/05/2020 11:41:19 > epoch 21 updates 31200 loss: 0.1451 lr: 2.4469e-04 gnorm: 0.4172
04/05/2020 11:41:21 train loss: 0.1326 lr: 2.4469e-04 gnorm: 0.4019 clip: 0
04/05/2020 11:41:21 valid loss: 0.3318 auc: 0.9527 f1: 0.8919 acc: 0.8899 [BEST: 0.8940]
04/05/2020 11:41:24 > epoch 21 updates 31220 loss: 0.1536 lr: 2.4469e-04 gnorm: 0.4639
04/05/2020 11:41:27 > epoch 21 updates 31240 loss: 0.0659 lr: 2.4469e-04 gnorm: 0.2806
04/05/2020 11:41:30 train loss: 0.1095 lr: 2.4469e-04 gnorm: 0.3718 clip: 0
04/05/2020 11:41:30 valid loss: 0.3227 auc: 0.9539 f1: 0.8937 acc: 0.8915 [BEST: 0.8940]
04/05/2020 11:41:32 > epoch 21 updates 31260 loss: 0.0966 lr: 2.4469e-04 gnorm: 0.4147
04/05/2020 11:41:35 > epoch 21 updates 31280 loss: 0.1708 lr: 2.4469e-04 gnorm: 0.4599
04/05/2020 11:41:38 > epoch 21 updates 31300 loss: 0.1570 lr: 2.4469e-04 gnorm: 0.4213
04/05/2020 11:41:40 train loss: 0.1417 lr: 2.4469e-04 gnorm: 0.4320 clip: 0
04/05/2020 11:41:40 valid loss: 0.3195 auc: 0.9539 f1: 0.8949 acc: 0.8928 [BEST: 0.8940]
04/05/2020 11:41:43 > epoch 21 updates 31320 loss: 0.0812 lr: 2.4469e-04 gnorm: 0.3311
04/05/2020 11:41:46 > epoch 21 updates 31340 loss: 0.1111 lr: 2.4469e-04 gnorm: 0.4111
04/05/2020 11:41:49 train loss: 0.0962 lr: 2.4469e-04 gnorm: 0.3713 clip: 0
04/05/2020 11:41:49 valid loss: 0.3212 auc: 0.9556 f1: 0.8942 acc: 0.8933 [BEST: 0.8940]
04/05/2020 11:41:50 > epoch 21 updates 31360 loss: 0.0926 lr: 2.4469e-04 gnorm: 0.3524
04/05/2020 11:41:53 > epoch 21 updates 31380 loss: 0.1047 lr: 2.4469e-04 gnorm: 0.3646
04/05/2020 11:41:56 > epoch 21 updates 31400 loss: 0.1494 lr: 2.4469e-04 gnorm: 0.4614
04/05/2020 11:41:58 train loss: 0.1158 lr: 2.4469e-04 gnorm: 0.3932 clip: 0
04/05/2020 11:41:58 valid loss: 0.3222 auc: 0.9553 f1: 0.8954 acc: 0.8940 [BEST: 0.8940]
04/05/2020 11:42:01 > epoch 21 updates 31420 loss: 0.1424 lr: 2.4469e-04 gnorm: 0.4171
04/05/2020 11:42:04 > epoch 21 updates 31440 loss: 0.0988 lr: 2.4469e-04 gnorm: 0.3455
04/05/2020 11:42:08 train loss: 0.1205 lr: 2.4469e-04 gnorm: 0.3811 clip: 0
04/05/2020 11:42:08 valid loss: 0.3209 auc: 0.9543 f1: 0.8944 acc: 0.8928 [BEST: 0.8940]
04/05/2020 11:42:09 > epoch 21 updates 31460 loss: 0.1023 lr: 2.4469e-04 gnorm: 0.4525
04/05/2020 11:42:12 > epoch 21 updates 31480 loss: 0.1363 lr: 2.4469e-04 gnorm: 0.4149
04/05/2020 11:42:15 > epoch 21 updates 31500 loss: 0.1537 lr: 2.4469e-04 gnorm: 0.5076
04/05/2020 11:42:17 train loss: 0.1309 lr: 2.4469e-04 gnorm: 0.4585 clip: 0
04/05/2020 11:42:17 valid loss: 0.3224 auc: 0.9542 f1: 0.8943 acc: 0.8915 [BEST: 0.8940]
04/05/2020 11:42:20 > epoch 21 updates 31520 loss: 0.1123 lr: 2.4469e-04 gnorm: 0.4431
04/05/2020 11:42:23 > epoch 21 updates 31540 loss: 0.0747 lr: 2.4469e-04 gnorm: 0.2667
04/05/2020 11:42:26 train loss: 0.0934 lr: 2.4469e-04 gnorm: 0.3544 clip: 0
04/05/2020 11:42:26 valid loss: 0.3261 auc: 0.9547 f1: 0.8945 acc: 0.8926 [BEST: 0.8940]
04/05/2020 11:42:26 Epoch: 22
04/05/2020 11:42:32 valid loss: 0.3245 auc: 0.9557 f1: 0.8939 acc: 0.8931 [BEST: 0.8940]
04/05/2020 11:42:34 > epoch 22 updates 31560 loss: 0.0844 lr: 2.4469e-04 gnorm: 0.3288
04/05/2020 11:42:37 > epoch 22 updates 31580 loss: 0.0803 lr: 2.4469e-04 gnorm: 0.3606
04/05/2020 11:42:39 > epoch 22 updates 31600 loss: 0.0490 lr: 2.4469e-04 gnorm: 0.2725
04/05/2020 11:42:41 train loss: 0.0711 lr: 2.4469e-04 gnorm: 0.3205 clip: 0
04/05/2020 11:42:41 valid loss: 0.3330 auc: 0.9547 f1: 0.8949 acc: 0.8928 [BEST: 0.8940]
04/05/2020 11:42:44 > epoch 22 updates 31620 loss: 0.1037 lr: 2.4469e-04 gnorm: 0.3665
04/05/2020 11:42:47 > epoch 22 updates 31640 loss: 0.0658 lr: 2.4469e-04 gnorm: 0.2657
04/05/2020 11:42:51 train loss: 0.0846 lr: 2.4469e-04 gnorm: 0.3158 clip: 0
04/05/2020 11:42:51 valid loss: 0.3385 auc: 0.9529 f1: 0.8917 acc: 0.8900 [BEST: 0.8940]
04/05/2020 11:42:52 > epoch 22 updates 31660 loss: 0.0982 lr: 2.4469e-04 gnorm: 0.3668
04/05/2020 11:42:55 > epoch 22 updates 31680 loss: 0.0893 lr: 2.4469e-04 gnorm: 0.3320
04/05/2020 11:42:58 > epoch 22 updates 31700 loss: 0.0529 lr: 2.4469e-04 gnorm: 0.2290
04/05/2020 11:43:00 train loss: 0.0800 lr: 2.4469e-04 gnorm: 0.3088 clip: 0
04/05/2020 11:43:00 valid loss: 0.3400 auc: 0.9542 f1: 0.8927 acc: 0.8913 [BEST: 0.8940]
04/05/2020 11:43:03 > epoch 22 updates 31720 loss: 0.1014 lr: 2.4469e-04 gnorm: 0.3306
04/05/2020 11:43:06 > epoch 22 updates 31740 loss: 0.1168 lr: 2.4469e-04 gnorm: 0.3766
04/05/2020 11:43:09 train loss: 0.1092 lr: 2.4469e-04 gnorm: 0.3537 clip: 0
04/05/2020 11:43:09 valid loss: 0.3264 auc: 0.9550 f1: 0.8936 acc: 0.8923 [BEST: 0.8940]
04/05/2020 11:43:11 > epoch 22 updates 31760 loss: 0.1552 lr: 2.4469e-04 gnorm: 0.4033
04/05/2020 11:43:14 > epoch 22 updates 31780 loss: 0.1019 lr: 2.4469e-04 gnorm: 0.3190
04/05/2020 11:43:17 > epoch 22 updates 31800 loss: 0.0752 lr: 2.4469e-04 gnorm: 0.2843
04/05/2020 11:43:19 train loss: 0.1105 lr: 2.4469e-04 gnorm: 0.3352 clip: 0
04/05/2020 11:43:19 valid loss: 0.3285 auc: 0.9547 f1: 0.8926 acc: 0.8903 [BEST: 0.8940]
04/05/2020 11:43:22 > epoch 22 updates 31820 loss: 0.1347 lr: 2.4469e-04 gnorm: 0.3274
04/05/2020 11:43:25 > epoch 22 updates 31840 loss: 0.1729 lr: 2.4469e-04 gnorm: 0.5157
04/05/2020 11:43:28 train loss: 0.1539 lr: 2.4469e-04 gnorm: 0.4220 clip: 0
04/05/2020 11:43:28 valid loss: 0.3282 auc: 0.9549 f1: 0.8941 acc: 0.8922 [BEST: 0.8940]
04/05/2020 11:43:30 > epoch 22 updates 31860 loss: 0.0857 lr: 2.4469e-04 gnorm: 0.3346
04/05/2020 11:43:33 > epoch 22 updates 31880 loss: 0.1069 lr: 2.4469e-04 gnorm: 0.4365
04/05/2020 11:43:36 > epoch 22 updates 31900 loss: 0.0725 lr: 2.4469e-04 gnorm: 0.3173
04/05/2020 11:43:38 train loss: 0.0883 lr: 2.4469e-04 gnorm: 0.3627 clip: 0
04/05/2020 11:43:38 valid loss: 0.3237 auc: 0.9552 f1: 0.8949 acc: 0.8929 [BEST: 0.8940]
04/05/2020 11:43:40 > epoch 22 updates 31920 loss: 0.0954 lr: 2.4469e-04 gnorm: 0.3565
04/05/2020 11:43:43 > epoch 22 updates 31940 loss: 0.0792 lr: 2.4469e-04 gnorm: 0.3276
04/05/2020 11:43:47 train loss: 0.0873 lr: 2.4469e-04 gnorm: 0.3420 clip: 0
04/05/2020 11:43:47 valid loss: 0.3405 auc: 0.9534 f1: 0.8926 acc: 0.8899 [BEST: 0.8940]
04/05/2020 11:43:48 > epoch 22 updates 31960 loss: 0.0714 lr: 2.4469e-04 gnorm: 0.3029
04/05/2020 11:43:51 > epoch 22 updates 31980 loss: 0.0730 lr: 2.4469e-04 gnorm: 0.3310
04/05/2020 11:43:54 > epoch 22 updates 32000 loss: 0.1054 lr: 2.4469e-04 gnorm: 0.3890
04/05/2020 11:43:56 train loss: 0.0834 lr: 2.4469e-04 gnorm: 0.3413 clip: 0
04/05/2020 11:43:56 valid loss: 0.3271 auc: 0.9549 f1: 0.8921 acc: 0.8907 [BEST: 0.8940]
04/05/2020 11:43:59 > epoch 22 updates 32020 loss: 0.0651 lr: 2.3245e-04 gnorm: 0.2877
04/05/2020 11:44:02 > epoch 22 updates 32040 loss: 0.0890 lr: 2.3245e-04 gnorm: 0.3140
04/05/2020 11:44:05 train loss: 0.0771 lr: 2.3245e-04 gnorm: 0.3009 clip: 0
04/05/2020 11:44:05 valid loss: 0.3280 auc: 0.9539 f1: 0.8924 acc: 0.8900 [BEST: 0.8940]
04/05/2020 11:44:07 > epoch 22 updates 32060 loss: 0.0960 lr: 2.3245e-04 gnorm: 0.4243
04/05/2020 11:44:10 > epoch 22 updates 32080 loss: 0.0813 lr: 2.3245e-04 gnorm: 0.3442
04/05/2020 11:44:13 > epoch 22 updates 32100 loss: 0.1138 lr: 2.3245e-04 gnorm: 0.3233
04/05/2020 11:44:15 train loss: 0.0971 lr: 2.3245e-04 gnorm: 0.3636 clip: 0
04/05/2020 11:44:15 valid loss: 0.3284 auc: 0.9552 f1: 0.8912 acc: 0.8903 [BEST: 0.8940]
04/05/2020 11:44:18 > epoch 22 updates 32120 loss: 0.0873 lr: 2.3245e-04 gnorm: 0.3670
04/05/2020 11:44:21 > epoch 22 updates 32140 loss: 0.0914 lr: 2.3245e-04 gnorm: 0.3418
04/05/2020 11:44:24 train loss: 0.0893 lr: 2.3245e-04 gnorm: 0.3543 clip: 0
04/05/2020 11:44:24 valid loss: 0.3302 auc: 0.9533 f1: 0.8930 acc: 0.8907 [BEST: 0.8940]
04/05/2020 11:44:25 > epoch 22 updates 32160 loss: 0.0617 lr: 2.3245e-04 gnorm: 0.2566
04/05/2020 11:44:28 > epoch 22 updates 32180 loss: 0.0900 lr: 2.3245e-04 gnorm: 0.3266
04/05/2020 11:44:31 > epoch 22 updates 32200 loss: 0.0814 lr: 2.3245e-04 gnorm: 0.3288
04/05/2020 11:44:33 train loss: 0.0777 lr: 2.3245e-04 gnorm: 0.3042 clip: 0
04/05/2020 11:44:33 valid loss: 0.3270 auc: 0.9532 f1: 0.8941 acc: 0.8920 [BEST: 0.8940]
04/05/2020 11:44:37 > epoch 22 updates 32220 loss: 0.1237 lr: 2.3245e-04 gnorm: 0.5047
04/05/2020 11:44:40 > epoch 22 updates 32240 loss: 0.0486 lr: 2.3245e-04 gnorm: 0.2817
04/05/2020 11:44:43 train loss: 0.0860 lr: 2.3245e-04 gnorm: 0.3927 clip: 0
04/05/2020 11:44:43 valid loss: 0.3229 auc: 0.9545 f1: 0.8926 acc: 0.8916 [BEST: 0.8940]
04/05/2020 11:44:44 > epoch 22 updates 32260 loss: 0.1398 lr: 2.3245e-04 gnorm: 0.4173
04/05/2020 11:44:47 > epoch 22 updates 32280 loss: 0.1068 lr: 2.3245e-04 gnorm: 0.4536
04/05/2020 11:44:50 > epoch 22 updates 32300 loss: 0.0971 lr: 2.3245e-04 gnorm: 0.3380
04/05/2020 11:44:52 train loss: 0.1144 lr: 2.3245e-04 gnorm: 0.4027 clip: 0
04/05/2020 11:44:52 valid loss: 0.3261 auc: 0.9534 f1: 0.8909 acc: 0.8893 [BEST: 0.8940]
04/05/2020 11:44:55 > epoch 22 updates 32320 loss: 0.1013 lr: 2.3245e-04 gnorm: 0.3792
04/05/2020 11:44:58 > epoch 22 updates 32340 loss: 0.1015 lr: 2.3245e-04 gnorm: 0.3474
04/05/2020 11:45:02 train loss: 0.1014 lr: 2.3245e-04 gnorm: 0.3633 clip: 0
04/05/2020 11:45:02 valid loss: 0.3330 auc: 0.9548 f1: 0.8923 acc: 0.8910 [BEST: 0.8940]
04/05/2020 11:45:03 > epoch 22 updates 32360 loss: 0.0853 lr: 2.3245e-04 gnorm: 0.3055
04/05/2020 11:45:06 > epoch 22 updates 32380 loss: 0.1156 lr: 2.3245e-04 gnorm: 0.4631
04/05/2020 11:45:09 > epoch 22 updates 32400 loss: 0.0811 lr: 2.3245e-04 gnorm: 0.2886
04/05/2020 11:45:11 train loss: 0.0940 lr: 2.3245e-04 gnorm: 0.3524 clip: 0
04/05/2020 11:45:11 valid loss: 0.3230 auc: 0.9555 f1: 0.8935 acc: 0.8919 [BEST: 0.8940]
04/05/2020 11:45:14 > epoch 22 updates 32420 loss: 0.0994 lr: 2.3245e-04 gnorm: 0.3289
04/05/2020 11:45:17 > epoch 22 updates 32440 loss: 0.1193 lr: 2.3245e-04 gnorm: 0.4132
04/05/2020 11:45:20 train loss: 0.1094 lr: 2.3245e-04 gnorm: 0.3713 clip: 0
04/05/2020 11:45:20 valid loss: 0.3277 auc: 0.9560 f1: 0.8943 acc: 0.8928 [BEST: 0.8940]
04/05/2020 11:45:22 > epoch 22 updates 32460 loss: 0.1420 lr: 2.3245e-04 gnorm: 0.4746
04/05/2020 11:45:25 > epoch 22 updates 32480 loss: 0.1360 lr: 2.3245e-04 gnorm: 0.3911
04/05/2020 11:45:27 > epoch 22 updates 32500 loss: 0.1354 lr: 2.3245e-04 gnorm: 0.3802
04/05/2020 11:45:29 train loss: 0.1378 lr: 2.3245e-04 gnorm: 0.4150 clip: 0
04/05/2020 11:45:29 valid loss: 0.3260 auc: 0.9542 f1: 0.8910 acc: 0.8889 [BEST: 0.8940]
04/05/2020 11:45:32 > epoch 22 updates 32520 loss: 0.0916 lr: 2.3245e-04 gnorm: 0.3558
04/05/2020 11:45:35 > epoch 22 updates 32540 loss: 0.1018 lr: 2.3245e-04 gnorm: 0.3309
04/05/2020 11:45:38 train loss: 0.0967 lr: 2.3245e-04 gnorm: 0.3433 clip: 0
04/05/2020 11:45:38 valid loss: 0.3376 auc: 0.9546 f1: 0.8938 acc: 0.8912 [BEST: 0.8940]
04/05/2020 11:45:40 > epoch 22 updates 32560 loss: 0.0783 lr: 2.3245e-04 gnorm: 0.3622
04/05/2020 11:45:43 > epoch 22 updates 32580 loss: 0.1002 lr: 2.3245e-04 gnorm: 0.4299
04/05/2020 11:45:46 > epoch 22 updates 32600 loss: 0.1163 lr: 2.3245e-04 gnorm: 0.3736
04/05/2020 11:45:48 train loss: 0.0984 lr: 2.3245e-04 gnorm: 0.3886 clip: 0
04/05/2020 11:45:48 valid loss: 0.3266 auc: 0.9544 f1: 0.8949 acc: 0.8924 [BEST: 0.8940]
04/05/2020 11:45:50 > epoch 22 updates 32620 loss: 0.1200 lr: 2.3245e-04 gnorm: 0.4305
04/05/2020 11:45:53 > epoch 22 updates 32640 loss: 0.0944 lr: 2.3245e-04 gnorm: 0.3301
04/05/2020 11:45:57 train loss: 0.1072 lr: 2.3245e-04 gnorm: 0.3800 clip: 0
04/05/2020 11:45:57 valid loss: 0.3247 auc: 0.9549 f1: 0.8941 acc: 0.8924 [BEST: 0.8940]
04/05/2020 11:45:58 > epoch 22 updates 32660 loss: 0.0993 lr: 2.3245e-04 gnorm: 0.3477
04/05/2020 11:46:01 > epoch 22 updates 32680 loss: 0.1732 lr: 2.3245e-04 gnorm: 0.5251
04/05/2020 11:46:04 > epoch 22 updates 32700 loss: 0.1275 lr: 2.3245e-04 gnorm: 0.4237
04/05/2020 11:46:06 train loss: 0.1334 lr: 2.3245e-04 gnorm: 0.4324 clip: 0
04/05/2020 11:46:06 valid loss: 0.3239 auc: 0.9547 f1: 0.8949 acc: 0.8929 [BEST: 0.8940]
04/05/2020 11:46:09 > epoch 22 updates 32720 loss: 0.0965 lr: 2.3245e-04 gnorm: 0.3483
04/05/2020 11:46:12 > epoch 22 updates 32740 loss: 0.1634 lr: 2.3245e-04 gnorm: 0.4343
04/05/2020 11:46:15 train loss: 0.1301 lr: 2.3245e-04 gnorm: 0.3915 clip: 0
04/05/2020 11:46:15 valid loss: 0.3260 auc: 0.9546 f1: 0.8952 acc: 0.8936 [BEST: 0.8940]
04/05/2020 11:46:17 > epoch 22 updates 32760 loss: 0.1318 lr: 2.3245e-04 gnorm: 0.3725
04/05/2020 11:46:20 > epoch 22 updates 32780 loss: 0.1030 lr: 2.3245e-04 gnorm: 0.3320
04/05/2020 11:46:23 > epoch 22 updates 32800 loss: 0.1642 lr: 2.3245e-04 gnorm: 0.3988
04/05/2020 11:46:25 train loss: 0.1331 lr: 2.3245e-04 gnorm: 0.3679 clip: 0
04/05/2020 11:46:25 valid loss: 0.3214 auc: 0.9551 f1: 0.8929 acc: 0.8919 [BEST: 0.8940]
04/05/2020 11:46:28 > epoch 22 updates 32820 loss: 0.0934 lr: 2.3245e-04 gnorm: 0.3253
04/05/2020 11:46:31 > epoch 22 updates 32840 loss: 0.1025 lr: 2.3245e-04 gnorm: 0.3559
04/05/2020 11:46:34 train loss: 0.0980 lr: 2.3245e-04 gnorm: 0.3407 clip: 0
04/05/2020 11:46:34 valid loss: 0.3370 auc: 0.9544 f1: 0.8942 acc: 0.8916 [BEST: 0.8940]
04/05/2020 11:46:36 > epoch 22 updates 32860 loss: 0.0979 lr: 2.3245e-04 gnorm: 0.3542
04/05/2020 11:46:39 > epoch 22 updates 32880 loss: 0.0872 lr: 2.3245e-04 gnorm: 0.2856
04/05/2020 11:46:41 > epoch 22 updates 32900 loss: 0.1204 lr: 2.3245e-04 gnorm: 0.3571
04/05/2020 11:46:43 train loss: 0.1019 lr: 2.3245e-04 gnorm: 0.3323 clip: 0
04/05/2020 11:46:43 valid loss: 0.3228 auc: 0.9546 f1: 0.8936 acc: 0.8916 [BEST: 0.8940]
04/05/2020 11:46:46 > epoch 22 updates 32920 loss: 0.1312 lr: 2.3245e-04 gnorm: 0.4346
04/05/2020 11:46:49 > epoch 22 updates 32940 loss: 0.1545 lr: 2.3245e-04 gnorm: 0.5140
04/05/2020 11:46:53 train loss: 0.1429 lr: 2.3245e-04 gnorm: 0.4745 clip: 0
04/05/2020 11:46:53 valid loss: 0.3178 auc: 0.9560 f1: 0.8959 acc: 0.8945 [NEW BEST]
04/05/2020 11:46:55 > epoch 22 updates 32960 loss: 0.1329 lr: 2.3245e-04 gnorm: 0.3945
04/05/2020 11:46:58 > epoch 22 updates 32980 loss: 0.0945 lr: 2.3245e-04 gnorm: 0.2795
04/05/2020 11:47:01 > epoch 22 updates 33000 loss: 0.1133 lr: 2.3245e-04 gnorm: 0.4035
04/05/2020 11:47:03 train loss: 0.1135 lr: 2.3245e-04 gnorm: 0.3592 clip: 0
04/05/2020 11:47:03 valid loss: 0.3218 auc: 0.9554 f1: 0.8959 acc: 0.8940 [BEST: 0.8945]
04/05/2020 11:47:06 > epoch 22 updates 33020 loss: 0.0977 lr: 2.2083e-04 gnorm: 0.3368
04/05/2020 11:47:08 > epoch 22 updates 33040 loss: 0.1213 lr: 2.2083e-04 gnorm: 0.4157
04/05/2020 11:47:11 train loss: 0.1096 lr: 2.2083e-04 gnorm: 0.3765 clip: 0
04/05/2020 11:47:11 valid loss: 0.3218 auc: 0.9565 f1: 0.8968 acc: 0.8950 [NEW BEST]
04/05/2020 11:47:11 Epoch: 23
04/05/2020 11:47:18 valid loss: 0.3202 auc: 0.9571 f1: 0.8974 acc: 0.8959 [NEW BEST]
04/05/2020 11:47:20 > epoch 23 updates 33060 loss: 0.1097 lr: 2.2083e-04 gnorm: 0.3652
04/05/2020 11:47:23 > epoch 23 updates 33080 loss: 0.0961 lr: 2.2083e-04 gnorm: 0.3611
04/05/2020 11:47:26 > epoch 23 updates 33100 loss: 0.0805 lr: 2.2083e-04 gnorm: 0.3714
04/05/2020 11:47:28 train loss: 0.0954 lr: 2.2083e-04 gnorm: 0.3659 clip: 0
04/05/2020 11:47:28 valid loss: 0.3434 auc: 0.9540 f1: 0.8935 acc: 0.8903 [BEST: 0.8959]
04/05/2020 11:47:31 > epoch 23 updates 33120 loss: 0.1392 lr: 2.2083e-04 gnorm: 0.4107
04/05/2020 11:47:34 > epoch 23 updates 33140 loss: 0.0735 lr: 2.2083e-04 gnorm: 0.3674
04/05/2020 11:47:37 train loss: 0.1062 lr: 2.2083e-04 gnorm: 0.3889 clip: 0
04/05/2020 11:47:37 valid loss: 0.3319 auc: 0.9551 f1: 0.8940 acc: 0.8923 [BEST: 0.8959]
04/05/2020 11:47:38 > epoch 23 updates 33160 loss: 0.0908 lr: 2.2083e-04 gnorm: 0.3433
04/05/2020 11:47:41 > epoch 23 updates 33180 loss: 0.1061 lr: 2.2083e-04 gnorm: 0.3570
04/05/2020 11:47:44 > epoch 23 updates 33200 loss: 0.0793 lr: 2.2083e-04 gnorm: 0.3255
04/05/2020 11:47:46 train loss: 0.0921 lr: 2.2083e-04 gnorm: 0.3419 clip: 0
04/05/2020 11:47:46 valid loss: 0.3353 auc: 0.9536 f1: 0.8935 acc: 0.8910 [BEST: 0.8959]
04/05/2020 11:47:49 > epoch 23 updates 33220 loss: 0.1199 lr: 2.2083e-04 gnorm: 0.3823
04/05/2020 11:47:52 > epoch 23 updates 33240 loss: 0.0701 lr: 2.2083e-04 gnorm: 0.2785
04/05/2020 11:47:55 train loss: 0.0949 lr: 2.2083e-04 gnorm: 0.3301 clip: 0
04/05/2020 11:47:55 valid loss: 0.3378 auc: 0.9547 f1: 0.8953 acc: 0.8931 [BEST: 0.8959]
04/05/2020 11:47:57 > epoch 23 updates 33260 loss: 0.0867 lr: 2.2083e-04 gnorm: 0.3986
04/05/2020 11:48:00 > epoch 23 updates 33280 loss: 0.0643 lr: 2.2083e-04 gnorm: 0.3496
04/05/2020 11:48:03 > epoch 23 updates 33300 loss: 0.1077 lr: 2.2083e-04 gnorm: 0.3960
04/05/2020 11:48:05 train loss: 0.0863 lr: 2.2083e-04 gnorm: 0.3814 clip: 0
04/05/2020 11:48:05 valid loss: 0.3389 auc: 0.9547 f1: 0.8950 acc: 0.8930 [BEST: 0.8959]
04/05/2020 11:48:08 > epoch 23 updates 33320 loss: 0.0948 lr: 2.2083e-04 gnorm: 0.3867
04/05/2020 11:48:11 > epoch 23 updates 33340 loss: 0.0842 lr: 2.2083e-04 gnorm: 0.3581
04/05/2020 11:48:14 train loss: 0.0895 lr: 2.2083e-04 gnorm: 0.3723 clip: 0
04/05/2020 11:48:14 valid loss: 0.3398 auc: 0.9539 f1: 0.8941 acc: 0.8919 [BEST: 0.8959]
04/05/2020 11:48:16 > epoch 23 updates 33360 loss: 0.0848 lr: 2.2083e-04 gnorm: 0.3678
04/05/2020 11:48:19 > epoch 23 updates 33380 loss: 0.0972 lr: 2.2083e-04 gnorm: 0.3349
04/05/2020 11:48:22 > epoch 23 updates 33400 loss: 0.1223 lr: 2.2083e-04 gnorm: 0.4246
04/05/2020 11:48:24 train loss: 0.1016 lr: 2.2083e-04 gnorm: 0.3760 clip: 0
04/05/2020 11:48:24 valid loss: 0.3334 auc: 0.9549 f1: 0.8916 acc: 0.8903 [BEST: 0.8959]
04/05/2020 11:48:27 > epoch 23 updates 33420 loss: 0.1155 lr: 2.2083e-04 gnorm: 0.4835
04/05/2020 11:48:30 > epoch 23 updates 33440 loss: 0.1360 lr: 2.2083e-04 gnorm: 0.5231
04/05/2020 11:48:33 train loss: 0.1258 lr: 2.2083e-04 gnorm: 0.5034 clip: 0
04/05/2020 11:48:33 valid loss: 0.3388 auc: 0.9544 f1: 0.8925 acc: 0.8903 [BEST: 0.8959]
04/05/2020 11:48:35 > epoch 23 updates 33460 loss: 0.0927 lr: 2.2083e-04 gnorm: 0.3130
04/05/2020 11:48:37 > epoch 23 updates 33480 loss: 0.1099 lr: 2.2083e-04 gnorm: 0.3820
04/05/2020 11:48:40 > epoch 23 updates 33500 loss: 0.1107 lr: 2.2083e-04 gnorm: 0.3745
04/05/2020 11:48:42 train loss: 0.1045 lr: 2.2083e-04 gnorm: 0.3567 clip: 0
04/05/2020 11:48:42 valid loss: 0.3364 auc: 0.9550 f1: 0.8940 acc: 0.8919 [BEST: 0.8959]
04/05/2020 11:48:45 > epoch 23 updates 33520 loss: 0.1293 lr: 2.2083e-04 gnorm: 0.4304
04/05/2020 11:48:48 > epoch 23 updates 33540 loss: 0.1297 lr: 2.2083e-04 gnorm: 0.4402
04/05/2020 11:48:51 train loss: 0.1295 lr: 2.2083e-04 gnorm: 0.4353 clip: 0
04/05/2020 11:48:51 valid loss: 0.3327 auc: 0.9546 f1: 0.8924 acc: 0.8912 [BEST: 0.8959]
04/05/2020 11:48:52 > epoch 23 updates 33560 loss: 0.1153 lr: 2.2083e-04 gnorm: 0.3706
04/05/2020 11:48:56 > epoch 23 updates 33580 loss: 0.1172 lr: 2.2083e-04 gnorm: 0.4081
04/05/2020 11:48:59 > epoch 23 updates 33600 loss: 0.0791 lr: 2.2083e-04 gnorm: 0.3442
04/05/2020 11:49:01 train loss: 0.1037 lr: 2.2083e-04 gnorm: 0.3742 clip: 0
04/05/2020 11:49:01 valid loss: 0.3343 auc: 0.9529 f1: 0.8901 acc: 0.8883 [BEST: 0.8959]
04/05/2020 11:49:03 > epoch 23 updates 33620 loss: 0.1440 lr: 2.2083e-04 gnorm: 0.4055
04/05/2020 11:49:06 > epoch 23 updates 33640 loss: 0.1108 lr: 2.2083e-04 gnorm: 0.3775
04/05/2020 11:49:10 train loss: 0.1273 lr: 2.2083e-04 gnorm: 0.3914 clip: 0
04/05/2020 11:49:10 valid loss: 0.3275 auc: 0.9549 f1: 0.8921 acc: 0.8909 [BEST: 0.8959]
04/05/2020 11:49:11 > epoch 23 updates 33660 loss: 0.0870 lr: 2.2083e-04 gnorm: 0.3206
04/05/2020 11:49:14 > epoch 23 updates 33680 loss: 0.0908 lr: 2.2083e-04 gnorm: 0.2847
04/05/2020 11:49:17 > epoch 23 updates 33700 loss: 0.0999 lr: 2.2083e-04 gnorm: 0.3803
04/05/2020 11:49:19 train loss: 0.0926 lr: 2.2083e-04 gnorm: 0.3287 clip: 0
04/05/2020 11:49:19 valid loss: 0.3349 auc: 0.9535 f1: 0.8911 acc: 0.8898 [BEST: 0.8959]
04/05/2020 11:49:22 > epoch 23 updates 33720 loss: 0.1114 lr: 2.2083e-04 gnorm: 0.5911
04/05/2020 11:49:25 > epoch 23 updates 33740 loss: 0.1332 lr: 2.2083e-04 gnorm: 0.4298
04/05/2020 11:49:28 train loss: 0.1223 lr: 2.2083e-04 gnorm: 0.5100 clip: 0
04/05/2020 11:49:28 valid loss: 0.3310 auc: 0.9545 f1: 0.8944 acc: 0.8925 [BEST: 0.8959]
04/05/2020 11:49:30 > epoch 23 updates 33760 loss: 0.1080 lr: 2.2083e-04 gnorm: 0.3759
04/05/2020 11:49:33 > epoch 23 updates 33780 loss: 0.1217 lr: 2.2083e-04 gnorm: 0.4302
04/05/2020 11:49:36 > epoch 23 updates 33800 loss: 0.1561 lr: 2.2083e-04 gnorm: 0.4375
04/05/2020 11:49:38 train loss: 0.1288 lr: 2.2083e-04 gnorm: 0.4147 clip: 0
04/05/2020 11:49:38 valid loss: 0.3335 auc: 0.9540 f1: 0.8931 acc: 0.8908 [BEST: 0.8959]
04/05/2020 11:49:41 > epoch 23 updates 33820 loss: 0.1197 lr: 2.2083e-04 gnorm: 0.3584
04/05/2020 11:49:44 > epoch 23 updates 33840 loss: 0.1199 lr: 2.2083e-04 gnorm: 0.4766
04/05/2020 11:49:47 train loss: 0.1198 lr: 2.2083e-04 gnorm: 0.4178 clip: 0
04/05/2020 11:49:47 valid loss: 0.3333 auc: 0.9541 f1: 0.8932 acc: 0.8914 [BEST: 0.8959]
04/05/2020 11:49:48 > epoch 23 updates 33860 loss: 0.1490 lr: 2.2083e-04 gnorm: 0.5268
04/05/2020 11:49:51 > epoch 23 updates 33880 loss: 0.1091 lr: 2.2083e-04 gnorm: 0.3581
04/05/2020 11:49:54 > epoch 23 updates 33900 loss: 0.1243 lr: 2.2083e-04 gnorm: 0.4396
04/05/2020 11:49:56 train loss: 0.1274 lr: 2.2083e-04 gnorm: 0.4412 clip: 0
04/05/2020 11:49:56 valid loss: 0.3292 auc: 0.9548 f1: 0.8931 acc: 0.8921 [BEST: 0.8959]
04/05/2020 11:49:59 > epoch 23 updates 33920 loss: 0.1467 lr: 2.2083e-04 gnorm: 0.5025
04/05/2020 11:50:02 > epoch 23 updates 33940 loss: 0.0750 lr: 2.2083e-04 gnorm: 0.2821
04/05/2020 11:50:05 train loss: 0.1106 lr: 2.2083e-04 gnorm: 0.3917 clip: 0
04/05/2020 11:50:05 valid loss: 0.3239 auc: 0.9542 f1: 0.8917 acc: 0.8901 [BEST: 0.8959]
04/05/2020 11:50:07 > epoch 23 updates 33960 loss: 0.1091 lr: 2.2083e-04 gnorm: 0.3745
04/05/2020 11:50:10 > epoch 23 updates 33980 loss: 0.1246 lr: 2.2083e-04 gnorm: 0.4578
04/05/2020 11:50:13 > epoch 23 updates 34000 loss: 0.0856 lr: 2.2083e-04 gnorm: 0.3086
04/05/2020 11:50:15 train loss: 0.1064 lr: 2.2083e-04 gnorm: 0.3801 clip: 0
04/05/2020 11:50:15 valid loss: 0.3334 auc: 0.9547 f1: 0.8961 acc: 0.8935 [BEST: 0.8959]
04/05/2020 11:50:18 > epoch 23 updates 34020 loss: 0.1018 lr: 2.0979e-04 gnorm: 0.3811
04/05/2020 11:50:21 > epoch 23 updates 34040 loss: 0.0658 lr: 2.0979e-04 gnorm: 0.3012
04/05/2020 11:50:24 train loss: 0.0837 lr: 2.0979e-04 gnorm: 0.3410 clip: 0
04/05/2020 11:50:24 valid loss: 0.3272 auc: 0.9552 f1: 0.8943 acc: 0.8928 [BEST: 0.8959]
04/05/2020 11:50:26 > epoch 23 updates 34060 loss: 0.0947 lr: 2.0979e-04 gnorm: 0.4115
04/05/2020 11:50:29 > epoch 23 updates 34080 loss: 0.0690 lr: 2.0979e-04 gnorm: 0.2850
04/05/2020 11:50:32 > epoch 23 updates 34100 loss: 0.0686 lr: 2.0979e-04 gnorm: 0.2644
04/05/2020 11:50:34 train loss: 0.0774 lr: 2.0979e-04 gnorm: 0.3198 clip: 0
04/05/2020 11:50:34 valid loss: 0.3255 auc: 0.9555 f1: 0.8958 acc: 0.8942 [BEST: 0.8959]
04/05/2020 11:50:37 > epoch 23 updates 34120 loss: 0.1212 lr: 2.0979e-04 gnorm: 0.4465
04/05/2020 11:50:40 > epoch 23 updates 34140 loss: 0.1115 lr: 2.0979e-04 gnorm: 0.4433
04/05/2020 11:50:43 train loss: 0.1163 lr: 2.0979e-04 gnorm: 0.4449 clip: 0
04/05/2020 11:50:43 valid loss: 0.3238 auc: 0.9553 f1: 0.8931 acc: 0.8915 [BEST: 0.8959]
04/05/2020 11:50:45 > epoch 23 updates 34160 loss: 0.1301 lr: 2.0979e-04 gnorm: 0.4462
04/05/2020 11:50:48 > epoch 23 updates 34180 loss: 0.0797 lr: 2.0979e-04 gnorm: 0.2919
04/05/2020 11:50:50 > epoch 23 updates 34200 loss: 0.0939 lr: 2.0979e-04 gnorm: 0.3966
04/05/2020 11:50:52 train loss: 0.1011 lr: 2.0979e-04 gnorm: 0.3781 clip: 0
04/05/2020 11:50:52 valid loss: 0.3245 auc: 0.9542 f1: 0.8924 acc: 0.8904 [BEST: 0.8959]
04/05/2020 11:50:55 > epoch 23 updates 34220 loss: 0.0676 lr: 2.0979e-04 gnorm: 0.2683
04/05/2020 11:50:58 > epoch 23 updates 34240 loss: 0.1534 lr: 2.0979e-04 gnorm: 0.4765
04/05/2020 11:51:02 train loss: 0.1107 lr: 2.0979e-04 gnorm: 0.3729 clip: 0
04/05/2020 11:51:02 valid loss: 0.3256 auc: 0.9545 f1: 0.8937 acc: 0.8920 [BEST: 0.8959]
04/05/2020 11:51:03 > epoch 23 updates 34260 loss: 0.0610 lr: 2.0979e-04 gnorm: 0.1960
04/05/2020 11:51:06 > epoch 23 updates 34280 loss: 0.0905 lr: 2.0979e-04 gnorm: 0.2964
04/05/2020 11:51:09 > epoch 23 updates 34300 loss: 0.0621 lr: 2.0979e-04 gnorm: 0.2959
04/05/2020 11:51:11 train loss: 0.0712 lr: 2.0979e-04 gnorm: 0.2631 clip: 0
04/05/2020 11:51:11 valid loss: 0.3333 auc: 0.9546 f1: 0.8949 acc: 0.8925 [BEST: 0.8959]
04/05/2020 11:51:14 > epoch 23 updates 34320 loss: 0.1241 lr: 2.0979e-04 gnorm: 0.3805
04/05/2020 11:51:17 > epoch 23 updates 34340 loss: 0.1062 lr: 2.0979e-04 gnorm: 0.3991
04/05/2020 11:51:20 train loss: 0.1151 lr: 2.0979e-04 gnorm: 0.3898 clip: 0
04/05/2020 11:51:20 valid loss: 0.3359 auc: 0.9541 f1: 0.8920 acc: 0.8902 [BEST: 0.8959]
04/05/2020 11:51:21 > epoch 23 updates 34360 loss: 0.1673 lr: 2.0979e-04 gnorm: 0.5095
04/05/2020 11:51:24 > epoch 23 updates 34380 loss: 0.0941 lr: 2.0979e-04 gnorm: 0.3963
04/05/2020 11:51:27 > epoch 23 updates 34400 loss: 0.0999 lr: 2.0979e-04 gnorm: 0.3630
04/05/2020 11:51:29 train loss: 0.1202 lr: 2.0979e-04 gnorm: 0.4224 clip: 0
04/05/2020 11:51:29 valid loss: 0.3240 auc: 0.9555 f1: 0.8936 acc: 0.8923 [BEST: 0.8959]
04/05/2020 11:51:32 > epoch 23 updates 34420 loss: 0.1106 lr: 2.0979e-04 gnorm: 0.3822
04/05/2020 11:51:35 > epoch 23 updates 34440 loss: 0.1307 lr: 2.0979e-04 gnorm: 0.4451
04/05/2020 11:51:39 train loss: 0.1207 lr: 2.0979e-04 gnorm: 0.4138 clip: 0
04/05/2020 11:51:39 valid loss: 0.3240 auc: 0.9548 f1: 0.8940 acc: 0.8920 [BEST: 0.8959]
04/05/2020 11:51:40 > epoch 23 updates 34460 loss: 0.1084 lr: 2.0979e-04 gnorm: 0.4377
04/05/2020 11:51:43 > epoch 23 updates 34480 loss: 0.0712 lr: 2.0979e-04 gnorm: 0.2669
04/05/2020 11:51:46 > epoch 23 updates 34500 loss: 0.1210 lr: 2.0979e-04 gnorm: 0.3561
04/05/2020 11:51:48 train loss: 0.1002 lr: 2.0979e-04 gnorm: 0.3533 clip: 0
04/05/2020 11:51:48 valid loss: 0.3299 auc: 0.9535 f1: 0.8903 acc: 0.8890 [BEST: 0.8959]
04/05/2020 11:51:51 > epoch 23 updates 34520 loss: 0.1227 lr: 2.0979e-04 gnorm: 0.4922
04/05/2020 11:51:54 > epoch 23 updates 34540 loss: 0.0874 lr: 2.0979e-04 gnorm: 0.3434
04/05/2020 11:51:56 train loss: 0.1050 lr: 2.0979e-04 gnorm: 0.4174 clip: 0
04/05/2020 11:51:56 valid loss: 0.3289 auc: 0.9539 f1: 0.8916 acc: 0.8901 [BEST: 0.8959]
04/05/2020 11:51:56 Epoch: 24
04/05/2020 11:52:02 valid loss: 0.3312 auc: 0.9531 f1: 0.8917 acc: 0.8891 [BEST: 0.8959]
04/05/2020 11:52:03 > epoch 24 updates 34560 loss: 0.1150 lr: 2.0979e-04 gnorm: 0.4110
04/05/2020 11:52:06 > epoch 24 updates 34580 loss: 0.0763 lr: 2.0979e-04 gnorm: 0.3139
04/05/2020 11:52:09 > epoch 24 updates 34600 loss: 0.1033 lr: 2.0979e-04 gnorm: 0.4381
04/05/2020 11:52:11 train loss: 0.0982 lr: 2.0979e-04 gnorm: 0.3877 clip: 0
04/05/2020 11:52:11 valid loss: 0.3373 auc: 0.9539 f1: 0.8940 acc: 0.8921 [BEST: 0.8959]
04/05/2020 11:52:14 > epoch 24 updates 34620 loss: 0.1185 lr: 2.0979e-04 gnorm: 0.3545
04/05/2020 11:52:17 > epoch 24 updates 34640 loss: 0.0693 lr: 2.0979e-04 gnorm: 0.3184
04/05/2020 11:52:21 train loss: 0.0938 lr: 2.0979e-04 gnorm: 0.3364 clip: 0
04/05/2020 11:52:21 valid loss: 0.3379 auc: 0.9547 f1: 0.8947 acc: 0.8930 [BEST: 0.8959]
04/05/2020 11:52:22 > epoch 24 updates 34660 loss: 0.0875 lr: 2.0979e-04 gnorm: 0.3377
04/05/2020 11:52:25 > epoch 24 updates 34680 loss: 0.1071 lr: 2.0979e-04 gnorm: 0.4550
04/05/2020 11:52:28 > epoch 24 updates 34700 loss: 0.1219 lr: 2.0979e-04 gnorm: 0.3780
04/05/2020 11:52:30 train loss: 0.1056 lr: 2.0979e-04 gnorm: 0.3904 clip: 0
04/05/2020 11:52:30 valid loss: 0.3325 auc: 0.9551 f1: 0.8950 acc: 0.8937 [BEST: 0.8959]
04/05/2020 11:52:33 > epoch 24 updates 34720 loss: 0.0680 lr: 2.0979e-04 gnorm: 0.3211
04/05/2020 11:52:35 > epoch 24 updates 34740 loss: 0.1273 lr: 2.0979e-04 gnorm: 0.4053
04/05/2020 11:52:39 train loss: 0.0978 lr: 2.0979e-04 gnorm: 0.3634 clip: 0
04/05/2020 11:52:39 valid loss: 0.3354 auc: 0.9539 f1: 0.8938 acc: 0.8914 [BEST: 0.8959]
04/05/2020 11:52:40 > epoch 24 updates 34760 loss: 0.0700 lr: 2.0979e-04 gnorm: 0.2734
04/05/2020 11:52:43 > epoch 24 updates 34780 loss: 0.1347 lr: 2.0979e-04 gnorm: 0.4729
04/05/2020 11:52:46 > epoch 24 updates 34800 loss: 0.1084 lr: 2.0979e-04 gnorm: 0.3983
04/05/2020 11:52:48 train loss: 0.1045 lr: 2.0979e-04 gnorm: 0.3820 clip: 0
04/05/2020 11:52:48 valid loss: 0.3373 auc: 0.9538 f1: 0.8933 acc: 0.8919 [BEST: 0.8959]
04/05/2020 11:52:51 > epoch 24 updates 34820 loss: 0.0682 lr: 2.0979e-04 gnorm: 0.3369
04/05/2020 11:52:54 > epoch 24 updates 34840 loss: 0.0582 lr: 2.0979e-04 gnorm: 0.2510
04/05/2020 11:52:57 train loss: 0.0631 lr: 2.0979e-04 gnorm: 0.2937 clip: 0
04/05/2020 11:52:57 valid loss: 0.3341 auc: 0.9552 f1: 0.8951 acc: 0.8938 [BEST: 0.8959]
04/05/2020 11:52:59 > epoch 24 updates 34860 loss: 0.1404 lr: 2.0979e-04 gnorm: 0.4138
04/05/2020 11:53:02 > epoch 24 updates 34880 loss: 0.0647 lr: 2.0979e-04 gnorm: 0.2482
04/05/2020 11:53:05 > epoch 24 updates 34900 loss: 0.1276 lr: 2.0979e-04 gnorm: 0.4567
04/05/2020 11:53:07 train loss: 0.1109 lr: 2.0979e-04 gnorm: 0.3730 clip: 0
04/05/2020 11:53:07 valid loss: 0.3280 auc: 0.9561 f1: 0.8957 acc: 0.8938 [BEST: 0.8959]
04/05/2020 11:53:10 > epoch 24 updates 34920 loss: 0.0941 lr: 2.0979e-04 gnorm: 0.3036
04/05/2020 11:53:13 > epoch 24 updates 34940 loss: 0.0730 lr: 2.0979e-04 gnorm: 0.2684
04/05/2020 11:53:16 train loss: 0.0835 lr: 2.0979e-04 gnorm: 0.2859 clip: 0
04/05/2020 11:53:16 valid loss: 0.3321 auc: 0.9553 f1: 0.8941 acc: 0.8925 [BEST: 0.8959]
04/05/2020 11:53:18 > epoch 24 updates 34960 loss: 0.0551 lr: 2.0979e-04 gnorm: 0.3609
04/05/2020 11:53:20 > epoch 24 updates 34980 loss: 0.1163 lr: 2.0979e-04 gnorm: 0.3911
04/05/2020 11:53:23 > epoch 24 updates 35000 loss: 0.1085 lr: 2.0979e-04 gnorm: 0.3628
04/05/2020 11:53:25 train loss: 0.0935 lr: 2.0979e-04 gnorm: 0.3716 clip: 0
04/05/2020 11:53:25 valid loss: 0.3283 auc: 0.9553 f1: 0.8946 acc: 0.8940 [BEST: 0.8959]
04/05/2020 11:53:28 > epoch 24 updates 35020 loss: 0.0733 lr: 1.9930e-04 gnorm: 0.2783
04/05/2020 11:53:31 > epoch 24 updates 35040 loss: 0.1239 lr: 1.9930e-04 gnorm: 0.5165
04/05/2020 11:53:35 train loss: 0.0987 lr: 1.9930e-04 gnorm: 0.3980 clip: 0
04/05/2020 11:53:35 valid loss: 0.3304 auc: 0.9544 f1: 0.8946 acc: 0.8923 [BEST: 0.8959]
04/05/2020 11:53:36 > epoch 24 updates 35060 loss: 0.1162 lr: 1.9930e-04 gnorm: 0.4070
04/05/2020 11:53:39 > epoch 24 updates 35080 loss: 0.1270 lr: 1.9930e-04 gnorm: 0.6883
04/05/2020 11:53:42 > epoch 24 updates 35100 loss: 0.0773 lr: 1.9930e-04 gnorm: 0.3279
04/05/2020 11:53:44 train loss: 0.1067 lr: 1.9930e-04 gnorm: 0.4741 clip: 0
04/05/2020 11:53:44 valid loss: 0.3328 auc: 0.9556 f1: 0.8938 acc: 0.8929 [BEST: 0.8959]
04/05/2020 11:53:47 > epoch 24 updates 35120 loss: 0.0775 lr: 1.9930e-04 gnorm: 0.3587
04/05/2020 11:53:50 > epoch 24 updates 35140 loss: 0.0716 lr: 1.9930e-04 gnorm: 0.2913
04/05/2020 11:53:53 train loss: 0.0746 lr: 1.9930e-04 gnorm: 0.3248 clip: 0
04/05/2020 11:53:53 valid loss: 0.3278 auc: 0.9562 f1: 0.8936 acc: 0.8927 [BEST: 0.8959]
04/05/2020 11:53:54 > epoch 24 updates 35160 loss: 0.0926 lr: 1.9930e-04 gnorm: 0.3739
04/05/2020 11:53:58 > epoch 24 updates 35180 loss: 0.1776 lr: 1.9930e-04 gnorm: 0.4985
04/05/2020 11:54:01 > epoch 24 updates 35200 loss: 0.0779 lr: 1.9930e-04 gnorm: 0.3600
04/05/2020 11:54:03 train loss: 0.1160 lr: 1.9930e-04 gnorm: 0.4107 clip: 0
04/05/2020 11:54:03 valid loss: 0.3309 auc: 0.9544 f1: 0.8927 acc: 0.8913 [BEST: 0.8959]
04/05/2020 11:54:05 > epoch 24 updates 35220 loss: 0.0782 lr: 1.9930e-04 gnorm: 0.3518
04/05/2020 11:54:09 > epoch 24 updates 35240 loss: 0.0768 lr: 1.9930e-04 gnorm: 0.2957
04/05/2020 11:54:12 train loss: 0.0775 lr: 1.9930e-04 gnorm: 0.3236 clip: 0
04/05/2020 11:54:12 valid loss: 0.3357 auc: 0.9547 f1: 0.8912 acc: 0.8897 [BEST: 0.8959]
04/05/2020 11:54:13 > epoch 24 updates 35260 loss: 0.1444 lr: 1.9930e-04 gnorm: 0.4640
04/05/2020 11:54:16 > epoch 24 updates 35280 loss: 0.0865 lr: 1.9930e-04 gnorm: 0.3611
04/05/2020 11:54:19 > epoch 24 updates 35300 loss: 0.0708 lr: 1.9930e-04 gnorm: 0.3505
04/05/2020 11:54:21 train loss: 0.1003 lr: 1.9930e-04 gnorm: 0.3915 clip: 0
04/05/2020 11:54:21 valid loss: 0.3428 auc: 0.9535 f1: 0.8903 acc: 0.8889 [BEST: 0.8959]
04/05/2020 11:54:24 > epoch 24 updates 35320 loss: 0.0837 lr: 1.9930e-04 gnorm: 0.3618
04/05/2020 11:54:27 > epoch 24 updates 35340 loss: 0.1198 lr: 1.9930e-04 gnorm: 0.3881
04/05/2020 11:54:30 train loss: 0.1018 lr: 1.9930e-04 gnorm: 0.3750 clip: 0
04/05/2020 11:54:30 valid loss: 0.3402 auc: 0.9552 f1: 0.8938 acc: 0.8920 [BEST: 0.8959]
04/05/2020 11:54:32 > epoch 24 updates 35360 loss: 0.1144 lr: 1.9930e-04 gnorm: 0.4693
04/05/2020 11:54:35 > epoch 24 updates 35380 loss: 0.0928 lr: 1.9930e-04 gnorm: 0.4222
04/05/2020 11:54:38 > epoch 24 updates 35400 loss: 0.0731 lr: 1.9930e-04 gnorm: 0.3057
04/05/2020 11:54:40 train loss: 0.0933 lr: 1.9930e-04 gnorm: 0.3985 clip: 0
04/05/2020 11:54:40 valid loss: 0.3357 auc: 0.9550 f1: 0.8956 acc: 0.8932 [BEST: 0.8959]
04/05/2020 11:54:43 > epoch 24 updates 35420 loss: 0.0789 lr: 1.9930e-04 gnorm: 0.3118
04/05/2020 11:54:46 > epoch 24 updates 35440 loss: 0.0763 lr: 1.9930e-04 gnorm: 0.3561
04/05/2020 11:54:49 train loss: 0.0776 lr: 1.9930e-04 gnorm: 0.3341 clip: 0
04/05/2020 11:54:49 valid loss: 0.3430 auc: 0.9534 f1: 0.8918 acc: 0.8894 [BEST: 0.8959]
04/05/2020 11:54:51 > epoch 24 updates 35460 loss: 0.1360 lr: 1.9930e-04 gnorm: 0.4710
04/05/2020 11:54:54 > epoch 24 updates 35480 loss: 0.1142 lr: 1.9930e-04 gnorm: 0.4058
04/05/2020 11:54:56 > epoch 24 updates 35500 loss: 0.0992 lr: 1.9930e-04 gnorm: 0.4255
04/05/2020 11:54:58 train loss: 0.1163 lr: 1.9930e-04 gnorm: 0.4339 clip: 0
04/05/2020 11:54:58 valid loss: 0.3277 auc: 0.9556 f1: 0.8951 acc: 0.8935 [BEST: 0.8959]
04/05/2020 11:55:01 > epoch 24 updates 35520 loss: 0.0667 lr: 1.9930e-04 gnorm: 0.2701
04/05/2020 11:55:04 > epoch 24 updates 35540 loss: 0.1109 lr: 1.9930e-04 gnorm: 0.4243
04/05/2020 11:55:08 train loss: 0.0889 lr: 1.9930e-04 gnorm: 0.3476 clip: 0
04/05/2020 11:55:08 valid loss: 0.3367 auc: 0.9543 f1: 0.8908 acc: 0.8893 [BEST: 0.8959]
04/05/2020 11:55:09 > epoch 24 updates 35560 loss: 0.0796 lr: 1.9930e-04 gnorm: 0.3408
04/05/2020 11:55:12 > epoch 24 updates 35580 loss: 0.0916 lr: 1.9930e-04 gnorm: 0.3252
04/05/2020 11:55:15 > epoch 24 updates 35600 loss: 0.0976 lr: 1.9930e-04 gnorm: 0.3240
04/05/2020 11:55:17 train loss: 0.0897 lr: 1.9930e-04 gnorm: 0.3299 clip: 0
04/05/2020 11:55:17 valid loss: 0.3320 auc: 0.9541 f1: 0.8933 acc: 0.8918 [BEST: 0.8959]
04/05/2020 11:55:20 > epoch 24 updates 35620 loss: 0.1417 lr: 1.9930e-04 gnorm: 0.4440
04/05/2020 11:55:23 > epoch 24 updates 35640 loss: 0.1289 lr: 1.9930e-04 gnorm: 0.4221
04/05/2020 11:55:26 train loss: 0.1353 lr: 1.9930e-04 gnorm: 0.4330 clip: 0
04/05/2020 11:55:26 valid loss: 0.3359 auc: 0.9548 f1: 0.8950 acc: 0.8930 [BEST: 0.8959]
04/05/2020 11:55:28 > epoch 24 updates 35660 loss: 0.0666 lr: 1.9930e-04 gnorm: 0.3327
04/05/2020 11:55:31 > epoch 24 updates 35680 loss: 0.0957 lr: 1.9930e-04 gnorm: 0.3944
04/05/2020 11:55:34 > epoch 24 updates 35700 loss: 0.0967 lr: 1.9930e-04 gnorm: 0.3683
04/05/2020 11:55:36 train loss: 0.0864 lr: 1.9930e-04 gnorm: 0.3652 clip: 0
04/05/2020 11:55:36 valid loss: 0.3318 auc: 0.9545 f1: 0.8941 acc: 0.8920 [BEST: 0.8959]
04/05/2020 11:55:39 > epoch 24 updates 35720 loss: 0.0867 lr: 1.9930e-04 gnorm: 0.4594
04/05/2020 11:55:42 > epoch 24 updates 35740 loss: 0.1237 lr: 1.9930e-04 gnorm: 0.4196
04/05/2020 11:55:45 train loss: 0.1053 lr: 1.9930e-04 gnorm: 0.4394 clip: 0
04/05/2020 11:55:45 valid loss: 0.3329 auc: 0.9540 f1: 0.8934 acc: 0.8914 [BEST: 0.8959]
04/05/2020 11:55:47 > epoch 24 updates 35760 loss: 0.0993 lr: 1.9930e-04 gnorm: 0.2994
04/05/2020 11:55:50 > epoch 24 updates 35780 loss: 0.1125 lr: 1.9930e-04 gnorm: 0.3508
04/05/2020 11:55:52 > epoch 24 updates 35800 loss: 0.0839 lr: 1.9930e-04 gnorm: 0.3442
04/05/2020 11:55:54 train loss: 0.0985 lr: 1.9930e-04 gnorm: 0.3316 clip: 0
04/05/2020 11:55:54 valid loss: 0.3279 auc: 0.9540 f1: 0.8914 acc: 0.8895 [BEST: 0.8959]
04/05/2020 11:55:58 > epoch 24 updates 35820 loss: 0.1059 lr: 1.9930e-04 gnorm: 0.3778
04/05/2020 11:56:01 > epoch 24 updates 35840 loss: 0.1175 lr: 1.9930e-04 gnorm: 0.4283
04/05/2020 11:56:04 train loss: 0.1118 lr: 1.9930e-04 gnorm: 0.4032 clip: 0
04/05/2020 11:56:04 valid loss: 0.3364 auc: 0.9538 f1: 0.8900 acc: 0.8896 [BEST: 0.8959]
04/05/2020 11:56:05 > epoch 24 updates 35860 loss: 0.1248 lr: 1.9930e-04 gnorm: 0.4500
04/05/2020 11:56:08 > epoch 24 updates 35880 loss: 0.0777 lr: 1.9930e-04 gnorm: 0.2748
04/05/2020 11:56:11 > epoch 24 updates 35900 loss: 0.1117 lr: 1.9930e-04 gnorm: 0.3805
04/05/2020 11:56:13 train loss: 0.1047 lr: 1.9930e-04 gnorm: 0.3682 clip: 0
04/05/2020 11:56:13 valid loss: 0.3275 auc: 0.9557 f1: 0.8935 acc: 0.8920 [BEST: 0.8959]
04/05/2020 11:56:16 > epoch 24 updates 35920 loss: 0.1208 lr: 1.9930e-04 gnorm: 0.4351
04/05/2020 11:56:19 > epoch 24 updates 35940 loss: 0.0808 lr: 1.9930e-04 gnorm: 0.2994
04/05/2020 11:56:22 train loss: 0.1007 lr: 1.9930e-04 gnorm: 0.3669 clip: 0
04/05/2020 11:56:22 valid loss: 0.3335 auc: 0.9539 f1: 0.8941 acc: 0.8914 [BEST: 0.8959]
04/05/2020 11:56:24 > epoch 24 updates 35960 loss: 0.0992 lr: 1.9930e-04 gnorm: 0.3260
04/05/2020 11:56:27 > epoch 24 updates 35980 loss: 0.1010 lr: 1.9930e-04 gnorm: 0.3935
04/05/2020 11:56:30 > epoch 24 updates 36000 loss: 0.0845 lr: 1.9930e-04 gnorm: 0.3320
04/05/2020 11:56:32 train loss: 0.0948 lr: 1.9930e-04 gnorm: 0.3505 clip: 0
04/05/2020 11:56:32 valid loss: 0.3279 auc: 0.9548 f1: 0.8912 acc: 0.8901 [BEST: 0.8959]
04/05/2020 11:56:35 > epoch 24 updates 36020 loss: 0.1197 lr: 1.8934e-04 gnorm: 0.3822
04/05/2020 11:56:38 > epoch 24 updates 36040 loss: 0.0944 lr: 1.8934e-04 gnorm: 0.4373
04/05/2020 11:56:41 train loss: 0.1070 lr: 1.8934e-04 gnorm: 0.4099 clip: 0
04/05/2020 11:56:41 valid loss: 0.3322 auc: 0.9544 f1: 0.8928 acc: 0.8911 [BEST: 0.8959]
04/05/2020 11:56:41 Epoch: 25
04/05/2020 11:56:46 valid loss: 0.3300 auc: 0.9550 f1: 0.8933 acc: 0.8919 [BEST: 0.8959]
04/05/2020 11:56:48 > epoch 25 updates 36060 loss: 0.1229 lr: 1.8934e-04 gnorm: 0.3990
04/05/2020 11:56:51 > epoch 25 updates 36080 loss: 0.1163 lr: 1.8934e-04 gnorm: 0.4473
04/05/2020 11:56:54 > epoch 25 updates 36100 loss: 0.1144 lr: 1.8934e-04 gnorm: 0.3816
04/05/2020 11:56:56 train loss: 0.1179 lr: 1.8934e-04 gnorm: 0.4093 clip: 0
04/05/2020 11:56:56 valid loss: 0.3340 auc: 0.9548 f1: 0.8941 acc: 0.8922 [BEST: 0.8959]
04/05/2020 11:56:59 > epoch 25 updates 36120 loss: 0.1055 lr: 1.8934e-04 gnorm: 0.3496
04/05/2020 11:57:02 > epoch 25 updates 36140 loss: 0.1032 lr: 1.8934e-04 gnorm: 0.3876
04/05/2020 11:57:05 train loss: 0.1044 lr: 1.8934e-04 gnorm: 0.3687 clip: 0
04/05/2020 11:57:05 valid loss: 0.3363 auc: 0.9551 f1: 0.8934 acc: 0.8916 [BEST: 0.8959]
04/05/2020 11:57:07 > epoch 25 updates 36160 loss: 0.0622 lr: 1.8934e-04 gnorm: 0.3250
04/05/2020 11:57:10 > epoch 25 updates 36180 loss: 0.0817 lr: 1.8934e-04 gnorm: 0.2663
04/05/2020 11:57:13 > epoch 25 updates 36200 loss: 0.0601 lr: 1.8934e-04 gnorm: 0.2894
04/05/2020 11:57:15 train loss: 0.0680 lr: 1.8934e-04 gnorm: 0.2934 clip: 0
04/05/2020 11:57:15 valid loss: 0.3350 auc: 0.9540 f1: 0.8947 acc: 0.8921 [BEST: 0.8959]
04/05/2020 11:57:17 > epoch 25 updates 36220 loss: 0.0765 lr: 1.8934e-04 gnorm: 0.3404
04/05/2020 11:57:20 > epoch 25 updates 36240 loss: 0.1066 lr: 1.8934e-04 gnorm: 0.4013
04/05/2020 11:57:24 train loss: 0.0917 lr: 1.8934e-04 gnorm: 0.3710 clip: 0
04/05/2020 11:57:24 valid loss: 0.3482 auc: 0.9535 f1: 0.8939 acc: 0.8910 [BEST: 0.8959]
04/05/2020 11:57:25 > epoch 25 updates 36260 loss: 0.1377 lr: 1.8934e-04 gnorm: 0.4070
04/05/2020 11:57:28 > epoch 25 updates 36280 loss: 0.0754 lr: 1.8934e-04 gnorm: 0.3106
04/05/2020 11:57:31 > epoch 25 updates 36300 loss: 0.0674 lr: 1.8934e-04 gnorm: 0.3025
04/05/2020 11:57:33 train loss: 0.0933 lr: 1.8934e-04 gnorm: 0.3397 clip: 0
04/05/2020 11:57:33 valid loss: 0.3436 auc: 0.9543 f1: 0.8937 acc: 0.8922 [BEST: 0.8959]
04/05/2020 11:57:36 > epoch 25 updates 36320 loss: 0.0710 lr: 1.8934e-04 gnorm: 0.3008
04/05/2020 11:57:39 > epoch 25 updates 36340 loss: 0.0781 lr: 1.8934e-04 gnorm: 0.3407
04/05/2020 11:57:43 train loss: 0.0746 lr: 1.8934e-04 gnorm: 0.3209 clip: 0
04/05/2020 11:57:43 valid loss: 0.3395 auc: 0.9539 f1: 0.8947 acc: 0.8928 [BEST: 0.8959]
04/05/2020 11:57:45 > epoch 25 updates 36360 loss: 0.0930 lr: 1.8934e-04 gnorm: 0.3886
04/05/2020 11:57:48 > epoch 25 updates 36380 loss: 0.0784 lr: 1.8934e-04 gnorm: 0.3928
04/05/2020 11:57:50 > epoch 25 updates 36400 loss: 0.0657 lr: 1.8934e-04 gnorm: 0.2964
04/05/2020 11:57:52 train loss: 0.0790 lr: 1.8934e-04 gnorm: 0.3589 clip: 0
04/05/2020 11:57:52 valid loss: 0.3459 auc: 0.9546 f1: 0.8955 acc: 0.8941 [BEST: 0.8959]
04/05/2020 11:57:55 > epoch 25 updates 36420 loss: 0.0742 lr: 1.8934e-04 gnorm: 0.3247
04/05/2020 11:57:58 > epoch 25 updates 36440 loss: 0.1005 lr: 1.8934e-04 gnorm: 0.3595
04/05/2020 11:58:02 train loss: 0.0874 lr: 1.8934e-04 gnorm: 0.3422 clip: 0
04/05/2020 11:58:02 valid loss: 0.3510 auc: 0.9525 f1: 0.8925 acc: 0.8904 [BEST: 0.8959]
04/05/2020 11:58:03 > epoch 25 updates 36460 loss: 0.1265 lr: 1.8934e-04 gnorm: 0.4332
04/05/2020 11:58:06 > epoch 25 updates 36480 loss: 0.0560 lr: 1.8934e-04 gnorm: 0.2909
04/05/2020 11:58:09 > epoch 25 updates 36500 loss: 0.0925 lr: 1.8934e-04 gnorm: 0.3916
04/05/2020 11:58:11 train loss: 0.0915 lr: 1.8934e-04 gnorm: 0.3717 clip: 0
04/05/2020 11:58:11 valid loss: 0.3389 auc: 0.9552 f1: 0.8948 acc: 0.8936 [BEST: 0.8959]
04/05/2020 11:58:14 > epoch 25 updates 36520 loss: 0.1051 lr: 1.8934e-04 gnorm: 0.3838
04/05/2020 11:58:17 > epoch 25 updates 36540 loss: 0.0888 lr: 1.8934e-04 gnorm: 0.3921
04/05/2020 11:58:20 train loss: 0.0969 lr: 1.8934e-04 gnorm: 0.3880 clip: 0
04/05/2020 11:58:20 valid loss: 0.3414 auc: 0.9540 f1: 0.8944 acc: 0.8915 [BEST: 0.8959]
04/05/2020 11:58:22 > epoch 25 updates 36560 loss: 0.0607 lr: 1.8934e-04 gnorm: 0.2813
04/05/2020 11:58:25 > epoch 25 updates 36580 loss: 0.0834 lr: 1.8934e-04 gnorm: 0.3584
04/05/2020 11:58:28 > epoch 25 updates 36600 loss: 0.1043 lr: 1.8934e-04 gnorm: 0.3669
04/05/2020 11:58:30 train loss: 0.0829 lr: 1.8934e-04 gnorm: 0.3358 clip: 0
04/05/2020 11:58:30 valid loss: 0.3353 auc: 0.9549 f1: 0.8945 acc: 0.8930 [BEST: 0.8959]
04/05/2020 11:58:33 > epoch 25 updates 36620 loss: 0.0876 lr: 1.8934e-04 gnorm: 0.3748
04/05/2020 11:58:35 > epoch 25 updates 36640 loss: 0.0505 lr: 1.8934e-04 gnorm: 0.2531
04/05/2020 11:58:39 train loss: 0.0689 lr: 1.8934e-04 gnorm: 0.3136 clip: 0
04/05/2020 11:58:39 valid loss: 0.3394 auc: 0.9551 f1: 0.8945 acc: 0.8929 [BEST: 0.8959]
04/05/2020 11:58:40 > epoch 25 updates 36660 loss: 0.1139 lr: 1.8934e-04 gnorm: 0.3833
04/05/2020 11:58:43 > epoch 25 updates 36680 loss: 0.0856 lr: 1.8934e-04 gnorm: 0.4055
04/05/2020 11:58:46 > epoch 25 updates 36700 loss: 0.0978 lr: 1.8934e-04 gnorm: 0.3678
04/05/2020 11:58:48 train loss: 0.0991 lr: 1.8934e-04 gnorm: 0.3855 clip: 0
04/05/2020 11:58:48 valid loss: 0.3423 auc: 0.9541 f1: 0.8931 acc: 0.8914 [BEST: 0.8959]
04/05/2020 11:58:51 > epoch 25 updates 36720 loss: 0.0853 lr: 1.8934e-04 gnorm: 0.3936
04/05/2020 11:58:54 > epoch 25 updates 36740 loss: 0.1238 lr: 1.8934e-04 gnorm: 0.4395
04/05/2020 11:58:57 train loss: 0.1047 lr: 1.8934e-04 gnorm: 0.4166 clip: 0
04/05/2020 11:58:57 valid loss: 0.3427 auc: 0.9543 f1: 0.8927 acc: 0.8911 [BEST: 0.8959]
04/05/2020 11:58:59 > epoch 25 updates 36760 loss: 0.1170 lr: 1.8934e-04 gnorm: 0.4377
04/05/2020 11:59:02 > epoch 25 updates 36780 loss: 0.0829 lr: 1.8934e-04 gnorm: 0.3506
04/05/2020 11:59:05 > epoch 25 updates 36800 loss: 0.1227 lr: 1.8934e-04 gnorm: 0.5448
04/05/2020 11:59:07 train loss: 0.1076 lr: 1.8934e-04 gnorm: 0.4447 clip: 0
04/05/2020 11:59:07 valid loss: 0.3343 auc: 0.9551 f1: 0.8939 acc: 0.8923 [BEST: 0.8959]
04/05/2020 11:59:09 > epoch 25 updates 36820 loss: 0.0957 lr: 1.8934e-04 gnorm: 0.3250
04/05/2020 11:59:12 > epoch 25 updates 36840 loss: 0.0974 lr: 1.8934e-04 gnorm: 0.3835
04/05/2020 11:59:16 train loss: 0.0966 lr: 1.8934e-04 gnorm: 0.3544 clip: 0
04/05/2020 11:59:16 valid loss: 0.3386 auc: 0.9545 f1: 0.8937 acc: 0.8919 [BEST: 0.8959]
04/05/2020 11:59:17 > epoch 25 updates 36860 loss: 0.1364 lr: 1.8934e-04 gnorm: 0.5062
04/05/2020 11:59:20 > epoch 25 updates 36880 loss: 0.1107 lr: 1.8934e-04 gnorm: 0.4387
04/05/2020 11:59:23 > epoch 25 updates 36900 loss: 0.1325 lr: 1.8934e-04 gnorm: 0.5203
04/05/2020 11:59:25 train loss: 0.1265 lr: 1.8934e-04 gnorm: 0.4885 clip: 0
04/05/2020 11:59:25 valid loss: 0.3358 auc: 0.9545 f1: 0.8932 acc: 0.8915 [BEST: 0.8959]
04/05/2020 11:59:28 > epoch 25 updates 36920 loss: 0.0935 lr: 1.8934e-04 gnorm: 0.3802
04/05/2020 11:59:31 > epoch 25 updates 36940 loss: 0.0864 lr: 1.8934e-04 gnorm: 0.3212
04/05/2020 11:59:34 train loss: 0.0899 lr: 1.8934e-04 gnorm: 0.3505 clip: 0
04/05/2020 11:59:34 valid loss: 0.3370 auc: 0.9558 f1: 0.8935 acc: 0.8921 [BEST: 0.8959]
04/05/2020 11:59:36 > epoch 25 updates 36960 loss: 0.0597 lr: 1.8934e-04 gnorm: 0.3321
04/05/2020 11:59:39 > epoch 25 updates 36980 loss: 0.1460 lr: 1.8934e-04 gnorm: 0.4651
04/05/2020 11:59:42 > epoch 25 updates 37000 loss: 0.1469 lr: 1.8934e-04 gnorm: 0.4989
04/05/2020 11:59:44 train loss: 0.1178 lr: 1.8934e-04 gnorm: 0.4326 clip: 0
04/05/2020 11:59:44 valid loss: 0.3323 auc: 0.9553 f1: 0.8932 acc: 0.8919 [BEST: 0.8959]
04/05/2020 11:59:46 > epoch 25 updates 37020 loss: 0.0943 lr: 1.7987e-04 gnorm: 0.3639
04/05/2020 11:59:49 > epoch 25 updates 37040 loss: 0.0480 lr: 1.7987e-04 gnorm: 0.2186
04/05/2020 11:59:53 train loss: 0.0711 lr: 1.7987e-04 gnorm: 0.2909 clip: 0
04/05/2020 11:59:53 valid loss: 0.3369 auc: 0.9556 f1: 0.8943 acc: 0.8928 [BEST: 0.8959]
04/05/2020 11:59:54 > epoch 25 updates 37060 loss: 0.1412 lr: 1.7987e-04 gnorm: 0.5719
04/05/2020 11:59:57 > epoch 25 updates 37080 loss: 0.1216 lr: 1.7987e-04 gnorm: 0.4751
04/05/2020 12:00:00 > epoch 25 updates 37100 loss: 0.0874 lr: 1.7987e-04 gnorm: 0.3761
04/05/2020 12:00:02 train loss: 0.1166 lr: 1.7987e-04 gnorm: 0.4737 clip: 0
04/05/2020 12:00:02 valid loss: 0.3475 auc: 0.9537 f1: 0.8914 acc: 0.8891 [BEST: 0.8959]
04/05/2020 12:00:05 > epoch 25 updates 37120 loss: 0.1126 lr: 1.7987e-04 gnorm: 0.3878
04/05/2020 12:00:08 > epoch 25 updates 37140 loss: 0.1155 lr: 1.7987e-04 gnorm: 0.4755
04/05/2020 12:00:11 train loss: 0.1141 lr: 1.7987e-04 gnorm: 0.4319 clip: 0
04/05/2020 12:00:11 valid loss: 0.3386 auc: 0.9551 f1: 0.8922 acc: 0.8907 [BEST: 0.8959]
04/05/2020 12:00:13 > epoch 25 updates 37160 loss: 0.1062 lr: 1.7987e-04 gnorm: 0.3244
04/05/2020 12:00:16 > epoch 25 updates 37180 loss: 0.0713 lr: 1.7987e-04 gnorm: 0.3218
04/05/2020 12:00:19 > epoch 25 updates 37200 loss: 0.0755 lr: 1.7987e-04 gnorm: 0.3094
04/05/2020 12:00:21 train loss: 0.0843 lr: 1.7987e-04 gnorm: 0.3185 clip: 0
04/05/2020 12:00:21 valid loss: 0.3412 auc: 0.9534 f1: 0.8908 acc: 0.8899 [BEST: 0.8959]
04/05/2020 12:00:24 > epoch 25 updates 37220 loss: 0.1117 lr: 1.7987e-04 gnorm: 0.4228
04/05/2020 12:00:27 > epoch 25 updates 37240 loss: 0.0902 lr: 1.7987e-04 gnorm: 0.3497
04/05/2020 12:00:30 train loss: 0.1009 lr: 1.7987e-04 gnorm: 0.3861 clip: 0
04/05/2020 12:00:30 valid loss: 0.3278 auc: 0.9545 f1: 0.8914 acc: 0.8908 [BEST: 0.8959]
04/05/2020 12:00:32 > epoch 25 updates 37260 loss: 0.1182 lr: 1.7987e-04 gnorm: 0.3997
04/05/2020 12:00:35 > epoch 25 updates 37280 loss: 0.0655 lr: 1.7987e-04 gnorm: 0.2985
04/05/2020 12:00:38 > epoch 25 updates 37300 loss: 0.0927 lr: 1.7987e-04 gnorm: 0.3776
04/05/2020 12:00:39 train loss: 0.0921 lr: 1.7987e-04 gnorm: 0.3586 clip: 0
04/05/2020 12:00:39 valid loss: 0.3291 auc: 0.9560 f1: 0.8931 acc: 0.8926 [BEST: 0.8959]
04/05/2020 12:00:42 > epoch 25 updates 37320 loss: 0.1071 lr: 1.7987e-04 gnorm: 0.4298
04/05/2020 12:00:45 > epoch 25 updates 37340 loss: 0.1133 lr: 1.7987e-04 gnorm: 0.3768
04/05/2020 12:00:49 train loss: 0.1102 lr: 1.7987e-04 gnorm: 0.4032 clip: 0
04/05/2020 12:00:49 valid loss: 0.3367 auc: 0.9539 f1: 0.8930 acc: 0.8914 [BEST: 0.8959]
04/05/2020 12:00:50 > epoch 25 updates 37360 loss: 0.0905 lr: 1.7987e-04 gnorm: 0.3045
04/05/2020 12:00:53 > epoch 25 updates 37380 loss: 0.0936 lr: 1.7987e-04 gnorm: 0.3802
04/05/2020 12:00:56 > epoch 25 updates 37400 loss: 0.0826 lr: 1.7987e-04 gnorm: 0.3034
04/05/2020 12:00:58 train loss: 0.0889 lr: 1.7987e-04 gnorm: 0.3294 clip: 0
04/05/2020 12:00:58 valid loss: 0.3265 auc: 0.9556 f1: 0.8945 acc: 0.8930 [BEST: 0.8959]
04/05/2020 12:01:01 > epoch 25 updates 37420 loss: 0.0788 lr: 1.7987e-04 gnorm: 0.3447
04/05/2020 12:01:04 > epoch 25 updates 37440 loss: 0.1300 lr: 1.7987e-04 gnorm: 0.4007
04/05/2020 12:01:07 train loss: 0.1045 lr: 1.7987e-04 gnorm: 0.3728 clip: 0
04/05/2020 12:01:07 valid loss: 0.3300 auc: 0.9550 f1: 0.8948 acc: 0.8929 [BEST: 0.8959]
04/05/2020 12:01:09 > epoch 25 updates 37460 loss: 0.0957 lr: 1.7987e-04 gnorm: 0.3227
04/05/2020 12:01:12 > epoch 25 updates 37480 loss: 0.1054 lr: 1.7987e-04 gnorm: 0.4352
04/05/2020 12:01:15 > epoch 25 updates 37500 loss: 0.0528 lr: 1.7987e-04 gnorm: 0.2436
04/05/2020 12:01:17 train loss: 0.0845 lr: 1.7987e-04 gnorm: 0.3336 clip: 0
04/05/2020 12:01:17 valid loss: 0.3299 auc: 0.9559 f1: 0.8952 acc: 0.8942 [BEST: 0.8959]
04/05/2020 12:01:20 > epoch 25 updates 37520 loss: 0.0958 lr: 1.7987e-04 gnorm: 0.3496
04/05/2020 12:01:23 > epoch 25 updates 37540 loss: 0.0693 lr: 1.7987e-04 gnorm: 0.2838
04/05/2020 12:01:26 train loss: 0.0825 lr: 1.7987e-04 gnorm: 0.3165 clip: 0
04/05/2020 12:01:26 valid loss: 0.3292 auc: 0.9551 f1: 0.8933 acc: 0.8922 [BEST: 0.8959]
04/05/2020 12:01:26 Epoch: 26
04/05/2020 12:01:30 > epoch 26 updates 37560 loss: 0.0961 lr: 1.7987e-04 gnorm: 0.3476
04/05/2020 12:01:34 > epoch 26 updates 37580 loss: 0.1356 lr: 1.7987e-04 gnorm: 0.4498
04/05/2020 12:01:37 > epoch 26 updates 37600 loss: 0.0937 lr: 1.7987e-04 gnorm: 0.3965
04/05/2020 12:01:39 train loss: 0.1084 lr: 1.7987e-04 gnorm: 0.3981 clip: 0
04/05/2020 12:01:39 valid loss: 0.3370 auc: 0.9551 f1: 0.8929 acc: 0.8909 [BEST: 0.8959]
04/05/2020 12:01:41 > epoch 26 updates 37620 loss: 0.1146 lr: 1.7987e-04 gnorm: 0.4982
04/05/2020 12:01:44 > epoch 26 updates 37640 loss: 0.0724 lr: 1.7987e-04 gnorm: 0.3410
04/05/2020 12:01:48 train loss: 0.0934 lr: 1.7987e-04 gnorm: 0.4192 clip: 0
04/05/2020 12:01:48 valid loss: 0.3449 auc: 0.9537 f1: 0.8927 acc: 0.8899 [BEST: 0.8959]
04/05/2020 12:01:49 > epoch 26 updates 37660 loss: 0.1021 lr: 1.7987e-04 gnorm: 0.4255
04/05/2020 12:01:52 > epoch 26 updates 37680 loss: 0.0890 lr: 1.7987e-04 gnorm: 0.3489
04/05/2020 12:01:55 > epoch 26 updates 37700 loss: 0.0846 lr: 1.7987e-04 gnorm: 0.4001
04/05/2020 12:01:57 train loss: 0.0918 lr: 1.7987e-04 gnorm: 0.3914 clip: 0
04/05/2020 12:01:57 valid loss: 0.3398 auc: 0.9542 f1: 0.8906 acc: 0.8891 [BEST: 0.8959]
04/05/2020 12:02:00 > epoch 26 updates 37720 loss: 0.0727 lr: 1.7987e-04 gnorm: 0.3067
04/05/2020 12:02:03 > epoch 26 updates 37740 loss: 0.0994 lr: 1.7987e-04 gnorm: 0.3839
04/05/2020 12:02:06 train loss: 0.0861 lr: 1.7987e-04 gnorm: 0.3455 clip: 0
04/05/2020 12:02:06 valid loss: 0.3442 auc: 0.9544 f1: 0.8930 acc: 0.8913 [BEST: 0.8959]
04/05/2020 12:02:08 > epoch 26 updates 37760 loss: 0.0828 lr: 1.7987e-04 gnorm: 0.3412
04/05/2020 12:02:11 > epoch 26 updates 37780 loss: 0.1006 lr: 1.7987e-04 gnorm: 0.4038
04/05/2020 12:02:14 > epoch 26 updates 37800 loss: 0.0702 lr: 1.7987e-04 gnorm: 0.3073
04/05/2020 12:02:16 train loss: 0.0845 lr: 1.7987e-04 gnorm: 0.3507 clip: 0
04/05/2020 12:02:16 valid loss: 0.3489 auc: 0.9544 f1: 0.8939 acc: 0.8917 [BEST: 0.8959]
04/05/2020 12:02:19 > epoch 26 updates 37820 loss: 0.0890 lr: 1.7987e-04 gnorm: 0.2981
04/05/2020 12:02:22 > epoch 26 updates 37840 loss: 0.0689 lr: 1.7987e-04 gnorm: 0.3963
04/05/2020 12:02:25 train loss: 0.0789 lr: 1.7987e-04 gnorm: 0.3475 clip: 0
04/05/2020 12:02:25 valid loss: 0.3458 auc: 0.9540 f1: 0.8929 acc: 0.8908 [BEST: 0.8959]
04/05/2020 12:02:27 > epoch 26 updates 37860 loss: 0.0768 lr: 1.7987e-04 gnorm: 0.2764
04/05/2020 12:02:29 > epoch 26 updates 37880 loss: 0.0743 lr: 1.7987e-04 gnorm: 0.3376
04/05/2020 12:02:32 > epoch 26 updates 37900 loss: 0.1006 lr: 1.7987e-04 gnorm: 0.4401
04/05/2020 12:02:34 train loss: 0.0840 lr: 1.7987e-04 gnorm: 0.3519 clip: 0
04/05/2020 12:02:34 valid loss: 0.3505 auc: 0.9549 f1: 0.8943 acc: 0.8922 [BEST: 0.8959]
04/05/2020 12:02:37 > epoch 26 updates 37920 loss: 0.1000 lr: 1.7987e-04 gnorm: 0.3947
04/05/2020 12:02:40 > epoch 26 updates 37940 loss: 0.0718 lr: 1.7987e-04 gnorm: 0.3520
04/05/2020 12:02:44 train loss: 0.0858 lr: 1.7987e-04 gnorm: 0.3733 clip: 0
04/05/2020 12:02:44 valid loss: 0.3489 auc: 0.9539 f1: 0.8930 acc: 0.8908 [BEST: 0.8959]
04/05/2020 12:02:45 > epoch 26 updates 37960 loss: 0.0790 lr: 1.7987e-04 gnorm: 0.3701
04/05/2020 12:02:48 > epoch 26 updates 37980 loss: 0.0787 lr: 1.7987e-04 gnorm: 0.2681
04/05/2020 12:02:51 > epoch 26 updates 38000 loss: 0.0585 lr: 1.7987e-04 gnorm: 0.2956
04/05/2020 12:02:53 train loss: 0.0720 lr: 1.7987e-04 gnorm: 0.3110 clip: 0
04/05/2020 12:02:53 valid loss: 0.3377 auc: 0.9545 f1: 0.8936 acc: 0.8917 [BEST: 0.8959]
04/05/2020 12:02:56 > epoch 26 updates 38020 loss: 0.0801 lr: 1.7087e-04 gnorm: 0.3490
04/05/2020 12:02:59 > epoch 26 updates 38040 loss: 0.0964 lr: 1.7087e-04 gnorm: 0.4138
04/05/2020 12:03:02 train loss: 0.0883 lr: 1.7087e-04 gnorm: 0.3816 clip: 0
04/05/2020 12:03:02 valid loss: 0.3425 auc: 0.9537 f1: 0.8914 acc: 0.8904 [BEST: 0.8959]
04/05/2020 12:03:04 > epoch 26 updates 38060 loss: 0.0977 lr: 1.7087e-04 gnorm: 0.3828
04/05/2020 12:03:07 > epoch 26 updates 38080 loss: 0.0903 lr: 1.7087e-04 gnorm: 0.3636
04/05/2020 12:03:10 > epoch 26 updates 38100 loss: 0.0828 lr: 1.7087e-04 gnorm: 0.3348
04/05/2020 12:03:12 train loss: 0.0902 lr: 1.7087e-04 gnorm: 0.3602 clip: 0
04/05/2020 12:03:12 valid loss: 0.3422 auc: 0.9539 f1: 0.8923 acc: 0.8912 [BEST: 0.8959]
04/05/2020 12:03:14 > epoch 26 updates 38120 loss: 0.1182 lr: 1.7087e-04 gnorm: 0.4525
04/05/2020 12:03:17 > epoch 26 updates 38140 loss: 0.1215 lr: 1.7087e-04 gnorm: 0.4579
04/05/2020 12:03:21 train loss: 0.1199 lr: 1.7087e-04 gnorm: 0.4552 clip: 0
04/05/2020 12:03:21 valid loss: 0.3443 auc: 0.9540 f1: 0.8934 acc: 0.8918 [BEST: 0.8959]
04/05/2020 12:03:22 > epoch 26 updates 38160 loss: 0.1009 lr: 1.7087e-04 gnorm: 0.3606
04/05/2020 12:03:25 > epoch 26 updates 38180 loss: 0.1145 lr: 1.7087e-04 gnorm: 0.4537
04/05/2020 12:03:28 > epoch 26 updates 38200 loss: 0.1097 lr: 1.7087e-04 gnorm: 0.5476
04/05/2020 12:03:30 train loss: 0.1084 lr: 1.7087e-04 gnorm: 0.4546 clip: 0
04/05/2020 12:03:30 valid loss: 0.3436 auc: 0.9551 f1: 0.8952 acc: 0.8934 [BEST: 0.8959]
04/05/2020 12:03:33 > epoch 26 updates 38220 loss: 0.0838 lr: 1.7087e-04 gnorm: 0.4196
04/05/2020 12:03:36 > epoch 26 updates 38240 loss: 0.0988 lr: 1.7087e-04 gnorm: 0.4696
04/05/2020 12:03:39 train loss: 0.0913 lr: 1.7087e-04 gnorm: 0.4447 clip: 0
04/05/2020 12:03:39 valid loss: 0.3448 auc: 0.9550 f1: 0.8940 acc: 0.8928 [BEST: 0.8959]
04/05/2020 12:03:41 > epoch 26 updates 38260 loss: 0.1023 lr: 1.7087e-04 gnorm: 0.4458
04/05/2020 12:03:44 > epoch 26 updates 38280 loss: 0.0752 lr: 1.7087e-04 gnorm: 0.3379
04/05/2020 12:03:47 > epoch 26 updates 38300 loss: 0.0937 lr: 1.7087e-04 gnorm: 0.3473
04/05/2020 12:03:49 train loss: 0.0904 lr: 1.7087e-04 gnorm: 0.3767 clip: 0
04/05/2020 12:03:49 valid loss: 0.3414 auc: 0.9544 f1: 0.8942 acc: 0.8929 [BEST: 0.8959]
04/05/2020 12:03:52 > epoch 26 updates 38320 loss: 0.0921 lr: 1.7087e-04 gnorm: 0.3943
04/05/2020 12:03:54 > epoch 26 updates 38340 loss: 0.1235 lr: 1.7087e-04 gnorm: 0.5059
04/05/2020 12:03:58 train loss: 0.1079 lr: 1.7087e-04 gnorm: 0.4504 clip: 0
04/05/2020 12:03:58 valid loss: 0.3430 auc: 0.9541 f1: 0.8943 acc: 0.8924 [BEST: 0.8959]
04/05/2020 12:03:59 > epoch 26 updates 38360 loss: 0.0732 lr: 1.7087e-04 gnorm: 0.3610
04/05/2020 12:04:02 > epoch 26 updates 38380 loss: 0.0919 lr: 1.7087e-04 gnorm: 0.4517
04/05/2020 12:04:05 > epoch 26 updates 38400 loss: 0.0853 lr: 1.7087e-04 gnorm: 0.4610
04/05/2020 12:04:07 train loss: 0.0835 lr: 1.7087e-04 gnorm: 0.4249 clip: 0
04/05/2020 12:04:07 valid loss: 0.3381 auc: 0.9541 f1: 0.8939 acc: 0.8920 [BEST: 0.8959]
04/05/2020 12:04:10 > epoch 26 updates 38420 loss: 0.0880 lr: 1.7087e-04 gnorm: 0.2738
04/05/2020 12:04:13 > epoch 26 updates 38440 loss: 0.0621 lr: 1.7087e-04 gnorm: 0.3046
04/05/2020 12:04:17 train loss: 0.0750 lr: 1.7087e-04 gnorm: 0.2893 clip: 0
04/05/2020 12:04:17 valid loss: 0.3396 auc: 0.9545 f1: 0.8959 acc: 0.8935 [BEST: 0.8959]
04/05/2020 12:04:18 > epoch 26 updates 38460 loss: 0.0908 lr: 1.7087e-04 gnorm: 0.3930
04/05/2020 12:04:21 > epoch 26 updates 38480 loss: 0.0726 lr: 1.7087e-04 gnorm: 0.3368
04/05/2020 12:04:24 > epoch 26 updates 38500 loss: 0.0807 lr: 1.7087e-04 gnorm: 0.3552
04/05/2020 12:04:26 train loss: 0.0813 lr: 1.7087e-04 gnorm: 0.3615 clip: 0
04/05/2020 12:04:26 valid loss: 0.3467 auc: 0.9543 f1: 0.8957 acc: 0.8934 [BEST: 0.8959]
04/05/2020 12:04:29 > epoch 26 updates 38520 loss: 0.1241 lr: 1.7087e-04 gnorm: 0.5148
04/05/2020 12:04:32 > epoch 26 updates 38540 loss: 0.0862 lr: 1.7087e-04 gnorm: 0.3771
04/05/2020 12:04:35 train loss: 0.1051 lr: 1.7087e-04 gnorm: 0.4456 clip: 0
04/05/2020 12:04:35 valid loss: 0.3376 auc: 0.9562 f1: 0.8970 acc: 0.8954 [BEST: 0.8959]
04/05/2020 12:04:36 > epoch 26 updates 38560 loss: 0.0857 lr: 1.7087e-04 gnorm: 0.3806
04/05/2020 12:04:39 > epoch 26 updates 38580 loss: 0.0906 lr: 1.7087e-04 gnorm: 0.3742
04/05/2020 12:04:42 > epoch 26 updates 38600 loss: 0.0858 lr: 1.7087e-04 gnorm: 0.3910
04/05/2020 12:04:44 train loss: 0.0874 lr: 1.7087e-04 gnorm: 0.3820 clip: 0
04/05/2020 12:04:44 valid loss: 0.3396 auc: 0.9548 f1: 0.8965 acc: 0.8942 [BEST: 0.8959]
04/05/2020 12:04:47 > epoch 26 updates 38620 loss: 0.1006 lr: 1.7087e-04 gnorm: 0.4946
04/05/2020 12:04:50 > epoch 26 updates 38640 loss: 0.1245 lr: 1.7087e-04 gnorm: 0.5574
04/05/2020 12:04:54 train loss: 0.1126 lr: 1.7087e-04 gnorm: 0.5262 clip: 0
04/05/2020 12:04:54 valid loss: 0.3436 auc: 0.9530 f1: 0.8956 acc: 0.8933 [BEST: 0.8959]
04/05/2020 12:04:55 > epoch 26 updates 38660 loss: 0.0824 lr: 1.7087e-04 gnorm: 0.3925
04/05/2020 12:04:58 > epoch 26 updates 38680 loss: 0.0806 lr: 1.7087e-04 gnorm: 0.3126
04/05/2020 12:05:01 > epoch 26 updates 38700 loss: 0.1247 lr: 1.7087e-04 gnorm: 0.3897
04/05/2020 12:05:03 train loss: 0.0961 lr: 1.7087e-04 gnorm: 0.3649 clip: 0
04/05/2020 12:05:03 valid loss: 0.3387 auc: 0.9547 f1: 0.8952 acc: 0.8933 [BEST: 0.8959]
04/05/2020 12:05:06 > epoch 26 updates 38720 loss: 0.1037 lr: 1.7087e-04 gnorm: 0.3197
04/05/2020 12:05:09 > epoch 26 updates 38740 loss: 0.0879 lr: 1.7087e-04 gnorm: 0.3956
04/05/2020 12:05:12 train loss: 0.0957 lr: 1.7087e-04 gnorm: 0.3578 clip: 0
04/05/2020 12:05:12 valid loss: 0.3416 auc: 0.9561 f1: 0.8953 acc: 0.8939 [BEST: 0.8959]
04/05/2020 12:05:14 > epoch 26 updates 38760 loss: 0.1150 lr: 1.7087e-04 gnorm: 0.3860
04/05/2020 12:05:17 > epoch 26 updates 38780 loss: 0.0822 lr: 1.7087e-04 gnorm: 0.3083
04/05/2020 12:05:20 > epoch 26 updates 38800 loss: 0.1036 lr: 1.7087e-04 gnorm: 0.4053
04/05/2020 12:05:22 train loss: 0.1002 lr: 1.7087e-04 gnorm: 0.3666 clip: 0
04/05/2020 12:05:22 valid loss: 0.3422 auc: 0.9545 f1: 0.8936 acc: 0.8921 [BEST: 0.8959]
04/05/2020 12:05:25 > epoch 26 updates 38820 loss: 0.0805 lr: 1.7087e-04 gnorm: 0.3697
04/05/2020 12:05:27 > epoch 26 updates 38840 loss: 0.1319 lr: 1.7087e-04 gnorm: 0.4328
04/05/2020 12:05:31 train loss: 0.1063 lr: 1.7087e-04 gnorm: 0.4014 clip: 0
04/05/2020 12:05:31 valid loss: 0.3554 auc: 0.9543 f1: 0.8949 acc: 0.8931 [BEST: 0.8959]
04/05/2020 12:05:32 > epoch 26 updates 38860 loss: 0.0930 lr: 1.7087e-04 gnorm: 0.4300
04/05/2020 12:05:35 > epoch 26 updates 38880 loss: 0.0914 lr: 1.7087e-04 gnorm: 0.3689
04/05/2020 12:05:38 > epoch 26 updates 38900 loss: 0.0999 lr: 1.7087e-04 gnorm: 0.3595
04/05/2020 12:05:40 train loss: 0.0948 lr: 1.7087e-04 gnorm: 0.3859 clip: 0
04/05/2020 12:05:40 valid loss: 0.3385 auc: 0.9563 f1: 0.8942 acc: 0.8932 [BEST: 0.8959]
04/05/2020 12:05:43 > epoch 26 updates 38920 loss: 0.1120 lr: 1.7087e-04 gnorm: 0.3781
04/05/2020 12:05:46 > epoch 26 updates 38940 loss: 0.0857 lr: 1.7087e-04 gnorm: 0.4216
04/05/2020 12:05:49 train loss: 0.0988 lr: 1.7087e-04 gnorm: 0.3999 clip: 0
04/05/2020 12:05:49 valid loss: 0.3323 auc: 0.9551 f1: 0.8930 acc: 0.8920 [BEST: 0.8959]
04/05/2020 12:05:51 > epoch 26 updates 38960 loss: 0.0924 lr: 1.7087e-04 gnorm: 0.3019
04/05/2020 12:05:54 > epoch 26 updates 38980 loss: 0.1062 lr: 1.7087e-04 gnorm: 0.4134
04/05/2020 12:05:57 > epoch 26 updates 39000 loss: 0.0931 lr: 1.7087e-04 gnorm: 0.4536
04/05/2020 12:05:59 train loss: 0.0973 lr: 1.7087e-04 gnorm: 0.3901 clip: 0
04/05/2020 12:05:59 valid loss: 0.3414 auc: 0.9550 f1: 0.8953 acc: 0.8937 [BEST: 0.8959]
04/05/2020 12:06:01 > epoch 26 updates 39020 loss: 0.1284 lr: 1.6233e-04 gnorm: 0.4093
04/05/2020 12:06:04 > epoch 26 updates 39040 loss: 0.0703 lr: 1.6233e-04 gnorm: 0.3474
04/05/2020 12:06:08 train loss: 0.0992 lr: 1.6233e-04 gnorm: 0.3782 clip: 0
04/05/2020 12:06:08 valid loss: 0.3416 auc: 0.9548 f1: 0.8957 acc: 0.8938 [BEST: 0.8959]
04/05/2020 12:06:10 valid loss: 0.3416 auc: 0.9548 f1: 0.8959 acc: 0.8939 [BEST: 0.8959]
04/05/2020 12:06:10 Epoch: 27
04/05/2020 12:06:15 > epoch 27 updates 39060 loss: 0.1307 lr: 1.6233e-04 gnorm: 0.3973
04/05/2020 12:06:18 > epoch 27 updates 39080 loss: 0.1645 lr: 1.6233e-04 gnorm: 0.4568
04/05/2020 12:06:21 > epoch 27 updates 39100 loss: 0.0873 lr: 1.6233e-04 gnorm: 0.4195
04/05/2020 12:06:23 train loss: 0.1273 lr: 1.6233e-04 gnorm: 0.4246 clip: 0
04/05/2020 12:06:23 valid loss: 0.3433 auc: 0.9548 f1: 0.8943 acc: 0.8928 [BEST: 0.8959]
04/05/2020 12:06:25 > epoch 27 updates 39120 loss: 0.0746 lr: 1.6233e-04 gnorm: 0.3479
04/05/2020 12:06:28 > epoch 27 updates 39140 loss: 0.1184 lr: 1.6233e-04 gnorm: 0.4830
04/05/2020 12:06:32 train loss: 0.0966 lr: 1.6233e-04 gnorm: 0.4158 clip: 0
04/05/2020 12:06:32 valid loss: 0.3470 auc: 0.9551 f1: 0.8950 acc: 0.8934 [BEST: 0.8959]
04/05/2020 12:06:33 > epoch 27 updates 39160 loss: 0.1245 lr: 1.6233e-04 gnorm: 0.4263
04/05/2020 12:06:36 > epoch 27 updates 39180 loss: 0.1148 lr: 1.6233e-04 gnorm: 0.4389
04/05/2020 12:06:39 > epoch 27 updates 39200 loss: 0.1458 lr: 1.6233e-04 gnorm: 0.5045
04/05/2020 12:06:41 train loss: 0.1284 lr: 1.6233e-04 gnorm: 0.4569 clip: 0
04/05/2020 12:06:41 valid loss: 0.3404 auc: 0.9547 f1: 0.8937 acc: 0.8925 [BEST: 0.8959]
04/05/2020 12:06:44 > epoch 27 updates 39220 loss: 0.0684 lr: 1.6233e-04 gnorm: 0.3057
04/05/2020 12:06:47 > epoch 27 updates 39240 loss: 0.0601 lr: 1.6233e-04 gnorm: 0.3338
04/05/2020 12:06:50 train loss: 0.0642 lr: 1.6233e-04 gnorm: 0.3198 clip: 0
04/05/2020 12:06:50 valid loss: 0.3466 auc: 0.9546 f1: 0.8922 acc: 0.8909 [BEST: 0.8959]
04/05/2020 12:06:52 > epoch 27 updates 39260 loss: 0.0601 lr: 1.6233e-04 gnorm: 0.2983
04/05/2020 12:06:55 > epoch 27 updates 39280 loss: 0.0704 lr: 1.6233e-04 gnorm: 0.3529
04/05/2020 12:06:58 > epoch 27 updates 39300 loss: 0.0850 lr: 1.6233e-04 gnorm: 0.3753
04/05/2020 12:07:00 train loss: 0.0719 lr: 1.6233e-04 gnorm: 0.3424 clip: 0
04/05/2020 12:07:00 valid loss: 0.3495 auc: 0.9543 f1: 0.8914 acc: 0.8902 [BEST: 0.8959]
04/05/2020 12:07:02 > epoch 27 updates 39320 loss: 0.0799 lr: 1.6233e-04 gnorm: 0.3136
04/05/2020 12:07:05 > epoch 27 updates 39340 loss: 0.0889 lr: 1.6233e-04 gnorm: 0.4150
04/05/2020 12:07:09 train loss: 0.0844 lr: 1.6233e-04 gnorm: 0.3646 clip: 0
04/05/2020 12:07:09 valid loss: 0.3400 auc: 0.9550 f1: 0.8946 acc: 0.8927 [BEST: 0.8959]
04/05/2020 12:07:10 > epoch 27 updates 39360 loss: 0.1146 lr: 1.6233e-04 gnorm: 0.4875
04/05/2020 12:07:13 > epoch 27 updates 39380 loss: 0.0388 lr: 1.6233e-04 gnorm: 0.1831
04/05/2020 12:07:16 > epoch 27 updates 39400 loss: 0.0572 lr: 1.6233e-04 gnorm: 0.2983
04/05/2020 12:07:18 train loss: 0.0700 lr: 1.6233e-04 gnorm: 0.3223 clip: 0
04/05/2020 12:07:18 valid loss: 0.3411 auc: 0.9558 f1: 0.8938 acc: 0.8928 [BEST: 0.8959]
04/05/2020 12:07:21 > epoch 27 updates 39420 loss: 0.1145 lr: 1.6233e-04 gnorm: 0.4522
04/05/2020 12:07:24 > epoch 27 updates 39440 loss: 0.0922 lr: 1.6233e-04 gnorm: 0.3816
04/05/2020 12:07:27 train loss: 0.1033 lr: 1.6233e-04 gnorm: 0.4168 clip: 0
04/05/2020 12:07:27 valid loss: 0.3471 auc: 0.9536 f1: 0.8940 acc: 0.8915 [BEST: 0.8959]
04/05/2020 12:07:29 > epoch 27 updates 39460 loss: 0.1245 lr: 1.6233e-04 gnorm: 0.3962
04/05/2020 12:07:32 > epoch 27 updates 39480 loss: 0.0856 lr: 1.6233e-04 gnorm: 0.3049
04/05/2020 12:07:35 > epoch 27 updates 39500 loss: 0.1246 lr: 1.6233e-04 gnorm: 0.3907
04/05/2020 12:07:37 train loss: 0.1116 lr: 1.6233e-04 gnorm: 0.3639 clip: 0
04/05/2020 12:07:37 valid loss: 0.3421 auc: 0.9546 f1: 0.8957 acc: 0.8934 [BEST: 0.8959]
04/05/2020 12:07:40 > epoch 27 updates 39520 loss: 0.0731 lr: 1.6233e-04 gnorm: 0.3609
04/05/2020 12:07:43 > epoch 27 updates 39540 loss: 0.1148 lr: 1.6233e-04 gnorm: 0.4509
04/05/2020 12:07:46 train loss: 0.0940 lr: 1.6233e-04 gnorm: 0.4061 clip: 0
04/05/2020 12:07:46 valid loss: 0.3449 auc: 0.9553 f1: 0.8955 acc: 0.8939 [BEST: 0.8959]
04/05/2020 12:07:47 > epoch 27 updates 39560 loss: 0.1233 lr: 1.6233e-04 gnorm: 0.3814
04/05/2020 12:07:50 > epoch 27 updates 39580 loss: 0.0919 lr: 1.6233e-04 gnorm: 0.4401
04/05/2020 12:07:53 > epoch 27 updates 39600 loss: 0.1400 lr: 1.6233e-04 gnorm: 0.4571
04/05/2020 12:07:55 train loss: 0.1185 lr: 1.6233e-04 gnorm: 0.4265 clip: 0
04/05/2020 12:07:55 valid loss: 0.3389 auc: 0.9553 f1: 0.8949 acc: 0.8935 [BEST: 0.8959]
04/05/2020 12:07:58 > epoch 27 updates 39620 loss: 0.0691 lr: 1.6233e-04 gnorm: 0.3442
04/05/2020 12:08:01 > epoch 27 updates 39640 loss: 0.0942 lr: 1.6233e-04 gnorm: 0.4529
04/05/2020 12:08:05 train loss: 0.0817 lr: 1.6233e-04 gnorm: 0.3988 clip: 0
04/05/2020 12:08:05 valid loss: 0.3520 auc: 0.9532 f1: 0.8915 acc: 0.8894 [BEST: 0.8959]
04/05/2020 12:08:06 > epoch 27 updates 39660 loss: 0.1140 lr: 1.6233e-04 gnorm: 0.4374
04/05/2020 12:08:09 > epoch 27 updates 39680 loss: 0.0595 lr: 1.6233e-04 gnorm: 0.2369
04/05/2020 12:08:12 > epoch 27 updates 39700 loss: 0.1080 lr: 1.6233e-04 gnorm: 0.3895
04/05/2020 12:08:14 train loss: 0.0938 lr: 1.6233e-04 gnorm: 0.3545 clip: 0
04/05/2020 12:08:14 valid loss: 0.3517 auc: 0.9547 f1: 0.8932 acc: 0.8912 [BEST: 0.8959]
04/05/2020 12:08:17 > epoch 27 updates 39720 loss: 0.1041 lr: 1.6233e-04 gnorm: 0.4229
04/05/2020 12:08:20 > epoch 27 updates 39740 loss: 0.0859 lr: 1.6233e-04 gnorm: 0.3948
04/05/2020 12:08:23 train loss: 0.0950 lr: 1.6233e-04 gnorm: 0.4088 clip: 0
04/05/2020 12:08:23 valid loss: 0.3467 auc: 0.9555 f1: 0.8938 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:08:25 > epoch 27 updates 39760 loss: 0.0611 lr: 1.6233e-04 gnorm: 0.2811
04/05/2020 12:08:28 > epoch 27 updates 39780 loss: 0.1056 lr: 1.6233e-04 gnorm: 0.3578
04/05/2020 12:08:31 > epoch 27 updates 39800 loss: 0.0598 lr: 1.6233e-04 gnorm: 0.3123
04/05/2020 12:08:33 train loss: 0.0755 lr: 1.6233e-04 gnorm: 0.3172 clip: 0
04/05/2020 12:08:33 valid loss: 0.3531 auc: 0.9545 f1: 0.8938 acc: 0.8917 [BEST: 0.8959]
04/05/2020 12:08:36 > epoch 27 updates 39820 loss: 0.0647 lr: 1.6233e-04 gnorm: 0.3434
04/05/2020 12:08:39 > epoch 27 updates 39840 loss: 0.1116 lr: 1.6233e-04 gnorm: 0.4582
04/05/2020 12:08:42 train loss: 0.0883 lr: 1.6233e-04 gnorm: 0.4011 clip: 0
04/05/2020 12:08:42 valid loss: 0.3511 auc: 0.9550 f1: 0.8941 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:08:44 > epoch 27 updates 39860 loss: 0.1262 lr: 1.6233e-04 gnorm: 0.4677
04/05/2020 12:08:47 > epoch 27 updates 39880 loss: 0.0969 lr: 1.6233e-04 gnorm: 0.3792
04/05/2020 12:08:50 > epoch 27 updates 39900 loss: 0.1044 lr: 1.6233e-04 gnorm: 0.4129
04/05/2020 12:08:52 train loss: 0.1091 lr: 1.6233e-04 gnorm: 0.4197 clip: 0
04/05/2020 12:08:52 valid loss: 0.3487 auc: 0.9533 f1: 0.8928 acc: 0.8910 [BEST: 0.8959]
04/05/2020 12:08:54 > epoch 27 updates 39920 loss: 0.1156 lr: 1.6233e-04 gnorm: 0.5024
04/05/2020 12:08:57 > epoch 27 updates 39940 loss: 0.1040 lr: 1.6233e-04 gnorm: 0.4501
04/05/2020 12:09:01 train loss: 0.1098 lr: 1.6233e-04 gnorm: 0.4761 clip: 0
04/05/2020 12:09:01 valid loss: 0.3452 auc: 0.9551 f1: 0.8925 acc: 0.8914 [BEST: 0.8959]
04/05/2020 12:09:02 > epoch 27 updates 39960 loss: 0.0955 lr: 1.6233e-04 gnorm: 0.4073
04/05/2020 12:09:05 > epoch 27 updates 39980 loss: 0.1079 lr: 1.6233e-04 gnorm: 0.4054
04/05/2020 12:09:08 > epoch 27 updates 40000 loss: 0.1434 lr: 1.6233e-04 gnorm: 0.4674
04/05/2020 12:09:10 train loss: 0.1158 lr: 1.6233e-04 gnorm: 0.4269 clip: 0
04/05/2020 12:09:10 valid loss: 0.3445 auc: 0.9545 f1: 0.8931 acc: 0.8910 [BEST: 0.8959]
04/05/2020 12:09:13 > epoch 27 updates 40020 loss: 0.0697 lr: 1.5421e-04 gnorm: 0.3106
04/05/2020 12:09:16 > epoch 27 updates 40040 loss: 0.0919 lr: 1.5421e-04 gnorm: 0.3571
04/05/2020 12:09:19 train loss: 0.0808 lr: 1.5421e-04 gnorm: 0.3339 clip: 0
04/05/2020 12:09:19 valid loss: 0.3427 auc: 0.9556 f1: 0.8937 acc: 0.8927 [BEST: 0.8959]
04/05/2020 12:09:21 > epoch 27 updates 40060 loss: 0.1224 lr: 1.5421e-04 gnorm: 0.5524
04/05/2020 12:09:24 > epoch 27 updates 40080 loss: 0.0931 lr: 1.5421e-04 gnorm: 0.3940
04/05/2020 12:09:27 > epoch 27 updates 40100 loss: 0.1142 lr: 1.5421e-04 gnorm: 0.4177
04/05/2020 12:09:29 train loss: 0.1099 lr: 1.5421e-04 gnorm: 0.4542 clip: 0
04/05/2020 12:09:29 valid loss: 0.3510 auc: 0.9537 f1: 0.8910 acc: 0.8897 [BEST: 0.8959]
04/05/2020 12:09:32 > epoch 27 updates 40120 loss: 0.0922 lr: 1.5421e-04 gnorm: 0.3600
04/05/2020 12:09:35 > epoch 27 updates 40140 loss: 0.0984 lr: 1.5421e-04 gnorm: 0.3595
04/05/2020 12:09:38 train loss: 0.0953 lr: 1.5421e-04 gnorm: 0.3597 clip: 0
04/05/2020 12:09:38 valid loss: 0.3412 auc: 0.9557 f1: 0.8949 acc: 0.8934 [BEST: 0.8959]
04/05/2020 12:09:40 > epoch 27 updates 40160 loss: 0.0787 lr: 1.5421e-04 gnorm: 0.3405
04/05/2020 12:09:43 > epoch 27 updates 40180 loss: 0.1028 lr: 1.5421e-04 gnorm: 0.4066
04/05/2020 12:09:46 > epoch 27 updates 40200 loss: 0.1127 lr: 1.5421e-04 gnorm: 0.4261
04/05/2020 12:09:48 train loss: 0.0982 lr: 1.5421e-04 gnorm: 0.3914 clip: 0
04/05/2020 12:09:48 valid loss: 0.3482 auc: 0.9538 f1: 0.8910 acc: 0.8894 [BEST: 0.8959]
04/05/2020 12:09:50 > epoch 27 updates 40220 loss: 0.1027 lr: 1.5421e-04 gnorm: 0.4248
04/05/2020 12:09:54 > epoch 27 updates 40240 loss: 0.1106 lr: 1.5421e-04 gnorm: 0.4501
04/05/2020 12:09:57 train loss: 0.1067 lr: 1.5421e-04 gnorm: 0.4375 clip: 0
04/05/2020 12:09:57 valid loss: 0.3544 auc: 0.9540 f1: 0.8930 acc: 0.8909 [BEST: 0.8959]
04/05/2020 12:09:58 > epoch 27 updates 40260 loss: 0.0762 lr: 1.5421e-04 gnorm: 0.3742
04/05/2020 12:10:01 > epoch 27 updates 40280 loss: 0.1528 lr: 1.5421e-04 gnorm: 0.4801
04/05/2020 12:10:04 > epoch 27 updates 40300 loss: 0.0806 lr: 1.5421e-04 gnorm: 0.4268
04/05/2020 12:10:06 train loss: 0.1032 lr: 1.5421e-04 gnorm: 0.4272 clip: 0
04/05/2020 12:10:06 valid loss: 0.3522 auc: 0.9547 f1: 0.8926 acc: 0.8910 [BEST: 0.8959]
04/05/2020 12:10:09 > epoch 27 updates 40320 loss: 0.0743 lr: 1.5421e-04 gnorm: 0.3430
04/05/2020 12:10:12 > epoch 27 updates 40340 loss: 0.0872 lr: 1.5421e-04 gnorm: 0.3748
04/05/2020 12:10:15 train loss: 0.0808 lr: 1.5421e-04 gnorm: 0.3590 clip: 0
04/05/2020 12:10:15 valid loss: 0.3543 auc: 0.9539 f1: 0.8940 acc: 0.8919 [BEST: 0.8959]
04/05/2020 12:10:17 > epoch 27 updates 40360 loss: 0.1190 lr: 1.5421e-04 gnorm: 0.4700
04/05/2020 12:10:20 > epoch 27 updates 40380 loss: 0.0912 lr: 1.5421e-04 gnorm: 0.4008
04/05/2020 12:10:23 > epoch 27 updates 40400 loss: 0.0837 lr: 1.5421e-04 gnorm: 0.3754
04/05/2020 12:10:25 train loss: 0.0979 lr: 1.5421e-04 gnorm: 0.4151 clip: 0
04/05/2020 12:10:25 valid loss: 0.3488 auc: 0.9546 f1: 0.8925 acc: 0.8912 [BEST: 0.8959]
04/05/2020 12:10:28 > epoch 27 updates 40420 loss: 0.0790 lr: 1.5421e-04 gnorm: 0.4106
04/05/2020 12:10:31 > epoch 27 updates 40440 loss: 0.1035 lr: 1.5421e-04 gnorm: 0.4677
04/05/2020 12:10:34 train loss: 0.0913 lr: 1.5421e-04 gnorm: 0.4393 clip: 0
04/05/2020 12:10:34 valid loss: 0.3454 auc: 0.9537 f1: 0.8924 acc: 0.8908 [BEST: 0.8959]
04/05/2020 12:10:36 > epoch 27 updates 40460 loss: 0.1153 lr: 1.5421e-04 gnorm: 0.4260
04/05/2020 12:10:38 > epoch 27 updates 40480 loss: 0.0994 lr: 1.5421e-04 gnorm: 0.4245
04/05/2020 12:10:41 > epoch 27 updates 40500 loss: 0.1005 lr: 1.5421e-04 gnorm: 0.4028
04/05/2020 12:10:43 train loss: 0.1050 lr: 1.5421e-04 gnorm: 0.4177 clip: 0
04/05/2020 12:10:43 valid loss: 0.3471 auc: 0.9547 f1: 0.8896 acc: 0.8892 [BEST: 0.8959]
04/05/2020 12:10:46 > epoch 27 updates 40520 loss: 0.0886 lr: 1.5421e-04 gnorm: 0.3778
04/05/2020 12:10:49 > epoch 27 updates 40540 loss: 0.1311 lr: 1.5421e-04 gnorm: 0.4095
04/05/2020 12:10:53 train loss: 0.1100 lr: 1.5421e-04 gnorm: 0.3938 clip: 0
04/05/2020 12:10:53 valid loss: 0.3380 auc: 0.9558 f1: 0.8932 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:10:55 valid loss: 0.3392 auc: 0.9556 f1: 0.8930 acc: 0.8921 [BEST: 0.8959]
04/05/2020 12:10:55 Epoch: 28
04/05/2020 12:10:59 > epoch 28 updates 40560 loss: 0.0772 lr: 1.5421e-04 gnorm: 0.3346
04/05/2020 12:11:02 > epoch 28 updates 40580 loss: 0.0758 lr: 1.5421e-04 gnorm: 0.3180
04/05/2020 12:11:05 > epoch 28 updates 40600 loss: 0.0745 lr: 1.5421e-04 gnorm: 0.3316
04/05/2020 12:11:07 train loss: 0.0758 lr: 1.5421e-04 gnorm: 0.3280 clip: 0
04/05/2020 12:11:07 valid loss: 0.3461 auc: 0.9543 f1: 0.8927 acc: 0.8912 [BEST: 0.8959]
04/05/2020 12:11:10 > epoch 28 updates 40620 loss: 0.1257 lr: 1.5421e-04 gnorm: 0.5011
04/05/2020 12:11:13 > epoch 28 updates 40640 loss: 0.0835 lr: 1.5421e-04 gnorm: 0.4929
04/05/2020 12:11:16 train loss: 0.1045 lr: 1.5421e-04 gnorm: 0.4970 clip: 0
04/05/2020 12:11:16 valid loss: 0.3478 auc: 0.9550 f1: 0.8954 acc: 0.8937 [BEST: 0.8959]
04/05/2020 12:11:18 > epoch 28 updates 40660 loss: 0.0889 lr: 1.5421e-04 gnorm: 0.3717
04/05/2020 12:11:21 > epoch 28 updates 40680 loss: 0.0994 lr: 1.5421e-04 gnorm: 0.3958
04/05/2020 12:11:24 > epoch 28 updates 40700 loss: 0.0573 lr: 1.5421e-04 gnorm: 0.3330
04/05/2020 12:11:26 train loss: 0.0817 lr: 1.5421e-04 gnorm: 0.3667 clip: 0
04/05/2020 12:11:26 valid loss: 0.3504 auc: 0.9547 f1: 0.8930 acc: 0.8916 [BEST: 0.8959]
04/05/2020 12:11:29 > epoch 28 updates 40720 loss: 0.0513 lr: 1.5421e-04 gnorm: 0.2465
04/05/2020 12:11:32 > epoch 28 updates 40740 loss: 0.0676 lr: 1.5421e-04 gnorm: 0.3315
04/05/2020 12:11:35 train loss: 0.0595 lr: 1.5421e-04 gnorm: 0.2892 clip: 0
04/05/2020 12:11:35 valid loss: 0.3546 auc: 0.9545 f1: 0.8938 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:11:36 > epoch 28 updates 40760 loss: 0.1738 lr: 1.5421e-04 gnorm: 0.5134
04/05/2020 12:11:39 > epoch 28 updates 40780 loss: 0.0820 lr: 1.5421e-04 gnorm: 0.4151
04/05/2020 12:11:42 > epoch 28 updates 40800 loss: 0.0723 lr: 1.5421e-04 gnorm: 0.2853
04/05/2020 12:11:44 train loss: 0.1090 lr: 1.5421e-04 gnorm: 0.4038 clip: 0
04/05/2020 12:11:44 valid loss: 0.3507 auc: 0.9541 f1: 0.8922 acc: 0.8913 [BEST: 0.8959]
04/05/2020 12:11:47 > epoch 28 updates 40820 loss: 0.0890 lr: 1.5421e-04 gnorm: 0.4395
04/05/2020 12:11:50 > epoch 28 updates 40840 loss: 0.0832 lr: 1.5421e-04 gnorm: 0.3651
04/05/2020 12:11:53 train loss: 0.0861 lr: 1.5421e-04 gnorm: 0.4021 clip: 0
04/05/2020 12:11:53 valid loss: 0.3522 auc: 0.9541 f1: 0.8940 acc: 0.8919 [BEST: 0.8959]
04/05/2020 12:11:55 > epoch 28 updates 40860 loss: 0.1030 lr: 1.5421e-04 gnorm: 0.4506
04/05/2020 12:11:58 > epoch 28 updates 40880 loss: 0.0695 lr: 1.5421e-04 gnorm: 0.3068
04/05/2020 12:12:01 > epoch 28 updates 40900 loss: 0.0774 lr: 1.5421e-04 gnorm: 0.3692
04/05/2020 12:12:03 train loss: 0.0832 lr: 1.5421e-04 gnorm: 0.3752 clip: 0
04/05/2020 12:12:03 valid loss: 0.3555 auc: 0.9535 f1: 0.8919 acc: 0.8905 [BEST: 0.8959]
04/05/2020 12:12:06 > epoch 28 updates 40920 loss: 0.1062 lr: 1.5421e-04 gnorm: 0.5729
04/05/2020 12:12:09 > epoch 28 updates 40940 loss: 0.0919 lr: 1.5421e-04 gnorm: 0.3707
04/05/2020 12:12:12 train loss: 0.0990 lr: 1.5421e-04 gnorm: 0.4713 clip: 0
04/05/2020 12:12:12 valid loss: 0.3451 auc: 0.9558 f1: 0.8942 acc: 0.8932 [BEST: 0.8959]
04/05/2020 12:12:14 > epoch 28 updates 40960 loss: 0.0555 lr: 1.5421e-04 gnorm: 0.3066
04/05/2020 12:12:16 > epoch 28 updates 40980 loss: 0.1755 lr: 1.5421e-04 gnorm: 0.5923
04/05/2020 12:12:19 > epoch 28 updates 41000 loss: 0.0697 lr: 1.5421e-04 gnorm: 0.2937
04/05/2020 12:12:21 train loss: 0.1003 lr: 1.5421e-04 gnorm: 0.3975 clip: 0
04/05/2020 12:12:21 valid loss: 0.3573 auc: 0.9531 f1: 0.8934 acc: 0.8910 [BEST: 0.8959]
04/05/2020 12:12:24 > epoch 28 updates 41020 loss: 0.0817 lr: 1.4650e-04 gnorm: 0.2799
04/05/2020 12:12:27 > epoch 28 updates 41040 loss: 0.0876 lr: 1.4650e-04 gnorm: 0.3503
04/05/2020 12:12:31 train loss: 0.0846 lr: 1.4650e-04 gnorm: 0.3153 clip: 0
04/05/2020 12:12:31 valid loss: 0.3515 auc: 0.9540 f1: 0.8932 acc: 0.8914 [BEST: 0.8959]
04/05/2020 12:12:32 > epoch 28 updates 41060 loss: 0.0882 lr: 1.4650e-04 gnorm: 0.3201
04/05/2020 12:12:35 > epoch 28 updates 41080 loss: 0.0968 lr: 1.4650e-04 gnorm: 0.4403
04/05/2020 12:12:38 > epoch 28 updates 41100 loss: 0.0878 lr: 1.4650e-04 gnorm: 0.3993
04/05/2020 12:12:40 train loss: 0.0909 lr: 1.4650e-04 gnorm: 0.3868 clip: 0
04/05/2020 12:12:40 valid loss: 0.3490 auc: 0.9549 f1: 0.8929 acc: 0.8914 [BEST: 0.8959]
04/05/2020 12:12:43 > epoch 28 updates 41120 loss: 0.1089 lr: 1.4650e-04 gnorm: 0.3703
04/05/2020 12:12:46 > epoch 28 updates 41140 loss: 0.0717 lr: 1.4650e-04 gnorm: 0.3164
04/05/2020 12:12:50 train loss: 0.0902 lr: 1.4650e-04 gnorm: 0.3432 clip: 0
04/05/2020 12:12:50 valid loss: 0.3433 auc: 0.9544 f1: 0.8930 acc: 0.8912 [BEST: 0.8959]
04/05/2020 12:12:51 > epoch 28 updates 41160 loss: 0.0826 lr: 1.4650e-04 gnorm: 0.3144
04/05/2020 12:12:54 > epoch 28 updates 41180 loss: 0.0942 lr: 1.4650e-04 gnorm: 0.4145
04/05/2020 12:12:57 > epoch 28 updates 41200 loss: 0.1476 lr: 1.4650e-04 gnorm: 0.5702
04/05/2020 12:12:59 train loss: 0.1083 lr: 1.4650e-04 gnorm: 0.4339 clip: 0
04/05/2020 12:12:59 valid loss: 0.3497 auc: 0.9543 f1: 0.8928 acc: 0.8911 [BEST: 0.8959]
04/05/2020 12:13:02 > epoch 28 updates 41220 loss: 0.0980 lr: 1.4650e-04 gnorm: 0.3996
04/05/2020 12:13:05 > epoch 28 updates 41240 loss: 0.1169 lr: 1.4650e-04 gnorm: 0.4297
04/05/2020 12:13:08 train loss: 0.1075 lr: 1.4650e-04 gnorm: 0.4148 clip: 0
04/05/2020 12:13:08 valid loss: 0.3490 auc: 0.9544 f1: 0.8961 acc: 0.8939 [BEST: 0.8959]
04/05/2020 12:13:10 > epoch 28 updates 41260 loss: 0.0969 lr: 1.4650e-04 gnorm: 0.4022
04/05/2020 12:13:12 > epoch 28 updates 41280 loss: 0.1103 lr: 1.4650e-04 gnorm: 0.4459
04/05/2020 12:13:16 > epoch 28 updates 41300 loss: 0.1105 lr: 1.4650e-04 gnorm: 0.3371
04/05/2020 12:13:17 train loss: 0.1060 lr: 1.4650e-04 gnorm: 0.3949 clip: 0
04/05/2020 12:13:17 valid loss: 0.3487 auc: 0.9543 f1: 0.8940 acc: 0.8922 [BEST: 0.8959]
04/05/2020 12:13:21 > epoch 28 updates 41320 loss: 0.0653 lr: 1.4650e-04 gnorm: 0.3225
04/05/2020 12:13:24 > epoch 28 updates 41340 loss: 0.0976 lr: 1.4650e-04 gnorm: 0.4252
04/05/2020 12:13:27 train loss: 0.0816 lr: 1.4650e-04 gnorm: 0.3741 clip: 0
04/05/2020 12:13:27 valid loss: 0.3473 auc: 0.9551 f1: 0.8943 acc: 0.8928 [BEST: 0.8959]
04/05/2020 12:13:28 > epoch 28 updates 41360 loss: 0.0725 lr: 1.4650e-04 gnorm: 0.3472
04/05/2020 12:13:31 > epoch 28 updates 41380 loss: 0.1085 lr: 1.4650e-04 gnorm: 0.4752
04/05/2020 12:13:34 > epoch 28 updates 41400 loss: 0.0825 lr: 1.4650e-04 gnorm: 0.3868
04/05/2020 12:13:36 train loss: 0.0879 lr: 1.4650e-04 gnorm: 0.4032 clip: 0
04/05/2020 12:13:36 valid loss: 0.3448 auc: 0.9559 f1: 0.8928 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:13:39 > epoch 28 updates 41420 loss: 0.0956 lr: 1.4650e-04 gnorm: 0.3883
04/05/2020 12:13:42 > epoch 28 updates 41440 loss: 0.0819 lr: 1.4650e-04 gnorm: 0.3136
04/05/2020 12:13:45 train loss: 0.0888 lr: 1.4650e-04 gnorm: 0.3508 clip: 0
04/05/2020 12:13:45 valid loss: 0.3456 auc: 0.9550 f1: 0.8933 acc: 0.8920 [BEST: 0.8959]
04/05/2020 12:13:47 > epoch 28 updates 41460 loss: 0.1213 lr: 1.4650e-04 gnorm: 0.3794
04/05/2020 12:13:50 > epoch 28 updates 41480 loss: 0.1038 lr: 1.4650e-04 gnorm: 0.3701
04/05/2020 12:13:53 > epoch 28 updates 41500 loss: 0.0677 lr: 1.4650e-04 gnorm: 0.3272
04/05/2020 12:13:55 train loss: 0.0974 lr: 1.4650e-04 gnorm: 0.3587 clip: 0
04/05/2020 12:13:55 valid loss: 0.3443 auc: 0.9550 f1: 0.8947 acc: 0.8930 [BEST: 0.8959]
04/05/2020 12:13:58 > epoch 28 updates 41520 loss: 0.1313 lr: 1.4650e-04 gnorm: 0.4842
04/05/2020 12:14:01 > epoch 28 updates 41540 loss: 0.0804 lr: 1.4650e-04 gnorm: 0.4092
04/05/2020 12:14:04 train loss: 0.1057 lr: 1.4650e-04 gnorm: 0.4465 clip: 0
04/05/2020 12:14:04 valid loss: 0.3496 auc: 0.9545 f1: 0.8942 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:14:06 > epoch 28 updates 41560 loss: 0.0722 lr: 1.4650e-04 gnorm: 0.4282
04/05/2020 12:14:08 > epoch 28 updates 41580 loss: 0.0955 lr: 1.4650e-04 gnorm: 0.3353
04/05/2020 12:14:11 > epoch 28 updates 41600 loss: 0.0789 lr: 1.4650e-04 gnorm: 0.3669
04/05/2020 12:14:13 train loss: 0.0822 lr: 1.4650e-04 gnorm: 0.3766 clip: 0
04/05/2020 12:14:13 valid loss: 0.3500 auc: 0.9546 f1: 0.8944 acc: 0.8927 [BEST: 0.8959]
04/05/2020 12:14:16 > epoch 28 updates 41620 loss: 0.1149 lr: 1.4650e-04 gnorm: 0.4588
04/05/2020 12:14:19 > epoch 28 updates 41640 loss: 0.0847 lr: 1.4650e-04 gnorm: 0.3123
04/05/2020 12:14:23 train loss: 0.0997 lr: 1.4650e-04 gnorm: 0.3852 clip: 0
04/05/2020 12:14:23 valid loss: 0.3495 auc: 0.9550 f1: 0.8937 acc: 0.8926 [BEST: 0.8959]
04/05/2020 12:14:24 > epoch 28 updates 41660 loss: 0.0466 lr: 1.4650e-04 gnorm: 0.2617
04/05/2020 12:14:27 > epoch 28 updates 41680 loss: 0.0948 lr: 1.4650e-04 gnorm: 0.4006
04/05/2020 12:14:30 > epoch 28 updates 41700 loss: 0.0694 lr: 1.4650e-04 gnorm: 0.2855
04/05/2020 12:14:32 train loss: 0.0703 lr: 1.4650e-04 gnorm: 0.3160 clip: 0
04/05/2020 12:14:32 valid loss: 0.3547 auc: 0.9541 f1: 0.8922 acc: 0.8909 [BEST: 0.8959]
04/05/2020 12:14:35 > epoch 28 updates 41720 loss: 0.1055 lr: 1.4650e-04 gnorm: 0.5587
04/05/2020 12:14:38 > epoch 28 updates 41740 loss: 0.0915 lr: 1.4650e-04 gnorm: 0.3319
04/05/2020 12:14:41 train loss: 0.0985 lr: 1.4650e-04 gnorm: 0.4447 clip: 0
04/05/2020 12:14:41 valid loss: 0.3487 auc: 0.9551 f1: 0.8947 acc: 0.8932 [BEST: 0.8959]
04/05/2020 12:14:43 > epoch 28 updates 41760 loss: 0.1024 lr: 1.4650e-04 gnorm: 0.5304
04/05/2020 12:14:46 > epoch 28 updates 41780 loss: 0.1581 lr: 1.4650e-04 gnorm: 0.5849
04/05/2020 12:14:48 > epoch 28 updates 41800 loss: 0.1106 lr: 1.4650e-04 gnorm: 0.4066
04/05/2020 12:14:50 train loss: 0.1237 lr: 1.4650e-04 gnorm: 0.5069 clip: 0
04/05/2020 12:14:50 valid loss: 0.3497 auc: 0.9544 f1: 0.8930 acc: 0.8911 [BEST: 0.8959]
04/05/2020 12:14:53 > epoch 28 updates 41820 loss: 0.0846 lr: 1.4650e-04 gnorm: 0.4146
04/05/2020 12:14:56 > epoch 28 updates 41840 loss: 0.0988 lr: 1.4650e-04 gnorm: 0.4256
04/05/2020 12:15:00 train loss: 0.0917 lr: 1.4650e-04 gnorm: 0.4201 clip: 0
04/05/2020 12:15:00 valid loss: 0.3445 auc: 0.9550 f1: 0.8940 acc: 0.8922 [BEST: 0.8959]
04/05/2020 12:15:01 > epoch 28 updates 41860 loss: 0.0808 lr: 1.4650e-04 gnorm: 0.3784
04/05/2020 12:15:04 > epoch 28 updates 41880 loss: 0.0947 lr: 1.4650e-04 gnorm: 0.3912
04/05/2020 12:15:07 > epoch 28 updates 41900 loss: 0.0620 lr: 1.4650e-04 gnorm: 0.3996
04/05/2020 12:15:09 train loss: 0.0791 lr: 1.4650e-04 gnorm: 0.3898 clip: 0
04/05/2020 12:15:09 valid loss: 0.3511 auc: 0.9539 f1: 0.8938 acc: 0.8918 [BEST: 0.8959]
04/05/2020 12:15:12 > epoch 28 updates 41920 loss: 0.0677 lr: 1.4650e-04 gnorm: 0.3333
04/05/2020 12:15:15 > epoch 28 updates 41940 loss: 0.0767 lr: 1.4650e-04 gnorm: 0.3637
04/05/2020 12:15:18 train loss: 0.0723 lr: 1.4650e-04 gnorm: 0.3486 clip: 0
04/05/2020 12:15:18 valid loss: 0.3482 auc: 0.9553 f1: 0.8948 acc: 0.8931 [BEST: 0.8959]
04/05/2020 12:15:20 > epoch 28 updates 41960 loss: 0.0871 lr: 1.4650e-04 gnorm: 0.4063
04/05/2020 12:15:23 > epoch 28 updates 41980 loss: 0.0959 lr: 1.4650e-04 gnorm: 0.3826
04/05/2020 12:15:26 > epoch 28 updates 42000 loss: 0.0578 lr: 1.4650e-04 gnorm: 0.2636
04/05/2020 12:15:28 train loss: 0.0801 lr: 1.4650e-04 gnorm: 0.3503 clip: 0
04/05/2020 12:15:28 valid loss: 0.3491 auc: 0.9540 f1: 0.8938 acc: 0.8910 [BEST: 0.8959]
04/05/2020 12:15:31 > epoch 28 updates 42020 loss: 0.1032 lr: 1.3918e-04 gnorm: 0.3744
04/05/2020 12:15:34 > epoch 28 updates 42040 loss: 0.0692 lr: 1.3918e-04 gnorm: 0.2583
04/05/2020 12:15:37 train loss: 0.0861 lr: 1.3918e-04 gnorm: 0.3161 clip: 0
04/05/2020 12:15:37 valid loss: 0.3432 auc: 0.9545 f1: 0.8943 acc: 0.8924 [BEST: 0.8959]
04/05/2020 12:15:40 valid loss: 0.3426 auc: 0.9551 f1: 0.8944 acc: 0.8927 [BEST: 0.8959]
04/05/2020 12:15:40 Epoch: 29
04/05/2020 12:15:43 > epoch 29 updates 42060 loss: 0.0903 lr: 1.3918e-04 gnorm: 0.4144
04/05/2020 12:15:46 > epoch 29 updates 42080 loss: 0.1172 lr: 1.3918e-04 gnorm: 0.3671
04/05/2020 12:15:49 > epoch 29 updates 42100 loss: 0.0614 lr: 1.3918e-04 gnorm: 0.3275
04/05/2020 12:15:51 train loss: 0.0895 lr: 1.3918e-04 gnorm: 0.3694 clip: 0
04/05/2020 12:15:51 valid loss: 0.3440 auc: 0.9561 f1: 0.8953 acc: 0.8942 [BEST: 0.8959]
04/05/2020 12:15:54 > epoch 29 updates 42120 loss: 0.0636 lr: 1.3918e-04 gnorm: 0.3192
04/05/2020 12:15:57 > epoch 29 updates 42140 loss: 0.1069 lr: 1.3918e-04 gnorm: 0.3626
04/05/2020 12:16:01 train loss: 0.0854 lr: 1.3918e-04 gnorm: 0.3410 clip: 0
04/05/2020 12:16:01 valid loss: 0.3509 auc: 0.9553 f1: 0.8960 acc: 0.8943 [BEST: 0.8959]
04/05/2020 12:16:02 > epoch 29 updates 42160 loss: 0.0727 lr: 1.3918e-04 gnorm: 0.3928
04/05/2020 12:16:05 > epoch 29 updates 42180 loss: 0.1585 lr: 1.3918e-04 gnorm: 0.5385
04/05/2020 12:16:08 > epoch 29 updates 42200 loss: 0.0660 lr: 1.3918e-04 gnorm: 0.2919
04/05/2020 12:16:10 train loss: 0.0990 lr: 1.3918e-04 gnorm: 0.4074 clip: 0
04/05/2020 12:16:10 valid loss: 0.3511 auc: 0.9541 f1: 0.8945 acc: 0.8925 [BEST: 0.8959]
04/05/2020 12:16:13 > epoch 29 updates 42220 loss: 0.0639 lr: 1.3918e-04 gnorm: 0.2203
04/05/2020 12:16:16 > epoch 29 updates 42240 loss: 0.0911 lr: 1.3918e-04 gnorm: 0.4041
04/05/2020 12:16:19 train loss: 0.0776 lr: 1.3918e-04 gnorm: 0.3127 clip: 0
04/05/2020 12:16:19 valid loss: 0.3470 auc: 0.9556 f1: 0.8957 acc: 0.8942 [BEST: 0.8959]
04/05/2020 12:16:20 > epoch 29 updates 42260 loss: 0.0742 lr: 1.3918e-04 gnorm: 0.3694
04/05/2020 12:16:23 > epoch 29 updates 42280 loss: 0.0603 lr: 1.3918e-04 gnorm: 0.3629
04/05/2020 12:16:26 > epoch 29 updates 42300 loss: 0.0699 lr: 1.3918e-04 gnorm: 0.3010
04/05/2020 12:16:28 train loss: 0.0682 lr: 1.3918e-04 gnorm: 0.3442 clip: 0
04/05/2020 12:16:28 valid loss: 0.3497 auc: 0.9554 f1: 0.8950 acc: 0.8933 [BEST: 0.8959]
04/05/2020 12:16:31 > epoch 29 updates 42320 loss: 0.0470 lr: 1.3918e-04 gnorm: 0.2963
04/05/2020 12:16:34 > epoch 29 updates 42340 loss: 0.0651 lr: 1.3918e-04 gnorm: 0.3194
04/05/2020 12:16:37 train loss: 0.0561 lr: 1.3918e-04 gnorm: 0.3079 clip: 0
04/05/2020 12:16:37 valid loss: 0.3505 auc: 0.9550 f1: 0.8946 acc: 0.8929 [BEST: 0.8959]
04/05/2020 12:16:39 > epoch 29 updates 42360 loss: 0.0977 lr: 1.3918e-04 gnorm: 0.4212
04/05/2020 12:16:42 > epoch 29 updates 42380 loss: 0.0998 lr: 1.3918e-04 gnorm: 0.4045
04/05/2020 12:16:45 > epoch 29 updates 42400 loss: 0.0640 lr: 1.3918e-04 gnorm: 0.2441
04/05/2020 12:16:47 train loss: 0.0871 lr: 1.3918e-04 gnorm: 0.3560 clip: 0
04/05/2020 12:16:47 valid loss: 0.3486 auc: 0.9550 f1: 0.8925 acc: 0.8914 [BEST: 0.8959]
04/05/2020 12:16:50 > epoch 29 updates 42420 loss: 0.0923 lr: 1.3918e-04 gnorm: 0.3551
04/05/2020 12:16:53 > epoch 29 updates 42440 loss: 0.0719 lr: 1.3918e-04 gnorm: 0.2350
04/05/2020 12:16:56 train loss: 0.0821 lr: 1.3918e-04 gnorm: 0.2947 clip: 0
04/05/2020 12:16:56 valid loss: 0.3460 auc: 0.9549 f1: 0.8942 acc: 0.8927 [BEST: 0.8959]
04/05/2020 12:16:57 > epoch 29 updates 42460 loss: 0.0589 lr: 1.3918e-04 gnorm: 0.3749
04/05/2020 12:17:00 > epoch 29 updates 42480 loss: 0.0596 lr: 1.3918e-04 gnorm: 0.2843
04/05/2020 12:17:03 > epoch 29 updates 42500 loss: 0.0804 lr: 1.3918e-04 gnorm: 0.3927
04/05/2020 12:17:05 train loss: 0.0664 lr: 1.3918e-04 gnorm: 0.3507 clip: 0
04/05/2020 12:17:05 valid loss: 0.3509 auc: 0.9551 f1: 0.8938 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:17:08 > epoch 29 updates 42520 loss: 0.0999 lr: 1.3918e-04 gnorm: 0.4246
04/05/2020 12:17:11 > epoch 29 updates 42540 loss: 0.0658 lr: 1.3918e-04 gnorm: 0.3375
04/05/2020 12:17:15 train loss: 0.0827 lr: 1.3918e-04 gnorm: 0.3808 clip: 0
04/05/2020 12:17:15 valid loss: 0.3470 auc: 0.9556 f1: 0.8947 acc: 0.8932 [BEST: 0.8959]
04/05/2020 12:17:16 > epoch 29 updates 42560 loss: 0.0458 lr: 1.3918e-04 gnorm: 0.2744
04/05/2020 12:17:19 > epoch 29 updates 42580 loss: 0.0651 lr: 1.3918e-04 gnorm: 0.4153
04/05/2020 12:17:22 > epoch 29 updates 42600 loss: 0.0646 lr: 1.3918e-04 gnorm: 0.3851
04/05/2020 12:17:24 train loss: 0.0586 lr: 1.3918e-04 gnorm: 0.3586 clip: 0
04/05/2020 12:17:24 valid loss: 0.3559 auc: 0.9541 f1: 0.8936 acc: 0.8920 [BEST: 0.8959]
04/05/2020 12:17:27 > epoch 29 updates 42620 loss: 0.0527 lr: 1.3918e-04 gnorm: 0.2682
04/05/2020 12:17:30 > epoch 29 updates 42640 loss: 0.0972 lr: 1.3918e-04 gnorm: 0.3934
04/05/2020 12:17:33 train loss: 0.0751 lr: 1.3918e-04 gnorm: 0.3311 clip: 0
04/05/2020 12:17:33 valid loss: 0.3503 auc: 0.9546 f1: 0.8948 acc: 0.8929 [BEST: 0.8959]
04/05/2020 12:17:35 > epoch 29 updates 42660 loss: 0.1151 lr: 1.3918e-04 gnorm: 0.4986
04/05/2020 12:17:37 > epoch 29 updates 42680 loss: 0.0811 lr: 1.3918e-04 gnorm: 0.3679
04/05/2020 12:17:40 > epoch 29 updates 42700 loss: 0.1143 lr: 1.3918e-04 gnorm: 0.5057
04/05/2020 12:17:42 train loss: 0.1035 lr: 1.3918e-04 gnorm: 0.4575 clip: 0
04/05/2020 12:17:42 valid loss: 0.3549 auc: 0.9540 f1: 0.8945 acc: 0.8922 [BEST: 0.8959]
04/05/2020 12:17:45 > epoch 29 updates 42720 loss: 0.0727 lr: 1.3918e-04 gnorm: 0.4514
04/05/2020 12:17:48 > epoch 29 updates 42740 loss: 0.0835 lr: 1.3918e-04 gnorm: 0.3869
04/05/2020 12:17:52 train loss: 0.0781 lr: 1.3918e-04 gnorm: 0.4190 clip: 0
04/05/2020 12:17:52 valid loss: 0.3499 auc: 0.9545 f1: 0.8945 acc: 0.8923 [BEST: 0.8959]
04/05/2020 12:17:53 > epoch 29 updates 42760 loss: 0.0772 lr: 1.3918e-04 gnorm: 0.3762
04/05/2020 12:17:56 > epoch 29 updates 42780 loss: 0.0950 lr: 1.3918e-04 gnorm: 0.3927
04/05/2020 12:17:59 > epoch 29 updates 42800 loss: 0.1602 lr: 1.3918e-04 gnorm: 0.5038
04/05/2020 12:18:01 train loss: 0.1111 lr: 1.3918e-04 gnorm: 0.4247 clip: 0
04/05/2020 12:18:01 valid loss: 0.3444 auc: 0.9556 f1: 0.8955 acc: 0.8934 [BEST: 0.8959]
04/05/2020 12:18:04 > epoch 29 updates 42820 loss: 0.0899 lr: 1.3918e-04 gnorm: 0.3693
04/05/2020 12:18:07 > epoch 29 updates 42840 loss: 0.0869 lr: 1.3918e-04 gnorm: 0.3610
04/05/2020 12:18:10 train loss: 0.0884 lr: 1.3918e-04 gnorm: 0.3651 clip: 0
04/05/2020 12:18:10 valid loss: 0.3487 auc: 0.9550 f1: 0.8921 acc: 0.8913 [BEST: 0.8959]
04/05/2020 12:18:11 > epoch 29 updates 42860 loss: 0.0851 lr: 1.3918e-04 gnorm: 0.3910
04/05/2020 12:18:14 > epoch 29 updates 42880 loss: 0.0943 lr: 1.3918e-04 gnorm: 0.4243
04/05/2020 12:18:17 > epoch 29 updates 42900 loss: 0.0783 lr: 1.3918e-04 gnorm: 0.4342
04/05/2020 12:18:19 train loss: 0.0859 lr: 1.3918e-04 gnorm: 0.4166 clip: 0
04/05/2020 12:18:19 valid loss: 0.3547 auc: 0.9543 f1: 0.8939 acc: 0.8914 [BEST: 0.8959]
04/05/2020 12:18:22 > epoch 29 updates 42920 loss: 0.0749 lr: 1.3918e-04 gnorm: 0.3293
04/05/2020 12:18:25 > epoch 29 updates 42940 loss: 0.0973 lr: 1.3918e-04 gnorm: 0.4773
04/05/2020 12:18:29 train loss: 0.0861 lr: 1.3918e-04 gnorm: 0.4037 clip: 0
04/05/2020 12:18:29 valid loss: 0.3585 auc: 0.9541 f1: 0.8915 acc: 0.8901 [BEST: 0.8959]
04/05/2020 12:18:30 > epoch 29 updates 42960 loss: 0.0798 lr: 1.3918e-04 gnorm: 0.4426
04/05/2020 12:18:33 > epoch 29 updates 42980 loss: 0.0841 lr: 1.3918e-04 gnorm: 0.3318
04/05/2020 12:18:36 > epoch 29 updates 43000 loss: 0.0894 lr: 1.3918e-04 gnorm: 0.3512
04/05/2020 12:18:38 train loss: 0.0845 lr: 1.3918e-04 gnorm: 0.3749 clip: 0
04/05/2020 12:18:38 valid loss: 0.3589 auc: 0.9539 f1: 0.8935 acc: 0.8915 [BEST: 0.8959]
04/05/2020 12:18:41 > epoch 29 updates 43020 loss: 0.0685 lr: 1.3222e-04 gnorm: 0.3611
04/05/2020 12:18:44 > epoch 29 updates 43040 loss: 0.0759 lr: 1.3222e-04 gnorm: 0.3142
04/05/2020 12:18:47 train loss: 0.0722 lr: 1.3222e-04 gnorm: 0.3375 clip: 0
04/05/2020 12:18:47 valid loss: 0.3548 auc: 0.9549 f1: 0.8942 acc: 0.8922 [BEST: 0.8959]
04/05/2020 12:18:49 > epoch 29 updates 43060 loss: 0.0687 lr: 1.3222e-04 gnorm: 0.2134
04/05/2020 12:18:52 > epoch 29 updates 43080 loss: 0.1019 lr: 1.3222e-04 gnorm: 0.3965
04/05/2020 12:18:55 > epoch 29 updates 43100 loss: 0.0995 lr: 1.3222e-04 gnorm: 0.4648
04/05/2020 12:18:57 train loss: 0.0901 lr: 1.3222e-04 gnorm: 0.3591 clip: 0
04/05/2020 12:18:57 valid loss: 0.3507 auc: 0.9545 f1: 0.8944 acc: 0.8925 [BEST: 0.8959]
04/05/2020 12:18:57 [Tolerance reached. Training is stopped early.]
04/05/2020 12:18:57 [Tolerance reached. Training is stopped early.]
04/05/2020 12:18:57 best dev score 0.8959 at step 33050 (epoch 23).
04/05/2020 12:18:57 best eval stats [loss: 0.3202 auc: 0.9571 f1: 0.8974 acc: 0.8959]
04/05/2020 12:18:57 Training time: 2:08:56.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment