Skip to content

Instantly share code, notes, and snippets.

@izuna385

izuna385/20190420_complex1asym1_ep100_newParameter_newLoss.log

Created April 21, 2019 09:56
Show Gist options
  • Save izuna385/952f9d9b5b03f9d0bef0d09a81d342f7 to your computer and use it in GitHub Desktop.
Save izuna385/952f9d9b5b03f9d0bef0d09a81d342f7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
20190420_complex1asym1_ep100_newParameter_newLoss.log
This file has been truncated, but you can view the full file.
dataset umls
dropout 0.5
train 1
bag_size 10
encoder position_cnn
struct_weight 0.5
typing_weight 0
multilabel_linking 0
parent_sample_size 100
bilinear_l2 0.0005
bilinear_bias 0
complex 1
asymmetric 1
learn_graph 1
priors 1
model_name complex1asym1ep100.model
base_dir ./dataset_dir
lr 0.001
beta1 0.9
beta2 0.999
epsilon 1e-08
weight_decay 0.0
save_model 1
clip_val 5
embedding_dim 300
hidden_dim 150
num_epochs 100
kernel_width 5
batch_size 256
take_frac 1.0
use_transitive 1
size of training data: 199977.0000
INFO:Entity Linker:
Number of words in vocab: 2195877
INFO:Entity Linker:
Number of entities in vocab: 25507
INFO:Entity Linker:
Number of types in vocab: 0
Using position embeddings with CNN
INFO:Entity Linker:
====================TRAINING STARTED====================
char_feature_weight True
model_feature_weight True
relation_real True
relation_img True
encoder.position_embeddings.weight True
encoder.conv.weight True
encoder.conv.bias True
encoder.affine1.weight True
encoder.affine1.bias True
encoder.affine3.weight True
encoder.affine3.bias True
encoder.affine2.weight True
encoder.affine2.bias True
entity_embeddings_real.weight True
entity_embeddings_img.weight True
encoder_real_mlp.weight True
encoder_real_mlp.bias True
encoder_img_mlp.weight True
encoder_img_mlp.bias True
INFO:Entity Linker:Hierarchical Accuracy: 0.0019
INFO:Entity Linker:
==== Initial accuracy: 0.0001
INFO:Entity Linker:
=====Epoch Number: 1 =====
INFO:Entity Linker:
=====Loss: 1.0695 Step: 0 ======
INFO:Entity Linker:
=====Loss: 0.4748 Step: 10 ======
INFO:Entity Linker:
=====Loss: 0.4474 Step: 20 ======
INFO:Entity Linker:
=====Loss: 0.4901 Step: 30 ======
INFO:Entity Linker:
=====Loss: 0.4223 Step: 40 ======
INFO:Entity Linker:
=====Loss: 0.4224 Step: 50 ======
INFO:Entity Linker:
=====Loss: 0.4510 Step: 60 ======
INFO:Entity Linker:
=====Loss: 0.4253 Step: 70 ======
INFO:Entity Linker:
=====Loss: 0.4163 Step: 80 ======
INFO:Entity Linker:
=====Loss: 0.4388 Step: 90 ======
INFO:Entity Linker:
=====Loss: 0.4009 Step: 100 ======
INFO:Entity Linker:
=====Loss: 0.4072 Step: 110 ======
INFO:Entity Linker:
=====Loss: 0.4347 Step: 120 ======
INFO:Entity Linker:
=====Loss: 0.4077 Step: 130 ======
INFO:Entity Linker:
=====Loss: 0.4013 Step: 140 ======
INFO:Entity Linker:
=====Loss: 0.4010 Step: 150 ======
INFO:Entity Linker:
=====Loss: 0.4062 Step: 160 ======
INFO:Entity Linker:
=====Loss: 0.4185 Step: 170 ======
INFO:Entity Linker:
=====Loss: 0.3961 Step: 180 ======
INFO:Entity Linker:
=====Loss: 0.3888 Step: 190 ======
INFO:Entity Linker:
=====Loss: 0.3927 Step: 200 ======
INFO:Entity Linker:
=====Loss: 0.3918 Step: 210 ======
INFO:Entity Linker:
=====Loss: 0.3885 Step: 220 ======
INFO:Entity Linker:
=====Loss: 0.3930 Step: 230 ======
INFO:Entity Linker:
=====Loss: 0.3963 Step: 240 ======
INFO:Entity Linker:
=====Loss: 0.3851 Step: 250 ======
INFO:Entity Linker:
=====Loss: 0.3938 Step: 260 ======
INFO:Entity Linker:
=====Loss: 0.3909 Step: 270 ======
INFO:Entity Linker:
=====Loss: 0.3844 Step: 280 ======
INFO:Entity Linker:
=====Loss: 0.3876 Step: 290 ======
INFO:Entity Linker:
=====Loss: 0.3829 Step: 300 ======
INFO:Entity Linker:
=====Loss: 0.3913 Step: 310 ======
INFO:Entity Linker:
=====Loss: 0.4160 Step: 320 ======
INFO:Entity Linker:
=====Loss: 0.3871 Step: 330 ======
INFO:Entity Linker:
=====Loss: 0.4038 Step: 340 ======
INFO:Entity Linker:
=====Loss: 0.3810 Step: 350 ======
INFO:Entity Linker:
=====Loss: 0.3952 Step: 360 ======
INFO:Entity Linker:
=====Loss: 0.3948 Step: 370 ======
INFO:Entity Linker:
=====Loss: 0.3789 Step: 380 ======
INFO:Entity Linker:
=====Loss: 0.3812 Step: 390 ======
INFO:Entity Linker:
=====Loss: 0.3814 Step: 400 ======
INFO:Entity Linker:
=====Loss: 0.3855 Step: 410 ======
INFO:Entity Linker:
=====Loss: 0.3937 Step: 420 ======
INFO:Entity Linker:
=====Loss: 0.3756 Step: 430 ======
INFO:Entity Linker:
=====Loss: 0.3790 Step: 440 ======
INFO:Entity Linker:
=====Loss: 0.3788 Step: 450 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 460 ======
INFO:Entity Linker:
=====Loss: 0.3771 Step: 470 ======
INFO:Entity Linker:
=====Loss: 0.3836 Step: 480 ======
INFO:Entity Linker:
=====Loss: 0.3786 Step: 490 ======
INFO:Entity Linker:
=====Loss: 0.3973 Step: 500 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 510 ======
INFO:Entity Linker:
=====Loss: 0.3746 Step: 520 ======
INFO:Entity Linker:
=====Loss: 0.3865 Step: 530 ======
INFO:Entity Linker:
=====Loss: 0.3988 Step: 540 ======
INFO:Entity Linker:
=====Loss: 0.3796 Step: 550 ======
INFO:Entity Linker:
=====Loss: 0.3721 Step: 560 ======
INFO:Entity Linker:
=====Loss: 0.3884 Step: 570 ======
INFO:Entity Linker:
=====Loss: 0.3794 Step: 580 ======
INFO:Entity Linker:
=====Loss: 0.3756 Step: 590 ======
INFO:Entity Linker:
=====Loss: 0.3783 Step: 600 ======
INFO:Entity Linker:
=====Loss: 0.3829 Step: 610 ======
INFO:Entity Linker:
=====Loss: 0.3736 Step: 620 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 630 ======
INFO:Entity Linker:
=====Loss: 0.3938 Step: 640 ======
INFO:Entity Linker:
=====Loss: 0.3738 Step: 650 ======
INFO:Entity Linker:
=====Loss: 0.3781 Step: 660 ======
INFO:Entity Linker:
=====Loss: 0.3753 Step: 670 ======
INFO:Entity Linker:
=====Loss: 0.3766 Step: 680 ======
INFO:Entity Linker:
=====Loss: 0.3836 Step: 690 ======
INFO:Entity Linker:
=====Loss: 0.3848 Step: 700 ======
INFO:Entity Linker:
=====Loss: 0.3737 Step: 710 ======
INFO:Entity Linker:
=====Loss: 0.3770 Step: 720 ======
INFO:Entity Linker:
=====Loss: 0.3839 Step: 730 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 740 ======
INFO:Entity Linker:
=====Loss: 0.3726 Step: 750 ======
INFO:Entity Linker:
=====Loss: 0.3768 Step: 760 ======
INFO:Entity Linker:
=====Loss: 0.3750 Step: 770 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 780 ======
one_epoch_time 200.74145102500916
INFO:Entity Linker:
=====Epoch Number: 2 =====
INFO:Entity Linker:
=====Loss: 0.3859 Step: 790 ======
INFO:Entity Linker:
=====Loss: 0.3904 Step: 800 ======
INFO:Entity Linker:
=====Loss: 0.3768 Step: 810 ======
INFO:Entity Linker:
=====Loss: 0.3779 Step: 820 ======
INFO:Entity Linker:
=====Loss: 0.3761 Step: 830 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 840 ======
INFO:Entity Linker:
=====Loss: 0.3715 Step: 850 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 860 ======
INFO:Entity Linker:
=====Loss: 0.3933 Step: 870 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 880 ======
INFO:Entity Linker:
=====Loss: 0.3836 Step: 890 ======
INFO:Entity Linker:
=====Loss: 0.3729 Step: 900 ======
INFO:Entity Linker:
=====Loss: 0.3892 Step: 910 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 920 ======
INFO:Entity Linker:
=====Loss: 0.3739 Step: 930 ======
INFO:Entity Linker:
=====Loss: 0.3777 Step: 940 ======
INFO:Entity Linker:
=====Loss: 0.3763 Step: 950 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 960 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 970 ======
INFO:Entity Linker:
=====Loss: 0.3764 Step: 980 ======
INFO:Entity Linker:
=====Loss: 0.3801 Step: 990 ======
INFO:Entity Linker:
=====Loss: 0.3767 Step: 1000 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 1010 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 1020 ======
INFO:Entity Linker:
=====Loss: 0.3760 Step: 1030 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 1040 ======
INFO:Entity Linker:
=====Loss: 0.3770 Step: 1050 ======
INFO:Entity Linker:
=====Loss: 0.3844 Step: 1060 ======
INFO:Entity Linker:
=====Loss: 0.3741 Step: 1070 ======
INFO:Entity Linker:
=====Loss: 0.3732 Step: 1080 ======
INFO:Entity Linker:
=====Loss: 0.3722 Step: 1090 ======
INFO:Entity Linker:
=====Loss: 0.3719 Step: 1100 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 1110 ======
INFO:Entity Linker:
=====Loss: 0.3790 Step: 1120 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 1130 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 1140 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 1150 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 1160 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 1170 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 1180 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 1190 ======
INFO:Entity Linker:
=====Loss: 0.3708 Step: 1200 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 1210 ======
INFO:Entity Linker:
=====Loss: 0.3865 Step: 1220 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 1230 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 1240 ======
INFO:Entity Linker:
=====Loss: 0.3714 Step: 1250 ======
INFO:Entity Linker:
=====Loss: 0.3780 Step: 1260 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 1270 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 1280 ======
INFO:Entity Linker:
=====Loss: 0.3767 Step: 1290 ======
INFO:Entity Linker:
=====Loss: 0.3721 Step: 1300 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 1310 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 1320 ======
INFO:Entity Linker:
=====Loss: 0.3721 Step: 1330 ======
INFO:Entity Linker:
=====Loss: 0.3805 Step: 1340 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 1350 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 1360 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 1370 ======
INFO:Entity Linker:
=====Loss: 0.3747 Step: 1380 ======
INFO:Entity Linker:
=====Loss: 0.3849 Step: 1390 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 1400 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 1410 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 1420 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 1430 ======
INFO:Entity Linker:
=====Loss: 0.3728 Step: 1440 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 1450 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 1460 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 1470 ======
INFO:Entity Linker:
=====Loss: 0.3690 Step: 1480 ======
INFO:Entity Linker:
=====Loss: 0.3787 Step: 1490 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 1500 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 1510 ======
INFO:Entity Linker:
=====Loss: 0.3804 Step: 1520 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 1530 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 1540 ======
INFO:Entity Linker:
=====Loss: 0.3826 Step: 1550 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 1560 ======
one_epoch_time 185.9005572795868
INFO:Entity Linker:
=====Epoch Number: 3 =====
INFO:Entity Linker:
=====Loss: 0.3674 Step: 1570 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 1580 ======
INFO:Entity Linker:
=====Loss: 0.3766 Step: 1590 ======
INFO:Entity Linker:
=====Loss: 0.3759 Step: 1600 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 1610 ======
INFO:Entity Linker:
=====Loss: 0.3717 Step: 1620 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 1630 ======
INFO:Entity Linker:
=====Loss: 0.3695 Step: 1640 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 1650 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 1660 ======
INFO:Entity Linker:
=====Loss: 0.3712 Step: 1670 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 1680 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 1690 ======
INFO:Entity Linker:
=====Loss: 0.3746 Step: 1700 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 1710 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 1720 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 1730 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 1740 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 1750 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 1760 ======
INFO:Entity Linker:
=====Loss: 0.3775 Step: 1770 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 1780 ======
INFO:Entity Linker:
=====Loss: 0.3802 Step: 1790 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 1800 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 1810 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 1820 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 1830 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 1840 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 1850 ======
INFO:Entity Linker:
=====Loss: 0.3869 Step: 1860 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 1870 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 1880 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 1890 ======
INFO:Entity Linker:
=====Loss: 0.3730 Step: 1900 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 1910 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 1920 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 1930 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 1940 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 1950 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 1960 ======
INFO:Entity Linker:
=====Loss: 0.3841 Step: 1970 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 1980 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 1990 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 2000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4282
INFO:Entity Linker:
==== Accuracy on dev after 2000 iterations: 0.3432
INFO:Entity Linker:Hierarchical Accuracy: 0.4236
INFO:Entity Linker:
==== Accuracy on test after 2000 iterations: 0.3354
INFO:Entity Linker:
=====Loss: 0.3733 Step: 2010 ======
INFO:Entity Linker:
=====Loss: 0.3729 Step: 2020 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 2030 ======
INFO:Entity Linker:
=====Loss: 0.3722 Step: 2040 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 2050 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 2060 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 2070 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 2080 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 2090 ======
INFO:Entity Linker:
=====Loss: 0.3715 Step: 2100 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 2110 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 2120 ======
INFO:Entity Linker:
=====Loss: 0.3759 Step: 2130 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 2140 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 2150 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 2160 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 2170 ======
INFO:Entity Linker:
=====Loss: 0.3698 Step: 2180 ======
INFO:Entity Linker:
=====Loss: 0.3692 Step: 2190 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 2200 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 2210 ======
INFO:Entity Linker:
=====Loss: 0.3786 Step: 2220 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 2230 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 2240 ======
INFO:Entity Linker:
=====Loss: 0.3694 Step: 2250 ======
INFO:Entity Linker:
=====Loss: 0.3707 Step: 2260 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 2270 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 2280 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 2290 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 2300 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 2310 ======
INFO:Entity Linker:
=====Loss: 0.3760 Step: 2320 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 2330 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 2340 ======
one_epoch_time 181.93391942977905
INFO:Entity Linker:
=====Epoch Number: 4 =====
INFO:Entity Linker:
=====Loss: 0.3683 Step: 2350 ======
INFO:Entity Linker:
=====Loss: 0.3743 Step: 2360 ======
INFO:Entity Linker:
=====Loss: 0.3705 Step: 2370 ======
INFO:Entity Linker:
=====Loss: 0.3696 Step: 2380 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 2390 ======
INFO:Entity Linker:
=====Loss: 0.3728 Step: 2400 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 2410 ======
INFO:Entity Linker:
=====Loss: 0.3745 Step: 2420 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 2430 ======
INFO:Entity Linker:
=====Loss: 0.3695 Step: 2440 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2450 ======
INFO:Entity Linker:
=====Loss: 0.3758 Step: 2460 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 2470 ======
INFO:Entity Linker:
=====Loss: 0.3752 Step: 2480 ======
INFO:Entity Linker:
=====Loss: 0.3697 Step: 2490 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4494
INFO:Entity Linker:
==== Accuracy on dev after 2500 iterations: 0.3579
INFO:Entity Linker:Hierarchical Accuracy: 0.4433
INFO:Entity Linker:
==== Accuracy on test after 2500 iterations: 0.3529
INFO:Entity Linker:
=====Loss: 0.3672 Step: 2510 ======
INFO:Entity Linker:
=====Loss: 0.3752 Step: 2520 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 2530 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 2540 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 2550 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 2560 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 2570 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 2580 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 2590 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 2600 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 2610 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 2620 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2630 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 2640 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 2650 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 2660 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 2670 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 2680 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 2690 ======
INFO:Entity Linker:
=====Loss: 0.3773 Step: 2700 ======
INFO:Entity Linker:
=====Loss: 0.3723 Step: 2710 ======
INFO:Entity Linker:
=====Loss: 0.3734 Step: 2720 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 2730 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 2740 ======
INFO:Entity Linker:
=====Loss: 0.3688 Step: 2750 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2760 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 2770 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 2780 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 2790 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 2800 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 2810 ======
INFO:Entity Linker:
=====Loss: 0.3698 Step: 2820 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 2830 ======
INFO:Entity Linker:
=====Loss: 0.3706 Step: 2840 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 2850 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 2860 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 2870 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 2880 ======
INFO:Entity Linker:
=====Loss: 0.3775 Step: 2890 ======
INFO:Entity Linker:
=====Loss: 0.3733 Step: 2900 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 2910 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 2920 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 2930 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 2940 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 2950 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 2960 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 2970 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 2980 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 2990 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 3000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4579
INFO:Entity Linker:
==== Accuracy on dev after 3000 iterations: 0.3682
INFO:Entity Linker:Hierarchical Accuracy: 0.4513
INFO:Entity Linker:
==== Accuracy on test after 3000 iterations: 0.3625
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3010 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 3020 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 3030 ======
INFO:Entity Linker:
=====Loss: 0.3682 Step: 3040 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3050 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 3060 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 3070 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 3080 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 3090 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 3100 ======
INFO:Entity Linker:
=====Loss: 0.3841 Step: 3110 ======
INFO:Entity Linker:
=====Loss: 0.3730 Step: 3120 ======
one_epoch_time 189.1564576625824
INFO:Entity Linker:
=====Epoch Number: 5 =====
INFO:Entity Linker:
=====Loss: 0.3708 Step: 3130 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3140 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 3150 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 3160 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3170 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 3180 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 3190 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 3200 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 3210 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 3220 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 3230 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 3240 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 3250 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3260 ======
INFO:Entity Linker:
=====Loss: 0.3726 Step: 3270 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 3280 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 3290 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 3300 ======
INFO:Entity Linker:
=====Loss: 0.3750 Step: 3310 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 3320 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 3330 ======
INFO:Entity Linker:
=====Loss: 0.3707 Step: 3340 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 3350 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 3360 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 3370 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 3380 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 3390 ======
INFO:Entity Linker:
=====Loss: 0.3717 Step: 3400 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 3410 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 3420 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 3430 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3440 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 3450 ======
INFO:Entity Linker:
=====Loss: 0.3832 Step: 3460 ======
INFO:Entity Linker:
=====Loss: 0.3807 Step: 3470 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 3480 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 3490 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4762
INFO:Entity Linker:
==== Accuracy on dev after 3500 iterations: 0.3873
INFO:Entity Linker:Hierarchical Accuracy: 0.4685
INFO:Entity Linker:
==== Accuracy on test after 3500 iterations: 0.3810
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3510 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 3520 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 3530 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 3540 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 3550 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 3560 ======
INFO:Entity Linker:
=====Loss: 0.3798 Step: 3570 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 3580 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 3590 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3600 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 3610 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 3620 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 3630 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 3640 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3650 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 3660 ======
INFO:Entity Linker:
=====Loss: 0.3749 Step: 3670 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 3680 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3690 ======
INFO:Entity Linker:
=====Loss: 0.3695 Step: 3700 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 3710 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 3720 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3730 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 3740 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3750 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3760 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3770 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 3780 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 3790 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 3800 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 3810 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 3820 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 3830 ======
INFO:Entity Linker:
=====Loss: 0.3718 Step: 3840 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 3850 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 3860 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 3870 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 3880 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 3890 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 3900 ======
one_epoch_time 177.86334037780762
INFO:Entity Linker:
=====Epoch Number: 6 =====
INFO:Entity Linker:
=====Loss: 0.3619 Step: 3910 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 3920 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 3930 ======
INFO:Entity Linker:
=====Loss: 0.3768 Step: 3940 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 3950 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 3960 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 3970 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 3980 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3990 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 4000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4732
INFO:Entity Linker:
==== Accuracy on dev after 4000 iterations: 0.3814
INFO:Entity Linker:
=====Loss: 0.3605 Step: 4010 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4020 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 4030 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 4040 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 4050 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 4060 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 4070 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 4080 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 4090 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 4100 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4110 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 4120 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4130 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4140 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 4150 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 4160 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 4170 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 4180 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 4190 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 4200 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 4210 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 4220 ======
INFO:Entity Linker:
=====Loss: 0.3749 Step: 4230 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 4240 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 4250 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 4260 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 4270 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 4280 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 4290 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 4300 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 4310 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 4320 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 4330 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4340 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4350 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 4360 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 4370 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 4380 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 4390 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 4400 ======
INFO:Entity Linker:
=====Loss: 0.3705 Step: 4410 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 4420 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 4430 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 4440 ======
INFO:Entity Linker:
=====Loss: 0.3737 Step: 4450 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 4460 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 4470 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 4480 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 4490 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 4500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4960
INFO:Entity Linker:
==== Accuracy on dev after 4500 iterations: 0.4070
INFO:Entity Linker:Hierarchical Accuracy: 0.4920
INFO:Entity Linker:
==== Accuracy on test after 4500 iterations: 0.4045
INFO:Entity Linker:
=====Loss: 0.3642 Step: 4510 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 4520 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 4530 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 4540 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 4550 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 4560 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 4570 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 4580 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 4590 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 4600 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 4610 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 4620 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 4630 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 4640 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 4650 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 4660 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 4670 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 4680 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 4690 ======
one_epoch_time 215.85510396957397
INFO:Entity Linker:
=====Epoch Number: 7 =====
INFO:Entity Linker:
=====Loss: 0.3679 Step: 4700 ======
INFO:Entity Linker:
=====Loss: 0.3728 Step: 4710 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 4720 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 4730 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 4740 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 4750 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 4760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 4770 ======
INFO:Entity Linker:
=====Loss: 0.3748 Step: 4780 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 4790 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 4800 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4810 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 4820 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 4830 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 4840 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4850 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 4860 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 4870 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4880 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 4890 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 4900 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 4910 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 4920 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 4930 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 4940 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 4950 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 4960 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 4970 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 4980 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 4990 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 5000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5018
INFO:Entity Linker:
==== Accuracy on dev after 5000 iterations: 0.4137
INFO:Entity Linker:Hierarchical Accuracy: 0.5007
INFO:Entity Linker:
==== Accuracy on test after 5000 iterations: 0.4120
INFO:Entity Linker:
=====Loss: 0.3629 Step: 5010 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 5020 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 5030 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 5040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 5050 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 5060 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 5070 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 5080 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 5090 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 5100 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 5110 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 5120 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 5130 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 5140 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 5150 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 5160 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 5170 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 5180 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 5190 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 5200 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 5210 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 5220 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 5230 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 5240 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 5250 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 5260 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 5270 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 5280 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 5290 ======
INFO:Entity Linker:
=====Loss: 0.3701 Step: 5300 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 5310 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 5320 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 5330 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 5340 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 5350 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 5360 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 5370 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 5380 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 5390 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 5400 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 5410 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5420 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 5430 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 5440 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 5450 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 5460 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 5470 ======
one_epoch_time 213.6846616268158
INFO:Entity Linker:
=====Epoch Number: 8 =====
INFO:Entity Linker:
=====Loss: 0.3616 Step: 5480 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 5490 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 5500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5049
INFO:Entity Linker:
==== Accuracy on dev after 5500 iterations: 0.4114
INFO:Entity Linker:
=====Loss: 0.3667 Step: 5510 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 5520 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 5530 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 5540 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5550 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 5560 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 5570 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 5580 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 5590 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 5600 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 5610 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 5620 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 5630 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 5640 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 5650 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 5660 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 5670 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 5680 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 5690 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 5700 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5710 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 5720 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 5730 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 5740 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 5750 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 5760 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 5770 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 5780 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 5790 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 5800 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 5810 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 5820 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 5830 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 5840 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 5850 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5860 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 5870 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 5880 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 5890 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 5900 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 5910 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 5920 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 5930 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 5940 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 5950 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 5960 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 5970 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 5980 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 5990 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 6000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5204
INFO:Entity Linker:
==== Accuracy on dev after 6000 iterations: 0.4285
INFO:Entity Linker:Hierarchical Accuracy: 0.5163
INFO:Entity Linker:
==== Accuracy on test after 6000 iterations: 0.4257
INFO:Entity Linker:
=====Loss: 0.3637 Step: 6010 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 6020 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 6030 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 6040 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 6050 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 6060 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 6070 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 6080 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 6090 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 6100 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 6110 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6120 ======
INFO:Entity Linker:
=====Loss: 0.3696 Step: 6130 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 6140 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 6150 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 6160 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 6170 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 6180 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 6190 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 6200 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 6210 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 6220 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 6230 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 6240 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 6250 ======
one_epoch_time 220.75161147117615
INFO:Entity Linker:
=====Epoch Number: 9 =====
INFO:Entity Linker:
=====Loss: 0.3620 Step: 6260 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6270 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 6280 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6290 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 6300 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 6310 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 6320 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 6330 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 6340 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 6350 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 6360 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 6370 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 6380 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 6390 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 6400 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 6410 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 6420 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 6430 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 6440 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 6450 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 6460 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6470 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 6480 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 6490 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5245
INFO:Entity Linker:
==== Accuracy on dev after 6500 iterations: 0.4311
INFO:Entity Linker:Hierarchical Accuracy: 0.5187
INFO:Entity Linker:
==== Accuracy on test after 6500 iterations: 0.4282
INFO:Entity Linker:
=====Loss: 0.3636 Step: 6510 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6520 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 6530 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 6540 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 6550 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 6560 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 6570 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 6580 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 6590 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 6600 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 6610 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 6620 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 6630 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 6640 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 6650 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 6660 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 6670 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 6680 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6690 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 6700 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 6710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 6720 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 6730 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 6740 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 6750 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 6760 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 6770 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 6780 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 6790 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 6800 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 6810 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 6820 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 6830 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 6840 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 6850 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 6860 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 6870 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 6880 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 6890 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 6900 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 6910 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 6920 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 6930 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6940 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 6950 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 6960 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 6970 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 6980 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 6990 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 7000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5304
INFO:Entity Linker:
==== Accuracy on dev after 7000 iterations: 0.4369
INFO:Entity Linker:Hierarchical Accuracy: 0.5287
INFO:Entity Linker:
==== Accuracy on test after 7000 iterations: 0.4366
INFO:Entity Linker:
=====Loss: 0.3607 Step: 7010 ======
INFO:Entity Linker:
=====Loss: 0.3737 Step: 7020 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 7030 ======
one_epoch_time 222.97300910949707
INFO:Entity Linker:
=====Epoch Number: 10 =====
INFO:Entity Linker:
=====Loss: 0.3616 Step: 7040 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 7050 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 7060 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 7070 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 7080 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 7090 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 7100 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 7110 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 7120 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 7130 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 7140 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 7150 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 7160 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 7170 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 7180 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 7190 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 7200 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 7210 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 7220 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 7230 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 7240 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 7250 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 7260 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 7270 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 7280 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 7290 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 7300 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 7310 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 7320 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 7330 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 7340 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 7350 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 7360 ======
INFO:Entity Linker:
=====Loss: 0.3750 Step: 7370 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 7380 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 7390 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 7400 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 7410 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 7420 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 7430 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 7440 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 7450 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 7460 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 7470 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 7480 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 7490 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 7500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5364
INFO:Entity Linker:
==== Accuracy on dev after 7500 iterations: 0.4427
INFO:Entity Linker:Hierarchical Accuracy: 0.5305
INFO:Entity Linker:
==== Accuracy on test after 7500 iterations: 0.4394
INFO:Entity Linker:
=====Loss: 0.3630 Step: 7510 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 7520 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 7530 ======
INFO:Entity Linker:
=====Loss: 0.3688 Step: 7540 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 7550 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 7560 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 7570 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 7580 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 7590 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 7600 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 7610 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 7620 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 7630 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 7640 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 7650 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 7660 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 7670 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 7680 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 7690 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 7700 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 7710 ======
INFO:Entity Linker:
=====Loss: 0.3696 Step: 7720 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 7730 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 7740 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 7750 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 7760 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 7770 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 7780 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 7790 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 7800 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 7810 ======
one_epoch_time 218.61605620384216
INFO:Entity Linker:
=====Epoch Number: 11 =====
INFO:Entity Linker:
=====Loss: 0.3596 Step: 7820 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 7830 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 7840 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 7850 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 7860 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 7870 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 7880 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 7890 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 7900 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 7910 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 7920 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 7930 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 7940 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 7950 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 7960 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 7970 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 7980 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 7990 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 8000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5431
INFO:Entity Linker:
==== Accuracy on dev after 8000 iterations: 0.4482
INFO:Entity Linker:Hierarchical Accuracy: 0.5389
INFO:Entity Linker:
==== Accuracy on test after 8000 iterations: 0.4474
INFO:Entity Linker:
=====Loss: 0.3597 Step: 8010 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 8020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 8030 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 8040 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 8050 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 8060 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 8070 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 8080 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 8090 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8100 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 8110 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 8120 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 8130 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 8140 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 8150 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 8160 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 8170 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 8180 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 8190 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 8200 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 8210 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 8220 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 8230 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 8240 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 8250 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 8260 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 8270 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 8280 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 8290 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 8300 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 8310 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 8320 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 8330 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 8340 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 8350 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 8360 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8370 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 8380 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 8390 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 8400 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 8410 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 8420 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 8430 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8440 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 8450 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 8460 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 8470 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 8480 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 8490 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 8500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5449
INFO:Entity Linker:
==== Accuracy on dev after 8500 iterations: 0.4503
INFO:Entity Linker:Hierarchical Accuracy: 0.5420
INFO:Entity Linker:
==== Accuracy on test after 8500 iterations: 0.4508
INFO:Entity Linker:
=====Loss: 0.3647 Step: 8510 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 8520 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 8530 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 8540 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 8550 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 8560 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 8570 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 8580 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 8590 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 8600 ======
one_epoch_time 227.9536702632904
INFO:Entity Linker:
=====Epoch Number: 12 =====
INFO:Entity Linker:
=====Loss: 0.3641 Step: 8610 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 8620 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 8630 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 8640 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 8650 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 8660 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 8670 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 8680 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 8690 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 8700 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 8710 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 8720 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 8730 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 8740 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 8750 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 8760 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 8770 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 8780 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 8790 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 8800 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 8810 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 8820 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 8830 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 8840 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 8850 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 8860 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8870 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 8880 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 8890 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 8900 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 8910 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 8920 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 8930 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 8940 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 8950 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 8960 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 8970 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 8980 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 8990 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 9000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5395
INFO:Entity Linker:
==== Accuracy on dev after 9000 iterations: 0.4440
INFO:Entity Linker:
=====Loss: 0.3603 Step: 9010 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 9020 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 9030 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 9040 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 9050 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 9060 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 9070 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 9080 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 9090 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 9100 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 9110 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9120 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9130 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 9140 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 9150 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 9160 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 9170 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 9180 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 9190 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 9200 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 9210 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 9220 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 9230 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9240 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9250 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 9260 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 9270 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 9280 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 9290 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 9300 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 9310 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 9320 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9330 ======
INFO:Entity Linker:
=====Loss: 0.3692 Step: 9340 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 9350 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 9360 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 9370 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9380 ======
one_epoch_time 216.11140298843384
INFO:Entity Linker:
=====Epoch Number: 13 =====
INFO:Entity Linker:
=====Loss: 0.3610 Step: 9390 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9400 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 9410 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9420 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 9430 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 9440 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9450 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 9460 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 9470 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9480 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 9490 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5527
INFO:Entity Linker:
==== Accuracy on dev after 9500 iterations: 0.4571
INFO:Entity Linker:Hierarchical Accuracy: 0.5477
INFO:Entity Linker:
==== Accuracy on test after 9500 iterations: 0.4568
INFO:Entity Linker:
=====Loss: 0.3661 Step: 9510 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 9520 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9530 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9540 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 9550 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9560 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 9570 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9580 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 9590 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 9600 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 9610 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9620 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9630 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 9640 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 9650 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 9660 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9670 ======
INFO:Entity Linker:
=====Loss: 0.3697 Step: 9680 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 9690 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 9700 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 9710 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 9720 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 9730 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 9740 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 9750 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 9760 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 9770 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9780 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 9790 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 9800 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 9810 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9820 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 9830 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 9840 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9850 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 9860 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9870 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9880 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 9890 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 9900 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 9910 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 9920 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 9930 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 9940 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 9950 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 9960 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 9970 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 9980 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 9990 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 10000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5540
INFO:Entity Linker:
==== Accuracy on dev after 10000 iterations: 0.4592
INFO:Entity Linker:Hierarchical Accuracy: 0.5502
INFO:Entity Linker:
==== Accuracy on test after 10000 iterations: 0.4605
INFO:Entity Linker:
=====Loss: 0.3668 Step: 10010 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 10020 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 10030 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 10040 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 10050 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 10060 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 10070 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 10080 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10090 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 10100 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 10110 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 10120 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 10130 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 10140 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 10150 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 10160 ======
one_epoch_time 228.0930585861206
INFO:Entity Linker:
=====Epoch Number: 14 =====
INFO:Entity Linker:
=====Loss: 0.3636 Step: 10170 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 10180 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 10190 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 10200 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 10210 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 10220 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 10230 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 10240 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 10250 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 10260 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 10270 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 10280 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 10290 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 10300 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 10310 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 10320 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 10330 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 10340 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 10350 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 10360 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 10370 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 10380 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 10390 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 10400 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 10410 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 10420 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 10430 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 10440 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 10450 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 10460 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10470 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 10480 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10490 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 10500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5547
INFO:Entity Linker:
==== Accuracy on dev after 10500 iterations: 0.4611
INFO:Entity Linker:Hierarchical Accuracy: 0.5554
INFO:Entity Linker:
==== Accuracy on test after 10500 iterations: 0.4637
INFO:Entity Linker:
=====Loss: 0.3625 Step: 10510 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 10520 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 10530 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 10540 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 10550 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 10560 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 10570 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 10580 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 10590 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 10600 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 10610 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 10620 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 10630 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 10640 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 10650 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 10660 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 10670 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 10680 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 10690 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 10700 ======
INFO:Entity Linker:
=====Loss: 0.3714 Step: 10710 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 10720 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 10730 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 10740 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 10750 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 10760 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 10770 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 10780 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 10790 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 10800 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 10810 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 10820 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 10830 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 10840 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 10850 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 10860 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 10870 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 10880 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 10890 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 10900 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 10910 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 10920 ======
INFO:Entity Linker:
=====Loss: 0.3722 Step: 10930 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 10940 ======
one_epoch_time 221.8712339401245
INFO:Entity Linker:
=====Epoch Number: 15 =====
INFO:Entity Linker:
=====Loss: 0.3627 Step: 10950 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10960 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 10970 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 10980 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 10990 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 11000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5325
INFO:Entity Linker:
==== Accuracy on dev after 11000 iterations: 0.4361
INFO:Entity Linker:
=====Loss: 0.3650 Step: 11010 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11020 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 11030 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 11040 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 11050 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 11060 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 11070 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 11080 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 11090 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11100 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 11110 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 11120 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 11130 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 11140 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11150 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 11160 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11170 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 11180 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 11190 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 11200 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 11210 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 11220 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 11230 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 11240 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 11250 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 11260 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 11270 ======
INFO:Entity Linker:
=====Loss: 0.3726 Step: 11280 ======
INFO:Entity Linker:
=====Loss: 0.3682 Step: 11290 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 11300 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 11310 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 11320 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 11330 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 11340 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 11350 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 11360 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11370 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 11380 ======
INFO:Entity Linker:
=====Loss: 0.3697 Step: 11390 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 11400 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 11410 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 11420 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 11430 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 11440 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 11450 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11460 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 11470 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 11480 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 11490 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 11500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5643
INFO:Entity Linker:
==== Accuracy on dev after 11500 iterations: 0.4695
INFO:Entity Linker:Hierarchical Accuracy: 0.5583
INFO:Entity Linker:
==== Accuracy on test after 11500 iterations: 0.4667
INFO:Entity Linker:
=====Loss: 0.3600 Step: 11510 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 11520 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 11530 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11540 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 11550 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 11560 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11570 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11580 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11590 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 11600 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 11610 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 11620 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 11630 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 11640 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 11650 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 11660 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 11670 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11680 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 11690 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11700 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 11710 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11720 ======
one_epoch_time 218.03969073295593
INFO:Entity Linker:
=====Epoch Number: 16 =====
INFO:Entity Linker:
=====Loss: 0.3608 Step: 11730 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 11740 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 11750 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 11760 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 11770 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 11780 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 11790 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 11800 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 11810 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 11820 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 11830 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11840 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 11850 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 11860 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11870 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11880 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 11890 ======
INFO:Entity Linker:
=====Loss: 0.3682 Step: 11900 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 11910 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 11920 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 11930 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11940 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 11950 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 11960 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 11970 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 11980 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11990 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 12000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5638
INFO:Entity Linker:
==== Accuracy on dev after 12000 iterations: 0.4680
INFO:Entity Linker:
=====Loss: 0.3605 Step: 12010 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 12020 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 12030 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 12040 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 12050 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 12060 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 12070 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 12080 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 12090 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 12100 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 12110 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 12120 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12130 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 12140 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 12150 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 12160 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12170 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 12180 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 12190 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12200 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 12210 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 12220 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 12230 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 12240 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 12250 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 12260 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 12270 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 12280 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 12290 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 12300 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 12310 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 12320 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 12330 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 12340 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 12350 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 12360 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 12370 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 12380 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 12390 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12400 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 12410 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 12420 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 12430 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12440 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 12450 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 12460 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 12470 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 12480 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 12490 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 12500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5664
INFO:Entity Linker:
==== Accuracy on dev after 12500 iterations: 0.4696
INFO:Entity Linker:Hierarchical Accuracy: 0.5646
INFO:Entity Linker:
==== Accuracy on test after 12500 iterations: 0.4727
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12510 ======
one_epoch_time 180.81734919548035
INFO:Entity Linker:
=====Epoch Number: 17 =====
INFO:Entity Linker:
=====Loss: 0.3639 Step: 12520 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 12530 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 12540 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 12550 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 12560 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 12570 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 12580 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 12590 ======
INFO:Entity Linker:
=====Loss: 0.3694 Step: 12600 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12610 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 12620 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 12630 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 12640 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 12650 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 12660 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 12670 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 12680 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12690 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12700 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 12710 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 12720 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 12730 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 12740 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 12750 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 12760 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 12770 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12780 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 12790 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 12800 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12810 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12820 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 12830 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 12840 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 12850 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 12860 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 12870 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12880 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 12890 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 12900 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 12910 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 12920 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 12930 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12940 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 12950 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 12960 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 12970 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 12980 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 12990 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5679
INFO:Entity Linker:
==== Accuracy on dev after 13000 iterations: 0.4718
INFO:Entity Linker:Hierarchical Accuracy: 0.5649
INFO:Entity Linker:
==== Accuracy on test after 13000 iterations: 0.4734
INFO:Entity Linker:
=====Loss: 0.3610 Step: 13010 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 13020 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 13030 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 13040 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 13050 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 13060 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 13070 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 13080 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 13090 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 13100 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13110 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 13120 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 13130 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 13140 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13150 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 13160 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 13170 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13180 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 13190 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 13200 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 13210 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 13220 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 13230 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 13240 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 13250 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 13260 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13270 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 13280 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 13290 ======
one_epoch_time 178.2151701450348
INFO:Entity Linker:
=====Epoch Number: 18 =====
INFO:Entity Linker:
=====Loss: 0.3603 Step: 13300 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 13310 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 13320 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 13330 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13340 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 13350 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 13360 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13370 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 13380 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 13390 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 13400 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 13410 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 13420 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13430 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 13440 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 13450 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 13460 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 13470 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 13480 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13490 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 13500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5619
INFO:Entity Linker:
==== Accuracy on dev after 13500 iterations: 0.4645
INFO:Entity Linker:
=====Loss: 0.3642 Step: 13510 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 13520 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 13530 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13540 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 13550 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 13560 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13570 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 13580 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 13590 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 13600 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 13610 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 13620 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 13630 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 13640 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 13650 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13660 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 13670 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 13680 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 13690 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 13700 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13710 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 13720 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 13730 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 13740 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 13750 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13760 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 13770 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 13780 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 13790 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 13800 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 13810 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 13820 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 13830 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 13840 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 13850 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 13860 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 13870 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 13880 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 13890 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 13900 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 13910 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 13920 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 13930 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 13940 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 13950 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 13960 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 13970 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 13980 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 13990 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 14000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5671
INFO:Entity Linker:
==== Accuracy on dev after 14000 iterations: 0.4711
INFO:Entity Linker:
=====Loss: 0.3601 Step: 14010 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 14020 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14030 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14040 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 14050 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14060 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 14070 ======
one_epoch_time 185.53165459632874
INFO:Entity Linker:
=====Epoch Number: 19 =====
INFO:Entity Linker:
=====Loss: 0.3624 Step: 14080 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 14090 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 14100 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 14110 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 14120 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 14130 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14140 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 14150 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 14160 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 14170 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14180 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 14190 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 14200 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 14210 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 14220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 14230 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14240 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 14250 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 14260 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 14270 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 14280 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 14290 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 14300 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 14310 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 14320 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14330 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 14340 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 14350 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 14360 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 14370 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14380 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14390 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 14400 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 14410 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 14420 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 14430 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 14440 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 14450 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14460 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 14470 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14480 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 14490 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5703
INFO:Entity Linker:
==== Accuracy on dev after 14500 iterations: 0.4743
INFO:Entity Linker:Hierarchical Accuracy: 0.5661
INFO:Entity Linker:
==== Accuracy on test after 14500 iterations: 0.4749
INFO:Entity Linker:
=====Loss: 0.3646 Step: 14510 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 14520 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 14530 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 14540 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 14550 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14560 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14570 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 14580 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 14590 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14600 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 14610 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 14620 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 14630 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 14640 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 14650 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 14660 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 14670 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14680 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 14690 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 14700 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 14710 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 14720 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 14730 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 14740 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 14750 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 14760 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 14770 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 14780 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 14790 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 14800 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 14810 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14820 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 14830 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 14840 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 14850 ======
one_epoch_time 211.79520654678345
INFO:Entity Linker:
=====Epoch Number: 20 =====
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14860 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14870 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14880 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 14890 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 14900 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 14910 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 14920 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 14930 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 14940 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 14950 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 14960 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14970 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 14980 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14990 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 15000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5707
INFO:Entity Linker:
==== Accuracy on dev after 15000 iterations: 0.4746
INFO:Entity Linker:Hierarchical Accuracy: 0.5676
INFO:Entity Linker:
==== Accuracy on test after 15000 iterations: 0.4764
INFO:Entity Linker:
=====Loss: 0.3611 Step: 15010 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 15020 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 15030 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 15040 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 15050 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 15060 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 15070 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 15080 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 15090 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 15100 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 15110 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 15120 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15130 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 15140 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 15150 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 15160 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 15170 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 15180 ======
INFO:Entity Linker:
=====Loss: 0.3699 Step: 15190 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 15200 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15210 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15220 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15230 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 15240 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 15250 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15260 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15270 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 15280 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 15290 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 15300 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15310 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 15320 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 15330 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 15340 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 15350 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 15360 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 15370 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 15380 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15390 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 15400 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 15410 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 15420 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 15430 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15440 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 15450 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 15460 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 15470 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 15480 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 15490 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5706
INFO:Entity Linker:
==== Accuracy on dev after 15500 iterations: 0.4767
INFO:Entity Linker:Hierarchical Accuracy: 0.5697
INFO:Entity Linker:
==== Accuracy on test after 15500 iterations: 0.4795
INFO:Entity Linker:
=====Loss: 0.3593 Step: 15510 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 15520 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 15530 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 15540 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15550 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 15560 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 15570 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 15580 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 15590 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15600 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15610 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 15620 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15630 ======
one_epoch_time 219.25718235969543
INFO:Entity Linker:
=====Epoch Number: 21 =====
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15640 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 15650 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15660 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 15670 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 15680 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 15690 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 15700 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 15710 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 15720 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 15730 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 15740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 15750 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 15760 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15770 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15780 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 15790 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 15800 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 15810 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 15820 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 15830 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 15840 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 15850 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 15860 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 15870 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15880 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15890 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 15900 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 15910 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15920 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 15930 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15940 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 15950 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 15960 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 15970 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 15980 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 15990 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 16000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5769
INFO:Entity Linker:
==== Accuracy on dev after 16000 iterations: 0.4819
INFO:Entity Linker:Hierarchical Accuracy: 0.5759
INFO:Entity Linker:
==== Accuracy on test after 16000 iterations: 0.4845
INFO:Entity Linker:
=====Loss: 0.3650 Step: 16010 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 16020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 16030 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 16040 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 16050 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 16060 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 16070 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 16080 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 16090 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 16100 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 16110 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 16120 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 16130 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 16140 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 16150 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 16160 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 16170 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 16180 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 16190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 16200 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16210 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16220 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 16230 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16240 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 16250 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 16260 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 16270 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 16280 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 16290 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 16300 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 16310 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 16320 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 16330 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 16340 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 16350 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 16360 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 16370 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 16380 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16390 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 16400 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 16410 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 16420 ======
one_epoch_time 207.2360701560974
INFO:Entity Linker:
=====Epoch Number: 22 =====
INFO:Entity Linker:
=====Loss: 0.3626 Step: 16430 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 16440 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 16450 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16460 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 16470 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 16480 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16490 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 16500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5733
INFO:Entity Linker:
==== Accuracy on dev after 16500 iterations: 0.4778
INFO:Entity Linker:
=====Loss: 0.3676 Step: 16510 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16520 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 16530 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 16540 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 16550 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 16560 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 16570 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 16580 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 16590 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16600 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 16610 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 16620 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 16630 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 16640 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 16650 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 16660 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 16670 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16680 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 16690 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 16700 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 16710 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 16720 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16730 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 16740 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 16750 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16760 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 16770 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 16780 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 16790 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 16800 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 16810 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 16820 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 16830 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 16840 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 16850 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 16860 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 16870 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 16880 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 16890 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 16900 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 16910 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16920 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 16930 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 16940 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 16950 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 16960 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 16970 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16980 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 16990 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5750
INFO:Entity Linker:
==== Accuracy on dev after 17000 iterations: 0.4782
INFO:Entity Linker:
=====Loss: 0.3581 Step: 17010 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 17020 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 17030 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 17040 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 17050 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 17060 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 17070 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 17080 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17090 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 17100 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 17110 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 17120 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17130 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 17140 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17150 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 17160 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 17170 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17180 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 17190 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 17200 ======
one_epoch_time 218.98427820205688
INFO:Entity Linker:
=====Epoch Number: 23 =====
INFO:Entity Linker:
=====Loss: 0.3588 Step: 17210 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 17220 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 17230 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 17240 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 17250 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 17260 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17270 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17280 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 17290 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 17300 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 17310 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 17320 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 17330 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 17340 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 17350 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 17360 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17370 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17380 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 17390 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 17400 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 17410 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 17420 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 17430 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 17440 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17450 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 17460 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 17470 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 17480 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 17490 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 17500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5789
INFO:Entity Linker:
==== Accuracy on dev after 17500 iterations: 0.4843
INFO:Entity Linker:Hierarchical Accuracy: 0.5797
INFO:Entity Linker:
==== Accuracy on test after 17500 iterations: 0.4899
INFO:Entity Linker:
=====Loss: 0.3583 Step: 17510 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 17520 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 17530 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 17540 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17550 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17560 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 17570 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 17580 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17590 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 17600 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 17610 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17620 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 17630 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 17640 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 17650 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 17660 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 17670 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 17680 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 17690 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17700 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 17720 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 17730 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 17740 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17750 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 17760 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 17770 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17780 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17790 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 17800 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 17810 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 17820 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 17830 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 17840 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 17850 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 17860 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 17870 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 17880 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 17890 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 17900 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 17910 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 17920 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 17930 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 17940 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 17950 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17960 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17970 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 17980 ======
one_epoch_time 209.18358635902405
INFO:Entity Linker:
=====Epoch Number: 24 =====
INFO:Entity Linker:
=====Loss: 0.3617 Step: 17990 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5763
INFO:Entity Linker:
==== Accuracy on dev after 18000 iterations: 0.4815
INFO:Entity Linker:
=====Loss: 0.3618 Step: 18010 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 18020 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 18030 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 18040 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 18050 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 18060 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 18070 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 18080 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 18090 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 18100 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 18110 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 18120 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 18130 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 18140 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 18150 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 18160 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 18170 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18180 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 18190 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 18200 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 18210 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 18220 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18230 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 18240 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 18250 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 18260 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18270 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 18280 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 18290 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18300 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 18310 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 18320 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 18330 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 18340 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 18350 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 18360 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 18370 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 18380 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 18390 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 18400 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 18410 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 18420 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 18430 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18440 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 18450 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 18460 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 18470 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 18480 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 18490 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 18500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5783
INFO:Entity Linker:
==== Accuracy on dev after 18500 iterations: 0.4830
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18510 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 18520 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 18530 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 18540 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 18550 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 18560 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 18570 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 18580 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 18590 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18600 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 18610 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 18620 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 18630 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 18640 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18650 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 18660 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 18670 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 18680 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 18690 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 18700 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 18710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 18720 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 18730 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 18740 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 18750 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 18760 ======
one_epoch_time 217.4662115573883
INFO:Entity Linker:
=====Epoch Number: 25 =====
INFO:Entity Linker:
=====Loss: 0.3582 Step: 18770 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18780 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18790 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 18800 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 18810 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 18820 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 18830 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 18840 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 18850 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 18860 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 18870 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 18880 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 18890 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 18900 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 18910 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 18920 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 18930 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 18940 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18950 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 18960 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 18970 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 18980 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 18990 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 19000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5807
INFO:Entity Linker:
==== Accuracy on dev after 19000 iterations: 0.4841
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19010 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 19020 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 19030 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 19040 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 19050 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 19060 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 19070 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 19080 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 19090 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 19100 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 19110 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19120 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19130 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 19140 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 19150 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 19160 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 19170 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 19180 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 19190 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 19200 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 19210 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 19220 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 19230 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 19240 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 19250 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 19260 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 19270 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 19280 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 19290 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 19300 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 19310 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19320 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 19330 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 19340 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 19350 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 19360 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 19370 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 19380 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 19390 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19400 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 19410 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 19420 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 19430 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 19440 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 19450 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 19460 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 19470 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 19480 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 19490 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5769
INFO:Entity Linker:
==== Accuracy on dev after 19500 iterations: 0.4799
INFO:Entity Linker:
=====Loss: 0.3593 Step: 19510 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 19520 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19530 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 19540 ======
one_epoch_time 223.56800842285156
INFO:Entity Linker:
=====Epoch Number: 26 =====
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19550 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 19560 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 19570 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 19580 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 19590 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 19600 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19610 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 19620 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 19630 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 19640 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19650 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 19660 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 19670 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 19680 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 19690 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19700 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 19710 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 19720 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 19730 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 19740 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 19750 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 19760 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 19770 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19780 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19790 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 19800 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 19810 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 19820 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19830 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 19840 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19850 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 19860 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 19870 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 19880 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 19890 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 19900 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 19910 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 19920 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 19930 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 19940 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 19950 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19960 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 19970 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19980 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 19990 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5770
INFO:Entity Linker:
==== Accuracy on dev after 20000 iterations: 0.4832
INFO:Entity Linker:
=====Loss: 0.3594 Step: 20010 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20020 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20030 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 20040 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 20050 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 20060 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 20070 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 20080 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 20090 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 20100 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 20110 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 20120 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20130 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 20140 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 20150 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 20160 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 20170 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 20180 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 20190 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 20200 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 20210 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 20220 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 20230 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 20240 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 20250 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 20260 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 20270 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 20280 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 20290 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 20300 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20310 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 20320 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 20330 ======
one_epoch_time 214.35574102401733
INFO:Entity Linker:
=====Epoch Number: 27 =====
INFO:Entity Linker:
=====Loss: 0.3626 Step: 20340 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 20350 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20360 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 20370 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 20380 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 20390 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 20400 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 20410 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 20420 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20430 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 20440 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 20450 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20460 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 20470 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 20480 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 20490 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 20500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5806
INFO:Entity Linker:
==== Accuracy on dev after 20500 iterations: 0.4844
INFO:Entity Linker:Hierarchical Accuracy: 0.5772
INFO:Entity Linker:
==== Accuracy on test after 20500 iterations: 0.4876
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20510 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 20520 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 20530 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20540 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 20550 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 20560 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 20570 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20580 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 20590 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 20600 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 20610 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 20620 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20630 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 20640 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 20650 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 20660 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 20670 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 20680 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 20690 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 20700 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 20710 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 20720 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20730 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 20750 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20760 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 20770 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 20780 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20790 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 20800 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 20810 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 20820 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20830 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 20840 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 20850 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20860 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20870 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 20880 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 20890 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 20900 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 20910 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20920 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 20930 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 20940 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20950 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 20960 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 20970 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 20980 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20990 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5803
INFO:Entity Linker:
==== Accuracy on dev after 21000 iterations: 0.4845
INFO:Entity Linker:Hierarchical Accuracy: 0.5823
INFO:Entity Linker:
==== Accuracy on test after 21000 iterations: 0.4926
INFO:Entity Linker:
=====Loss: 0.3592 Step: 21010 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 21020 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 21030 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 21040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 21050 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 21060 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 21070 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 21080 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 21090 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 21100 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21110 ======
one_epoch_time 230.2123475074768
INFO:Entity Linker:
=====Epoch Number: 28 =====
INFO:Entity Linker:
=====Loss: 0.3590 Step: 21120 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 21130 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21140 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 21150 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 21160 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 21170 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 21180 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 21190 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 21200 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 21210 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 21220 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 21230 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21240 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 21250 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 21260 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 21270 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 21280 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 21290 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21300 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21310 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 21320 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 21330 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 21340 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 21350 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21360 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 21370 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 21380 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21390 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 21400 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 21410 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 21420 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 21430 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 21440 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 21450 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 21460 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 21470 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 21480 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 21490 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5786
INFO:Entity Linker:
==== Accuracy on dev after 21500 iterations: 0.4848
INFO:Entity Linker:Hierarchical Accuracy: 0.5838
INFO:Entity Linker:
==== Accuracy on test after 21500 iterations: 0.4933
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21510 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 21520 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 21530 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21540 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 21550 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 21560 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 21570 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 21580 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 21590 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 21600 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 21610 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 21620 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 21630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 21640 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 21650 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 21660 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 21670 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 21680 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 21690 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 21700 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 21710 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 21720 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 21730 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 21740 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 21750 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 21760 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 21770 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 21780 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 21790 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21800 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 21810 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 21820 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 21830 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 21840 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 21850 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 21860 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 21870 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21880 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 21890 ======
one_epoch_time 224.6108148097992
INFO:Entity Linker:
=====Epoch Number: 29 =====
INFO:Entity Linker:
=====Loss: 0.3608 Step: 21900 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 21910 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 21920 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 21940 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 21950 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 21960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21970 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 21980 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21990 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 22000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5817
INFO:Entity Linker:
==== Accuracy on dev after 22000 iterations: 0.4852
INFO:Entity Linker:Hierarchical Accuracy: 0.5828
INFO:Entity Linker:
==== Accuracy on test after 22000 iterations: 0.4913
INFO:Entity Linker:
=====Loss: 0.3631 Step: 22010 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 22020 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 22030 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 22040 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 22050 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 22060 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 22070 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 22080 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 22090 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 22100 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22110 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 22120 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 22130 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 22140 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22150 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 22160 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22170 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 22180 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 22190 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 22200 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 22210 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 22220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22230 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 22240 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 22250 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 22260 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 22270 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22280 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 22290 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 22300 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 22310 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 22320 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 22330 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 22340 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 22350 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 22360 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 22370 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 22380 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 22390 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 22400 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 22410 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 22420 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22430 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 22440 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 22450 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 22460 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 22470 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 22480 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 22490 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 22500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5855
INFO:Entity Linker:
==== Accuracy on dev after 22500 iterations: 0.4909
INFO:Entity Linker:Hierarchical Accuracy: 0.5849
INFO:Entity Linker:
==== Accuracy on test after 22500 iterations: 0.4947
INFO:Entity Linker:
=====Loss: 0.3584 Step: 22510 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 22520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 22530 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 22540 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 22550 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 22560 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 22570 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22580 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22590 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 22600 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 22610 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 22620 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 22630 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 22640 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 22650 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 22660 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 22670 ======
one_epoch_time 208.45689249038696
INFO:Entity Linker:
=====Epoch Number: 30 =====
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22680 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 22690 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22700 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 22710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 22720 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 22730 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 22740 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 22750 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 22760 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 22770 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 22780 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 22790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 22800 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 22810 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 22820 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22830 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 22840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 22850 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22860 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 22870 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22880 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 22890 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 22900 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22910 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22920 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 22930 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 22940 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 22950 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22960 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 22970 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 22980 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 22990 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5849
INFO:Entity Linker:
==== Accuracy on dev after 23000 iterations: 0.4903
INFO:Entity Linker:
=====Loss: 0.3651 Step: 23010 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 23020 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 23030 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23040 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23050 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23060 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 23070 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23080 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 23090 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23100 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 23110 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 23120 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23130 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 23140 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 23150 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 23160 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 23170 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 23180 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 23190 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23200 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 23210 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 23220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 23230 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 23240 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 23250 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23260 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 23270 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23280 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 23290 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 23300 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 23310 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23320 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 23330 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 23340 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 23350 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 23360 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 23370 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 23380 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 23390 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 23400 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 23410 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23420 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23430 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 23440 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23450 ======
one_epoch_time 174.85696864128113
INFO:Entity Linker:
=====Epoch Number: 31 =====
INFO:Entity Linker:
=====Loss: 0.3579 Step: 23460 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 23470 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 23480 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 23490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5864
INFO:Entity Linker:
==== Accuracy on dev after 23500 iterations: 0.4907
INFO:Entity Linker:
=====Loss: 0.3583 Step: 23510 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 23520 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 23530 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23540 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 23550 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 23560 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 23570 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 23580 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 23590 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23600 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 23610 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 23620 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 23630 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23640 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 23650 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23660 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 23670 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 23680 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 23690 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 23700 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 23710 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 23720 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23730 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 23740 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 23750 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 23760 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 23770 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 23780 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 23790 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23800 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23810 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 23820 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 23830 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23840 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 23850 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 23860 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 23870 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 23880 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23890 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 23900 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 23910 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23920 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 23930 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 23940 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 23950 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 23960 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 23970 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23980 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23990 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 24000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5826
INFO:Entity Linker:
==== Accuracy on dev after 24000 iterations: 0.4879
INFO:Entity Linker:
=====Loss: 0.3578 Step: 24010 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 24020 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 24030 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 24040 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 24050 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 24060 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 24070 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24080 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 24090 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 24100 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 24110 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 24120 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 24130 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 24140 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 24150 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 24160 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 24170 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 24180 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 24190 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 24200 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 24210 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24220 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24230 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 24240 ======
one_epoch_time 177.99996304512024
INFO:Entity Linker:
=====Epoch Number: 32 =====
INFO:Entity Linker:
=====Loss: 0.3607 Step: 24250 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 24260 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24270 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 24280 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24290 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 24300 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 24310 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 24320 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 24330 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 24340 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 24350 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24360 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 24370 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24380 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 24390 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 24400 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 24410 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 24420 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 24430 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24440 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24450 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 24460 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 24470 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24480 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 24490 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 24500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5854
INFO:Entity Linker:
==== Accuracy on dev after 24500 iterations: 0.4908
INFO:Entity Linker:
=====Loss: 0.3595 Step: 24510 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 24520 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 24530 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24540 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 24550 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 24560 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 24570 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 24580 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24590 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 24600 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 24610 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 24620 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 24630 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24640 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 24650 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 24660 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 24670 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 24680 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 24690 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 24700 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 24710 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24720 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 24730 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 24740 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 24750 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24760 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 24770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 24780 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 24790 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 24800 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24810 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 24820 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 24830 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24840 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 24850 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 24860 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 24870 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24880 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 24890 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24900 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 24910 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24920 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 24930 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 24940 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 24950 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 24960 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24970 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 24980 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24990 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 25000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5862
INFO:Entity Linker:
==== Accuracy on dev after 25000 iterations: 0.4932
INFO:Entity Linker:Hierarchical Accuracy: 0.5850
INFO:Entity Linker:
==== Accuracy on test after 25000 iterations: 0.4962
INFO:Entity Linker:
=====Loss: 0.3629 Step: 25010 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 25020 ======
one_epoch_time 185.77836418151855
INFO:Entity Linker:
=====Epoch Number: 33 =====
INFO:Entity Linker:
=====Loss: 0.3569 Step: 25030 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 25040 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 25050 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 25060 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 25070 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 25080 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 25090 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25100 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25110 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 25120 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 25130 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 25140 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25150 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 25160 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 25170 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 25180 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25190 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 25200 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 25210 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25220 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 25230 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 25240 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 25250 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 25260 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 25270 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 25280 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 25290 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25300 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 25310 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 25320 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 25330 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 25340 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 25350 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 25360 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 25370 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 25380 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 25390 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 25400 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25410 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 25420 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 25430 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 25440 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 25450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25460 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 25470 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 25480 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25490 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 25500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5872
INFO:Entity Linker:
==== Accuracy on dev after 25500 iterations: 0.4935
INFO:Entity Linker:Hierarchical Accuracy: 0.5865
INFO:Entity Linker:
==== Accuracy on test after 25500 iterations: 0.4960
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25510 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 25520 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 25530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25540 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25550 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 25560 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 25570 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 25580 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 25590 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 25600 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25610 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 25620 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 25630 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 25640 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25650 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 25660 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 25670 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 25680 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 25690 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 25700 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 25710 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 25720 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 25730 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 25750 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 25760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 25770 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 25780 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 25790 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 25800 ======
one_epoch_time 191.4654152393341
INFO:Entity Linker:
=====Epoch Number: 34 =====
INFO:Entity Linker:
=====Loss: 0.3608 Step: 25810 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 25820 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 25830 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 25840 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 25850 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 25860 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 25870 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 25880 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 25890 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25900 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 25910 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 25920 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25930 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 25940 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25950 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 25960 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 25970 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 25980 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 25990 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 26000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5912
INFO:Entity Linker:
==== Accuracy on dev after 26000 iterations: 0.4963
INFO:Entity Linker:Hierarchical Accuracy: 0.5908
INFO:Entity Linker:
==== Accuracy on test after 26000 iterations: 0.5001
INFO:Entity Linker:
=====Loss: 0.3611 Step: 26010 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 26020 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 26030 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26040 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26050 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 26060 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 26070 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 26080 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 26090 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 26100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26110 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 26120 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26130 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26140 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26150 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 26160 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 26170 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 26180 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 26190 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26200 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 26210 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 26220 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 26230 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26240 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 26250 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 26260 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26270 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 26280 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 26290 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 26300 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 26310 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 26320 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 26330 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 26340 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 26350 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 26360 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26370 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 26380 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 26390 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 26400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 26410 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 26420 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 26430 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 26440 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26450 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 26460 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 26470 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 26480 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26490 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 26500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5814
INFO:Entity Linker:
==== Accuracy on dev after 26500 iterations: 0.4853
INFO:Entity Linker:
=====Loss: 0.3594 Step: 26510 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 26520 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 26530 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 26540 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26550 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 26560 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 26570 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 26580 ======
one_epoch_time 218.2602343559265
INFO:Entity Linker:
=====Epoch Number: 35 =====
INFO:Entity Linker:
=====Loss: 0.3581 Step: 26590 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 26600 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 26610 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 26620 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26630 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 26640 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26650 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 26660 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 26670 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 26680 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 26690 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 26700 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 26710 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 26720 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 26730 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 26740 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 26750 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 26760 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 26770 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 26780 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 26790 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 26800 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26810 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26820 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 26830 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 26840 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 26850 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 26860 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 26870 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 26880 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26890 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 26900 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 26910 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 26920 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 26930 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26940 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 26950 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 26960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 26970 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 26980 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26990 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5883
INFO:Entity Linker:
==== Accuracy on dev after 27000 iterations: 0.4958
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27010 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27020 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 27030 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 27040 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 27050 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 27060 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 27070 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 27080 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 27090 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27100 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 27110 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 27120 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 27130 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27140 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 27150 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 27160 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27170 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27180 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 27190 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 27200 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 27210 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 27220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27230 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 27240 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 27250 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 27260 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 27270 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 27280 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 27290 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 27300 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27310 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 27320 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 27330 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27340 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 27350 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 27360 ======
one_epoch_time 211.0336878299713
INFO:Entity Linker:
=====Epoch Number: 36 =====
INFO:Entity Linker:
=====Loss: 0.3584 Step: 27370 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 27380 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27390 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 27400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 27410 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 27420 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 27440 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 27450 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 27460 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 27470 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27480 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 27490 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5897
INFO:Entity Linker:
==== Accuracy on dev after 27500 iterations: 0.4931
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27510 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 27520 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27530 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 27540 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 27550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 27560 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27570 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 27580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 27590 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 27600 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27610 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 27620 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27630 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 27640 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 27650 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 27660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 27670 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 27680 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 27690 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 27700 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27710 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 27720 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27730 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 27740 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 27750 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 27760 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 27780 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 27790 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 27800 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 27810 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 27820 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 27830 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 27840 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27850 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 27860 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 27870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 27880 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 27890 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 27900 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 27910 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 27920 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 27930 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27940 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 27950 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 27960 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 27970 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 27980 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 27990 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5871
INFO:Entity Linker:
==== Accuracy on dev after 28000 iterations: 0.4925
INFO:Entity Linker:
=====Loss: 0.3608 Step: 28010 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 28020 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28030 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28040 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 28050 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 28060 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 28070 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 28080 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 28090 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 28100 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 28110 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 28120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28130 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 28140 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28150 ======
one_epoch_time 220.42527866363525
INFO:Entity Linker:
=====Epoch Number: 37 =====
INFO:Entity Linker:
=====Loss: 0.3593 Step: 28160 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 28170 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 28180 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 28190 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 28200 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 28210 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 28220 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 28230 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 28240 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 28250 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 28260 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 28270 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 28280 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 28290 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 28300 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 28310 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 28320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 28330 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 28340 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 28350 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 28360 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 28370 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 28380 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 28390 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 28400 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 28410 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 28420 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 28430 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 28440 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 28450 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 28460 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28470 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 28480 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 28490 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 28500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5909
INFO:Entity Linker:
==== Accuracy on dev after 28500 iterations: 0.4964
INFO:Entity Linker:Hierarchical Accuracy: 0.5918
INFO:Entity Linker:
==== Accuracy on test after 28500 iterations: 0.5030
INFO:Entity Linker:
=====Loss: 0.3554 Step: 28510 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28520 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 28530 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 28540 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28550 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 28560 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 28570 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 28580 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 28590 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28600 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 28610 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28620 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 28630 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 28640 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28650 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 28660 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 28670 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 28680 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 28690 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 28700 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 28710 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28720 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28730 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 28740 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 28750 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 28760 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28780 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28790 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 28800 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 28810 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 28820 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 28830 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 28840 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 28850 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 28860 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 28870 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28880 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 28890 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 28900 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28910 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 28920 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28930 ======
one_epoch_time 222.23420643806458
INFO:Entity Linker:
=====Epoch Number: 38 =====
INFO:Entity Linker:
=====Loss: 0.3570 Step: 28940 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 28950 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28960 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 28970 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28980 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 28990 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 29000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5854
INFO:Entity Linker:
==== Accuracy on dev after 29000 iterations: 0.4898
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29010 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 29020 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 29030 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 29040 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 29050 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 29060 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 29070 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29080 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 29090 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 29100 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 29110 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 29120 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 29130 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 29140 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29150 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 29160 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 29170 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29180 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 29190 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 29200 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 29210 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 29220 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 29230 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 29240 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 29250 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 29260 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 29270 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 29280 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 29290 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 29300 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 29310 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 29320 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29330 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 29340 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29350 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 29360 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29370 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 29380 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 29390 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 29400 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 29410 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29420 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 29430 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 29440 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 29450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 29460 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 29470 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 29480 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 29490 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 29500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5884
INFO:Entity Linker:
==== Accuracy on dev after 29500 iterations: 0.4940
INFO:Entity Linker:
=====Loss: 0.3592 Step: 29510 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29520 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 29530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 29540 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 29550 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 29560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 29570 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 29580 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 29590 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29600 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29610 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29620 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 29630 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29640 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29650 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 29660 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 29670 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 29680 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 29690 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29700 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 29710 ======
one_epoch_time 200.61731386184692
INFO:Entity Linker:
=====Epoch Number: 39 =====
INFO:Entity Linker:
=====Loss: 0.3597 Step: 29720 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 29730 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 29740 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 29750 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 29760 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 29770 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 29780 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29790 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 29800 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 29810 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 29820 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 29830 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 29840 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 29850 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 29860 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29870 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29880 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 29890 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 29900 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29910 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 29920 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29930 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 29940 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29950 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 29960 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 29970 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29980 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 29990 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 30000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5892
INFO:Entity Linker:
==== Accuracy on dev after 30000 iterations: 0.4935
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30010 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 30020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 30030 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30040 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30050 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30060 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 30070 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 30080 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 30090 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 30100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 30110 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 30120 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30140 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 30150 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 30160 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 30170 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30180 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 30190 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30200 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 30210 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 30220 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30230 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30240 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 30250 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 30260 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 30270 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30280 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 30290 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 30300 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30310 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 30320 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30330 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 30340 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 30350 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30360 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 30370 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 30380 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 30390 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 30400 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 30410 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30420 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 30430 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 30440 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 30450 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30460 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 30470 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 30480 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 30490 ======
one_epoch_time 174.88196468353271
INFO:Entity Linker:
=====Epoch Number: 40 =====
INFO:Entity Linker:
=====Loss: 0.3568 Step: 30500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5901
INFO:Entity Linker:
==== Accuracy on dev after 30500 iterations: 0.4961
INFO:Entity Linker:
=====Loss: 0.3591 Step: 30510 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30520 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 30530 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30540 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 30550 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 30560 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 30570 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 30580 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 30590 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 30600 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30610 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 30620 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 30630 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 30640 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 30650 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 30660 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30670 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 30680 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 30690 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30700 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 30710 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 30720 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 30730 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 30740 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 30750 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 30760 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 30770 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30780 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 30790 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 30800 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30810 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 30820 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 30830 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 30840 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30850 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 30860 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 30870 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 30880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 30890 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30900 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30910 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30920 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30930 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 30940 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 30950 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 30960 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 30970 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 30980 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30990 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 31000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5897
INFO:Entity Linker:
==== Accuracy on dev after 31000 iterations: 0.4932
INFO:Entity Linker:
=====Loss: 0.3567 Step: 31010 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 31020 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31030 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 31040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 31050 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 31060 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 31070 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31080 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 31090 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 31100 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 31110 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 31130 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 31140 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 31150 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31160 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31170 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 31180 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 31190 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 31200 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 31210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 31220 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 31230 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31240 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31250 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 31260 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 31270 ======
one_epoch_time 179.48860955238342
INFO:Entity Linker:
=====Epoch Number: 41 =====
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31280 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31290 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 31300 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 31310 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 31320 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31330 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 31340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 31350 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 31360 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 31370 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 31380 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31390 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 31400 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 31410 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 31420 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31430 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 31440 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 31450 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31460 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31470 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 31480 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 31490 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 31500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5890
INFO:Entity Linker:
==== Accuracy on dev after 31500 iterations: 0.4951
INFO:Entity Linker:
=====Loss: 0.3570 Step: 31510 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 31520 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31530 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 31540 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 31550 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31560 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 31570 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31580 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 31590 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 31600 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 31610 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 31620 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 31630 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 31640 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 31650 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 31670 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 31680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31690 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 31700 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 31720 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 31730 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 31740 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 31750 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31760 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31770 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 31780 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31790 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 31800 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 31810 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 31820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 31830 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 31840 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 31850 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 31860 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 31870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 31880 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 31890 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 31900 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 31910 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 31920 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 31930 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31940 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 31950 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 31960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 31970 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 31980 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 31990 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 32000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5919
INFO:Entity Linker:
==== Accuracy on dev after 32000 iterations: 0.4965
INFO:Entity Linker:Hierarchical Accuracy: 0.5908
INFO:Entity Linker:
==== Accuracy on test after 32000 iterations: 0.5033
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32010 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 32020 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32030 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32050 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 32060 ======
one_epoch_time 184.97631216049194
INFO:Entity Linker:
=====Epoch Number: 42 =====
INFO:Entity Linker:
=====Loss: 0.3589 Step: 32070 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 32080 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 32090 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32100 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32120 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32130 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32140 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 32150 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32160 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 32170 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32180 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 32190 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 32200 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 32210 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 32220 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 32230 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 32240 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 32250 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 32260 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 32270 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 32280 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 32290 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 32300 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 32310 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 32320 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32330 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 32340 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 32350 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 32360 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32370 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 32380 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 32390 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 32400 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 32410 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 32420 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 32430 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 32440 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 32450 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 32460 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 32470 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32480 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 32490 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 32500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5919
INFO:Entity Linker:
==== Accuracy on dev after 32500 iterations: 0.4963
INFO:Entity Linker:
=====Loss: 0.3575 Step: 32510 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 32520 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 32530 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 32540 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 32550 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32560 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 32570 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 32580 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 32590 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 32600 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32610 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 32620 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 32630 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 32640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 32650 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 32660 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 32670 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32680 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 32690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32700 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 32710 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32720 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 32730 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32740 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32750 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 32760 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 32770 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32780 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32790 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 32800 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32810 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 32820 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 32830 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32840 ======
one_epoch_time 209.2925670146942
INFO:Entity Linker:
=====Epoch Number: 43 =====
INFO:Entity Linker:
=====Loss: 0.3577 Step: 32850 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 32860 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32870 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 32880 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 32890 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 32900 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32910 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32920 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 32930 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32940 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32950 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 32960 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 32970 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 32980 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 32990 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5898
INFO:Entity Linker:
==== Accuracy on dev after 33000 iterations: 0.4929
INFO:Entity Linker:
=====Loss: 0.3599 Step: 33010 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 33020 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33030 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33040 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 33050 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 33060 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 33070 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33080 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 33090 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33100 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 33110 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33120 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 33130 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 33140 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 33150 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33160 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 33170 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33180 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 33190 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33200 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 33210 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 33220 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33230 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33240 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 33250 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33260 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 33270 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33280 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33290 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33300 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33310 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33320 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 33330 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 33340 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 33350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 33360 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 33370 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33380 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 33390 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 33400 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 33410 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33420 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33430 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 33440 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 33450 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 33460 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 33470 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 33480 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 33490 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 33500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5941
INFO:Entity Linker:
==== Accuracy on dev after 33500 iterations: 0.5001
INFO:Entity Linker:Hierarchical Accuracy: 0.5946
INFO:Entity Linker:
==== Accuracy on test after 33500 iterations: 0.5056
INFO:Entity Linker:
=====Loss: 0.3561 Step: 33510 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 33520 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 33530 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 33540 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33550 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 33560 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33570 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33580 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 33590 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 33600 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 33610 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 33620 ======
one_epoch_time 210.18883681297302
INFO:Entity Linker:
=====Epoch Number: 44 =====
INFO:Entity Linker:
=====Loss: 0.3595 Step: 33630 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 33640 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33650 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33660 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 33670 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 33680 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 33690 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33700 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33710 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33720 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33730 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 33740 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 33750 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 33760 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 33770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 33780 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33790 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 33800 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 33810 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33820 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 33830 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33840 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 33850 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 33860 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33870 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33880 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 33890 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33900 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 33910 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 33920 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 33930 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33940 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 33950 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33960 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33970 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 33980 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33990 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 34000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5928
INFO:Entity Linker:
==== Accuracy on dev after 34000 iterations: 0.4992
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34010 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 34020 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34030 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 34040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 34050 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 34060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 34070 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 34080 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 34090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 34100 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 34110 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34120 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 34130 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 34140 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 34150 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 34160 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 34170 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 34180 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 34190 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 34200 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 34210 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34220 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 34230 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 34240 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34250 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 34260 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 34270 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 34280 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34290 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 34300 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 34310 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34320 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34330 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 34340 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 34350 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 34360 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 34370 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 34380 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 34390 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 34400 ======
one_epoch_time 201.47481393814087
INFO:Entity Linker:
=====Epoch Number: 45 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 34410 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 34420 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 34430 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 34440 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 34450 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 34460 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 34470 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 34480 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 34490 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 34500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5956
INFO:Entity Linker:
==== Accuracy on dev after 34500 iterations: 0.5022
INFO:Entity Linker:Hierarchical Accuracy: 0.5941
INFO:Entity Linker:
==== Accuracy on test after 34500 iterations: 0.5046
INFO:Entity Linker:
=====Loss: 0.3566 Step: 34510 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34520 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 34530 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 34540 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 34550 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 34560 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 34570 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 34580 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 34590 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 34600 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 34610 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 34620 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 34630 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 34640 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 34650 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 34660 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 34670 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 34680 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 34690 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 34700 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 34710 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 34720 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34730 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 34740 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 34750 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 34760 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 34770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 34780 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 34790 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 34800 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 34810 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 34820 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34830 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34840 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 34850 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 34860 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 34870 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 34880 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 34890 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 34900 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 34910 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 34920 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 34930 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 34940 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 34950 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 34960 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 34970 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 34980 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 34990 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 35000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5910
INFO:Entity Linker:
==== Accuracy on dev after 35000 iterations: 0.4976
INFO:Entity Linker:
=====Loss: 0.3565 Step: 35010 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 35020 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35030 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35040 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 35050 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 35060 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 35070 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35080 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 35090 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35100 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 35110 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 35120 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 35130 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35140 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35150 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35160 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 35170 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 35180 ======
one_epoch_time 221.75921988487244
INFO:Entity Linker:
=====Epoch Number: 46 =====
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35190 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35200 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 35210 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 35220 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35230 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 35240 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35250 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 35260 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 35270 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35280 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35290 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35300 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 35310 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 35320 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35330 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35340 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 35350 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 35360 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 35370 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 35380 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35390 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 35400 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 35410 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 35420 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 35430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 35440 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 35450 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35460 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 35470 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 35480 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 35490 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 35500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5969
INFO:Entity Linker:
==== Accuracy on dev after 35500 iterations: 0.5037
INFO:Entity Linker:Hierarchical Accuracy: 0.6001
INFO:Entity Linker:
==== Accuracy on test after 35500 iterations: 0.5127
INFO:Entity Linker:
=====Loss: 0.3615 Step: 35510 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 35520 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35530 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35540 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35550 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 35560 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35570 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35580 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 35590 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 35600 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 35610 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 35620 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35630 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35640 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 35650 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35660 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 35670 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35680 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 35690 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 35700 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35710 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35720 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 35730 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 35740 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 35750 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 35760 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35770 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 35780 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35790 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 35800 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 35810 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35820 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 35830 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 35840 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35850 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35860 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35870 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 35880 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 35890 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35900 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35910 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 35920 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 35930 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35940 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 35950 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 35960 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 35970 ======
one_epoch_time 216.06572008132935
INFO:Entity Linker:
=====Epoch Number: 47 =====
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35980 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 35990 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5951
INFO:Entity Linker:
==== Accuracy on dev after 36000 iterations: 0.5000
INFO:Entity Linker:
=====Loss: 0.3574 Step: 36010 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 36020 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 36030 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36050 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 36060 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 36070 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 36080 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 36090 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 36100 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36110 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 36120 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 36130 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 36140 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 36150 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 36160 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 36170 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36180 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 36190 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 36200 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36210 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 36220 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 36230 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 36240 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 36250 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 36260 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 36270 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36280 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 36290 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 36300 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36310 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 36320 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 36330 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36340 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 36350 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 36360 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36370 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 36380 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 36390 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 36400 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 36410 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 36420 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 36430 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 36440 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36450 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 36460 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36470 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 36480 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 36490 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5926
INFO:Entity Linker:
==== Accuracy on dev after 36500 iterations: 0.4971
INFO:Entity Linker:
=====Loss: 0.3562 Step: 36510 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 36520 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 36530 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 36540 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36550 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 36560 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 36570 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 36580 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 36590 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 36600 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36610 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 36620 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 36630 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 36640 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36650 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 36660 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 36670 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 36680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 36690 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 36700 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 36710 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 36720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36730 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 36740 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36750 ======
one_epoch_time 217.2502887248993
INFO:Entity Linker:
=====Epoch Number: 48 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 36760 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 36770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36780 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 36790 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 36800 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36810 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 36820 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36830 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 36840 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36850 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 36860 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 36870 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 36880 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36890 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 36900 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36910 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 36920 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36930 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36940 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 36950 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 36960 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 36970 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 36980 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 36990 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 37000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5923
INFO:Entity Linker:
==== Accuracy on dev after 37000 iterations: 0.4962
INFO:Entity Linker:
=====Loss: 0.3601 Step: 37010 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 37020 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 37030 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 37040 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 37050 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37060 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 37070 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 37080 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 37090 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 37100 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 37110 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 37120 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 37130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 37140 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 37150 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 37160 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37170 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 37180 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 37190 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 37200 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 37210 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 37220 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 37230 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 37240 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 37250 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 37260 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 37270 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37280 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 37290 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 37300 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 37310 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 37320 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 37330 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 37340 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 37350 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 37360 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 37370 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 37380 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 37390 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 37400 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 37410 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 37420 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 37430 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 37440 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 37450 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37460 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 37470 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37480 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 37490 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 37500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5897
INFO:Entity Linker:
==== Accuracy on dev after 37500 iterations: 0.4950
INFO:Entity Linker:
=====Loss: 0.3611 Step: 37510 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37520 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 37530 ======
one_epoch_time 200.23189210891724
INFO:Entity Linker:
=====Epoch Number: 49 =====
INFO:Entity Linker:
=====Loss: 0.3582 Step: 37540 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 37550 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 37560 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37570 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 37580 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 37590 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37600 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 37610 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 37620 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 37630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 37640 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 37650 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37660 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 37670 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37680 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 37690 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37700 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 37710 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37720 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 37730 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 37740 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 37750 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 37760 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37770 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 37780 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 37790 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 37800 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 37810 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37820 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 37830 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 37840 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 37850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 37860 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 37870 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37880 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 37890 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 37900 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 37910 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 37920 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 37930 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37940 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 37950 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 37960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37970 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 37980 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 37990 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 38000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5935
INFO:Entity Linker:
==== Accuracy on dev after 38000 iterations: 0.5012
INFO:Entity Linker:
=====Loss: 0.3563 Step: 38010 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38020 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 38030 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 38040 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 38050 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 38060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38070 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 38080 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 38090 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38100 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38110 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38120 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 38130 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 38140 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 38150 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38160 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38170 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 38180 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 38190 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38200 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 38210 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 38220 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 38230 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 38240 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38250 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38260 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 38270 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38280 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38290 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 38300 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 38310 ======
one_epoch_time 217.279305934906
INFO:Entity Linker:
=====Epoch Number: 50 =====
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38320 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 38330 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38340 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38350 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38360 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38370 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 38380 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 38390 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 38400 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 38410 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 38420 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 38430 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 38440 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 38450 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 38460 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38470 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 38480 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 38490 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 38500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5922
INFO:Entity Linker:
==== Accuracy on dev after 38500 iterations: 0.4968
INFO:Entity Linker:
=====Loss: 0.3551 Step: 38510 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 38520 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 38530 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 38540 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 38550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 38560 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 38570 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38580 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38590 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38600 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38610 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 38620 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 38630 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 38640 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 38650 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 38660 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38670 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 38680 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38690 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 38700 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 38710 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38720 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 38730 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 38740 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 38750 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 38760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 38770 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38780 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 38790 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 38800 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 38810 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 38820 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 38830 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 38840 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 38850 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38860 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 38870 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 38880 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38890 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38900 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 38910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 38920 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38930 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 38940 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 38950 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38960 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 38970 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 38980 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38990 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 39000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5952
INFO:Entity Linker:
==== Accuracy on dev after 39000 iterations: 0.5018
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39010 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 39020 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 39030 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 39040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 39050 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 39060 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 39070 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 39080 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 39090 ======
one_epoch_time 219.82003498077393
INFO:Entity Linker:
=====Epoch Number: 51 =====
INFO:Entity Linker:
=====Loss: 0.3562 Step: 39100 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 39110 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39120 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 39130 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39140 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 39150 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39160 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 39170 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39180 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 39190 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39200 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39210 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 39220 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 39230 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 39240 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39250 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 39260 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 39270 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39280 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 39290 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 39300 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 39310 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 39320 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 39330 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 39340 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 39350 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39360 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39370 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 39380 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 39390 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39400 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 39410 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 39420 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 39430 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 39440 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 39450 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 39460 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39470 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 39480 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39490 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 39500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5918
INFO:Entity Linker:
==== Accuracy on dev after 39500 iterations: 0.4958
INFO:Entity Linker:
=====Loss: 0.3553 Step: 39510 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 39520 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39530 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 39540 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 39560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39570 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39580 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39590 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 39600 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39610 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 39620 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 39630 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 39640 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39650 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 39660 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39670 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39680 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 39690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39700 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39710 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 39720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 39730 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 39740 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 39750 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39760 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39770 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 39780 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 39790 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39800 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 39810 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39820 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 39830 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 39840 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39850 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 39860 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39870 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39880 ======
one_epoch_time 214.68361020088196
INFO:Entity Linker:
=====Epoch Number: 52 =====
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39890 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 39900 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 39910 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39920 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 39930 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 39940 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 39950 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 39960 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 39970 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 39980 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 39990 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 40000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5932
INFO:Entity Linker:
==== Accuracy on dev after 40000 iterations: 0.4977
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40010 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 40020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 40030 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 40040 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40050 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 40060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 40070 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 40080 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40090 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 40100 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 40110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40120 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40130 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 40140 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 40150 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 40160 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40170 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 40180 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 40190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 40200 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 40210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 40220 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 40230 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 40240 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40250 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 40260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 40270 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 40280 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 40290 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40300 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 40310 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 40320 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 40330 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 40340 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40350 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 40360 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 40370 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 40380 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40390 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 40400 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 40410 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40420 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 40430 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 40440 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 40450 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 40460 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 40470 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40480 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40490 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5955
INFO:Entity Linker:
==== Accuracy on dev after 40500 iterations: 0.5020
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40510 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 40520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 40530 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40540 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 40550 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 40560 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40570 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 40580 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40590 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 40600 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40610 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 40620 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 40630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 40640 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 40650 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40660 ======
one_epoch_time 221.99675631523132
INFO:Entity Linker:
=====Epoch Number: 53 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 40670 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 40680 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 40690 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 40700 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 40710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 40720 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 40730 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 40740 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 40750 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 40770 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 40780 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 40790 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40800 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40810 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 40820 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 40830 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 40850 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 40860 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 40870 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40880 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 40890 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 40900 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 40910 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 40920 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 40930 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 40940 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 40950 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 40960 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 40970 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40980 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 40990 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5943
INFO:Entity Linker:
==== Accuracy on dev after 41000 iterations: 0.4999
INFO:Entity Linker:
=====Loss: 0.3598 Step: 41010 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41020 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41030 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 41040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 41050 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 41060 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 41070 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 41080 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 41090 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 41100 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 41110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 41120 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 41130 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41140 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 41150 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 41160 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 41170 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 41180 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 41190 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 41200 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41210 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 41220 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 41230 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 41240 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 41250 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 41260 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 41270 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 41280 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 41290 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 41300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41310 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 41320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 41330 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 41340 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 41350 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 41360 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 41370 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 41380 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 41390 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 41400 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 41410 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41420 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 41430 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 41440 ======
one_epoch_time 195.5592737197876
INFO:Entity Linker:
=====Epoch Number: 54 =====
INFO:Entity Linker:
=====Loss: 0.3581 Step: 41450 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 41460 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 41470 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 41480 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 41490 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 41500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5976
INFO:Entity Linker:
==== Accuracy on dev after 41500 iterations: 0.5040
INFO:Entity Linker:Hierarchical Accuracy: 0.5985
INFO:Entity Linker:
==== Accuracy on test after 41500 iterations: 0.5106
INFO:Entity Linker:
=====Loss: 0.3574 Step: 41510 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 41520 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41530 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 41540 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41550 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 41560 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 41570 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41580 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41590 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 41600 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41610 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41620 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 41630 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 41640 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 41650 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 41660 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 41670 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 41680 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41690 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 41700 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 41710 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 41720 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 41730 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 41740 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 41750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 41760 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 41770 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 41780 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41790 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 41800 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 41810 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 41820 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 41830 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 41840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 41850 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 41860 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41870 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 41880 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 41890 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 41900 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 41910 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41920 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 41930 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 41940 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41950 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 41960 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 41970 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 41980 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 41990 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 42000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5909
INFO:Entity Linker:
==== Accuracy on dev after 42000 iterations: 0.4961
INFO:Entity Linker:
=====Loss: 0.3542 Step: 42010 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42020 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 42030 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42040 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 42050 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 42060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42070 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42080 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 42090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42100 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42110 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 42120 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 42130 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 42140 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42150 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 42160 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42170 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 42180 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 42190 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 42200 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 42210 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 42220 ======
one_epoch_time 218.88876152038574
INFO:Entity Linker:
=====Epoch Number: 55 =====
INFO:Entity Linker:
=====Loss: 0.3563 Step: 42230 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 42240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42250 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 42260 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 42270 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 42280 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 42290 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 42300 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 42310 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 42320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42330 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42340 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 42350 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 42360 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42370 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 42380 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 42390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42400 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 42410 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 42420 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 42430 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42440 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 42450 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42460 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 42470 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 42480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 42490 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 42500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5921
INFO:Entity Linker:
==== Accuracy on dev after 42500 iterations: 0.4993
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42510 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42520 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 42530 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 42540 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42550 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 42560 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 42570 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 42580 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 42590 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 42600 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 42610 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 42620 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 42630 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 42640 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42650 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 42660 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 42670 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 42680 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 42690 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42700 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 42710 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 42720 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 42730 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42740 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 42750 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 42760 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 42770 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 42780 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 42790 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 42800 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42810 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42820 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 42830 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 42840 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42850 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 42860 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 42870 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 42880 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 42890 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 42900 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 42910 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42920 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 42930 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42940 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42950 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 42960 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 42970 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 42980 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 42990 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5954
INFO:Entity Linker:
==== Accuracy on dev after 43000 iterations: 0.5005
one_epoch_time 216.43057346343994
INFO:Entity Linker:
=====Epoch Number: 56 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 43010 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43020 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 43030 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 43040 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 43050 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 43060 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 43070 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 43080 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43090 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 43100 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 43110 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43120 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 43130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43140 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 43150 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43160 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43170 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 43180 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43190 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43200 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 43210 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43220 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 43230 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43240 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 43250 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 43260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43270 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 43280 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 43290 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 43300 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 43310 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 43320 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 43330 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 43340 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 43350 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 43360 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 43370 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 43380 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 43390 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43400 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 43410 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 43420 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 43430 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 43440 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 43450 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43460 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43470 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 43480 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43490 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 43500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5949
INFO:Entity Linker:
==== Accuracy on dev after 43500 iterations: 0.5014
INFO:Entity Linker:
=====Loss: 0.3600 Step: 43510 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 43520 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 43530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43540 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 43550 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 43560 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 43570 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 43580 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43590 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43600 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 43610 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 43620 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 43630 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 43640 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 43650 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43660 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 43670 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 43680 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 43690 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 43700 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 43710 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 43720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43730 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 43740 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 43750 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43760 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 43770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 43780 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43790 ======
one_epoch_time 215.66584038734436
INFO:Entity Linker:
=====Epoch Number: 57 =====
INFO:Entity Linker:
=====Loss: 0.3577 Step: 43800 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 43810 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 43820 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 43830 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43840 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 43850 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 43860 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 43870 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 43880 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43890 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 43900 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 43910 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 43920 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 43930 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 43940 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 43950 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43960 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 43970 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43980 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 43990 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 44000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5956
INFO:Entity Linker:
==== Accuracy on dev after 44000 iterations: 0.5016
INFO:Entity Linker:
=====Loss: 0.3590 Step: 44010 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 44020 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 44030 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 44040 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 44050 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44060 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 44070 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 44080 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 44090 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44100 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 44110 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 44120 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 44130 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 44140 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 44150 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 44160 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 44170 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 44180 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 44190 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 44200 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44210 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44220 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 44230 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44240 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 44250 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 44260 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 44270 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 44280 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44290 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 44300 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 44310 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44320 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44330 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44340 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 44350 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 44360 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44370 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44380 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 44390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 44400 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 44410 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 44420 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44430 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 44440 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44450 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 44460 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 44470 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44480 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 44490 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 44500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5960
INFO:Entity Linker:
==== Accuracy on dev after 44500 iterations: 0.4993
INFO:Entity Linker:
=====Loss: 0.3563 Step: 44510 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44520 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 44530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 44540 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44550 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 44560 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44570 ======
one_epoch_time 215.17581987380981
INFO:Entity Linker:
=====Epoch Number: 58 =====
INFO:Entity Linker:
=====Loss: 0.3563 Step: 44580 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 44590 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 44600 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 44610 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 44620 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44630 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44640 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 44650 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 44660 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 44670 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44680 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 44690 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 44700 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 44710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 44720 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 44730 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 44740 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 44750 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 44760 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44770 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 44780 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 44790 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 44800 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 44810 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44820 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 44830 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 44840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 44850 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 44860 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 44870 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 44880 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44890 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 44900 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 44910 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44920 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 44930 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44940 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 44950 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 44960 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 44970 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 44980 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 44990 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 45000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5982
INFO:Entity Linker:
==== Accuracy on dev after 45000 iterations: 0.5052
INFO:Entity Linker:Hierarchical Accuracy: 0.6009
INFO:Entity Linker:
==== Accuracy on test after 45000 iterations: 0.5127
INFO:Entity Linker:
=====Loss: 0.3552 Step: 45010 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 45020 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 45030 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 45040 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 45050 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45060 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45070 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45080 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45090 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 45100 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 45110 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 45120 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 45130 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 45140 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 45150 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45160 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45170 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 45180 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45190 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 45200 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 45210 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 45220 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 45230 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 45240 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 45250 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45260 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 45270 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45280 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 45290 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45300 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 45310 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45320 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 45330 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 45340 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 45350 ======
one_epoch_time 184.2569923400879
INFO:Entity Linker:
=====Epoch Number: 59 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45360 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 45370 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 45380 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45390 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 45400 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 45410 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 45420 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45430 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45440 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 45450 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 45460 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 45470 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 45480 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 45490 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5979
INFO:Entity Linker:
==== Accuracy on dev after 45500 iterations: 0.5040
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45510 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 45520 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 45530 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 45540 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 45550 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 45560 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45570 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45580 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45590 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 45600 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 45610 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45620 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 45630 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 45640 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 45650 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 45660 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 45670 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 45680 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 45690 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 45700 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 45710 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45720 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 45730 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 45740 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 45750 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 45760 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 45770 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45780 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 45790 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 45800 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45810 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 45820 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45830 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45840 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 45850 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 45860 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 45870 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45880 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 45890 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 45900 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 45910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 45920 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 45930 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 45940 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45950 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 45960 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45970 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45980 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 45990 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5963
INFO:Entity Linker:
==== Accuracy on dev after 46000 iterations: 0.5044
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46010 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 46020 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 46030 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 46040 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 46050 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 46060 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46070 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 46080 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 46090 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46100 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 46110 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 46120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 46130 ======
one_epoch_time 218.78426551818848
INFO:Entity Linker:
=====Epoch Number: 60 =====
INFO:Entity Linker:
=====Loss: 0.3556 Step: 46140 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46150 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 46160 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46180 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 46190 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 46200 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 46210 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46220 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46230 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 46240 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 46250 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 46260 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 46270 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46280 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46290 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 46300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46310 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 46320 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 46330 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46340 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 46350 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 46360 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 46370 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 46380 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 46400 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 46410 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 46420 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 46430 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46440 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 46450 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 46460 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 46470 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 46480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 46490 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5914
INFO:Entity Linker:
==== Accuracy on dev after 46500 iterations: 0.4992
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46510 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 46520 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 46530 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 46540 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 46550 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 46560 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 46570 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 46580 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 46590 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46600 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 46610 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 46620 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 46630 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 46640 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 46650 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 46660 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 46670 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 46680 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 46690 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 46700 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 46710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 46720 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 46730 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 46740 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 46750 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 46760 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 46770 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 46780 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 46790 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 46800 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 46810 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 46820 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46830 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 46840 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46850 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 46860 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 46880 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 46890 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 46900 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 46910 ======
one_epoch_time 211.79808568954468
INFO:Entity Linker:
=====Epoch Number: 61 =====
INFO:Entity Linker:
=====Loss: 0.3561 Step: 46920 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 46930 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 46940 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 46950 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 46960 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 46970 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 46980 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 46990 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 47000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5957
INFO:Entity Linker:
==== Accuracy on dev after 47000 iterations: 0.5017
INFO:Entity Linker:
=====Loss: 0.3582 Step: 47010 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 47020 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 47030 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 47040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 47050 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 47060 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47070 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47080 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 47090 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 47100 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47110 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 47120 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 47130 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47140 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 47150 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 47160 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47170 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47180 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 47190 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 47200 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 47210 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47220 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 47230 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 47240 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47250 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47260 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 47270 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 47280 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 47290 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47300 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 47310 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 47320 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 47330 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 47340 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 47350 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 47360 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 47370 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 47380 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 47390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47400 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47410 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 47420 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 47430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47440 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47450 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 47460 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47470 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47480 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5967
INFO:Entity Linker:
==== Accuracy on dev after 47500 iterations: 0.5034
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47510 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47540 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 47550 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 47560 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 47570 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 47580 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47590 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 47600 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 47610 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 47620 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47630 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 47640 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 47650 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 47660 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 47670 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 47680 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 47690 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 47700 ======
one_epoch_time 219.33735942840576
INFO:Entity Linker:
=====Epoch Number: 62 =====
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47710 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 47720 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 47730 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47740 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 47750 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47760 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47770 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47780 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 47790 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 47800 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 47810 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 47820 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47830 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 47840 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 47850 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 47860 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47870 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 47880 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 47890 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 47900 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47910 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 47920 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 47930 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 47940 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47950 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 47960 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 47970 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 47980 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47990 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 48000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5973
INFO:Entity Linker:
==== Accuracy on dev after 48000 iterations: 0.5039
INFO:Entity Linker:
=====Loss: 0.3558 Step: 48010 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 48030 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 48040 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 48050 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 48060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48070 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 48080 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48090 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 48100 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 48110 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 48120 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48130 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 48140 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 48150 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 48160 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48170 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 48180 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 48190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 48200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 48210 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 48220 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 48230 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48240 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 48250 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 48260 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48270 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 48280 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 48290 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 48300 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48310 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 48320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48330 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 48340 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48350 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 48360 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 48370 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 48380 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48390 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 48400 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 48410 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 48420 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 48430 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 48440 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48450 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 48460 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 48470 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 48480 ======
one_epoch_time 206.85688018798828
INFO:Entity Linker:
=====Epoch Number: 63 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48490 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 48500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5962
INFO:Entity Linker:
==== Accuracy on dev after 48500 iterations: 0.5027
INFO:Entity Linker:
=====Loss: 0.3564 Step: 48510 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 48520 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 48530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 48540 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 48550 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48560 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 48570 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 48580 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48590 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 48600 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 48610 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48620 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48630 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 48640 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 48650 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 48660 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 48670 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48680 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 48690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 48700 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 48710 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 48720 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 48730 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 48740 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 48750 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48760 ======
INFO:Entity Linker:
=====Loss: 0.3519 Step: 48770 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 48780 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48790 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48800 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48810 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 48820 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48830 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 48840 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 48850 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 48860 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 48870 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 48880 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 48890 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 48900 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 48910 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 48920 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 48930 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 48940 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 48950 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 48960 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48970 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48980 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 48990 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5932
INFO:Entity Linker:
==== Accuracy on dev after 49000 iterations: 0.4983
INFO:Entity Linker:
=====Loss: 0.3548 Step: 49010 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 49020 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49030 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 49040 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 49050 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 49060 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 49070 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 49080 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 49090 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 49100 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 49110 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 49120 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 49130 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 49140 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 49150 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 49160 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49170 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 49180 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 49190 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 49200 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 49210 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49220 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 49230 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 49240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49250 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 49260 ======
one_epoch_time 218.1157569885254
INFO:Entity Linker:
=====Epoch Number: 64 =====
INFO:Entity Linker:
=====Loss: 0.3575 Step: 49270 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 49280 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 49290 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 49300 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 49310 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 49320 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49330 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 49340 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 49350 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 49360 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49370 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 49380 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 49390 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49400 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 49410 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 49420 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 49430 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 49440 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49460 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49470 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49480 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 49490 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 49500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5956
INFO:Entity Linker:
==== Accuracy on dev after 49500 iterations: 0.4999
INFO:Entity Linker:
=====Loss: 0.3585 Step: 49510 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49520 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 49530 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49540 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 49550 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49560 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 49570 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 49580 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 49590 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 49600 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 49610 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 49620 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 49640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 49650 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 49660 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 49670 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 49680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49690 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 49700 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 49710 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 49720 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 49730 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 49740 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 49750 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 49760 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 49770 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 49780 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 49790 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 49800 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 49810 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 49820 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 49830 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 49840 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 49850 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49860 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 49870 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 49880 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49890 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 49900 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49910 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49920 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 49930 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49940 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 49950 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 49960 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 49970 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 49980 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49990 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 50000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5984
INFO:Entity Linker:
==== Accuracy on dev after 50000 iterations: 0.5052
INFO:Entity Linker:Hierarchical Accuracy: 0.5969
INFO:Entity Linker:
==== Accuracy on test after 50000 iterations: 0.5100
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50010 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 50020 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 50030 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 50040 ======
one_epoch_time 197.8830349445343
INFO:Entity Linker:
=====Epoch Number: 65 =====
INFO:Entity Linker:
=====Loss: 0.3547 Step: 50050 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 50060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50070 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50080 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50090 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50110 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 50120 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50130 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 50140 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 50150 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 50160 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 50170 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50180 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 50190 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 50200 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 50210 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50220 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50230 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 50240 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50250 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 50260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 50270 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 50280 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50290 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 50300 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 50310 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 50320 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50330 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 50340 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 50350 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 50360 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 50370 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 50380 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 50390 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 50400 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 50410 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50420 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50430 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 50440 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 50450 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50460 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 50470 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 50480 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 50490 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5955
INFO:Entity Linker:
==== Accuracy on dev after 50500 iterations: 0.5031
INFO:Entity Linker:
=====Loss: 0.3576 Step: 50510 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50520 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 50530 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 50540 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 50550 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 50560 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 50570 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50580 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 50590 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50600 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 50610 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 50620 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 50630 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50640 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 50650 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 50660 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50670 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50680 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50690 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 50700 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 50710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 50720 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 50730 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 50740 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 50750 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 50760 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 50770 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 50780 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 50800 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50810 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 50820 ======
one_epoch_time 175.06949996948242
INFO:Entity Linker:
=====Epoch Number: 66 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50830 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 50840 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 50850 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50860 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 50870 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50880 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 50890 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 50900 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 50910 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 50920 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50940 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 50950 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 50960 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 50970 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50980 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 50990 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 51000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5985
INFO:Entity Linker:
==== Accuracy on dev after 51000 iterations: 0.5048
INFO:Entity Linker:
=====Loss: 0.3560 Step: 51010 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 51020 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 51030 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 51040 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51050 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51060 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51070 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51080 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 51100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51110 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51120 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 51130 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 51140 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 51150 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 51160 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 51170 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51180 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 51190 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 51200 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 51210 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51220 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 51230 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51240 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 51250 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 51260 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51270 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51280 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51290 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 51300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 51310 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51320 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 51330 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51340 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 51350 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 51360 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 51370 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51380 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 51390 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 51400 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 51410 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 51420 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 51430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51440 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 51450 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51460 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 51470 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51480 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 51490 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 51500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5963
INFO:Entity Linker:
==== Accuracy on dev after 51500 iterations: 0.5025
INFO:Entity Linker:
=====Loss: 0.3587 Step: 51510 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51520 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 51530 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51540 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51550 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51560 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51570 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51580 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51590 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 51600 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51610 ======
one_epoch_time 179.04845905303955
INFO:Entity Linker:
=====Epoch Number: 67 =====
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51620 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 51630 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 51640 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 51650 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 51660 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51670 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51680 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51690 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 51700 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 51710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 51720 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 51730 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 51740 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 51750 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 51760 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 51770 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51780 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 51790 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 51800 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51810 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 51820 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 51830 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 51840 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 51850 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51860 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 51870 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 51880 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51890 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 51900 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 51910 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51920 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51930 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 51940 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 51950 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51960 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 51970 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 51980 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51990 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5970
INFO:Entity Linker:
==== Accuracy on dev after 52000 iterations: 0.5055
INFO:Entity Linker:Hierarchical Accuracy: 0.6025
INFO:Entity Linker:
==== Accuracy on test after 52000 iterations: 0.5131
INFO:Entity Linker:
=====Loss: 0.3560 Step: 52010 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52020 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 52030 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 52040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 52050 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52060 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 52070 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 52080 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 52090 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 52100 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52110 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52120 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52140 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 52150 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 52160 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52170 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 52180 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52190 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 52200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 52210 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 52220 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52230 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52240 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 52250 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52260 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 52270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52280 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52290 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52300 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 52310 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 52320 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 52330 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 52340 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 52350 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52360 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 52370 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 52380 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52390 ======
one_epoch_time 202.17608737945557
INFO:Entity Linker:
=====Epoch Number: 68 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52400 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 52410 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 52420 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 52430 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52440 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 52450 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52460 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 52470 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52480 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52490 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 52500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5988
INFO:Entity Linker:
==== Accuracy on dev after 52500 iterations: 0.5048
INFO:Entity Linker:
=====Loss: 0.3543 Step: 52510 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 52520 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 52530 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 52540 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52550 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 52560 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52570 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52580 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 52590 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 52600 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52610 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 52620 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 52630 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 52640 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 52650 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 52660 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52670 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 52680 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 52690 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 52700 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 52710 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 52720 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 52730 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 52740 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 52750 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52760 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 52770 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52780 ======
INFO:Entity Linker:
=====Loss: 0.3884 Step: 52790 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 52800 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 52810 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 52820 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52830 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 52840 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 52850 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 52860 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 52870 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 52880 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52890 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52900 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52910 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 52920 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 52930 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52940 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 52950 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 52960 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52970 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 52980 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 52990 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 53000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5963
INFO:Entity Linker:
==== Accuracy on dev after 53000 iterations: 0.5050
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53010 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 53020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 53030 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 53040 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 53050 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53060 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 53070 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53080 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 53090 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 53100 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 53110 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53120 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 53130 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 53140 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 53150 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53160 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 53170 ======
one_epoch_time 196.09459400177002
INFO:Entity Linker:
=====Epoch Number: 69 =====
INFO:Entity Linker:
=====Loss: 0.3568 Step: 53180 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 53190 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 53200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53210 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 53220 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 53230 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 53240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53250 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53260 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 53270 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53280 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 53290 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 53300 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 53310 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 53330 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 53340 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 53350 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53360 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53370 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 53380 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 53390 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53400 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 53410 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53420 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 53430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 53440 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53450 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53460 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 53470 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53490 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6007
INFO:Entity Linker:
==== Accuracy on dev after 53500 iterations: 0.5101
INFO:Entity Linker:Hierarchical Accuracy: 0.6024
INFO:Entity Linker:
==== Accuracy on test after 53500 iterations: 0.5155
INFO:Entity Linker:
=====Loss: 0.3550 Step: 53510 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53520 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 53530 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53540 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53550 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 53560 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 53570 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 53580 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 53590 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53600 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 53610 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 53620 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 53630 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 53640 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53650 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 53660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53670 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 53680 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 53690 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 53700 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 53710 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 53720 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 53730 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 53740 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 53750 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 53760 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 53770 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 53780 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 53790 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53800 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53810 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 53820 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53830 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 53840 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 53850 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 53860 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 53880 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53890 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 53900 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 53910 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 53920 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 53930 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 53940 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 53950 ======
one_epoch_time 178.06586456298828
INFO:Entity Linker:
=====Epoch Number: 70 =====
INFO:Entity Linker:
=====Loss: 0.3553 Step: 53960 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 53970 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 53980 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53990 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 54000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5958
INFO:Entity Linker:
==== Accuracy on dev after 54000 iterations: 0.5026
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54010 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 54020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 54030 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 54040 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 54050 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 54060 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54070 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 54080 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54090 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 54100 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 54110 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 54120 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 54130 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 54140 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 54150 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 54160 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 54170 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 54180 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 54190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54200 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 54210 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 54220 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 54230 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54240 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54250 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 54260 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 54270 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54280 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 54290 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 54300 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 54310 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 54320 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 54330 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 54340 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 54350 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 54360 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 54370 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 54380 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 54390 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 54400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54410 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 54420 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 54430 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 54440 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 54450 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 54460 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 54470 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 54480 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54490 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 54500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5975
INFO:Entity Linker:
==== Accuracy on dev after 54500 iterations: 0.5057
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54510 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 54520 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54540 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54550 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 54560 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 54570 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 54580 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 54590 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 54600 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 54610 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 54620 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54630 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 54640 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 54650 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 54660 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54670 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 54680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54690 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54700 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 54710 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 54720 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54730 ======
one_epoch_time 206.6469805240631
INFO:Entity Linker:
=====Epoch Number: 71 =====
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54740 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 54750 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 54760 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 54770 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 54780 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 54790 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 54800 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 54810 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 54820 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 54830 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 54840 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 54850 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 54860 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 54870 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 54880 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54890 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 54900 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 54910 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 54920 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 54930 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54940 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 54950 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 54960 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 54970 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 54980 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 54990 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 55000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5997
INFO:Entity Linker:
==== Accuracy on dev after 55000 iterations: 0.5061
INFO:Entity Linker:
=====Loss: 0.3577 Step: 55010 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55020 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 55030 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 55040 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 55050 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 55060 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 55070 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55080 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 55090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 55100 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 55110 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55120 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 55130 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 55140 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 55150 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 55160 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 55170 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 55180 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 55190 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55200 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 55210 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55220 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55230 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 55240 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 55250 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55260 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 55270 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 55280 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 55290 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 55300 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 55310 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 55320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 55330 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55340 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55360 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 55370 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 55380 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 55390 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 55400 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 55410 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 55420 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 55430 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55440 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55450 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 55460 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55470 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 55480 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 55490 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 55500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5962
INFO:Entity Linker:
==== Accuracy on dev after 55500 iterations: 0.5024
INFO:Entity Linker:
=====Loss: 0.3570 Step: 55510 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55520 ======
one_epoch_time 216.3754050731659
INFO:Entity Linker:
=====Epoch Number: 72 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 55530 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 55540 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 55550 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55560 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 55570 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55580 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55590 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 55600 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 55610 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 55620 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 55630 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55640 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55650 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55660 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 55670 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 55680 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55690 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 55700 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 55720 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 55730 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 55740 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 55750 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 55760 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 55770 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55780 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 55790 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 55800 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 55810 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 55820 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 55830 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55840 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 55850 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 55860 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 55870 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 55880 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 55890 ======
INFO:Entity Linker:
=====Loss: 0.3520 Step: 55900 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 55910 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55920 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 55930 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55940 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 55950 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 55960 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55970 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 55980 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 55990 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5991
INFO:Entity Linker:
==== Accuracy on dev after 56000 iterations: 0.5062
INFO:Entity Linker:
=====Loss: 0.3563 Step: 56010 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 56020 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56030 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56040 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56050 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 56060 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56070 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56080 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56090 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56100 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 56110 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 56130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56140 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 56150 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 56160 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56170 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56180 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 56190 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 56200 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 56210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56220 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 56230 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56240 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56250 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 56260 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 56280 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 56290 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56300 ======
one_epoch_time 185.1197361946106
INFO:Entity Linker:
=====Epoch Number: 73 =====
INFO:Entity Linker:
=====Loss: 0.3543 Step: 56310 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 56320 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 56330 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 56340 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 56350 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56360 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56370 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 56380 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 56390 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 56400 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 56410 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 56420 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56430 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 56440 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 56450 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56460 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 56470 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56480 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 56490 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5974
INFO:Entity Linker:
==== Accuracy on dev after 56500 iterations: 0.5032
INFO:Entity Linker:
=====Loss: 0.3600 Step: 56510 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56520 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 56530 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56540 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56550 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56560 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56570 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 56580 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 56590 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 56600 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 56610 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 56620 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56630 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 56640 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 56650 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56660 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 56670 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 56680 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 56690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56700 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56710 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 56720 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56730 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56740 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 56750 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56760 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 56770 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56780 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 56790 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 56800 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 56810 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 56820 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 56830 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 56840 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 56850 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 56860 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 56870 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 56880 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 56890 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 56900 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56910 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 56920 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56930 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 56940 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 56950 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 56960 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56970 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56980 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 56990 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 57000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5966
INFO:Entity Linker:
==== Accuracy on dev after 57000 iterations: 0.5033
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57010 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 57020 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 57030 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57040 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57050 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57060 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57070 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 57080 ======
one_epoch_time 190.43340015411377
INFO:Entity Linker:
=====Epoch Number: 74 =====
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57090 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 57100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 57110 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57120 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 57130 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 57140 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 57150 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 57160 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 57170 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 57180 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57190 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 57200 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 57210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 57220 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 57230 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 57240 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57250 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 57260 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 57270 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 57280 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57290 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57300 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 57310 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57320 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57330 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57350 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 57360 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57370 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 57380 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 57400 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57410 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57420 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57430 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 57440 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 57450 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 57460 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57470 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57480 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57490 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5961
INFO:Entity Linker:
==== Accuracy on dev after 57500 iterations: 0.5030
INFO:Entity Linker:
=====Loss: 0.3565 Step: 57510 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57520 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 57530 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 57540 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 57550 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 57560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 57570 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 57580 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 57590 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 57600 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 57610 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57620 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 57630 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 57640 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57650 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 57660 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57670 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57680 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 57690 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57700 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 57710 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57720 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57730 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 57740 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57750 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 57760 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57770 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57780 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 57790 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 57800 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57810 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 57820 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57830 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 57840 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 57850 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 57860 ======
one_epoch_time 184.52604365348816
INFO:Entity Linker:
=====Epoch Number: 75 =====
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57870 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57880 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57890 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57900 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57910 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 57920 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 57930 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 57940 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 57950 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 57960 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57970 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57980 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 57990 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5999
INFO:Entity Linker:
==== Accuracy on dev after 58000 iterations: 0.5067
INFO:Entity Linker:
=====Loss: 0.3578 Step: 58010 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 58020 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58030 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 58040 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58050 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 58060 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 58070 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58080 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 58090 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 58100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 58120 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 58130 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 58140 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58150 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58160 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 58170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58180 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58190 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 58200 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 58210 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 58220 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 58230 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58240 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 58250 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 58260 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 58270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 58280 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58290 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58300 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 58310 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58320 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 58330 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 58340 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 58350 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 58360 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 58370 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 58380 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 58390 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 58400 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 58410 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58420 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 58430 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 58440 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58450 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 58460 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 58470 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 58480 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 58490 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5995
INFO:Entity Linker:
==== Accuracy on dev after 58500 iterations: 0.5087
INFO:Entity Linker:
=====Loss: 0.3557 Step: 58510 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 58520 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58530 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58540 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 58550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 58560 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 58570 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 58580 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58590 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 58600 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 58610 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58620 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58630 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58640 ======
one_epoch_time 180.18090343475342
INFO:Entity Linker:
=====Epoch Number: 76 =====
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58650 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 58660 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 58670 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 58680 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58690 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 58700 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 58710 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 58720 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 58730 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 58740 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58750 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58760 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 58770 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 58780 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58800 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58810 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 58820 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58830 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58840 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 58850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58860 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 58870 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 58880 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 58890 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 58900 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 58910 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 58920 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 58940 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 58950 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58960 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 58970 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58980 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58990 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 59000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6026
INFO:Entity Linker:
==== Accuracy on dev after 59000 iterations: 0.5106
INFO:Entity Linker:Hierarchical Accuracy: 0.6025
INFO:Entity Linker:
==== Accuracy on test after 59000 iterations: 0.5154
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59010 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 59020 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 59030 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59040 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59050 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 59060 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 59070 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 59080 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59090 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59100 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59110 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 59120 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 59130 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59140 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 59150 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 59160 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 59180 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 59190 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 59200 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 59210 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 59220 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59230 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 59240 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59250 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59260 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 59270 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 59280 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 59290 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59300 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 59310 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59320 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 59330 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 59340 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 59350 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59360 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 59370 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 59380 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 59390 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 59400 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59410 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 59420 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 59430 ======
one_epoch_time 182.5898940563202
INFO:Entity Linker:
=====Epoch Number: 77 =====
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59440 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 59450 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 59460 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 59470 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59480 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59490 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5975
INFO:Entity Linker:
==== Accuracy on dev after 59500 iterations: 0.5028
INFO:Entity Linker:
=====Loss: 0.3557 Step: 59510 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 59520 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59530 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 59540 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 59550 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59560 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59570 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 59580 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59590 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 59600 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59610 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59620 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 59630 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 59640 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 59650 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59660 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 59670 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 59680 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59690 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59700 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 59710 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 59720 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 59730 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 59740 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 59750 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59760 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59770 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 59780 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 59790 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59800 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59810 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59820 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 59830 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59840 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59850 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 59860 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 59870 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59880 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59890 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 59900 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 59910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59920 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 59930 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 59940 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 59950 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59960 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 59970 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59980 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59990 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 60000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5967
INFO:Entity Linker:
==== Accuracy on dev after 60000 iterations: 0.5023
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60010 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 60020 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 60030 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60040 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 60050 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 60060 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60070 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 60080 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60090 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 60100 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 60110 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 60120 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 60130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 60140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60150 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60160 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 60170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 60180 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 60190 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 60200 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 60210 ======
one_epoch_time 215.34261989593506
INFO:Entity Linker:
=====Epoch Number: 78 =====
INFO:Entity Linker:
=====Loss: 0.3561 Step: 60220 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60230 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 60240 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 60250 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60260 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 60270 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 60280 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60290 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60300 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60310 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 60320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 60330 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 60340 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 60360 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60370 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 60380 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60390 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 60400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 60410 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 60420 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 60430 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 60440 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 60450 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60460 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 60470 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 60480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 60490 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 60500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5998
INFO:Entity Linker:
==== Accuracy on dev after 60500 iterations: 0.5071
INFO:Entity Linker:
=====Loss: 0.3589 Step: 60510 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 60520 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 60530 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 60540 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 60550 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 60560 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 60570 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 60580 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 60590 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 60600 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 60610 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 60620 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 60630 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 60640 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60650 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 60660 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 60670 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 60680 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 60690 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 60700 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60710 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 60720 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60730 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 60740 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 60750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60760 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 60770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 60780 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 60790 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60800 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 60810 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 60830 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 60840 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 60850 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 60860 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 60870 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 60880 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60890 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 60900 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 60910 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 60920 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 60930 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 60940 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 60950 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 60960 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 60970 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 60980 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 60990 ======
one_epoch_time 191.14348888397217
INFO:Entity Linker:
=====Epoch Number: 79 =====
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5996
INFO:Entity Linker:
==== Accuracy on dev after 61000 iterations: 0.5070
INFO:Entity Linker:
=====Loss: 0.3574 Step: 61010 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 61020 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 61030 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 61040 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 61050 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 61060 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 61070 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 61080 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61090 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 61100 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 61110 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 61120 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 61130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61150 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61160 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 61170 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 61180 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 61190 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 61200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 61210 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 61220 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61230 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61240 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61250 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 61260 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 61270 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 61280 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 61290 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61300 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61310 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 61320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61330 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 61340 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 61350 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61360 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 61370 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61380 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 61390 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61400 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 61410 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61420 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 61430 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 61440 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 61450 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 61460 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61470 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61480 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 61490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 61500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6000
INFO:Entity Linker:
==== Accuracy on dev after 61500 iterations: 0.5055
INFO:Entity Linker:
=====Loss: 0.3548 Step: 61510 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61520 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 61530 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 61540 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 61550 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 61560 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 61570 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 61580 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61590 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 61600 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 61610 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 61620 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 61630 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61640 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 61650 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 61670 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61680 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 61690 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 61700 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 61710 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 61720 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 61730 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61740 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61750 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 61760 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 61770 ======
one_epoch_time 178.91503524780273
INFO:Entity Linker:
=====Epoch Number: 80 =====
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61780 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61790 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 61800 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61810 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 61830 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 61840 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 61850 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61860 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61870 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 61880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 61890 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 61900 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 61910 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 61920 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 61930 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 61940 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 61950 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61960 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 61970 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61980 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61990 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 62000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5962
INFO:Entity Linker:
==== Accuracy on dev after 62000 iterations: 0.5036
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62010 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 62020 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 62030 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 62040 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 62050 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 62060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62070 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 62080 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 62090 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 62100 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 62110 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 62120 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62130 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62150 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 62160 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 62170 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 62180 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 62190 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62200 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62210 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 62220 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 62230 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62240 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62250 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 62260 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 62270 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 62280 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 62290 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 62300 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 62310 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 62320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62330 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 62340 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 62350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62360 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 62370 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62380 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 62390 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62400 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 62410 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 62420 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 62430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62440 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62450 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 62460 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 62470 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 62480 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 62490 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5987
INFO:Entity Linker:
==== Accuracy on dev after 62500 iterations: 0.5074
INFO:Entity Linker:
=====Loss: 0.3559 Step: 62510 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 62520 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62530 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 62540 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62550 ======
one_epoch_time 178.262943983078
INFO:Entity Linker:
=====Epoch Number: 81 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 62560 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62570 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 62590 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 62600 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 62610 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 62620 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 62630 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62650 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62660 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 62670 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 62680 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62690 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62700 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 62710 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62720 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 62730 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62740 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 62750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 62760 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62770 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62780 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62790 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 62800 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 62810 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62820 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 62830 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 62840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62850 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62860 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 62870 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 62880 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 62890 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 62900 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 62910 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62920 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 62930 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 62940 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 62950 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 62960 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 62970 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 62980 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62990 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 63000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6011
INFO:Entity Linker:
==== Accuracy on dev after 63000 iterations: 0.5096
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63010 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 63020 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63030 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 63040 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63050 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 63060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63070 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 63080 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63090 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 63100 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 63110 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 63120 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 63140 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 63150 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63160 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 63170 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63180 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63190 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 63200 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 63210 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 63220 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 63230 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 63240 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 63250 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 63260 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 63270 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 63280 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63290 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63300 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63310 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 63320 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 63330 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 63340 ======
one_epoch_time 187.3455913066864
INFO:Entity Linker:
=====Epoch Number: 82 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63350 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 63360 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63370 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63380 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 63390 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63400 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63410 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 63420 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 63430 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 63440 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 63450 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63460 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 63470 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63480 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 63490 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 63500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6026
INFO:Entity Linker:
==== Accuracy on dev after 63500 iterations: 0.5105
INFO:Entity Linker:
=====Loss: 0.3567 Step: 63510 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63520 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 63530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 63540 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 63550 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63560 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 63570 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 63590 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 63600 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63610 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 63620 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 63630 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 63640 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63650 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 63660 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 63670 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63680 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 63690 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 63700 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 63710 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 63720 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63730 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63740 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 63750 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 63760 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 63770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 63780 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63790 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63800 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63810 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 63820 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 63830 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 63840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 63850 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 63860 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63870 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 63880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 63890 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63900 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 63910 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63920 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63930 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 63940 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 63950 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63960 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 63970 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63980 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 63990 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 64000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5995
INFO:Entity Linker:
==== Accuracy on dev after 64000 iterations: 0.5058
INFO:Entity Linker:
=====Loss: 0.3553 Step: 64010 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 64020 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64030 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 64050 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 64060 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 64070 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 64080 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 64090 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64100 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 64110 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 64120 ======
one_epoch_time 225.4181263446808
INFO:Entity Linker:
=====Epoch Number: 83 =====
INFO:Entity Linker:
=====Loss: 0.3548 Step: 64130 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 64140 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 64150 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 64160 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 64170 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 64180 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 64190 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 64200 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 64210 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64220 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64230 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 64240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 64250 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64260 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 64270 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64280 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 64290 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 64300 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 64310 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64320 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 64330 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 64340 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 64350 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64360 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64370 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 64380 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 64390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64400 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 64410 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 64420 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 64430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64440 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 64450 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 64460 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 64470 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 64480 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 64490 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 64500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6022
INFO:Entity Linker:
==== Accuracy on dev after 64500 iterations: 0.5117
INFO:Entity Linker:Hierarchical Accuracy: 0.6056
INFO:Entity Linker:
==== Accuracy on test after 64500 iterations: 0.5204
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64510 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 64520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 64530 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 64540 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64550 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 64560 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 64570 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64580 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 64590 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 64600 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64610 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 64620 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 64630 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64640 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 64650 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 64660 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64670 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 64680 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 64690 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64700 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64710 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 64720 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 64730 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 64740 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 64750 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 64760 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 64770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 64780 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 64790 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64800 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64810 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 64820 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64830 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 64840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64860 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64870 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 64880 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 64890 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 64900 ======
one_epoch_time 219.83664631843567
INFO:Entity Linker:
=====Epoch Number: 84 =====
INFO:Entity Linker:
=====Loss: 0.3560 Step: 64910 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 64920 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 64930 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 64940 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 64950 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 64960 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 64970 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 64980 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 64990 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 65000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6011
INFO:Entity Linker:
==== Accuracy on dev after 65000 iterations: 0.5096
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65010 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 65020 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 65030 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65040 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 65050 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65060 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65070 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 65080 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 65090 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65100 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65110 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 65120 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 65130 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 65140 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65150 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 65160 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 65170 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 65180 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65190 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65200 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65210 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65220 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 65230 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65240 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 65250 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 65260 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65270 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65280 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65290 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 65300 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 65310 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 65320 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65330 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 65340 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 65350 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 65360 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 65370 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 65380 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 65390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 65400 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 65410 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 65420 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65430 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 65440 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 65450 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 65460 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 65470 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 65480 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 65490 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5945
INFO:Entity Linker:
==== Accuracy on dev after 65500 iterations: 0.5020
INFO:Entity Linker:
=====Loss: 0.3538 Step: 65510 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 65520 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65530 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 65540 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 65550 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65560 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 65570 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 65580 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65590 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65600 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65610 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65620 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 65630 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65640 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 65650 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 65660 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 65670 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 65680 ======
one_epoch_time 217.52614641189575
INFO:Entity Linker:
=====Epoch Number: 85 =====
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65690 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 65700 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 65710 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65720 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 65730 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 65740 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 65750 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 65760 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65770 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65780 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65790 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 65800 ======
INFO:Entity Linker:
=====Loss: 0.3528 Step: 65810 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 65830 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 65840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 65850 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 65860 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65870 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 65880 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 65890 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 65900 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 65910 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65920 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65930 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 65940 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65950 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 65960 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 65970 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 65980 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 65990 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 66000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6023
INFO:Entity Linker:
==== Accuracy on dev after 66000 iterations: 0.5110
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66010 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 66020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 66030 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 66040 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66050 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 66060 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66070 ======
INFO:Entity Linker:
=====Loss: 0.3523 Step: 66080 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66090 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66100 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66110 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66120 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 66130 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 66140 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 66150 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 66160 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 66170 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 66180 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 66190 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 66200 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 66210 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66220 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 66230 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 66240 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 66250 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 66260 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66280 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 66290 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 66300 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66310 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66330 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66340 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 66350 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 66360 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 66370 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66380 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 66390 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 66400 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66410 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66420 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 66430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66440 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 66450 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 66460 ======
one_epoch_time 215.60596537590027
INFO:Entity Linker:
=====Epoch Number: 86 =====
INFO:Entity Linker:
=====Loss: 0.3545 Step: 66470 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 66480 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 66490 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6003
INFO:Entity Linker:
==== Accuracy on dev after 66500 iterations: 0.5075
INFO:Entity Linker:
=====Loss: 0.3539 Step: 66510 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 66520 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 66530 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66540 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 66550 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 66560 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 66570 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66580 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 66590 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 66600 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66610 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66620 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 66630 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 66640 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 66650 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66660 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66670 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 66680 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 66690 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 66700 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66710 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 66720 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66730 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 66740 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66750 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 66760 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66770 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 66780 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 66790 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 66800 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 66810 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 66820 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 66830 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 66840 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66850 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 66860 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66870 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 66880 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 66890 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 66900 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66910 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66920 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 66930 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66940 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 66950 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 66960 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 66970 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66980 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 66990 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 67000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5997
INFO:Entity Linker:
==== Accuracy on dev after 67000 iterations: 0.5064
INFO:Entity Linker:
=====Loss: 0.3593 Step: 67010 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 67020 ======
INFO:Entity Linker:
=====Loss: 0.3525 Step: 67030 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 67050 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 67060 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67070 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 67080 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 67090 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67100 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 67110 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 67120 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67130 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67140 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 67150 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 67160 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 67170 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 67180 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 67190 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 67200 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67210 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 67220 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 67230 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 67240 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 67250 ======
one_epoch_time 217.98821234703064
INFO:Entity Linker:
=====Epoch Number: 87 =====
INFO:Entity Linker:
=====Loss: 0.3554 Step: 67260 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 67270 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 67280 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 67290 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67300 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 67310 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 67330 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 67340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67350 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 67360 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 67370 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67380 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 67390 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 67400 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 67410 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67420 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 67430 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 67440 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 67450 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 67460 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 67470 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 67480 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67490 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 67500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5987
INFO:Entity Linker:
==== Accuracy on dev after 67500 iterations: 0.5062
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67510 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 67520 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 67530 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67540 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 67550 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 67560 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67570 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 67580 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 67590 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 67600 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 67610 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67620 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 67630 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67640 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67650 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 67660 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67670 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 67680 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 67690 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 67700 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67710 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 67720 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 67730 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67740 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 67750 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 67760 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67770 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67780 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 67790 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67800 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67810 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67820 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67830 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67840 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67850 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67860 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 67870 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67880 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67890 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67900 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 67910 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 67920 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67930 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67940 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 67950 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 67960 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67970 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 67980 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 67990 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 68000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5974
INFO:Entity Linker:
==== Accuracy on dev after 68000 iterations: 0.5049
INFO:Entity Linker:
=====Loss: 0.3553 Step: 68010 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 68020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 68030 ======
one_epoch_time 220.31659817695618
INFO:Entity Linker:
=====Epoch Number: 88 =====
INFO:Entity Linker:
=====Loss: 0.3547 Step: 68040 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68050 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 68060 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68070 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68080 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68090 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68100 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68110 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 68120 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 68130 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 68140 ======
INFO:Entity Linker:
=====Loss: 0.3527 Step: 68150 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 68160 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68170 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68180 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 68190 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 68200 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 68210 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68220 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 68230 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 68240 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68250 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 68260 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 68270 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 68280 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 68290 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 68300 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68310 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 68320 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 68330 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 68340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68350 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 68360 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 68370 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68380 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68390 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68400 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 68410 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68420 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 68430 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 68440 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68460 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 68470 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 68480 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 68490 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 68500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6008
INFO:Entity Linker:
==== Accuracy on dev after 68500 iterations: 0.5096
INFO:Entity Linker:
=====Loss: 0.3568 Step: 68510 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 68520 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68530 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68540 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 68550 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 68560 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 68570 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68580 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 68590 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 68600 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68610 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 68620 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68630 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68640 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68650 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 68660 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68670 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 68680 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 68690 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 68700 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68710 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 68720 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 68730 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 68740 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 68750 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68760 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 68770 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68780 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 68790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 68800 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 68810 ======
one_epoch_time 218.7773118019104
INFO:Entity Linker:
=====Epoch Number: 89 =====
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68820 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 68830 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 68840 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68850 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68860 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 68870 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 68880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68890 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 68900 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 68910 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68920 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 68930 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 68940 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 68950 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68960 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 68970 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68980 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 68990 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6013
INFO:Entity Linker:
==== Accuracy on dev after 69000 iterations: 0.5079
INFO:Entity Linker:
=====Loss: 0.3554 Step: 69010 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69020 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 69030 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 69040 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 69050 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 69060 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 69070 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69080 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69090 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69110 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 69120 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 69130 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 69140 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 69150 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 69160 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 69170 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 69180 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 69190 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69200 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 69210 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69220 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 69230 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 69240 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 69250 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 69260 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69270 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 69280 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 69290 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 69300 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69310 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 69320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69330 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 69340 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69350 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 69360 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 69370 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 69380 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 69390 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 69400 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 69410 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 69420 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 69440 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 69450 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69460 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69470 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 69480 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 69490 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 69500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5985
INFO:Entity Linker:
==== Accuracy on dev after 69500 iterations: 0.5052
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69510 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 69520 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69530 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 69540 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 69550 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69560 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69570 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 69580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 69590 ======
one_epoch_time 226.10751700401306
INFO:Entity Linker:
=====Epoch Number: 90 =====
INFO:Entity Linker:
=====Loss: 0.3544 Step: 69600 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 69610 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 69620 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69630 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 69650 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 69660 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 69670 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69680 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 69690 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69700 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 69710 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 69720 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 69730 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 69740 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 69750 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 69760 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 69770 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 69780 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 69790 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 69800 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 69810 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69820 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 69830 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 69840 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 69850 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69860 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 69870 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 69880 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 69890 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 69900 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 69910 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 69920 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 69930 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 69940 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69950 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 69960 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 69970 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69980 ======
INFO:Entity Linker:
=====Loss: 0.3528 Step: 69990 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 70000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5986
INFO:Entity Linker:
==== Accuracy on dev after 70000 iterations: 0.5059
INFO:Entity Linker:
=====Loss: 0.3548 Step: 70010 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 70020 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 70030 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 70040 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 70050 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 70060 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 70070 ======
INFO:Entity Linker:
=====Loss: 0.3526 Step: 70080 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 70090 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 70100 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 70110 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 70120 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 70130 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 70140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 70150 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 70160 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 70170 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 70180 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 70190 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 70200 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 70210 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 70220 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 70230 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 70240 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 70250 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 70260 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 70270 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 70280 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 70290 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 70300 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 70310 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 70320 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 70330 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 70340 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 70350 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 70360 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 70370 ======
one_epoch_time 214.9558563232422
INFO:Entity Linker:
=====Epoch Number: 91 =====
INFO:Entity Linker:
=====Loss: 0.3546 Step: 70380 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 70390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 70400 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 70410 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 70420 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 70430 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 70440 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 70450 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 70460 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 70470 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 70480 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 70490 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 70500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5989
INFO:Entity Linker:
==== Accuracy on dev after 70500 iterations: 0.5038
INFO:Entity Linker:
=====Loss: 0.3564 Step: 70510 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 70520 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 70530 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 70540 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 70550 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 70560 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 70570 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 70580 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 70590 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 70600 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 70610 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 70620 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 70630 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 70640 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 70650 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 70660 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 70670 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 70680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 70690 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 70700 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 70710 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 70720 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 70730 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 70740 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 70750 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 70760 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 70770 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 70780 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 70790 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 70800 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 70810 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 70820 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 70830 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 70840 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 70850 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 70860 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 70870 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 70880 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 70890 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 70900 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 70910 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 70920 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 70930 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 70940 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 70950 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 70960 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 70970 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 70980 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 70990 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 71000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5989
INFO:Entity Linker:
==== Accuracy on dev after 71000 iterations: 0.5081
INFO:Entity Linker:
=====Loss: 0.3550 Step: 71010 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 71020 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 71030 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 71040 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 71050 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 71060 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 71070 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 71080 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 71090 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 71100 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71110 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 71120 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 71130 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 71140 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 71150 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 71160 ======
one_epoch_time 198.2945568561554
INFO:Entity Linker:
=====Epoch Number: 92 =====
INFO:Entity Linker:
=====Loss: 0.3559 Step: 71170 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 71180 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 71190 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 71200 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 71210 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 71220 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 71230 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 71240 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 71250 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 71260 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 71270 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 71280 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 71290 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 71300 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 71310 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 71320 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 71330 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 71340 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 71350 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 71360 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 71370 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 71380 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 71390 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 71400 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 71410 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 71420 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 71430 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 71440 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 71450 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 71460 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 71470 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 71480 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 71490 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5981
INFO:Entity Linker:
==== Accuracy on dev after 71500 iterations: 0.5065
INFO:Entity Linker:
=====Loss: 0.3534 Step: 71510 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 71520 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 71530 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 71540 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 71550 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 71560 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 71570 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 71580 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 71590 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 71600 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 71610 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 71620 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 71630 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 71640 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 71650 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71660 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 71670 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 71680 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 71690 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 71700 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 71710 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 71720 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 71730 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 71740 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 71750 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 71760 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71770 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 71780 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 71790 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 71800 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71810 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 71820 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 71830 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 71840 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 71850 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 71860 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 71870 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 71880 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 71890 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 71900 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 71910 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 71920 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 71930 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 71940 ======
one_epoch_time 202.57570147514343
INFO:Entity Linker:
=====Epoch Number: 93 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71950 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 71960 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 71970 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 71980 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 71990 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 72000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5976
INFO:Entity Linker:
==== Accuracy on dev after 72000 iterations: 0.5040
INFO:Entity Linker:
=====Loss: 0.3534 Step: 72010 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 72020 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 72030 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 72040 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 72050 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 72060 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 72070 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 72080 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 72090 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 72100 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 72110 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 72120 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 72130 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 72140 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 72150 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 72160 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 72170 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 72180 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 72190 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 72200 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 72210 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 72220 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 72230 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 72240 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 72250 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 72260 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 72270 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 72280 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 72290 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 72300 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 72310 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 72320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 72330 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 72340 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 72350 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 72360 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 72370 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 72380 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 72390 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 72400 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 72410 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 72420 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 72430 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 72440 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 72450 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 72460 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 72470 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 72480 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 72490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 72500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5994
INFO:Entity Linker:
==== Accuracy on dev after 72500 iterations: 0.5052
INFO:Entity Linker:
=====Loss: 0.3586 Step: 72510 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 72520 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 72530 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 72540 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 72550 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 72560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 72570 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 72580 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 72590 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 72600 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 72610 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 72620 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 72630 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 72640 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 72650 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 72660 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 72670 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 72680 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 72690 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 72700 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 72710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 72720 ======
one_epoch_time 218.43661236763
INFO:Entity Linker:
=====Epoch Number: 94 =====
INFO:Entity Linker:
=====Loss: 0.3558 Step: 72730 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 72740 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 72750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 72760 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 72770 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 72780 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 72790 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 72800 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 72810 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 72820 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 72830 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 72840 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 72850 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 72860 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 72870 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 72880 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 72890 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 72900 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 72910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 72920 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 72930 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 72940 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 72950 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 72960 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 72970 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 72980 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 72990 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 73000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6003
INFO:Entity Linker:
==== Accuracy on dev after 73000 iterations: 0.5089
INFO:Entity Linker:
=====Loss: 0.3548 Step: 73010 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 73020 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 73030 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 73040 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 73050 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 73060 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 73070 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 73080 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 73090 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 73100 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 73110 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 73120 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 73130 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 73140 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 73150 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 73160 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 73170 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 73180 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 73190 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 73200 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 73210 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 73220 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 73230 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 73240 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 73250 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 73260 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 73270 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 73280 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 73290 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 73300 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 73310 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 73320 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 73330 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 73340 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 73350 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 73360 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 73370 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 73380 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 73390 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 73400 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 73410 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 73420 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 73430 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 73440 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 73450 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 73460 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 73470 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 73480 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 73490 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 73500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6024
INFO:Entity Linker:
==== Accuracy on dev after 73500 iterations: 0.5100
one_epoch_time 204.1274836063385
INFO:Entity Linker:
=====Epoch Number: 95 =====
INFO:Entity Linker:
=====Loss: 0.3551 Step: 73510 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 73520 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 73530 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 73540 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 73550 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 73560 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 73570 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 73580 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 73590 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 73600 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 73610 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 73620 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 73630 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 73640 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 73650 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 73660 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 73670 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 73680 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 73690 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 73700 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 73710 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 73720 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 73730 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 73740 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 73750 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 73760 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 73770 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 73780 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 73790 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 73800 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 73810 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 73820 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 73830 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 73840 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 73850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 73860 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 73870 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 73880 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 73890 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 73900 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 73910 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 73920 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 73930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 73940 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 73950 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 73960 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 73970 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 73980 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 73990 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 74000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6032
INFO:Entity Linker:
==== Accuracy on dev after 74000 iterations: 0.5099
INFO:Entity Linker:
=====Loss: 0.3605 Step: 74010 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 74020 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 74030 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 74040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 74050 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 74060 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 74070 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 74080 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 74090 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 74100 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 74110 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 74120 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 74130 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 74140 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 74150 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 74160 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 74170 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 74180 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 74190 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 74200 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 74210 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 74220 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 74230 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 74240 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 74250 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 74260 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 74270 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 74280 ======
one_epoch_time 176.30534434318542
INFO:Entity Linker:
=====Epoch Number: 96 =====
INFO:Entity Linker:
=====Loss: 0.3549 Step: 74290 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 74300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 74310 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 74320 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 74330 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 74340 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 74350 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 74360 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 74370 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 74380 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 74390 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 74400 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 74410 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 74420 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 74430 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 74440 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 74450 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 74460 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 74470 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 74480 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 74490 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 74500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5964
INFO:Entity Linker:
==== Accuracy on dev after 74500 iterations: 0.5028
INFO:Entity Linker:
=====Loss: 0.3555 Step: 74510 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 74520 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 74530 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 74540 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 74550 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 74560 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 74570 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 74580 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 74590 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 74600 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 74610 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 74620 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 74630 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 74640 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 74650 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 74660 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 74670 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 74680 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 74690 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 74700 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 74710 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 74720 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 74730 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 74740 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 74750 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 74760 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 74770 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 74780 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 74790 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 74800 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 74810 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 74820 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 74830 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 74840 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 74850 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 74860 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 74870 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 74880 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 74890 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 74900 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 74910 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 74920 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 74930 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 74940 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 74950 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 74960 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 74970 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 74980 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 74990 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 75000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6018
INFO:Entity Linker:
==== Accuracy on dev after 75000 iterations: 0.5090
INFO:Entity Linker:
=====Loss: 0.3558 Step: 75010 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 75020 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 75030 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 75040 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 75050 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 75060 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 75070 ======
one_epoch_time 183.48755884170532
INFO:Entity Linker:
=====Epoch Number: 97 =====
INFO:Entity Linker:
=====Loss: 0.3547 Step: 75080 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 75090 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 75100 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 75110 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 75120 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 75130 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 75140 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 75150 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 75160 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 75170 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 75180 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 75190 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 75200 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 75210 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 75220 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 75230 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 75240 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 75250 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 75260 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 75270 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 75280 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 75290 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 75300 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 75310 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 75320 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75330 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 75340 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 75350 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 75360 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 75370 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 75380 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 75390 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 75400 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 75410 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 75420 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 75430 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 75440 ======
INFO:Entity Linker:
=====Loss: 0.3526 Step: 75450 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 75460 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75470 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 75480 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 75490 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 75500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6039
INFO:Entity Linker:
==== Accuracy on dev after 75500 iterations: 0.5123
INFO:Entity Linker:Hierarchical Accuracy: 0.6061
INFO:Entity Linker:
==== Accuracy on test after 75500 iterations: 0.5184
INFO:Entity Linker:
=====Loss: 0.3573 Step: 75510 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 75520 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 75530 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 75540 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 75550 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 75560 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 75570 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75580 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 75590 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 75600 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 75610 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 75620 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 75630 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 75640 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 75650 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 75660 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 75670 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 75680 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75690 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 75700 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 75710 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 75720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 75730 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 75740 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 75750 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 75760 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 75770 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 75780 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 75790 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 75800 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 75810 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75820 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 75830 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 75840 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 75850 ======
one_epoch_time 207.6132206916809
INFO:Entity Linker:
=====Epoch Number: 98 =====
INFO:Entity Linker:
=====Loss: 0.3545 Step: 75860 ======
INFO:Entity Linker:
=====Loss: 0.3527 Step: 75870 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75880 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 75890 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 75900 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 75910 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 75920 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75930 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 75940 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 75950 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 75960 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 75970 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 75980 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 75990 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 76000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6025
INFO:Entity Linker:
==== Accuracy on dev after 76000 iterations: 0.5098
INFO:Entity Linker:
=====Loss: 0.3549 Step: 76010 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 76020 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 76030 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 76040 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 76050 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 76060 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 76070 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 76080 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 76090 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 76100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 76110 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 76120 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 76130 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 76140 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 76150 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 76160 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 76170 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 76180 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 76190 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 76200 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 76210 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 76220 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 76230 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 76240 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 76250 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 76260 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 76270 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 76280 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 76290 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 76300 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 76310 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 76320 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 76330 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 76340 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 76350 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 76360 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 76370 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 76380 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 76390 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 76400 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 76410 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 76420 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 76430 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 76440 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 76450 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 76460 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 76470 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 76480 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 76490 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 76500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5991
INFO:Entity Linker:
==== Accuracy on dev after 76500 iterations: 0.5067
INFO:Entity Linker:
=====Loss: 0.3584 Step: 76510 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 76520 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 76530 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 76540 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 76550 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 76560 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 76570 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 76580 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 76590 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 76600 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 76610 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 76620 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 76630 ======
one_epoch_time 218.84179615974426
INFO:Entity Linker:
=====Epoch Number: 99 =====
INFO:Entity Linker:
=====Loss: 0.3549 Step: 76640 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 76650 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 76660 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 76670 ======
INFO:Entity Linker:
=====Loss: 0.3525 Step: 76680 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 76690 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 76700 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 76710 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 76720 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 76730 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 76740 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 76750 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 76760 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 76770 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 76780 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 76790 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 76800 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 76810 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 76820 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 76830 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 76840 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 76850 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 76860 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 76870 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 76880 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 76890 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 76900 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 76910 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 76920 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 76930 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 76940 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 76950 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 76960 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 76970 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 76980 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 76990 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 77000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6021
INFO:Entity Linker:
==== Accuracy on dev after 77000 iterations: 0.5113
INFO:Entity Linker:
=====Loss: 0.3563 Step: 77010 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 77020 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 77030 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 77040 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 77050 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 77060 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 77070 ======
INFO:Entity Linker:
=====Loss: 0.3527 Step: 77080 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 77090 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 77100 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 77110 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 77120 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 77130 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 77140 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 77150 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 77160 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 77170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 77180 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 77190 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 77200 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 77210 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 77220 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 77230 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 77240 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 77250 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 77260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 77270 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 77280 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 77290 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 77300 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 77310 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 77320 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 77330 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 77340 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 77350 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 77360 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 77370 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 77380 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 77390 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 77400 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 77410 ======
one_epoch_time 213.28386926651
INFO:Entity Linker:
=====Epoch Number: 100 =====
INFO:Entity Linker:
=====Loss: 0.3550 Step: 77420 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 77430 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 77440 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 77450 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 77460 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 77470 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 77480 ======
INFO:Entity Linker:
=====Loss: 0.3527 Step: 77490 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 77500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5972
INFO:Entity Linker:
==== Accuracy on dev after 77500 iterations: 0.5042
INFO:Entity Linker:
=====Loss: 0.3561 Step: 77510 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 77520 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 77530 ======
INFO:Entity Linker:
=====Loss: 0.3523 Step: 77540 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 77550 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 77560 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 77570 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 77580 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 77590 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 77600 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 77610 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 77620 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 77630 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 77640 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 77650 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 77660 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 77670 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 77680 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 77690 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 77700 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 77710 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 77720 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 77730 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 77740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 77750 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 77760 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 77770 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 77780 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 77790 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 77800 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 77810 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 77820 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 77830 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 77840 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 77850 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 77860 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 77870 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 77880 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 77890 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 77900 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 77910 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 77920 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 77930 ======
INFO:Entity Linker:
=====Loss: 0.3524 Step: 77940 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 77950 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 77960 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 77970 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 77980 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 77990 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 78000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6036
INFO:Entity Linker:
==== Accuracy on dev after 78000 iterations: 0.5118
INFO:Entity Linker:
=====Loss: 0.3558 Step: 78010 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 78020 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 78030 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 78040 ======
INFO:Entity Linker:
=====Loss: 0.3526 Step: 78050 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 78060 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 78070 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 78080 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 78090 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 78100 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 78110 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 78120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 78130 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 78140 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 78150 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 78160 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 78170 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 78180 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 78190 ======
one_epoch_time 213.57466292381287
INFO:Entity Linker:Hierarchical Accuracy: 0.6004
INFO:Entity Linker:
===== Training Finished! =====
INFO:Entity Linker:
===== Accuracy on Test: 0.5126
INFO:Entity Linker:
====================EVALUATION STARTED====================
INFO:Entity Linker:Hierarchical Accuracy: 0.6004
INFO:Entity Linker:Hierarchical Accuracy: 0.5994
INFO:Entity Linker:
: Dev accuracy 0.5063
INFO:Entity Linker:
: Test accuracy 0.5126
/var/autofs/cl/work/hiroshi-ho/OriginalHT_20190420/src/general_utils.py:111: UserWarning: torch.nn.utils.clip_grad_norm is now deprecated in favor of torch.nn.utils.clip_grad_norm_.
torch.nn.utils.clip_grad_norm(model.parameters(), clip_val)
dataset umls
dropout 0.5
train 1
bag_size 10
encoder position_cnn
struct_weight 0.5
typing_weight 0
multilabel_linking 0
parent_sample_size 100
bilinear_l2 0.0005
bilinear_bias 0
complex 1
asymmetric 1
learn_graph 1
priors 1
model_name complex1asym1ep100.model
base_dir ./dataset_dir
lr 0.001
beta1 0.9
beta2 0.999
epsilon 1e-08
weight_decay 0.0
save_model 1
clip_val 5
embedding_dim 300
hidden_dim 150
num_epochs 100
kernel_width 5
batch_size 256
take_frac 1.0
use_transitive 1
size of training data: 199977.0000
INFO:Entity Linker:
Number of words in vocab: 2195877
INFO:Entity Linker:
Number of entities in vocab: 25507
INFO:Entity Linker:
Number of types in vocab: 0
Using position embeddings with CNN
INFO:Entity Linker:
====================TRAINING STARTED====================
char_feature_weight True
model_feature_weight True
relation_real True
relation_img True
encoder.position_embeddings.weight True
encoder.conv.weight True
encoder.conv.bias True
encoder.affine1.weight True
encoder.affine1.bias True
encoder.affine3.weight True
encoder.affine3.bias True
encoder.affine2.weight True
encoder.affine2.bias True
entity_embeddings_real.weight True
entity_embeddings_img.weight True
encoder_real_mlp.weight True
encoder_real_mlp.bias True
encoder_img_mlp.weight True
encoder_img_mlp.bias True
INFO:Entity Linker:Hierarchical Accuracy: 0.0019
INFO:Entity Linker:
==== Initial accuracy: 0.0001
INFO:Entity Linker:
=====Epoch Number: 1 =====
INFO:Entity Linker:
=====Loss: 1.0695 Step: 0 ======
INFO:Entity Linker:
=====Loss: 0.4748 Step: 10 ======
INFO:Entity Linker:
=====Loss: 0.4474 Step: 20 ======
INFO:Entity Linker:
=====Loss: 0.4901 Step: 30 ======
INFO:Entity Linker:
=====Loss: 0.4223 Step: 40 ======
INFO:Entity Linker:
=====Loss: 0.4224 Step: 50 ======
INFO:Entity Linker:
=====Loss: 0.4510 Step: 60 ======
INFO:Entity Linker:
=====Loss: 0.4253 Step: 70 ======
INFO:Entity Linker:
=====Loss: 0.4163 Step: 80 ======
INFO:Entity Linker:
=====Loss: 0.4388 Step: 90 ======
INFO:Entity Linker:
=====Loss: 0.4009 Step: 100 ======
INFO:Entity Linker:
=====Loss: 0.4072 Step: 110 ======
INFO:Entity Linker:
=====Loss: 0.4347 Step: 120 ======
INFO:Entity Linker:
=====Loss: 0.4077 Step: 130 ======
INFO:Entity Linker:
=====Loss: 0.4013 Step: 140 ======
INFO:Entity Linker:
=====Loss: 0.4010 Step: 150 ======
INFO:Entity Linker:
=====Loss: 0.4062 Step: 160 ======
INFO:Entity Linker:
=====Loss: 0.4185 Step: 170 ======
INFO:Entity Linker:
=====Loss: 0.3961 Step: 180 ======
INFO:Entity Linker:
=====Loss: 0.3888 Step: 190 ======
INFO:Entity Linker:
=====Loss: 0.3927 Step: 200 ======
INFO:Entity Linker:
=====Loss: 0.3918 Step: 210 ======
INFO:Entity Linker:
=====Loss: 0.3885 Step: 220 ======
INFO:Entity Linker:
=====Loss: 0.3930 Step: 230 ======
INFO:Entity Linker:
=====Loss: 0.3963 Step: 240 ======
INFO:Entity Linker:
=====Loss: 0.3851 Step: 250 ======
INFO:Entity Linker:
=====Loss: 0.3938 Step: 260 ======
INFO:Entity Linker:
=====Loss: 0.3909 Step: 270 ======
INFO:Entity Linker:
=====Loss: 0.3844 Step: 280 ======
INFO:Entity Linker:
=====Loss: 0.3876 Step: 290 ======
INFO:Entity Linker:
=====Loss: 0.3829 Step: 300 ======
INFO:Entity Linker:
=====Loss: 0.3913 Step: 310 ======
INFO:Entity Linker:
=====Loss: 0.4160 Step: 320 ======
INFO:Entity Linker:
=====Loss: 0.3871 Step: 330 ======
INFO:Entity Linker:
=====Loss: 0.4038 Step: 340 ======
INFO:Entity Linker:
=====Loss: 0.3810 Step: 350 ======
INFO:Entity Linker:
=====Loss: 0.3952 Step: 360 ======
INFO:Entity Linker:
=====Loss: 0.3948 Step: 370 ======
INFO:Entity Linker:
=====Loss: 0.3789 Step: 380 ======
INFO:Entity Linker:
=====Loss: 0.3812 Step: 390 ======
INFO:Entity Linker:
=====Loss: 0.3814 Step: 400 ======
INFO:Entity Linker:
=====Loss: 0.3855 Step: 410 ======
INFO:Entity Linker:
=====Loss: 0.3937 Step: 420 ======
INFO:Entity Linker:
=====Loss: 0.3756 Step: 430 ======
INFO:Entity Linker:
=====Loss: 0.3790 Step: 440 ======
INFO:Entity Linker:
=====Loss: 0.3788 Step: 450 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 460 ======
INFO:Entity Linker:
=====Loss: 0.3771 Step: 470 ======
INFO:Entity Linker:
=====Loss: 0.3836 Step: 480 ======
INFO:Entity Linker:
=====Loss: 0.3786 Step: 490 ======
INFO:Entity Linker:
=====Loss: 0.3973 Step: 500 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 510 ======
INFO:Entity Linker:
=====Loss: 0.3746 Step: 520 ======
INFO:Entity Linker:
=====Loss: 0.3865 Step: 530 ======
INFO:Entity Linker:
=====Loss: 0.3988 Step: 540 ======
INFO:Entity Linker:
=====Loss: 0.3796 Step: 550 ======
INFO:Entity Linker:
=====Loss: 0.3721 Step: 560 ======
INFO:Entity Linker:
=====Loss: 0.3884 Step: 570 ======
INFO:Entity Linker:
=====Loss: 0.3794 Step: 580 ======
INFO:Entity Linker:
=====Loss: 0.3756 Step: 590 ======
INFO:Entity Linker:
=====Loss: 0.3783 Step: 600 ======
INFO:Entity Linker:
=====Loss: 0.3829 Step: 610 ======
INFO:Entity Linker:
=====Loss: 0.3736 Step: 620 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 630 ======
INFO:Entity Linker:
=====Loss: 0.3938 Step: 640 ======
INFO:Entity Linker:
=====Loss: 0.3738 Step: 650 ======
INFO:Entity Linker:
=====Loss: 0.3781 Step: 660 ======
INFO:Entity Linker:
=====Loss: 0.3753 Step: 670 ======
INFO:Entity Linker:
=====Loss: 0.3766 Step: 680 ======
INFO:Entity Linker:
=====Loss: 0.3836 Step: 690 ======
INFO:Entity Linker:
=====Loss: 0.3848 Step: 700 ======
INFO:Entity Linker:
=====Loss: 0.3737 Step: 710 ======
INFO:Entity Linker:
=====Loss: 0.3770 Step: 720 ======
INFO:Entity Linker:
=====Loss: 0.3839 Step: 730 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 740 ======
INFO:Entity Linker:
=====Loss: 0.3726 Step: 750 ======
INFO:Entity Linker:
=====Loss: 0.3768 Step: 760 ======
INFO:Entity Linker:
=====Loss: 0.3750 Step: 770 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 780 ======
one_epoch_time 200.74145102500916
INFO:Entity Linker:
=====Epoch Number: 2 =====
INFO:Entity Linker:
=====Loss: 0.3859 Step: 790 ======
INFO:Entity Linker:
=====Loss: 0.3904 Step: 800 ======
INFO:Entity Linker:
=====Loss: 0.3768 Step: 810 ======
INFO:Entity Linker:
=====Loss: 0.3779 Step: 820 ======
INFO:Entity Linker:
=====Loss: 0.3761 Step: 830 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 840 ======
INFO:Entity Linker:
=====Loss: 0.3715 Step: 850 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 860 ======
INFO:Entity Linker:
=====Loss: 0.3933 Step: 870 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 880 ======
INFO:Entity Linker:
=====Loss: 0.3836 Step: 890 ======
INFO:Entity Linker:
=====Loss: 0.3729 Step: 900 ======
INFO:Entity Linker:
=====Loss: 0.3892 Step: 910 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 920 ======
INFO:Entity Linker:
=====Loss: 0.3739 Step: 930 ======
INFO:Entity Linker:
=====Loss: 0.3777 Step: 940 ======
INFO:Entity Linker:
=====Loss: 0.3763 Step: 950 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 960 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 970 ======
INFO:Entity Linker:
=====Loss: 0.3764 Step: 980 ======
INFO:Entity Linker:
=====Loss: 0.3801 Step: 990 ======
INFO:Entity Linker:
=====Loss: 0.3767 Step: 1000 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 1010 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 1020 ======
INFO:Entity Linker:
=====Loss: 0.3760 Step: 1030 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 1040 ======
INFO:Entity Linker:
=====Loss: 0.3770 Step: 1050 ======
INFO:Entity Linker:
=====Loss: 0.3844 Step: 1060 ======
INFO:Entity Linker:
=====Loss: 0.3741 Step: 1070 ======
INFO:Entity Linker:
=====Loss: 0.3732 Step: 1080 ======
INFO:Entity Linker:
=====Loss: 0.3722 Step: 1090 ======
INFO:Entity Linker:
=====Loss: 0.3719 Step: 1100 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 1110 ======
INFO:Entity Linker:
=====Loss: 0.3790 Step: 1120 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 1130 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 1140 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 1150 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 1160 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 1170 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 1180 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 1190 ======
INFO:Entity Linker:
=====Loss: 0.3708 Step: 1200 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 1210 ======
INFO:Entity Linker:
=====Loss: 0.3865 Step: 1220 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 1230 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 1240 ======
INFO:Entity Linker:
=====Loss: 0.3714 Step: 1250 ======
INFO:Entity Linker:
=====Loss: 0.3780 Step: 1260 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 1270 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 1280 ======
INFO:Entity Linker:
=====Loss: 0.3767 Step: 1290 ======
INFO:Entity Linker:
=====Loss: 0.3721 Step: 1300 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 1310 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 1320 ======
INFO:Entity Linker:
=====Loss: 0.3721 Step: 1330 ======
INFO:Entity Linker:
=====Loss: 0.3805 Step: 1340 ======
INFO:Entity Linker:
=====Loss: 0.3778 Step: 1350 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 1360 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 1370 ======
INFO:Entity Linker:
=====Loss: 0.3747 Step: 1380 ======
INFO:Entity Linker:
=====Loss: 0.3849 Step: 1390 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 1400 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 1410 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 1420 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 1430 ======
INFO:Entity Linker:
=====Loss: 0.3728 Step: 1440 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 1450 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 1460 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 1470 ======
INFO:Entity Linker:
=====Loss: 0.3690 Step: 1480 ======
INFO:Entity Linker:
=====Loss: 0.3787 Step: 1490 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 1500 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 1510 ======
INFO:Entity Linker:
=====Loss: 0.3804 Step: 1520 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 1530 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 1540 ======
INFO:Entity Linker:
=====Loss: 0.3826 Step: 1550 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 1560 ======
one_epoch_time 185.9005572795868
INFO:Entity Linker:
=====Epoch Number: 3 =====
INFO:Entity Linker:
=====Loss: 0.3674 Step: 1570 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 1580 ======
INFO:Entity Linker:
=====Loss: 0.3766 Step: 1590 ======
INFO:Entity Linker:
=====Loss: 0.3759 Step: 1600 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 1610 ======
INFO:Entity Linker:
=====Loss: 0.3717 Step: 1620 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 1630 ======
INFO:Entity Linker:
=====Loss: 0.3695 Step: 1640 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 1650 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 1660 ======
INFO:Entity Linker:
=====Loss: 0.3712 Step: 1670 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 1680 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 1690 ======
INFO:Entity Linker:
=====Loss: 0.3746 Step: 1700 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 1710 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 1720 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 1730 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 1740 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 1750 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 1760 ======
INFO:Entity Linker:
=====Loss: 0.3775 Step: 1770 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 1780 ======
INFO:Entity Linker:
=====Loss: 0.3802 Step: 1790 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 1800 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 1810 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 1820 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 1830 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 1840 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 1850 ======
INFO:Entity Linker:
=====Loss: 0.3869 Step: 1860 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 1870 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 1880 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 1890 ======
INFO:Entity Linker:
=====Loss: 0.3730 Step: 1900 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 1910 ======
INFO:Entity Linker:
=====Loss: 0.3762 Step: 1920 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 1930 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 1940 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 1950 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 1960 ======
INFO:Entity Linker:
=====Loss: 0.3841 Step: 1970 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 1980 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 1990 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 2000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4282
INFO:Entity Linker:
==== Accuracy on dev after 2000 iterations: 0.3432
INFO:Entity Linker:Hierarchical Accuracy: 0.4236
INFO:Entity Linker:
==== Accuracy on test after 2000 iterations: 0.3354
INFO:Entity Linker:
=====Loss: 0.3733 Step: 2010 ======
INFO:Entity Linker:
=====Loss: 0.3729 Step: 2020 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 2030 ======
INFO:Entity Linker:
=====Loss: 0.3722 Step: 2040 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 2050 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 2060 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 2070 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 2080 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 2090 ======
INFO:Entity Linker:
=====Loss: 0.3715 Step: 2100 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 2110 ======
INFO:Entity Linker:
=====Loss: 0.3755 Step: 2120 ======
INFO:Entity Linker:
=====Loss: 0.3759 Step: 2130 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 2140 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 2150 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 2160 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 2170 ======
INFO:Entity Linker:
=====Loss: 0.3698 Step: 2180 ======
INFO:Entity Linker:
=====Loss: 0.3692 Step: 2190 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 2200 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 2210 ======
INFO:Entity Linker:
=====Loss: 0.3786 Step: 2220 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 2230 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 2240 ======
INFO:Entity Linker:
=====Loss: 0.3694 Step: 2250 ======
INFO:Entity Linker:
=====Loss: 0.3707 Step: 2260 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 2270 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 2280 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 2290 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 2300 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 2310 ======
INFO:Entity Linker:
=====Loss: 0.3760 Step: 2320 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 2330 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 2340 ======
one_epoch_time 181.93391942977905
INFO:Entity Linker:
=====Epoch Number: 4 =====
INFO:Entity Linker:
=====Loss: 0.3683 Step: 2350 ======
INFO:Entity Linker:
=====Loss: 0.3743 Step: 2360 ======
INFO:Entity Linker:
=====Loss: 0.3705 Step: 2370 ======
INFO:Entity Linker:
=====Loss: 0.3696 Step: 2380 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 2390 ======
INFO:Entity Linker:
=====Loss: 0.3728 Step: 2400 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 2410 ======
INFO:Entity Linker:
=====Loss: 0.3745 Step: 2420 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 2430 ======
INFO:Entity Linker:
=====Loss: 0.3695 Step: 2440 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2450 ======
INFO:Entity Linker:
=====Loss: 0.3758 Step: 2460 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 2470 ======
INFO:Entity Linker:
=====Loss: 0.3752 Step: 2480 ======
INFO:Entity Linker:
=====Loss: 0.3697 Step: 2490 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4494
INFO:Entity Linker:
==== Accuracy on dev after 2500 iterations: 0.3579
INFO:Entity Linker:Hierarchical Accuracy: 0.4433
INFO:Entity Linker:
==== Accuracy on test after 2500 iterations: 0.3529
INFO:Entity Linker:
=====Loss: 0.3672 Step: 2510 ======
INFO:Entity Linker:
=====Loss: 0.3752 Step: 2520 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 2530 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 2540 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 2550 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 2560 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 2570 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 2580 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 2590 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 2600 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 2610 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 2620 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2630 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 2640 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 2650 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 2660 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 2670 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 2680 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 2690 ======
INFO:Entity Linker:
=====Loss: 0.3773 Step: 2700 ======
INFO:Entity Linker:
=====Loss: 0.3723 Step: 2710 ======
INFO:Entity Linker:
=====Loss: 0.3734 Step: 2720 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 2730 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 2740 ======
INFO:Entity Linker:
=====Loss: 0.3688 Step: 2750 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 2760 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 2770 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 2780 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 2790 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 2800 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 2810 ======
INFO:Entity Linker:
=====Loss: 0.3698 Step: 2820 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 2830 ======
INFO:Entity Linker:
=====Loss: 0.3706 Step: 2840 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 2850 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 2860 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 2870 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 2880 ======
INFO:Entity Linker:
=====Loss: 0.3775 Step: 2890 ======
INFO:Entity Linker:
=====Loss: 0.3733 Step: 2900 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 2910 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 2920 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 2930 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 2940 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 2950 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 2960 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 2970 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 2980 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 2990 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 3000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4579
INFO:Entity Linker:
==== Accuracy on dev after 3000 iterations: 0.3682
INFO:Entity Linker:Hierarchical Accuracy: 0.4513
INFO:Entity Linker:
==== Accuracy on test after 3000 iterations: 0.3625
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3010 ======
INFO:Entity Linker:
=====Loss: 0.3711 Step: 3020 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 3030 ======
INFO:Entity Linker:
=====Loss: 0.3682 Step: 3040 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3050 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 3060 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 3070 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 3080 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 3090 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 3100 ======
INFO:Entity Linker:
=====Loss: 0.3841 Step: 3110 ======
INFO:Entity Linker:
=====Loss: 0.3730 Step: 3120 ======
one_epoch_time 189.1564576625824
INFO:Entity Linker:
=====Epoch Number: 5 =====
INFO:Entity Linker:
=====Loss: 0.3708 Step: 3130 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3140 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 3150 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 3160 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3170 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 3180 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 3190 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 3200 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 3210 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 3220 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 3230 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 3240 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 3250 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3260 ======
INFO:Entity Linker:
=====Loss: 0.3726 Step: 3270 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 3280 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 3290 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 3300 ======
INFO:Entity Linker:
=====Loss: 0.3750 Step: 3310 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 3320 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 3330 ======
INFO:Entity Linker:
=====Loss: 0.3707 Step: 3340 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 3350 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 3360 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 3370 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 3380 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 3390 ======
INFO:Entity Linker:
=====Loss: 0.3717 Step: 3400 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 3410 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 3420 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 3430 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3440 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 3450 ======
INFO:Entity Linker:
=====Loss: 0.3832 Step: 3460 ======
INFO:Entity Linker:
=====Loss: 0.3807 Step: 3470 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 3480 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 3490 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4762
INFO:Entity Linker:
==== Accuracy on dev after 3500 iterations: 0.3873
INFO:Entity Linker:Hierarchical Accuracy: 0.4685
INFO:Entity Linker:
==== Accuracy on test after 3500 iterations: 0.3810
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3510 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 3520 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 3530 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 3540 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 3550 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 3560 ======
INFO:Entity Linker:
=====Loss: 0.3798 Step: 3570 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 3580 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 3590 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 3600 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 3610 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 3620 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 3630 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 3640 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3650 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 3660 ======
INFO:Entity Linker:
=====Loss: 0.3749 Step: 3670 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 3680 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3690 ======
INFO:Entity Linker:
=====Loss: 0.3695 Step: 3700 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 3710 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 3720 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 3730 ======
INFO:Entity Linker:
=====Loss: 0.3709 Step: 3740 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3750 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 3760 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3770 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 3780 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 3790 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 3800 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 3810 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 3820 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 3830 ======
INFO:Entity Linker:
=====Loss: 0.3718 Step: 3840 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 3850 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 3860 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 3870 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 3880 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 3890 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 3900 ======
one_epoch_time 177.86334037780762
INFO:Entity Linker:
=====Epoch Number: 6 =====
INFO:Entity Linker:
=====Loss: 0.3619 Step: 3910 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 3920 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 3930 ======
INFO:Entity Linker:
=====Loss: 0.3768 Step: 3940 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 3950 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 3960 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 3970 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 3980 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 3990 ======
INFO:Entity Linker:
=====Loss: 0.3700 Step: 4000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4732
INFO:Entity Linker:
==== Accuracy on dev after 4000 iterations: 0.3814
INFO:Entity Linker:
=====Loss: 0.3605 Step: 4010 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4020 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 4030 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 4040 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 4050 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 4060 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 4070 ======
INFO:Entity Linker:
=====Loss: 0.3731 Step: 4080 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 4090 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 4100 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4110 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 4120 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4130 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4140 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 4150 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 4160 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 4170 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 4180 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 4190 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 4200 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 4210 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 4220 ======
INFO:Entity Linker:
=====Loss: 0.3749 Step: 4230 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 4240 ======
INFO:Entity Linker:
=====Loss: 0.3720 Step: 4250 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 4260 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 4270 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 4280 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 4290 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 4300 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 4310 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 4320 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 4330 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4340 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4350 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 4360 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 4370 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 4380 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 4390 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 4400 ======
INFO:Entity Linker:
=====Loss: 0.3705 Step: 4410 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 4420 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 4430 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 4440 ======
INFO:Entity Linker:
=====Loss: 0.3737 Step: 4450 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 4460 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 4470 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 4480 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 4490 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 4500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.4960
INFO:Entity Linker:
==== Accuracy on dev after 4500 iterations: 0.4070
INFO:Entity Linker:Hierarchical Accuracy: 0.4920
INFO:Entity Linker:
==== Accuracy on test after 4500 iterations: 0.4045
INFO:Entity Linker:
=====Loss: 0.3642 Step: 4510 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 4520 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 4530 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 4540 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 4550 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 4560 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 4570 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 4580 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 4590 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 4600 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 4610 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 4620 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 4630 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 4640 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 4650 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 4660 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 4670 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 4680 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 4690 ======
one_epoch_time 215.85510396957397
INFO:Entity Linker:
=====Epoch Number: 7 =====
INFO:Entity Linker:
=====Loss: 0.3679 Step: 4700 ======
INFO:Entity Linker:
=====Loss: 0.3728 Step: 4710 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 4720 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 4730 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 4740 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 4750 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 4760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 4770 ======
INFO:Entity Linker:
=====Loss: 0.3748 Step: 4780 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 4790 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 4800 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4810 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 4820 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 4830 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 4840 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 4850 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 4860 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 4870 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 4880 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 4890 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 4900 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 4910 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 4920 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 4930 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 4940 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 4950 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 4960 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 4970 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 4980 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 4990 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 5000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5018
INFO:Entity Linker:
==== Accuracy on dev after 5000 iterations: 0.4137
INFO:Entity Linker:Hierarchical Accuracy: 0.5007
INFO:Entity Linker:
==== Accuracy on test after 5000 iterations: 0.4120
INFO:Entity Linker:
=====Loss: 0.3629 Step: 5010 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 5020 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 5030 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 5040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 5050 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 5060 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 5070 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 5080 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 5090 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 5100 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 5110 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 5120 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 5130 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 5140 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 5150 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 5160 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 5170 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 5180 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 5190 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 5200 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 5210 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 5220 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 5230 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 5240 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 5250 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 5260 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 5270 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 5280 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 5290 ======
INFO:Entity Linker:
=====Loss: 0.3701 Step: 5300 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 5310 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 5320 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 5330 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 5340 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 5350 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 5360 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 5370 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 5380 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 5390 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 5400 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 5410 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5420 ======
INFO:Entity Linker:
=====Loss: 0.3703 Step: 5430 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 5440 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 5450 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 5460 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 5470 ======
one_epoch_time 213.6846616268158
INFO:Entity Linker:
=====Epoch Number: 8 =====
INFO:Entity Linker:
=====Loss: 0.3616 Step: 5480 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 5490 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 5500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5049
INFO:Entity Linker:
==== Accuracy on dev after 5500 iterations: 0.4114
INFO:Entity Linker:
=====Loss: 0.3667 Step: 5510 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 5520 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 5530 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 5540 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5550 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 5560 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 5570 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 5580 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 5590 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 5600 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 5610 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 5620 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 5630 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 5640 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 5650 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 5660 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 5670 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 5680 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 5690 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 5700 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5710 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 5720 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 5730 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 5740 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 5750 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 5760 ======
INFO:Entity Linker:
=====Loss: 0.3727 Step: 5770 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 5780 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 5790 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 5800 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 5810 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 5820 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 5830 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 5840 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 5850 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 5860 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 5870 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 5880 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 5890 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 5900 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 5910 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 5920 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 5930 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 5940 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 5950 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 5960 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 5970 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 5980 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 5990 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 6000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5204
INFO:Entity Linker:
==== Accuracy on dev after 6000 iterations: 0.4285
INFO:Entity Linker:Hierarchical Accuracy: 0.5163
INFO:Entity Linker:
==== Accuracy on test after 6000 iterations: 0.4257
INFO:Entity Linker:
=====Loss: 0.3637 Step: 6010 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 6020 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 6030 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 6040 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 6050 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 6060 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 6070 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 6080 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 6090 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 6100 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 6110 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6120 ======
INFO:Entity Linker:
=====Loss: 0.3696 Step: 6130 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 6140 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 6150 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 6160 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 6170 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 6180 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 6190 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 6200 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 6210 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 6220 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 6230 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 6240 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 6250 ======
one_epoch_time 220.75161147117615
INFO:Entity Linker:
=====Epoch Number: 9 =====
INFO:Entity Linker:
=====Loss: 0.3620 Step: 6260 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6270 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 6280 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6290 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 6300 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 6310 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 6320 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 6330 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 6340 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 6350 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 6360 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 6370 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 6380 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 6390 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 6400 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 6410 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 6420 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 6430 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 6440 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 6450 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 6460 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6470 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 6480 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 6490 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5245
INFO:Entity Linker:
==== Accuracy on dev after 6500 iterations: 0.4311
INFO:Entity Linker:Hierarchical Accuracy: 0.5187
INFO:Entity Linker:
==== Accuracy on test after 6500 iterations: 0.4282
INFO:Entity Linker:
=====Loss: 0.3636 Step: 6510 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6520 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 6530 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 6540 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 6550 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 6560 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 6570 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 6580 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 6590 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 6600 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 6610 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 6620 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 6630 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 6640 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 6650 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 6660 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 6670 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 6680 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 6690 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 6700 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 6710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 6720 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 6730 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 6740 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 6750 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 6760 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 6770 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 6780 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 6790 ======
INFO:Entity Linker:
=====Loss: 0.3691 Step: 6800 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 6810 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 6820 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 6830 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 6840 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 6850 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 6860 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 6870 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 6880 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 6890 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 6900 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 6910 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 6920 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 6930 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 6940 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 6950 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 6960 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 6970 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 6980 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 6990 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 7000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5304
INFO:Entity Linker:
==== Accuracy on dev after 7000 iterations: 0.4369
INFO:Entity Linker:Hierarchical Accuracy: 0.5287
INFO:Entity Linker:
==== Accuracy on test after 7000 iterations: 0.4366
INFO:Entity Linker:
=====Loss: 0.3607 Step: 7010 ======
INFO:Entity Linker:
=====Loss: 0.3737 Step: 7020 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 7030 ======
one_epoch_time 222.97300910949707
INFO:Entity Linker:
=====Epoch Number: 10 =====
INFO:Entity Linker:
=====Loss: 0.3616 Step: 7040 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 7050 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 7060 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 7070 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 7080 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 7090 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 7100 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 7110 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 7120 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 7130 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 7140 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 7150 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 7160 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 7170 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 7180 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 7190 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 7200 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 7210 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 7220 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 7230 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 7240 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 7250 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 7260 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 7270 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 7280 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 7290 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 7300 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 7310 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 7320 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 7330 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 7340 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 7350 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 7360 ======
INFO:Entity Linker:
=====Loss: 0.3750 Step: 7370 ======
INFO:Entity Linker:
=====Loss: 0.3716 Step: 7380 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 7390 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 7400 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 7410 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 7420 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 7430 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 7440 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 7450 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 7460 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 7470 ======
INFO:Entity Linker:
=====Loss: 0.3713 Step: 7480 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 7490 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 7500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5364
INFO:Entity Linker:
==== Accuracy on dev after 7500 iterations: 0.4427
INFO:Entity Linker:Hierarchical Accuracy: 0.5305
INFO:Entity Linker:
==== Accuracy on test after 7500 iterations: 0.4394
INFO:Entity Linker:
=====Loss: 0.3630 Step: 7510 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 7520 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 7530 ======
INFO:Entity Linker:
=====Loss: 0.3688 Step: 7540 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 7550 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 7560 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 7570 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 7580 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 7590 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 7600 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 7610 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 7620 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 7630 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 7640 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 7650 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 7660 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 7670 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 7680 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 7690 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 7700 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 7710 ======
INFO:Entity Linker:
=====Loss: 0.3696 Step: 7720 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 7730 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 7740 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 7750 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 7760 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 7770 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 7780 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 7790 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 7800 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 7810 ======
one_epoch_time 218.61605620384216
INFO:Entity Linker:
=====Epoch Number: 11 =====
INFO:Entity Linker:
=====Loss: 0.3596 Step: 7820 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 7830 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 7840 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 7850 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 7860 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 7870 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 7880 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 7890 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 7900 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 7910 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 7920 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 7930 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 7940 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 7950 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 7960 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 7970 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 7980 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 7990 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 8000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5431
INFO:Entity Linker:
==== Accuracy on dev after 8000 iterations: 0.4482
INFO:Entity Linker:Hierarchical Accuracy: 0.5389
INFO:Entity Linker:
==== Accuracy on test after 8000 iterations: 0.4474
INFO:Entity Linker:
=====Loss: 0.3597 Step: 8010 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 8020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 8030 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 8040 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 8050 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 8060 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 8070 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 8080 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 8090 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8100 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 8110 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 8120 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 8130 ======
INFO:Entity Linker:
=====Loss: 0.3689 Step: 8140 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 8150 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 8160 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 8170 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 8180 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 8190 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 8200 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 8210 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 8220 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 8230 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 8240 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 8250 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 8260 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 8270 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 8280 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 8290 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 8300 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 8310 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 8320 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 8330 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 8340 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 8350 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 8360 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8370 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 8380 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 8390 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 8400 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 8410 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 8420 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 8430 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8440 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 8450 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 8460 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 8470 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 8480 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 8490 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 8500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5449
INFO:Entity Linker:
==== Accuracy on dev after 8500 iterations: 0.4503
INFO:Entity Linker:Hierarchical Accuracy: 0.5420
INFO:Entity Linker:
==== Accuracy on test after 8500 iterations: 0.4508
INFO:Entity Linker:
=====Loss: 0.3647 Step: 8510 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 8520 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 8530 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 8540 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 8550 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 8560 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 8570 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 8580 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 8590 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 8600 ======
one_epoch_time 227.9536702632904
INFO:Entity Linker:
=====Epoch Number: 12 =====
INFO:Entity Linker:
=====Loss: 0.3641 Step: 8610 ======
INFO:Entity Linker:
=====Loss: 0.3702 Step: 8620 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 8630 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 8640 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 8650 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 8660 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 8670 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 8680 ======
INFO:Entity Linker:
=====Loss: 0.3710 Step: 8690 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 8700 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 8710 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 8720 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 8730 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 8740 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 8750 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 8760 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 8770 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 8780 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 8790 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 8800 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 8810 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 8820 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 8830 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 8840 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 8850 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 8860 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 8870 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 8880 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 8890 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 8900 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 8910 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 8920 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 8930 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 8940 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 8950 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 8960 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 8970 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 8980 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 8990 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 9000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5395
INFO:Entity Linker:
==== Accuracy on dev after 9000 iterations: 0.4440
INFO:Entity Linker:
=====Loss: 0.3603 Step: 9010 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 9020 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 9030 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 9040 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 9050 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 9060 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 9070 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 9080 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 9090 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 9100 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 9110 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9120 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9130 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 9140 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 9150 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 9160 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 9170 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 9180 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 9190 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 9200 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 9210 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 9220 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 9230 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9240 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9250 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 9260 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 9270 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 9280 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 9290 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 9300 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 9310 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 9320 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9330 ======
INFO:Entity Linker:
=====Loss: 0.3692 Step: 9340 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 9350 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 9360 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 9370 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9380 ======
one_epoch_time 216.11140298843384
INFO:Entity Linker:
=====Epoch Number: 13 =====
INFO:Entity Linker:
=====Loss: 0.3610 Step: 9390 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9400 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 9410 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9420 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 9430 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 9440 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9450 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 9460 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 9470 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9480 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 9490 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5527
INFO:Entity Linker:
==== Accuracy on dev after 9500 iterations: 0.4571
INFO:Entity Linker:Hierarchical Accuracy: 0.5477
INFO:Entity Linker:
==== Accuracy on test after 9500 iterations: 0.4568
INFO:Entity Linker:
=====Loss: 0.3661 Step: 9510 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 9520 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 9530 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9540 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 9550 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9560 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 9570 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9580 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 9590 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 9600 ======
INFO:Entity Linker:
=====Loss: 0.3685 Step: 9610 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9620 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9630 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 9640 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 9650 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 9660 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9670 ======
INFO:Entity Linker:
=====Loss: 0.3697 Step: 9680 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 9690 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 9700 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 9710 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 9720 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 9730 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 9740 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 9750 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 9760 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 9770 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 9780 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 9790 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 9800 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 9810 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9820 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 9830 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 9840 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 9850 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 9860 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 9870 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 9880 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 9890 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 9900 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 9910 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 9920 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 9930 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 9940 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 9950 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 9960 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 9970 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 9980 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 9990 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 10000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5540
INFO:Entity Linker:
==== Accuracy on dev after 10000 iterations: 0.4592
INFO:Entity Linker:Hierarchical Accuracy: 0.5502
INFO:Entity Linker:
==== Accuracy on test after 10000 iterations: 0.4605
INFO:Entity Linker:
=====Loss: 0.3668 Step: 10010 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 10020 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 10030 ======
INFO:Entity Linker:
=====Loss: 0.3693 Step: 10040 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 10050 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 10060 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 10070 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 10080 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10090 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 10100 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 10110 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 10120 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 10130 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 10140 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 10150 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 10160 ======
one_epoch_time 228.0930585861206
INFO:Entity Linker:
=====Epoch Number: 14 =====
INFO:Entity Linker:
=====Loss: 0.3636 Step: 10170 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 10180 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 10190 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 10200 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 10210 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 10220 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 10230 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 10240 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 10250 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 10260 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 10270 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 10280 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 10290 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 10300 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 10310 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 10320 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 10330 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 10340 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 10350 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 10360 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 10370 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 10380 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 10390 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 10400 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 10410 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 10420 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 10430 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 10440 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 10450 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 10460 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10470 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 10480 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10490 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 10500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5547
INFO:Entity Linker:
==== Accuracy on dev after 10500 iterations: 0.4611
INFO:Entity Linker:Hierarchical Accuracy: 0.5554
INFO:Entity Linker:
==== Accuracy on test after 10500 iterations: 0.4637
INFO:Entity Linker:
=====Loss: 0.3625 Step: 10510 ======
INFO:Entity Linker:
=====Loss: 0.3683 Step: 10520 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 10530 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 10540 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 10550 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 10560 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 10570 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 10580 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 10590 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 10600 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 10610 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 10620 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 10630 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 10640 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 10650 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 10660 ======
INFO:Entity Linker:
=====Loss: 0.3667 Step: 10670 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 10680 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 10690 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 10700 ======
INFO:Entity Linker:
=====Loss: 0.3714 Step: 10710 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 10720 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 10730 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 10740 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 10750 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 10760 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 10770 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 10780 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 10790 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 10800 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 10810 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 10820 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 10830 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 10840 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 10850 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 10860 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 10870 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 10880 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 10890 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 10900 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 10910 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 10920 ======
INFO:Entity Linker:
=====Loss: 0.3722 Step: 10930 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 10940 ======
one_epoch_time 221.8712339401245
INFO:Entity Linker:
=====Epoch Number: 15 =====
INFO:Entity Linker:
=====Loss: 0.3627 Step: 10950 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 10960 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 10970 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 10980 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 10990 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 11000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5325
INFO:Entity Linker:
==== Accuracy on dev after 11000 iterations: 0.4361
INFO:Entity Linker:
=====Loss: 0.3650 Step: 11010 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11020 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 11030 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 11040 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 11050 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 11060 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 11070 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 11080 ======
INFO:Entity Linker:
=====Loss: 0.3677 Step: 11090 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11100 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 11110 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 11120 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 11130 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 11140 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11150 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 11160 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11170 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 11180 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 11190 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 11200 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 11210 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 11220 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 11230 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 11240 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 11250 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 11260 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 11270 ======
INFO:Entity Linker:
=====Loss: 0.3726 Step: 11280 ======
INFO:Entity Linker:
=====Loss: 0.3682 Step: 11290 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 11300 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 11310 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 11320 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 11330 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 11340 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 11350 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 11360 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11370 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 11380 ======
INFO:Entity Linker:
=====Loss: 0.3697 Step: 11390 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 11400 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 11410 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 11420 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 11430 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 11440 ======
INFO:Entity Linker:
=====Loss: 0.3680 Step: 11450 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11460 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 11470 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 11480 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 11490 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 11500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5643
INFO:Entity Linker:
==== Accuracy on dev after 11500 iterations: 0.4695
INFO:Entity Linker:Hierarchical Accuracy: 0.5583
INFO:Entity Linker:
==== Accuracy on test after 11500 iterations: 0.4667
INFO:Entity Linker:
=====Loss: 0.3600 Step: 11510 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 11520 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 11530 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11540 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 11550 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 11560 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11570 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11580 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11590 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 11600 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 11610 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 11620 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 11630 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 11640 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 11650 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 11660 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 11670 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11680 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 11690 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11700 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 11710 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 11720 ======
one_epoch_time 218.03969073295593
INFO:Entity Linker:
=====Epoch Number: 16 =====
INFO:Entity Linker:
=====Loss: 0.3608 Step: 11730 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 11740 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 11750 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 11760 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 11770 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 11780 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 11790 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 11800 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 11810 ======
INFO:Entity Linker:
=====Loss: 0.3666 Step: 11820 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 11830 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11840 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 11850 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 11860 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 11870 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 11880 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 11890 ======
INFO:Entity Linker:
=====Loss: 0.3682 Step: 11900 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 11910 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 11920 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 11930 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11940 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 11950 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 11960 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 11970 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 11980 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 11990 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 12000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5638
INFO:Entity Linker:
==== Accuracy on dev after 12000 iterations: 0.4680
INFO:Entity Linker:
=====Loss: 0.3605 Step: 12010 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 12020 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 12030 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 12040 ======
INFO:Entity Linker:
=====Loss: 0.3684 Step: 12050 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 12060 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 12070 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 12080 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 12090 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 12100 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 12110 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 12120 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12130 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 12140 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 12150 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 12160 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12170 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 12180 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 12190 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12200 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 12210 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 12220 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 12230 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 12240 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 12250 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 12260 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 12270 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 12280 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 12290 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 12300 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 12310 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 12320 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 12330 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 12340 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 12350 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 12360 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 12370 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 12380 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 12390 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12400 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 12410 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 12420 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 12430 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12440 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 12450 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 12460 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 12470 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 12480 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 12490 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 12500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5664
INFO:Entity Linker:
==== Accuracy on dev after 12500 iterations: 0.4696
INFO:Entity Linker:Hierarchical Accuracy: 0.5646
INFO:Entity Linker:
==== Accuracy on test after 12500 iterations: 0.4727
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12510 ======
one_epoch_time 180.81734919548035
INFO:Entity Linker:
=====Epoch Number: 17 =====
INFO:Entity Linker:
=====Loss: 0.3639 Step: 12520 ======
INFO:Entity Linker:
=====Loss: 0.3687 Step: 12530 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 12540 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 12550 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 12560 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 12570 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 12580 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 12590 ======
INFO:Entity Linker:
=====Loss: 0.3694 Step: 12600 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12610 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 12620 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 12630 ======
INFO:Entity Linker:
=====Loss: 0.3660 Step: 12640 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 12650 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 12660 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 12670 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 12680 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12690 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 12700 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 12710 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 12720 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 12730 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 12740 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 12750 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 12760 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 12770 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12780 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 12790 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 12800 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12810 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 12820 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 12830 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 12840 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 12850 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 12860 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 12870 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12880 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 12890 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 12900 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 12910 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 12920 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 12930 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 12940 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 12950 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 12960 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 12970 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 12980 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 12990 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5679
INFO:Entity Linker:
==== Accuracy on dev after 13000 iterations: 0.4718
INFO:Entity Linker:Hierarchical Accuracy: 0.5649
INFO:Entity Linker:
==== Accuracy on test after 13000 iterations: 0.4734
INFO:Entity Linker:
=====Loss: 0.3610 Step: 13010 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 13020 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 13030 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 13040 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 13050 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 13060 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 13070 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 13080 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 13090 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 13100 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13110 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 13120 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 13130 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 13140 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13150 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 13160 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 13170 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13180 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 13190 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 13200 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 13210 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 13220 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 13230 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 13240 ======
INFO:Entity Linker:
=====Loss: 0.3675 Step: 13250 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 13260 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13270 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 13280 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 13290 ======
one_epoch_time 178.2151701450348
INFO:Entity Linker:
=====Epoch Number: 18 =====
INFO:Entity Linker:
=====Loss: 0.3603 Step: 13300 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 13310 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 13320 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 13330 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13340 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 13350 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 13360 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13370 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 13380 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 13390 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 13400 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 13410 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 13420 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 13430 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 13440 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 13450 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 13460 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 13470 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 13480 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13490 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 13500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5619
INFO:Entity Linker:
==== Accuracy on dev after 13500 iterations: 0.4645
INFO:Entity Linker:
=====Loss: 0.3642 Step: 13510 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 13520 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 13530 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13540 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 13550 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 13560 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13570 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 13580 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 13590 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 13600 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 13610 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 13620 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 13630 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 13640 ======
INFO:Entity Linker:
=====Loss: 0.3664 Step: 13650 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 13660 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 13670 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 13680 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 13690 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 13700 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13710 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 13720 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 13730 ======
INFO:Entity Linker:
=====Loss: 0.3658 Step: 13740 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 13750 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 13760 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 13770 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 13780 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 13790 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 13800 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 13810 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 13820 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 13830 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 13840 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 13850 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 13860 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 13870 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 13880 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 13890 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 13900 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 13910 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 13920 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 13930 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 13940 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 13950 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 13960 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 13970 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 13980 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 13990 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 14000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5671
INFO:Entity Linker:
==== Accuracy on dev after 14000 iterations: 0.4711
INFO:Entity Linker:
=====Loss: 0.3601 Step: 14010 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 14020 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14030 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14040 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 14050 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14060 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 14070 ======
one_epoch_time 185.53165459632874
INFO:Entity Linker:
=====Epoch Number: 19 =====
INFO:Entity Linker:
=====Loss: 0.3624 Step: 14080 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 14090 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 14100 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 14110 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 14120 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 14130 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14140 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 14150 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 14160 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 14170 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14180 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 14190 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 14200 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 14210 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 14220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 14230 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14240 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 14250 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 14260 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 14270 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 14280 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 14290 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 14300 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 14310 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 14320 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14330 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 14340 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 14350 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 14360 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 14370 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14380 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14390 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 14400 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 14410 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 14420 ======
INFO:Entity Linker:
=====Loss: 0.3674 Step: 14430 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 14440 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 14450 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14460 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 14470 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14480 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 14490 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 14500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5703
INFO:Entity Linker:
==== Accuracy on dev after 14500 iterations: 0.4743
INFO:Entity Linker:Hierarchical Accuracy: 0.5661
INFO:Entity Linker:
==== Accuracy on test after 14500 iterations: 0.4749
INFO:Entity Linker:
=====Loss: 0.3646 Step: 14510 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 14520 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 14530 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 14540 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 14550 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 14560 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14570 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 14580 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 14590 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14600 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 14610 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 14620 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 14630 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 14640 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 14650 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 14660 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 14670 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14680 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 14690 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 14700 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 14710 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 14720 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 14730 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 14740 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 14750 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 14760 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 14770 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 14780 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 14790 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 14800 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 14810 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14820 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 14830 ======
INFO:Entity Linker:
=====Loss: 0.3686 Step: 14840 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 14850 ======
one_epoch_time 211.79520654678345
INFO:Entity Linker:
=====Epoch Number: 20 =====
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14860 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 14870 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14880 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 14890 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 14900 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 14910 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 14920 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 14930 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 14940 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 14950 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 14960 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 14970 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 14980 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 14990 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 15000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5707
INFO:Entity Linker:
==== Accuracy on dev after 15000 iterations: 0.4746
INFO:Entity Linker:Hierarchical Accuracy: 0.5676
INFO:Entity Linker:
==== Accuracy on test after 15000 iterations: 0.4764
INFO:Entity Linker:
=====Loss: 0.3611 Step: 15010 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 15020 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 15030 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 15040 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 15050 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 15060 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 15070 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 15080 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 15090 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 15100 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 15110 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 15120 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15130 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 15140 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 15150 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 15160 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 15170 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 15180 ======
INFO:Entity Linker:
=====Loss: 0.3699 Step: 15190 ======
INFO:Entity Linker:
=====Loss: 0.3665 Step: 15200 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15210 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15220 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15230 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 15240 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 15250 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15260 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15270 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 15280 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 15290 ======
INFO:Entity Linker:
=====Loss: 0.3681 Step: 15300 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15310 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 15320 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 15330 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 15340 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 15350 ======
INFO:Entity Linker:
=====Loss: 0.3671 Step: 15360 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 15370 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 15380 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15390 ======
INFO:Entity Linker:
=====Loss: 0.3663 Step: 15400 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 15410 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 15420 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 15430 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15440 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 15450 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 15460 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 15470 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 15480 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 15490 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5706
INFO:Entity Linker:
==== Accuracy on dev after 15500 iterations: 0.4767
INFO:Entity Linker:Hierarchical Accuracy: 0.5697
INFO:Entity Linker:
==== Accuracy on test after 15500 iterations: 0.4795
INFO:Entity Linker:
=====Loss: 0.3593 Step: 15510 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 15520 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 15530 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 15540 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 15550 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 15560 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 15570 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 15580 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 15590 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15600 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15610 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 15620 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15630 ======
one_epoch_time 219.25718235969543
INFO:Entity Linker:
=====Epoch Number: 21 =====
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15640 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 15650 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15660 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 15670 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 15680 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 15690 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 15700 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 15710 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 15720 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 15730 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 15740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 15750 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 15760 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 15770 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15780 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 15790 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 15800 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 15810 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 15820 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 15830 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 15840 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 15850 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 15860 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 15870 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 15880 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15890 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 15900 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 15910 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 15920 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 15930 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 15940 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 15950 ======
INFO:Entity Linker:
=====Loss: 0.3678 Step: 15960 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 15970 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 15980 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 15990 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 16000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5769
INFO:Entity Linker:
==== Accuracy on dev after 16000 iterations: 0.4819
INFO:Entity Linker:Hierarchical Accuracy: 0.5759
INFO:Entity Linker:
==== Accuracy on test after 16000 iterations: 0.4845
INFO:Entity Linker:
=====Loss: 0.3650 Step: 16010 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 16020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 16030 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 16040 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 16050 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 16060 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 16070 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 16080 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 16090 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 16100 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 16110 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 16120 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 16130 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 16140 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 16150 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 16160 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 16170 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 16180 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 16190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 16200 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16210 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16220 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 16230 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16240 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 16250 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 16260 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 16270 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 16280 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 16290 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 16300 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 16310 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 16320 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 16330 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 16340 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 16350 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 16360 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 16370 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 16380 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16390 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 16400 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 16410 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 16420 ======
one_epoch_time 207.2360701560974
INFO:Entity Linker:
=====Epoch Number: 22 =====
INFO:Entity Linker:
=====Loss: 0.3626 Step: 16430 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 16440 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 16450 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16460 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 16470 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 16480 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16490 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 16500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5733
INFO:Entity Linker:
==== Accuracy on dev after 16500 iterations: 0.4778
INFO:Entity Linker:
=====Loss: 0.3676 Step: 16510 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16520 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 16530 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 16540 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 16550 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 16560 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 16570 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 16580 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 16590 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16600 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 16610 ======
INFO:Entity Linker:
=====Loss: 0.3645 Step: 16620 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 16630 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 16640 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 16650 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 16660 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 16670 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16680 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 16690 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 16700 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 16710 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 16720 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 16730 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 16740 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 16750 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 16760 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 16770 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 16780 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 16790 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 16800 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 16810 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 16820 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 16830 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 16840 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 16850 ======
INFO:Entity Linker:
=====Loss: 0.3673 Step: 16860 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 16870 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 16880 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 16890 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 16900 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 16910 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16920 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 16930 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 16940 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 16950 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 16960 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 16970 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 16980 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 16990 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5750
INFO:Entity Linker:
==== Accuracy on dev after 17000 iterations: 0.4782
INFO:Entity Linker:
=====Loss: 0.3581 Step: 17010 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 17020 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 17030 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 17040 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 17050 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 17060 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 17070 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 17080 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17090 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 17100 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 17110 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 17120 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17130 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 17140 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17150 ======
INFO:Entity Linker:
=====Loss: 0.3676 Step: 17160 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 17170 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17180 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 17190 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 17200 ======
one_epoch_time 218.98427820205688
INFO:Entity Linker:
=====Epoch Number: 23 =====
INFO:Entity Linker:
=====Loss: 0.3588 Step: 17210 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 17220 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 17230 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 17240 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 17250 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 17260 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17270 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17280 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 17290 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 17300 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 17310 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 17320 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 17330 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 17340 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 17350 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 17360 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17370 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17380 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 17390 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 17400 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 17410 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 17420 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 17430 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 17440 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17450 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 17460 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 17470 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 17480 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 17490 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 17500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5789
INFO:Entity Linker:
==== Accuracy on dev after 17500 iterations: 0.4843
INFO:Entity Linker:Hierarchical Accuracy: 0.5797
INFO:Entity Linker:
==== Accuracy on test after 17500 iterations: 0.4899
INFO:Entity Linker:
=====Loss: 0.3583 Step: 17510 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 17520 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 17530 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 17540 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 17550 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17560 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 17570 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 17580 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17590 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 17600 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 17610 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17620 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 17630 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 17640 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 17650 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 17660 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 17670 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 17680 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 17690 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17700 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 17720 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 17730 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 17740 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 17750 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 17760 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 17770 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17780 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 17790 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 17800 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 17810 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 17820 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 17830 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 17840 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 17850 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 17860 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 17870 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 17880 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 17890 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 17900 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 17910 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 17920 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 17930 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 17940 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 17950 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 17960 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 17970 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 17980 ======
one_epoch_time 209.18358635902405
INFO:Entity Linker:
=====Epoch Number: 24 =====
INFO:Entity Linker:
=====Loss: 0.3617 Step: 17990 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5763
INFO:Entity Linker:
==== Accuracy on dev after 18000 iterations: 0.4815
INFO:Entity Linker:
=====Loss: 0.3618 Step: 18010 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 18020 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 18030 ======
INFO:Entity Linker:
=====Loss: 0.3652 Step: 18040 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 18050 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 18060 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 18070 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 18080 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 18090 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 18100 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 18110 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 18120 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 18130 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 18140 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 18150 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 18160 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 18170 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18180 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 18190 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 18200 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 18210 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 18220 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18230 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 18240 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 18250 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 18260 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18270 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 18280 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 18290 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18300 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 18310 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 18320 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 18330 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 18340 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 18350 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 18360 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 18370 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 18380 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 18390 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 18400 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 18410 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 18420 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 18430 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18440 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 18450 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 18460 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 18470 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 18480 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 18490 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 18500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5783
INFO:Entity Linker:
==== Accuracy on dev after 18500 iterations: 0.4830
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18510 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 18520 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 18530 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 18540 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 18550 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 18560 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 18570 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 18580 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 18590 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18600 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 18610 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 18620 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 18630 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 18640 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18650 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 18660 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 18670 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 18680 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 18690 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 18700 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 18710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 18720 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 18730 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 18740 ======
INFO:Entity Linker:
=====Loss: 0.3672 Step: 18750 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 18760 ======
one_epoch_time 217.4662115573883
INFO:Entity Linker:
=====Epoch Number: 25 =====
INFO:Entity Linker:
=====Loss: 0.3582 Step: 18770 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 18780 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 18790 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 18800 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 18810 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 18820 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 18830 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 18840 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 18850 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 18860 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 18870 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 18880 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 18890 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 18900 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 18910 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 18920 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 18930 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 18940 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 18950 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 18960 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 18970 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 18980 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 18990 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 19000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5807
INFO:Entity Linker:
==== Accuracy on dev after 19000 iterations: 0.4841
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19010 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 19020 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 19030 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 19040 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 19050 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 19060 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 19070 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 19080 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 19090 ======
INFO:Entity Linker:
=====Loss: 0.3679 Step: 19100 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 19110 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19120 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19130 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 19140 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 19150 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 19160 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 19170 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 19180 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 19190 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 19200 ======
INFO:Entity Linker:
=====Loss: 0.3670 Step: 19210 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 19220 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 19230 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 19240 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 19250 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 19260 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 19270 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 19280 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 19290 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 19300 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 19310 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19320 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 19330 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 19340 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 19350 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 19360 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 19370 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 19380 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 19390 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19400 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 19410 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 19420 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 19430 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 19440 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 19450 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 19460 ======
INFO:Entity Linker:
=====Loss: 0.3662 Step: 19470 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 19480 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 19490 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5769
INFO:Entity Linker:
==== Accuracy on dev after 19500 iterations: 0.4799
INFO:Entity Linker:
=====Loss: 0.3593 Step: 19510 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 19520 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19530 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 19540 ======
one_epoch_time 223.56800842285156
INFO:Entity Linker:
=====Epoch Number: 26 =====
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19550 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 19560 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 19570 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 19580 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 19590 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 19600 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19610 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 19620 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 19630 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 19640 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19650 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 19660 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 19670 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 19680 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 19690 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19700 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 19710 ======
INFO:Entity Linker:
=====Loss: 0.3659 Step: 19720 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 19730 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 19740 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 19750 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 19760 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 19770 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 19780 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 19790 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 19800 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 19810 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 19820 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19830 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 19840 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 19850 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 19860 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 19870 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 19880 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 19890 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 19900 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 19910 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 19920 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 19930 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 19940 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 19950 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19960 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 19970 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 19980 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 19990 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5770
INFO:Entity Linker:
==== Accuracy on dev after 20000 iterations: 0.4832
INFO:Entity Linker:
=====Loss: 0.3594 Step: 20010 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20020 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20030 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 20040 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 20050 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 20060 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 20070 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 20080 ======
INFO:Entity Linker:
=====Loss: 0.3649 Step: 20090 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 20100 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 20110 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 20120 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20130 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 20140 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 20150 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 20160 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 20170 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 20180 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 20190 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 20200 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 20210 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 20220 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 20230 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 20240 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 20250 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 20260 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 20270 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 20280 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 20290 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 20300 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20310 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 20320 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 20330 ======
one_epoch_time 214.35574102401733
INFO:Entity Linker:
=====Epoch Number: 27 =====
INFO:Entity Linker:
=====Loss: 0.3626 Step: 20340 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 20350 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20360 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 20370 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 20380 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 20390 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 20400 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 20410 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 20420 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20430 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 20440 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 20450 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20460 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 20470 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 20480 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 20490 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 20500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5806
INFO:Entity Linker:
==== Accuracy on dev after 20500 iterations: 0.4844
INFO:Entity Linker:Hierarchical Accuracy: 0.5772
INFO:Entity Linker:
==== Accuracy on test after 20500 iterations: 0.4876
INFO:Entity Linker:
=====Loss: 0.3607 Step: 20510 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 20520 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 20530 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20540 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 20550 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 20560 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 20570 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20580 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 20590 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 20600 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 20610 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 20620 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20630 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 20640 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 20650 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 20660 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 20670 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 20680 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 20690 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 20700 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 20710 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 20720 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20730 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 20750 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20760 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 20770 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 20780 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20790 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 20800 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 20810 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 20820 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 20830 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 20840 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 20850 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20860 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20870 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 20880 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 20890 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 20900 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 20910 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 20920 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 20930 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 20940 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 20950 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 20960 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 20970 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 20980 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 20990 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5803
INFO:Entity Linker:
==== Accuracy on dev after 21000 iterations: 0.4845
INFO:Entity Linker:Hierarchical Accuracy: 0.5823
INFO:Entity Linker:
==== Accuracy on test after 21000 iterations: 0.4926
INFO:Entity Linker:
=====Loss: 0.3592 Step: 21010 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 21020 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 21030 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 21040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 21050 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 21060 ======
INFO:Entity Linker:
=====Loss: 0.3656 Step: 21070 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 21080 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 21090 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 21100 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21110 ======
one_epoch_time 230.2123475074768
INFO:Entity Linker:
=====Epoch Number: 28 =====
INFO:Entity Linker:
=====Loss: 0.3590 Step: 21120 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 21130 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21140 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 21150 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 21160 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 21170 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 21180 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 21190 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 21200 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 21210 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 21220 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 21230 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21240 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 21250 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 21260 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 21270 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 21280 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 21290 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21300 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21310 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 21320 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 21330 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 21340 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 21350 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21360 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 21370 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 21380 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21390 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 21400 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 21410 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 21420 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 21430 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 21440 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 21450 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 21460 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 21470 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 21480 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 21490 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5786
INFO:Entity Linker:
==== Accuracy on dev after 21500 iterations: 0.4848
INFO:Entity Linker:Hierarchical Accuracy: 0.5838
INFO:Entity Linker:
==== Accuracy on test after 21500 iterations: 0.4933
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21510 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 21520 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 21530 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21540 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 21550 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 21560 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 21570 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 21580 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 21590 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 21600 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 21610 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 21620 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 21630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 21640 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 21650 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 21660 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 21670 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 21680 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 21690 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 21700 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 21710 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 21720 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 21730 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 21740 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 21750 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 21760 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 21770 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 21780 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 21790 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 21800 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 21810 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 21820 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 21830 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 21840 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 21850 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 21860 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 21870 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 21880 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 21890 ======
one_epoch_time 224.6108148097992
INFO:Entity Linker:
=====Epoch Number: 29 =====
INFO:Entity Linker:
=====Loss: 0.3608 Step: 21900 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 21910 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 21920 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 21940 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 21950 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 21960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 21970 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 21980 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 21990 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 22000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5817
INFO:Entity Linker:
==== Accuracy on dev after 22000 iterations: 0.4852
INFO:Entity Linker:Hierarchical Accuracy: 0.5828
INFO:Entity Linker:
==== Accuracy on test after 22000 iterations: 0.4913
INFO:Entity Linker:
=====Loss: 0.3631 Step: 22010 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 22020 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 22030 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 22040 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 22050 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 22060 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 22070 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 22080 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 22090 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 22100 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22110 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 22120 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 22130 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 22140 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22150 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 22160 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22170 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 22180 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 22190 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 22200 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 22210 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 22220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22230 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 22240 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 22250 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 22260 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 22270 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22280 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 22290 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 22300 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 22310 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 22320 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 22330 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 22340 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 22350 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 22360 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 22370 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 22380 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 22390 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 22400 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 22410 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 22420 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22430 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 22440 ======
INFO:Entity Linker:
=====Loss: 0.3633 Step: 22450 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 22460 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 22470 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 22480 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 22490 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 22500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5855
INFO:Entity Linker:
==== Accuracy on dev after 22500 iterations: 0.4909
INFO:Entity Linker:Hierarchical Accuracy: 0.5849
INFO:Entity Linker:
==== Accuracy on test after 22500 iterations: 0.4947
INFO:Entity Linker:
=====Loss: 0.3584 Step: 22510 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 22520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 22530 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 22540 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 22550 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 22560 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 22570 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22580 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22590 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 22600 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 22610 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 22620 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 22630 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 22640 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 22650 ======
INFO:Entity Linker:
=====Loss: 0.3668 Step: 22660 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 22670 ======
one_epoch_time 208.45689249038696
INFO:Entity Linker:
=====Epoch Number: 30 =====
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22680 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 22690 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22700 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 22710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 22720 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 22730 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 22740 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 22750 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 22760 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 22770 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 22780 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 22790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 22800 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 22810 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 22820 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22830 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 22840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 22850 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22860 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 22870 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 22880 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 22890 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 22900 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 22910 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 22920 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 22930 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 22940 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 22950 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 22960 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 22970 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 22980 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 22990 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5849
INFO:Entity Linker:
==== Accuracy on dev after 23000 iterations: 0.4903
INFO:Entity Linker:
=====Loss: 0.3651 Step: 23010 ======
INFO:Entity Linker:
=====Loss: 0.3654 Step: 23020 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 23030 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23040 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23050 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23060 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 23070 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23080 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 23090 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23100 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 23110 ======
INFO:Entity Linker:
=====Loss: 0.3653 Step: 23120 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23130 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 23140 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 23150 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 23160 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 23170 ======
INFO:Entity Linker:
=====Loss: 0.3655 Step: 23180 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 23190 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23200 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 23210 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 23220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 23230 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 23240 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 23250 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23260 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 23270 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23280 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 23290 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 23300 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 23310 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23320 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 23330 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 23340 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 23350 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 23360 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 23370 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 23380 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 23390 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 23400 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 23410 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23420 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23430 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 23440 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 23450 ======
one_epoch_time 174.85696864128113
INFO:Entity Linker:
=====Epoch Number: 31 =====
INFO:Entity Linker:
=====Loss: 0.3579 Step: 23460 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 23470 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 23480 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 23490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5864
INFO:Entity Linker:
==== Accuracy on dev after 23500 iterations: 0.4907
INFO:Entity Linker:
=====Loss: 0.3583 Step: 23510 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 23520 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 23530 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23540 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 23550 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 23560 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 23570 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 23580 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 23590 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23600 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 23610 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 23620 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 23630 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23640 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 23650 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 23660 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 23670 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 23680 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 23690 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 23700 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 23710 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 23720 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23730 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 23740 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 23750 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 23760 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 23770 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 23780 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 23790 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23800 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23810 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 23820 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 23830 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23840 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 23850 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 23860 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 23870 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 23880 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 23890 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 23900 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 23910 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 23920 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 23930 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 23940 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 23950 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 23960 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 23970 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 23980 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 23990 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 24000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5826
INFO:Entity Linker:
==== Accuracy on dev after 24000 iterations: 0.4879
INFO:Entity Linker:
=====Loss: 0.3578 Step: 24010 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 24020 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 24030 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 24040 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 24050 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 24060 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 24070 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24080 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 24090 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 24100 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 24110 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 24120 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 24130 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 24140 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 24150 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 24160 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 24170 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 24180 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 24190 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 24200 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 24210 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24220 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24230 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 24240 ======
one_epoch_time 177.99996304512024
INFO:Entity Linker:
=====Epoch Number: 32 =====
INFO:Entity Linker:
=====Loss: 0.3607 Step: 24250 ======
INFO:Entity Linker:
=====Loss: 0.3661 Step: 24260 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24270 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 24280 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24290 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 24300 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 24310 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 24320 ======
INFO:Entity Linker:
=====Loss: 0.3647 Step: 24330 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 24340 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 24350 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24360 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 24370 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24380 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 24390 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 24400 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 24410 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 24420 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 24430 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24440 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24450 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 24460 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 24470 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24480 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 24490 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 24500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5854
INFO:Entity Linker:
==== Accuracy on dev after 24500 iterations: 0.4908
INFO:Entity Linker:
=====Loss: 0.3595 Step: 24510 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 24520 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 24530 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24540 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 24550 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 24560 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 24570 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 24580 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24590 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 24600 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 24610 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 24620 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 24630 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24640 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 24650 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 24660 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 24670 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 24680 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 24690 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 24700 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 24710 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24720 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 24730 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 24740 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 24750 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 24760 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 24770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 24780 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 24790 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 24800 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24810 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 24820 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 24830 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 24840 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 24850 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 24860 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 24870 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24880 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 24890 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24900 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 24910 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 24920 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 24930 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 24940 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 24950 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 24960 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 24970 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 24980 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 24990 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 25000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5862
INFO:Entity Linker:
==== Accuracy on dev after 25000 iterations: 0.4932
INFO:Entity Linker:Hierarchical Accuracy: 0.5850
INFO:Entity Linker:
==== Accuracy on test after 25000 iterations: 0.4962
INFO:Entity Linker:
=====Loss: 0.3629 Step: 25010 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 25020 ======
one_epoch_time 185.77836418151855
INFO:Entity Linker:
=====Epoch Number: 33 =====
INFO:Entity Linker:
=====Loss: 0.3569 Step: 25030 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 25040 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 25050 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 25060 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 25070 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 25080 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 25090 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25100 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25110 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 25120 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 25130 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 25140 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25150 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 25160 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 25170 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 25180 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25190 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 25200 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 25210 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25220 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 25230 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 25240 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 25250 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 25260 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 25270 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 25280 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 25290 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25300 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 25310 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 25320 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 25330 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 25340 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 25350 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 25360 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 25370 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 25380 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 25390 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 25400 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25410 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 25420 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 25430 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 25440 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 25450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25460 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 25470 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 25480 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25490 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 25500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5872
INFO:Entity Linker:
==== Accuracy on dev after 25500 iterations: 0.4935
INFO:Entity Linker:Hierarchical Accuracy: 0.5865
INFO:Entity Linker:
==== Accuracy on test after 25500 iterations: 0.4960
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25510 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 25520 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 25530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25540 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25550 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 25560 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 25570 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 25580 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 25590 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 25600 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 25610 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 25620 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 25630 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 25640 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25650 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 25660 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 25670 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 25680 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 25690 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 25700 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 25710 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 25720 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 25730 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25740 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 25750 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 25760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 25770 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 25780 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 25790 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 25800 ======
one_epoch_time 191.4654152393341
INFO:Entity Linker:
=====Epoch Number: 34 =====
INFO:Entity Linker:
=====Loss: 0.3608 Step: 25810 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 25820 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 25830 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 25840 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 25850 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 25860 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 25870 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 25880 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 25890 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 25900 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 25910 ======
INFO:Entity Linker:
=====Loss: 0.3636 Step: 25920 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 25930 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 25940 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 25950 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 25960 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 25970 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 25980 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 25990 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 26000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5912
INFO:Entity Linker:
==== Accuracy on dev after 26000 iterations: 0.4963
INFO:Entity Linker:Hierarchical Accuracy: 0.5908
INFO:Entity Linker:
==== Accuracy on test after 26000 iterations: 0.5001
INFO:Entity Linker:
=====Loss: 0.3611 Step: 26010 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 26020 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 26030 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26040 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26050 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 26060 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 26070 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 26080 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 26090 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 26100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26110 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 26120 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26130 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26140 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26150 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 26160 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 26170 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 26180 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 26190 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26200 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 26210 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 26220 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 26230 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26240 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 26250 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 26260 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26270 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 26280 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 26290 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 26300 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 26310 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 26320 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 26330 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 26340 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 26350 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 26360 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26370 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 26380 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 26390 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 26400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 26410 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 26420 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 26430 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 26440 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26450 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 26460 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 26470 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 26480 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 26490 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 26500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5814
INFO:Entity Linker:
==== Accuracy on dev after 26500 iterations: 0.4853
INFO:Entity Linker:
=====Loss: 0.3594 Step: 26510 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 26520 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 26530 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 26540 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26550 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 26560 ======
INFO:Entity Linker:
=====Loss: 0.3669 Step: 26570 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 26580 ======
one_epoch_time 218.2602343559265
INFO:Entity Linker:
=====Epoch Number: 35 =====
INFO:Entity Linker:
=====Loss: 0.3581 Step: 26590 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 26600 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 26610 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 26620 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26630 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 26640 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26650 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 26660 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 26670 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 26680 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 26690 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 26700 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 26710 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 26720 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 26730 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 26740 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 26750 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 26760 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 26770 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 26780 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 26790 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 26800 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 26810 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26820 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 26830 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 26840 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 26850 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 26860 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 26870 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 26880 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 26890 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 26900 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 26910 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 26920 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 26930 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 26940 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 26950 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 26960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 26970 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 26980 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 26990 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5883
INFO:Entity Linker:
==== Accuracy on dev after 27000 iterations: 0.4958
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27010 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27020 ======
INFO:Entity Linker:
=====Loss: 0.3644 Step: 27030 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 27040 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 27050 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 27060 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 27070 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 27080 ======
INFO:Entity Linker:
=====Loss: 0.3648 Step: 27090 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27100 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 27110 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 27120 ======
INFO:Entity Linker:
=====Loss: 0.3646 Step: 27130 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27140 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 27150 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 27160 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27170 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27180 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 27190 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 27200 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 27210 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 27220 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27230 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 27240 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 27250 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 27260 ======
INFO:Entity Linker:
=====Loss: 0.3651 Step: 27270 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 27280 ======
INFO:Entity Linker:
=====Loss: 0.3650 Step: 27290 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 27300 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27310 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 27320 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 27330 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27340 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 27350 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 27360 ======
one_epoch_time 211.0336878299713
INFO:Entity Linker:
=====Epoch Number: 36 =====
INFO:Entity Linker:
=====Loss: 0.3584 Step: 27370 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 27380 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27390 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 27400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 27410 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 27420 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 27440 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 27450 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 27460 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 27470 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27480 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 27490 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 27500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5897
INFO:Entity Linker:
==== Accuracy on dev after 27500 iterations: 0.4931
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27510 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 27520 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27530 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 27540 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 27550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 27560 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27570 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 27580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 27590 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 27600 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27610 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 27620 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27630 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 27640 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 27650 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 27660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 27670 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 27680 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 27690 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 27700 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27710 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 27720 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 27730 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 27740 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 27750 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 27760 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 27770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 27780 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 27790 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 27800 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 27810 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 27820 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 27830 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 27840 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 27850 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 27860 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 27870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 27880 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 27890 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 27900 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 27910 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 27920 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 27930 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 27940 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 27950 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 27960 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 27970 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 27980 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 27990 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5871
INFO:Entity Linker:
==== Accuracy on dev after 28000 iterations: 0.4925
INFO:Entity Linker:
=====Loss: 0.3608 Step: 28010 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 28020 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28030 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28040 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 28050 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 28060 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 28070 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 28080 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 28090 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 28100 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 28110 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 28120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28130 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 28140 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28150 ======
one_epoch_time 220.42527866363525
INFO:Entity Linker:
=====Epoch Number: 37 =====
INFO:Entity Linker:
=====Loss: 0.3593 Step: 28160 ======
INFO:Entity Linker:
=====Loss: 0.3642 Step: 28170 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 28180 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 28190 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 28200 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 28210 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 28220 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 28230 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 28240 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 28250 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 28260 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 28270 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 28280 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 28290 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 28300 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 28310 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 28320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 28330 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 28340 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 28350 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 28360 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 28370 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 28380 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 28390 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 28400 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 28410 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 28420 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 28430 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 28440 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 28450 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 28460 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28470 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 28480 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 28490 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 28500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5909
INFO:Entity Linker:
==== Accuracy on dev after 28500 iterations: 0.4964
INFO:Entity Linker:Hierarchical Accuracy: 0.5918
INFO:Entity Linker:
==== Accuracy on test after 28500 iterations: 0.5030
INFO:Entity Linker:
=====Loss: 0.3554 Step: 28510 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28520 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 28530 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 28540 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28550 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 28560 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 28570 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 28580 ======
INFO:Entity Linker:
=====Loss: 0.3638 Step: 28590 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28600 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 28610 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28620 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 28630 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 28640 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 28650 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 28660 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 28670 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 28680 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 28690 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 28700 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 28710 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28720 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28730 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 28740 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 28750 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 28760 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 28780 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28790 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 28800 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 28810 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 28820 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 28830 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 28840 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 28850 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 28860 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 28870 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28880 ======
INFO:Entity Linker:
=====Loss: 0.3640 Step: 28890 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 28900 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 28910 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 28920 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28930 ======
one_epoch_time 222.23420643806458
INFO:Entity Linker:
=====Epoch Number: 38 =====
INFO:Entity Linker:
=====Loss: 0.3570 Step: 28940 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 28950 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 28960 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 28970 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 28980 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 28990 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 29000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5854
INFO:Entity Linker:
==== Accuracy on dev after 29000 iterations: 0.4898
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29010 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 29020 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 29030 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 29040 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 29050 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 29060 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 29070 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29080 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 29090 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 29100 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 29110 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 29120 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 29130 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 29140 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29150 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 29160 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 29170 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29180 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 29190 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 29200 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 29210 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 29220 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 29230 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 29240 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 29250 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 29260 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 29270 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 29280 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 29290 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 29300 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 29310 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 29320 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29330 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 29340 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29350 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 29360 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29370 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 29380 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 29390 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 29400 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 29410 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29420 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 29430 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 29440 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 29450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 29460 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 29470 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 29480 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 29490 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 29500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5884
INFO:Entity Linker:
==== Accuracy on dev after 29500 iterations: 0.4940
INFO:Entity Linker:
=====Loss: 0.3592 Step: 29510 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29520 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 29530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 29540 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 29550 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 29560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 29570 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 29580 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 29590 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29600 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29610 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29620 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 29630 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29640 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29650 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 29660 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 29670 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 29680 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 29690 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 29700 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 29710 ======
one_epoch_time 200.61731386184692
INFO:Entity Linker:
=====Epoch Number: 39 =====
INFO:Entity Linker:
=====Loss: 0.3597 Step: 29720 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 29730 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 29740 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 29750 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 29760 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 29770 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 29780 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29790 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 29800 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 29810 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 29820 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 29830 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 29840 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 29850 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 29860 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29870 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29880 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 29890 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 29900 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 29910 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 29920 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 29930 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 29940 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 29950 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 29960 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 29970 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 29980 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 29990 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 30000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5892
INFO:Entity Linker:
==== Accuracy on dev after 30000 iterations: 0.4935
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30010 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 30020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 30030 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30040 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30050 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30060 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 30070 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 30080 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 30090 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 30100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 30110 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 30120 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30140 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 30150 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 30160 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 30170 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30180 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 30190 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30200 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 30210 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 30220 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30230 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30240 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 30250 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 30260 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 30270 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30280 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 30290 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 30300 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30310 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 30320 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30330 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 30340 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 30350 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30360 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 30370 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 30380 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 30390 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 30400 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 30410 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 30420 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 30430 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 30440 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 30450 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 30460 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 30470 ======
INFO:Entity Linker:
=====Loss: 0.3643 Step: 30480 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 30490 ======
one_epoch_time 174.88196468353271
INFO:Entity Linker:
=====Epoch Number: 40 =====
INFO:Entity Linker:
=====Loss: 0.3568 Step: 30500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5901
INFO:Entity Linker:
==== Accuracy on dev after 30500 iterations: 0.4961
INFO:Entity Linker:
=====Loss: 0.3591 Step: 30510 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30520 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 30530 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30540 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 30550 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 30560 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 30570 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 30580 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 30590 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 30600 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30610 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 30620 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 30630 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 30640 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 30650 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 30660 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30670 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 30680 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 30690 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30700 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 30710 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 30720 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 30730 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 30740 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 30750 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 30760 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 30770 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30780 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 30790 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 30800 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 30810 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 30820 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 30830 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 30840 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 30850 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 30860 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 30870 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 30880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 30890 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30900 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30910 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30920 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 30930 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 30940 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 30950 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 30960 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 30970 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 30980 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 30990 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 31000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5897
INFO:Entity Linker:
==== Accuracy on dev after 31000 iterations: 0.4932
INFO:Entity Linker:
=====Loss: 0.3567 Step: 31010 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 31020 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31030 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 31040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 31050 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 31060 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 31070 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31080 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 31090 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 31100 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 31110 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 31130 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 31140 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 31150 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31160 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31170 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 31180 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 31190 ======
INFO:Entity Linker:
=====Loss: 0.3637 Step: 31200 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 31210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 31220 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 31230 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31240 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31250 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 31260 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 31270 ======
one_epoch_time 179.48860955238342
INFO:Entity Linker:
=====Epoch Number: 41 =====
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31280 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31290 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 31300 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 31310 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 31320 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31330 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 31340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 31350 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 31360 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 31370 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 31380 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31390 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 31400 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 31410 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 31420 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31430 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 31440 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 31450 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31460 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31470 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 31480 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 31490 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 31500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5890
INFO:Entity Linker:
==== Accuracy on dev after 31500 iterations: 0.4951
INFO:Entity Linker:
=====Loss: 0.3570 Step: 31510 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 31520 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 31530 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 31540 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 31550 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31560 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 31570 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 31580 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 31590 ======
INFO:Entity Linker:
=====Loss: 0.3626 Step: 31600 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 31610 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 31620 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 31630 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 31640 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 31650 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 31670 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 31680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31690 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 31700 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 31720 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 31730 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 31740 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 31750 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 31760 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 31770 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 31780 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 31790 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 31800 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 31810 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 31820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 31830 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 31840 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 31850 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 31860 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 31870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 31880 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 31890 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 31900 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 31910 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 31920 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 31930 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 31940 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 31950 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 31960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 31970 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 31980 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 31990 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 32000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5919
INFO:Entity Linker:
==== Accuracy on dev after 32000 iterations: 0.4965
INFO:Entity Linker:Hierarchical Accuracy: 0.5908
INFO:Entity Linker:
==== Accuracy on test after 32000 iterations: 0.5033
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32010 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 32020 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32030 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32050 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 32060 ======
one_epoch_time 184.97631216049194
INFO:Entity Linker:
=====Epoch Number: 42 =====
INFO:Entity Linker:
=====Loss: 0.3589 Step: 32070 ======
INFO:Entity Linker:
=====Loss: 0.3639 Step: 32080 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 32090 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32100 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32120 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32130 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32140 ======
INFO:Entity Linker:
=====Loss: 0.3631 Step: 32150 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32160 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 32170 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32180 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 32190 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 32200 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 32210 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 32220 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 32230 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 32240 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 32250 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 32260 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 32270 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 32280 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 32290 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 32300 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 32310 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 32320 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32330 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 32340 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 32350 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 32360 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32370 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 32380 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 32390 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 32400 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 32410 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 32420 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 32430 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 32440 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 32450 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 32460 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 32470 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32480 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 32490 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 32500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5919
INFO:Entity Linker:
==== Accuracy on dev after 32500 iterations: 0.4963
INFO:Entity Linker:
=====Loss: 0.3575 Step: 32510 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 32520 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 32530 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 32540 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 32550 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32560 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 32570 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 32580 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 32590 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 32600 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32610 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 32620 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 32630 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 32640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 32650 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 32660 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 32670 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 32680 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 32690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 32700 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 32710 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32720 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 32730 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32740 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32750 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 32760 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 32770 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32780 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32790 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 32800 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 32810 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 32820 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 32830 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32840 ======
one_epoch_time 209.2925670146942
INFO:Entity Linker:
=====Epoch Number: 43 =====
INFO:Entity Linker:
=====Loss: 0.3577 Step: 32850 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 32860 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 32870 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 32880 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 32890 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 32900 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 32910 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32920 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 32930 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 32940 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 32950 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 32960 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 32970 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 32980 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 32990 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5898
INFO:Entity Linker:
==== Accuracy on dev after 33000 iterations: 0.4929
INFO:Entity Linker:
=====Loss: 0.3599 Step: 33010 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 33020 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33030 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33040 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 33050 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 33060 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 33070 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33080 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 33090 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33100 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 33110 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33120 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 33130 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 33140 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 33150 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33160 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 33170 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33180 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 33190 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33200 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 33210 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 33220 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33230 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33240 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 33250 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33260 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 33270 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33280 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33290 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33300 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33310 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 33320 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 33330 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 33340 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 33350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 33360 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 33370 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33380 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 33390 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 33400 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 33410 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33420 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33430 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 33440 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 33450 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 33460 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 33470 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 33480 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 33490 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 33500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5941
INFO:Entity Linker:
==== Accuracy on dev after 33500 iterations: 0.5001
INFO:Entity Linker:Hierarchical Accuracy: 0.5946
INFO:Entity Linker:
==== Accuracy on test after 33500 iterations: 0.5056
INFO:Entity Linker:
=====Loss: 0.3561 Step: 33510 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 33520 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 33530 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 33540 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33550 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 33560 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33570 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33580 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 33590 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 33600 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 33610 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 33620 ======
one_epoch_time 210.18883681297302
INFO:Entity Linker:
=====Epoch Number: 44 =====
INFO:Entity Linker:
=====Loss: 0.3595 Step: 33630 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 33640 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33650 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33660 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 33670 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 33680 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 33690 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 33700 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 33710 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33720 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33730 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 33740 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 33750 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 33760 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 33770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 33780 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 33790 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 33800 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 33810 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33820 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 33830 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 33840 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 33850 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 33860 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 33870 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33880 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 33890 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33900 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 33910 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 33920 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 33930 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 33940 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 33950 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33960 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 33970 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 33980 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 33990 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 34000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5928
INFO:Entity Linker:
==== Accuracy on dev after 34000 iterations: 0.4992
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34010 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 34020 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34030 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 34040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 34050 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 34060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 34070 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 34080 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 34090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 34100 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 34110 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34120 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 34130 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 34140 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 34150 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 34160 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 34170 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 34180 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 34190 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 34200 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 34210 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34220 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 34230 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 34240 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34250 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 34260 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 34270 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 34280 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34290 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 34300 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 34310 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34320 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 34330 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 34340 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 34350 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 34360 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 34370 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 34380 ======
INFO:Entity Linker:
=====Loss: 0.3657 Step: 34390 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 34400 ======
one_epoch_time 201.47481393814087
INFO:Entity Linker:
=====Epoch Number: 45 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 34410 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 34420 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 34430 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 34440 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 34450 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 34460 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 34470 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 34480 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 34490 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 34500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5956
INFO:Entity Linker:
==== Accuracy on dev after 34500 iterations: 0.5022
INFO:Entity Linker:Hierarchical Accuracy: 0.5941
INFO:Entity Linker:
==== Accuracy on test after 34500 iterations: 0.5046
INFO:Entity Linker:
=====Loss: 0.3566 Step: 34510 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34520 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 34530 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 34540 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 34550 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 34560 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 34570 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 34580 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 34590 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 34600 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 34610 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 34620 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 34630 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 34640 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 34650 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 34660 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 34670 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 34680 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 34690 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 34700 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 34710 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 34720 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34730 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 34740 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 34750 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 34760 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 34770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 34780 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 34790 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 34800 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 34810 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 34820 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 34830 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 34840 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 34850 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 34860 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 34870 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 34880 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 34890 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 34900 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 34910 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 34920 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 34930 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 34940 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 34950 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 34960 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 34970 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 34980 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 34990 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 35000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5910
INFO:Entity Linker:
==== Accuracy on dev after 35000 iterations: 0.4976
INFO:Entity Linker:
=====Loss: 0.3565 Step: 35010 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 35020 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35030 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35040 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 35050 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 35060 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 35070 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35080 ======
INFO:Entity Linker:
=====Loss: 0.3630 Step: 35090 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35100 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 35110 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 35120 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 35130 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35140 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35150 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35160 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 35170 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 35180 ======
one_epoch_time 221.75921988487244
INFO:Entity Linker:
=====Epoch Number: 46 =====
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35190 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35200 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 35210 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 35220 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35230 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 35240 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35250 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 35260 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 35270 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35280 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35290 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35300 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 35310 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 35320 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35330 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35340 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 35350 ======
INFO:Entity Linker:
=====Loss: 0.3629 Step: 35360 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 35370 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 35380 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35390 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 35400 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 35410 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 35420 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 35430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 35440 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 35450 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35460 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 35470 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 35480 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 35490 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 35500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5969
INFO:Entity Linker:
==== Accuracy on dev after 35500 iterations: 0.5037
INFO:Entity Linker:Hierarchical Accuracy: 0.6001
INFO:Entity Linker:
==== Accuracy on test after 35500 iterations: 0.5127
INFO:Entity Linker:
=====Loss: 0.3615 Step: 35510 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 35520 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35530 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35540 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35550 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 35560 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35570 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35580 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 35590 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 35600 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 35610 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 35620 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35630 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35640 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 35650 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 35660 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 35670 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35680 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 35690 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 35700 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35710 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35720 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 35730 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 35740 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 35750 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 35760 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35770 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 35780 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 35790 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 35800 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 35810 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 35820 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 35830 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 35840 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 35850 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35860 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 35870 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 35880 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 35890 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35900 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 35910 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 35920 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 35930 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 35940 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 35950 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 35960 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 35970 ======
one_epoch_time 216.06572008132935
INFO:Entity Linker:
=====Epoch Number: 47 =====
INFO:Entity Linker:
=====Loss: 0.3576 Step: 35980 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 35990 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5951
INFO:Entity Linker:
==== Accuracy on dev after 36000 iterations: 0.5000
INFO:Entity Linker:
=====Loss: 0.3574 Step: 36010 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 36020 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 36030 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36050 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 36060 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 36070 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 36080 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 36090 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 36100 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36110 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 36120 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 36130 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 36140 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 36150 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 36160 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 36170 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36180 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 36190 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 36200 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36210 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 36220 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 36230 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 36240 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 36250 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 36260 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 36270 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36280 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 36290 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 36300 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36310 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 36320 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 36330 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36340 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 36350 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 36360 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36370 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 36380 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 36390 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 36400 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 36410 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 36420 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 36430 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 36440 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36450 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 36460 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36470 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 36480 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 36490 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 36500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5926
INFO:Entity Linker:
==== Accuracy on dev after 36500 iterations: 0.4971
INFO:Entity Linker:
=====Loss: 0.3562 Step: 36510 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 36520 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 36530 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 36540 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36550 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 36560 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 36570 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 36580 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 36590 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 36600 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36610 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 36620 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 36630 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 36640 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36650 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 36660 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 36670 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 36680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 36690 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 36700 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 36710 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 36720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36730 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 36740 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36750 ======
one_epoch_time 217.2502887248993
INFO:Entity Linker:
=====Epoch Number: 48 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 36760 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 36770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36780 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 36790 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 36800 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36810 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 36820 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 36830 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 36840 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36850 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 36860 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 36870 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 36880 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 36890 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 36900 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 36910 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 36920 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 36930 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 36940 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 36950 ======
INFO:Entity Linker:
=====Loss: 0.3624 Step: 36960 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 36970 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 36980 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 36990 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 37000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5923
INFO:Entity Linker:
==== Accuracy on dev after 37000 iterations: 0.4962
INFO:Entity Linker:
=====Loss: 0.3601 Step: 37010 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 37020 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 37030 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 37040 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 37050 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37060 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 37070 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 37080 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 37090 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 37100 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 37110 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 37120 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 37130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 37140 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 37150 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 37160 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37170 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 37180 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 37190 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 37200 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 37210 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 37220 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 37230 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 37240 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 37250 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 37260 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 37270 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37280 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 37290 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 37300 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 37310 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 37320 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 37330 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 37340 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 37350 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 37360 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 37370 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 37380 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 37390 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 37400 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 37410 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 37420 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 37430 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 37440 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 37450 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37460 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 37470 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37480 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 37490 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 37500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5897
INFO:Entity Linker:
==== Accuracy on dev after 37500 iterations: 0.4950
INFO:Entity Linker:
=====Loss: 0.3611 Step: 37510 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37520 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 37530 ======
one_epoch_time 200.23189210891724
INFO:Entity Linker:
=====Epoch Number: 49 =====
INFO:Entity Linker:
=====Loss: 0.3582 Step: 37540 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 37550 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 37560 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37570 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 37580 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 37590 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37600 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 37610 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 37620 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 37630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 37640 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 37650 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37660 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 37670 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37680 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 37690 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37700 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 37710 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37720 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 37730 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 37740 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 37750 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 37760 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37770 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 37780 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 37790 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 37800 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 37810 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 37820 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 37830 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 37840 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 37850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 37860 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 37870 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 37880 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 37890 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 37900 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 37910 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 37920 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 37930 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 37940 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 37950 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 37960 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 37970 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 37980 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 37990 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 38000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5935
INFO:Entity Linker:
==== Accuracy on dev after 38000 iterations: 0.5012
INFO:Entity Linker:
=====Loss: 0.3563 Step: 38010 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38020 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 38030 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 38040 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 38050 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 38060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38070 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 38080 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 38090 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38100 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38110 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38120 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 38130 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 38140 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 38150 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38160 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38170 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 38180 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 38190 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38200 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 38210 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 38220 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 38230 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 38240 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38250 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38260 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 38270 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38280 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38290 ======
INFO:Entity Linker:
=====Loss: 0.3641 Step: 38300 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 38310 ======
one_epoch_time 217.279305934906
INFO:Entity Linker:
=====Epoch Number: 50 =====
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38320 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 38330 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38340 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38350 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 38360 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38370 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 38380 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 38390 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 38400 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 38410 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 38420 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 38430 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 38440 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 38450 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 38460 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38470 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 38480 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 38490 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 38500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5922
INFO:Entity Linker:
==== Accuracy on dev after 38500 iterations: 0.4968
INFO:Entity Linker:
=====Loss: 0.3551 Step: 38510 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 38520 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 38530 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 38540 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 38550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 38560 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 38570 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38580 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38590 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38600 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38610 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 38620 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 38630 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 38640 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 38650 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 38660 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38670 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 38680 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 38690 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 38700 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 38710 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38720 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 38730 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 38740 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 38750 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 38760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 38770 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 38780 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 38790 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 38800 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 38810 ======
INFO:Entity Linker:
=====Loss: 0.3622 Step: 38820 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 38830 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 38840 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 38850 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38860 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 38870 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 38880 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38890 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 38900 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 38910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 38920 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 38930 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 38940 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 38950 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 38960 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 38970 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 38980 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 38990 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 39000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5952
INFO:Entity Linker:
==== Accuracy on dev after 39000 iterations: 0.5018
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39010 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 39020 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 39030 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 39040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 39050 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 39060 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 39070 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 39080 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 39090 ======
one_epoch_time 219.82003498077393
INFO:Entity Linker:
=====Epoch Number: 51 =====
INFO:Entity Linker:
=====Loss: 0.3562 Step: 39100 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 39110 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39120 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 39130 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39140 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 39150 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39160 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 39170 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39180 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 39190 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39200 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39210 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 39220 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 39230 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 39240 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39250 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 39260 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 39270 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39280 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 39290 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 39300 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 39310 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 39320 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 39330 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 39340 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 39350 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39360 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39370 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 39380 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 39390 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39400 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 39410 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 39420 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 39430 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 39440 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 39450 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 39460 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39470 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 39480 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39490 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 39500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5918
INFO:Entity Linker:
==== Accuracy on dev after 39500 iterations: 0.4958
INFO:Entity Linker:
=====Loss: 0.3553 Step: 39510 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 39520 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39530 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 39540 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 39560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39570 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39580 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 39590 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 39600 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39610 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 39620 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 39630 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 39640 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39650 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 39660 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39670 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39680 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 39690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39700 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39710 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 39720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 39730 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 39740 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 39750 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 39760 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 39770 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 39780 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 39790 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 39800 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 39810 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39820 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 39830 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 39840 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39850 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 39860 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 39870 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39880 ======
one_epoch_time 214.68361020088196
INFO:Entity Linker:
=====Epoch Number: 52 =====
INFO:Entity Linker:
=====Loss: 0.3570 Step: 39890 ======
INFO:Entity Linker:
=====Loss: 0.3635 Step: 39900 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 39910 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 39920 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 39930 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 39940 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 39950 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 39960 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 39970 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 39980 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 39990 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 40000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5932
INFO:Entity Linker:
==== Accuracy on dev after 40000 iterations: 0.4977
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40010 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 40020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 40030 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 40040 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40050 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 40060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 40070 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 40080 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40090 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 40100 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 40110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40120 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40130 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 40140 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 40150 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 40160 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40170 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 40180 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 40190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 40200 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 40210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 40220 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 40230 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 40240 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40250 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 40260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 40270 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 40280 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 40290 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40300 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 40310 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 40320 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 40330 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 40340 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40350 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 40360 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 40370 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 40380 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40390 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 40400 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 40410 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40420 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 40430 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 40440 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 40450 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 40460 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 40470 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40480 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40490 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5955
INFO:Entity Linker:
==== Accuracy on dev after 40500 iterations: 0.5020
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40510 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 40520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 40530 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40540 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 40550 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 40560 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40570 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 40580 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40590 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 40600 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40610 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 40620 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 40630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 40640 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 40650 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 40660 ======
one_epoch_time 221.99675631523132
INFO:Entity Linker:
=====Epoch Number: 53 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 40670 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 40680 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 40690 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 40700 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 40710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 40720 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 40730 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 40740 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 40750 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 40760 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 40770 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 40780 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 40790 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40800 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 40810 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 40820 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 40830 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 40840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 40850 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 40860 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 40870 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 40880 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 40890 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 40900 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 40910 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 40920 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 40930 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 40940 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 40950 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 40960 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 40970 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 40980 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 40990 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5943
INFO:Entity Linker:
==== Accuracy on dev after 41000 iterations: 0.4999
INFO:Entity Linker:
=====Loss: 0.3598 Step: 41010 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41020 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41030 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 41040 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 41050 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 41060 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 41070 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 41080 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 41090 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 41100 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 41110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 41120 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 41130 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41140 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 41150 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 41160 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 41170 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 41180 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 41190 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 41200 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41210 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 41220 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 41230 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 41240 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 41250 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 41260 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 41270 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 41280 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 41290 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 41300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41310 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 41320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 41330 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 41340 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 41350 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 41360 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 41370 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 41380 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 41390 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 41400 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 41410 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41420 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 41430 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 41440 ======
one_epoch_time 195.5592737197876
INFO:Entity Linker:
=====Epoch Number: 54 =====
INFO:Entity Linker:
=====Loss: 0.3581 Step: 41450 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 41460 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 41470 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 41480 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 41490 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 41500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5976
INFO:Entity Linker:
==== Accuracy on dev after 41500 iterations: 0.5040
INFO:Entity Linker:Hierarchical Accuracy: 0.5985
INFO:Entity Linker:
==== Accuracy on test after 41500 iterations: 0.5106
INFO:Entity Linker:
=====Loss: 0.3574 Step: 41510 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 41520 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41530 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 41540 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41550 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 41560 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 41570 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41580 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41590 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 41600 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41610 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 41620 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 41630 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 41640 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 41650 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 41660 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 41670 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 41680 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41690 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 41700 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 41710 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 41720 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 41730 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 41740 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 41750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 41760 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 41770 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 41780 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41790 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 41800 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 41810 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 41820 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 41830 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 41840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 41850 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 41860 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 41870 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 41880 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 41890 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 41900 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 41910 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 41920 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 41930 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 41940 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 41950 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 41960 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 41970 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 41980 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 41990 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 42000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5909
INFO:Entity Linker:
==== Accuracy on dev after 42000 iterations: 0.4961
INFO:Entity Linker:
=====Loss: 0.3542 Step: 42010 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42020 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 42030 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42040 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 42050 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 42060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42070 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42080 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 42090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42100 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42110 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 42120 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 42130 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 42140 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42150 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 42160 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42170 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 42180 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 42190 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 42200 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 42210 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 42220 ======
one_epoch_time 218.88876152038574
INFO:Entity Linker:
=====Epoch Number: 55 =====
INFO:Entity Linker:
=====Loss: 0.3563 Step: 42230 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 42240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42250 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 42260 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 42270 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 42280 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 42290 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 42300 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 42310 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 42320 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42330 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42340 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 42350 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 42360 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42370 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 42380 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 42390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42400 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 42410 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 42420 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 42430 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42440 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 42450 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42460 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 42470 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 42480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 42490 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 42500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5921
INFO:Entity Linker:
==== Accuracy on dev after 42500 iterations: 0.4993
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42510 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42520 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 42530 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 42540 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42550 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 42560 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 42570 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 42580 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 42590 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 42600 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 42610 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 42620 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 42630 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 42640 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42650 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 42660 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 42670 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 42680 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 42690 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42700 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 42710 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 42720 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 42730 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42740 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 42750 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 42760 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 42770 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 42780 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 42790 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 42800 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 42810 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 42820 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 42830 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 42840 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 42850 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 42860 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 42870 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 42880 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 42890 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 42900 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 42910 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 42920 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 42930 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 42940 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 42950 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 42960 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 42970 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 42980 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 42990 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5954
INFO:Entity Linker:
==== Accuracy on dev after 43000 iterations: 0.5005
one_epoch_time 216.43057346343994
INFO:Entity Linker:
=====Epoch Number: 56 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 43010 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43020 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 43030 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 43040 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 43050 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 43060 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 43070 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 43080 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43090 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 43100 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 43110 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43120 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 43130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43140 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 43150 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43160 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43170 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 43180 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43190 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43200 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 43210 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43220 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 43230 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43240 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 43250 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 43260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43270 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 43280 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 43290 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 43300 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 43310 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 43320 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 43330 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 43340 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 43350 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 43360 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 43370 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 43380 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 43390 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 43400 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 43410 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 43420 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 43430 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 43440 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 43450 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43460 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 43470 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 43480 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43490 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 43500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5949
INFO:Entity Linker:
==== Accuracy on dev after 43500 iterations: 0.5014
INFO:Entity Linker:
=====Loss: 0.3600 Step: 43510 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 43520 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 43530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43540 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 43550 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 43560 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 43570 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 43580 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43590 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43600 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 43610 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 43620 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 43630 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 43640 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 43650 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 43660 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 43670 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 43680 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 43690 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 43700 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 43710 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 43720 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43730 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 43740 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 43750 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43760 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 43770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 43780 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43790 ======
one_epoch_time 215.66584038734436
INFO:Entity Linker:
=====Epoch Number: 57 =====
INFO:Entity Linker:
=====Loss: 0.3577 Step: 43800 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 43810 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 43820 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 43830 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43840 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 43850 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 43860 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 43870 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 43880 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 43890 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 43900 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 43910 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 43920 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 43930 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 43940 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 43950 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 43960 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 43970 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 43980 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 43990 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 44000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5956
INFO:Entity Linker:
==== Accuracy on dev after 44000 iterations: 0.5016
INFO:Entity Linker:
=====Loss: 0.3590 Step: 44010 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 44020 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 44030 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 44040 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 44050 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44060 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 44070 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 44080 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 44090 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44100 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 44110 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 44120 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 44130 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 44140 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 44150 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 44160 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 44170 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 44180 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 44190 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 44200 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44210 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44220 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 44230 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44240 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 44250 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 44260 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 44270 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 44280 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44290 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 44300 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 44310 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44320 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44330 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44340 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 44350 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 44360 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44370 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44380 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 44390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 44400 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 44410 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 44420 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44430 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 44440 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44450 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 44460 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 44470 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44480 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 44490 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 44500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5960
INFO:Entity Linker:
==== Accuracy on dev after 44500 iterations: 0.4993
INFO:Entity Linker:
=====Loss: 0.3563 Step: 44510 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 44520 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 44530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 44540 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44550 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 44560 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44570 ======
one_epoch_time 215.17581987380981
INFO:Entity Linker:
=====Epoch Number: 58 =====
INFO:Entity Linker:
=====Loss: 0.3563 Step: 44580 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 44590 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 44600 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 44610 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 44620 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44630 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44640 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 44650 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 44660 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 44670 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44680 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 44690 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 44700 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 44710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 44720 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 44730 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 44740 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 44750 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 44760 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 44770 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 44780 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 44790 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 44800 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 44810 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 44820 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 44830 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 44840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 44850 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 44860 ======
INFO:Entity Linker:
=====Loss: 0.3621 Step: 44870 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 44880 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 44890 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 44900 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 44910 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 44920 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 44930 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 44940 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 44950 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 44960 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 44970 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 44980 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 44990 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 45000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5982
INFO:Entity Linker:
==== Accuracy on dev after 45000 iterations: 0.5052
INFO:Entity Linker:Hierarchical Accuracy: 0.6009
INFO:Entity Linker:
==== Accuracy on test after 45000 iterations: 0.5127
INFO:Entity Linker:
=====Loss: 0.3552 Step: 45010 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 45020 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 45030 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 45040 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 45050 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45060 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45070 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45080 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45090 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 45100 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 45110 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 45120 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 45130 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 45140 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 45150 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45160 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45170 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 45180 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45190 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 45200 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 45210 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 45220 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 45230 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 45240 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 45250 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45260 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 45270 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45280 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 45290 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45300 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 45310 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45320 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 45330 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 45340 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 45350 ======
one_epoch_time 184.2569923400879
INFO:Entity Linker:
=====Epoch Number: 59 =====
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45360 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 45370 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 45380 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45390 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 45400 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 45410 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 45420 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45430 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45440 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 45450 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 45460 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 45470 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 45480 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 45490 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5979
INFO:Entity Linker:
==== Accuracy on dev after 45500 iterations: 0.5040
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45510 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 45520 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 45530 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 45540 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 45550 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 45560 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45570 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 45580 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 45590 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 45600 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 45610 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45620 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 45630 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 45640 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 45650 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 45660 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 45670 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 45680 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 45690 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 45700 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 45710 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45720 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 45730 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 45740 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 45750 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 45760 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 45770 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 45780 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 45790 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 45800 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45810 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 45820 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45830 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 45840 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 45850 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 45860 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 45870 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45880 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 45890 ======
INFO:Entity Linker:
=====Loss: 0.3615 Step: 45900 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 45910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 45920 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 45930 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 45940 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 45950 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 45960 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 45970 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 45980 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 45990 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5963
INFO:Entity Linker:
==== Accuracy on dev after 46000 iterations: 0.5044
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46010 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 46020 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 46030 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 46040 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 46050 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 46060 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46070 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 46080 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 46090 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46100 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 46110 ======
INFO:Entity Linker:
=====Loss: 0.3632 Step: 46120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 46130 ======
one_epoch_time 218.78426551818848
INFO:Entity Linker:
=====Epoch Number: 60 =====
INFO:Entity Linker:
=====Loss: 0.3556 Step: 46140 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46150 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 46160 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46180 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 46190 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 46200 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 46210 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46220 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46230 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 46240 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 46250 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 46260 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 46270 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46280 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46290 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 46300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 46310 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 46320 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 46330 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 46340 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 46350 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 46360 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 46370 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 46380 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 46400 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 46410 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 46420 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 46430 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 46440 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 46450 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 46460 ======
INFO:Entity Linker:
=====Loss: 0.3627 Step: 46470 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 46480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 46490 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5914
INFO:Entity Linker:
==== Accuracy on dev after 46500 iterations: 0.4992
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46510 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 46520 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 46530 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 46540 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 46550 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 46560 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 46570 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 46580 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 46590 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46600 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 46610 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 46620 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 46630 ======
INFO:Entity Linker:
=====Loss: 0.3614 Step: 46640 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 46650 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 46660 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 46670 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 46680 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 46690 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 46700 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 46710 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 46720 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 46730 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 46740 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 46750 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 46760 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 46770 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 46780 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 46790 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 46800 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 46810 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 46820 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 46830 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 46840 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46850 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 46860 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 46870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 46880 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 46890 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 46900 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 46910 ======
one_epoch_time 211.79808568954468
INFO:Entity Linker:
=====Epoch Number: 61 =====
INFO:Entity Linker:
=====Loss: 0.3561 Step: 46920 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 46930 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 46940 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 46950 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 46960 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 46970 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 46980 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 46990 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 47000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5957
INFO:Entity Linker:
==== Accuracy on dev after 47000 iterations: 0.5017
INFO:Entity Linker:
=====Loss: 0.3582 Step: 47010 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 47020 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 47030 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 47040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 47050 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 47060 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47070 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47080 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 47090 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 47100 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47110 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 47120 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 47130 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47140 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 47150 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 47160 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47170 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47180 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 47190 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 47200 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 47210 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47220 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 47230 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 47240 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47250 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47260 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 47270 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 47280 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 47290 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47300 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 47310 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 47320 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 47330 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 47340 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 47350 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 47360 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 47370 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 47380 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 47390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47400 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47410 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 47420 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 47430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47440 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47450 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 47460 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47470 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47480 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5967
INFO:Entity Linker:
==== Accuracy on dev after 47500 iterations: 0.5034
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47510 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47540 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 47550 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 47560 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 47570 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 47580 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 47590 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 47600 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 47610 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 47620 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47630 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 47640 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 47650 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 47660 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 47670 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 47680 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 47690 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 47700 ======
one_epoch_time 219.33735942840576
INFO:Entity Linker:
=====Epoch Number: 62 =====
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47710 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 47720 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 47730 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47740 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 47750 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 47760 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 47770 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 47780 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 47790 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 47800 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 47810 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 47820 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47830 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 47840 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 47850 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 47860 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 47870 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 47880 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 47890 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 47900 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 47910 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 47920 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 47930 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 47940 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 47950 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 47960 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 47970 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 47980 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 47990 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 48000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5973
INFO:Entity Linker:
==== Accuracy on dev after 48000 iterations: 0.5039
INFO:Entity Linker:
=====Loss: 0.3558 Step: 48010 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 48030 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 48040 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 48050 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 48060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48070 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 48080 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48090 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 48100 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 48110 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 48120 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48130 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 48140 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 48150 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 48160 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48170 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 48180 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 48190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 48200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 48210 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 48220 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 48230 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48240 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 48250 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 48260 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48270 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 48280 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 48290 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 48300 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48310 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 48320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48330 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 48340 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48350 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 48360 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 48370 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 48380 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48390 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 48400 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 48410 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 48420 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 48430 ======
INFO:Entity Linker:
=====Loss: 0.3611 Step: 48440 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48450 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 48460 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 48470 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 48480 ======
one_epoch_time 206.85688018798828
INFO:Entity Linker:
=====Epoch Number: 63 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48490 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 48500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5962
INFO:Entity Linker:
==== Accuracy on dev after 48500 iterations: 0.5027
INFO:Entity Linker:
=====Loss: 0.3564 Step: 48510 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 48520 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 48530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 48540 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 48550 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48560 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 48570 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 48580 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48590 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 48600 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 48610 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48620 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48630 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 48640 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 48650 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 48660 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 48670 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48680 ======
INFO:Entity Linker:
=====Loss: 0.3616 Step: 48690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 48700 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 48710 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 48720 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 48730 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 48740 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 48750 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48760 ======
INFO:Entity Linker:
=====Loss: 0.3519 Step: 48770 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 48780 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48790 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 48800 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 48810 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 48820 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 48830 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 48840 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 48850 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 48860 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 48870 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 48880 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 48890 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 48900 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 48910 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 48920 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 48930 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 48940 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 48950 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 48960 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 48970 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 48980 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 48990 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5932
INFO:Entity Linker:
==== Accuracy on dev after 49000 iterations: 0.4983
INFO:Entity Linker:
=====Loss: 0.3548 Step: 49010 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 49020 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49030 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 49040 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 49050 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 49060 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 49070 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 49080 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 49090 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 49100 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 49110 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 49120 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 49130 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 49140 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 49150 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 49160 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49170 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 49180 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 49190 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 49200 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 49210 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49220 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 49230 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 49240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49250 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 49260 ======
one_epoch_time 218.1157569885254
INFO:Entity Linker:
=====Epoch Number: 64 =====
INFO:Entity Linker:
=====Loss: 0.3575 Step: 49270 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 49280 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 49290 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 49300 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 49310 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 49320 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49330 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 49340 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 49350 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 49360 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49370 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 49380 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 49390 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49400 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 49410 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 49420 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 49430 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 49440 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49460 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49470 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49480 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 49490 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 49500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5956
INFO:Entity Linker:
==== Accuracy on dev after 49500 iterations: 0.4999
INFO:Entity Linker:
=====Loss: 0.3585 Step: 49510 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49520 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 49530 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49540 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 49550 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49560 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 49570 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 49580 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 49590 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 49600 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 49610 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 49620 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49630 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 49640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 49650 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 49660 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 49670 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 49680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 49690 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 49700 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 49710 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 49720 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 49730 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 49740 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 49750 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 49760 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 49770 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 49780 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 49790 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 49800 ======
INFO:Entity Linker:
=====Loss: 0.3623 Step: 49810 ======
INFO:Entity Linker:
=====Loss: 0.3602 Step: 49820 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 49830 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 49840 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 49850 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49860 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 49870 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 49880 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 49890 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 49900 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 49910 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 49920 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 49930 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49940 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 49950 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 49960 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 49970 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 49980 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 49990 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 50000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5984
INFO:Entity Linker:
==== Accuracy on dev after 50000 iterations: 0.5052
INFO:Entity Linker:Hierarchical Accuracy: 0.5969
INFO:Entity Linker:
==== Accuracy on test after 50000 iterations: 0.5100
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50010 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 50020 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 50030 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 50040 ======
one_epoch_time 197.8830349445343
INFO:Entity Linker:
=====Epoch Number: 65 =====
INFO:Entity Linker:
=====Loss: 0.3547 Step: 50050 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 50060 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50070 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50080 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50090 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50110 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 50120 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50130 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 50140 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 50150 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 50160 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 50170 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50180 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 50190 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 50200 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 50210 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50220 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50230 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 50240 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 50250 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 50260 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 50270 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 50280 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50290 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 50300 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 50310 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 50320 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50330 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 50340 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 50350 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 50360 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 50370 ======
INFO:Entity Linker:
=====Loss: 0.3625 Step: 50380 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 50390 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 50400 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 50410 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50420 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50430 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 50440 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 50450 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 50460 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 50470 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 50480 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 50490 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5955
INFO:Entity Linker:
==== Accuracy on dev after 50500 iterations: 0.5031
INFO:Entity Linker:
=====Loss: 0.3576 Step: 50510 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50520 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 50530 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 50540 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 50550 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 50560 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 50570 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50580 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 50590 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50600 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 50610 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 50620 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 50630 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50640 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 50650 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 50660 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50670 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 50680 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 50690 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 50700 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 50710 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 50720 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 50730 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 50740 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 50750 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 50760 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 50770 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 50780 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 50800 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50810 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 50820 ======
one_epoch_time 175.06949996948242
INFO:Entity Linker:
=====Epoch Number: 66 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50830 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 50840 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 50850 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 50860 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 50870 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50880 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 50890 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 50900 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 50910 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 50920 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 50940 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 50950 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 50960 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 50970 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 50980 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 50990 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 51000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5985
INFO:Entity Linker:
==== Accuracy on dev after 51000 iterations: 0.5048
INFO:Entity Linker:
=====Loss: 0.3560 Step: 51010 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 51020 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 51030 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 51040 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51050 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51060 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51070 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51080 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 51100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51110 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51120 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 51130 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 51140 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 51150 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 51160 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 51170 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51180 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 51190 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 51200 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 51210 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51220 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 51230 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51240 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 51250 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 51260 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51270 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51280 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51290 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 51300 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 51310 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51320 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 51330 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51340 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 51350 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 51360 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 51370 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51380 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 51390 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 51400 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 51410 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 51420 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 51430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51440 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 51450 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51460 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 51470 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51480 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 51490 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 51500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5963
INFO:Entity Linker:
==== Accuracy on dev after 51500 iterations: 0.5025
INFO:Entity Linker:
=====Loss: 0.3587 Step: 51510 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51520 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 51530 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51540 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51550 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51560 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 51570 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51580 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51590 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 51600 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51610 ======
one_epoch_time 179.04845905303955
INFO:Entity Linker:
=====Epoch Number: 67 =====
INFO:Entity Linker:
=====Loss: 0.3565 Step: 51620 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 51630 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 51640 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 51650 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 51660 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51670 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 51680 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51690 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 51700 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 51710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 51720 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 51730 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 51740 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 51750 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 51760 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 51770 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 51780 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 51790 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 51800 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51810 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 51820 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 51830 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 51840 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 51850 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51860 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 51870 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 51880 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 51890 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 51900 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 51910 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 51920 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 51930 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 51940 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 51950 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51960 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 51970 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 51980 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 51990 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5970
INFO:Entity Linker:
==== Accuracy on dev after 52000 iterations: 0.5055
INFO:Entity Linker:Hierarchical Accuracy: 0.6025
INFO:Entity Linker:
==== Accuracy on test after 52000 iterations: 0.5131
INFO:Entity Linker:
=====Loss: 0.3560 Step: 52010 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52020 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 52030 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 52040 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 52050 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52060 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 52070 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 52080 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 52090 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 52100 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52110 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52120 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 52140 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 52150 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 52160 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52170 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 52180 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52190 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 52200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 52210 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 52220 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52230 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52240 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 52250 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52260 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 52270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52280 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52290 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52300 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 52310 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 52320 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 52330 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 52340 ======
INFO:Entity Linker:
=====Loss: 0.3608 Step: 52350 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52360 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 52370 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 52380 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52390 ======
one_epoch_time 202.17608737945557
INFO:Entity Linker:
=====Epoch Number: 68 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52400 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 52410 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 52420 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 52430 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52440 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 52450 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52460 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 52470 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 52480 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52490 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 52500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5988
INFO:Entity Linker:
==== Accuracy on dev after 52500 iterations: 0.5048
INFO:Entity Linker:
=====Loss: 0.3543 Step: 52510 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 52520 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 52530 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 52540 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52550 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 52560 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52570 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52580 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 52590 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 52600 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52610 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 52620 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 52630 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 52640 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 52650 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 52660 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52670 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 52680 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 52690 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 52700 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 52710 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 52720 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 52730 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 52740 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 52750 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52760 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 52770 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52780 ======
INFO:Entity Linker:
=====Loss: 0.3884 Step: 52790 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 52800 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 52810 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 52820 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 52830 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 52840 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 52850 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 52860 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 52870 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 52880 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52890 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 52900 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 52910 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 52920 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 52930 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 52940 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 52950 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 52960 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 52970 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 52980 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 52990 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 53000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5963
INFO:Entity Linker:
==== Accuracy on dev after 53000 iterations: 0.5050
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53010 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 53020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 53030 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 53040 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 53050 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53060 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 53070 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53080 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 53090 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 53100 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 53110 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53120 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 53130 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 53140 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 53150 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53160 ======
INFO:Entity Linker:
=====Loss: 0.3618 Step: 53170 ======
one_epoch_time 196.09459400177002
INFO:Entity Linker:
=====Epoch Number: 69 =====
INFO:Entity Linker:
=====Loss: 0.3568 Step: 53180 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 53190 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 53200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53210 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 53220 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 53230 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 53240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53250 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53260 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 53270 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53280 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 53290 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 53300 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 53310 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 53320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 53330 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 53340 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 53350 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53360 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53370 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 53380 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 53390 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53400 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 53410 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53420 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 53430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 53440 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53450 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53460 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 53470 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53490 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6007
INFO:Entity Linker:
==== Accuracy on dev after 53500 iterations: 0.5101
INFO:Entity Linker:Hierarchical Accuracy: 0.6024
INFO:Entity Linker:
==== Accuracy on test after 53500 iterations: 0.5155
INFO:Entity Linker:
=====Loss: 0.3550 Step: 53510 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 53520 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 53530 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53540 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53550 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 53560 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 53570 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 53580 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 53590 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53600 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 53610 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 53620 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 53630 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 53640 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53650 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 53660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53670 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 53680 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 53690 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 53700 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 53710 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 53720 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 53730 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 53740 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 53750 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 53760 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 53770 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 53780 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 53790 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 53800 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 53810 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 53820 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53830 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 53840 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 53850 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 53860 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 53870 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 53880 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 53890 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 53900 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 53910 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 53920 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 53930 ======
INFO:Entity Linker:
=====Loss: 0.3628 Step: 53940 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 53950 ======
one_epoch_time 178.06586456298828
INFO:Entity Linker:
=====Epoch Number: 70 =====
INFO:Entity Linker:
=====Loss: 0.3553 Step: 53960 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 53970 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 53980 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 53990 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 54000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5958
INFO:Entity Linker:
==== Accuracy on dev after 54000 iterations: 0.5026
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54010 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 54020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 54030 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 54040 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 54050 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 54060 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54070 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 54080 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54090 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 54100 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 54110 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 54120 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 54130 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 54140 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 54150 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 54160 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 54170 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 54180 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 54190 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54200 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 54210 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 54220 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 54230 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54240 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54250 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 54260 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 54270 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54280 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 54290 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 54300 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 54310 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 54320 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 54330 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 54340 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 54350 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 54360 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 54370 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 54380 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 54390 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 54400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54410 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 54420 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 54430 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 54440 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 54450 ======
INFO:Entity Linker:
=====Loss: 0.3609 Step: 54460 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 54470 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 54480 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54490 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 54500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5975
INFO:Entity Linker:
==== Accuracy on dev after 54500 iterations: 0.5057
INFO:Entity Linker:
=====Loss: 0.3568 Step: 54510 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 54520 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 54530 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54540 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54550 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 54560 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 54570 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 54580 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 54590 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 54600 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 54610 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 54620 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54630 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 54640 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 54650 ======
INFO:Entity Linker:
=====Loss: 0.3620 Step: 54660 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54670 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 54680 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54690 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54700 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 54710 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 54720 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54730 ======
one_epoch_time 206.6469805240631
INFO:Entity Linker:
=====Epoch Number: 71 =====
INFO:Entity Linker:
=====Loss: 0.3571 Step: 54740 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 54750 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 54760 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 54770 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 54780 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 54790 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 54800 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 54810 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 54820 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 54830 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 54840 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 54850 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 54860 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 54870 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 54880 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 54890 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 54900 ======
INFO:Entity Linker:
=====Loss: 0.3617 Step: 54910 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 54920 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 54930 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 54940 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 54950 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 54960 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 54970 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 54980 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 54990 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 55000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5997
INFO:Entity Linker:
==== Accuracy on dev after 55000 iterations: 0.5061
INFO:Entity Linker:
=====Loss: 0.3577 Step: 55010 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55020 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 55030 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 55040 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 55050 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 55060 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 55070 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55080 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 55090 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 55100 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 55110 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55120 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 55130 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 55140 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 55150 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 55160 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 55170 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 55180 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 55190 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55200 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 55210 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55220 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55230 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 55240 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 55250 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55260 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 55270 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 55280 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 55290 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 55300 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 55310 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 55320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 55330 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55340 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55360 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 55370 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 55380 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 55390 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 55400 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 55410 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 55420 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 55430 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55440 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55450 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 55460 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55470 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 55480 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 55490 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 55500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5962
INFO:Entity Linker:
==== Accuracy on dev after 55500 iterations: 0.5024
INFO:Entity Linker:
=====Loss: 0.3570 Step: 55510 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55520 ======
one_epoch_time 216.3754050731659
INFO:Entity Linker:
=====Epoch Number: 72 =====
INFO:Entity Linker:
=====Loss: 0.3564 Step: 55530 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 55540 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 55550 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55560 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 55570 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55580 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55590 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 55600 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 55610 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 55620 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 55630 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55640 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55650 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55660 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 55670 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 55680 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 55690 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 55700 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55710 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 55720 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 55730 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 55740 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 55750 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 55760 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 55770 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 55780 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 55790 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 55800 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 55810 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 55820 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 55830 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55840 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 55850 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 55860 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 55870 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 55880 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 55890 ======
INFO:Entity Linker:
=====Loss: 0.3520 Step: 55900 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 55910 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 55920 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 55930 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 55940 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 55950 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 55960 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 55970 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 55980 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 55990 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5991
INFO:Entity Linker:
==== Accuracy on dev after 56000 iterations: 0.5062
INFO:Entity Linker:
=====Loss: 0.3563 Step: 56010 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 56020 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56030 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56040 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56050 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 56060 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56070 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56080 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56090 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56100 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 56110 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56120 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 56130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56140 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 56150 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 56160 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56170 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56180 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 56190 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 56200 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 56210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56220 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 56230 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56240 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56250 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 56260 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 56280 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 56290 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56300 ======
one_epoch_time 185.1197361946106
INFO:Entity Linker:
=====Epoch Number: 73 =====
INFO:Entity Linker:
=====Loss: 0.3543 Step: 56310 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 56320 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 56330 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 56340 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 56350 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56360 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56370 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 56380 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 56390 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 56400 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 56410 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 56420 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56430 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 56440 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 56450 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56460 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 56470 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56480 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 56490 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5974
INFO:Entity Linker:
==== Accuracy on dev after 56500 iterations: 0.5032
INFO:Entity Linker:
=====Loss: 0.3600 Step: 56510 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 56520 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 56530 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56540 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56550 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56560 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56570 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 56580 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 56590 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 56600 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 56610 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 56620 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56630 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 56640 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 56650 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56660 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 56670 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 56680 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 56690 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 56700 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56710 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 56720 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 56730 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56740 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 56750 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 56760 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 56770 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 56780 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 56790 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 56800 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 56810 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 56820 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 56830 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 56840 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 56850 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 56860 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 56870 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 56880 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 56890 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 56900 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 56910 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 56920 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 56930 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 56940 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 56950 ======
INFO:Entity Linker:
=====Loss: 0.3604 Step: 56960 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 56970 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 56980 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 56990 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 57000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5966
INFO:Entity Linker:
==== Accuracy on dev after 57000 iterations: 0.5033
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57010 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 57020 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 57030 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57040 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57050 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57060 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57070 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 57080 ======
one_epoch_time 190.43340015411377
INFO:Entity Linker:
=====Epoch Number: 74 =====
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57090 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 57100 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 57110 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57120 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 57130 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 57140 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 57150 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 57160 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 57170 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 57180 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57190 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 57200 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 57210 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 57220 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 57230 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 57240 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57250 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 57260 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 57270 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 57280 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57290 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57300 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 57310 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57320 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57330 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57350 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 57360 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57370 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 57380 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 57400 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57410 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57420 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57430 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 57440 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 57450 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 57460 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57470 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57480 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57490 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5961
INFO:Entity Linker:
==== Accuracy on dev after 57500 iterations: 0.5030
INFO:Entity Linker:
=====Loss: 0.3565 Step: 57510 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57520 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 57530 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 57540 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 57550 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 57560 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 57570 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 57580 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 57590 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 57600 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 57610 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57620 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 57630 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 57640 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 57650 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 57660 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57670 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 57680 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 57690 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57700 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 57710 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 57720 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57730 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 57740 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57750 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 57760 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 57770 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57780 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 57790 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 57800 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 57810 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 57820 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57830 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 57840 ======
INFO:Entity Linker:
=====Loss: 0.3634 Step: 57850 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 57860 ======
one_epoch_time 184.52604365348816
INFO:Entity Linker:
=====Epoch Number: 75 =====
INFO:Entity Linker:
=====Loss: 0.3558 Step: 57870 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57880 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 57890 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57900 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 57910 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 57920 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 57930 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 57940 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 57950 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 57960 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 57970 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 57980 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 57990 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5999
INFO:Entity Linker:
==== Accuracy on dev after 58000 iterations: 0.5067
INFO:Entity Linker:
=====Loss: 0.3578 Step: 58010 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 58020 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58030 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 58040 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58050 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 58060 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 58070 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58080 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 58090 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 58100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58110 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 58120 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 58130 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 58140 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58150 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58160 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 58170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58180 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58190 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 58200 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 58210 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 58220 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 58230 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58240 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 58250 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 58260 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 58270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 58280 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58290 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58300 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 58310 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58320 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 58330 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 58340 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 58350 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 58360 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 58370 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 58380 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 58390 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 58400 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 58410 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58420 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 58430 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 58440 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58450 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 58460 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 58470 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 58480 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 58490 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5995
INFO:Entity Linker:
==== Accuracy on dev after 58500 iterations: 0.5087
INFO:Entity Linker:
=====Loss: 0.3557 Step: 58510 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 58520 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58530 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58540 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 58550 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 58560 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 58570 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 58580 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58590 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 58600 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 58610 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58620 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58630 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58640 ======
one_epoch_time 180.18090343475342
INFO:Entity Linker:
=====Epoch Number: 76 =====
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58650 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 58660 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 58670 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 58680 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58690 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 58700 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 58710 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 58720 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 58730 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 58740 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58750 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 58760 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 58770 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 58780 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58800 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 58810 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 58820 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58830 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58840 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 58850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 58860 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 58870 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 58880 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 58890 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 58900 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 58910 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 58920 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 58930 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 58940 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 58950 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 58960 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 58970 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 58980 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 58990 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 59000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6026
INFO:Entity Linker:
==== Accuracy on dev after 59000 iterations: 0.5106
INFO:Entity Linker:Hierarchical Accuracy: 0.6025
INFO:Entity Linker:
==== Accuracy on test after 59000 iterations: 0.5154
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59010 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 59020 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 59030 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59040 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59050 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 59060 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 59070 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 59080 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59090 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59100 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59110 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 59120 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 59130 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59140 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 59150 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 59160 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 59180 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 59190 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 59200 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 59210 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 59220 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59230 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 59240 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59250 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59260 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 59270 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 59280 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 59290 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59300 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 59310 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59320 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 59330 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 59340 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 59350 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59360 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 59370 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 59380 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 59390 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 59400 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59410 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 59420 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 59430 ======
one_epoch_time 182.5898940563202
INFO:Entity Linker:
=====Epoch Number: 77 =====
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59440 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 59450 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 59460 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 59470 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59480 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59490 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5975
INFO:Entity Linker:
==== Accuracy on dev after 59500 iterations: 0.5028
INFO:Entity Linker:
=====Loss: 0.3557 Step: 59510 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 59520 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59530 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 59540 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 59550 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59560 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59570 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 59580 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 59590 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 59600 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59610 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59620 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 59630 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 59640 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 59650 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59660 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 59670 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 59680 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59690 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59700 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 59710 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 59720 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 59730 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 59740 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 59750 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59760 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 59770 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 59780 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 59790 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59800 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59810 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 59820 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 59830 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 59840 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59850 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 59860 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 59870 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59880 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 59890 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 59900 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 59910 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59920 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 59930 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 59940 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 59950 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 59960 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 59970 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 59980 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 59990 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 60000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5967
INFO:Entity Linker:
==== Accuracy on dev after 60000 iterations: 0.5023
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60010 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 60020 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 60030 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60040 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 60050 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 60060 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60070 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 60080 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60090 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 60100 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 60110 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 60120 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 60130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 60140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60150 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60160 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 60170 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 60180 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 60190 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 60200 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 60210 ======
one_epoch_time 215.34261989593506
INFO:Entity Linker:
=====Epoch Number: 78 =====
INFO:Entity Linker:
=====Loss: 0.3561 Step: 60220 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60230 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 60240 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 60250 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60260 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 60270 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 60280 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60290 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60300 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60310 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 60320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 60330 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 60340 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 60360 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60370 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 60380 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60390 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 60400 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 60410 ======
INFO:Entity Linker:
=====Loss: 0.3613 Step: 60420 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 60430 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 60440 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 60450 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60460 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 60470 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 60480 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 60490 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 60500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5998
INFO:Entity Linker:
==== Accuracy on dev after 60500 iterations: 0.5071
INFO:Entity Linker:
=====Loss: 0.3589 Step: 60510 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 60520 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 60530 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 60540 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 60550 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 60560 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 60570 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 60580 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 60590 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 60600 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 60610 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 60620 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 60630 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 60640 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60650 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 60660 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 60670 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 60680 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 60690 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 60700 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 60710 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 60720 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 60730 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 60740 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 60750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60760 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 60770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 60780 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 60790 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 60800 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 60810 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 60820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 60830 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 60840 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 60850 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 60860 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 60870 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 60880 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 60890 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 60900 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 60910 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 60920 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 60930 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 60940 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 60950 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 60960 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 60970 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 60980 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 60990 ======
one_epoch_time 191.14348888397217
INFO:Entity Linker:
=====Epoch Number: 79 =====
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5996
INFO:Entity Linker:
==== Accuracy on dev after 61000 iterations: 0.5070
INFO:Entity Linker:
=====Loss: 0.3574 Step: 61010 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 61020 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 61030 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 61040 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 61050 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 61060 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 61070 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 61080 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61090 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 61100 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 61110 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 61120 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 61130 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61150 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61160 ======
INFO:Entity Linker:
=====Loss: 0.3596 Step: 61170 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 61180 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 61190 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 61200 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 61210 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 61220 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61230 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61240 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61250 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 61260 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 61270 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 61280 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 61290 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61300 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61310 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 61320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61330 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 61340 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 61350 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61360 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 61370 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61380 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 61390 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61400 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 61410 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61420 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 61430 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 61440 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 61450 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 61460 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61470 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 61480 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 61490 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 61500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6000
INFO:Entity Linker:
==== Accuracy on dev after 61500 iterations: 0.5055
INFO:Entity Linker:
=====Loss: 0.3548 Step: 61510 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61520 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 61530 ======
INFO:Entity Linker:
=====Loss: 0.3597 Step: 61540 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 61550 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 61560 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 61570 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 61580 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61590 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 61600 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 61610 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 61620 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 61630 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61640 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 61650 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61660 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 61670 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61680 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 61690 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 61700 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 61710 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 61720 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 61730 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61740 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61750 ======
INFO:Entity Linker:
=====Loss: 0.3601 Step: 61760 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 61770 ======
one_epoch_time 178.91503524780273
INFO:Entity Linker:
=====Epoch Number: 80 =====
INFO:Entity Linker:
=====Loss: 0.3554 Step: 61780 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 61790 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 61800 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61810 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 61820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 61830 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 61840 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 61850 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 61860 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61870 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 61880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 61890 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 61900 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 61910 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 61920 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 61930 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 61940 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 61950 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61960 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 61970 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 61980 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 61990 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 62000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5962
INFO:Entity Linker:
==== Accuracy on dev after 62000 iterations: 0.5036
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62010 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 62020 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 62030 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 62040 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 62050 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 62060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62070 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 62080 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 62090 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 62100 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 62110 ======
INFO:Entity Linker:
=====Loss: 0.3610 Step: 62120 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62130 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62140 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62150 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 62160 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 62170 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 62180 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 62190 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62200 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62210 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 62220 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 62230 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62240 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62250 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 62260 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 62270 ======
INFO:Entity Linker:
=====Loss: 0.3606 Step: 62280 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 62290 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 62300 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 62310 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 62320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62330 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 62340 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 62350 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62360 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 62370 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62380 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 62390 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62400 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 62410 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 62420 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 62430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62440 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62450 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 62460 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 62470 ======
INFO:Entity Linker:
=====Loss: 0.3605 Step: 62480 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 62490 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5987
INFO:Entity Linker:
==== Accuracy on dev after 62500 iterations: 0.5074
INFO:Entity Linker:
=====Loss: 0.3559 Step: 62510 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 62520 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62530 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 62540 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 62550 ======
one_epoch_time 178.262943983078
INFO:Entity Linker:
=====Epoch Number: 81 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 62560 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62570 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 62590 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 62600 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 62610 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 62620 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 62630 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 62640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62650 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62660 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 62670 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 62680 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 62690 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62700 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 62710 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 62720 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 62730 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62740 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 62750 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 62760 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62770 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62780 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 62790 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 62800 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 62810 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 62820 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 62830 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 62840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62850 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62860 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 62870 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 62880 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 62890 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 62900 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 62910 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 62920 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 62930 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 62940 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 62950 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 62960 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 62970 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 62980 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 62990 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 63000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6011
INFO:Entity Linker:
==== Accuracy on dev after 63000 iterations: 0.5096
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63010 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 63020 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63030 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 63040 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63050 ======
INFO:Entity Linker:
=====Loss: 0.3587 Step: 63060 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63070 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 63080 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63090 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 63100 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 63110 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 63120 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63130 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 63140 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 63150 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63160 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 63170 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63180 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63190 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 63200 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 63210 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 63220 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 63230 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 63240 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 63250 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 63260 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 63270 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 63280 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63290 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63300 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63310 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 63320 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 63330 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 63340 ======
one_epoch_time 187.3455913066864
INFO:Entity Linker:
=====Epoch Number: 82 =====
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63350 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 63360 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63370 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63380 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 63390 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63400 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63410 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 63420 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 63430 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 63440 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 63450 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63460 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 63470 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63480 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 63490 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 63500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6026
INFO:Entity Linker:
==== Accuracy on dev after 63500 iterations: 0.5105
INFO:Entity Linker:
=====Loss: 0.3567 Step: 63510 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63520 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 63530 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 63540 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 63550 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63560 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 63570 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 63590 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 63600 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 63610 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 63620 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 63630 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 63640 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63650 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 63660 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 63670 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63680 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 63690 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 63700 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 63710 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 63720 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63730 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63740 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 63750 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 63760 ======
INFO:Entity Linker:
=====Loss: 0.3535 Step: 63770 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 63780 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63790 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 63800 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 63810 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 63820 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 63830 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 63840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 63850 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 63860 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 63870 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 63880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 63890 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 63900 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 63910 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63920 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63930 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 63940 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 63950 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 63960 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 63970 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 63980 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 63990 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 64000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5995
INFO:Entity Linker:
==== Accuracy on dev after 64000 iterations: 0.5058
INFO:Entity Linker:
=====Loss: 0.3553 Step: 64010 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 64020 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64030 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 64050 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 64060 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 64070 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 64080 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 64090 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64100 ======
INFO:Entity Linker:
=====Loss: 0.3584 Step: 64110 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 64120 ======
one_epoch_time 225.4181263446808
INFO:Entity Linker:
=====Epoch Number: 83 =====
INFO:Entity Linker:
=====Loss: 0.3548 Step: 64130 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 64140 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 64150 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 64160 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 64170 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 64180 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 64190 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 64200 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 64210 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64220 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64230 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 64240 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 64250 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64260 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 64270 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64280 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 64290 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 64300 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 64310 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64320 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 64330 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 64340 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 64350 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64360 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64370 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 64380 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 64390 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64400 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 64410 ======
INFO:Entity Linker:
=====Loss: 0.3599 Step: 64420 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 64430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 64440 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 64450 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 64460 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 64470 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 64480 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 64490 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 64500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6022
INFO:Entity Linker:
==== Accuracy on dev after 64500 iterations: 0.5117
INFO:Entity Linker:Hierarchical Accuracy: 0.6056
INFO:Entity Linker:
==== Accuracy on test after 64500 iterations: 0.5204
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64510 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 64520 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 64530 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 64540 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64550 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 64560 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 64570 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64580 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 64590 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 64600 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64610 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 64620 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 64630 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64640 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 64650 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 64660 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64670 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 64680 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 64690 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64700 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64710 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 64720 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 64730 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 64740 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 64750 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 64760 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 64770 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 64780 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 64790 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64800 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 64810 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 64820 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 64830 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 64840 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 64850 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64860 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 64870 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 64880 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 64890 ======
INFO:Entity Linker:
=====Loss: 0.3600 Step: 64900 ======
one_epoch_time 219.83664631843567
INFO:Entity Linker:
=====Epoch Number: 84 =====
INFO:Entity Linker:
=====Loss: 0.3560 Step: 64910 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 64920 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 64930 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 64940 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 64950 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 64960 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 64970 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 64980 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 64990 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 65000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6011
INFO:Entity Linker:
==== Accuracy on dev after 65000 iterations: 0.5096
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65010 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 65020 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 65030 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65040 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 65050 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65060 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65070 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 65080 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 65090 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65100 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65110 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 65120 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 65130 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 65140 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65150 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 65160 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 65170 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 65180 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65190 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65200 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65210 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65220 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 65230 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65240 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 65250 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 65260 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65270 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65280 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65290 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 65300 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 65310 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 65320 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65330 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 65340 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 65350 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 65360 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 65370 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 65380 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 65390 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 65400 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 65410 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 65420 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65430 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 65440 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 65450 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 65460 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 65470 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 65480 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 65490 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5945
INFO:Entity Linker:
==== Accuracy on dev after 65500 iterations: 0.5020
INFO:Entity Linker:
=====Loss: 0.3538 Step: 65510 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 65520 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65530 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 65540 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 65550 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65560 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 65570 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 65580 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65590 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65600 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65610 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65620 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 65630 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 65640 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 65650 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 65660 ======
INFO:Entity Linker:
=====Loss: 0.3607 Step: 65670 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 65680 ======
one_epoch_time 217.52614641189575
INFO:Entity Linker:
=====Epoch Number: 85 =====
INFO:Entity Linker:
=====Loss: 0.3555 Step: 65690 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 65700 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 65710 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 65720 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 65730 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 65740 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 65750 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 65760 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65770 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 65780 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65790 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 65800 ======
INFO:Entity Linker:
=====Loss: 0.3528 Step: 65810 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 65820 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 65830 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 65840 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 65850 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 65860 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 65870 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 65880 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 65890 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 65900 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 65910 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65920 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 65930 ======
INFO:Entity Linker:
=====Loss: 0.3591 Step: 65940 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 65950 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 65960 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 65970 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 65980 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 65990 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 66000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6023
INFO:Entity Linker:
==== Accuracy on dev after 66000 iterations: 0.5110
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66010 ======
INFO:Entity Linker:
=====Loss: 0.3603 Step: 66020 ======
INFO:Entity Linker:
=====Loss: 0.3592 Step: 66030 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 66040 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66050 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 66060 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66070 ======
INFO:Entity Linker:
=====Loss: 0.3523 Step: 66080 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66090 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66100 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66110 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66120 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 66130 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 66140 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 66150 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 66160 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 66170 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 66180 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 66190 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 66200 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 66210 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66220 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 66230 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 66240 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 66250 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 66260 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66270 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66280 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 66290 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 66300 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66310 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66320 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66330 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66340 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 66350 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 66360 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 66370 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66380 ======
INFO:Entity Linker:
=====Loss: 0.3612 Step: 66390 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 66400 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66410 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66420 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 66430 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66440 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 66450 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 66460 ======
one_epoch_time 215.60596537590027
INFO:Entity Linker:
=====Epoch Number: 86 =====
INFO:Entity Linker:
=====Loss: 0.3545 Step: 66470 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 66480 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 66490 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6003
INFO:Entity Linker:
==== Accuracy on dev after 66500 iterations: 0.5075
INFO:Entity Linker:
=====Loss: 0.3539 Step: 66510 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 66520 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 66530 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66540 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 66550 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 66560 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 66570 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66580 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 66590 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 66600 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 66610 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66620 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 66630 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 66640 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 66650 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66660 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 66670 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 66680 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 66690 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 66700 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66710 ======
INFO:Entity Linker:
=====Loss: 0.3536 Step: 66720 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66730 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 66740 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66750 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 66760 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 66770 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 66780 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 66790 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 66800 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 66810 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 66820 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 66830 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 66840 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 66850 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 66860 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66870 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 66880 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 66890 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 66900 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 66910 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 66920 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 66930 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 66940 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 66950 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 66960 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 66970 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 66980 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 66990 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 67000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5997
INFO:Entity Linker:
==== Accuracy on dev after 67000 iterations: 0.5064
INFO:Entity Linker:
=====Loss: 0.3593 Step: 67010 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 67020 ======
INFO:Entity Linker:
=====Loss: 0.3525 Step: 67030 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67040 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 67050 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 67060 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67070 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 67080 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 67090 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67100 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 67110 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 67120 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67130 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67140 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 67150 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 67160 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 67170 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 67180 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 67190 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 67200 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67210 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 67220 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 67230 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 67240 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 67250 ======
one_epoch_time 217.98821234703064
INFO:Entity Linker:
=====Epoch Number: 87 =====
INFO:Entity Linker:
=====Loss: 0.3554 Step: 67260 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 67270 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 67280 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 67290 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67300 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 67310 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 67330 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 67340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67350 ======
INFO:Entity Linker:
=====Loss: 0.3595 Step: 67360 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 67370 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67380 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 67390 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 67400 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 67410 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67420 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 67430 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 67440 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 67450 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 67460 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 67470 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 67480 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67490 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 67500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5987
INFO:Entity Linker:
==== Accuracy on dev after 67500 iterations: 0.5062
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67510 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 67520 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 67530 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67540 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 67550 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 67560 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67570 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 67580 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 67590 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 67600 ======
INFO:Entity Linker:
=====Loss: 0.3529 Step: 67610 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67620 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 67630 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67640 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67650 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 67660 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67670 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 67680 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 67690 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 67700 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67710 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 67720 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 67730 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67740 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 67750 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 67760 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67770 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67780 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 67790 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67800 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67810 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 67820 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67830 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67840 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 67850 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 67860 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 67870 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67880 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67890 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 67900 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 67910 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 67920 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 67930 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 67940 ======
INFO:Entity Linker:
=====Loss: 0.3576 Step: 67950 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 67960 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 67970 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 67980 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 67990 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 68000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5974
INFO:Entity Linker:
==== Accuracy on dev after 68000 iterations: 0.5049
INFO:Entity Linker:
=====Loss: 0.3553 Step: 68010 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 68020 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 68030 ======
one_epoch_time 220.31659817695618
INFO:Entity Linker:
=====Epoch Number: 88 =====
INFO:Entity Linker:
=====Loss: 0.3547 Step: 68040 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68050 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 68060 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68070 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68080 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68090 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68100 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68110 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 68120 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 68130 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 68140 ======
INFO:Entity Linker:
=====Loss: 0.3527 Step: 68150 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 68160 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68170 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68180 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 68190 ======
INFO:Entity Linker:
=====Loss: 0.3583 Step: 68200 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 68210 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68220 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 68230 ======
INFO:Entity Linker:
=====Loss: 0.3590 Step: 68240 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68250 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 68260 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 68270 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 68280 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 68290 ======
INFO:Entity Linker:
=====Loss: 0.3585 Step: 68300 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68310 ======
INFO:Entity Linker:
=====Loss: 0.3532 Step: 68320 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 68330 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 68340 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68350 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 68360 ======
INFO:Entity Linker:
=====Loss: 0.3575 Step: 68370 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68380 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68390 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68400 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 68410 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68420 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 68430 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 68440 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68450 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68460 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 68470 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 68480 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 68490 ======
INFO:Entity Linker:
=====Loss: 0.3537 Step: 68500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6008
INFO:Entity Linker:
==== Accuracy on dev after 68500 iterations: 0.5096
INFO:Entity Linker:
=====Loss: 0.3568 Step: 68510 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 68520 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68530 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68540 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 68550 ======
INFO:Entity Linker:
=====Loss: 0.3533 Step: 68560 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 68570 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68580 ======
INFO:Entity Linker:
=====Loss: 0.3570 Step: 68590 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 68600 ======
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68610 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 68620 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68630 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68640 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68650 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 68660 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68670 ======
INFO:Entity Linker:
=====Loss: 0.3544 Step: 68680 ======
INFO:Entity Linker:
=====Loss: 0.3594 Step: 68690 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 68700 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68710 ======
INFO:Entity Linker:
=====Loss: 0.3572 Step: 68720 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 68730 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 68740 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 68750 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68760 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 68770 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 68780 ======
INFO:Entity Linker:
=====Loss: 0.3559 Step: 68790 ======
INFO:Entity Linker:
=====Loss: 0.3563 Step: 68800 ======
INFO:Entity Linker:
=====Loss: 0.3598 Step: 68810 ======
one_epoch_time 218.7773118019104
INFO:Entity Linker:
=====Epoch Number: 89 =====
INFO:Entity Linker:
=====Loss: 0.3558 Step: 68820 ======
INFO:Entity Linker:
=====Loss: 0.3586 Step: 68830 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 68840 ======
INFO:Entity Linker:
=====Loss: 0.3556 Step: 68850 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 68860 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 68870 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 68880 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 68890 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 68900 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 68910 ======
INFO:Entity Linker:
=====Loss: 0.3545 Step: 68920 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 68930 ======
INFO:Entity Linker:
=====Loss: 0.3531 Step: 68940 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 68950 ======
INFO:Entity Linker:
=====Loss: 0.3573 Step: 68960 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 68970 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 68980 ======
INFO:Entity Linker:
=====Loss: 0.3588 Step: 68990 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69000 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.6013
INFO:Entity Linker:
==== Accuracy on dev after 69000 iterations: 0.5079
INFO:Entity Linker:
=====Loss: 0.3554 Step: 69010 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69020 ======
INFO:Entity Linker:
=====Loss: 0.3571 Step: 69030 ======
INFO:Entity Linker:
=====Loss: 0.3580 Step: 69040 ======
INFO:Entity Linker:
=====Loss: 0.3541 Step: 69050 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 69060 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 69070 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69080 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69090 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69100 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69110 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 69120 ======
INFO:Entity Linker:
=====Loss: 0.3566 Step: 69130 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 69140 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 69150 ======
INFO:Entity Linker:
=====Loss: 0.3557 Step: 69160 ======
INFO:Entity Linker:
=====Loss: 0.3593 Step: 69170 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 69180 ======
INFO:Entity Linker:
=====Loss: 0.3567 Step: 69190 ======
INFO:Entity Linker:
=====Loss: 0.3562 Step: 69200 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 69210 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69220 ======
INFO:Entity Linker:
=====Loss: 0.3540 Step: 69230 ======
INFO:Entity Linker:
=====Loss: 0.3554 Step: 69240 ======
INFO:Entity Linker:
=====Loss: 0.3568 Step: 69250 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 69260 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69270 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 69280 ======
INFO:Entity Linker:
=====Loss: 0.3553 Step: 69290 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 69300 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69310 ======
INFO:Entity Linker:
=====Loss: 0.3574 Step: 69320 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69330 ======
INFO:Entity Linker:
=====Loss: 0.3579 Step: 69340 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69350 ======
INFO:Entity Linker:
=====Loss: 0.3582 Step: 69360 ======
INFO:Entity Linker:
=====Loss: 0.3589 Step: 69370 ======
INFO:Entity Linker:
=====Loss: 0.3538 Step: 69380 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 69390 ======
INFO:Entity Linker:
=====Loss: 0.3550 Step: 69400 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 69410 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 69420 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69430 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 69440 ======
INFO:Entity Linker:
=====Loss: 0.3546 Step: 69450 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69460 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69470 ======
INFO:Entity Linker:
=====Loss: 0.3555 Step: 69480 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 69490 ======
INFO:Entity Linker:
=====Loss: 0.3552 Step: 69500 ======
INFO:Entity Linker:Hierarchical Accuracy: 0.5985
INFO:Entity Linker:
==== Accuracy on dev after 69500 iterations: 0.5052
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69510 ======
INFO:Entity Linker:
=====Loss: 0.3551 Step: 69520 ======
INFO:Entity Linker:
=====Loss: 0.3564 Step: 69530 ======
INFO:Entity Linker:
=====Loss: 0.3581 Step: 69540 ======
INFO:Entity Linker:
=====Loss: 0.3543 Step: 69550 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69560 ======
INFO:Entity Linker:
=====Loss: 0.3542 Step: 69570 ======
INFO:Entity Linker:
=====Loss: 0.3619 Step: 69580 ======
INFO:Entity Linker:
=====Loss: 0.3578 Step: 69590 ======
one_epoch_time 226.10751700401306
INFO:Entity Linker:
=====Epoch Number: 90 =====
INFO:Entity Linker:
=====Loss: 0.3544 Step: 69600 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 69610 ======
INFO:Entity Linker:
=====Loss: 0.3539 Step: 69620 ======
INFO:Entity Linker:
=====Loss: 0.3548 Step: 69630 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69640 ======
INFO:Entity Linker:
=====Loss: 0.3569 Step: 69650 ======
INFO:Entity Linker:
=====Loss: 0.3577 Step: 69660 ======
INFO:Entity Linker:
=====Loss: 0.3530 Step: 69670 ======
INFO:Entity Linker:
=====Loss: 0.3560 Step: 69680 ======
INFO:Entity Linker:
=====Loss: 0.3565 Step: 69690 ======
INFO:Entity Linker:
=====Loss: 0.3547 Step: 69700 ======
INFO:Entity Linker:
=====Loss: 0.3561 Step: 69710 ======
INFO:Entity Linker:
=====Loss: 0.3534 Step: 69720 ======
INFO:Entity Linker:
=====Loss: 0.3549 Step: 69730 ====
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment