Last active
April 17, 2023 06:23
-
-
Save gengwg/f584cfeec8cac91940c4c1f9ee202967 to your computer and use it in GitHub Desktop.
Volcano tensorflow example
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ cat tf-mnist.yaml | |
apiVersion: batch.volcano.sh/v1alpha1 | |
kind: Job | |
metadata: | |
name: tensorflow-dist-mnist | |
spec: | |
minAvailable: 3 | |
schedulerName: volcano | |
plugins: | |
env: [] | |
svc: [] | |
policies: | |
- event: PodEvicted | |
action: RestartJob | |
queue: default | |
tasks: | |
- replicas: 1 | |
name: ps | |
template: | |
spec: | |
containers: | |
- command: | |
- sh | |
- -c | |
- | | |
PS_HOST=`cat /etc/volcano/ps.host | sed 's/$/&:2222/g' | sed 's/^/"/;s/$/"/' | tr "\n" ","`; | |
WORKER_HOST=`cat /etc/volcano/worker.host | sed 's/$/&:2222/g' | sed 's/^/"/;s/$/"/' | tr "\n" ","`; | |
export TF_CONFIG={\"cluster\":{\"ps\":[${PS_HOST}],\"worker\":[${WORKER_HOST}]},\"task\":{\"type\":\"ps\",\"index\":${VK_TASK_INDEX}},\"environment\":\"cloud\"}; | |
python /var/tf_dist_mnist/dist_mnist.py | |
image: volcanosh/dist-mnist-tf-example:0.0.1 | |
name: tensorflow | |
ports: | |
- containerPort: 2222 | |
name: tfjob-port | |
resources: {} | |
restartPolicy: Never | |
- replicas: 2 | |
name: worker | |
policies: | |
- event: TaskCompleted | |
action: CompleteJob | |
template: | |
spec: | |
containers: | |
- command: | |
- sh | |
- -c | |
- | | |
PS_HOST=`cat /etc/volcano/ps.host | sed 's/$/&:2222/g' | sed 's/^/"/;s/$/"/' | tr "\n" ","`; | |
WORKER_HOST=`cat /etc/volcano/worker.host | sed 's/$/&:2222/g' | sed 's/^/"/;s/$/"/' | tr "\n" ","`; | |
export TF_CONFIG={\"cluster\":{\"ps\":[${PS_HOST}],\"worker\":[${WORKER_HOST}]},\"task\":{\"type\":\"worker\",\"index\":${VK_TASK_INDEX}},\"environment\":\"cloud\"}; | |
python /var/tf_dist_mnist/dist_mnist.py | |
image: volcanosh/dist-mnist-tf-example:0.0.1 | |
name: tensorflow | |
ports: | |
- containerPort: 2222 | |
name: tfjob-port | |
resources: {} | |
restartPolicy: Never | |
$ k apply -f tf-mnist.yaml | |
job.batch.volcano.sh/tensorflow-dist-mnist created | |
$ k get po -o wide | |
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES | |
tensorflow-dist-mnist-ps-0 1/1 Running 0 45s 10.244.0.10 volcano-control-plane <none> <none> | |
tensorflow-dist-mnist-worker-0 1/1 Running 0 45s 10.244.0.9 volcano-control-plane <none> <none> | |
tensorflow-dist-mnist-worker-1 1/1 Running 0 45s 10.244.0.8 volcano-control-plane <none> <none> | |
k logs tensorflow-dist-mnist-ps-0 | |
WARNING:tensorflow:From /var/tf_dist_mnist/dist_mnist.py:110: read_data_sets (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use alternatives such as official/mnist/dataset.py from tensorflow/models. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:260: maybe_download (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please write your own downloading logic. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/base.py:252: _internal_retry.<locals>.wrap.<locals>.wrapped_fn (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use urllib or similar directly. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:262: extract_images (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use tf.data to implement this functionality. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:267: extract_labels (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use tf.data to implement this functionality. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:110: dense_to_one_hot (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use tf.one_hot on tensors. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:290: DataSet.__init__ (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use alternatives such as official/mnist/dataset.py from tensorflow/models. | |
2023-04-09 17:36:11.617845: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA | |
2023-04-09 17:36:11.619549: I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:215] Initialize GrpcChannelCache for job ps -> {0 -> localhost:2222} | |
2023-04-09 17:36:11.619574: I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:215] Initialize GrpcChannelCache for job worker -> {0 -> tensorflow-dist-mnist-worker-0.tensorflow-dist-mnist:2222, 1 -> tensorflow-dist-mnist-worker-1.tensorflow-dist-mnist:2222} | |
2023-04-09 17:36:11.620517: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:332] Started server with target: grpc://localhost:2222 | |
$ k logs tensorflow-dist-mnist-worker-0 | |
WARNING:tensorflow:From /var/tf_dist_mnist/dist_mnist.py:110: read_data_sets (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use alternatives such as official/mnist/dataset.py from tensorflow/models. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:260: maybe_download (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please write your own downloading logic. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/base.py:252: _internal_retry.<locals>.wrap.<locals>.wrapped_fn (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use urllib or similar directly. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:262: extract_images (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use tf.data to implement this functionality. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:267: extract_labels (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use tf.data to implement this functionality. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:110: dense_to_one_hot (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use tf.one_hot on tensors. | |
WARNING:tensorflow:From /opt/conda/lib/python3.5/site-packages/tensorflow/contrib/learn/python/learn/datasets/mnist.py:290: DataSet.__init__ (from tensorflow.contrib.learn.python.learn.datasets.mnist) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please use alternatives such as official/mnist/dataset.py from tensorflow/models. | |
2023-04-09 17:36:13.619649: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA | |
2023-04-09 17:36:13.621893: I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:215] Initialize GrpcChannelCache for job ps -> {0 -> tensorflow-dist-mnist-ps-0.tensorflow-dist-mnist:2222} | |
2023-04-09 17:36:13.621915: I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:215] Initialize GrpcChannelCache for job worker -> {0 -> localhost:2222, 1 -> tensorflow-dist-mnist-worker-1.tensorflow-dist-mnist:2222} | |
2023-04-09 17:36:13.622786: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:332] Started server with target: grpc://localhost:2222 | |
WARNING:tensorflow:From /var/tf_dist_mnist/dist_mnist.py:239: Supervisor.__init__ (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
Please switch to tf.train.MonitoredTrainingSession | |
2023-04-09 17:36:13.952512: I tensorflow/core/distributed_runtime/master_session.cc:1136] Start master session 61de5c38d9ac3f7e with config: device_filters: "/job:ps" device_filters: "/job:worker/task:0" allow_soft_placement: true | |
Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes. | |
Extracting /tmp/mnist-data/train-images-idx3-ubyte.gz | |
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes. | |
Extracting /tmp/mnist-data/train-labels-idx1-ubyte.gz | |
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes. | |
Extracting /tmp/mnist-data/t10k-images-idx3-ubyte.gz | |
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes. | |
Extracting /tmp/mnist-data/t10k-labels-idx1-ubyte.gz | |
job name = worker | |
task index = 0 | |
Worker 0: Initializing session... | |
Worker 0: Session initialization complete. | |
Training begins @ 1681061774.142746 | |
1681061774.387769: Worker 0: training step 1 done (global step: 0) | |
1681061774.402901: Worker 0: training step 2 done (global step: 1) | |
1681061774.411291: Worker 0: training step 3 done (global step: 2) | |
1681061774.417297: Worker 0: training step 4 done (global step: 3) | |
1681061774.422888: Worker 0: training step 5 done (global step: 4) | |
1681061774.427747: Worker 0: training step 6 done (global step: 5) | |
1681061774.432595: Worker 0: training step 7 done (global step: 6) | |
1681061774.438733: Worker 0: training step 8 done (global step: 7) | |
1681061774.444171: Worker 0: training step 9 done (global step: 8) | |
1681061774.449089: Worker 0: training step 10 done (global step: 9) | |
1681061774.453861: Worker 0: training step 11 done (global step: 10) | |
1681061774.460969: Worker 0: training step 12 done (global step: 11) | |
1681061774.468159: Worker 0: training step 13 done (global step: 12) | |
1681061774.475073: Worker 0: training step 14 done (global step: 13) | |
1681061774.480319: Worker 0: training step 15 done (global step: 14) | |
1681061774.486821: Worker 0: training step 16 done (global step: 15) | |
1681061774.492249: Worker 0: training step 17 done (global step: 16) | |
1681061774.497753: Worker 0: training step 18 done (global step: 17) | |
1681061774.502753: Worker 0: training step 19 done (global step: 18) | |
1681061774.508323: Worker 0: training step 20 done (global step: 19) | |
1681061774.515297: Worker 0: training step 21 done (global step: 20) | |
1681061774.520140: Worker 0: training step 22 done (global step: 21) | |
1681061774.526029: Worker 0: training step 23 done (global step: 22) | |
1681061774.532272: Worker 0: training step 24 done (global step: 23) | |
1681061774.539944: Worker 0: training step 25 done (global step: 24) | |
1681061774.549273: Worker 0: training step 26 done (global step: 25) | |
1681061774.557657: Worker 0: training step 27 done (global step: 26) | |
1681061774.566136: Worker 0: training step 28 done (global step: 27) | |
1681061774.574002: Worker 0: training step 29 done (global step: 28) | |
1681061774.584341: Worker 0: training step 30 done (global step: 29) | |
1681061774.590987: Worker 0: training step 31 done (global step: 30) | |
1681061774.596736: Worker 0: training step 32 done (global step: 31) | |
1681061774.602338: Worker 0: training step 33 done (global step: 32) | |
1681061774.607818: Worker 0: training step 34 done (global step: 33) | |
1681061774.613273: Worker 0: training step 35 done (global step: 34) | |
1681061774.618237: Worker 0: training step 36 done (global step: 35) | |
1681061774.624134: Worker 0: training step 37 done (global step: 36) | |
1681061774.687242: Worker 0: training step 38 done (global step: 37) | |
1681061774.693892: Worker 0: training step 39 done (global step: 38) | |
1681061774.702441: Worker 0: training step 40 done (global step: 39) | |
1681061774.708189: Worker 0: training step 41 done (global step: 40) | |
1681061774.715269: Worker 0: training step 42 done (global step: 41) | |
1681061774.720896: Worker 0: training step 43 done (global step: 42) | |
1681061774.726524: Worker 0: training step 44 done (global step: 43) | |
1681061774.732558: Worker 0: training step 45 done (global step: 44) | |
1681061774.738775: Worker 0: training step 46 done (global step: 45) | |
1681061774.744277: Worker 0: training step 47 done (global step: 46) | |
1681061774.750652: Worker 0: training step 48 done (global step: 47) | |
1681061774.758446: Worker 0: training step 49 done (global step: 48) | |
1681061774.766885: Worker 0: training step 50 done (global step: 49) | |
1681061774.774515: Worker 0: training step 51 done (global step: 50) | |
1681061774.781659: Worker 0: training step 52 done (global step: 51) | |
1681061774.794586: Worker 0: training step 53 done (global step: 52) | |
1681061774.806274: Worker 0: training step 54 done (global step: 53) | |
1681061774.814805: Worker 0: training step 55 done (global step: 55) | |
1681061774.822020: Worker 0: training step 56 done (global step: 56) | |
1681061774.831505: Worker 0: training step 57 done (global step: 58) | |
1681061774.837719: Worker 0: training step 58 done (global step: 60) | |
1681061774.844520: Worker 0: training step 59 done (global step: 62) | |
1681061774.850246: Worker 0: training step 60 done (global step: 64) | |
1681061774.855685: Worker 0: training step 61 done (global step: 66) | |
1681061774.862270: Worker 0: training step 62 done (global step: 68) | |
1681061774.868152: Worker 0: training step 63 done (global step: 70) | |
1681061774.874236: Worker 0: training step 64 done (global step: 72) | |
1681061774.880228: Worker 0: training step 65 done (global step: 74) | |
1681061774.885930: Worker 0: training step 66 done (global step: 76) | |
1681061774.891030: Worker 0: training step 67 done (global step: 78) | |
1681061774.898124: Worker 0: training step 68 done (global step: 80) | |
1681061774.903580: Worker 0: training step 69 done (global step: 82) | |
1681061774.909512: Worker 0: training step 70 done (global step: 84) | |
1681061774.915429: Worker 0: training step 71 done (global step: 86) | |
1681061774.921004: Worker 0: training step 72 done (global step: 88) | |
1681061774.926665: Worker 0: training step 73 done (global step: 90) | |
1681061774.933089: Worker 0: training step 74 done (global step: 92) | |
1681061774.941417: Worker 0: training step 75 done (global step: 94) | |
1681061774.948644: Worker 0: training step 76 done (global step: 96) | |
1681061774.954315: Worker 0: training step 77 done (global step: 98) | |
1681061774.960397: Worker 0: training step 78 done (global step: 100) | |
1681061774.972121: Worker 0: training step 79 done (global step: 102) | |
1681061774.980708: Worker 0: training step 80 done (global step: 104) | |
1681061774.991088: Worker 0: training step 81 done (global step: 105) | |
1681061774.998831: Worker 0: training step 82 done (global step: 107) | |
1681061775.004029: Worker 0: training step 83 done (global step: 109) | |
1681061775.009850: Worker 0: training step 84 done (global step: 111) | |
1681061775.015934: Worker 0: training step 85 done (global step: 113) | |
1681061775.022306: Worker 0: training step 86 done (global step: 115) | |
1681061775.027468: Worker 0: training step 87 done (global step: 117) | |
1681061775.033107: Worker 0: training step 88 done (global step: 119) | |
1681061775.041971: Worker 0: training step 89 done (global step: 121) | |
1681061775.047674: Worker 0: training step 90 done (global step: 123) | |
1681061775.055896: Worker 0: training step 91 done (global step: 125) | |
1681061775.063125: Worker 0: training step 92 done (global step: 127) | |
1681061775.077240: Worker 0: training step 93 done (global step: 129) | |
1681061775.087240: Worker 0: training step 94 done (global step: 131) | |
1681061775.096867: Worker 0: training step 95 done (global step: 133) | |
1681061775.103492: Worker 0: training step 96 done (global step: 135) | |
1681061775.109597: Worker 0: training step 97 done (global step: 137) | |
1681061775.115575: Worker 0: training step 98 done (global step: 139) | |
1681061775.120964: Worker 0: training step 99 done (global step: 141) | |
1681061775.126814: Worker 0: training step 100 done (global step: 143) | |
1681061775.133038: Worker 0: training step 101 done (global step: 145) | |
1681061775.138509: Worker 0: training step 102 done (global step: 147) | |
1681061775.144072: Worker 0: training step 103 done (global step: 149) | |
1681061775.151189: Worker 0: training step 104 done (global step: 151) | |
1681061775.157459: Worker 0: training step 105 done (global step: 153) | |
1681061775.163231: Worker 0: training step 106 done (global step: 155) | |
1681061775.169350: Worker 0: training step 107 done (global step: 157) | |
1681061775.174956: Worker 0: training step 108 done (global step: 159) | |
1681061775.180447: Worker 0: training step 109 done (global step: 161) | |
1681061775.185974: Worker 0: training step 110 done (global step: 163) | |
1681061775.191877: Worker 0: training step 111 done (global step: 165) | |
1681061775.197345: Worker 0: training step 112 done (global step: 167) | |
1681061775.202665: Worker 0: training step 113 done (global step: 169) | |
1681061775.209972: Worker 0: training step 114 done (global step: 171) | |
1681061775.216350: Worker 0: training step 115 done (global step: 173) | |
1681061775.223093: Worker 0: training step 116 done (global step: 175) | |
1681061775.228711: Worker 0: training step 117 done (global step: 177) | |
1681061775.238024: Worker 0: training step 118 done (global step: 179) | |
1681061775.254791: Worker 0: training step 119 done (global step: 181) | |
1681061775.266630: Worker 0: training step 120 done (global step: 182) | |
1681061775.272839: Worker 0: training step 121 done (global step: 185) | |
1681061775.277990: Worker 0: training step 122 done (global step: 187) | |
1681061775.283537: Worker 0: training step 123 done (global step: 188) | |
1681061775.289778: Worker 0: training step 124 done (global step: 190) | |
1681061775.295861: Worker 0: training step 125 done (global step: 192) | |
1681061775.302946: Worker 0: training step 126 done (global step: 195) | |
1681061775.311930: Worker 0: training step 127 done (global step: 197) | |
1681061775.318463: Worker 0: training step 128 done (global step: 199) | |
1681061775.324947: Worker 0: training step 129 done (global step: 201) | |
1681061775.331946: Worker 0: training step 130 done (global step: 203) | |
1681061775.341138: Worker 0: training step 131 done (global step: 205) | |
1681061775.354313: Worker 0: training step 132 done (global step: 207) | |
1681061775.368669: Worker 0: training step 133 done (global step: 209) | |
1681061775.379211: Worker 0: training step 134 done (global step: 211) | |
1681061775.392015: Worker 0: training step 135 done (global step: 213) | |
1681061775.399385: Worker 0: training step 136 done (global step: 216) | |
1681061775.410499: Worker 0: training step 137 done (global step: 217) | |
1681061775.419956: Worker 0: training step 138 done (global step: 220) | |
1681061775.429372: Worker 0: training step 139 done (global step: 222) | |
1681061775.439174: Worker 0: training step 140 done (global step: 224) | |
1681061775.449688: Worker 0: training step 141 done (global step: 226) | |
1681061775.456872: Worker 0: training step 142 done (global step: 229) | |
1681061775.465508: Worker 0: training step 143 done (global step: 230) | |
1681061775.475366: Worker 0: training step 144 done (global step: 233) | |
1681061775.483634: Worker 0: training step 145 done (global step: 235) | |
1681061775.490335: Worker 0: training step 146 done (global step: 237) | |
1681061775.497983: Worker 0: training step 147 done (global step: 239) | |
1681061775.507718: Worker 0: training step 148 done (global step: 241) | |
1681061775.514736: Worker 0: training step 149 done (global step: 242) | |
1681061775.525315: Worker 0: training step 150 done (global step: 244) | |
1681061775.534419: Worker 0: training step 151 done (global step: 247) | |
1681061775.543828: Worker 0: training step 152 done (global step: 249) | |
1681061775.552652: Worker 0: training step 153 done (global step: 252) | |
1681061775.561386: Worker 0: training step 154 done (global step: 254) | |
1681061775.568788: Worker 0: training step 155 done (global step: 256) | |
1681061775.579449: Worker 0: training step 156 done (global step: 259) | |
1681061775.587096: Worker 0: training step 157 done (global step: 261) | |
1681061775.596857: Worker 0: training step 158 done (global step: 263) | |
1681061775.608352: Worker 0: training step 159 done (global step: 265) | |
1681061775.635970: Worker 0: training step 160 done (global step: 267) | |
1681061775.645468: Worker 0: training step 161 done (global step: 270) | |
1681061775.653135: Worker 0: training step 162 done (global step: 272) | |
1681061775.667032: Worker 0: training step 163 done (global step: 274) | |
1681061775.673599: Worker 0: training step 164 done (global step: 276) | |
1681061775.681400: Worker 0: training step 165 done (global step: 278) | |
1681061775.689393: Worker 0: training step 166 done (global step: 280) | |
1681061775.698180: Worker 0: training step 167 done (global step: 282) | |
1681061775.705385: Worker 0: training step 168 done (global step: 284) | |
1681061775.712115: Worker 0: training step 169 done (global step: 286) | |
1681061775.721118: Worker 0: training step 170 done (global step: 287) | |
1681061775.730281: Worker 0: training step 171 done (global step: 289) | |
1681061775.739194: Worker 0: training step 172 done (global step: 292) | |
1681061775.752288: Worker 0: training step 173 done (global step: 294) | |
1681061775.761839: Worker 0: training step 174 done (global step: 296) | |
1681061775.769722: Worker 0: training step 175 done (global step: 298) | |
1681061775.777739: Worker 0: training step 176 done (global step: 300) | |
1681061775.785160: Worker 0: training step 177 done (global step: 302) | |
1681061775.793823: Worker 0: training step 178 done (global step: 304) | |
1681061775.804521: Worker 0: training step 179 done (global step: 306) | |
1681061775.812113: Worker 0: training step 180 done (global step: 308) | |
1681061775.820995: Worker 0: training step 181 done (global step: 310) | |
1681061775.829911: Worker 0: training step 182 done (global step: 313) | |
1681061775.837790: Worker 0: training step 183 done (global step: 315) | |
1681061775.845678: Worker 0: training step 184 done (global step: 317) | |
1681061775.857684: Worker 0: training step 185 done (global step: 319) | |
1681061775.869338: Worker 0: training step 186 done (global step: 322) | |
1681061775.876760: Worker 0: training step 187 done (global step: 324) | |
1681061775.883759: Worker 0: training step 188 done (global step: 326) | |
1681061775.892585: Worker 0: training step 189 done (global step: 328) | |
1681061775.899988: Worker 0: training step 190 done (global step: 330) | |
1681061775.906214: Worker 0: training step 191 done (global step: 332) | |
1681061775.915991: Worker 0: training step 192 done (global step: 334) | |
1681061775.921716: Worker 0: training step 193 done (global step: 337) | |
1681061775.930180: Worker 0: training step 194 done (global step: 338) | |
1681061775.938507: Worker 0: training step 195 done (global step: 341) | |
1681061775.944180: Worker 0: training step 196 done (global step: 343) | |
1681061775.949238: Worker 0: training step 197 done (global step: 344) | |
1681061775.957135: Worker 0: training step 198 done (global step: 346) | |
1681061775.961861: Worker 0: training step 199 done (global step: 349) | |
1681061775.967263: Worker 0: training step 200 done (global step: 350) | |
1681061775.973161: Worker 0: training step 201 done (global step: 352) | |
1681061775.978586: Worker 0: training step 202 done (global step: 354) | |
1681061775.984072: Worker 0: training step 203 done (global step: 356) | |
1681061775.990559: Worker 0: training step 204 done (global step: 358) | |
1681061775.996767: Worker 0: training step 205 done (global step: 360) | |
1681061776.001803: Worker 0: training step 206 done (global step: 362) | |
1681061776.007495: Worker 0: training step 207 done (global step: 364) | |
1681061776.013120: Worker 0: training step 208 done (global step: 366) | |
1681061776.017884: Worker 0: training step 209 done (global step: 368) | |
1681061776.023976: Worker 0: training step 210 done (global step: 370) | |
1681061776.028396: Worker 0: training step 211 done (global step: 372) | |
1681061776.033855: Worker 0: training step 212 done (global step: 374) | |
1681061776.040095: Worker 0: training step 213 done (global step: 376) | |
1681061776.046119: Worker 0: training step 214 done (global step: 378) | |
1681061776.051539: Worker 0: training step 215 done (global step: 380) | |
1681061776.056371: Worker 0: training step 216 done (global step: 382) | |
1681061776.062043: Worker 0: training step 217 done (global step: 384) | |
1681061776.066602: Worker 0: training step 218 done (global step: 386) | |
1681061776.072315: Worker 0: training step 219 done (global step: 387) | |
1681061776.078125: Worker 0: training step 220 done (global step: 389) | |
1681061776.082937: Worker 0: training step 221 done (global step: 392) | |
1681061776.087934: Worker 0: training step 222 done (global step: 393) | |
1681061776.093526: Worker 0: training step 223 done (global step: 395) | |
1681061776.099743: Worker 0: training step 224 done (global step: 397) | |
1681061776.106201: Worker 0: training step 225 done (global step: 399) | |
1681061776.112226: Worker 0: training step 226 done (global step: 401) | |
1681061776.119630: Worker 0: training step 227 done (global step: 403) | |
1681061776.124846: Worker 0: training step 228 done (global step: 405) | |
1681061776.131696: Worker 0: training step 229 done (global step: 407) | |
1681061776.137923: Worker 0: training step 230 done (global step: 410) | |
1681061776.143408: Worker 0: training step 231 done (global step: 412) | |
1681061776.149457: Worker 0: training step 232 done (global step: 414) | |
1681061776.154499: Worker 0: training step 233 done (global step: 416) | |
1681061776.159839: Worker 0: training step 234 done (global step: 417) | |
1681061776.165785: Worker 0: training step 235 done (global step: 419) | |
1681061776.171916: Worker 0: training step 236 done (global step: 421) | |
1681061776.177814: Worker 0: training step 237 done (global step: 423) | |
1681061776.183209: Worker 0: training step 238 done (global step: 426) | |
1681061776.188877: Worker 0: training step 239 done (global step: 427) | |
1681061776.194504: Worker 0: training step 240 done (global step: 430) | |
1681061776.200083: Worker 0: training step 241 done (global step: 431) | |
1681061776.205694: Worker 0: training step 242 done (global step: 433) | |
1681061776.211533: Worker 0: training step 243 done (global step: 435) | |
1681061776.217158: Worker 0: training step 244 done (global step: 437) | |
1681061776.223540: Worker 0: training step 245 done (global step: 439) | |
1681061776.230115: Worker 0: training step 246 done (global step: 442) | |
1681061776.236104: Worker 0: training step 247 done (global step: 444) | |
1681061776.243102: Worker 0: training step 248 done (global step: 446) | |
1681061776.248850: Worker 0: training step 249 done (global step: 448) | |
1681061776.254262: Worker 0: training step 250 done (global step: 450) | |
1681061776.260063: Worker 0: training step 251 done (global step: 452) | |
1681061776.266098: Worker 0: training step 252 done (global step: 454) | |
1681061776.271025: Worker 0: training step 253 done (global step: 456) | |
1681061776.276386: Worker 0: training step 254 done (global step: 458) | |
1681061776.282132: Worker 0: training step 255 done (global step: 460) | |
1681061776.287544: Worker 0: training step 256 done (global step: 462) | |
1681061776.293100: Worker 0: training step 257 done (global step: 464) | |
1681061776.299302: Worker 0: training step 258 done (global step: 466) | |
1681061776.306017: Worker 0: training step 259 done (global step: 468) | |
1681061776.312654: Worker 0: training step 260 done (global step: 470) | |
1681061776.318616: Worker 0: training step 261 done (global step: 471) | |
1681061776.324027: Worker 0: training step 262 done (global step: 473) | |
1681061776.330014: Worker 0: training step 263 done (global step: 475) | |
1681061776.335917: Worker 0: training step 264 done (global step: 478) | |
1681061776.341211: Worker 0: training step 265 done (global step: 479) | |
1681061776.347209: Worker 0: training step 266 done (global step: 481) | |
1681061776.354485: Worker 0: training step 267 done (global step: 484) | |
1681061776.360238: Worker 0: training step 268 done (global step: 486) | |
1681061776.365747: Worker 0: training step 269 done (global step: 488) | |
1681061776.371808: Worker 0: training step 270 done (global step: 490) | |
1681061776.377008: Worker 0: training step 271 done (global step: 492) | |
1681061776.382874: Worker 0: training step 272 done (global step: 493) | |
1681061776.388844: Worker 0: training step 273 done (global step: 495) | |
1681061776.394405: Worker 0: training step 274 done (global step: 497) | |
1681061776.399912: Worker 0: training step 275 done (global step: 499) | |
1681061776.406224: Worker 0: training step 276 done (global step: 501) | |
1681061776.412920: Worker 0: training step 277 done (global step: 503) | |
1681061776.420510: Worker 0: training step 278 done (global step: 505) | |
1681061776.429221: Worker 0: training step 279 done (global step: 507) | |
1681061776.435025: Worker 0: training step 280 done (global step: 509) | |
1681061776.441637: Worker 0: training step 281 done (global step: 511) | |
1681061776.449442: Worker 0: training step 282 done (global step: 513) | |
1681061776.456931: Worker 0: training step 283 done (global step: 515) | |
1681061776.463022: Worker 0: training step 284 done (global step: 517) | |
1681061776.471966: Worker 0: training step 285 done (global step: 518) | |
1681061776.478261: Worker 0: training step 286 done (global step: 520) | |
1681061776.484760: Worker 0: training step 287 done (global step: 522) | |
1681061776.490201: Worker 0: training step 288 done (global step: 524) | |
1681061776.495480: Worker 0: training step 289 done (global step: 526) | |
1681061776.499919: Worker 0: training step 290 done (global step: 527) | |
1681061776.504904: Worker 0: training step 291 done (global step: 529) | |
1681061776.510503: Worker 0: training step 292 done (global step: 531) | |
1681061776.516395: Worker 0: training step 293 done (global step: 533) | |
1681061776.522555: Worker 0: training step 294 done (global step: 535) | |
1681061776.528280: Worker 0: training step 295 done (global step: 537) | |
1681061776.535314: Worker 0: training step 296 done (global step: 539) | |
1681061776.542387: Worker 0: training step 297 done (global step: 541) | |
1681061776.549234: Worker 0: training step 298 done (global step: 543) | |
1681061776.555192: Worker 0: training step 299 done (global step: 546) | |
1681061776.560450: Worker 0: training step 300 done (global step: 548) | |
1681061776.566137: Worker 0: training step 301 done (global step: 550) | |
1681061776.571311: Worker 0: training step 302 done (global step: 552) | |
1681061776.577187: Worker 0: training step 303 done (global step: 554) | |
1681061776.584002: Worker 0: training step 304 done (global step: 556) | |
1681061776.590811: Worker 0: training step 305 done (global step: 558) | |
1681061776.596394: Worker 0: training step 306 done (global step: 560) | |
1681061776.603078: Worker 0: training step 307 done (global step: 562) | |
1681061776.608587: Worker 0: training step 308 done (global step: 564) | |
1681061776.613796: Worker 0: training step 309 done (global step: 566) | |
1681061776.619177: Worker 0: training step 310 done (global step: 568) | |
1681061776.625396: Worker 0: training step 311 done (global step: 570) | |
1681061776.631081: Worker 0: training step 312 done (global step: 572) | |
1681061776.637867: Worker 0: training step 313 done (global step: 574) | |
1681061776.643946: Worker 0: training step 314 done (global step: 576) | |
1681061776.649209: Worker 0: training step 315 done (global step: 578) | |
1681061776.654469: Worker 0: training step 316 done (global step: 580) | |
1681061776.660921: Worker 0: training step 317 done (global step: 581) | |
1681061776.665867: Worker 0: training step 318 done (global step: 584) | |
1681061776.671246: Worker 0: training step 319 done (global step: 586) | |
1681061776.677163: Worker 0: training step 320 done (global step: 587) | |
1681061776.683187: Worker 0: training step 321 done (global step: 589) | |
1681061776.689266: Worker 0: training step 322 done (global step: 591) | |
1681061776.695465: Worker 0: training step 323 done (global step: 593) | |
1681061776.701009: Worker 0: training step 324 done (global step: 596) | |
1681061776.707202: Worker 0: training step 325 done (global step: 598) | |
1681061776.713445: Worker 0: training step 326 done (global step: 600) | |
1681061776.719105: Worker 0: training step 327 done (global step: 602) | |
1681061776.725137: Worker 0: training step 328 done (global step: 604) | |
1681061776.730789: Worker 0: training step 329 done (global step: 606) | |
1681061776.736171: Worker 0: training step 330 done (global step: 608) | |
1681061776.741506: Worker 0: training step 331 done (global step: 610) | |
1681061776.747197: Worker 0: training step 332 done (global step: 612) | |
1681061776.752776: Worker 0: training step 333 done (global step: 614) | |
1681061776.758558: Worker 0: training step 334 done (global step: 615) | |
1681061776.764891: Worker 0: training step 335 done (global step: 618) | |
1681061776.770286: Worker 0: training step 336 done (global step: 619) | |
1681061776.775718: Worker 0: training step 337 done (global step: 621) | |
1681061776.781876: Worker 0: training step 338 done (global step: 623) | |
1681061776.788406: Worker 0: training step 339 done (global step: 625) | |
1681061776.793689: Worker 0: training step 340 done (global step: 628) | |
1681061776.799630: Worker 0: training step 341 done (global step: 630) | |
1681061776.805751: Worker 0: training step 342 done (global step: 632) | |
1681061776.811333: Worker 0: training step 343 done (global step: 634) | |
1681061776.817079: Worker 0: training step 344 done (global step: 636) | |
1681061776.822158: Worker 0: training step 345 done (global step: 638) | |
1681061776.827156: Worker 0: training step 346 done (global step: 640) | |
1681061776.832393: Worker 0: training step 347 done (global step: 642) | |
1681061776.837351: Worker 0: training step 348 done (global step: 643) | |
1681061776.843995: Worker 0: training step 349 done (global step: 645) | |
1681061776.848951: Worker 0: training step 350 done (global step: 647) | |
1681061776.855135: Worker 0: training step 351 done (global step: 649) | |
1681061776.860371: Worker 0: training step 352 done (global step: 652) | |
1681061776.865181: Worker 0: training step 353 done (global step: 653) | |
1681061776.871434: Worker 0: training step 354 done (global step: 655) | |
1681061776.877591: Worker 0: training step 355 done (global step: 657) | |
1681061776.882872: Worker 0: training step 356 done (global step: 659) | |
1681061776.889255: Worker 0: training step 357 done (global step: 661) | |
1681061776.895190: Worker 0: training step 358 done (global step: 664) | |
1681061776.900474: Worker 0: training step 359 done (global step: 665) | |
1681061776.906261: Worker 0: training step 360 done (global step: 667) | |
1681061776.912483: Worker 0: training step 361 done (global step: 669) | |
1681061776.919105: Worker 0: training step 362 done (global step: 671) | |
1681061776.924730: Worker 0: training step 363 done (global step: 674) | |
1681061776.931011: Worker 0: training step 364 done (global step: 676) | |
1681061776.937151: Worker 0: training step 365 done (global step: 678) | |
1681061776.942795: Worker 0: training step 366 done (global step: 680) | |
1681061776.947983: Worker 0: training step 367 done (global step: 682) | |
1681061776.953564: Worker 0: training step 368 done (global step: 684) | |
1681061776.959320: Worker 0: training step 369 done (global step: 686) | |
1681061776.965181: Worker 0: training step 370 done (global step: 688) | |
1681061776.970466: Worker 0: training step 371 done (global step: 690) | |
1681061776.975728: Worker 0: training step 372 done (global step: 692) | |
1681061776.980901: Worker 0: training step 373 done (global step: 694) | |
1681061776.986054: Worker 0: training step 374 done (global step: 696) | |
1681061776.991728: Worker 0: training step 375 done (global step: 698) | |
1681061776.996855: Worker 0: training step 376 done (global step: 700) | |
1681061777.002105: Worker 0: training step 377 done (global step: 702) | |
1681061777.007725: Worker 0: training step 378 done (global step: 704) | |
1681061777.013907: Worker 0: training step 379 done (global step: 706) | |
1681061777.020253: Worker 0: training step 380 done (global step: 708) | |
1681061777.026693: Worker 0: training step 381 done (global step: 710) | |
1681061777.031269: Worker 0: training step 382 done (global step: 712) | |
1681061777.036570: Worker 0: training step 383 done (global step: 714) | |
1681061777.042489: Worker 0: training step 384 done (global step: 716) | |
1681061777.050327: Worker 0: training step 385 done (global step: 718) | |
1681061777.058377: Worker 0: training step 386 done (global step: 720) | |
1681061777.068746: Worker 0: training step 387 done (global step: 722) | |
1681061777.077122: Worker 0: training step 388 done (global step: 725) | |
1681061777.087909: Worker 0: training step 389 done (global step: 727) | |
1681061777.095958: Worker 0: training step 390 done (global step: 729) | |
1681061777.110563: Worker 0: training step 391 done (global step: 730) | |
1681061777.122053: Worker 0: training step 392 done (global step: 733) | |
1681061777.138144: Worker 0: training step 393 done (global step: 734) | |
1681061777.145130: Worker 0: training step 394 done (global step: 737) | |
1681061777.152644: Worker 0: training step 395 done (global step: 739) | |
1681061777.158385: Worker 0: training step 396 done (global step: 741) | |
1681061777.164127: Worker 0: training step 397 done (global step: 743) | |
1681061777.168852: Worker 0: training step 398 done (global step: 745) | |
1681061777.174052: Worker 0: training step 399 done (global step: 747) | |
1681061777.179066: Worker 0: training step 400 done (global step: 749) | |
1681061777.184581: Worker 0: training step 401 done (global step: 750) | |
1681061777.191076: Worker 0: training step 402 done (global step: 753) | |
1681061777.197813: Worker 0: training step 403 done (global step: 755) | |
1681061777.204421: Worker 0: training step 404 done (global step: 757) | |
1681061777.211911: Worker 0: training step 405 done (global step: 759) | |
1681061777.218661: Worker 0: training step 406 done (global step: 761) | |
1681061777.224496: Worker 0: training step 407 done (global step: 764) | |
1681061777.231185: Worker 0: training step 408 done (global step: 766) | |
1681061777.237266: Worker 0: training step 409 done (global step: 768) | |
1681061777.243299: Worker 0: training step 410 done (global step: 770) | |
1681061777.248719: Worker 0: training step 411 done (global step: 772) | |
1681061777.255107: Worker 0: training step 412 done (global step: 774) | |
1681061777.260661: Worker 0: training step 413 done (global step: 776) | |
1681061777.266174: Worker 0: training step 414 done (global step: 778) | |
1681061777.272880: Worker 0: training step 415 done (global step: 780) | |
1681061777.279834: Worker 0: training step 416 done (global step: 782) | |
1681061777.284628: Worker 0: training step 417 done (global step: 784) | |
1681061777.290396: Worker 0: training step 418 done (global step: 786) | |
1681061777.297555: Worker 0: training step 419 done (global step: 788) | |
1681061777.303444: Worker 0: training step 420 done (global step: 790) | |
1681061777.312995: Worker 0: training step 421 done (global step: 792) | |
1681061777.318707: Worker 0: training step 422 done (global step: 795) | |
1681061777.324425: Worker 0: training step 423 done (global step: 797) | |
1681061777.329710: Worker 0: training step 424 done (global step: 799) | |
1681061777.335572: Worker 0: training step 425 done (global step: 801) | |
1681061777.341273: Worker 0: training step 426 done (global step: 803) | |
1681061777.347252: Worker 0: training step 427 done (global step: 805) | |
1681061777.352249: Worker 0: training step 428 done (global step: 807) | |
1681061777.358498: Worker 0: training step 429 done (global step: 809) | |
1681061777.364874: Worker 0: training step 430 done (global step: 811) | |
1681061777.369754: Worker 0: training step 431 done (global step: 813) | |
1681061777.374741: Worker 0: training step 432 done (global step: 815) | |
1681061777.380048: Worker 0: training step 433 done (global step: 817) | |
1681061777.385281: Worker 0: training step 434 done (global step: 819) | |
1681061777.390825: Worker 0: training step 435 done (global step: 821) | |
1681061777.397372: Worker 0: training step 436 done (global step: 823) | |
1681061777.402504: Worker 0: training step 437 done (global step: 825) | |
1681061777.408378: Worker 0: training step 438 done (global step: 827) | |
1681061777.413728: Worker 0: training step 439 done (global step: 829) | |
1681061777.418856: Worker 0: training step 440 done (global step: 831) | |
1681061777.424071: Worker 0: training step 441 done (global step: 833) | |
1681061777.429156: Worker 0: training step 442 done (global step: 835) | |
1681061777.434252: Worker 0: training step 443 done (global step: 837) | |
1681061777.440708: Worker 0: training step 444 done (global step: 839) | |
1681061777.448555: Worker 0: training step 445 done (global step: 841) | |
1681061777.454663: Worker 0: training step 446 done (global step: 843) | |
1681061777.460700: Worker 0: training step 447 done (global step: 846) | |
1681061777.467098: Worker 0: training step 448 done (global step: 848) | |
1681061777.471825: Worker 0: training step 449 done (global step: 850) | |
1681061777.477192: Worker 0: training step 450 done (global step: 852) | |
1681061777.483457: Worker 0: training step 451 done (global step: 854) | |
1681061777.496733: Worker 0: training step 452 done (global step: 856) | |
1681061777.513557: Worker 0: training step 453 done (global step: 858) | |
1681061777.519065: Worker 0: training step 454 done (global step: 860) | |
1681061777.523860: Worker 0: training step 455 done (global step: 862) | |
1681061777.530296: Worker 0: training step 456 done (global step: 864) | |
1681061777.537430: Worker 0: training step 457 done (global step: 866) | |
1681061777.545383: Worker 0: training step 458 done (global step: 869) | |
1681061777.550828: Worker 0: training step 459 done (global step: 870) | |
1681061777.556582: Worker 0: training step 460 done (global step: 872) | |
1681061777.562071: Worker 0: training step 461 done (global step: 875) | |
1681061777.567355: Worker 0: training step 462 done (global step: 877) | |
1681061777.572488: Worker 0: training step 463 done (global step: 878) | |
1681061777.578700: Worker 0: training step 464 done (global step: 880) | |
1681061777.584789: Worker 0: training step 465 done (global step: 883) | |
1681061777.590904: Worker 0: training step 466 done (global step: 884) | |
1681061777.598551: Worker 0: training step 467 done (global step: 887) | |
1681061777.603838: Worker 0: training step 468 done (global step: 889) | |
1681061777.609146: Worker 0: training step 469 done (global step: 891) | |
1681061777.614526: Worker 0: training step 470 done (global step: 893) | |
1681061777.620066: Worker 0: training step 471 done (global step: 895) | |
1681061777.626160: Worker 0: training step 472 done (global step: 897) | |
1681061777.632167: Worker 0: training step 473 done (global step: 899) | |
1681061777.637168: Worker 0: training step 474 done (global step: 901) | |
1681061777.642771: Worker 0: training step 475 done (global step: 903) | |
1681061777.647932: Worker 0: training step 476 done (global step: 905) | |
1681061777.653288: Worker 0: training step 477 done (global step: 907) | |
1681061777.659061: Worker 0: training step 478 done (global step: 909) | |
1681061777.665244: Worker 0: training step 479 done (global step: 911) | |
1681061777.670418: Worker 0: training step 480 done (global step: 913) | |
1681061777.675891: Worker 0: training step 481 done (global step: 915) | |
1681061777.681145: Worker 0: training step 482 done (global step: 917) | |
1681061777.686218: Worker 0: training step 483 done (global step: 919) | |
1681061777.691650: Worker 0: training step 484 done (global step: 921) | |
1681061777.697465: Worker 0: training step 485 done (global step: 923) | |
1681061777.702884: Worker 0: training step 486 done (global step: 925) | |
1681061777.708315: Worker 0: training step 487 done (global step: 927) | |
1681061777.713402: Worker 0: training step 488 done (global step: 929) | |
1681061777.719353: Worker 0: training step 489 done (global step: 931) | |
1681061777.725585: Worker 0: training step 490 done (global step: 933) | |
1681061777.731706: Worker 0: training step 491 done (global step: 935) | |
1681061777.737539: Worker 0: training step 492 done (global step: 937) | |
1681061777.743866: Worker 0: training step 493 done (global step: 939) | |
1681061777.750063: Worker 0: training step 494 done (global step: 941) | |
1681061777.756540: Worker 0: training step 495 done (global step: 943) | |
1681061777.764132: Worker 0: training step 496 done (global step: 945) | |
1681061777.770987: Worker 0: training step 497 done (global step: 947) | |
1681061777.777683: Worker 0: training step 498 done (global step: 949) | |
1681061777.783894: Worker 0: training step 499 done (global step: 951) | |
1681061777.789793: Worker 0: training step 500 done (global step: 953) | |
1681061777.795514: Worker 0: training step 501 done (global step: 956) | |
1681061777.802191: Worker 0: training step 502 done (global step: 958) | |
1681061777.808216: Worker 0: training step 503 done (global step: 960) | |
1681061777.813371: Worker 0: training step 504 done (global step: 962) | |
1681061777.819018: Worker 0: training step 505 done (global step: 964) | |
1681061777.824589: Worker 0: training step 506 done (global step: 966) | |
1681061777.830289: Worker 0: training step 507 done (global step: 968) | |
1681061777.835017: Worker 0: training step 508 done (global step: 970) | |
1681061777.840529: Worker 0: training step 509 done (global step: 972) | |
1681061777.845632: Worker 0: training step 510 done (global step: 974) | |
1681061777.851130: Worker 0: training step 511 done (global step: 976) | |
1681061777.856097: Worker 0: training step 512 done (global step: 978) | |
1681061777.861074: Worker 0: training step 513 done (global step: 980) | |
1681061777.866249: Worker 0: training step 514 done (global step: 982) | |
1681061777.873797: Worker 0: training step 515 done (global step: 984) | |
1681061777.878831: Worker 0: training step 516 done (global step: 986) | |
1681061777.884088: Worker 0: training step 517 done (global step: 988) | |
1681061777.889670: Worker 0: training step 518 done (global step: 989) | |
1681061777.894446: Worker 0: training step 519 done (global step: 991) | |
1681061777.899804: Worker 0: training step 520 done (global step: 993) | |
1681061777.906320: Worker 0: training step 521 done (global step: 995) | |
1681061777.912087: Worker 0: training step 522 done (global step: 997) | |
1681061777.917920: Worker 0: training step 523 done (global step: 999) | |
1681061777.924919: Worker 0: training step 524 done (global step: 1001) | |
1681061777.929363: Worker 0: training step 525 done (global step: 1004) | |
1681061777.937718: Worker 0: training step 526 done (global step: 1006) | |
1681061777.944805: Worker 0: training step 527 done (global step: 1008) | |
1681061777.950674: Worker 0: training step 528 done (global step: 1010) | |
1681061777.955915: Worker 0: training step 529 done (global step: 1012) | |
1681061777.961444: Worker 0: training step 530 done (global step: 1014) | |
1681061777.967049: Worker 0: training step 531 done (global step: 1016) | |
1681061777.972982: Worker 0: training step 532 done (global step: 1018) | |
1681061777.979118: Worker 0: training step 533 done (global step: 1020) | |
1681061777.984886: Worker 0: training step 534 done (global step: 1022) | |
1681061777.990267: Worker 0: training step 535 done (global step: 1024) | |
1681061777.995648: Worker 0: training step 536 done (global step: 1026) | |
1681061778.000818: Worker 0: training step 537 done (global step: 1028) | |
1681061778.005991: Worker 0: training step 538 done (global step: 1030) | |
1681061778.011370: Worker 0: training step 539 done (global step: 1032) | |
1681061778.017344: Worker 0: training step 540 done (global step: 1034) | |
1681061778.022693: Worker 0: training step 541 done (global step: 1036) | |
1681061778.028354: Worker 0: training step 542 done (global step: 1038) | |
1681061778.034858: Worker 0: training step 543 done (global step: 1040) | |
1681061778.040744: Worker 0: training step 544 done (global step: 1042) | |
1681061778.047506: Worker 0: training step 545 done (global step: 1044) | |
1681061778.053043: Worker 0: training step 546 done (global step: 1046) | |
1681061778.058484: Worker 0: training step 547 done (global step: 1048) | |
1681061778.067913: Worker 0: training step 548 done (global step: 1050) | |
1681061778.078668: Worker 0: training step 549 done (global step: 1052) | |
1681061778.090433: Worker 0: training step 550 done (global step: 1054) | |
1681061778.269723: Worker 0: training step 551 done (global step: 1089) | |
1681061778.274689: Worker 0: training step 552 done (global step: 1091) | |
1681061778.280206: Worker 0: training step 553 done (global step: 1093) | |
1681061778.285139: Worker 0: training step 554 done (global step: 1095) | |
1681061778.290400: Worker 0: training step 555 done (global step: 1097) | |
1681061778.295694: Worker 0: training step 556 done (global step: 1099) | |
1681061778.301384: Worker 0: training step 557 done (global step: 1101) | |
1681061778.309580: Worker 0: training step 558 done (global step: 1103) | |
1681061778.314685: Worker 0: training step 559 done (global step: 1105) | |
1681061778.320498: Worker 0: training step 560 done (global step: 1107) | |
1681061778.326145: Worker 0: training step 561 done (global step: 1109) | |
1681061778.331670: Worker 0: training step 562 done (global step: 1111) | |
1681061778.337763: Worker 0: training step 563 done (global step: 1112) | |
1681061778.342961: Worker 0: training step 564 done (global step: 1113) | |
1681061778.348148: Worker 0: training step 565 done (global step: 1114) | |
1681061778.352939: Worker 0: training step 566 done (global step: 1115) | |
1681061778.357946: Worker 0: training step 567 done (global step: 1116) | |
1681061778.362766: Worker 0: training step 568 done (global step: 1117) | |
1681061778.367232: Worker 0: training step 569 done (global step: 1118) | |
1681061778.371694: Worker 0: training step 570 done (global step: 1119) | |
1681061778.375905: Worker 0: training step 571 done (global step: 1120) | |
1681061778.380045: Worker 0: training step 572 done (global step: 1121) | |
1681061778.384374: Worker 0: training step 573 done (global step: 1122) | |
1681061778.389413: Worker 0: training step 574 done (global step: 1123) | |
1681061778.394175: Worker 0: training step 575 done (global step: 1124) | |
1681061778.398717: Worker 0: training step 576 done (global step: 1125) | |
1681061778.403649: Worker 0: training step 577 done (global step: 1126) | |
1681061778.408183: Worker 0: training step 578 done (global step: 1127) | |
1681061778.412762: Worker 0: training step 579 done (global step: 1128) | |
1681061778.416719: Worker 0: training step 580 done (global step: 1129) | |
1681061778.421141: Worker 0: training step 581 done (global step: 1130) | |
1681061778.425575: Worker 0: training step 582 done (global step: 1131) | |
1681061778.429917: Worker 0: training step 583 done (global step: 1132) | |
1681061778.434251: Worker 0: training step 584 done (global step: 1133) | |
1681061778.441795: Worker 0: training step 585 done (global step: 1134) | |
1681061778.446259: Worker 0: training step 586 done (global step: 1135) | |
1681061778.451055: Worker 0: training step 587 done (global step: 1136) | |
1681061778.455357: Worker 0: training step 588 done (global step: 1137) | |
1681061778.461112: Worker 0: training step 589 done (global step: 1138) | |
1681061778.466650: Worker 0: training step 590 done (global step: 1139) | |
1681061778.471881: Worker 0: training step 591 done (global step: 1140) | |
1681061778.475948: Worker 0: training step 592 done (global step: 1141) | |
1681061778.479790: Worker 0: training step 593 done (global step: 1142) | |
1681061778.483765: Worker 0: training step 594 done (global step: 1143) | |
1681061778.487897: Worker 0: training step 595 done (global step: 1144) | |
1681061778.492006: Worker 0: training step 596 done (global step: 1145) | |
1681061778.497458: Worker 0: training step 597 done (global step: 1146) | |
1681061778.503256: Worker 0: training step 598 done (global step: 1148) | |
1681061778.508897: Worker 0: training step 599 done (global step: 1150) | |
1681061778.513484: Worker 0: training step 600 done (global step: 1152) | |
1681061778.518009: Worker 0: training step 601 done (global step: 1154) | |
1681061778.523954: Worker 0: training step 602 done (global step: 1156) | |
1681061778.529279: Worker 0: training step 603 done (global step: 1158) | |
1681061778.534301: Worker 0: training step 604 done (global step: 1160) | |
1681061778.540320: Worker 0: training step 605 done (global step: 1162) | |
1681061778.545789: Worker 0: training step 606 done (global step: 1164) | |
1681061778.551883: Worker 0: training step 607 done (global step: 1166) | |
1681061778.557642: Worker 0: training step 608 done (global step: 1168) | |
1681061778.563117: Worker 0: training step 609 done (global step: 1170) | |
1681061778.568952: Worker 0: training step 610 done (global step: 1172) | |
1681061778.574072: Worker 0: training step 611 done (global step: 1174) | |
1681061778.579031: Worker 0: training step 612 done (global step: 1175) | |
1681061778.584128: Worker 0: training step 613 done (global step: 1177) | |
1681061778.589393: Worker 0: training step 614 done (global step: 1179) | |
1681061778.596034: Worker 0: training step 615 done (global step: 1181) | |
1681061778.601824: Worker 0: training step 616 done (global step: 1183) | |
1681061778.607138: Worker 0: training step 617 done (global step: 1185) | |
1681061778.613204: Worker 0: training step 618 done (global step: 1187) | |
1681061778.620156: Worker 0: training step 619 done (global step: 1189) | |
1681061778.625896: Worker 0: training step 620 done (global step: 1191) | |
1681061778.631528: Worker 0: training step 621 done (global step: 1193) | |
1681061778.637028: Worker 0: training step 622 done (global step: 1195) | |
1681061778.642796: Worker 0: training step 623 done (global step: 1198) | |
1681061778.648375: Worker 0: training step 624 done (global step: 1199) | |
1681061778.654083: Worker 0: training step 625 done (global step: 1202) | |
1681061778.660354: Worker 0: training step 626 done (global step: 1204) | |
1681061778.665787: Worker 0: training step 627 done (global step: 1206) | |
1681061778.670915: Worker 0: training step 628 done (global step: 1208) | |
1681061778.675869: Worker 0: training step 629 done (global step: 1210) | |
1681061778.681647: Worker 0: training step 630 done (global step: 1212) | |
1681061778.687256: Worker 0: training step 631 done (global step: 1214) | |
1681061778.693234: Worker 0: training step 632 done (global step: 1216) | |
1681061778.699878: Worker 0: training step 633 done (global step: 1218) | |
1681061778.705389: Worker 0: training step 634 done (global step: 1220) | |
1681061778.710943: Worker 0: training step 635 done (global step: 1222) | |
1681061778.716566: Worker 0: training step 636 done (global step: 1224) | |
1681061778.722077: Worker 0: training step 637 done (global step: 1226) | |
1681061778.727316: Worker 0: training step 638 done (global step: 1228) | |
1681061778.732825: Worker 0: training step 639 done (global step: 1230) | |
1681061778.741711: Worker 0: training step 640 done (global step: 1232) | |
1681061778.747361: Worker 0: training step 641 done (global step: 1235) | |
1681061778.752645: Worker 0: training step 642 done (global step: 1237) | |
1681061778.758649: Worker 0: training step 643 done (global step: 1239) | |
1681061778.763906: Worker 0: training step 644 done (global step: 1241) | |
1681061778.769272: Worker 0: training step 645 done (global step: 1243) | |
1681061778.774277: Worker 0: training step 646 done (global step: 1245) | |
1681061778.779039: Worker 0: training step 647 done (global step: 1247) | |
1681061778.784120: Worker 0: training step 648 done (global step: 1249) | |
1681061778.789704: Worker 0: training step 649 done (global step: 1251) | |
1681061778.795240: Worker 0: training step 650 done (global step: 1253) | |
1681061778.803652: Worker 0: training step 651 done (global step: 1255) | |
1681061778.812520: Worker 0: training step 652 done (global step: 1257) | |
1681061778.819458: Worker 0: training step 653 done (global step: 1259) | |
1681061778.826261: Worker 0: training step 654 done (global step: 1261) | |
1681061778.841920: Worker 0: training step 655 done (global step: 1263) | |
1681061778.855553: Worker 0: training step 656 done (global step: 1265) | |
1681061778.874514: Worker 0: training step 657 done (global step: 1267) | |
1681061778.879849: Worker 0: training step 658 done (global step: 1269) | |
1681061778.888976: Worker 0: training step 659 done (global step: 1270) | |
1681061778.896941: Worker 0: training step 660 done (global step: 1273) | |
1681061778.907713: Worker 0: training step 661 done (global step: 1274) | |
1681061778.916599: Worker 0: training step 662 done (global step: 1276) | |
1681061778.924664: Worker 0: training step 663 done (global step: 1278) | |
1681061778.932973: Worker 0: training step 664 done (global step: 1281) | |
1681061778.940698: Worker 0: training step 665 done (global step: 1283) | |
1681061778.949008: Worker 0: training step 666 done (global step: 1285) | |
1681061778.956953: Worker 0: training step 667 done (global step: 1286) | |
1681061778.965860: Worker 0: training step 668 done (global step: 1289) | |
1681061778.974582: Worker 0: training step 669 done (global step: 1290) | |
1681061778.982676: Worker 0: training step 670 done (global step: 1292) | |
1681061778.987844: Worker 0: training step 671 done (global step: 1294) | |
1681061778.996300: Worker 0: training step 672 done (global step: 1297) | |
1681061779.007272: Worker 0: training step 673 done (global step: 1298) | |
1681061779.017460: Worker 0: training step 674 done (global step: 1300) | |
1681061779.024060: Worker 0: training step 675 done (global step: 1302) | |
1681061779.030932: Worker 0: training step 676 done (global step: 1305) | |
1681061779.037184: Worker 0: training step 677 done (global step: 1307) | |
1681061779.043814: Worker 0: training step 678 done (global step: 1309) | |
1681061779.051891: Worker 0: training step 679 done (global step: 1311) | |
1681061779.057416: Worker 0: training step 680 done (global step: 1313) | |
1681061779.062741: Worker 0: training step 681 done (global step: 1315) | |
1681061779.067518: Worker 0: training step 682 done (global step: 1317) | |
1681061779.073573: Worker 0: training step 683 done (global step: 1319) | |
1681061779.079348: Worker 0: training step 684 done (global step: 1321) | |
1681061779.084691: Worker 0: training step 685 done (global step: 1323) | |
1681061779.092303: Worker 0: training step 686 done (global step: 1325) | |
1681061779.098737: Worker 0: training step 687 done (global step: 1327) | |
1681061779.103391: Worker 0: training step 688 done (global step: 1329) | |
1681061779.111116: Worker 0: training step 689 done (global step: 1331) | |
1681061779.120124: Worker 0: training step 690 done (global step: 1334) | |
1681061779.127249: Worker 0: training step 691 done (global step: 1336) | |
1681061779.136124: Worker 0: training step 692 done (global step: 1338) | |
1681061779.145600: Worker 0: training step 693 done (global step: 1340) | |
1681061779.153068: Worker 0: training step 694 done (global step: 1342) | |
1681061779.159226: Worker 0: training step 695 done (global step: 1343) | |
1681061779.165970: Worker 0: training step 696 done (global step: 1345) | |
1681061779.172395: Worker 0: training step 697 done (global step: 1347) | |
1681061779.186047: Worker 0: training step 698 done (global step: 1349) | |
1681061779.194569: Worker 0: training step 699 done (global step: 1351) | |
1681061779.201665: Worker 0: training step 700 done (global step: 1353) | |
1681061779.208816: Worker 0: training step 701 done (global step: 1355) | |
1681061779.219260: Worker 0: training step 702 done (global step: 1357) | |
1681061779.227229: Worker 0: training step 703 done (global step: 1359) | |
1681061779.234718: Worker 0: training step 704 done (global step: 1361) | |
1681061779.242403: Worker 0: training step 705 done (global step: 1363) | |
1681061779.256444: Worker 0: training step 706 done (global step: 1365) | |
1681061779.264020: Worker 0: training step 707 done (global step: 1367) | |
1681061779.270007: Worker 0: training step 708 done (global step: 1369) | |
1681061779.275490: Worker 0: training step 709 done (global step: 1371) | |
1681061779.280903: Worker 0: training step 710 done (global step: 1373) | |
1681061779.286886: Worker 0: training step 711 done (global step: 1375) | |
1681061779.292541: Worker 0: training step 712 done (global step: 1377) | |
1681061779.298027: Worker 0: training step 713 done (global step: 1379) | |
1681061779.304323: Worker 0: training step 714 done (global step: 1381) | |
1681061779.310866: Worker 0: training step 715 done (global step: 1383) | |
1681061779.316320: Worker 0: training step 716 done (global step: 1385) | |
1681061779.321763: Worker 0: training step 717 done (global step: 1387) | |
1681061779.326821: Worker 0: training step 718 done (global step: 1389) | |
1681061779.332253: Worker 0: training step 719 done (global step: 1391) | |
1681061779.338046: Worker 0: training step 720 done (global step: 1393) | |
1681061779.344248: Worker 0: training step 721 done (global step: 1395) | |
1681061779.350708: Worker 0: training step 722 done (global step: 1397) | |
1681061779.356472: Worker 0: training step 723 done (global step: 1399) | |
1681061779.361902: Worker 0: training step 724 done (global step: 1401) | |
1681061779.367673: Worker 0: training step 725 done (global step: 1403) | |
1681061779.372933: Worker 0: training step 726 done (global step: 1405) | |
1681061779.378197: Worker 0: training step 727 done (global step: 1407) | |
1681061779.383535: Worker 0: training step 728 done (global step: 1408) | |
1681061779.389661: Worker 0: training step 729 done (global step: 1410) | |
1681061779.395642: Worker 0: training step 730 done (global step: 1412) | |
1681061779.403866: Worker 0: training step 731 done (global step: 1415) | |
1681061779.411177: Worker 0: training step 732 done (global step: 1417) | |
1681061779.416921: Worker 0: training step 733 done (global step: 1419) | |
1681061779.422522: Worker 0: training step 734 done (global step: 1421) | |
1681061779.427681: Worker 0: training step 735 done (global step: 1423) | |
1681061779.432889: Worker 0: training step 736 done (global step: 1425) | |
1681061779.438514: Worker 0: training step 737 done (global step: 1427) | |
1681061779.445521: Worker 0: training step 738 done (global step: 1429) | |
1681061779.451685: Worker 0: training step 739 done (global step: 1431) | |
1681061779.457253: Worker 0: training step 740 done (global step: 1433) | |
1681061779.463066: Worker 0: training step 741 done (global step: 1435) | |
1681061779.468237: Worker 0: training step 742 done (global step: 1437) | |
1681061779.474123: Worker 0: training step 743 done (global step: 1439) | |
1681061779.479905: Worker 0: training step 744 done (global step: 1441) | |
1681061779.484992: Worker 0: training step 745 done (global step: 1443) | |
1681061779.490555: Worker 0: training step 746 done (global step: 1444) | |
1681061779.495826: Worker 0: training step 747 done (global step: 1446) | |
1681061779.501361: Worker 0: training step 748 done (global step: 1448) | |
1681061779.507765: Worker 0: training step 749 done (global step: 1450) | |
1681061779.513552: Worker 0: training step 750 done (global step: 1453) | |
1681061779.518986: Worker 0: training step 751 done (global step: 1455) | |
1681061779.524302: Worker 0: training step 752 done (global step: 1457) | |
1681061779.530477: Worker 0: training step 753 done (global step: 1459) | |
1681061779.535749: Worker 0: training step 754 done (global step: 1461) | |
1681061779.542182: Worker 0: training step 755 done (global step: 1463) | |
1681061779.547969: Worker 0: training step 756 done (global step: 1465) | |
1681061779.553530: Worker 0: training step 757 done (global step: 1467) | |
1681061779.559417: Worker 0: training step 758 done (global step: 1469) | |
1681061779.564645: Worker 0: training step 759 done (global step: 1471) | |
1681061779.570120: Worker 0: training step 760 done (global step: 1473) | |
1681061779.575696: Worker 0: training step 761 done (global step: 1475) | |
1681061779.580836: Worker 0: training step 762 done (global step: 1477) | |
1681061779.586686: Worker 0: training step 763 done (global step: 1478) | |
1681061779.592935: Worker 0: training step 764 done (global step: 1481) | |
1681061779.598633: Worker 0: training step 765 done (global step: 1483) | |
1681061779.604691: Worker 0: training step 766 done (global step: 1485) | |
1681061779.610776: Worker 0: training step 767 done (global step: 1487) | |
1681061779.616038: Worker 0: training step 768 done (global step: 1489) | |
1681061779.621484: Worker 0: training step 769 done (global step: 1491) | |
1681061779.627849: Worker 0: training step 770 done (global step: 1493) | |
1681061779.632985: Worker 0: training step 771 done (global step: 1495) | |
1681061779.638904: Worker 0: training step 772 done (global step: 1497) | |
1681061779.644445: Worker 0: training step 773 done (global step: 1499) | |
1681061779.649838: Worker 0: training step 774 done (global step: 1501) | |
1681061779.654857: Worker 0: training step 775 done (global step: 1503) | |
1681061779.660704: Worker 0: training step 776 done (global step: 1505) | |
1681061779.666052: Worker 0: training step 777 done (global step: 1507) | |
1681061779.671469: Worker 0: training step 778 done (global step: 1509) | |
1681061779.676843: Worker 0: training step 779 done (global step: 1511) | |
1681061779.682946: Worker 0: training step 780 done (global step: 1513) | |
1681061779.688016: Worker 0: training step 781 done (global step: 1515) | |
1681061779.693079: Worker 0: training step 782 done (global step: 1517) | |
1681061779.698101: Worker 0: training step 783 done (global step: 1519) | |
1681061779.703039: Worker 0: training step 784 done (global step: 1521) | |
1681061779.708525: Worker 0: training step 785 done (global step: 1523) | |
1681061779.713896: Worker 0: training step 786 done (global step: 1525) | |
1681061779.719548: Worker 0: training step 787 done (global step: 1527) | |
1681061779.725642: Worker 0: training step 788 done (global step: 1529) | |
1681061779.731916: Worker 0: training step 789 done (global step: 1531) | |
1681061779.739159: Worker 0: training step 790 done (global step: 1533) | |
1681061779.745744: Worker 0: training step 791 done (global step: 1535) | |
1681061779.751914: Worker 0: training step 792 done (global step: 1538) | |
1681061779.758937: Worker 0: training step 793 done (global step: 1540) | |
1681061779.765223: Worker 0: training step 794 done (global step: 1542) | |
1681061779.771058: Worker 0: training step 795 done (global step: 1544) | |
1681061779.778570: Worker 0: training step 796 done (global step: 1546) | |
1681061779.787343: Worker 0: training step 797 done (global step: 1548) | |
1681061779.792485: Worker 0: training step 798 done (global step: 1551) | |
1681061779.798953: Worker 0: training step 799 done (global step: 1552) | |
1681061779.806066: Worker 0: training step 800 done (global step: 1555) | |
1681061779.813552: Worker 0: training step 801 done (global step: 1557) | |
1681061779.818451: Worker 0: training step 802 done (global step: 1558) | |
1681061779.824275: Worker 0: training step 803 done (global step: 1560) | |
1681061779.830291: Worker 0: training step 804 done (global step: 1562) | |
1681061779.837023: Worker 0: training step 805 done (global step: 1564) | |
1681061779.842874: Worker 0: training step 806 done (global step: 1566) | |
1681061779.849086: Worker 0: training step 807 done (global step: 1568) | |
1681061779.854172: Worker 0: training step 808 done (global step: 1570) | |
1681061779.859329: Worker 0: training step 809 done (global step: 1571) | |
1681061779.867023: Worker 0: training step 810 done (global step: 1573) | |
1681061779.872374: Worker 0: training step 811 done (global step: 1575) | |
1681061779.879876: Worker 0: training step 812 done (global step: 1577) | |
1681061779.886745: Worker 0: training step 813 done (global step: 1579) | |
1681061779.893172: Worker 0: training step 814 done (global step: 1581) | |
1681061779.899788: Worker 0: training step 815 done (global step: 1583) | |
1681061779.905187: Worker 0: training step 816 done (global step: 1585) | |
1681061779.910689: Worker 0: training step 817 done (global step: 1588) | |
1681061779.915866: Worker 0: training step 818 done (global step: 1589) | |
1681061779.922659: Worker 0: training step 819 done (global step: 1591) | |
1681061779.928755: Worker 0: training step 820 done (global step: 1593) | |
1681061779.934809: Worker 0: training step 821 done (global step: 1596) | |
1681061779.940476: Worker 0: training step 822 done (global step: 1598) | |
1681061779.946115: Worker 0: training step 823 done (global step: 1600) | |
1681061779.953117: Worker 0: training step 824 done (global step: 1602) | |
1681061779.960480: Worker 0: training step 825 done (global step: 1604) | |
1681061779.967386: Worker 0: training step 826 done (global step: 1606) | |
1681061779.974062: Worker 0: training step 827 done (global step: 1608) | |
1681061779.979431: Worker 0: training step 828 done (global step: 1610) | |
1681061779.984756: Worker 0: training step 829 done (global step: 1612) | |
1681061779.990540: Worker 0: training step 830 done (global step: 1614) | |
1681061779.995397: Worker 0: training step 831 done (global step: 1616) | |
1681061780.001442: Worker 0: training step 832 done (global step: 1618) | |
1681061780.007080: Worker 0: training step 833 done (global step: 1620) | |
1681061780.012805: Worker 0: training step 834 done (global step: 1622) | |
1681061780.018542: Worker 0: training step 835 done (global step: 1624) | |
1681061780.026342: Worker 0: training step 836 done (global step: 1626) | |
1681061780.033295: Worker 0: training step 837 done (global step: 1628) | |
1681061780.039043: Worker 0: training step 838 done (global step: 1630) | |
1681061780.045507: Worker 0: training step 839 done (global step: 1632) | |
1681061780.051552: Worker 0: training step 840 done (global step: 1634) | |
1681061780.056866: Worker 0: training step 841 done (global step: 1636) | |
1681061780.062464: Worker 0: training step 842 done (global step: 1638) | |
1681061780.068121: Worker 0: training step 843 done (global step: 1640) | |
1681061780.073357: Worker 0: training step 844 done (global step: 1642) | |
1681061780.079082: Worker 0: training step 845 done (global step: 1644) | |
1681061780.084725: Worker 0: training step 846 done (global step: 1646) | |
1681061780.090439: Worker 0: training step 847 done (global step: 1648) | |
1681061780.095772: Worker 0: training step 848 done (global step: 1650) | |
1681061780.100378: Worker 0: training step 849 done (global step: 1652) | |
1681061780.105039: Worker 0: training step 850 done (global step: 1653) | |
1681061780.109878: Worker 0: training step 851 done (global step: 1655) | |
1681061780.115699: Worker 0: training step 852 done (global step: 1657) | |
1681061780.120464: Worker 0: training step 853 done (global step: 1659) | |
1681061780.126440: Worker 0: training step 854 done (global step: 1660) | |
1681061780.131843: Worker 0: training step 855 done (global step: 1663) | |
1681061780.138521: Worker 0: training step 856 done (global step: 1665) | |
1681061780.144864: Worker 0: training step 857 done (global step: 1667) | |
1681061780.150215: Worker 0: training step 858 done (global step: 1669) | |
1681061780.156723: Worker 0: training step 859 done (global step: 1671) | |
1681061780.162463: Worker 0: training step 860 done (global step: 1673) | |
1681061780.168187: Worker 0: training step 861 done (global step: 1675) | |
1681061780.173745: Worker 0: training step 862 done (global step: 1677) | |
1681061780.179709: Worker 0: training step 863 done (global step: 1679) | |
1681061780.184720: Worker 0: training step 864 done (global step: 1681) | |
1681061780.189706: Worker 0: training step 865 done (global step: 1683) | |
1681061780.195966: Worker 0: training step 866 done (global step: 1685) | |
1681061780.201837: Worker 0: training step 867 done (global step: 1687) | |
1681061780.206979: Worker 0: training step 868 done (global step: 1689) | |
1681061780.212185: Worker 0: training step 869 done (global step: 1691) | |
1681061780.217815: Worker 0: training step 870 done (global step: 1693) | |
1681061780.223478: Worker 0: training step 871 done (global step: 1695) | |
1681061780.229212: Worker 0: training step 872 done (global step: 1697) | |
1681061780.235108: Worker 0: training step 873 done (global step: 1699) | |
1681061780.240464: Worker 0: training step 874 done (global step: 1701) | |
1681061780.247835: Worker 0: training step 875 done (global step: 1703) | |
1681061780.254592: Worker 0: training step 876 done (global step: 1705) | |
1681061780.261692: Worker 0: training step 877 done (global step: 1707) | |
1681061780.267097: Worker 0: training step 878 done (global step: 1709) | |
1681061780.273474: Worker 0: training step 879 done (global step: 1711) | |
1681061780.281228: Worker 0: training step 880 done (global step: 1713) | |
1681061780.287110: Worker 0: training step 881 done (global step: 1715) | |
1681061780.292732: Worker 0: training step 882 done (global step: 1718) | |
1681061780.298450: Worker 0: training step 883 done (global step: 1720) | |
1681061780.304925: Worker 0: training step 884 done (global step: 1722) | |
1681061780.312683: Worker 0: training step 885 done (global step: 1724) | |
1681061780.318444: Worker 0: training step 886 done (global step: 1725) | |
1681061780.323709: Worker 0: training step 887 done (global step: 1728) | |
1681061780.328586: Worker 0: training step 888 done (global step: 1730) | |
1681061780.335749: Worker 0: training step 889 done (global step: 1731) | |
1681061780.341424: Worker 0: training step 890 done (global step: 1734) | |
1681061780.346549: Worker 0: training step 891 done (global step: 1736) | |
1681061780.352325: Worker 0: training step 892 done (global step: 1738) | |
1681061780.357214: Worker 0: training step 893 done (global step: 1740) | |
1681061780.362885: Worker 0: training step 894 done (global step: 1742) | |
1681061780.367927: Worker 0: training step 895 done (global step: 1744) | |
1681061780.373522: Worker 0: training step 896 done (global step: 1746) | |
1681061780.379317: Worker 0: training step 897 done (global step: 1748) | |
1681061780.384892: Worker 0: training step 898 done (global step: 1750) | |
1681061780.391297: Worker 0: training step 899 done (global step: 1752) | |
1681061780.397407: Worker 0: training step 900 done (global step: 1754) | |
1681061780.402739: Worker 0: training step 901 done (global step: 1756) | |
1681061780.408215: Worker 0: training step 902 done (global step: 1758) | |
1681061780.414461: Worker 0: training step 903 done (global step: 1760) | |
1681061780.420103: Worker 0: training step 904 done (global step: 1762) | |
1681061780.425308: Worker 0: training step 905 done (global step: 1764) | |
1681061780.430290: Worker 0: training step 906 done (global step: 1766) | |
1681061780.436062: Worker 0: training step 907 done (global step: 1768) | |
1681061780.441904: Worker 0: training step 908 done (global step: 1770) | |
1681061780.448264: Worker 0: training step 909 done (global step: 1772) | |
1681061780.453295: Worker 0: training step 910 done (global step: 1774) | |
1681061780.459497: Worker 0: training step 911 done (global step: 1776) | |
1681061780.473214: Worker 0: training step 912 done (global step: 1778) | |
1681061780.481100: Worker 0: training step 913 done (global step: 1780) | |
1681061780.486303: Worker 0: training step 914 done (global step: 1782) | |
1681061780.491592: Worker 0: training step 915 done (global step: 1784) | |
1681061780.496938: Worker 0: training step 916 done (global step: 1786) | |
1681061780.502333: Worker 0: training step 917 done (global step: 1788) | |
1681061780.508171: Worker 0: training step 918 done (global step: 1790) | |
1681061780.514046: Worker 0: training step 919 done (global step: 1792) | |
1681061780.521009: Worker 0: training step 920 done (global step: 1794) | |
1681061780.526764: Worker 0: training step 921 done (global step: 1796) | |
1681061780.531834: Worker 0: training step 922 done (global step: 1798) | |
1681061780.537372: Worker 0: training step 923 done (global step: 1800) | |
1681061780.543226: Worker 0: training step 924 done (global step: 1802) | |
1681061780.549260: Worker 0: training step 925 done (global step: 1804) | |
1681061780.554771: Worker 0: training step 926 done (global step: 1806) | |
1681061780.559961: Worker 0: training step 927 done (global step: 1808) | |
1681061780.565945: Worker 0: training step 928 done (global step: 1810) | |
1681061780.571563: Worker 0: training step 929 done (global step: 1812) | |
1681061780.577158: Worker 0: training step 930 done (global step: 1814) | |
1681061780.583220: Worker 0: training step 931 done (global step: 1816) | |
1681061780.589873: Worker 0: training step 932 done (global step: 1818) | |
1681061780.595025: Worker 0: training step 933 done (global step: 1820) | |
1681061780.601815: Worker 0: training step 934 done (global step: 1822) | |
1681061780.608961: Worker 0: training step 935 done (global step: 1824) | |
1681061780.614920: Worker 0: training step 936 done (global step: 1826) | |
1681061780.620248: Worker 0: training step 937 done (global step: 1828) | |
1681061780.625683: Worker 0: training step 938 done (global step: 1830) | |
1681061780.631027: Worker 0: training step 939 done (global step: 1832) | |
1681061780.636349: Worker 0: training step 940 done (global step: 1834) | |
1681061780.642483: Worker 0: training step 941 done (global step: 1836) | |
1681061780.647789: Worker 0: training step 942 done (global step: 1838) | |
1681061780.653308: Worker 0: training step 943 done (global step: 1840) | |
1681061780.659015: Worker 0: training step 944 done (global step: 1842) | |
1681061780.664211: Worker 0: training step 945 done (global step: 1844) | |
1681061780.669733: Worker 0: training step 946 done (global step: 1846) | |
1681061780.675047: Worker 0: training step 947 done (global step: 1848) | |
1681061780.680367: Worker 0: training step 948 done (global step: 1850) | |
1681061780.685563: Worker 0: training step 949 done (global step: 1852) | |
1681061780.691761: Worker 0: training step 950 done (global step: 1854) | |
1681061780.697079: Worker 0: training step 951 done (global step: 1856) | |
1681061780.702746: Worker 0: training step 952 done (global step: 1858) | |
1681061780.708165: Worker 0: training step 953 done (global step: 1860) | |
1681061780.714322: Worker 0: training step 954 done (global step: 1862) | |
1681061780.721799: Worker 0: training step 955 done (global step: 1864) | |
1681061780.728384: Worker 0: training step 956 done (global step: 1866) | |
1681061780.735185: Worker 0: training step 957 done (global step: 1868) | |
1681061780.742148: Worker 0: training step 958 done (global step: 1870) | |
1681061780.748410: Worker 0: training step 959 done (global step: 1872) | |
1681061780.756505: Worker 0: training step 960 done (global step: 1874) | |
1681061780.763631: Worker 0: training step 961 done (global step: 1876) | |
1681061780.772694: Worker 0: training step 962 done (global step: 1878) | |
1681061780.783880: Worker 0: training step 963 done (global step: 1880) | |
1681061780.792046: Worker 0: training step 964 done (global step: 1882) | |
1681061780.799820: Worker 0: training step 965 done (global step: 1885) | |
1681061780.807306: Worker 0: training step 966 done (global step: 1886) | |
1681061780.814519: Worker 0: training step 967 done (global step: 1889) | |
1681061780.821872: Worker 0: training step 968 done (global step: 1891) | |
1681061780.828438: Worker 0: training step 969 done (global step: 1892) | |
1681061780.835500: Worker 0: training step 970 done (global step: 1894) | |
1681061780.841756: Worker 0: training step 971 done (global step: 1896) | |
1681061780.851368: Worker 0: training step 972 done (global step: 1898) | |
1681061780.859369: Worker 0: training step 973 done (global step: 1901) | |
1681061780.867321: Worker 0: training step 974 done (global step: 1903) | |
1681061780.873717: Worker 0: training step 975 done (global step: 1904) | |
1681061780.881184: Worker 0: training step 976 done (global step: 1906) | |
1681061780.890909: Worker 0: training step 977 done (global step: 1908) | |
1681061780.898043: Worker 0: training step 978 done (global step: 1910) | |
1681061780.904657: Worker 0: training step 979 done (global step: 1912) | |
1681061780.911342: Worker 0: training step 980 done (global step: 1914) | |
1681061780.918044: Worker 0: training step 981 done (global step: 1916) | |
1681061780.925221: Worker 0: training step 982 done (global step: 1918) | |
1681061780.931062: Worker 0: training step 983 done (global step: 1920) | |
1681061780.937669: Worker 0: training step 984 done (global step: 1922) | |
1681061780.945504: Worker 0: training step 985 done (global step: 1924) | |
1681061780.951046: Worker 0: training step 986 done (global step: 1926) | |
1681061780.960598: Worker 0: training step 987 done (global step: 1928) | |
1681061780.977793: Worker 0: training step 988 done (global step: 1931) | |
1681061780.984585: Worker 0: training step 989 done (global step: 1933) | |
1681061780.995121: Worker 0: training step 990 done (global step: 1934) | |
1681061781.003672: Worker 0: training step 991 done (global step: 1937) | |
1681061781.010284: Worker 0: training step 992 done (global step: 1939) | |
1681061781.018440: Worker 0: training step 993 done (global step: 1941) | |
1681061781.024687: Worker 0: training step 994 done (global step: 1943) | |
1681061781.030844: Worker 0: training step 995 done (global step: 1945) | |
1681061781.040554: Worker 0: training step 996 done (global step: 1947) | |
1681061781.050519: Worker 0: training step 997 done (global step: 1949) | |
1681061781.059447: Worker 0: training step 998 done (global step: 1952) | |
1681061781.068843: Worker 0: training step 999 done (global step: 1954) | |
1681061781.076382: Worker 0: training step 1000 done (global step: 1956) | |
1681061781.085791: Worker 0: training step 1001 done (global step: 1959) | |
1681061781.092536: Worker 0: training step 1002 done (global step: 1961) | |
1681061781.102747: Worker 0: training step 1003 done (global step: 1963) | |
1681061781.111737: Worker 0: training step 1004 done (global step: 1965) | |
1681061781.120508: Worker 0: training step 1005 done (global step: 1967) | |
1681061781.130054: Worker 0: training step 1006 done (global step: 1969) | |
1681061781.137077: Worker 0: training step 1007 done (global step: 1971) | |
1681061781.145768: Worker 0: training step 1008 done (global step: 1973) | |
1681061781.151922: Worker 0: training step 1009 done (global step: 1975) | |
1681061781.158641: Worker 0: training step 1010 done (global step: 1977) | |
1681061781.168062: Worker 0: training step 1011 done (global step: 1978) | |
1681061781.175668: Worker 0: training step 1012 done (global step: 1981) | |
1681061781.183225: Worker 0: training step 1013 done (global step: 1983) | |
1681061781.191156: Worker 0: training step 1014 done (global step: 1985) | |
1681061781.199525: Worker 0: training step 1015 done (global step: 1986) | |
1681061781.208371: Worker 0: training step 1016 done (global step: 1988) | |
1681061781.216979: Worker 0: training step 1017 done (global step: 1990) | |
1681061781.226168: Worker 0: training step 1018 done (global step: 1993) | |
1681061781.234224: Worker 0: training step 1019 done (global step: 1995) | |
1681061781.241294: Worker 0: training step 1020 done (global step: 1996) | |
1681061781.251660: Worker 0: training step 1021 done (global step: 1999) | |
1681061781.259781: Worker 0: training step 1022 done (global step: 2001) | |
1681061781.268437: Worker 0: training step 1023 done (global step: 2003) | |
1681061781.275665: Worker 0: training step 1024 done (global step: 2005) | |
1681061781.284183: Worker 0: training step 1025 done (global step: 2007) | |
1681061781.291675: Worker 0: training step 1026 done (global step: 2009) | |
1681061781.298221: Worker 0: training step 1027 done (global step: 2011) | |
1681061781.308037: Worker 0: training step 1028 done (global step: 2013) | |
1681061781.316339: Worker 0: training step 1029 done (global step: 2015) | |
1681061781.324323: Worker 0: training step 1030 done (global step: 2017) | |
1681061781.331596: Worker 0: training step 1031 done (global step: 2019) | |
1681061781.337422: Worker 0: training step 1032 done (global step: 2021) | |
1681061781.342648: Worker 0: training step 1033 done (global step: 2023) | |
1681061781.347915: Worker 0: training step 1034 done (global step: 2025) | |
1681061781.353361: Worker 0: training step 1035 done (global step: 2027) | |
1681061781.358890: Worker 0: training step 1036 done (global step: 2029) | |
1681061781.364632: Worker 0: training step 1037 done (global step: 2031) | |
1681061781.369933: Worker 0: training step 1038 done (global step: 2033) | |
1681061781.376070: Worker 0: training step 1039 done (global step: 2035) | |
1681061781.382229: Worker 0: training step 1040 done (global step: 2037) | |
1681061781.389105: Worker 0: training step 1041 done (global step: 2039) | |
1681061781.394631: Worker 0: training step 1042 done (global step: 2041) | |
1681061781.398815: Worker 0: training step 1043 done (global step: 2043) | |
1681061781.404742: Worker 0: training step 1044 done (global step: 2045) | |
1681061781.410164: Worker 0: training step 1045 done (global step: 2047) | |
1681061781.415506: Worker 0: training step 1046 done (global step: 2049) | |
1681061781.422011: Worker 0: training step 1047 done (global step: 2051) | |
1681061781.427366: Worker 0: training step 1048 done (global step: 2053) | |
1681061781.433080: Worker 0: training step 1049 done (global step: 2055) | |
1681061781.437930: Worker 0: training step 1050 done (global step: 2057) | |
1681061781.442738: Worker 0: training step 1051 done (global step: 2059) | |
1681061781.448274: Worker 0: training step 1052 done (global step: 2061) | |
1681061781.453785: Worker 0: training step 1053 done (global step: 2063) | |
1681061781.458917: Worker 0: training step 1054 done (global step: 2065) | |
1681061781.463924: Worker 0: training step 1055 done (global step: 2067) | |
1681061781.468785: Worker 0: training step 1056 done (global step: 2068) | |
1681061781.474081: Worker 0: training step 1057 done (global step: 2070) | |
1681061781.479400: Worker 0: training step 1058 done (global step: 2072) | |
1681061781.484738: Worker 0: training step 1059 done (global step: 2074) | |
1681061781.490890: Worker 0: training step 1060 done (global step: 2077) | |
1681061781.496667: Worker 0: training step 1061 done (global step: 2078) | |
1681061781.501892: Worker 0: training step 1062 done (global step: 2081) | |
1681061781.507179: Worker 0: training step 1063 done (global step: 2083) | |
1681061781.512489: Worker 0: training step 1064 done (global step: 2085) | |
1681061781.517581: Worker 0: training step 1065 done (global step: 2086) | |
1681061781.522769: Worker 0: training step 1066 done (global step: 2088) | |
1681061781.528321: Worker 0: training step 1067 done (global step: 2090) | |
1681061781.534897: Worker 0: training step 1068 done (global step: 2092) | |
1681061781.541063: Worker 0: training step 1069 done (global step: 2094) | |
1681061781.545778: Worker 0: training step 1070 done (global step: 2096) | |
1681061781.551794: Worker 0: training step 1071 done (global step: 2098) | |
1681061781.556908: Worker 0: training step 1072 done (global step: 2100) | |
1681061781.561841: Worker 0: training step 1073 done (global step: 2102) | |
1681061781.567049: Worker 0: training step 1074 done (global step: 2104) | |
1681061781.572518: Worker 0: training step 1075 done (global step: 2106) | |
1681061781.578905: Worker 0: training step 1076 done (global step: 2108) | |
1681061781.585257: Worker 0: training step 1077 done (global step: 2110) | |
1681061781.590816: Worker 0: training step 1078 done (global step: 2112) | |
1681061781.595818: Worker 0: training step 1079 done (global step: 2114) | |
1681061781.600957: Worker 0: training step 1080 done (global step: 2116) | |
1681061781.606766: Worker 0: training step 1081 done (global step: 2118) | |
1681061781.611893: Worker 0: training step 1082 done (global step: 2120) | |
1681061781.618134: Worker 0: training step 1083 done (global step: 2122) | |
1681061781.623411: Worker 0: training step 1084 done (global step: 2124) | |
1681061781.629246: Worker 0: training step 1085 done (global step: 2126) | |
1681061781.634695: Worker 0: training step 1086 done (global step: 2128) | |
1681061781.640736: Worker 0: training step 1087 done (global step: 2130) | |
1681061781.646277: Worker 0: training step 1088 done (global step: 2132) | |
1681061781.651711: Worker 0: training step 1089 done (global step: 2134) | |
1681061781.657810: Worker 0: training step 1090 done (global step: 2137) | |
1681061781.663317: Worker 0: training step 1091 done (global step: 2138) | |
1681061781.669094: Worker 0: training step 1092 done (global step: 2141) | |
1681061781.675348: Worker 0: training step 1093 done (global step: 2143) | |
1681061781.681767: Worker 0: training step 1094 done (global step: 2145) | |
1681061781.686982: Worker 0: training step 1095 done (global step: 2147) | |
1681061781.692782: Worker 0: training step 1096 done (global step: 2149) | |
1681061781.697833: Worker 0: training step 1097 done (global step: 2151) | |
1681061781.703025: Worker 0: training step 1098 done (global step: 2153) | |
1681061781.708750: Worker 0: training step 1099 done (global step: 2155) | |
1681061781.713718: Worker 0: training step 1100 done (global step: 2157) | |
1681061781.880022: Worker 0: training step 1101 done (global step: 2189) | |
1681061781.886137: Worker 0: training step 1102 done (global step: 2191) | |
1681061781.893645: Worker 0: training step 1103 done (global step: 2193) | |
1681061781.900037: Worker 0: training step 1104 done (global step: 2195) | |
1681061781.906145: Worker 0: training step 1105 done (global step: 2197) | |
1681061781.912322: Worker 0: training step 1106 done (global step: 2199) | |
1681061781.917859: Worker 0: training step 1107 done (global step: 2201) | |
1681061781.923402: Worker 0: training step 1108 done (global step: 2203) | |
1681061781.928307: Worker 0: training step 1109 done (global step: 2205) | |
1681061781.933570: Worker 0: training step 1110 done (global step: 2207) | |
1681061781.939636: Worker 0: training step 1111 done (global step: 2209) | |
1681061781.944271: Worker 0: training step 1112 done (global step: 2211) | |
1681061781.948621: Worker 0: training step 1113 done (global step: 2212) | |
1681061781.954161: Worker 0: training step 1114 done (global step: 2213) | |
1681061781.960971: Worker 0: training step 1115 done (global step: 2214) | |
1681061781.967882: Worker 0: training step 1116 done (global step: 2215) | |
1681061781.973325: Worker 0: training step 1117 done (global step: 2216) | |
1681061781.978266: Worker 0: training step 1118 done (global step: 2217) | |
1681061781.982664: Worker 0: training step 1119 done (global step: 2218) | |
1681061781.987909: Worker 0: training step 1120 done (global step: 2219) | |
1681061781.992517: Worker 0: training step 1121 done (global step: 2220) | |
1681061781.997061: Worker 0: training step 1122 done (global step: 2221) | |
1681061782.001790: Worker 0: training step 1123 done (global step: 2222) | |
1681061782.006113: Worker 0: training step 1124 done (global step: 2223) | |
1681061782.010353: Worker 0: training step 1125 done (global step: 2224) | |
1681061782.015320: Worker 0: training step 1126 done (global step: 2225) | |
1681061782.019672: Worker 0: training step 1127 done (global step: 2226) | |
1681061782.023951: Worker 0: training step 1128 done (global step: 2227) | |
1681061782.029406: Worker 0: training step 1129 done (global step: 2228) | |
1681061782.034452: Worker 0: training step 1130 done (global step: 2229) | |
1681061782.039336: Worker 0: training step 1131 done (global step: 2230) | |
1681061782.043624: Worker 0: training step 1132 done (global step: 2231) | |
1681061782.048419: Worker 0: training step 1133 done (global step: 2232) | |
1681061782.053125: Worker 0: training step 1134 done (global step: 2233) | |
1681061782.058460: Worker 0: training step 1135 done (global step: 2234) | |
1681061782.063237: Worker 0: training step 1136 done (global step: 2235) | |
1681061782.068109: Worker 0: training step 1137 done (global step: 2236) | |
1681061782.073261: Worker 0: training step 1138 done (global step: 2237) | |
1681061782.077209: Worker 0: training step 1139 done (global step: 2238) | |
1681061782.081451: Worker 0: training step 1140 done (global step: 2239) | |
1681061782.085585: Worker 0: training step 1141 done (global step: 2240) | |
1681061782.089873: Worker 0: training step 1142 done (global step: 2241) | |
1681061782.094734: Worker 0: training step 1143 done (global step: 2242) | |
1681061782.099900: Worker 0: training step 1144 done (global step: 2243) | |
1681061782.105781: Worker 0: training step 1145 done (global step: 2244) | |
1681061782.112139: Worker 0: training step 1146 done (global step: 2247) | |
1681061782.118436: Worker 0: training step 1147 done (global step: 2249) | |
1681061782.124852: Worker 0: training step 1148 done (global step: 2251) | |
1681061782.130161: Worker 0: training step 1149 done (global step: 2253) | |
1681061782.136097: Worker 0: training step 1150 done (global step: 2255) | |
1681061782.141719: Worker 0: training step 1151 done (global step: 2257) | |
1681061782.147917: Worker 0: training step 1152 done (global step: 2259) | |
1681061782.155133: Worker 0: training step 1153 done (global step: 2261) | |
1681061782.161011: Worker 0: training step 1154 done (global step: 2263) | |
1681061782.166459: Worker 0: training step 1155 done (global step: 2265) | |
1681061782.171843: Worker 0: training step 1156 done (global step: 2267) | |
1681061782.176992: Worker 0: training step 1157 done (global step: 2269) | |
1681061782.183322: Worker 0: training step 1158 done (global step: 2271) | |
1681061782.188366: Worker 0: training step 1159 done (global step: 2273) | |
1681061782.194503: Worker 0: training step 1160 done (global step: 2275) | |
1681061782.200943: Worker 0: training step 1161 done (global step: 2277) | |
1681061782.206395: Worker 0: training step 1162 done (global step: 2279) | |
1681061782.212527: Worker 0: training step 1163 done (global step: 2281) | |
1681061782.218051: Worker 0: training step 1164 done (global step: 2284) | |
1681061782.224288: Worker 0: training step 1165 done (global step: 2286) | |
1681061782.230134: Worker 0: training step 1166 done (global step: 2288) | |
1681061782.235848: Worker 0: training step 1167 done (global step: 2290) | |
1681061782.240894: Worker 0: training step 1168 done (global step: 2292) | |
1681061782.246361: Worker 0: training step 1169 done (global step: 2294) | |
1681061782.252635: Worker 0: training step 1170 done (global step: 2296) | |
1681061782.257842: Worker 0: training step 1171 done (global step: 2298) | |
1681061782.262850: Worker 0: training step 1172 done (global step: 2299) | |
1681061782.268964: Worker 0: training step 1173 done (global step: 2301) | |
1681061782.274457: Worker 0: training step 1174 done (global step: 2303) | |
1681061782.279539: Worker 0: training step 1175 done (global step: 2305) | |
1681061782.284939: Worker 0: training step 1176 done (global step: 2307) | |
1681061782.290223: Worker 0: training step 1177 done (global step: 2309) | |
1681061782.295892: Worker 0: training step 1178 done (global step: 2311) | |
1681061782.301567: Worker 0: training step 1179 done (global step: 2313) | |
1681061782.309343: Worker 0: training step 1180 done (global step: 2315) | |
1681061782.314856: Worker 0: training step 1181 done (global step: 2317) | |
1681061782.320240: Worker 0: training step 1182 done (global step: 2319) | |
1681061782.326362: Worker 0: training step 1183 done (global step: 2321) | |
1681061782.333493: Worker 0: training step 1184 done (global step: 2323) | |
1681061782.338869: Worker 0: training step 1185 done (global step: 2326) | |
1681061782.344980: Worker 0: training step 1186 done (global step: 2328) | |
1681061782.350374: Worker 0: training step 1187 done (global step: 2330) | |
1681061782.355942: Worker 0: training step 1188 done (global step: 2332) | |
1681061782.361271: Worker 0: training step 1189 done (global step: 2334) | |
1681061782.366947: Worker 0: training step 1190 done (global step: 2336) | |
1681061782.371900: Worker 0: training step 1191 done (global step: 2338) | |
1681061782.376984: Worker 0: training step 1192 done (global step: 2340) | |
1681061782.383032: Worker 0: training step 1193 done (global step: 2341) | |
1681061782.388369: Worker 0: training step 1194 done (global step: 2343) | |
1681061782.393789: Worker 0: training step 1195 done (global step: 2345) | |
1681061782.398889: Worker 0: training step 1196 done (global step: 2347) | |
1681061782.405504: Worker 0: training step 1197 done (global step: 2349) | |
1681061782.411241: Worker 0: training step 1198 done (global step: 2351) | |
1681061782.416417: Worker 0: training step 1199 done (global step: 2353) | |
1681061782.421934: Worker 0: training step 1200 done (global step: 2355) | |
1681061782.427592: Worker 0: training step 1201 done (global step: 2357) | |
1681061782.433117: Worker 0: training step 1202 done (global step: 2359) | |
1681061782.439695: Worker 0: training step 1203 done (global step: 2361) | |
1681061782.444791: Worker 0: training step 1204 done (global step: 2363) | |
1681061782.450062: Worker 0: training step 1205 done (global step: 2365) | |
1681061782.455555: Worker 0: training step 1206 done (global step: 2367) | |
1681061782.463113: Worker 0: training step 1207 done (global step: 2369) | |
1681061782.469129: Worker 0: training step 1208 done (global step: 2371) | |
1681061782.475847: Worker 0: training step 1209 done (global step: 2373) | |
1681061782.481750: Worker 0: training step 1210 done (global step: 2375) | |
1681061782.487114: Worker 0: training step 1211 done (global step: 2377) | |
1681061782.492495: Worker 0: training step 1212 done (global step: 2379) | |
1681061782.497403: Worker 0: training step 1213 done (global step: 2381) | |
1681061782.501833: Worker 0: training step 1214 done (global step: 2383) | |
1681061782.507277: Worker 0: training step 1215 done (global step: 2384) | |
1681061782.513973: Worker 0: training step 1216 done (global step: 2386) | |
1681061782.519349: Worker 0: training step 1217 done (global step: 2389) | |
1681061782.524382: Worker 0: training step 1218 done (global step: 2390) | |
1681061782.530268: Worker 0: training step 1219 done (global step: 2392) | |
1681061782.536488: Worker 0: training step 1220 done (global step: 2395) | |
1681061782.542034: Worker 0: training step 1221 done (global step: 2397) | |
1681061782.547783: Worker 0: training step 1222 done (global step: 2399) | |
1681061782.553211: Worker 0: training step 1223 done (global step: 2401) | |
1681061782.558494: Worker 0: training step 1224 done (global step: 2403) | |
1681061782.564192: Worker 0: training step 1225 done (global step: 2405) | |
1681061782.569745: Worker 0: training step 1226 done (global step: 2407) | |
1681061782.575017: Worker 0: training step 1227 done (global step: 2409) | |
1681061782.580080: Worker 0: training step 1228 done (global step: 2411) | |
1681061782.585917: Worker 0: training step 1229 done (global step: 2413) | |
1681061782.592407: Worker 0: training step 1230 done (global step: 2415) | |
1681061782.598435: Worker 0: training step 1231 done (global step: 2417) | |
1681061782.604347: Worker 0: training step 1232 done (global step: 2419) | |
1681061782.610406: Worker 0: training step 1233 done (global step: 2421) | |
1681061782.615743: Worker 0: training step 1234 done (global step: 2423) | |
1681061782.621005: Worker 0: training step 1235 done (global step: 2425) | |
1681061782.626250: Worker 0: training step 1236 done (global step: 2427) | |
1681061782.631457: Worker 0: training step 1237 done (global step: 2429) | |
1681061782.637536: Worker 0: training step 1238 done (global step: 2431) | |
1681061782.643080: Worker 0: training step 1239 done (global step: 2433) | |
1681061782.648688: Worker 0: training step 1240 done (global step: 2435) | |
1681061782.654197: Worker 0: training step 1241 done (global step: 2437) | |
1681061782.659737: Worker 0: training step 1242 done (global step: 2439) | |
1681061782.665161: Worker 0: training step 1243 done (global step: 2441) | |
1681061782.670878: Worker 0: training step 1244 done (global step: 2443) | |
1681061782.675756: Worker 0: training step 1245 done (global step: 2445) | |
1681061782.681035: Worker 0: training step 1246 done (global step: 2447) | |
1681061782.686180: Worker 0: training step 1247 done (global step: 2449) | |
1681061782.691741: Worker 0: training step 1248 done (global step: 2451) | |
1681061782.697530: Worker 0: training step 1249 done (global step: 2453) | |
1681061782.702877: Worker 0: training step 1250 done (global step: 2455) | |
1681061782.707988: Worker 0: training step 1251 done (global step: 2457) | |
1681061782.713401: Worker 0: training step 1252 done (global step: 2459) | |
1681061782.719908: Worker 0: training step 1253 done (global step: 2461) | |
1681061782.724855: Worker 0: training step 1254 done (global step: 2463) | |
1681061782.732872: Worker 0: training step 1255 done (global step: 2465) | |
1681061782.738069: Worker 0: training step 1256 done (global step: 2468) | |
1681061782.743190: Worker 0: training step 1257 done (global step: 2470) | |
1681061782.749823: Worker 0: training step 1258 done (global step: 2472) | |
1681061782.755250: Worker 0: training step 1259 done (global step: 2474) | |
1681061782.760032: Worker 0: training step 1260 done (global step: 2475) | |
1681061782.764369: Worker 0: training step 1261 done (global step: 2477) | |
1681061782.769753: Worker 0: training step 1262 done (global step: 2479) | |
1681061782.775038: Worker 0: training step 1263 done (global step: 2481) | |
1681061782.780025: Worker 0: training step 1264 done (global step: 2483) | |
1681061782.786227: Worker 0: training step 1265 done (global step: 2485) | |
1681061782.791573: Worker 0: training step 1266 done (global step: 2487) | |
1681061782.796577: Worker 0: training step 1267 done (global step: 2489) | |
1681061782.802759: Worker 0: training step 1268 done (global step: 2491) | |
1681061782.808228: Worker 0: training step 1269 done (global step: 2493) | |
1681061782.812894: Worker 0: training step 1270 done (global step: 2495) | |
1681061782.819542: Worker 0: training step 1271 done (global step: 2496) | |
1681061782.825042: Worker 0: training step 1272 done (global step: 2499) | |
1681061782.831103: Worker 0: training step 1273 done (global step: 2501) | |
1681061782.837198: Worker 0: training step 1274 done (global step: 2503) | |
1681061782.843145: Worker 0: training step 1275 done (global step: 2505) | |
1681061782.849417: Worker 0: training step 1276 done (global step: 2507) | |
1681061782.855435: Worker 0: training step 1277 done (global step: 2509) | |
1681061782.860653: Worker 0: training step 1278 done (global step: 2512) | |
1681061782.866685: Worker 0: training step 1279 done (global step: 2514) | |
1681061782.872203: Worker 0: training step 1280 done (global step: 2516) | |
1681061782.877667: Worker 0: training step 1281 done (global step: 2518) | |
1681061782.882715: Worker 0: training step 1282 done (global step: 2520) | |
1681061782.888895: Worker 0: training step 1283 done (global step: 2521) | |
1681061782.895354: Worker 0: training step 1284 done (global step: 2523) | |
1681061782.900853: Worker 0: training step 1285 done (global step: 2526) | |
1681061782.906427: Worker 0: training step 1286 done (global step: 2528) | |
1681061782.911636: Worker 0: training step 1287 done (global step: 2530) | |
1681061782.916888: Worker 0: training step 1288 done (global step: 2532) | |
1681061782.922921: Worker 0: training step 1289 done (global step: 2534) | |
1681061782.927988: Worker 0: training step 1290 done (global step: 2536) | |
1681061782.933364: Worker 0: training step 1291 done (global step: 2538) | |
1681061782.938667: Worker 0: training step 1292 done (global step: 2540) | |
1681061782.944471: Worker 0: training step 1293 done (global step: 2542) | |
1681061782.950287: Worker 0: training step 1294 done (global step: 2544) | |
1681061782.955734: Worker 0: training step 1295 done (global step: 2546) | |
1681061782.960979: Worker 0: training step 1296 done (global step: 2548) | |
1681061782.966191: Worker 0: training step 1297 done (global step: 2550) | |
1681061782.972367: Worker 0: training step 1298 done (global step: 2552) | |
1681061782.978283: Worker 0: training step 1299 done (global step: 2554) | |
1681061782.984229: Worker 0: training step 1300 done (global step: 2556) | |
1681061782.991027: Worker 0: training step 1301 done (global step: 2558) | |
1681061782.996552: Worker 0: training step 1302 done (global step: 2561) | |
1681061783.001478: Worker 0: training step 1303 done (global step: 2562) | |
1681061783.008924: Worker 0: training step 1304 done (global step: 2564) | |
1681061783.015002: Worker 0: training step 1305 done (global step: 2567) | |
1681061783.020040: Worker 0: training step 1306 done (global step: 2569) | |
1681061783.025508: Worker 0: training step 1307 done (global step: 2570) | |
1681061783.031332: Worker 0: training step 1308 done (global step: 2572) | |
1681061783.037570: Worker 0: training step 1309 done (global step: 2574) | |
1681061783.043662: Worker 0: training step 1310 done (global step: 2576) | |
1681061783.049178: Worker 0: training step 1311 done (global step: 2579) | |
1681061783.053874: Worker 0: training step 1312 done (global step: 2580) | |
1681061783.060141: Worker 0: training step 1313 done (global step: 2582) | |
1681061783.066578: Worker 0: training step 1314 done (global step: 2584) | |
1681061783.071771: Worker 0: training step 1315 done (global step: 2586) | |
1681061783.076943: Worker 0: training step 1316 done (global step: 2588) | |
1681061783.082915: Worker 0: training step 1317 done (global step: 2590) | |
1681061783.088674: Worker 0: training step 1318 done (global step: 2592) | |
1681061783.094774: Worker 0: training step 1319 done (global step: 2594) | |
1681061783.099783: Worker 0: training step 1320 done (global step: 2596) | |
1681061783.105721: Worker 0: training step 1321 done (global step: 2598) | |
1681061783.110548: Worker 0: training step 1322 done (global step: 2600) | |
1681061783.115742: Worker 0: training step 1323 done (global step: 2602) | |
1681061783.121075: Worker 0: training step 1324 done (global step: 2604) | |
1681061783.126680: Worker 0: training step 1325 done (global step: 2606) | |
1681061783.131705: Worker 0: training step 1326 done (global step: 2608) | |
1681061783.137715: Worker 0: training step 1327 done (global step: 2610) | |
1681061783.143252: Worker 0: training step 1328 done (global step: 2612) | |
1681061783.148596: Worker 0: training step 1329 done (global step: 2614) | |
1681061783.154355: Worker 0: training step 1330 done (global step: 2616) | |
1681061783.160770: Worker 0: training step 1331 done (global step: 2618) | |
1681061783.166234: Worker 0: training step 1332 done (global step: 2620) | |
1681061783.171490: Worker 0: training step 1333 done (global step: 2622) | |
1681061783.176837: Worker 0: training step 1334 done (global step: 2624) | |
1681061783.182951: Worker 0: training step 1335 done (global step: 2626) | |
1681061783.188533: Worker 0: training step 1336 done (global step: 2628) | |
1681061783.194405: Worker 0: training step 1337 done (global step: 2630) | |
1681061783.199847: Worker 0: training step 1338 done (global step: 2632) | |
1681061783.205031: Worker 0: training step 1339 done (global step: 2634) | |
1681061783.210889: Worker 0: training step 1340 done (global step: 2636) | |
1681061783.216094: Worker 0: training step 1341 done (global step: 2638) | |
1681061783.222230: Worker 0: training step 1342 done (global step: 2640) | |
1681061783.229111: Worker 0: training step 1343 done (global step: 2642) | |
1681061783.235409: Worker 0: training step 1344 done (global step: 2644) | |
1681061783.241068: Worker 0: training step 1345 done (global step: 2646) | |
1681061783.247543: Worker 0: training step 1346 done (global step: 2649) | |
1681061783.253492: Worker 0: training step 1347 done (global step: 2651) | |
1681061783.259075: Worker 0: training step 1348 done (global step: 2653) | |
1681061783.264519: Worker 0: training step 1349 done (global step: 2655) | |
1681061783.270010: Worker 0: training step 1350 done (global step: 2657) | |
1681061783.275391: Worker 0: training step 1351 done (global step: 2659) | |
1681061783.281561: Worker 0: training step 1352 done (global step: 2661) | |
1681061783.287058: Worker 0: training step 1353 done (global step: 2663) | |
1681061783.292384: Worker 0: training step 1354 done (global step: 2665) | |
1681061783.297895: Worker 0: training step 1355 done (global step: 2667) | |
1681061783.304160: Worker 0: training step 1356 done (global step: 2669) | |
1681061783.311879: Worker 0: training step 1357 done (global step: 2671) | |
1681061783.317359: Worker 0: training step 1358 done (global step: 2673) | |
1681061783.322497: Worker 0: training step 1359 done (global step: 2675) | |
1681061783.327935: Worker 0: training step 1360 done (global step: 2677) | |
1681061783.333278: Worker 0: training step 1361 done (global step: 2678) | |
1681061783.339097: Worker 0: training step 1362 done (global step: 2680) | |
1681061783.345262: Worker 0: training step 1363 done (global step: 2682) | |
1681061783.350578: Worker 0: training step 1364 done (global step: 2685) | |
1681061783.356278: Worker 0: training step 1365 done (global step: 2687) | |
1681061783.361287: Worker 0: training step 1366 done (global step: 2689) | |
1681061783.366715: Worker 0: training step 1367 done (global step: 2691) | |
1681061783.372225: Worker 0: training step 1368 done (global step: 2693) | |
1681061783.378167: Worker 0: training step 1369 done (global step: 2695) | |
1681061783.383488: Worker 0: training step 1370 done (global step: 2697) | |
1681061783.389050: Worker 0: training step 1371 done (global step: 2699) | |
1681061783.396436: Worker 0: training step 1372 done (global step: 2701) | |
1681061783.402096: Worker 0: training step 1373 done (global step: 2703) | |
1681061783.407387: Worker 0: training step 1374 done (global step: 2705) | |
1681061783.413198: Worker 0: training step 1375 done (global step: 2707) | |
1681061783.418278: Worker 0: training step 1376 done (global step: 2709) | |
1681061783.423502: Worker 0: training step 1377 done (global step: 2711) | |
1681061783.429347: Worker 0: training step 1378 done (global step: 2713) | |
1681061783.434712: Worker 0: training step 1379 done (global step: 2715) | |
1681061783.440447: Worker 0: training step 1380 done (global step: 2717) | |
1681061783.446972: Worker 0: training step 1381 done (global step: 2719) | |
1681061783.451452: Worker 0: training step 1382 done (global step: 2721) | |
1681061783.458198: Worker 0: training step 1383 done (global step: 2723) | |
1681061783.463494: Worker 0: training step 1384 done (global step: 2725) | |
1681061783.467813: Worker 0: training step 1385 done (global step: 2726) | |
1681061783.474043: Worker 0: training step 1386 done (global step: 2728) | |
1681061783.479095: Worker 0: training step 1387 done (global step: 2730) | |
1681061783.484744: Worker 0: training step 1388 done (global step: 2732) | |
1681061783.490749: Worker 0: training step 1389 done (global step: 2734) | |
1681061783.496178: Worker 0: training step 1390 done (global step: 2736) | |
1681061783.501571: Worker 0: training step 1391 done (global step: 2738) | |
1681061783.507449: Worker 0: training step 1392 done (global step: 2740) | |
1681061783.513276: Worker 0: training step 1393 done (global step: 2742) | |
1681061783.519120: Worker 0: training step 1394 done (global step: 2744) | |
1681061783.524196: Worker 0: training step 1395 done (global step: 2746) | |
1681061783.530515: Worker 0: training step 1396 done (global step: 2748) | |
1681061783.536453: Worker 0: training step 1397 done (global step: 2750) | |
1681061783.542307: Worker 0: training step 1398 done (global step: 2752) | |
1681061783.547599: Worker 0: training step 1399 done (global step: 2754) | |
1681061783.552942: Worker 0: training step 1400 done (global step: 2756) | |
1681061783.557914: Worker 0: training step 1401 done (global step: 2758) | |
1681061783.562915: Worker 0: training step 1402 done (global step: 2760) | |
1681061783.567927: Worker 0: training step 1403 done (global step: 2762) | |
1681061783.573257: Worker 0: training step 1404 done (global step: 2764) | |
1681061783.579186: Worker 0: training step 1405 done (global step: 2766) | |
1681061783.584629: Worker 0: training step 1406 done (global step: 2768) | |
1681061783.590697: Worker 0: training step 1407 done (global step: 2770) | |
1681061783.596371: Worker 0: training step 1408 done (global step: 2772) | |
1681061783.601638: Worker 0: training step 1409 done (global step: 2774) | |
1681061783.607358: Worker 0: training step 1410 done (global step: 2776) | |
1681061783.613801: Worker 0: training step 1411 done (global step: 2778) | |
1681061783.620562: Worker 0: training step 1412 done (global step: 2780) | |
1681061783.626645: Worker 0: training step 1413 done (global step: 2782) | |
1681061783.631428: Worker 0: training step 1414 done (global step: 2785) | |
1681061783.637898: Worker 0: training step 1415 done (global step: 2786) | |
1681061783.644066: Worker 0: training step 1416 done (global step: 2789) | |
1681061783.650267: Worker 0: training step 1417 done (global step: 2790) | |
1681061783.655136: Worker 0: training step 1418 done (global step: 2792) | |
1681061783.660816: Worker 0: training step 1419 done (global step: 2794) | |
1681061783.667325: Worker 0: training step 1420 done (global step: 2797) | |
1681061783.672950: Worker 0: training step 1421 done (global step: 2799) | |
1681061783.679341: Worker 0: training step 1422 done (global step: 2801) | |
1681061783.685694: Worker 0: training step 1423 done (global step: 2803) | |
1681061783.692204: Worker 0: training step 1424 done (global step: 2805) | |
1681061783.697732: Worker 0: training step 1425 done (global step: 2807) | |
1681061783.703058: Worker 0: training step 1426 done (global step: 2810) | |
1681061783.709286: Worker 0: training step 1427 done (global step: 2812) | |
1681061783.715931: Worker 0: training step 1428 done (global step: 2813) | |
1681061783.722172: Worker 0: training step 1429 done (global step: 2816) | |
1681061783.727811: Worker 0: training step 1430 done (global step: 2818) | |
1681061783.732864: Worker 0: training step 1431 done (global step: 2820) | |
1681061783.739807: Worker 0: training step 1432 done (global step: 2822) | |
1681061783.744932: Worker 0: training step 1433 done (global step: 2824) | |
1681061783.751326: Worker 0: training step 1434 done (global step: 2826) | |
1681061783.757233: Worker 0: training step 1435 done (global step: 2828) | |
1681061783.762134: Worker 0: training step 1436 done (global step: 2830) | |
1681061783.767105: Worker 0: training step 1437 done (global step: 2832) | |
1681061783.772374: Worker 0: training step 1438 done (global step: 2834) | |
1681061783.777405: Worker 0: training step 1439 done (global step: 2836) | |
1681061783.782106: Worker 0: training step 1440 done (global step: 2838) | |
1681061783.788028: Worker 0: training step 1441 done (global step: 2839) | |
1681061783.793289: Worker 0: training step 1442 done (global step: 2842) | |
1681061783.799584: Worker 0: training step 1443 done (global step: 2843) | |
1681061783.812557: Worker 0: training step 1444 done (global step: 2845) | |
1681061783.820403: Worker 0: training step 1445 done (global step: 2848) | |
1681061783.826965: Worker 0: training step 1446 done (global step: 2850) | |
1681061783.832409: Worker 0: training step 1447 done (global step: 2852) | |
1681061783.837909: Worker 0: training step 1448 done (global step: 2854) | |
1681061783.843052: Worker 0: training step 1449 done (global step: 2856) | |
1681061783.848362: Worker 0: training step 1450 done (global step: 2858) | |
1681061783.854132: Worker 0: training step 1451 done (global step: 2860) | |
1681061783.859785: Worker 0: training step 1452 done (global step: 2862) | |
1681061783.864479: Worker 0: training step 1453 done (global step: 2864) | |
1681061783.871029: Worker 0: training step 1454 done (global step: 2865) | |
1681061783.876955: Worker 0: training step 1455 done (global step: 2868) | |
1681061783.882470: Worker 0: training step 1456 done (global step: 2870) | |
1681061783.888948: Worker 0: training step 1457 done (global step: 2872) | |
1681061783.896984: Worker 0: training step 1458 done (global step: 2874) | |
1681061783.904074: Worker 0: training step 1459 done (global step: 2876) | |
1681061783.909772: Worker 0: training step 1460 done (global step: 2878) | |
1681061783.915107: Worker 0: training step 1461 done (global step: 2880) | |
1681061783.921018: Worker 0: training step 1462 done (global step: 2882) | |
1681061783.927501: Worker 0: training step 1463 done (global step: 2884) | |
1681061783.932581: Worker 0: training step 1464 done (global step: 2886) | |
1681061783.938320: Worker 0: training step 1465 done (global step: 2888) | |
1681061783.943354: Worker 0: training step 1466 done (global step: 2890) | |
1681061783.948981: Worker 0: training step 1467 done (global step: 2892) | |
1681061783.954536: Worker 0: training step 1468 done (global step: 2894) | |
1681061783.960201: Worker 0: training step 1469 done (global step: 2896) | |
1681061783.966020: Worker 0: training step 1470 done (global step: 2898) | |
1681061783.970930: Worker 0: training step 1471 done (global step: 2900) | |
1681061783.978154: Worker 0: training step 1472 done (global step: 2902) | |
1681061783.984196: Worker 0: training step 1473 done (global step: 2904) | |
1681061783.989854: Worker 0: training step 1474 done (global step: 2905) | |
1681061783.997215: Worker 0: training step 1475 done (global step: 2907) | |
1681061784.003603: Worker 0: training step 1476 done (global step: 2910) | |
1681061784.008462: Worker 0: training step 1477 done (global step: 2912) | |
1681061784.013201: Worker 0: training step 1478 done (global step: 2913) | |
1681061784.019966: Worker 0: training step 1479 done (global step: 2915) | |
1681061784.025655: Worker 0: training step 1480 done (global step: 2918) | |
1681061784.031730: Worker 0: training step 1481 done (global step: 2920) | |
1681061784.038146: Worker 0: training step 1482 done (global step: 2922) | |
1681061784.044246: Worker 0: training step 1483 done (global step: 2924) | |
1681061784.051324: Worker 0: training step 1484 done (global step: 2926) | |
1681061784.056696: Worker 0: training step 1485 done (global step: 2928) | |
1681061784.062224: Worker 0: training step 1486 done (global step: 2930) | |
1681061784.068294: Worker 0: training step 1487 done (global step: 2932) | |
1681061784.074913: Worker 0: training step 1488 done (global step: 2934) | |
1681061784.080497: Worker 0: training step 1489 done (global step: 2936) | |
1681061784.085665: Worker 0: training step 1490 done (global step: 2938) | |
1681061784.091150: Worker 0: training step 1491 done (global step: 2940) | |
1681061784.096533: Worker 0: training step 1492 done (global step: 2942) | |
1681061784.102663: Worker 0: training step 1493 done (global step: 2944) | |
1681061784.109324: Worker 0: training step 1494 done (global step: 2946) | |
1681061784.120424: Worker 0: training step 1495 done (global step: 2949) | |
1681061784.127344: Worker 0: training step 1496 done (global step: 2951) | |
1681061784.133594: Worker 0: training step 1497 done (global step: 2953) | |
1681061784.141515: Worker 0: training step 1498 done (global step: 2955) | |
1681061784.146168: Worker 0: training step 1499 done (global step: 2956) | |
1681061784.152149: Worker 0: training step 1500 done (global step: 2958) | |
1681061784.157442: Worker 0: training step 1501 done (global step: 2960) | |
1681061784.162494: Worker 0: training step 1502 done (global step: 2962) | |
1681061784.168572: Worker 0: training step 1503 done (global step: 2964) | |
1681061784.173651: Worker 0: training step 1504 done (global step: 2966) | |
1681061784.179405: Worker 0: training step 1505 done (global step: 2968) | |
1681061784.185474: Worker 0: training step 1506 done (global step: 2970) | |
1681061784.190545: Worker 0: training step 1507 done (global step: 2972) | |
1681061784.195440: Worker 0: training step 1508 done (global step: 2974) | |
1681061784.200989: Worker 0: training step 1509 done (global step: 2976) | |
1681061784.206772: Worker 0: training step 1510 done (global step: 2978) | |
1681061784.211307: Worker 0: training step 1511 done (global step: 2980) | |
1681061784.217054: Worker 0: training step 1512 done (global step: 2981) | |
1681061784.223599: Worker 0: training step 1513 done (global step: 2983) | |
1681061784.230112: Worker 0: training step 1514 done (global step: 2986) | |
1681061784.236707: Worker 0: training step 1515 done (global step: 2988) | |
1681061784.242428: Worker 0: training step 1516 done (global step: 2990) | |
1681061784.248315: Worker 0: training step 1517 done (global step: 2992) | |
1681061784.254259: Worker 0: training step 1518 done (global step: 2994) | |
1681061784.260991: Worker 0: training step 1519 done (global step: 2996) | |
1681061784.267519: Worker 0: training step 1520 done (global step: 2998) | |
1681061784.272785: Worker 0: training step 1521 done (global step: 3000) | |
1681061784.278890: Worker 0: training step 1522 done (global step: 3002) | |
1681061784.283785: Worker 0: training step 1523 done (global step: 3004) | |
1681061784.289553: Worker 0: training step 1524 done (global step: 3006) | |
1681061784.296210: Worker 0: training step 1525 done (global step: 3008) | |
1681061784.304075: Worker 0: training step 1526 done (global step: 3010) | |
1681061784.311144: Worker 0: training step 1527 done (global step: 3013) | |
1681061784.317125: Worker 0: training step 1528 done (global step: 3015) | |
1681061784.322755: Worker 0: training step 1529 done (global step: 3017) | |
1681061784.328401: Worker 0: training step 1530 done (global step: 3019) | |
1681061784.333367: Worker 0: training step 1531 done (global step: 3021) | |
1681061784.338706: Worker 0: training step 1532 done (global step: 3023) | |
1681061784.344809: Worker 0: training step 1533 done (global step: 3025) | |
1681061784.350327: Worker 0: training step 1534 done (global step: 3027) | |
1681061784.355722: Worker 0: training step 1535 done (global step: 3029) | |
1681061784.361489: Worker 0: training step 1536 done (global step: 3031) | |
1681061784.366734: Worker 0: training step 1537 done (global step: 3033) | |
1681061784.372665: Worker 0: training step 1538 done (global step: 3035) | |
1681061784.377752: Worker 0: training step 1539 done (global step: 3037) | |
1681061784.383291: Worker 0: training step 1540 done (global step: 3039) | |
1681061784.388410: Worker 0: training step 1541 done (global step: 3041) | |
1681061784.393860: Worker 0: training step 1542 done (global step: 3043) | |
1681061784.398790: Worker 0: training step 1543 done (global step: 3044) | |
1681061784.404012: Worker 0: training step 1544 done (global step: 3046) | |
1681061784.408867: Worker 0: training step 1545 done (global step: 3048) | |
1681061784.415438: Worker 0: training step 1546 done (global step: 3050) | |
1681061784.420568: Worker 0: training step 1547 done (global step: 3052) | |
1681061784.425768: Worker 0: training step 1548 done (global step: 3054) | |
1681061784.430824: Worker 0: training step 1549 done (global step: 3056) | |
1681061784.436366: Worker 0: training step 1550 done (global step: 3058) | |
1681061784.442322: Worker 0: training step 1551 done (global step: 3060) | |
1681061784.448486: Worker 0: training step 1552 done (global step: 3062) | |
1681061784.453566: Worker 0: training step 1553 done (global step: 3064) | |
1681061784.459270: Worker 0: training step 1554 done (global step: 3066) | |
1681061784.465528: Worker 0: training step 1555 done (global step: 3068) | |
1681061784.472218: Worker 0: training step 1556 done (global step: 3070) | |
1681061784.478316: Worker 0: training step 1557 done (global step: 3072) | |
1681061784.483279: Worker 0: training step 1558 done (global step: 3074) | |
1681061784.488871: Worker 0: training step 1559 done (global step: 3076) | |
1681061784.493995: Worker 0: training step 1560 done (global step: 3078) | |
1681061784.498734: Worker 0: training step 1561 done (global step: 3079) | |
1681061784.503855: Worker 0: training step 1562 done (global step: 3081) | |
1681061784.509012: Worker 0: training step 1563 done (global step: 3083) | |
1681061784.514844: Worker 0: training step 1564 done (global step: 3085) | |
1681061784.519746: Worker 0: training step 1565 done (global step: 3087) | |
1681061784.525010: Worker 0: training step 1566 done (global step: 3089) | |
1681061784.530571: Worker 0: training step 1567 done (global step: 3091) | |
1681061784.536197: Worker 0: training step 1568 done (global step: 3093) | |
1681061784.541384: Worker 0: training step 1569 done (global step: 3095) | |
1681061784.547728: Worker 0: training step 1570 done (global step: 3097) | |
1681061784.554415: Worker 0: training step 1571 done (global step: 3099) | |
1681061784.559551: Worker 0: training step 1572 done (global step: 3101) | |
1681061784.565290: Worker 0: training step 1573 done (global step: 3103) | |
1681061784.571990: Worker 0: training step 1574 done (global step: 3105) | |
1681061784.577270: Worker 0: training step 1575 done (global step: 3107) | |
1681061784.581708: Worker 0: training step 1576 done (global step: 3109) | |
1681061784.588894: Worker 0: training step 1577 done (global step: 3111) | |
1681061784.595148: Worker 0: training step 1578 done (global step: 3113) | |
1681061784.601579: Worker 0: training step 1579 done (global step: 3116) | |
1681061784.607402: Worker 0: training step 1580 done (global step: 3118) | |
1681061784.619110: Worker 0: training step 1581 done (global step: 3120) | |
1681061784.625525: Worker 0: training step 1582 done (global step: 3122) | |
1681061784.630847: Worker 0: training step 1583 done (global step: 3124) | |
1681061784.637941: Worker 0: training step 1584 done (global step: 3126) | |
1681061784.644728: Worker 0: training step 1585 done (global step: 3128) | |
1681061784.652192: Worker 0: training step 1586 done (global step: 3130) | |
1681061784.660505: Worker 0: training step 1587 done (global step: 3132) | |
1681061784.669453: Worker 0: training step 1588 done (global step: 3134) | |
1681061784.676729: Worker 0: training step 1589 done (global step: 3137) | |
1681061784.683803: Worker 0: training step 1590 done (global step: 3139) | |
1681061784.692408: Worker 0: training step 1591 done (global step: 3141) | |
1681061784.698477: Worker 0: training step 1592 done (global step: 3143) | |
1681061784.705146: Worker 0: training step 1593 done (global step: 3145) | |
1681061784.711053: Worker 0: training step 1594 done (global step: 3147) | |
1681061784.717637: Worker 0: training step 1595 done (global step: 3149) | |
1681061784.726418: Worker 0: training step 1596 done (global step: 3150) | |
1681061784.731907: Worker 0: training step 1597 done (global step: 3152) | |
1681061784.737494: Worker 0: training step 1598 done (global step: 3154) | |
1681061784.743856: Worker 0: training step 1599 done (global step: 3156) | |
1681061784.750091: Worker 0: training step 1600 done (global step: 3159) | |
1681061784.756098: Worker 0: training step 1601 done (global step: 3161) | |
1681061784.761231: Worker 0: training step 1602 done (global step: 3163) | |
1681061784.766180: Worker 0: training step 1603 done (global step: 3165) | |
1681061784.772106: Worker 0: training step 1604 done (global step: 3167) | |
1681061784.776872: Worker 0: training step 1605 done (global step: 3169) | |
1681061784.782753: Worker 0: training step 1606 done (global step: 3170) | |
1681061784.788631: Worker 0: training step 1607 done (global step: 3172) | |
1681061784.794466: Worker 0: training step 1608 done (global step: 3175) | |
1681061784.800363: Worker 0: training step 1609 done (global step: 3177) | |
1681061784.808000: Worker 0: training step 1610 done (global step: 3179) | |
1681061784.812922: Worker 0: training step 1611 done (global step: 3181) | |
1681061784.818594: Worker 0: training step 1612 done (global step: 3183) | |
1681061784.825118: Worker 0: training step 1613 done (global step: 3185) | |
1681061784.830783: Worker 0: training step 1614 done (global step: 3187) | |
1681061784.835755: Worker 0: training step 1615 done (global step: 3189) | |
1681061784.841464: Worker 0: training step 1616 done (global step: 3191) | |
1681061784.846947: Worker 0: training step 1617 done (global step: 3193) | |
1681061784.852216: Worker 0: training step 1618 done (global step: 3195) | |
1681061784.857273: Worker 0: training step 1619 done (global step: 3197) | |
1681061784.862519: Worker 0: training step 1620 done (global step: 3199) | |
1681061784.868362: Worker 0: training step 1621 done (global step: 3201) | |
1681061784.873770: Worker 0: training step 1622 done (global step: 3203) | |
1681061784.879227: Worker 0: training step 1623 done (global step: 3205) | |
1681061784.885041: Worker 0: training step 1624 done (global step: 3207) | |
1681061784.890243: Worker 0: training step 1625 done (global step: 3209) | |
1681061784.896122: Worker 0: training step 1626 done (global step: 3211) | |
1681061784.902350: Worker 0: training step 1627 done (global step: 3213) | |
1681061784.909374: Worker 0: training step 1628 done (global step: 3215) | |
1681061784.914667: Worker 0: training step 1629 done (global step: 3217) | |
1681061784.920469: Worker 0: training step 1630 done (global step: 3219) | |
1681061784.926347: Worker 0: training step 1631 done (global step: 3221) | |
1681061784.931183: Worker 0: training step 1632 done (global step: 3224) | |
1681061784.935925: Worker 0: training step 1633 done (global step: 3225) | |
1681061784.941898: Worker 0: training step 1634 done (global step: 3227) | |
1681061784.948123: Worker 0: training step 1635 done (global step: 3229) | |
1681061784.953218: Worker 0: training step 1636 done (global step: 3231) | |
1681061784.958775: Worker 0: training step 1637 done (global step: 3233) | |
1681061784.964145: Worker 0: training step 1638 done (global step: 3235) | |
1681061784.969797: Worker 0: training step 1639 done (global step: 3237) | |
1681061784.975799: Worker 0: training step 1640 done (global step: 3239) | |
1681061784.981096: Worker 0: training step 1641 done (global step: 3241) | |
1681061784.986881: Worker 0: training step 1642 done (global step: 3243) | |
1681061784.992596: Worker 0: training step 1643 done (global step: 3245) | |
1681061784.998119: Worker 0: training step 1644 done (global step: 3247) | |
1681061785.003291: Worker 0: training step 1645 done (global step: 3249) | |
1681061785.009715: Worker 0: training step 1646 done (global step: 3251) | |
1681061785.015389: Worker 0: training step 1647 done (global step: 3253) | |
1681061785.021680: Worker 0: training step 1648 done (global step: 3255) | |
1681061785.027435: Worker 0: training step 1649 done (global step: 3258) | |
1681061785.033152: Worker 0: training step 1650 done (global step: 3260) | |
1681061785.203835: Worker 0: training step 1651 done (global step: 3291) | |
1681061785.208636: Worker 0: training step 1652 done (global step: 3293) | |
1681061785.214276: Worker 0: training step 1653 done (global step: 3295) | |
1681061785.220785: Worker 0: training step 1654 done (global step: 3297) | |
1681061785.226463: Worker 0: training step 1655 done (global step: 3299) | |
1681061785.231535: Worker 0: training step 1656 done (global step: 3301) | |
1681061785.237371: Worker 0: training step 1657 done (global step: 3303) | |
1681061785.242676: Worker 0: training step 1658 done (global step: 3305) | |
1681061785.247242: Worker 0: training step 1659 done (global step: 3307) | |
1681061785.252378: Worker 0: training step 1660 done (global step: 3308) | |
1681061785.262185: Worker 0: training step 1661 done (global step: 3309) | |
1681061785.266635: Worker 0: training step 1662 done (global step: 3310) | |
1681061785.271755: Worker 0: training step 1663 done (global step: 3311) | |
1681061785.276252: Worker 0: training step 1664 done (global step: 3312) | |
1681061785.280940: Worker 0: training step 1665 done (global step: 3313) | |
1681061785.285653: Worker 0: training step 1666 done (global step: 3314) | |
1681061785.289879: Worker 0: training step 1667 done (global step: 3315) | |
1681061785.295077: Worker 0: training step 1668 done (global step: 3316) | |
1681061785.299921: Worker 0: training step 1669 done (global step: 3317) | |
1681061785.306578: Worker 0: training step 1670 done (global step: 3318) | |
1681061785.312673: Worker 0: training step 1671 done (global step: 3319) | |
1681061785.317455: Worker 0: training step 1672 done (global step: 3320) | |
1681061785.321785: Worker 0: training step 1673 done (global step: 3321) | |
1681061785.326380: Worker 0: training step 1674 done (global step: 3322) | |
1681061785.330801: Worker 0: training step 1675 done (global step: 3323) | |
1681061785.335300: Worker 0: training step 1676 done (global step: 3324) | |
1681061785.340210: Worker 0: training step 1677 done (global step: 3325) | |
1681061785.348886: Worker 0: training step 1678 done (global step: 3326) | |
1681061785.353433: Worker 0: training step 1679 done (global step: 3327) | |
1681061785.357706: Worker 0: training step 1680 done (global step: 3328) | |
1681061785.362005: Worker 0: training step 1681 done (global step: 3329) | |
1681061785.366268: Worker 0: training step 1682 done (global step: 3330) | |
1681061785.370382: Worker 0: training step 1683 done (global step: 3331) | |
1681061785.374862: Worker 0: training step 1684 done (global step: 3332) | |
1681061785.379146: Worker 0: training step 1685 done (global step: 3333) | |
1681061785.383197: Worker 0: training step 1686 done (global step: 3334) | |
1681061785.387382: Worker 0: training step 1687 done (global step: 3335) | |
1681061785.391819: Worker 0: training step 1688 done (global step: 3336) | |
1681061785.396324: Worker 0: training step 1689 done (global step: 3337) | |
1681061785.400754: Worker 0: training step 1690 done (global step: 3338) | |
1681061785.408076: Worker 0: training step 1691 done (global step: 3339) | |
1681061785.413648: Worker 0: training step 1692 done (global step: 3341) | |
1681061785.419036: Worker 0: training step 1693 done (global step: 3343) | |
1681061785.425141: Worker 0: training step 1694 done (global step: 3345) | |
1681061785.431068: Worker 0: training step 1695 done (global step: 3347) | |
1681061785.436444: Worker 0: training step 1696 done (global step: 3349) | |
1681061785.442116: Worker 0: training step 1697 done (global step: 3351) | |
1681061785.447886: Worker 0: training step 1698 done (global step: 3353) | |
1681061785.453229: Worker 0: training step 1699 done (global step: 3355) | |
1681061785.458308: Worker 0: training step 1700 done (global step: 3357) | |
1681061785.463448: Worker 0: training step 1701 done (global step: 3359) | |
1681061785.469185: Worker 0: training step 1702 done (global step: 3360) | |
1681061785.475251: Worker 0: training step 1703 done (global step: 3362) | |
1681061785.479902: Worker 0: training step 1704 done (global step: 3365) | |
1681061785.484185: Worker 0: training step 1705 done (global step: 3366) | |
1681061785.488929: Worker 0: training step 1706 done (global step: 3368) | |
1681061785.494317: Worker 0: training step 1707 done (global step: 3370) | |
1681061785.499998: Worker 0: training step 1708 done (global step: 3372) | |
1681061785.505226: Worker 0: training step 1709 done (global step: 3374) | |
1681061785.510596: Worker 0: training step 1710 done (global step: 3376) | |
1681061785.516285: Worker 0: training step 1711 done (global step: 3378) | |
1681061785.521269: Worker 0: training step 1712 done (global step: 3380) | |
1681061785.526901: Worker 0: training step 1713 done (global step: 3382) | |
1681061785.531652: Worker 0: training step 1714 done (global step: 3384) | |
1681061785.536068: Worker 0: training step 1715 done (global step: 3385) | |
1681061785.541731: Worker 0: training step 1716 done (global step: 3387) | |
1681061785.546902: Worker 0: training step 1717 done (global step: 3389) | |
1681061785.551589: Worker 0: training step 1718 done (global step: 3391) | |
1681061785.557221: Worker 0: training step 1719 done (global step: 3393) | |
1681061785.562275: Worker 0: training step 1720 done (global step: 3395) | |
1681061785.568079: Worker 0: training step 1721 done (global step: 3397) | |
1681061785.573181: Worker 0: training step 1722 done (global step: 3399) | |
1681061785.578198: Worker 0: training step 1723 done (global step: 3401) | |
1681061785.584308: Worker 0: training step 1724 done (global step: 3403) | |
1681061785.589428: Worker 0: training step 1725 done (global step: 3405) | |
1681061785.595178: Worker 0: training step 1726 done (global step: 3407) | |
1681061785.601071: Worker 0: training step 1727 done (global step: 3409) | |
1681061785.608449: Worker 0: training step 1728 done (global step: 3411) | |
1681061785.614576: Worker 0: training step 1729 done (global step: 3414) | |
1681061785.619917: Worker 0: training step 1730 done (global step: 3416) | |
1681061785.626600: Worker 0: training step 1731 done (global step: 3418) | |
1681061785.632722: Worker 0: training step 1732 done (global step: 3420) | |
1681061785.637851: Worker 0: training step 1733 done (global step: 3422) | |
1681061785.642735: Worker 0: training step 1734 done (global step: 3424) | |
1681061785.647729: Worker 0: training step 1735 done (global step: 3426) | |
1681061785.653641: Worker 0: training step 1736 done (global step: 3428) | |
1681061785.659731: Worker 0: training step 1737 done (global step: 3430) | |
1681061785.666242: Worker 0: training step 1738 done (global step: 3432) | |
1681061785.671537: Worker 0: training step 1739 done (global step: 3434) | |
1681061785.677446: Worker 0: training step 1740 done (global step: 3436) | |
1681061785.683520: Worker 0: training step 1741 done (global step: 3438) | |
1681061785.689662: Worker 0: training step 1742 done (global step: 3440) | |
1681061785.695508: Worker 0: training step 1743 done (global step: 3443) | |
1681061785.700887: Worker 0: training step 1744 done (global step: 3445) | |
1681061785.706004: Worker 0: training step 1745 done (global step: 3447) | |
1681061785.711582: Worker 0: training step 1746 done (global step: 3449) | |
1681061785.719389: Worker 0: training step 1747 done (global step: 3450) | |
1681061785.725836: Worker 0: training step 1748 done (global step: 3452) | |
1681061785.731081: Worker 0: training step 1749 done (global step: 3455) | |
1681061785.736353: Worker 0: training step 1750 done (global step: 3456) | |
1681061785.742182: Worker 0: training step 1751 done (global step: 3458) | |
1681061785.747107: Worker 0: training step 1752 done (global step: 3461) | |
1681061785.752517: Worker 0: training step 1753 done (global step: 3462) | |
1681061785.759792: Worker 0: training step 1754 done (global step: 3464) | |
1681061785.765876: Worker 0: training step 1755 done (global step: 3467) | |
1681061785.771439: Worker 0: training step 1756 done (global step: 3469) | |
1681061785.776827: Worker 0: training step 1757 done (global step: 3471) | |
1681061785.783113: Worker 0: training step 1758 done (global step: 3473) | |
1681061785.788679: Worker 0: training step 1759 done (global step: 3475) | |
1681061785.794161: Worker 0: training step 1760 done (global step: 3477) | |
1681061785.799721: Worker 0: training step 1761 done (global step: 3479) | |
1681061785.804919: Worker 0: training step 1762 done (global step: 3481) | |
1681061785.810877: Worker 0: training step 1763 done (global step: 3483) | |
1681061785.816204: Worker 0: training step 1764 done (global step: 3485) | |
1681061785.822073: Worker 0: training step 1765 done (global step: 3487) | |
1681061785.828869: Worker 0: training step 1766 done (global step: 3489) | |
1681061785.835671: Worker 0: training step 1767 done (global step: 3491) | |
1681061785.841604: Worker 0: training step 1768 done (global step: 3493) | |
1681061785.846632: Worker 0: training step 1769 done (global step: 3495) | |
1681061785.851911: Worker 0: training step 1770 done (global step: 3496) | |
1681061785.858799: Worker 0: training step 1771 done (global step: 3498) | |
1681061785.863673: Worker 0: training step 1772 done (global step: 3501) | |
1681061785.870199: Worker 0: training step 1773 done (global step: 3503) | |
1681061785.876063: Worker 0: training step 1774 done (global step: 3505) | |
1681061785.882542: Worker 0: training step 1775 done (global step: 3507) | |
1681061785.889482: Worker 0: training step 1776 done (global step: 3509) | |
1681061785.895127: Worker 0: training step 1777 done (global step: 3512) | |
1681061785.901604: Worker 0: training step 1778 done (global step: 3514) | |
1681061785.910060: Worker 0: training step 1779 done (global step: 3516) | |
1681061785.915938: Worker 0: training step 1780 done (global step: 3518) | |
1681061785.922671: Worker 0: training step 1781 done (global step: 3520) | |
1681061785.928677: Worker 0: training step 1782 done (global step: 3522) | |
1681061785.933839: Worker 0: training step 1783 done (global step: 3525) | |
1681061785.939848: Worker 0: training step 1784 done (global step: 3527) | |
1681061785.946022: Worker 0: training step 1785 done (global step: 3529) | |
1681061785.950974: Worker 0: training step 1786 done (global step: 3530) | |
1681061785.956267: Worker 0: training step 1787 done (global step: 3532) | |
1681061785.961938: Worker 0: training step 1788 done (global step: 3534) | |
1681061785.968400: Worker 0: training step 1789 done (global step: 3536) | |
1681061785.973877: Worker 0: training step 1790 done (global step: 3539) | |
1681061785.979078: Worker 0: training step 1791 done (global step: 3540) | |
1681061785.986009: Worker 0: training step 1792 done (global step: 3542) | |
1681061785.993701: Worker 0: training step 1793 done (global step: 3544) | |
1681061786.000219: Worker 0: training step 1794 done (global step: 3546) | |
1681061786.006148: Worker 0: training step 1795 done (global step: 3549) | |
1681061786.012661: Worker 0: training step 1796 done (global step: 3551) | |
1681061786.018169: Worker 0: training step 1797 done (global step: 3553) | |
1681061786.024349: Worker 0: training step 1798 done (global step: 3555) | |
1681061786.030596: Worker 0: training step 1799 done (global step: 3557) | |
1681061786.037104: Worker 0: training step 1800 done (global step: 3559) | |
1681061786.042781: Worker 0: training step 1801 done (global step: 3561) | |
1681061786.047960: Worker 0: training step 1802 done (global step: 3563) | |
1681061786.053495: Worker 0: training step 1803 done (global step: 3565) | |
1681061786.059392: Worker 0: training step 1804 done (global step: 3567) | |
1681061786.065129: Worker 0: training step 1805 done (global step: 3569) | |
1681061786.071814: Worker 0: training step 1806 done (global step: 3571) | |
1681061786.078673: Worker 0: training step 1807 done (global step: 3573) | |
1681061786.083774: Worker 0: training step 1808 done (global step: 3575) | |
1681061786.090485: Worker 0: training step 1809 done (global step: 3577) | |
1681061786.095731: Worker 0: training step 1810 done (global step: 3579) | |
1681061786.103351: Worker 0: training step 1811 done (global step: 3581) | |
1681061786.111521: Worker 0: training step 1812 done (global step: 3584) | |
1681061786.117498: Worker 0: training step 1813 done (global step: 3586) | |
1681061786.123570: Worker 0: training step 1814 done (global step: 3588) | |
1681061786.129431: Worker 0: training step 1815 done (global step: 3590) | |
1681061786.135435: Worker 0: training step 1816 done (global step: 3592) | |
1681061786.141963: Worker 0: training step 1817 done (global step: 3594) | |
1681061786.147893: Worker 0: training step 1818 done (global step: 3596) | |
1681061786.154929: Worker 0: training step 1819 done (global step: 3598) | |
1681061786.161591: Worker 0: training step 1820 done (global step: 3600) | |
1681061786.167045: Worker 0: training step 1821 done (global step: 3602) | |
1681061786.172681: Worker 0: training step 1822 done (global step: 3604) | |
1681061786.178683: Worker 0: training step 1823 done (global step: 3606) | |
1681061786.184442: Worker 0: training step 1824 done (global step: 3608) | |
1681061786.190099: Worker 0: training step 1825 done (global step: 3610) | |
1681061786.195486: Worker 0: training step 1826 done (global step: 3612) | |
1681061786.201449: Worker 0: training step 1827 done (global step: 3614) | |
1681061786.207185: Worker 0: training step 1828 done (global step: 3616) | |
1681061786.214380: Worker 0: training step 1829 done (global step: 3618) | |
1681061786.219817: Worker 0: training step 1830 done (global step: 3621) | |
1681061786.224525: Worker 0: training step 1831 done (global step: 3622) | |
1681061786.229853: Worker 0: training step 1832 done (global step: 3624) | |
1681061786.234499: Worker 0: training step 1833 done (global step: 3626) | |
1681061786.240313: Worker 0: training step 1834 done (global step: 3628) | |
1681061786.245388: Worker 0: training step 1835 done (global step: 3630) | |
1681061786.251440: Worker 0: training step 1836 done (global step: 3632) | |
1681061786.257539: Worker 0: training step 1837 done (global step: 3634) | |
1681061786.263220: Worker 0: training step 1838 done (global step: 3636) | |
1681061786.268757: Worker 0: training step 1839 done (global step: 3638) | |
1681061786.274154: Worker 0: training step 1840 done (global step: 3640) | |
1681061786.279049: Worker 0: training step 1841 done (global step: 3642) | |
1681061786.284755: Worker 0: training step 1842 done (global step: 3643) | |
1681061786.289771: Worker 0: training step 1843 done (global step: 3645) | |
1681061786.295281: Worker 0: training step 1844 done (global step: 3647) | |
1681061786.300353: Worker 0: training step 1845 done (global step: 3649) | |
1681061786.306045: Worker 0: training step 1846 done (global step: 3651) | |
1681061786.313195: Worker 0: training step 1847 done (global step: 3653) | |
1681061786.319564: Worker 0: training step 1848 done (global step: 3655) | |
1681061786.325226: Worker 0: training step 1849 done (global step: 3657) | |
1681061786.330934: Worker 0: training step 1850 done (global step: 3659) | |
1681061786.336262: Worker 0: training step 1851 done (global step: 3661) | |
1681061786.341786: Worker 0: training step 1852 done (global step: 3663) | |
1681061786.347294: Worker 0: training step 1853 done (global step: 3665) | |
1681061786.352273: Worker 0: training step 1854 done (global step: 3667) | |
1681061786.357560: Worker 0: training step 1855 done (global step: 3669) | |
1681061786.363111: Worker 0: training step 1856 done (global step: 3671) | |
1681061786.368918: Worker 0: training step 1857 done (global step: 3673) | |
1681061786.375222: Worker 0: training step 1858 done (global step: 3675) | |
1681061786.380185: Worker 0: training step 1859 done (global step: 3677) | |
1681061786.385441: Worker 0: training step 1860 done (global step: 3679) | |
1681061786.391804: Worker 0: training step 1861 done (global step: 3681) | |
1681061786.396971: Worker 0: training step 1862 done (global step: 3683) | |
1681061786.402695: Worker 0: training step 1863 done (global step: 3684) | |
1681061786.408404: Worker 0: training step 1864 done (global step: 3686) | |
1681061786.413648: Worker 0: training step 1865 done (global step: 3688) | |
1681061786.420669: Worker 0: training step 1866 done (global step: 3690) | |
1681061786.426215: Worker 0: training step 1867 done (global step: 3693) | |
1681061786.431834: Worker 0: training step 1868 done (global step: 3695) | |
1681061786.438159: Worker 0: training step 1869 done (global step: 3697) | |
1681061786.443788: Worker 0: training step 1870 done (global step: 3699) | |
1681061786.450061: Worker 0: training step 1871 done (global step: 3701) | |
1681061786.456395: Worker 0: training step 1872 done (global step: 3703) | |
1681061786.463260: Worker 0: training step 1873 done (global step: 3705) | |
1681061786.471156: Worker 0: training step 1874 done (global step: 3707) | |
1681061786.477570: Worker 0: training step 1875 done (global step: 3709) | |
1681061786.482871: Worker 0: training step 1876 done (global step: 3711) | |
1681061786.488495: Worker 0: training step 1877 done (global step: 3713) | |
1681061786.494276: Worker 0: training step 1878 done (global step: 3716) | |
1681061786.500005: Worker 0: training step 1879 done (global step: 3717) | |
1681061786.505297: Worker 0: training step 1880 done (global step: 3719) | |
1681061786.511037: Worker 0: training step 1881 done (global step: 3721) | |
1681061786.516255: Worker 0: training step 1882 done (global step: 3723) | |
1681061786.521292: Worker 0: training step 1883 done (global step: 3725) | |
1681061786.527414: Worker 0: training step 1884 done (global step: 3727) | |
1681061786.533487: Worker 0: training step 1885 done (global step: 3729) | |
1681061786.538783: Worker 0: training step 1886 done (global step: 3731) | |
1681061786.543963: Worker 0: training step 1887 done (global step: 3733) | |
1681061786.549363: Worker 0: training step 1888 done (global step: 3735) | |
1681061786.554424: Worker 0: training step 1889 done (global step: 3737) | |
1681061786.560562: Worker 0: training step 1890 done (global step: 3739) | |
1681061786.566821: Worker 0: training step 1891 done (global step: 3741) | |
1681061786.572273: Worker 0: training step 1892 done (global step: 3743) | |
1681061786.577830: Worker 0: training step 1893 done (global step: 3745) | |
1681061786.583007: Worker 0: training step 1894 done (global step: 3747) | |
1681061786.588463: Worker 0: training step 1895 done (global step: 3749) | |
1681061786.593871: Worker 0: training step 1896 done (global step: 3751) | |
1681061786.598998: Worker 0: training step 1897 done (global step: 3753) | |
1681061786.605163: Worker 0: training step 1898 done (global step: 3755) | |
1681061786.610940: Worker 0: training step 1899 done (global step: 3757) | |
1681061786.616893: Worker 0: training step 1900 done (global step: 3759) | |
1681061786.622866: Worker 0: training step 1901 done (global step: 3761) | |
1681061786.628469: Worker 0: training step 1902 done (global step: 3763) | |
1681061786.634881: Worker 0: training step 1903 done (global step: 3765) | |
1681061786.640816: Worker 0: training step 1904 done (global step: 3767) | |
1681061786.646298: Worker 0: training step 1905 done (global step: 3769) | |
1681061786.651508: Worker 0: training step 1906 done (global step: 3771) | |
1681061786.656872: Worker 0: training step 1907 done (global step: 3773) | |
1681061786.662416: Worker 0: training step 1908 done (global step: 3775) | |
1681061786.668062: Worker 0: training step 1909 done (global step: 3777) | |
1681061786.673772: Worker 0: training step 1910 done (global step: 3779) | |
1681061786.679712: Worker 0: training step 1911 done (global step: 3781) | |
1681061786.685874: Worker 0: training step 1912 done (global step: 3783) | |
1681061786.691176: Worker 0: training step 1913 done (global step: 3785) | |
1681061786.696731: Worker 0: training step 1914 done (global step: 3787) | |
1681061786.702535: Worker 0: training step 1915 done (global step: 3789) | |
1681061786.707323: Worker 0: training step 1916 done (global step: 3791) | |
1681061786.712107: Worker 0: training step 1917 done (global step: 3792) | |
1681061786.717290: Worker 0: training step 1918 done (global step: 3794) | |
1681061786.722869: Worker 0: training step 1919 done (global step: 3796) | |
1681061786.728138: Worker 0: training step 1920 done (global step: 3798) | |
1681061786.733751: Worker 0: training step 1921 done (global step: 3800) | |
1681061786.738928: Worker 0: training step 1922 done (global step: 3802) | |
1681061786.744947: Worker 0: training step 1923 done (global step: 3804) | |
1681061786.750194: Worker 0: training step 1924 done (global step: 3806) | |
1681061786.757154: Worker 0: training step 1925 done (global step: 3808) | |
1681061786.763083: Worker 0: training step 1926 done (global step: 3810) | |
1681061786.768250: Worker 0: training step 1927 done (global step: 3812) | |
1681061786.772953: Worker 0: training step 1928 done (global step: 3814) | |
1681061786.778390: Worker 0: training step 1929 done (global step: 3815) | |
1681061786.784369: Worker 0: training step 1930 done (global step: 3817) | |
1681061786.789298: Worker 0: training step 1931 done (global step: 3819) | |
1681061786.794577: Worker 0: training step 1932 done (global step: 3821) | |
1681061786.800724: Worker 0: training step 1933 done (global step: 3823) | |
1681061786.806164: Worker 0: training step 1934 done (global step: 3825) | |
1681061786.811383: Worker 0: training step 1935 done (global step: 3827) | |
1681061786.816979: Worker 0: training step 1936 done (global step: 3829) | |
1681061786.821871: Worker 0: training step 1937 done (global step: 3830) | |
1681061786.827868: Worker 0: training step 1938 done (global step: 3833) | |
1681061786.834004: Worker 0: training step 1939 done (global step: 3835) | |
1681061786.839248: Worker 0: training step 1940 done (global step: 3837) | |
1681061786.844661: Worker 0: training step 1941 done (global step: 3839) | |
1681061786.850032: Worker 0: training step 1942 done (global step: 3840) | |
1681061786.855067: Worker 0: training step 1943 done (global step: 3842) | |
1681061786.860471: Worker 0: training step 1944 done (global step: 3844) | |
1681061786.865963: Worker 0: training step 1945 done (global step: 3846) | |
1681061786.871165: Worker 0: training step 1946 done (global step: 3848) | |
1681061786.876839: Worker 0: training step 1947 done (global step: 3850) | |
1681061786.882826: Worker 0: training step 1948 done (global step: 3852) | |
1681061786.887957: Worker 0: training step 1949 done (global step: 3854) | |
1681061786.894295: Worker 0: training step 1950 done (global step: 3856) | |
1681061786.900586: Worker 0: training step 1951 done (global step: 3858) | |
1681061786.907026: Worker 0: training step 1952 done (global step: 3860) | |
1681061786.913584: Worker 0: training step 1953 done (global step: 3863) | |
1681061786.918360: Worker 0: training step 1954 done (global step: 3865) | |
1681061786.923373: Worker 0: training step 1955 done (global step: 3866) | |
1681061786.929250: Worker 0: training step 1956 done (global step: 3868) | |
1681061786.933595: Worker 0: training step 1957 done (global step: 3870) | |
1681061786.939470: Worker 0: training step 1958 done (global step: 3872) | |
1681061786.944269: Worker 0: training step 1959 done (global step: 3874) | |
1681061786.949590: Worker 0: training step 1960 done (global step: 3876) | |
1681061786.954991: Worker 0: training step 1961 done (global step: 3878) | |
1681061786.960585: Worker 0: training step 1962 done (global step: 3880) | |
1681061786.966196: Worker 0: training step 1963 done (global step: 3882) | |
1681061786.971441: Worker 0: training step 1964 done (global step: 3884) | |
1681061786.976829: Worker 0: training step 1965 done (global step: 3886) | |
1681061786.981797: Worker 0: training step 1966 done (global step: 3887) | |
1681061786.987101: Worker 0: training step 1967 done (global step: 3889) | |
1681061786.992257: Worker 0: training step 1968 done (global step: 3891) | |
1681061786.998579: Worker 0: training step 1969 done (global step: 3893) | |
1681061787.004040: Worker 0: training step 1970 done (global step: 3895) | |
1681061787.009708: Worker 0: training step 1971 done (global step: 3897) | |
1681061787.014903: Worker 0: training step 1972 done (global step: 3899) | |
1681061787.021699: Worker 0: training step 1973 done (global step: 3901) | |
1681061787.027760: Worker 0: training step 1974 done (global step: 3903) | |
1681061787.032921: Worker 0: training step 1975 done (global step: 3905) | |
1681061787.038321: Worker 0: training step 1976 done (global step: 3907) | |
1681061787.042881: Worker 0: training step 1977 done (global step: 3909) | |
1681061787.048287: Worker 0: training step 1978 done (global step: 3911) | |
1681061787.054233: Worker 0: training step 1979 done (global step: 3913) | |
1681061787.059097: Worker 0: training step 1980 done (global step: 3915) | |
1681061787.064506: Worker 0: training step 1981 done (global step: 3917) | |
1681061787.070302: Worker 0: training step 1982 done (global step: 3919) | |
1681061787.076663: Worker 0: training step 1983 done (global step: 3921) | |
1681061787.081567: Worker 0: training step 1984 done (global step: 3923) | |
1681061787.086563: Worker 0: training step 1985 done (global step: 3924) | |
1681061787.091833: Worker 0: training step 1986 done (global step: 3926) | |
1681061787.098109: Worker 0: training step 1987 done (global step: 3928) | |
1681061787.104475: Worker 0: training step 1988 done (global step: 3930) | |
1681061787.110433: Worker 0: training step 1989 done (global step: 3931) | |
1681061787.115491: Worker 0: training step 1990 done (global step: 3933) | |
1681061787.120785: Worker 0: training step 1991 done (global step: 3935) | |
1681061787.126953: Worker 0: training step 1992 done (global step: 3937) | |
1681061787.133036: Worker 0: training step 1993 done (global step: 3939) | |
1681061787.137920: Worker 0: training step 1994 done (global step: 3941) | |
1681061787.143378: Worker 0: training step 1995 done (global step: 3943) | |
1681061787.149498: Worker 0: training step 1996 done (global step: 3945) | |
1681061787.154438: Worker 0: training step 1997 done (global step: 3947) | |
1681061787.159728: Worker 0: training step 1998 done (global step: 3949) | |
1681061787.166024: Worker 0: training step 1999 done (global step: 3951) | |
1681061787.170681: Worker 0: training step 2000 done (global step: 3953) | |
1681061787.176512: Worker 0: training step 2001 done (global step: 3955) | |
1681061787.182519: Worker 0: training step 2002 done (global step: 3957) | |
1681061787.187965: Worker 0: training step 2003 done (global step: 3959) | |
1681061787.193568: Worker 0: training step 2004 done (global step: 3961) | |
1681061787.199866: Worker 0: training step 2005 done (global step: 3963) | |
1681061787.205579: Worker 0: training step 2006 done (global step: 3965) | |
1681061787.211447: Worker 0: training step 2007 done (global step: 3967) | |
1681061787.217021: Worker 0: training step 2008 done (global step: 3969) | |
1681061787.222898: Worker 0: training step 2009 done (global step: 3971) | |
1681061787.228519: Worker 0: training step 2010 done (global step: 3973) | |
1681061787.233753: Worker 0: training step 2011 done (global step: 3975) | |
1681061787.239391: Worker 0: training step 2012 done (global step: 3977) | |
1681061787.245257: Worker 0: training step 2013 done (global step: 3979) | |
1681061787.251780: Worker 0: training step 2014 done (global step: 3981) | |
1681061787.259581: Worker 0: training step 2015 done (global step: 3983) | |
1681061787.265664: Worker 0: training step 2016 done (global step: 3986) | |
1681061787.270985: Worker 0: training step 2017 done (global step: 3988) | |
1681061787.277529: Worker 0: training step 2018 done (global step: 3990) | |
1681061787.282856: Worker 0: training step 2019 done (global step: 3992) | |
1681061787.287805: Worker 0: training step 2020 done (global step: 3994) | |
1681061787.293802: Worker 0: training step 2021 done (global step: 3996) | |
1681061787.299131: Worker 0: training step 2022 done (global step: 3998) | |
1681061787.305212: Worker 0: training step 2023 done (global step: 4000) | |
1681061787.312308: Worker 0: training step 2024 done (global step: 4002) | |
1681061787.317774: Worker 0: training step 2025 done (global step: 4004) | |
1681061787.323222: Worker 0: training step 2026 done (global step: 4006) | |
1681061787.328189: Worker 0: training step 2027 done (global step: 4008) | |
1681061787.333594: Worker 0: training step 2028 done (global step: 4010) | |
1681061787.339778: Worker 0: training step 2029 done (global step: 4012) | |
1681061787.344144: Worker 0: training step 2030 done (global step: 4014) | |
1681061787.349753: Worker 0: training step 2031 done (global step: 4015) | |
1681061787.354725: Worker 0: training step 2032 done (global step: 4017) | |
1681061787.360209: Worker 0: training step 2033 done (global step: 4019) | |
1681061787.365963: Worker 0: training step 2034 done (global step: 4021) | |
1681061787.371997: Worker 0: training step 2035 done (global step: 4023) | |
1681061787.378485: Worker 0: training step 2036 done (global step: 4025) | |
1681061787.383648: Worker 0: training step 2037 done (global step: 4027) | |
1681061787.388361: Worker 0: training step 2038 done (global step: 4029) | |
1681061787.394137: Worker 0: training step 2039 done (global step: 4031) | |
1681061787.399599: Worker 0: training step 2040 done (global step: 4033) | |
1681061787.405207: Worker 0: training step 2041 done (global step: 4035) | |
1681061787.410901: Worker 0: training step 2042 done (global step: 4037) | |
1681061787.415986: Worker 0: training step 2043 done (global step: 4039) | |
1681061787.421355: Worker 0: training step 2044 done (global step: 4041) | |
1681061787.426697: Worker 0: training step 2045 done (global step: 4043) | |
1681061787.432425: Worker 0: training step 2046 done (global step: 4045) | |
1681061787.438522: Worker 0: training step 2047 done (global step: 4047) | |
1681061787.444642: Worker 0: training step 2048 done (global step: 4049) | |
1681061787.450012: Worker 0: training step 2049 done (global step: 4051) | |
1681061787.455489: Worker 0: training step 2050 done (global step: 4053) | |
1681061787.460954: Worker 0: training step 2051 done (global step: 4055) | |
1681061787.466283: Worker 0: training step 2052 done (global step: 4057) | |
1681061787.471536: Worker 0: training step 2053 done (global step: 4059) | |
1681061787.476863: Worker 0: training step 2054 done (global step: 4061) | |
1681061787.482355: Worker 0: training step 2055 done (global step: 4063) | |
1681061787.487200: Worker 0: training step 2056 done (global step: 4065) | |
1681061787.494152: Worker 0: training step 2057 done (global step: 4067) | |
1681061787.499526: Worker 0: training step 2058 done (global step: 4069) | |
1681061787.505316: Worker 0: training step 2059 done (global step: 4071) | |
1681061787.511661: Worker 0: training step 2060 done (global step: 4073) | |
1681061787.517989: Worker 0: training step 2061 done (global step: 4075) | |
1681061787.523464: Worker 0: training step 2062 done (global step: 4077) | |
1681061787.528584: Worker 0: training step 2063 done (global step: 4079) | |
1681061787.533391: Worker 0: training step 2064 done (global step: 4081) | |
1681061787.538477: Worker 0: training step 2065 done (global step: 4083) | |
1681061787.544229: Worker 0: training step 2066 done (global step: 4085) | |
1681061787.549497: Worker 0: training step 2067 done (global step: 4087) | |
1681061787.555274: Worker 0: training step 2068 done (global step: 4089) | |
1681061787.560992: Worker 0: training step 2069 done (global step: 4091) | |
1681061787.568115: Worker 0: training step 2070 done (global step: 4093) | |
1681061787.573021: Worker 0: training step 2071 done (global step: 4095) | |
1681061787.578205: Worker 0: training step 2072 done (global step: 4097) | |
1681061787.583193: Worker 0: training step 2073 done (global step: 4099) | |
1681061787.588948: Worker 0: training step 2074 done (global step: 4101) | |
1681061787.594154: Worker 0: training step 2075 done (global step: 4103) | |
1681061787.599860: Worker 0: training step 2076 done (global step: 4105) | |
1681061787.604899: Worker 0: training step 2077 done (global step: 4107) | |
1681061787.609939: Worker 0: training step 2078 done (global step: 4109) | |
1681061787.614977: Worker 0: training step 2079 done (global step: 4111) | |
1681061787.620483: Worker 0: training step 2080 done (global step: 4113) | |
1681061787.628062: Worker 0: training step 2081 done (global step: 4115) | |
1681061787.633329: Worker 0: training step 2082 done (global step: 4117) | |
1681061787.641160: Worker 0: training step 2083 done (global step: 4119) | |
1681061787.646798: Worker 0: training step 2084 done (global step: 4121) | |
1681061787.651963: Worker 0: training step 2085 done (global step: 4123) | |
1681061787.657043: Worker 0: training step 2086 done (global step: 4125) | |
1681061787.662203: Worker 0: training step 2087 done (global step: 4127) | |
1681061787.667999: Worker 0: training step 2088 done (global step: 4129) | |
1681061787.673959: Worker 0: training step 2089 done (global step: 4131) | |
1681061787.681378: Worker 0: training step 2090 done (global step: 4133) | |
1681061787.686041: Worker 0: training step 2091 done (global step: 4136) | |
1681061787.691975: Worker 0: training step 2092 done (global step: 4137) | |
1681061787.698054: Worker 0: training step 2093 done (global step: 4140) | |
1681061787.704398: Worker 0: training step 2094 done (global step: 4142) | |
1681061787.710052: Worker 0: training step 2095 done (global step: 4144) | |
1681061787.715430: Worker 0: training step 2096 done (global step: 4146) | |
1681061787.721865: Worker 0: training step 2097 done (global step: 4148) | |
1681061787.728659: Worker 0: training step 2098 done (global step: 4151) | |
1681061787.734406: Worker 0: training step 2099 done (global step: 4153) | |
1681061787.740351: Worker 0: training step 2100 done (global step: 4155) | |
1681061787.747635: Worker 0: training step 2101 done (global step: 4157) | |
1681061787.753459: Worker 0: training step 2102 done (global step: 4159) | |
1681061787.759993: Worker 0: training step 2103 done (global step: 4161) | |
1681061787.764966: Worker 0: training step 2104 done (global step: 4163) | |
1681061787.770103: Worker 0: training step 2105 done (global step: 4165) | |
1681061787.775156: Worker 0: training step 2106 done (global step: 4167) | |
1681061787.781523: Worker 0: training step 2107 done (global step: 4169) | |
1681061787.787254: Worker 0: training step 2108 done (global step: 4171) | |
1681061787.792934: Worker 0: training step 2109 done (global step: 4174) | |
1681061787.797231: Worker 0: training step 2110 done (global step: 4176) | |
1681061787.802374: Worker 0: training step 2111 done (global step: 4177) | |
1681061787.807995: Worker 0: training step 2112 done (global step: 4179) | |
1681061787.814021: Worker 0: training step 2113 done (global step: 4181) | |
1681061787.818966: Worker 0: training step 2114 done (global step: 4183) | |
1681061787.824849: Worker 0: training step 2115 done (global step: 4185) | |
1681061787.830600: Worker 0: training step 2116 done (global step: 4187) | |
1681061787.835979: Worker 0: training step 2117 done (global step: 4189) | |
1681061787.842204: Worker 0: training step 2118 done (global step: 4191) | |
1681061787.849152: Worker 0: training step 2119 done (global step: 4193) | |
1681061787.856391: Worker 0: training step 2120 done (global step: 4195) | |
1681061787.861949: Worker 0: training step 2121 done (global step: 4197) | |
1681061787.867760: Worker 0: training step 2122 done (global step: 4199) | |
1681061787.873486: Worker 0: training step 2123 done (global step: 4201) | |
1681061787.878425: Worker 0: training step 2124 done (global step: 4203) | |
1681061787.883473: Worker 0: training step 2125 done (global step: 4205) | |
1681061787.888946: Worker 0: training step 2126 done (global step: 4207) | |
1681061787.895122: Worker 0: training step 2127 done (global step: 4209) | |
1681061787.900546: Worker 0: training step 2128 done (global step: 4211) | |
1681061787.905525: Worker 0: training step 2129 done (global step: 4213) | |
1681061787.912567: Worker 0: training step 2130 done (global step: 4215) | |
1681061787.919420: Worker 0: training step 2131 done (global step: 4217) | |
1681061787.924958: Worker 0: training step 2132 done (global step: 4219) | |
1681061787.930434: Worker 0: training step 2133 done (global step: 4221) | |
1681061787.935708: Worker 0: training step 2134 done (global step: 4223) | |
1681061787.940781: Worker 0: training step 2135 done (global step: 4225) | |
1681061787.946829: Worker 0: training step 2136 done (global step: 4227) | |
1681061787.952693: Worker 0: training step 2137 done (global step: 4229) | |
1681061787.958108: Worker 0: training step 2138 done (global step: 4231) | |
1681061787.963710: Worker 0: training step 2139 done (global step: 4233) | |
1681061787.969960: Worker 0: training step 2140 done (global step: 4235) | |
1681061787.974936: Worker 0: training step 2141 done (global step: 4237) | |
1681061787.980330: Worker 0: training step 2142 done (global step: 4239) | |
1681061787.985562: Worker 0: training step 2143 done (global step: 4241) | |
1681061787.990821: Worker 0: training step 2144 done (global step: 4243) | |
1681061787.999019: Worker 0: training step 2145 done (global step: 4245) | |
1681061788.005409: Worker 0: training step 2146 done (global step: 4247) | |
1681061788.011254: Worker 0: training step 2147 done (global step: 4249) | |
1681061788.016320: Worker 0: training step 2148 done (global step: 4251) | |
1681061788.021816: Worker 0: training step 2149 done (global step: 4253) | |
1681061788.028370: Worker 0: training step 2150 done (global step: 4255) | |
1681061788.033477: Worker 0: training step 2151 done (global step: 4257) | |
1681061788.038804: Worker 0: training step 2152 done (global step: 4259) | |
1681061788.043902: Worker 0: training step 2153 done (global step: 4261) | |
1681061788.049280: Worker 0: training step 2154 done (global step: 4263) | |
1681061788.055064: Worker 0: training step 2155 done (global step: 4265) | |
1681061788.062129: Worker 0: training step 2156 done (global step: 4267) | |
1681061788.067681: Worker 0: training step 2157 done (global step: 4269) | |
1681061788.072882: Worker 0: training step 2158 done (global step: 4271) | |
1681061788.078580: Worker 0: training step 2159 done (global step: 4273) | |
1681061788.084248: Worker 0: training step 2160 done (global step: 4275) | |
1681061788.089698: Worker 0: training step 2161 done (global step: 4277) | |
1681061788.095168: Worker 0: training step 2162 done (global step: 4279) | |
1681061788.100652: Worker 0: training step 2163 done (global step: 4281) | |
1681061788.105069: Worker 0: training step 2164 done (global step: 4283) | |
1681061788.110646: Worker 0: training step 2165 done (global step: 4285) | |
1681061788.116323: Worker 0: training step 2166 done (global step: 4287) | |
1681061788.120831: Worker 0: training step 2167 done (global step: 4289) | |
1681061788.126902: Worker 0: training step 2168 done (global step: 4290) | |
1681061788.132427: Worker 0: training step 2169 done (global step: 4292) | |
1681061788.136635: Worker 0: training step 2170 done (global step: 4294) | |
1681061788.142078: Worker 0: training step 2171 done (global step: 4296) | |
1681061788.147405: Worker 0: training step 2172 done (global step: 4298) | |
1681061788.154342: Worker 0: training step 2173 done (global step: 4300) | |
1681061788.161704: Worker 0: training step 2174 done (global step: 4302) | |
1681061788.168295: Worker 0: training step 2175 done (global step: 4304) | |
1681061788.173919: Worker 0: training step 2176 done (global step: 4306) | |
1681061788.179848: Worker 0: training step 2177 done (global step: 4307) | |
1681061788.188514: Worker 0: training step 2178 done (global step: 4309) | |
1681061788.195731: Worker 0: training step 2179 done (global step: 4311) | |
1681061788.203715: Worker 0: training step 2180 done (global step: 4313) | |
1681061788.210529: Worker 0: training step 2181 done (global step: 4316) | |
1681061788.216459: Worker 0: training step 2182 done (global step: 4317) | |
1681061788.222119: Worker 0: training step 2183 done (global step: 4319) | |
1681061788.228091: Worker 0: training step 2184 done (global step: 4321) | |
1681061788.233681: Worker 0: training step 2185 done (global step: 4323) | |
1681061788.240487: Worker 0: training step 2186 done (global step: 4325) | |
1681061788.246779: Worker 0: training step 2187 done (global step: 4327) | |
1681061788.253474: Worker 0: training step 2188 done (global step: 4329) | |
1681061788.261688: Worker 0: training step 2189 done (global step: 4331) | |
1681061788.267903: Worker 0: training step 2190 done (global step: 4333) | |
1681061788.273916: Worker 0: training step 2191 done (global step: 4335) | |
1681061788.279859: Worker 0: training step 2192 done (global step: 4337) | |
1681061788.285477: Worker 0: training step 2193 done (global step: 4339) | |
1681061788.290940: Worker 0: training step 2194 done (global step: 4341) | |
1681061788.297202: Worker 0: training step 2195 done (global step: 4343) | |
1681061788.305316: Worker 0: training step 2196 done (global step: 4344) | |
1681061788.313653: Worker 0: training step 2197 done (global step: 4347) | |
1681061788.318944: Worker 0: training step 2198 done (global step: 4349) | |
1681061788.324093: Worker 0: training step 2199 done (global step: 4351) | |
1681061788.329642: Worker 0: training step 2200 done (global step: 4353) | |
1681061788.495883: Worker 0: training step 2201 done (global step: 4388) | |
1681061788.500752: Worker 0: training step 2202 done (global step: 4390) | |
1681061788.506215: Worker 0: training step 2203 done (global step: 4392) | |
1681061788.511619: Worker 0: training step 2204 done (global step: 4394) | |
1681061788.517388: Worker 0: training step 2205 done (global step: 4396) | |
1681061788.522661: Worker 0: training step 2206 done (global step: 4398) | |
1681061788.528291: Worker 0: training step 2207 done (global step: 4400) | |
1681061788.534081: Worker 0: training step 2208 done (global step: 4402) | |
1681061788.540131: Worker 0: training step 2209 done (global step: 4404) | |
1681061788.546434: Worker 0: training step 2210 done (global step: 4406) | |
1681061788.551920: Worker 0: training step 2211 done (global step: 4408) | |
1681061788.556566: Worker 0: training step 2212 done (global step: 4409) | |
1681061788.561050: Worker 0: training step 2213 done (global step: 4410) | |
1681061788.566434: Worker 0: training step 2214 done (global step: 4411) | |
1681061788.571501: Worker 0: training step 2215 done (global step: 4412) | |
1681061788.575971: Worker 0: training step 2216 done (global step: 4413) | |
1681061788.581185: Worker 0: training step 2217 done (global step: 4414) | |
1681061788.586777: Worker 0: training step 2218 done (global step: 4415) | |
1681061788.591837: Worker 0: training step 2219 done (global step: 4416) | |
1681061788.597043: Worker 0: training step 2220 done (global step: 4417) | |
1681061788.602134: Worker 0: training step 2221 done (global step: 4418) | |
1681061788.606466: Worker 0: training step 2222 done (global step: 4419) | |
1681061788.611547: Worker 0: training step 2223 done (global step: 4420) | |
1681061788.616471: Worker 0: training step 2224 done (global step: 4421) | |
1681061788.621398: Worker 0: training step 2225 done (global step: 4422) | |
1681061788.626600: Worker 0: training step 2226 done (global step: 4423) | |
1681061788.638097: Worker 0: training step 2227 done (global step: 4424) | |
1681061788.642280: Worker 0: training step 2228 done (global step: 4425) | |
1681061788.646828: Worker 0: training step 2229 done (global step: 4426) | |
1681061788.651423: Worker 0: training step 2230 done (global step: 4427) | |
1681061788.655888: Worker 0: training step 2231 done (global step: 4428) | |
1681061788.660569: Worker 0: training step 2232 done (global step: 4429) | |
1681061788.665436: Worker 0: training step 2233 done (global step: 4430) | |
1681061788.670021: Worker 0: training step 2234 done (global step: 4431) | |
1681061788.675369: Worker 0: training step 2235 done (global step: 4432) | |
1681061788.679867: Worker 0: training step 2236 done (global step: 4433) | |
1681061788.684105: Worker 0: training step 2237 done (global step: 4434) | |
1681061788.688720: Worker 0: training step 2238 done (global step: 4435) | |
1681061788.693328: Worker 0: training step 2239 done (global step: 4436) | |
1681061788.697657: Worker 0: training step 2240 done (global step: 4437) | |
1681061788.701576: Worker 0: training step 2241 done (global step: 4438) | |
1681061788.705497: Worker 0: training step 2242 done (global step: 4439) | |
1681061788.711345: Worker 0: training step 2243 done (global step: 4440) | |
1681061788.717259: Worker 0: training step 2244 done (global step: 4442) | |
1681061788.723077: Worker 0: training step 2245 done (global step: 4444) | |
1681061788.731138: Worker 0: training step 2246 done (global step: 4446) | |
1681061788.742518: Worker 0: training step 2247 done (global step: 4448) | |
1681061788.750463: Worker 0: training step 2248 done (global step: 4450) | |
1681061788.759953: Worker 0: training step 2249 done (global step: 4451) | |
1681061788.765512: Worker 0: training step 2250 done (global step: 4454) | |
1681061788.772404: Worker 0: training step 2251 done (global step: 4456) | |
1681061788.780262: Worker 0: training step 2252 done (global step: 4458) | |
1681061788.785538: Worker 0: training step 2253 done (global step: 4461) | |
1681061788.793193: Worker 0: training step 2254 done (global step: 4462) | |
1681061788.799439: Worker 0: training step 2255 done (global step: 4465) | |
1681061788.806552: Worker 0: training step 2256 done (global step: 4467) | |
1681061788.813916: Worker 0: training step 2257 done (global step: 4469) | |
1681061788.820116: Worker 0: training step 2258 done (global step: 4471) | |
1681061788.827013: Worker 0: training step 2259 done (global step: 4473) | |
1681061788.833687: Worker 0: training step 2260 done (global step: 4475) | |
1681061788.839335: Worker 0: training step 2261 done (global step: 4477) | |
1681061788.845275: Worker 0: training step 2262 done (global step: 4479) | |
1681061788.851961: Worker 0: training step 2263 done (global step: 4482) | |
1681061788.858230: Worker 0: training step 2264 done (global step: 4484) | |
1681061788.864370: Worker 0: training step 2265 done (global step: 4486) | |
1681061788.869452: Worker 0: training step 2266 done (global step: 4488) | |
1681061788.874990: Worker 0: training step 2267 done (global step: 4489) | |
1681061788.881047: Worker 0: training step 2268 done (global step: 4492) | |
1681061788.887440: Worker 0: training step 2269 done (global step: 4494) | |
1681061788.893814: Worker 0: training step 2270 done (global step: 4495) | |
1681061788.898745: Worker 0: training step 2271 done (global step: 4497) | |
1681061788.905135: Worker 0: training step 2272 done (global step: 4499) | |
1681061788.912973: Worker 0: training step 2273 done (global step: 4501) | |
1681061788.918703: Worker 0: training step 2274 done (global step: 4503) | |
1681061788.924287: Worker 0: training step 2275 done (global step: 4505) | |
1681061788.930483: Worker 0: training step 2276 done (global step: 4507) | |
1681061788.936514: Worker 0: training step 2277 done (global step: 4509) | |
1681061788.942122: Worker 0: training step 2278 done (global step: 4511) | |
1681061788.948799: Worker 0: training step 2279 done (global step: 4513) | |
1681061788.954665: Worker 0: training step 2280 done (global step: 4515) | |
1681061788.961510: Worker 0: training step 2281 done (global step: 4517) | |
1681061788.969128: Worker 0: training step 2282 done (global step: 4519) | |
1681061788.975252: Worker 0: training step 2283 done (global step: 4521) | |
1681061788.980578: Worker 0: training step 2284 done (global step: 4523) | |
1681061788.987023: Worker 0: training step 2285 done (global step: 4525) | |
1681061788.993514: Worker 0: training step 2286 done (global step: 4528) | |
1681061788.999733: Worker 0: training step 2287 done (global step: 4530) | |
1681061789.005798: Worker 0: training step 2288 done (global step: 4532) | |
1681061789.011312: Worker 0: training step 2289 done (global step: 4534) | |
1681061789.018417: Worker 0: training step 2290 done (global step: 4536) | |
1681061789.024471: Worker 0: training step 2291 done (global step: 4538) | |
1681061789.031180: Worker 0: training step 2292 done (global step: 4540) | |
1681061789.037467: Worker 0: training step 2293 done (global step: 4542) | |
1681061789.042380: Worker 0: training step 2294 done (global step: 4544) | |
1681061789.048393: Worker 0: training step 2295 done (global step: 4546) | |
1681061789.055048: Worker 0: training step 2296 done (global step: 4548) | |
1681061789.059204: Worker 0: training step 2297 done (global step: 4549) | |
1681061789.064556: Worker 0: training step 2298 done (global step: 4551) | |
1681061789.069949: Worker 0: training step 2299 done (global step: 4553) | |
1681061789.077012: Worker 0: training step 2300 done (global step: 4555) | |
1681061789.083248: Worker 0: training step 2301 done (global step: 4557) | |
1681061789.089053: Worker 0: training step 2302 done (global step: 4559) | |
1681061789.094641: Worker 0: training step 2303 done (global step: 4561) | |
1681061789.099995: Worker 0: training step 2304 done (global step: 4563) | |
1681061789.105407: Worker 0: training step 2305 done (global step: 4565) | |
1681061789.113065: Worker 0: training step 2306 done (global step: 4567) | |
1681061789.120390: Worker 0: training step 2307 done (global step: 4569) | |
1681061789.128646: Worker 0: training step 2308 done (global step: 4571) | |
1681061789.138711: Worker 0: training step 2309 done (global step: 4573) | |
1681061789.146340: Worker 0: training step 2310 done (global step: 4575) | |
1681061789.151628: Worker 0: training step 2311 done (global step: 4577) | |
1681061789.161812: Worker 0: training step 2312 done (global step: 4578) | |
1681061789.172113: Worker 0: training step 2313 done (global step: 4581) | |
1681061789.181557: Worker 0: training step 2314 done (global step: 4583) | |
1681061789.189421: Worker 0: training step 2315 done (global step: 4585) | |
1681061789.197910: Worker 0: training step 2316 done (global step: 4587) | |
1681061789.204958: Worker 0: training step 2317 done (global step: 4589) | |
1681061789.216766: Worker 0: training step 2318 done (global step: 4591) | |
1681061789.223350: Worker 0: training step 2319 done (global step: 4594) | |
1681061789.229304: Worker 0: training step 2320 done (global step: 4595) | |
1681061789.236604: Worker 0: training step 2321 done (global step: 4597) | |
1681061789.247804: Worker 0: training step 2322 done (global step: 4599) | |
1681061789.257015: Worker 0: training step 2323 done (global step: 4601) | |
1681061789.263764: Worker 0: training step 2324 done (global step: 4603) | |
1681061789.269815: Worker 0: training step 2325 done (global step: 4605) | |
1681061789.275230: Worker 0: training step 2326 done (global step: 4607) | |
1681061789.280399: Worker 0: training step 2327 done (global step: 4609) | |
1681061789.285995: Worker 0: training step 2328 done (global step: 4611) | |
1681061789.292315: Worker 0: training step 2329 done (global step: 4613) | |
1681061789.299223: Worker 0: training step 2330 done (global step: 4615) | |
1681061789.307002: Worker 0: training step 2331 done (global step: 4617) | |
1681061789.313627: Worker 0: training step 2332 done (global step: 4620) | |
1681061789.320244: Worker 0: training step 2333 done (global step: 4622) | |
1681061789.326322: Worker 0: training step 2334 done (global step: 4624) | |
1681061789.331604: Worker 0: training step 2335 done (global step: 4626) | |
1681061789.337465: Worker 0: training step 2336 done (global step: 4628) | |
1681061789.343556: Worker 0: training step 2337 done (global step: 4630) | |
1681061789.348819: Worker 0: training step 2338 done (global step: 4632) | |
1681061789.354704: Worker 0: training step 2339 done (global step: 4634) | |
1681061789.360525: Worker 0: training step 2340 done (global step: 4636) | |
1681061789.365819: Worker 0: training step 2341 done (global step: 4638) | |
1681061789.371789: Worker 0: training step 2342 done (global step: 4640) | |
1681061789.377670: Worker 0: training step 2343 done (global step: 4642) | |
1681061789.383217: Worker 0: training step 2344 done (global step: 4644) | |
1681061789.388545: Worker 0: training step 2345 done (global step: 4646) | |
1681061789.394258: Worker 0: training step 2346 done (global step: 4648) | |
1681061789.400106: Worker 0: training step 2347 done (global step: 4650) | |
1681061789.406427: Worker 0: training step 2348 done (global step: 4652) | |
1681061789.412741: Worker 0: training step 2349 done (global step: 4654) | |
1681061789.419549: Worker 0: training step 2350 done (global step: 4656) | |
1681061789.424954: Worker 0: training step 2351 done (global step: 4658) | |
1681061789.430256: Worker 0: training step 2352 done (global step: 4660) | |
1681061789.435472: Worker 0: training step 2353 done (global step: 4662) | |
1681061789.441171: Worker 0: training step 2354 done (global step: 4664) | |
1681061789.447496: Worker 0: training step 2355 done (global step: 4666) | |
1681061789.452382: Worker 0: training step 2356 done (global step: 4668) | |
1681061789.460803: Worker 0: training step 2357 done (global step: 4670) | |
1681061789.465897: Worker 0: training step 2358 done (global step: 4673) | |
1681061789.470747: Worker 0: training step 2359 done (global step: 4674) | |
1681061789.476537: Worker 0: training step 2360 done (global step: 4676) | |
1681061789.482406: Worker 0: training step 2361 done (global step: 4678) | |
1681061789.487258: Worker 0: training step 2362 done (global step: 4680) | |
1681061789.494521: Worker 0: training step 2363 done (global step: 4682) | |
1681061789.500002: Worker 0: training step 2364 done (global step: 4684) | |
1681061789.505396: Worker 0: training step 2365 done (global step: 4686) | |
1681061789.510925: Worker 0: training step 2366 done (global step: 4688) | |
1681061789.516425: Worker 0: training step 2367 done (global step: 4690) | |
1681061789.521585: Worker 0: training step 2368 done (global step: 4692) | |
1681061789.527912: Worker 0: training step 2369 done (global step: 4694) | |
1681061789.533351: Worker 0: training step 2370 done (global step: 4696) | |
1681061789.538816: Worker 0: training step 2371 done (global step: 4698) | |
1681061789.544473: Worker 0: training step 2372 done (global step: 4700) | |
1681061789.549923: Worker 0: training step 2373 done (global step: 4702) | |
1681061789.556097: Worker 0: training step 2374 done (global step: 4704) | |
1681061789.562686: Worker 0: training step 2375 done (global step: 4706) | |
1681061789.567478: Worker 0: training step 2376 done (global step: 4708) | |
1681061789.572487: Worker 0: training step 2377 done (global step: 4710) | |
1681061789.577654: Worker 0: training step 2378 done (global step: 4712) | |
1681061789.583475: Worker 0: training step 2379 done (global step: 4714) | |
1681061789.589515: Worker 0: training step 2380 done (global step: 4716) | |
1681061789.595129: Worker 0: training step 2381 done (global step: 4718) | |
1681061789.601150: Worker 0: training step 2382 done (global step: 4720) | |
1681061789.607286: Worker 0: training step 2383 done (global step: 4722) | |
1681061789.612648: Worker 0: training step 2384 done (global step: 4725) | |
1681061789.618681: Worker 0: training step 2385 done (global step: 4727) | |
1681061789.625921: Worker 0: training step 2386 done (global step: 4728) | |
1681061789.631469: Worker 0: training step 2387 done (global step: 4731) | |
1681061789.637388: Worker 0: training step 2388 done (global step: 4733) | |
1681061789.642948: Worker 0: training step 2389 done (global step: 4735) | |
1681061789.648671: Worker 0: training step 2390 done (global step: 4737) | |
1681061789.653749: Worker 0: training step 2391 done (global step: 4739) | |
1681061789.657728: Worker 0: training step 2392 done (global step: 4740) | |
1681061789.662542: Worker 0: training step 2393 done (global step: 4742) | |
1681061789.667563: Worker 0: training step 2394 done (global step: 4744) | |
1681061789.673256: Worker 0: training step 2395 done (global step: 4746) | |
1681061789.678470: Worker 0: training step 2396 done (global step: 4748) | |
1681061789.683900: Worker 0: training step 2397 done (global step: 4750) | |
1681061789.690051: Worker 0: training step 2398 done (global step: 4752) | |
1681061789.695774: Worker 0: training step 2399 done (global step: 4754) | |
1681061789.700490: Worker 0: training step 2400 done (global step: 4756) | |
1681061789.705947: Worker 0: training step 2401 done (global step: 4758) | |
1681061789.711041: Worker 0: training step 2402 done (global step: 4760) | |
1681061789.717411: Worker 0: training step 2403 done (global step: 4762) | |
1681061789.722745: Worker 0: training step 2404 done (global step: 4764) | |
1681061789.728594: Worker 0: training step 2405 done (global step: 4766) | |
1681061789.733989: Worker 0: training step 2406 done (global step: 4768) | |
1681061789.738866: Worker 0: training step 2407 done (global step: 4770) | |
1681061789.744494: Worker 0: training step 2408 done (global step: 4772) | |
1681061789.749303: Worker 0: training step 2409 done (global step: 4774) | |
1681061789.755761: Worker 0: training step 2410 done (global step: 4775) | |
1681061789.761709: Worker 0: training step 2411 done (global step: 4778) | |
1681061789.766392: Worker 0: training step 2412 done (global step: 4780) | |
1681061789.772698: Worker 0: training step 2413 done (global step: 4782) | |
1681061789.778636: Worker 0: training step 2414 done (global step: 4784) | |
1681061789.783803: Worker 0: training step 2415 done (global step: 4786) | |
1681061789.790233: Worker 0: training step 2416 done (global step: 4788) | |
1681061789.795979: Worker 0: training step 2417 done (global step: 4790) | |
1681061789.801738: Worker 0: training step 2418 done (global step: 4792) | |
1681061789.807140: Worker 0: training step 2419 done (global step: 4794) | |
1681061789.811926: Worker 0: training step 2420 done (global step: 4796) | |
1681061789.818552: Worker 0: training step 2421 done (global step: 4798) | |
1681061789.824543: Worker 0: training step 2422 done (global step: 4800) | |
1681061789.830745: Worker 0: training step 2423 done (global step: 4802) | |
1681061789.837037: Worker 0: training step 2424 done (global step: 4804) | |
1681061789.843706: Worker 0: training step 2425 done (global step: 4806) | |
1681061789.860873: Worker 0: training step 2426 done (global step: 4809) | |
1681061789.872017: Worker 0: training step 2427 done (global step: 4811) | |
1681061789.880374: Worker 0: training step 2428 done (global step: 4813) | |
1681061789.886856: Worker 0: training step 2429 done (global step: 4815) | |
1681061789.892028: Worker 0: training step 2430 done (global step: 4817) | |
1681061789.897881: Worker 0: training step 2431 done (global step: 4818) | |
1681061789.904208: Worker 0: training step 2432 done (global step: 4820) | |
1681061789.910269: Worker 0: training step 2433 done (global step: 4823) | |
1681061789.916142: Worker 0: training step 2434 done (global step: 4825) | |
1681061789.924861: Worker 0: training step 2435 done (global step: 4827) | |
1681061789.930413: Worker 0: training step 2436 done (global step: 4829) | |
1681061789.935844: Worker 0: training step 2437 done (global step: 4831) | |
1681061789.942122: Worker 0: training step 2438 done (global step: 4833) | |
1681061789.948311: Worker 0: training step 2439 done (global step: 4835) | |
1681061789.953455: Worker 0: training step 2440 done (global step: 4837) | |
1681061789.958885: Worker 0: training step 2441 done (global step: 4839) | |
1681061789.964037: Worker 0: training step 2442 done (global step: 4841) | |
1681061789.968943: Worker 0: training step 2443 done (global step: 4842) | |
1681061789.975143: Worker 0: training step 2444 done (global step: 4844) | |
1681061789.980437: Worker 0: training step 2445 done (global step: 4846) | |
1681061789.987581: Worker 0: training step 2446 done (global step: 4849) | |
1681061789.992964: Worker 0: training step 2447 done (global step: 4851) | |
1681061789.999021: Worker 0: training step 2448 done (global step: 4853) | |
1681061790.004801: Worker 0: training step 2449 done (global step: 4855) | |
1681061790.010101: Worker 0: training step 2450 done (global step: 4857) | |
1681061790.016151: Worker 0: training step 2451 done (global step: 4859) | |
1681061790.023562: Worker 0: training step 2452 done (global step: 4861) | |
1681061790.027963: Worker 0: training step 2453 done (global step: 4862) | |
1681061790.033663: Worker 0: training step 2454 done (global step: 4864) | |
1681061790.039016: Worker 0: training step 2455 done (global step: 4866) | |
1681061790.043844: Worker 0: training step 2456 done (global step: 4868) | |
1681061790.048927: Worker 0: training step 2457 done (global step: 4870) | |
1681061790.059690: Worker 0: training step 2458 done (global step: 4872) | |
1681061790.072944: Worker 0: training step 2459 done (global step: 4874) | |
1681061790.083638: Worker 0: training step 2460 done (global step: 4876) | |
1681061790.093214: Worker 0: training step 2461 done (global step: 4878) | |
1681061790.104734: Worker 0: training step 2462 done (global step: 4880) | |
1681061790.113205: Worker 0: training step 2463 done (global step: 4882) | |
1681061790.119241: Worker 0: training step 2464 done (global step: 4884) | |
1681061790.124401: Worker 0: training step 2465 done (global step: 4886) | |
1681061790.129923: Worker 0: training step 2466 done (global step: 4888) | |
1681061790.135754: Worker 0: training step 2467 done (global step: 4890) | |
1681061790.141250: Worker 0: training step 2468 done (global step: 4892) | |
1681061790.146467: Worker 0: training step 2469 done (global step: 4894) | |
1681061790.153542: Worker 0: training step 2470 done (global step: 4896) | |
1681061790.159244: Worker 0: training step 2471 done (global step: 4898) | |
1681061790.165271: Worker 0: training step 2472 done (global step: 4900) | |
1681061790.170349: Worker 0: training step 2473 done (global step: 4902) | |
1681061790.175459: Worker 0: training step 2474 done (global step: 4904) | |
1681061790.182081: Worker 0: training step 2475 done (global step: 4906) | |
1681061790.187655: Worker 0: training step 2476 done (global step: 4908) | |
1681061790.194318: Worker 0: training step 2477 done (global step: 4910) | |
1681061790.199167: Worker 0: training step 2478 done (global step: 4912) | |
1681061790.204343: Worker 0: training step 2479 done (global step: 4913) | |
1681061790.209301: Worker 0: training step 2480 done (global step: 4915) | |
1681061790.215142: Worker 0: training step 2481 done (global step: 4917) | |
1681061790.219964: Worker 0: training step 2482 done (global step: 4919) | |
1681061790.227336: Worker 0: training step 2483 done (global step: 4921) | |
1681061790.233905: Worker 0: training step 2484 done (global step: 4923) | |
1681061790.241400: Worker 0: training step 2485 done (global step: 4925) | |
1681061790.249052: Worker 0: training step 2486 done (global step: 4927) | |
1681061790.256665: Worker 0: training step 2487 done (global step: 4929) | |
1681061790.262177: Worker 0: training step 2488 done (global step: 4931) | |
1681061790.267997: Worker 0: training step 2489 done (global step: 4933) | |
1681061790.273521: Worker 0: training step 2490 done (global step: 4935) | |
1681061790.278762: Worker 0: training step 2491 done (global step: 4937) | |
1681061790.284385: Worker 0: training step 2492 done (global step: 4939) | |
1681061790.289707: Worker 0: training step 2493 done (global step: 4941) | |
1681061790.295886: Worker 0: training step 2494 done (global step: 4943) | |
1681061790.301362: Worker 0: training step 2495 done (global step: 4945) | |
1681061790.308701: Worker 0: training step 2496 done (global step: 4947) | |
1681061790.314440: Worker 0: training step 2497 done (global step: 4949) | |
1681061790.322252: Worker 0: training step 2498 done (global step: 4951) | |
1681061790.327921: Worker 0: training step 2499 done (global step: 4953) | |
1681061790.333882: Worker 0: training step 2500 done (global step: 4955) | |
1681061790.339493: Worker 0: training step 2501 done (global step: 4957) | |
1681061790.345495: Worker 0: training step 2502 done (global step: 4959) | |
1681061790.351200: Worker 0: training step 2503 done (global step: 4961) | |
1681061790.356194: Worker 0: training step 2504 done (global step: 4963) | |
1681061790.361823: Worker 0: training step 2505 done (global step: 4965) | |
1681061790.367291: Worker 0: training step 2506 done (global step: 4967) | |
1681061790.373026: Worker 0: training step 2507 done (global step: 4969) | |
1681061790.378447: Worker 0: training step 2508 done (global step: 4971) | |
1681061790.384050: Worker 0: training step 2509 done (global step: 4973) | |
1681061790.391017: Worker 0: training step 2510 done (global step: 4975) | |
1681061790.396180: Worker 0: training step 2511 done (global step: 4977) | |
1681061790.401958: Worker 0: training step 2512 done (global step: 4979) | |
1681061790.408638: Worker 0: training step 2513 done (global step: 4981) | |
1681061790.414019: Worker 0: training step 2514 done (global step: 4983) | |
1681061790.420925: Worker 0: training step 2515 done (global step: 4985) | |
1681061790.426325: Worker 0: training step 2516 done (global step: 4987) | |
1681061790.431930: Worker 0: training step 2517 done (global step: 4989) | |
1681061790.438041: Worker 0: training step 2518 done (global step: 4991) | |
1681061790.445491: Worker 0: training step 2519 done (global step: 4993) | |
1681061790.449911: Worker 0: training step 2520 done (global step: 4996) | |
1681061790.455252: Worker 0: training step 2521 done (global step: 4997) | |
1681061790.464175: Worker 0: training step 2522 done (global step: 4999) | |
1681061790.471969: Worker 0: training step 2523 done (global step: 5002) | |
1681061790.477329: Worker 0: training step 2524 done (global step: 5004) | |
1681061790.483248: Worker 0: training step 2525 done (global step: 5006) | |
1681061790.489723: Worker 0: training step 2526 done (global step: 5008) | |
1681061790.495033: Worker 0: training step 2527 done (global step: 5011) | |
1681061790.501293: Worker 0: training step 2528 done (global step: 5012) | |
1681061790.506432: Worker 0: training step 2529 done (global step: 5015) | |
1681061790.512146: Worker 0: training step 2530 done (global step: 5017) | |
1681061790.518987: Worker 0: training step 2531 done (global step: 5019) | |
1681061790.524788: Worker 0: training step 2532 done (global step: 5021) | |
1681061790.529891: Worker 0: training step 2533 done (global step: 5023) | |
1681061790.534733: Worker 0: training step 2534 done (global step: 5024) | |
1681061790.539572: Worker 0: training step 2535 done (global step: 5026) | |
1681061790.545044: Worker 0: training step 2536 done (global step: 5028) | |
1681061790.550945: Worker 0: training step 2537 done (global step: 5030) | |
1681061790.556633: Worker 0: training step 2538 done (global step: 5032) | |
1681061790.562309: Worker 0: training step 2539 done (global step: 5034) | |
1681061790.568097: Worker 0: training step 2540 done (global step: 5036) | |
1681061790.574972: Worker 0: training step 2541 done (global step: 5038) | |
1681061790.580708: Worker 0: training step 2542 done (global step: 5041) | |
1681061790.585636: Worker 0: training step 2543 done (global step: 5042) | |
1681061790.590255: Worker 0: training step 2544 done (global step: 5044) | |
1681061790.595710: Worker 0: training step 2545 done (global step: 5046) | |
1681061790.601496: Worker 0: training step 2546 done (global step: 5048) | |
1681061790.608995: Worker 0: training step 2547 done (global step: 5050) | |
1681061790.614324: Worker 0: training step 2548 done (global step: 5053) | |
1681061790.619009: Worker 0: training step 2549 done (global step: 5055) | |
1681061790.625735: Worker 0: training step 2550 done (global step: 5057) | |
1681061790.631016: Worker 0: training step 2551 done (global step: 5059) | |
1681061790.637285: Worker 0: training step 2552 done (global step: 5061) | |
1681061790.643051: Worker 0: training step 2553 done (global step: 5063) | |
1681061790.648930: Worker 0: training step 2554 done (global step: 5065) | |
1681061790.654199: Worker 0: training step 2555 done (global step: 5066) | |
1681061790.659945: Worker 0: training step 2556 done (global step: 5068) | |
1681061790.665666: Worker 0: training step 2557 done (global step: 5070) | |
1681061790.670792: Worker 0: training step 2558 done (global step: 5072) | |
1681061790.676160: Worker 0: training step 2559 done (global step: 5074) | |
1681061790.681522: Worker 0: training step 2560 done (global step: 5076) | |
1681061790.686810: Worker 0: training step 2561 done (global step: 5078) | |
1681061790.691813: Worker 0: training step 2562 done (global step: 5080) | |
1681061790.698317: Worker 0: training step 2563 done (global step: 5082) | |
1681061790.704106: Worker 0: training step 2564 done (global step: 5084) | |
1681061790.709377: Worker 0: training step 2565 done (global step: 5086) | |
1681061790.716148: Worker 0: training step 2566 done (global step: 5088) | |
1681061790.721736: Worker 0: training step 2567 done (global step: 5090) | |
1681061790.727035: Worker 0: training step 2568 done (global step: 5092) | |
1681061790.732553: Worker 0: training step 2569 done (global step: 5094) | |
1681061790.737749: Worker 0: training step 2570 done (global step: 5096) | |
1681061790.743593: Worker 0: training step 2571 done (global step: 5098) | |
1681061790.748948: Worker 0: training step 2572 done (global step: 5100) | |
1681061790.755593: Worker 0: training step 2573 done (global step: 5102) | |
1681061790.761544: Worker 0: training step 2574 done (global step: 5104) | |
1681061790.767053: Worker 0: training step 2575 done (global step: 5106) | |
1681061790.772234: Worker 0: training step 2576 done (global step: 5108) | |
1681061790.777402: Worker 0: training step 2577 done (global step: 5110) | |
1681061790.782602: Worker 0: training step 2578 done (global step: 5112) | |
1681061790.789517: Worker 0: training step 2579 done (global step: 5114) | |
1681061790.795911: Worker 0: training step 2580 done (global step: 5116) | |
1681061790.802088: Worker 0: training step 2581 done (global step: 5118) | |
1681061790.807998: Worker 0: training step 2582 done (global step: 5121) | |
1681061790.813251: Worker 0: training step 2583 done (global step: 5122) | |
1681061790.819617: Worker 0: training step 2584 done (global step: 5124) | |
1681061790.827651: Worker 0: training step 2585 done (global step: 5126) | |
1681061790.834107: Worker 0: training step 2586 done (global step: 5129) | |
1681061790.840114: Worker 0: training step 2587 done (global step: 5131) | |
1681061790.846076: Worker 0: training step 2588 done (global step: 5133) | |
1681061790.851829: Worker 0: training step 2589 done (global step: 5135) | |
1681061790.857095: Worker 0: training step 2590 done (global step: 5137) | |
1681061790.861692: Worker 0: training step 2591 done (global step: 5139) | |
1681061790.866014: Worker 0: training step 2592 done (global step: 5140) | |
1681061790.871396: Worker 0: training step 2593 done (global step: 5142) | |
1681061790.877052: Worker 0: training step 2594 done (global step: 5144) | |
1681061790.882716: Worker 0: training step 2595 done (global step: 5146) | |
1681061790.887963: Worker 0: training step 2596 done (global step: 5148) | |
1681061790.893867: Worker 0: training step 2597 done (global step: 5150) | |
1681061790.899511: Worker 0: training step 2598 done (global step: 5152) | |
1681061790.905041: Worker 0: training step 2599 done (global step: 5154) | |
1681061790.910746: Worker 0: training step 2600 done (global step: 5156) | |
1681061790.916281: Worker 0: training step 2601 done (global step: 5158) | |
1681061790.922454: Worker 0: training step 2602 done (global step: 5160) | |
1681061790.929002: Worker 0: training step 2603 done (global step: 5162) | |
1681061790.934738: Worker 0: training step 2604 done (global step: 5164) | |
1681061790.941119: Worker 0: training step 2605 done (global step: 5166) | |
1681061790.946195: Worker 0: training step 2606 done (global step: 5168) | |
1681061790.952045: Worker 0: training step 2607 done (global step: 5170) | |
1681061790.957103: Worker 0: training step 2608 done (global step: 5172) | |
1681061790.963076: Worker 0: training step 2609 done (global step: 5174) | |
1681061790.969007: Worker 0: training step 2610 done (global step: 5177) | |
1681061790.974219: Worker 0: training step 2611 done (global step: 5179) | |
1681061790.980202: Worker 0: training step 2612 done (global step: 5181) | |
1681061790.986829: Worker 0: training step 2613 done (global step: 5182) | |
1681061790.992839: Worker 0: training step 2614 done (global step: 5185) | |
1681061790.998698: Worker 0: training step 2615 done (global step: 5187) | |
1681061791.004033: Worker 0: training step 2616 done (global step: 5189) | |
1681061791.009708: Worker 0: training step 2617 done (global step: 5191) | |
1681061791.015287: Worker 0: training step 2618 done (global step: 5193) | |
1681061791.020582: Worker 0: training step 2619 done (global step: 5195) | |
1681061791.026474: Worker 0: training step 2620 done (global step: 5197) | |
1681061791.032123: Worker 0: training step 2621 done (global step: 5199) | |
1681061791.038447: Worker 0: training step 2622 done (global step: 5201) | |
1681061791.044118: Worker 0: training step 2623 done (global step: 5203) | |
1681061791.049306: Worker 0: training step 2624 done (global step: 5205) | |
1681061791.055535: Worker 0: training step 2625 done (global step: 5207) | |
1681061791.060866: Worker 0: training step 2626 done (global step: 5209) | |
1681061791.065993: Worker 0: training step 2627 done (global step: 5211) | |
1681061791.071119: Worker 0: training step 2628 done (global step: 5213) | |
1681061791.076427: Worker 0: training step 2629 done (global step: 5215) | |
1681061791.081912: Worker 0: training step 2630 done (global step: 5217) | |
1681061791.087077: Worker 0: training step 2631 done (global step: 5219) | |
1681061791.092637: Worker 0: training step 2632 done (global step: 5221) | |
1681061791.098400: Worker 0: training step 2633 done (global step: 5223) | |
1681061791.103637: Worker 0: training step 2634 done (global step: 5225) | |
1681061791.110311: Worker 0: training step 2635 done (global step: 5227) | |
1681061791.117091: Worker 0: training step 2636 done (global step: 5229) | |
1681061791.122671: Worker 0: training step 2637 done (global step: 5231) | |
1681061791.127249: Worker 0: training step 2638 done (global step: 5233) | |
1681061791.132236: Worker 0: training step 2639 done (global step: 5235) | |
1681061791.138295: Worker 0: training step 2640 done (global step: 5237) | |
1681061791.144153: Worker 0: training step 2641 done (global step: 5239) | |
1681061791.149809: Worker 0: training step 2642 done (global step: 5241) | |
1681061791.155227: Worker 0: training step 2643 done (global step: 5243) | |
1681061791.162041: Worker 0: training step 2644 done (global step: 5245) | |
1681061791.168259: Worker 0: training step 2645 done (global step: 5247) | |
1681061791.177124: Worker 0: training step 2646 done (global step: 5249) | |
1681061791.183088: Worker 0: training step 2647 done (global step: 5252) | |
1681061791.188918: Worker 0: training step 2648 done (global step: 5254) | |
1681061791.194953: Worker 0: training step 2649 done (global step: 5256) | |
1681061791.201087: Worker 0: training step 2650 done (global step: 5258) | |
1681061791.208224: Worker 0: training step 2651 done (global step: 5260) | |
1681061791.214772: Worker 0: training step 2652 done (global step: 5262) | |
1681061791.220656: Worker 0: training step 2653 done (global step: 5264) | |
1681061791.228819: Worker 0: training step 2654 done (global step: 5265) | |
1681061791.242494: Worker 0: training step 2655 done (global step: 5268) | |
1681061791.254624: Worker 0: training step 2656 done (global step: 5270) | |
1681061791.271197: Worker 0: training step 2657 done (global step: 5272) | |
1681061791.281800: Worker 0: training step 2658 done (global step: 5274) | |
1681061791.289078: Worker 0: training step 2659 done (global step: 5276) | |
1681061791.297210: Worker 0: training step 2660 done (global step: 5278) | |
1681061791.304997: Worker 0: training step 2661 done (global step: 5280) | |
1681061791.314785: Worker 0: training step 2662 done (global step: 5282) | |
1681061791.323377: Worker 0: training step 2663 done (global step: 5283) | |
1681061791.334965: Worker 0: training step 2664 done (global step: 5286) | |
1681061791.349357: Worker 0: training step 2665 done (global step: 5288) | |
1681061791.359714: Worker 0: training step 2666 done (global step: 5290) | |
1681061791.368753: Worker 0: training step 2667 done (global step: 5292) | |
1681061791.384602: Worker 0: training step 2668 done (global step: 5294) | |
1681061791.402416: Worker 0: training step 2669 done (global step: 5295) | |
1681061791.420539: Worker 0: training step 2670 done (global step: 5298) | |
1681061791.435489: Worker 0: training step 2671 done (global step: 5299) | |
1681061791.442696: Worker 0: training step 2672 done (global step: 5301) | |
1681061791.452313: Worker 0: training step 2673 done (global step: 5304) | |
1681061791.458221: Worker 0: training step 2674 done (global step: 5306) | |
1681061791.467224: Worker 0: training step 2675 done (global step: 5307) | |
1681061791.473934: Worker 0: training step 2676 done (global step: 5309) | |
1681061791.481826: Worker 0: training step 2677 done (global step: 5311) | |
1681061791.488344: Worker 0: training step 2678 done (global step: 5313) | |
1681061791.494877: Worker 0: training step 2679 done (global step: 5315) | |
1681061791.500597: Worker 0: training step 2680 done (global step: 5316) | |
1681061791.507974: Worker 0: training step 2681 done (global step: 5318) | |
1681061791.516009: Worker 0: training step 2682 done (global step: 5320) | |
1681061791.522786: Worker 0: training step 2683 done (global step: 5322) | |
1681061791.531423: Worker 0: training step 2684 done (global step: 5324) | |
1681061791.542109: Worker 0: training step 2685 done (global step: 5325) | |
1681061791.561052: Worker 0: training step 2686 done (global step: 5328) | |
1681061791.572784: Worker 0: training step 2687 done (global step: 5329) | |
1681061791.581281: Worker 0: training step 2688 done (global step: 5332) | |
1681061791.589497: Worker 0: training step 2689 done (global step: 5334) | |
1681061791.599010: Worker 0: training step 2690 done (global step: 5336) | |
1681061791.608426: Worker 0: training step 2691 done (global step: 5338) | |
1681061791.617479: Worker 0: training step 2692 done (global step: 5340) | |
1681061791.623804: Worker 0: training step 2693 done (global step: 5342) | |
1681061791.630750: Worker 0: training step 2694 done (global step: 5344) | |
1681061791.637207: Worker 0: training step 2695 done (global step: 5346) | |
1681061791.646168: Worker 0: training step 2696 done (global step: 5347) | |
1681061791.654602: Worker 0: training step 2697 done (global step: 5350) | |
1681061791.662228: Worker 0: training step 2698 done (global step: 5352) | |
1681061791.668703: Worker 0: training step 2699 done (global step: 5354) | |
1681061791.677040: Worker 0: training step 2700 done (global step: 5356) | |
1681061791.684418: Worker 0: training step 2701 done (global step: 5357) | |
1681061791.693580: Worker 0: training step 2702 done (global step: 5359) | |
1681061791.701893: Worker 0: training step 2703 done (global step: 5361) | |
1681061791.720487: Worker 0: training step 2704 done (global step: 5363) | |
1681061791.734956: Worker 0: training step 2705 done (global step: 5365) | |
1681061791.743700: Worker 0: training step 2706 done (global step: 5367) | |
1681061791.751905: Worker 0: training step 2707 done (global step: 5369) | |
1681061791.758043: Worker 0: training step 2708 done (global step: 5371) | |
1681061791.771890: Worker 0: training step 2709 done (global step: 5373) | |
1681061791.781703: Worker 0: training step 2710 done (global step: 5375) | |
1681061791.790276: Worker 0: training step 2711 done (global step: 5377) | |
1681061791.798101: Worker 0: training step 2712 done (global step: 5379) | |
1681061791.804552: Worker 0: training step 2713 done (global step: 5381) | |
1681061791.811401: Worker 0: training step 2714 done (global step: 5382) | |
1681061791.816797: Worker 0: training step 2715 done (global step: 5384) | |
1681061791.821829: Worker 0: training step 2716 done (global step: 5386) | |
1681061791.827262: Worker 0: training step 2717 done (global step: 5388) | |
1681061791.833387: Worker 0: training step 2718 done (global step: 5390) | |
1681061791.838458: Worker 0: training step 2719 done (global step: 5393) | |
1681061791.843900: Worker 0: training step 2720 done (global step: 5394) | |
1681061791.849504: Worker 0: training step 2721 done (global step: 5396) | |
1681061791.854418: Worker 0: training step 2722 done (global step: 5398) | |
1681061791.859765: Worker 0: training step 2723 done (global step: 5400) | |
1681061791.865073: Worker 0: training step 2724 done (global step: 5402) | |
1681061791.872102: Worker 0: training step 2725 done (global step: 5404) | |
1681061791.877345: Worker 0: training step 2726 done (global step: 5406) | |
1681061791.882386: Worker 0: training step 2727 done (global step: 5408) | |
1681061791.889735: Worker 0: training step 2728 done (global step: 5410) | |
1681061791.904444: Worker 0: training step 2729 done (global step: 5412) | |
1681061791.915531: Worker 0: training step 2730 done (global step: 5414) | |
1681061791.923291: Worker 0: training step 2731 done (global step: 5416) | |
1681061791.931456: Worker 0: training step 2732 done (global step: 5417) | |
1681061791.939007: Worker 0: training step 2733 done (global step: 5419) | |
1681061791.944547: Worker 0: training step 2734 done (global step: 5421) | |
1681061791.950113: Worker 0: training step 2735 done (global step: 5423) | |
1681061791.956344: Worker 0: training step 2736 done (global step: 5424) | |
1681061791.962260: Worker 0: training step 2737 done (global step: 5427) | |
1681061791.968429: Worker 0: training step 2738 done (global step: 5429) | |
1681061791.973925: Worker 0: training step 2739 done (global step: 5431) | |
1681061791.979550: Worker 0: training step 2740 done (global step: 5433) | |
1681061791.985062: Worker 0: training step 2741 done (global step: 5435) | |
1681061791.990480: Worker 0: training step 2742 done (global step: 5437) | |
1681061791.996945: Worker 0: training step 2743 done (global step: 5439) | |
1681061792.003635: Worker 0: training step 2744 done (global step: 5441) | |
1681061792.009054: Worker 0: training step 2745 done (global step: 5443) | |
1681061792.014632: Worker 0: training step 2746 done (global step: 5445) | |
1681061792.020089: Worker 0: training step 2747 done (global step: 5447) | |
1681061792.029025: Worker 0: training step 2748 done (global step: 5449) | |
1681061792.044191: Worker 0: training step 2749 done (global step: 5451) | |
1681061792.060878: Worker 0: training step 2750 done (global step: 5452) | |
1681061792.227657: Worker 0: training step 2751 done (global step: 5488) | |
1681061792.233031: Worker 0: training step 2752 done (global step: 5490) | |
1681061792.238324: Worker 0: training step 2753 done (global step: 5492) | |
1681061792.243907: Worker 0: training step 2754 done (global step: 5494) | |
1681061792.249351: Worker 0: training step 2755 done (global step: 5496) | |
1681061792.255660: Worker 0: training step 2756 done (global step: 5498) | |
1681061792.261262: Worker 0: training step 2757 done (global step: 5500) | |
1681061792.266827: Worker 0: training step 2758 done (global step: 5502) | |
1681061792.272831: Worker 0: training step 2759 done (global step: 5504) | |
1681061792.277923: Worker 0: training step 2760 done (global step: 5506) | |
1681061792.282762: Worker 0: training step 2761 done (global step: 5507) | |
1681061792.287476: Worker 0: training step 2762 done (global step: 5508) | |
1681061792.292960: Worker 0: training step 2763 done (global step: 5509) | |
1681061792.297808: Worker 0: training step 2764 done (global step: 5510) | |
1681061792.303468: Worker 0: training step 2765 done (global step: 5511) | |
1681061792.310442: Worker 0: training step 2766 done (global step: 5512) | |
1681061792.315766: Worker 0: training step 2767 done (global step: 5513) | |
1681061792.320105: Worker 0: training step 2768 done (global step: 5514) | |
1681061792.325059: Worker 0: training step 2769 done (global step: 5515) | |
1681061792.329862: Worker 0: training step 2770 done (global step: 5516) | |
1681061792.334186: Worker 0: training step 2771 done (global step: 5517) | |
1681061792.339303: Worker 0: training step 2772 done (global step: 5518) | |
1681061792.344043: Worker 0: training step 2773 done (global step: 5519) | |
1681061792.348879: Worker 0: training step 2774 done (global step: 5520) | |
1681061792.353598: Worker 0: training step 2775 done (global step: 5521) | |
1681061792.358546: Worker 0: training step 2776 done (global step: 5522) | |
1681061792.363138: Worker 0: training step 2777 done (global step: 5523) | |
1681061792.367767: Worker 0: training step 2778 done (global step: 5524) | |
1681061792.372739: Worker 0: training step 2779 done (global step: 5525) | |
1681061792.377393: Worker 0: training step 2780 done (global step: 5526) | |
1681061792.381787: Worker 0: training step 2781 done (global step: 5527) | |
1681061792.386410: Worker 0: training step 2782 done (global step: 5528) | |
1681061792.391070: Worker 0: training step 2783 done (global step: 5529) | |
1681061792.395581: Worker 0: training step 2784 done (global step: 5530) | |
1681061792.400357: Worker 0: training step 2785 done (global step: 5531) | |
1681061792.404826: Worker 0: training step 2786 done (global step: 5532) | |
1681061792.409035: Worker 0: training step 2787 done (global step: 5533) | |
1681061792.413888: Worker 0: training step 2788 done (global step: 5534) | |
1681061792.418103: Worker 0: training step 2789 done (global step: 5535) | |
1681061792.421951: Worker 0: training step 2790 done (global step: 5536) | |
1681061792.425830: Worker 0: training step 2791 done (global step: 5537) | |
1681061792.430457: Worker 0: training step 2792 done (global step: 5538) | |
1681061792.434621: Worker 0: training step 2793 done (global step: 5539) | |
1681061792.439515: Worker 0: training step 2794 done (global step: 5540) | |
1681061792.445596: Worker 0: training step 2795 done (global step: 5542) | |
1681061792.450759: Worker 0: training step 2796 done (global step: 5544) | |
1681061792.456013: Worker 0: training step 2797 done (global step: 5546) | |
1681061792.463664: Worker 0: training step 2798 done (global step: 5548) | |
1681061792.471148: Worker 0: training step 2799 done (global step: 5550) | |
1681061792.476561: Worker 0: training step 2800 done (global step: 5552) | |
1681061792.481733: Worker 0: training step 2801 done (global step: 5554) | |
1681061792.487416: Worker 0: training step 2802 done (global step: 5556) | |
1681061792.493127: Worker 0: training step 2803 done (global step: 5558) | |
1681061792.498996: Worker 0: training step 2804 done (global step: 5560) | |
1681061792.504334: Worker 0: training step 2805 done (global step: 5562) | |
1681061792.509347: Worker 0: training step 2806 done (global step: 5564) | |
1681061792.514961: Worker 0: training step 2807 done (global step: 5566) | |
1681061792.520063: Worker 0: training step 2808 done (global step: 5568) | |
1681061792.525444: Worker 0: training step 2809 done (global step: 5570) | |
1681061792.531181: Worker 0: training step 2810 done (global step: 5572) | |
1681061792.536494: Worker 0: training step 2811 done (global step: 5574) | |
1681061792.542595: Worker 0: training step 2812 done (global step: 5576) | |
1681061792.547963: Worker 0: training step 2813 done (global step: 5578) | |
1681061792.553043: Worker 0: training step 2814 done (global step: 5580) | |
1681061792.558551: Worker 0: training step 2815 done (global step: 5582) | |
1681061792.563601: Worker 0: training step 2816 done (global step: 5584) | |
1681061792.570147: Worker 0: training step 2817 done (global step: 5586) | |
1681061792.575452: Worker 0: training step 2818 done (global step: 5588) | |
1681061792.580478: Worker 0: training step 2819 done (global step: 5590) | |
1681061792.585900: Worker 0: training step 2820 done (global step: 5592) | |
1681061792.592091: Worker 0: training step 2821 done (global step: 5594) | |
1681061792.597652: Worker 0: training step 2822 done (global step: 5596) | |
1681061792.602367: Worker 0: training step 2823 done (global step: 5598) | |
1681061792.607495: Worker 0: training step 2824 done (global step: 5600) | |
1681061792.612427: Worker 0: training step 2825 done (global step: 5602) | |
1681061792.617486: Worker 0: training step 2826 done (global step: 5603) | |
1681061792.621955: Worker 0: training step 2827 done (global step: 5605) | |
1681061792.627936: Worker 0: training step 2828 done (global step: 5607) | |
1681061792.634229: Worker 0: training step 2829 done (global step: 5609) | |
1681061792.640486: Worker 0: training step 2830 done (global step: 5611) | |
1681061792.647065: Worker 0: training step 2831 done (global step: 5614) | |
1681061792.652592: Worker 0: training step 2832 done (global step: 5616) | |
1681061792.658328: Worker 0: training step 2833 done (global step: 5618) | |
1681061792.663879: Worker 0: training step 2834 done (global step: 5620) | |
1681061792.670033: Worker 0: training step 2835 done (global step: 5622) | |
1681061792.675355: Worker 0: training step 2836 done (global step: 5624) | |
1681061792.680854: Worker 0: training step 2837 done (global step: 5626) | |
1681061792.686841: Worker 0: training step 2838 done (global step: 5628) | |
1681061792.692353: Worker 0: training step 2839 done (global step: 5630) | |
1681061792.698460: Worker 0: training step 2840 done (global step: 5632) | |
1681061792.704094: Worker 0: training step 2841 done (global step: 5634) | |
1681061792.710030: Worker 0: training step 2842 done (global step: 5636) | |
1681061792.715407: Worker 0: training step 2843 done (global step: 5638) | |
1681061792.721582: Worker 0: training step 2844 done (global step: 5640) | |
1681061792.726956: Worker 0: training step 2845 done (global step: 5642) | |
1681061792.732724: Worker 0: training step 2846 done (global step: 5644) | |
1681061792.738289: Worker 0: training step 2847 done (global step: 5646) | |
1681061792.743478: Worker 0: training step 2848 done (global step: 5648) | |
1681061792.748913: Worker 0: training step 2849 done (global step: 5650) | |
1681061792.754460: Worker 0: training step 2850 done (global step: 5652) | |
1681061792.761645: Worker 0: training step 2851 done (global step: 5654) | |
1681061792.766739: Worker 0: training step 2852 done (global step: 5656) | |
1681061792.771450: Worker 0: training step 2853 done (global step: 5658) | |
1681061792.776771: Worker 0: training step 2854 done (global step: 5660) | |
1681061792.783040: Worker 0: training step 2855 done (global step: 5662) | |
1681061792.789038: Worker 0: training step 2856 done (global step: 5664) | |
1681061792.795084: Worker 0: training step 2857 done (global step: 5667) | |
1681061792.801301: Worker 0: training step 2858 done (global step: 5669) | |
1681061792.806494: Worker 0: training step 2859 done (global step: 5671) | |
1681061792.811482: Worker 0: training step 2860 done (global step: 5673) | |
1681061792.817421: Worker 0: training step 2861 done (global step: 5675) | |
1681061792.823276: Worker 0: training step 2862 done (global step: 5677) | |
1681061792.829523: Worker 0: training step 2863 done (global step: 5679) | |
1681061792.835268: Worker 0: training step 2864 done (global step: 5681) | |
1681061792.840748: Worker 0: training step 2865 done (global step: 5683) | |
1681061792.845833: Worker 0: training step 2866 done (global step: 5685) | |
1681061792.851313: Worker 0: training step 2867 done (global step: 5687) | |
1681061792.856542: Worker 0: training step 2868 done (global step: 5689) | |
1681061792.861543: Worker 0: training step 2869 done (global step: 5691) | |
1681061792.867236: Worker 0: training step 2870 done (global step: 5693) | |
1681061792.872675: Worker 0: training step 2871 done (global step: 5695) | |
1681061792.877971: Worker 0: training step 2872 done (global step: 5697) | |
1681061792.883770: Worker 0: training step 2873 done (global step: 5699) | |
1681061792.890448: Worker 0: training step 2874 done (global step: 5701) | |
1681061792.896959: Worker 0: training step 2875 done (global step: 5703) | |
1681061792.902308: Worker 0: training step 2876 done (global step: 5705) | |
1681061792.907272: Worker 0: training step 2877 done (global step: 5707) | |
1681061792.912526: Worker 0: training step 2878 done (global step: 5708) | |
1681061792.918649: Worker 0: training step 2879 done (global step: 5710) | |
1681061792.923565: Worker 0: training step 2880 done (global step: 5712) | |
1681061792.929275: Worker 0: training step 2881 done (global step: 5714) | |
1681061792.934808: Worker 0: training step 2882 done (global step: 5716) | |
1681061792.940683: Worker 0: training step 2883 done (global step: 5718) | |
1681061792.946045: Worker 0: training step 2884 done (global step: 5720) | |
1681061792.951757: Worker 0: training step 2885 done (global step: 5722) | |
1681061792.957144: Worker 0: training step 2886 done (global step: 5724) | |
1681061792.962730: Worker 0: training step 2887 done (global step: 5726) | |
1681061792.968153: Worker 0: training step 2888 done (global step: 5728) | |
1681061792.974352: Worker 0: training step 2889 done (global step: 5730) | |
1681061792.983901: Worker 0: training step 2890 done (global step: 5732) | |
1681061792.992653: Worker 0: training step 2891 done (global step: 5734) | |
1681061793.001811: Worker 0: training step 2892 done (global step: 5736) | |
1681061793.008934: Worker 0: training step 2893 done (global step: 5738) | |
1681061793.014259: Worker 0: training step 2894 done (global step: 5740) | |
1681061793.020548: Worker 0: training step 2895 done (global step: 5742) | |
1681061793.026825: Worker 0: training step 2896 done (global step: 5744) | |
1681061793.041955: Worker 0: training step 2897 done (global step: 5746) | |
1681061793.053644: Worker 0: training step 2898 done (global step: 5748) | |
1681061793.064239: Worker 0: training step 2899 done (global step: 5750) | |
1681061793.069887: Worker 0: training step 2900 done (global step: 5752) | |
1681061793.076459: Worker 0: training step 2901 done (global step: 5754) | |
1681061793.082460: Worker 0: training step 2902 done (global step: 5756) | |
1681061793.088375: Worker 0: training step 2903 done (global step: 5758) | |
1681061793.093903: Worker 0: training step 2904 done (global step: 5760) | |
1681061793.099499: Worker 0: training step 2905 done (global step: 5762) | |
1681061793.105106: Worker 0: training step 2906 done (global step: 5764) | |
1681061793.110763: Worker 0: training step 2907 done (global step: 5766) | |
1681061793.116489: Worker 0: training step 2908 done (global step: 5768) | |
1681061793.122710: Worker 0: training step 2909 done (global step: 5770) | |
1681061793.129340: Worker 0: training step 2910 done (global step: 5772) | |
1681061793.134637: Worker 0: training step 2911 done (global step: 5774) | |
1681061793.139478: Worker 0: training step 2912 done (global step: 5775) | |
1681061793.146010: Worker 0: training step 2913 done (global step: 5777) | |
1681061793.151572: Worker 0: training step 2914 done (global step: 5780) | |
1681061793.157359: Worker 0: training step 2915 done (global step: 5782) | |
1681061793.162752: Worker 0: training step 2916 done (global step: 5784) | |
1681061793.168117: Worker 0: training step 2917 done (global step: 5786) | |
1681061793.173037: Worker 0: training step 2918 done (global step: 5788) | |
1681061793.178598: Worker 0: training step 2919 done (global step: 5790) | |
1681061793.183491: Worker 0: training step 2920 done (global step: 5792) | |
1681061793.189722: Worker 0: training step 2921 done (global step: 5794) | |
1681061793.195285: Worker 0: training step 2922 done (global step: 5796) | |
1681061793.201221: Worker 0: training step 2923 done (global step: 5798) | |
1681061793.206702: Worker 0: training step 2924 done (global step: 5800) | |
1681061793.212214: Worker 0: training step 2925 done (global step: 5802) | |
1681061793.217293: Worker 0: training step 2926 done (global step: 5803) | |
1681061793.222365: Worker 0: training step 2927 done (global step: 5805) | |
1681061793.227076: Worker 0: training step 2928 done (global step: 5806) | |
1681061793.231766: Worker 0: training step 2929 done (global step: 5808) | |
1681061793.237345: Worker 0: training step 2930 done (global step: 5810) | |
1681061793.244250: Worker 0: training step 2931 done (global step: 5812) | |
1681061793.250272: Worker 0: training step 2932 done (global step: 5814) | |
1681061793.257077: Worker 0: training step 2933 done (global step: 5817) | |
1681061793.262190: Worker 0: training step 2934 done (global step: 5819) | |
1681061793.266860: Worker 0: training step 2935 done (global step: 5820) | |
1681061793.275369: Worker 0: training step 2936 done (global step: 5822) | |
1681061793.281824: Worker 0: training step 2937 done (global step: 5825) | |
1681061793.288307: Worker 0: training step 2938 done (global step: 5826) | |
1681061793.293776: Worker 0: training step 2939 done (global step: 5829) | |
1681061793.302420: Worker 0: training step 2940 done (global step: 5830) | |
1681061793.311764: Worker 0: training step 2941 done (global step: 5833) | |
1681061793.317257: Worker 0: training step 2942 done (global step: 5834) | |
1681061793.328638: Worker 0: training step 2943 done (global step: 5837) | |
1681061793.337945: Worker 0: training step 2944 done (global step: 5839) | |
1681061793.346091: Worker 0: training step 2945 done (global step: 5841) | |
1681061793.362883: Worker 0: training step 2946 done (global step: 5843) | |
1681061793.377979: Worker 0: training step 2947 done (global step: 5845) | |
1681061793.391977: Worker 0: training step 2948 done (global step: 5847) | |
1681061793.401480: Worker 0: training step 2949 done (global step: 5849) | |
1681061793.410414: Worker 0: training step 2950 done (global step: 5851) | |
1681061793.419248: Worker 0: training step 2951 done (global step: 5853) | |
1681061793.427266: Worker 0: training step 2952 done (global step: 5855) | |
1681061793.436100: Worker 0: training step 2953 done (global step: 5857) | |
1681061793.444069: Worker 0: training step 2954 done (global step: 5859) | |
1681061793.453395: Worker 0: training step 2955 done (global step: 5861) | |
1681061793.461434: Worker 0: training step 2956 done (global step: 5864) | |
1681061793.472684: Worker 0: training step 2957 done (global step: 5866) | |
1681061793.489789: Worker 0: training step 2958 done (global step: 5868) | |
1681061793.506110: Worker 0: training step 2959 done (global step: 5869) | |
1681061793.515951: Worker 0: training step 2960 done (global step: 5871) | |
1681061793.529116: Worker 0: training step 2961 done (global step: 5873) | |
1681061793.544496: Worker 0: training step 2962 done (global step: 5875) | |
1681061793.557111: Worker 0: training step 2963 done (global step: 5877) | |
1681061793.566140: Worker 0: training step 2964 done (global step: 5880) | |
1681061793.573741: Worker 0: training step 2965 done (global step: 5882) | |
1681061793.579448: Worker 0: training step 2966 done (global step: 5883) | |
1681061793.584601: Worker 0: training step 2967 done (global step: 5886) | |
1681061793.590669: Worker 0: training step 2968 done (global step: 5887) | |
1681061793.600454: Worker 0: training step 2969 done (global step: 5889) | |
1681061793.613388: Worker 0: training step 2970 done (global step: 5891) | |
1681061793.623810: Worker 0: training step 2971 done (global step: 5893) | |
1681061793.633018: Worker 0: training step 2972 done (global step: 5895) | |
1681061793.641082: Worker 0: training step 2973 done (global step: 5898) | |
1681061793.648096: Worker 0: training step 2974 done (global step: 5900) | |
1681061793.654089: Worker 0: training step 2975 done (global step: 5902) | |
1681061793.659524: Worker 0: training step 2976 done (global step: 5904) | |
1681061793.664668: Worker 0: training step 2977 done (global step: 5906) | |
1681061793.669964: Worker 0: training step 2978 done (global step: 5908) | |
1681061793.675104: Worker 0: training step 2979 done (global step: 5910) | |
1681061793.681137: Worker 0: training step 2980 done (global step: 5912) | |
1681061793.685957: Worker 0: training step 2981 done (global step: 5914) | |
1681061793.691176: Worker 0: training step 2982 done (global step: 5916) | |
1681061793.696538: Worker 0: training step 2983 done (global step: 5917) | |
1681061793.702939: Worker 0: training step 2984 done (global step: 5920) | |
1681061793.707601: Worker 0: training step 2985 done (global step: 5922) | |
1681061793.712062: Worker 0: training step 2986 done (global step: 5923) | |
1681061793.716638: Worker 0: training step 2987 done (global step: 5925) | |
1681061793.722433: Worker 0: training step 2988 done (global step: 5927) | |
1681061793.727856: Worker 0: training step 2989 done (global step: 5929) | |
1681061793.733494: Worker 0: training step 2990 done (global step: 5931) | |
1681061793.740512: Worker 0: training step 2991 done (global step: 5933) | |
1681061793.745964: Worker 0: training step 2992 done (global step: 5935) | |
1681061793.752405: Worker 0: training step 2993 done (global step: 5937) | |
1681061793.757835: Worker 0: training step 2994 done (global step: 5940) | |
1681061793.764616: Worker 0: training step 2995 done (global step: 5942) | |
1681061793.770247: Worker 0: training step 2996 done (global step: 5944) | |
1681061793.776392: Worker 0: training step 2997 done (global step: 5946) | |
1681061793.782931: Worker 0: training step 2998 done (global step: 5948) | |
1681061793.788648: Worker 0: training step 2999 done (global step: 5950) | |
1681061793.793567: Worker 0: training step 3000 done (global step: 5952) | |
1681061793.798751: Worker 0: training step 3001 done (global step: 5954) | |
1681061793.804492: Worker 0: training step 3002 done (global step: 5956) | |
1681061793.809771: Worker 0: training step 3003 done (global step: 5958) | |
1681061793.814779: Worker 0: training step 3004 done (global step: 5960) | |
1681061793.819712: Worker 0: training step 3005 done (global step: 5962) | |
1681061793.824640: Worker 0: training step 3006 done (global step: 5964) | |
1681061793.830428: Worker 0: training step 3007 done (global step: 5965) | |
1681061793.835492: Worker 0: training step 3008 done (global step: 5968) | |
1681061793.840556: Worker 0: training step 3009 done (global step: 5969) | |
1681061793.845670: Worker 0: training step 3010 done (global step: 5971) | |
1681061793.852334: Worker 0: training step 3011 done (global step: 5973) | |
1681061793.857992: Worker 0: training step 3012 done (global step: 5976) | |
1681061793.864918: Worker 0: training step 3013 done (global step: 5978) | |
1681061793.871031: Worker 0: training step 3014 done (global step: 5980) | |
1681061793.875837: Worker 0: training step 3015 done (global step: 5982) | |
1681061793.881754: Worker 0: training step 3016 done (global step: 5984) | |
1681061793.886993: Worker 0: training step 3017 done (global step: 5986) | |
1681061793.891831: Worker 0: training step 3018 done (global step: 5988) | |
1681061793.897778: Worker 0: training step 3019 done (global step: 5990) | |
1681061793.904766: Worker 0: training step 3020 done (global step: 5992) | |
1681061793.912137: Worker 0: training step 3021 done (global step: 5994) | |
1681061793.919071: Worker 0: training step 3022 done (global step: 5996) | |
1681061793.925096: Worker 0: training step 3023 done (global step: 5998) | |
1681061793.931574: Worker 0: training step 3024 done (global step: 6000) | |
1681061793.939180: Worker 0: training step 3025 done (global step: 6002) | |
1681061793.945445: Worker 0: training step 3026 done (global step: 6004) | |
1681061793.950843: Worker 0: training step 3027 done (global step: 6005) | |
1681061793.956136: Worker 0: training step 3028 done (global step: 6008) | |
1681061793.960853: Worker 0: training step 3029 done (global step: 6009) | |
1681061793.966570: Worker 0: training step 3030 done (global step: 6011) | |
1681061793.972015: Worker 0: training step 3031 done (global step: 6013) | |
1681061793.977816: Worker 0: training step 3032 done (global step: 6015) | |
1681061793.983178: Worker 0: training step 3033 done (global step: 6017) | |
1681061793.989404: Worker 0: training step 3034 done (global step: 6019) | |
1681061793.994796: Worker 0: training step 3035 done (global step: 6021) | |
1681061794.000506: Worker 0: training step 3036 done (global step: 6023) | |
1681061794.005965: Worker 0: training step 3037 done (global step: 6025) | |
1681061794.010928: Worker 0: training step 3038 done (global step: 6027) | |
1681061794.016249: Worker 0: training step 3039 done (global step: 6029) | |
1681061794.021225: Worker 0: training step 3040 done (global step: 6031) | |
1681061794.026355: Worker 0: training step 3041 done (global step: 6033) | |
1681061794.031446: Worker 0: training step 3042 done (global step: 6035) | |
1681061794.036404: Worker 0: training step 3043 done (global step: 6036) | |
1681061794.041765: Worker 0: training step 3044 done (global step: 6038) | |
1681061794.050071: Worker 0: training step 3045 done (global step: 6040) | |
1681061794.057791: Worker 0: training step 3046 done (global step: 6043) | |
1681061794.072581: Worker 0: training step 3047 done (global step: 6045) | |
1681061794.079015: Worker 0: training step 3048 done (global step: 6048) | |
1681061794.084233: Worker 0: training step 3049 done (global step: 6050) | |
1681061794.090329: Worker 0: training step 3050 done (global step: 6052) | |
1681061794.095680: Worker 0: training step 3051 done (global step: 6054) | |
1681061794.101441: Worker 0: training step 3052 done (global step: 6056) | |
1681061794.106977: Worker 0: training step 3053 done (global step: 6058) | |
1681061794.112177: Worker 0: training step 3054 done (global step: 6060) | |
1681061794.117797: Worker 0: training step 3055 done (global step: 6062) | |
1681061794.123396: Worker 0: training step 3056 done (global step: 6064) | |
1681061794.128879: Worker 0: training step 3057 done (global step: 6066) | |
1681061794.134718: Worker 0: training step 3058 done (global step: 6068) | |
1681061794.139936: Worker 0: training step 3059 done (global step: 6070) | |
1681061794.145368: Worker 0: training step 3060 done (global step: 6072) | |
1681061794.150678: Worker 0: training step 3061 done (global step: 6074) | |
1681061794.156098: Worker 0: training step 3062 done (global step: 6076) | |
1681061794.161809: Worker 0: training step 3063 done (global step: 6078) | |
1681061794.167199: Worker 0: training step 3064 done (global step: 6080) | |
1681061794.173150: Worker 0: training step 3065 done (global step: 6082) | |
1681061794.178893: Worker 0: training step 3066 done (global step: 6084) | |
1681061794.184304: Worker 0: training step 3067 done (global step: 6086) | |
1681061794.189485: Worker 0: training step 3068 done (global step: 6088) | |
1681061794.195139: Worker 0: training step 3069 done (global step: 6090) | |
1681061794.199903: Worker 0: training step 3070 done (global step: 6092) | |
1681061794.205414: Worker 0: training step 3071 done (global step: 6094) | |
1681061794.210603: Worker 0: training step 3072 done (global step: 6096) | |
1681061794.216516: Worker 0: training step 3073 done (global step: 6098) | |
1681061794.222732: Worker 0: training step 3074 done (global step: 6100) | |
1681061794.229870: Worker 0: training step 3075 done (global step: 6102) | |
1681061794.235795: Worker 0: training step 3076 done (global step: 6105) | |
1681061794.241819: Worker 0: training step 3077 done (global step: 6107) | |
1681061794.246733: Worker 0: training step 3078 done (global step: 6109) | |
1681061794.252566: Worker 0: training step 3079 done (global step: 6111) | |
1681061794.258736: Worker 0: training step 3080 done (global step: 6113) | |
1681061794.263858: Worker 0: training step 3081 done (global step: 6115) | |
1681061794.269426: Worker 0: training step 3082 done (global step: 6117) | |
1681061794.274800: Worker 0: training step 3083 done (global step: 6119) | |
1681061794.279890: Worker 0: training step 3084 done (global step: 6121) | |
1681061794.285060: Worker 0: training step 3085 done (global step: 6123) | |
1681061794.289347: Worker 0: training step 3086 done (global step: 6124) | |
1681061794.294770: Worker 0: training step 3087 done (global step: 6126) | |
1681061794.300390: Worker 0: training step 3088 done (global step: 6128) | |
1681061794.306208: Worker 0: training step 3089 done (global step: 6130) | |
1681061794.312808: Worker 0: training step 3090 done (global step: 6132) | |
1681061794.319351: Worker 0: training step 3091 done (global step: 6133) | |
1681061794.324511: Worker 0: training step 3092 done (global step: 6135) | |
1681061794.329931: Worker 0: training step 3093 done (global step: 6137) | |
1681061794.334729: Worker 0: training step 3094 done (global step: 6139) | |
1681061794.340855: Worker 0: training step 3095 done (global step: 6141) | |
1681061794.346056: Worker 0: training step 3096 done (global step: 6144) | |
1681061794.351525: Worker 0: training step 3097 done (global step: 6145) | |
1681061794.356571: Worker 0: training step 3098 done (global step: 6147) | |
1681061794.361959: Worker 0: training step 3099 done (global step: 6149) | |
1681061794.367800: Worker 0: training step 3100 done (global step: 6152) | |
1681061794.372412: Worker 0: training step 3101 done (global step: 6153) | |
1681061794.379024: Worker 0: training step 3102 done (global step: 6155) | |
1681061794.384503: Worker 0: training step 3103 done (global step: 6157) | |
1681061794.390766: Worker 0: training step 3104 done (global step: 6159) | |
1681061794.396187: Worker 0: training step 3105 done (global step: 6161) | |
1681061794.401564: Worker 0: training step 3106 done (global step: 6163) | |
1681061794.406621: Worker 0: training step 3107 done (global step: 6165) | |
1681061794.413154: Worker 0: training step 3108 done (global step: 6167) | |
1681061794.419242: Worker 0: training step 3109 done (global step: 6169) | |
1681061794.424084: Worker 0: training step 3110 done (global step: 6172) | |
1681061794.429014: Worker 0: training step 3111 done (global step: 6173) | |
1681061794.434702: Worker 0: training step 3112 done (global step: 6175) | |
1681061794.441189: Worker 0: training step 3113 done (global step: 6177) | |
1681061794.447052: Worker 0: training step 3114 done (global step: 6179) | |
1681061794.452833: Worker 0: training step 3115 done (global step: 6181) | |
1681061794.458674: Worker 0: training step 3116 done (global step: 6183) | |
1681061794.465279: Worker 0: training step 3117 done (global step: 6185) | |
1681061794.472118: Worker 0: training step 3118 done (global step: 6187) | |
1681061794.477707: Worker 0: training step 3119 done (global step: 6189) | |
1681061794.482765: Worker 0: training step 3120 done (global step: 6191) | |
1681061794.488984: Worker 0: training step 3121 done (global step: 6193) | |
1681061794.494680: Worker 0: training step 3122 done (global step: 6195) | |
1681061794.499406: Worker 0: training step 3123 done (global step: 6197) | |
1681061794.505016: Worker 0: training step 3124 done (global step: 6199) | |
1681061794.510802: Worker 0: training step 3125 done (global step: 6201) | |
1681061794.516356: Worker 0: training step 3126 done (global step: 6203) | |
1681061794.522417: Worker 0: training step 3127 done (global step: 6205) | |
1681061794.527415: Worker 0: training step 3128 done (global step: 6207) | |
1681061794.533963: Worker 0: training step 3129 done (global step: 6209) | |
1681061794.540455: Worker 0: training step 3130 done (global step: 6211) | |
1681061794.547555: Worker 0: training step 3131 done (global step: 6213) | |
1681061794.553177: Worker 0: training step 3132 done (global step: 6215) | |
1681061794.559119: Worker 0: training step 3133 done (global step: 6217) | |
1681061794.564755: Worker 0: training step 3134 done (global step: 6219) | |
1681061794.571164: Worker 0: training step 3135 done (global step: 6221) | |
1681061794.577555: Worker 0: training step 3136 done (global step: 6223) | |
1681061794.582966: Worker 0: training step 3137 done (global step: 6226) | |
1681061794.589257: Worker 0: training step 3138 done (global step: 6228) | |
1681061794.594103: Worker 0: training step 3139 done (global step: 6230) | |
1681061794.599290: Worker 0: training step 3140 done (global step: 6232) | |
1681061794.604382: Worker 0: training step 3141 done (global step: 6234) | |
1681061794.610949: Worker 0: training step 3142 done (global step: 6235) | |
1681061794.616374: Worker 0: training step 3143 done (global step: 6238) | |
1681061794.622228: Worker 0: training step 3144 done (global step: 6240) | |
1681061794.627506: Worker 0: training step 3145 done (global step: 6242) | |
1681061794.633273: Worker 0: training step 3146 done (global step: 6244) | |
1681061794.639404: Worker 0: training step 3147 done (global step: 6246) | |
1681061794.644051: Worker 0: training step 3148 done (global step: 6248) | |
1681061794.653662: Worker 0: training step 3149 done (global step: 6250) | |
1681061794.659882: Worker 0: training step 3150 done (global step: 6252) | |
1681061794.665338: Worker 0: training step 3151 done (global step: 6254) | |
1681061794.671397: Worker 0: training step 3152 done (global step: 6256) | |
1681061794.676468: Worker 0: training step 3153 done (global step: 6258) | |
1681061794.682260: Worker 0: training step 3154 done (global step: 6260) | |
1681061794.687678: Worker 0: training step 3155 done (global step: 6262) | |
1681061794.692333: Worker 0: training step 3156 done (global step: 6264) | |
1681061794.698222: Worker 0: training step 3157 done (global step: 6265) | |
1681061794.703753: Worker 0: training step 3158 done (global step: 6267) | |
1681061794.709097: Worker 0: training step 3159 done (global step: 6270) | |
1681061794.716323: Worker 0: training step 3160 done (global step: 6272) | |
1681061794.723994: Worker 0: training step 3161 done (global step: 6274) | |
1681061794.730820: Worker 0: training step 3162 done (global step: 6276) | |
1681061794.738175: Worker 0: training step 3163 done (global step: 6278) | |
1681061794.744734: Worker 0: training step 3164 done (global step: 6280) | |
1681061794.751278: Worker 0: training step 3165 done (global step: 6282) | |
1681061794.757535: Worker 0: training step 3166 done (global step: 6284) | |
1681061794.764817: Worker 0: training step 3167 done (global step: 6285) | |
1681061794.773204: Worker 0: training step 3168 done (global step: 6287) | |
1681061794.779853: Worker 0: training step 3169 done (global step: 6290) | |
1681061794.785592: Worker 0: training step 3170 done (global step: 6292) | |
1681061794.792010: Worker 0: training step 3171 done (global step: 6293) | |
1681061794.799577: Worker 0: training step 3172 done (global step: 6295) | |
1681061794.805734: Worker 0: training step 3173 done (global step: 6297) | |
1681061794.811753: Worker 0: training step 3174 done (global step: 6298) | |
1681061794.818979: Worker 0: training step 3175 done (global step: 6300) | |
1681061794.826647: Worker 0: training step 3176 done (global step: 6302) | |
1681061794.831732: Worker 0: training step 3177 done (global step: 6304) | |
1681061794.837765: Worker 0: training step 3178 done (global step: 6306) | |
1681061794.843008: Worker 0: training step 3179 done (global step: 6308) | |
1681061794.848507: Worker 0: training step 3180 done (global step: 6309) | |
1681061794.855098: Worker 0: training step 3181 done (global step: 6312) | |
1681061794.861190: Worker 0: training step 3182 done (global step: 6314) | |
1681061794.866266: Worker 0: training step 3183 done (global step: 6316) | |
1681061794.871986: Worker 0: training step 3184 done (global step: 6318) | |
1681061794.877678: Worker 0: training step 3185 done (global step: 6320) | |
1681061794.883315: Worker 0: training step 3186 done (global step: 6322) | |
1681061794.889652: Worker 0: training step 3187 done (global step: 6324) | |
1681061794.895933: Worker 0: training step 3188 done (global step: 6326) | |
1681061794.902080: Worker 0: training step 3189 done (global step: 6328) | |
1681061794.907196: Worker 0: training step 3190 done (global step: 6330) | |
1681061794.912359: Worker 0: training step 3191 done (global step: 6332) | |
1681061794.918016: Worker 0: training step 3192 done (global step: 6333) | |
1681061794.922913: Worker 0: training step 3193 done (global step: 6336) | |
1681061794.928276: Worker 0: training step 3194 done (global step: 6337) | |
1681061794.934437: Worker 0: training step 3195 done (global step: 6339) | |
1681061794.939582: Worker 0: training step 3196 done (global step: 6341) | |
1681061794.944854: Worker 0: training step 3197 done (global step: 6343) | |
1681061794.950804: Worker 0: training step 3198 done (global step: 6345) | |
1681061794.957361: Worker 0: training step 3199 done (global step: 6347) | |
1681061794.963104: Worker 0: training step 3200 done (global step: 6349) | |
1681061794.968500: Worker 0: training step 3201 done (global step: 6351) | |
1681061794.974752: Worker 0: training step 3202 done (global step: 6353) | |
1681061794.980385: Worker 0: training step 3203 done (global step: 6355) | |
1681061794.985422: Worker 0: training step 3204 done (global step: 6358) | |
1681061794.992455: Worker 0: training step 3205 done (global step: 6359) | |
1681061794.997911: Worker 0: training step 3206 done (global step: 6361) | |
1681061795.003130: Worker 0: training step 3207 done (global step: 6363) | |
1681061795.009163: Worker 0: training step 3208 done (global step: 6365) | |
1681061795.014597: Worker 0: training step 3209 done (global step: 6367) | |
1681061795.019804: Worker 0: training step 3210 done (global step: 6369) | |
1681061795.026267: Worker 0: training step 3211 done (global step: 6371) | |
1681061795.032010: Worker 0: training step 3212 done (global step: 6373) | |
1681061795.037925: Worker 0: training step 3213 done (global step: 6375) | |
1681061795.044932: Worker 0: training step 3214 done (global step: 6377) | |
1681061795.050746: Worker 0: training step 3215 done (global step: 6380) | |
1681061795.056223: Worker 0: training step 3216 done (global step: 6381) | |
1681061795.061511: Worker 0: training step 3217 done (global step: 6383) | |
1681061795.067042: Worker 0: training step 3218 done (global step: 6385) | |
1681061795.072644: Worker 0: training step 3219 done (global step: 6387) | |
1681061795.078952: Worker 0: training step 3220 done (global step: 6389) | |
1681061795.085580: Worker 0: training step 3221 done (global step: 6391) | |
1681061795.091989: Worker 0: training step 3222 done (global step: 6393) | |
1681061795.098238: Worker 0: training step 3223 done (global step: 6395) | |
1681061795.103480: Worker 0: training step 3224 done (global step: 6397) | |
1681061795.109211: Worker 0: training step 3225 done (global step: 6399) | |
1681061795.115120: Worker 0: training step 3226 done (global step: 6401) | |
1681061795.120904: Worker 0: training step 3227 done (global step: 6403) | |
1681061795.127408: Worker 0: training step 3228 done (global step: 6405) | |
1681061795.133536: Worker 0: training step 3229 done (global step: 6407) | |
1681061795.139088: Worker 0: training step 3230 done (global step: 6409) | |
1681061795.144907: Worker 0: training step 3231 done (global step: 6411) | |
1681061795.151356: Worker 0: training step 3232 done (global step: 6413) | |
1681061795.157236: Worker 0: training step 3233 done (global step: 6415) | |
1681061795.163760: Worker 0: training step 3234 done (global step: 6417) | |
1681061795.169276: Worker 0: training step 3235 done (global step: 6420) | |
1681061795.174736: Worker 0: training step 3236 done (global step: 6422) | |
1681061795.179657: Worker 0: training step 3237 done (global step: 6423) | |
1681061795.185193: Worker 0: training step 3238 done (global step: 6425) | |
1681061795.191177: Worker 0: training step 3239 done (global step: 6427) | |
1681061795.197893: Worker 0: training step 3240 done (global step: 6430) | |
1681061795.203648: Worker 0: training step 3241 done (global step: 6432) | |
1681061795.208838: Worker 0: training step 3242 done (global step: 6434) | |
1681061795.214350: Worker 0: training step 3243 done (global step: 6436) | |
1681061795.220524: Worker 0: training step 3244 done (global step: 6438) | |
1681061795.225888: Worker 0: training step 3245 done (global step: 6440) | |
1681061795.231120: Worker 0: training step 3246 done (global step: 6442) | |
1681061795.236550: Worker 0: training step 3247 done (global step: 6444) | |
1681061795.241800: Worker 0: training step 3248 done (global step: 6446) | |
1681061795.246798: Worker 0: training step 3249 done (global step: 6448) | |
1681061795.252933: Worker 0: training step 3250 done (global step: 6450) | |
1681061795.258927: Worker 0: training step 3251 done (global step: 6452) | |
1681061795.264071: Worker 0: training step 3252 done (global step: 6454) | |
1681061795.269497: Worker 0: training step 3253 done (global step: 6455) | |
1681061795.275544: Worker 0: training step 3254 done (global step: 6457) | |
1681061795.281364: Worker 0: training step 3255 done (global step: 6460) | |
1681061795.286514: Worker 0: training step 3256 done (global step: 6461) | |
1681061795.292149: Worker 0: training step 3257 done (global step: 6463) | |
1681061795.298993: Worker 0: training step 3258 done (global step: 6465) | |
1681061795.306756: Worker 0: training step 3259 done (global step: 6467) | |
1681061795.313834: Worker 0: training step 3260 done (global step: 6470) | |
1681061795.320515: Worker 0: training step 3261 done (global step: 6472) | |
1681061795.325920: Worker 0: training step 3262 done (global step: 6474) | |
1681061795.331212: Worker 0: training step 3263 done (global step: 6476) | |
1681061795.337116: Worker 0: training step 3264 done (global step: 6478) | |
1681061795.342472: Worker 0: training step 3265 done (global step: 6480) | |
1681061795.347749: Worker 0: training step 3266 done (global step: 6482) | |
1681061795.353496: Worker 0: training step 3267 done (global step: 6484) | |
1681061795.359540: Worker 0: training step 3268 done (global step: 6486) | |
1681061795.365344: Worker 0: training step 3269 done (global step: 6488) | |
1681061795.371144: Worker 0: training step 3270 done (global step: 6490) | |
1681061795.376672: Worker 0: training step 3271 done (global step: 6492) | |
1681061795.382330: Worker 0: training step 3272 done (global step: 6494) | |
1681061795.388760: Worker 0: training step 3273 done (global step: 6496) | |
1681061795.394085: Worker 0: training step 3274 done (global step: 6498) | |
1681061795.399755: Worker 0: training step 3275 done (global step: 6500) | |
1681061795.404229: Worker 0: training step 3276 done (global step: 6502) | |
1681061795.410589: Worker 0: training step 3277 done (global step: 6504) | |
1681061795.416502: Worker 0: training step 3278 done (global step: 6506) | |
1681061795.422903: Worker 0: training step 3279 done (global step: 6508) | |
1681061795.428318: Worker 0: training step 3280 done (global step: 6510) | |
1681061795.433697: Worker 0: training step 3281 done (global step: 6512) | |
1681061795.439047: Worker 0: training step 3282 done (global step: 6514) | |
1681061795.445518: Worker 0: training step 3283 done (global step: 6516) | |
1681061795.451303: Worker 0: training step 3284 done (global step: 6518) | |
1681061795.456773: Worker 0: training step 3285 done (global step: 6520) | |
1681061795.461973: Worker 0: training step 3286 done (global step: 6522) | |
1681061795.467938: Worker 0: training step 3287 done (global step: 6524) | |
1681061795.473898: Worker 0: training step 3288 done (global step: 6526) | |
1681061795.480030: Worker 0: training step 3289 done (global step: 6528) | |
1681061795.486510: Worker 0: training step 3290 done (global step: 6530) | |
1681061795.493604: Worker 0: training step 3291 done (global step: 6532) | |
1681061795.500373: Worker 0: training step 3292 done (global step: 6535) | |
1681061795.505857: Worker 0: training step 3293 done (global step: 6537) | |
1681061795.510866: Worker 0: training step 3294 done (global step: 6539) | |
1681061795.516181: Worker 0: training step 3295 done (global step: 6541) | |
1681061795.521056: Worker 0: training step 3296 done (global step: 6542) | |
1681061795.525738: Worker 0: training step 3297 done (global step: 6544) | |
1681061795.530856: Worker 0: training step 3298 done (global step: 6546) | |
1681061795.536114: Worker 0: training step 3299 done (global step: 6548) | |
1681061795.541831: Worker 0: training step 3300 done (global step: 6550) | |
1681061795.710520: Worker 0: training step 3301 done (global step: 6588) | |
1681061795.717590: Worker 0: training step 3302 done (global step: 6590) | |
1681061795.723042: Worker 0: training step 3303 done (global step: 6592) | |
1681061795.728962: Worker 0: training step 3304 done (global step: 6594) | |
1681061795.734480: Worker 0: training step 3305 done (global step: 6596) | |
1681061795.740758: Worker 0: training step 3306 done (global step: 6598) | |
1681061795.746022: Worker 0: training step 3307 done (global step: 6600) | |
1681061795.751876: Worker 0: training step 3308 done (global step: 6602) | |
1681061795.756992: Worker 0: training step 3309 done (global step: 6604) | |
1681061795.762530: Worker 0: training step 3310 done (global step: 6605) | |
1681061795.767110: Worker 0: training step 3311 done (global step: 6606) | |
1681061795.771479: Worker 0: training step 3312 done (global step: 6607) | |
1681061795.775738: Worker 0: training step 3313 done (global step: 6608) | |
1681061795.780128: Worker 0: training step 3314 done (global step: 6609) | |
1681061795.784945: Worker 0: training step 3315 done (global step: 6610) | |
1681061795.789372: Worker 0: training step 3316 done (global step: 6611) | |
1681061795.794208: Worker 0: training step 3317 done (global step: 6612) | |
1681061795.799125: Worker 0: training step 3318 done (global step: 6613) | |
1681061795.804506: Worker 0: training step 3319 done (global step: 6614) | |
1681061795.809846: Worker 0: training step 3320 done (global step: 6615) | |
1681061795.815250: Worker 0: training step 3321 done (global step: 6616) | |
1681061795.820051: Worker 0: training step 3322 done (global step: 6617) | |
1681061795.825854: Worker 0: training step 3323 done (global step: 6618) | |
1681061795.831237: Worker 0: training step 3324 done (global step: 6619) | |
1681061795.836213: Worker 0: training step 3325 done (global step: 6620) | |
1681061795.840927: Worker 0: training step 3326 done (global step: 6621) | |
1681061795.846059: Worker 0: training step 3327 done (global step: 6622) | |
1681061795.851673: Worker 0: training step 3328 done (global step: 6623) | |
1681061795.857328: Worker 0: training step 3329 done (global step: 6624) | |
1681061795.862945: Worker 0: training step 3330 done (global step: 6625) | |
1681061795.867828: Worker 0: training step 3331 done (global step: 6626) | |
1681061795.872183: Worker 0: training step 3332 done (global step: 6627) | |
1681061795.876646: Worker 0: training step 3333 done (global step: 6628) | |
1681061795.880967: Worker 0: training step 3334 done (global step: 6629) | |
1681061795.885151: Worker 0: training step 3335 done (global step: 6630) | |
1681061795.889190: Worker 0: training step 3336 done (global step: 6631) | |
1681061795.893922: Worker 0: training step 3337 done (global step: 6632) | |
1681061795.897827: Worker 0: training step 3338 done (global step: 6633) | |
1681061795.901870: Worker 0: training step 3339 done (global step: 6634) | |
1681061795.906232: Worker 0: training step 3340 done (global step: 6635) | |
1681061795.911747: Worker 0: training step 3341 done (global step: 6636) | |
1681061795.917811: Worker 0: training step 3342 done (global step: 6638) | |
1681061795.923051: Worker 0: training step 3343 done (global step: 6640) | |
1681061795.928902: Worker 0: training step 3344 done (global step: 6641) | |
1681061795.936114: Worker 0: training step 3345 done (global step: 6643) | |
1681061795.941550: Worker 0: training step 3346 done (global step: 6645) | |
1681061795.948599: Worker 0: training step 3347 done (global step: 6647) | |
1681061795.954497: Worker 0: training step 3348 done (global step: 6649) | |
1681061795.960058: Worker 0: training step 3349 done (global step: 6651) | |
1681061795.966153: Worker 0: training step 3350 done (global step: 6653) | |
1681061795.971229: Worker 0: training step 3351 done (global step: 6655) | |
1681061795.976881: Worker 0: training step 3352 done (global step: 6657) | |
1681061795.981902: Worker 0: training step 3353 done (global step: 6659) | |
1681061795.987736: Worker 0: training step 3354 done (global step: 6661) | |
1681061795.993588: Worker 0: training step 3355 done (global step: 6663) | |
1681061795.999450: Worker 0: training step 3356 done (global step: 6665) | |
1681061796.004677: Worker 0: training step 3357 done (global step: 6667) | |
1681061796.010301: Worker 0: training step 3358 done (global step: 6669) | |
1681061796.016020: Worker 0: training step 3359 done (global step: 6671) | |
1681061796.021776: Worker 0: training step 3360 done (global step: 6673) | |
1681061796.027362: Worker 0: training step 3361 done (global step: 6675) | |
1681061796.033300: Worker 0: training step 3362 done (global step: 6677) | |
1681061796.039315: Worker 0: training step 3363 done (global step: 6679) | |
1681061796.044804: Worker 0: training step 3364 done (global step: 6681) | |
1681061796.051175: Worker 0: training step 3365 done (global step: 6684) | |
1681061796.057087: Worker 0: training step 3366 done (global step: 6685) | |
1681061796.062920: Worker 0: training step 3367 done (global step: 6687) | |
1681061796.069137: Worker 0: training step 3368 done (global step: 6690) | |
1681061796.076735: Worker 0: training step 3369 done (global step: 6691) | |
1681061796.083283: Worker 0: training step 3370 done (global step: 6694) | |
1681061796.088325: Worker 0: training step 3371 done (global step: 6696) | |
1681061796.094415: Worker 0: training step 3372 done (global step: 6698) | |
1681061796.099589: Worker 0: training step 3373 done (global step: 6699) | |
1681061796.105071: Worker 0: training step 3374 done (global step: 6701) | |
1681061796.111034: Worker 0: training step 3375 done (global step: 6703) | |
1681061796.116176: Worker 0: training step 3376 done (global step: 6705) | |
1681061796.121981: Worker 0: training step 3377 done (global step: 6707) | |
1681061796.128235: Worker 0: training step 3378 done (global step: 6709) | |
1681061796.133566: Worker 0: training step 3379 done (global step: 6711) | |
1681061796.139807: Worker 0: training step 3380 done (global step: 6713) | |
1681061796.145318: Worker 0: training step 3381 done (global step: 6716) | |
1681061796.150831: Worker 0: training step 3382 done (global step: 6717) | |
1681061796.157263: Worker 0: training step 3383 done (global step: 6720) | |
1681061796.164032: Worker 0: training step 3384 done (global step: 6722) | |
1681061796.169629: Worker 0: training step 3385 done (global step: 6724) | |
1681061796.175240: Worker 0: training step 3386 done (global step: 6726) | |
1681061796.183954: Worker 0: training step 3387 done (global step: 6728) | |
1681061796.191833: Worker 0: training step 3388 done (global step: 6730) | |
1681061796.200539: Worker 0: training step 3389 done (global step: 6732) | |
1681061796.208177: Worker 0: training step 3390 done (global step: 6734) | |
1681061796.215127: Worker 0: training step 3391 done (global step: 6737) | |
1681061796.221999: Worker 0: training step 3392 done (global step: 6738) | |
1681061796.227547: Worker 0: training step 3393 done (global step: 6740) | |
1681061796.235056: Worker 0: training step 3394 done (global step: 6742) | |
1681061796.242072: Worker 0: training step 3395 done (global step: 6744) | |
1681061796.250811: Worker 0: training step 3396 done (global step: 6746) | |
1681061796.262216: Worker 0: training step 3397 done (global step: 6748) | |
1681061796.267161: Worker 0: training step 3398 done (global step: 6751) | |
1681061796.271552: Worker 0: training step 3399 done (global step: 6752) | |
1681061796.279442: Worker 0: training step 3400 done (global step: 6754) | |
1681061796.289580: Worker 0: training step 3401 done (global step: 6756) | |
1681061796.297507: Worker 0: training step 3402 done (global step: 6758) | |
1681061796.307773: Worker 0: training step 3403 done (global step: 6761) | |
1681061796.314464: Worker 0: training step 3404 done (global step: 6763) | |
1681061796.320317: Worker 0: training step 3405 done (global step: 6765) | |
1681061796.327184: Worker 0: training step 3406 done (global step: 6767) | |
1681061796.332479: Worker 0: training step 3407 done (global step: 6769) | |
1681061796.337943: Worker 0: training step 3408 done (global step: 6771) | |
1681061796.343438: Worker 0: training step 3409 done (global step: 6773) | |
1681061796.348691: Worker 0: training step 3410 done (global step: 6775) | |
1681061796.353752: Worker 0: training step 3411 done (global step: 6777) | |
1681061796.359125: Worker 0: training step 3412 done (global step: 6779) | |
1681061796.364670: Worker 0: training step 3413 done (global step: 6781) | |
1681061796.370544: Worker 0: training step 3414 done (global step: 6783) | |
1681061796.376656: Worker 0: training step 3415 done (global step: 6785) | |
1681061796.381522: Worker 0: training step 3416 done (global step: 6787) | |
1681061796.386788: Worker 0: training step 3417 done (global step: 6789) | |
1681061796.392516: Worker 0: training step 3418 done (global step: 6791) | |
1681061796.397472: Worker 0: training step 3419 done (global step: 6793) | |
1681061796.403296: Worker 0: training step 3420 done (global step: 6795) | |
1681061796.409529: Worker 0: training step 3421 done (global step: 6797) | |
1681061796.415297: Worker 0: training step 3422 done (global step: 6799) | |
1681061796.420645: Worker 0: training step 3423 done (global step: 6801) | |
1681061796.425906: Worker 0: training step 3424 done (global step: 6803) | |
1681061796.431859: Worker 0: training step 3425 done (global step: 6805) | |
1681061796.437886: Worker 0: training step 3426 done (global step: 6807) | |
1681061796.443356: Worker 0: training step 3427 done (global step: 6809) | |
1681061796.448463: Worker 0: training step 3428 done (global step: 6811) | |
1681061796.454049: Worker 0: training step 3429 done (global step: 6813) | |
1681061796.460292: Worker 0: training step 3430 done (global step: 6815) | |
1681061796.466135: Worker 0: training step 3431 done (global step: 6817) | |
1681061796.472846: Worker 0: training step 3432 done (global step: 6818) | |
1681061796.478087: Worker 0: training step 3433 done (global step: 6820) | |
1681061796.482782: Worker 0: training step 3434 done (global step: 6822) | |
1681061796.488437: Worker 0: training step 3435 done (global step: 6824) | |
1681061796.494292: Worker 0: training step 3436 done (global step: 6826) | |
1681061796.499199: Worker 0: training step 3437 done (global step: 6828) | |
1681061796.504220: Worker 0: training step 3438 done (global step: 6829) | |
1681061796.509872: Worker 0: training step 3439 done (global step: 6831) | |
1681061796.514745: Worker 0: training step 3440 done (global step: 6833) | |
1681061796.520245: Worker 0: training step 3441 done (global step: 6835) | |
1681061796.526899: Worker 0: training step 3442 done (global step: 6837) | |
1681061796.531578: Worker 0: training step 3443 done (global step: 6839) | |
1681061796.536901: Worker 0: training step 3444 done (global step: 6841) | |
1681061796.542878: Worker 0: training step 3445 done (global step: 6843) | |
1681061796.548579: Worker 0: training step 3446 done (global step: 6845) | |
1681061796.554598: Worker 0: training step 3447 done (global step: 6847) | |
1681061796.560646: Worker 0: training step 3448 done (global step: 6849) | |
1681061796.567492: Worker 0: training step 3449 done (global step: 6851) | |
1681061796.573347: Worker 0: training step 3450 done (global step: 6854) | |
1681061796.578853: Worker 0: training step 3451 done (global step: 6856) | |
1681061796.584085: Worker 0: training step 3452 done (global step: 6858) | |
1681061796.589199: Worker 0: training step 3453 done (global step: 6860) | |
1681061796.594484: Worker 0: training step 3454 done (global step: 6862) | |
1681061796.599639: Worker 0: training step 3455 done (global step: 6864) | |
1681061796.604953: Worker 0: training step 3456 done (global step: 6866) | |
1681061796.611026: Worker 0: training step 3457 done (global step: 6868) | |
1681061796.616241: Worker 0: training step 3458 done (global step: 6870) | |
1681061796.622833: Worker 0: training step 3459 done (global step: 6872) | |
1681061796.628324: Worker 0: training step 3460 done (global step: 6874) | |
1681061796.636258: Worker 0: training step 3461 done (global step: 6876) | |
1681061796.642306: Worker 0: training step 3462 done (global step: 6878) | |
1681061796.647635: Worker 0: training step 3463 done (global step: 6881) | |
1681061796.652875: Worker 0: training step 3464 done (global step: 6882) | |
1681061796.659166: Worker 0: training step 3465 done (global step: 6884) | |
1681061796.665097: Worker 0: training step 3466 done (global step: 6886) | |
1681061796.671117: Worker 0: training step 3467 done (global step: 6889) | |
1681061796.676213: Worker 0: training step 3468 done (global step: 6891) | |
1681061796.681526: Worker 0: training step 3469 done (global step: 6893) | |
1681061796.687292: Worker 0: training step 3470 done (global step: 6895) | |
1681061796.692335: Worker 0: training step 3471 done (global step: 6897) | |
1681061796.697759: Worker 0: training step 3472 done (global step: 6899) | |
1681061796.703228: Worker 0: training step 3473 done (global step: 6901) | |
1681061796.708745: Worker 0: training step 3474 done (global step: 6903) | |
1681061796.714075: Worker 0: training step 3475 done (global step: 6905) | |
1681061796.719264: Worker 0: training step 3476 done (global step: 6907) | |
1681061796.724526: Worker 0: training step 3477 done (global step: 6909) | |
1681061796.729550: Worker 0: training step 3478 done (global step: 6911) | |
1681061796.734834: Worker 0: training step 3479 done (global step: 6913) | |
1681061796.740410: Worker 0: training step 3480 done (global step: 6915) | |
1681061796.745561: Worker 0: training step 3481 done (global step: 6917) | |
1681061796.751018: Worker 0: training step 3482 done (global step: 6919) | |
1681061796.756803: Worker 0: training step 3483 done (global step: 6921) | |
1681061796.762365: Worker 0: training step 3484 done (global step: 6923) | |
1681061796.767429: Worker 0: training step 3485 done (global step: 6924) | |
1681061796.773353: Worker 0: training step 3486 done (global step: 6926) | |
1681061796.778975: Worker 0: training step 3487 done (global step: 6929) | |
1681061796.784603: Worker 0: training step 3488 done (global step: 6931) | |
1681061796.789945: Worker 0: training step 3489 done (global step: 6933) | |
1681061796.794278: Worker 0: training step 3490 done (global step: 6934) | |
1681061796.799429: Worker 0: training step 3491 done (global step: 6936) | |
1681061796.805142: Worker 0: training step 3492 done (global step: 6938) | |
1681061796.811203: Worker 0: training step 3493 done (global step: 6940) | |
1681061796.815902: Worker 0: training step 3494 done (global step: 6942) | |
1681061796.820897: Worker 0: training step 3495 done (global step: 6944) | |
1681061796.826287: Worker 0: training step 3496 done (global step: 6946) | |
1681061796.831181: Worker 0: training step 3497 done (global step: 6948) | |
1681061796.836050: Worker 0: training step 3498 done (global step: 6950) | |
1681061796.841166: Worker 0: training step 3499 done (global step: 6951) | |
1681061796.847145: Worker 0: training step 3500 done (global step: 6953) | |
1681061796.852162: Worker 0: training step 3501 done (global step: 6955) | |
1681061796.856875: Worker 0: training step 3502 done (global step: 6957) | |
1681061796.862048: Worker 0: training step 3503 done (global step: 6959) | |
1681061796.867872: Worker 0: training step 3504 done (global step: 6961) | |
1681061796.873756: Worker 0: training step 3505 done (global step: 6963) | |
1681061796.878716: Worker 0: training step 3506 done (global step: 6965) | |
1681061796.884107: Worker 0: training step 3507 done (global step: 6967) | |
1681061796.889951: Worker 0: training step 3508 done (global step: 6969) | |
1681061796.895349: Worker 0: training step 3509 done (global step: 6971) | |
1681061796.900581: Worker 0: training step 3510 done (global step: 6973) | |
1681061796.906172: Worker 0: training step 3511 done (global step: 6975) | |
1681061796.912045: Worker 0: training step 3512 done (global step: 6977) | |
1681061796.917445: Worker 0: training step 3513 done (global step: 6979) | |
1681061796.922954: Worker 0: training step 3514 done (global step: 6981) | |
1681061796.929090: Worker 0: training step 3515 done (global step: 6983) | |
1681061796.934549: Worker 0: training step 3516 done (global step: 6985) | |
1681061796.939821: Worker 0: training step 3517 done (global step: 6987) | |
1681061796.945469: Worker 0: training step 3518 done (global step: 6989) | |
1681061796.951714: Worker 0: training step 3519 done (global step: 6991) | |
1681061796.957545: Worker 0: training step 3520 done (global step: 6993) | |
1681061796.963274: Worker 0: training step 3521 done (global step: 6995) | |
1681061796.968730: Worker 0: training step 3522 done (global step: 6997) | |
1681061796.974108: Worker 0: training step 3523 done (global step: 6999) | |
1681061796.979141: Worker 0: training step 3524 done (global step: 7001) | |
1681061796.984729: Worker 0: training step 3525 done (global step: 7003) | |
1681061796.990449: Worker 0: training step 3526 done (global step: 7005) | |
1681061796.996931: Worker 0: training step 3527 done (global step: 7007) | |
1681061797.002027: Worker 0: training step 3528 done (global step: 7009) | |
1681061797.008273: Worker 0: training step 3529 done (global step: 7011) | |
1681061797.013745: Worker 0: training step 3530 done (global step: 7013) | |
1681061797.019421: Worker 0: training step 3531 done (global step: 7015) | |
1681061797.024318: Worker 0: training step 3532 done (global step: 7018) | |
1681061797.029303: Worker 0: training step 3533 done (global step: 7019) | |
1681061797.034408: Worker 0: training step 3534 done (global step: 7021) | |
1681061797.040213: Worker 0: training step 3535 done (global step: 7023) | |
1681061797.045600: Worker 0: training step 3536 done (global step: 7025) | |
1681061797.050720: Worker 0: training step 3537 done (global step: 7027) | |
1681061797.056124: Worker 0: training step 3538 done (global step: 7029) | |
1681061797.061464: Worker 0: training step 3539 done (global step: 7031) | |
1681061797.066967: Worker 0: training step 3540 done (global step: 7033) | |
1681061797.072360: Worker 0: training step 3541 done (global step: 7035) | |
1681061797.077532: Worker 0: training step 3542 done (global step: 7037) | |
1681061797.082988: Worker 0: training step 3543 done (global step: 7039) | |
1681061797.088042: Worker 0: training step 3544 done (global step: 7041) | |
1681061797.093980: Worker 0: training step 3545 done (global step: 7043) | |
1681061797.099092: Worker 0: training step 3546 done (global step: 7045) | |
1681061797.104276: Worker 0: training step 3547 done (global step: 7047) | |
1681061797.110080: Worker 0: training step 3548 done (global step: 7049) | |
1681061797.115794: Worker 0: training step 3549 done (global step: 7051) | |
1681061797.122008: Worker 0: training step 3550 done (global step: 7053) | |
1681061797.128237: Worker 0: training step 3551 done (global step: 7055) | |
1681061797.133512: Worker 0: training step 3552 done (global step: 7057) | |
1681061797.139783: Worker 0: training step 3553 done (global step: 7060) | |
1681061797.145136: Worker 0: training step 3554 done (global step: 7062) | |
1681061797.151058: Worker 0: training step 3555 done (global step: 7064) | |
1681061797.156523: Worker 0: training step 3556 done (global step: 7066) | |
1681061797.161657: Worker 0: training step 3557 done (global step: 7068) | |
1681061797.167499: Worker 0: training step 3558 done (global step: 7070) | |
1681061797.173248: Worker 0: training step 3559 done (global step: 7072) | |
1681061797.178635: Worker 0: training step 3560 done (global step: 7074) | |
1681061797.185627: Worker 0: training step 3561 done (global step: 7076) | |
1681061797.190924: Worker 0: training step 3562 done (global step: 7078) | |
1681061797.196337: Worker 0: training step 3563 done (global step: 7081) | |
1681061797.201570: Worker 0: training step 3564 done (global step: 7083) | |
1681061797.207803: Worker 0: training step 3565 done (global step: 7084) | |
1681061797.213358: Worker 0: training step 3566 done (global step: 7087) | |
1681061797.218973: Worker 0: training step 3567 done (global step: 7089) | |
1681061797.224334: Worker 0: training step 3568 done (global step: 7091) | |
1681061797.229551: Worker 0: training step 3569 done (global step: 7093) | |
1681061797.235130: Worker 0: training step 3570 done (global step: 7095) | |
1681061797.240458: Worker 0: training step 3571 done (global step: 7097) | |
1681061797.246426: Worker 0: training step 3572 done (global step: 7099) | |
1681061797.251876: Worker 0: training step 3573 done (global step: 7101) | |
1681061797.257799: Worker 0: training step 3574 done (global step: 7103) | |
1681061797.262960: Worker 0: training step 3575 done (global step: 7105) | |
1681061797.268331: Worker 0: training step 3576 done (global step: 7107) | |
1681061797.273946: Worker 0: training step 3577 done (global step: 7109) | |
1681061797.279554: Worker 0: training step 3578 done (global step: 7111) | |
1681061797.284783: Worker 0: training step 3579 done (global step: 7113) | |
1681061797.290492: Worker 0: training step 3580 done (global step: 7115) | |
1681061797.295509: Worker 0: training step 3581 done (global step: 7117) | |
1681061797.301770: Worker 0: training step 3582 done (global step: 7119) | |
1681061797.311006: Worker 0: training step 3583 done (global step: 7121) | |
1681061797.318736: Worker 0: training step 3584 done (global step: 7122) | |
1681061797.324888: Worker 0: training step 3585 done (global step: 7124) | |
1681061797.331326: Worker 0: training step 3586 done (global step: 7126) | |
1681061797.337343: Worker 0: training step 3587 done (global step: 7128) | |
1681061797.343022: Worker 0: training step 3588 done (global step: 7130) | |
1681061797.348172: Worker 0: training step 3589 done (global step: 7132) | |
1681061797.354577: Worker 0: training step 3590 done (global step: 7135) | |
1681061797.360757: Worker 0: training step 3591 done (global step: 7136) | |
1681061797.367084: Worker 0: training step 3592 done (global step: 7139) | |
1681061797.372797: Worker 0: training step 3593 done (global step: 7141) | |
1681061797.378293: Worker 0: training step 3594 done (global step: 7143) | |
1681061797.383603: Worker 0: training step 3595 done (global step: 7145) | |
1681061797.390148: Worker 0: training step 3596 done (global step: 7147) | |
1681061797.395944: Worker 0: training step 3597 done (global step: 7149) | |
1681061797.401482: Worker 0: training step 3598 done (global step: 7151) | |
1681061797.408558: Worker 0: training step 3599 done (global step: 7153) | |
1681061797.414729: Worker 0: training step 3600 done (global step: 7156) | |
1681061797.420357: Worker 0: training step 3601 done (global step: 7158) | |
1681061797.426114: Worker 0: training step 3602 done (global step: 7160) | |
1681061797.431921: Worker 0: training step 3603 done (global step: 7162) | |
1681061797.437259: Worker 0: training step 3604 done (global step: 7164) | |
1681061797.442458: Worker 0: training step 3605 done (global step: 7166) | |
1681061797.447679: Worker 0: training step 3606 done (global step: 7168) | |
1681061797.454184: Worker 0: training step 3607 done (global step: 7170) | |
1681061797.459276: Worker 0: training step 3608 done (global step: 7172) | |
1681061797.464737: Worker 0: training step 3609 done (global step: 7174) | |
1681061797.470406: Worker 0: training step 3610 done (global step: 7176) | |
1681061797.476078: Worker 0: training step 3611 done (global step: 7178) | |
1681061797.481306: Worker 0: training step 3612 done (global step: 7180) | |
1681061797.486787: Worker 0: training step 3613 done (global step: 7182) | |
1681061797.491698: Worker 0: training step 3614 done (global step: 7184) | |
1681061797.496890: Worker 0: training step 3615 done (global step: 7186) | |
1681061797.502288: Worker 0: training step 3616 done (global step: 7188) | |
1681061797.507236: Worker 0: training step 3617 done (global step: 7190) | |
1681061797.513839: Worker 0: training step 3618 done (global step: 7192) | |
1681061797.518941: Worker 0: training step 3619 done (global step: 7194) | |
1681061797.524479: Worker 0: training step 3620 done (global step: 7195) | |
1681061797.529513: Worker 0: training step 3621 done (global step: 7197) | |
1681061797.534970: Worker 0: training step 3622 done (global step: 7199) | |
1681061797.540850: Worker 0: training step 3623 done (global step: 7201) | |
1681061797.546572: Worker 0: training step 3624 done (global step: 7203) | |
1681061797.551593: Worker 0: training step 3625 done (global step: 7205) | |
1681061797.557397: Worker 0: training step 3626 done (global step: 7207) | |
1681061797.562876: Worker 0: training step 3627 done (global step: 7209) | |
1681061797.568025: Worker 0: training step 3628 done (global step: 7211) | |
1681061797.574147: Worker 0: training step 3629 done (global step: 7212) | |
1681061797.580306: Worker 0: training step 3630 done (global step: 7215) | |
1681061797.586510: Worker 0: training step 3631 done (global step: 7217) | |
1681061797.591830: Worker 0: training step 3632 done (global step: 7219) | |
1681061797.597669: Worker 0: training step 3633 done (global step: 7221) | |
1681061797.602519: Worker 0: training step 3634 done (global step: 7223) | |
1681061797.607418: Worker 0: training step 3635 done (global step: 7225) | |
1681061797.612658: Worker 0: training step 3636 done (global step: 7227) | |
1681061797.617501: Worker 0: training step 3637 done (global step: 7229) | |
1681061797.622720: Worker 0: training step 3638 done (global step: 7231) | |
1681061797.627684: Worker 0: training step 3639 done (global step: 7233) | |
1681061797.632924: Worker 0: training step 3640 done (global step: 7235) | |
1681061797.638124: Worker 0: training step 3641 done (global step: 7237) | |
1681061797.644451: Worker 0: training step 3642 done (global step: 7239) | |
1681061797.649416: Worker 0: training step 3643 done (global step: 7241) | |
1681061797.654624: Worker 0: training step 3644 done (global step: 7243) | |
1681061797.661347: Worker 0: training step 3645 done (global step: 7245) | |
1681061797.667535: Worker 0: training step 3646 done (global step: 7247) | |
1681061797.673732: Worker 0: training step 3647 done (global step: 7249) | |
1681061797.679210: Worker 0: training step 3648 done (global step: 7251) | |
1681061797.684711: Worker 0: training step 3649 done (global step: 7253) | |
1681061797.690442: Worker 0: training step 3650 done (global step: 7255) | |
1681061797.696594: Worker 0: training step 3651 done (global step: 7257) | |
1681061797.702163: Worker 0: training step 3652 done (global step: 7259) | |
1681061797.708251: Worker 0: training step 3653 done (global step: 7261) | |
1681061797.714360: Worker 0: training step 3654 done (global step: 7263) | |
1681061797.719775: Worker 0: training step 3655 done (global step: 7266) | |
1681061797.725763: Worker 0: training step 3656 done (global step: 7268) | |
1681061797.731263: Worker 0: training step 3657 done (global step: 7270) | |
1681061797.737683: Worker 0: training step 3658 done (global step: 7272) | |
1681061797.742354: Worker 0: training step 3659 done (global step: 7274) | |
1681061797.747733: Worker 0: training step 3660 done (global step: 7276) | |
1681061797.753277: Worker 0: training step 3661 done (global step: 7278) | |
1681061797.758776: Worker 0: training step 3662 done (global step: 7280) | |
1681061797.764748: Worker 0: training step 3663 done (global step: 7282) | |
1681061797.770337: Worker 0: training step 3664 done (global step: 7284) | |
1681061797.776386: Worker 0: training step 3665 done (global step: 7286) | |
1681061797.781532: Worker 0: training step 3666 done (global step: 7288) | |
1681061797.786938: Worker 0: training step 3667 done (global step: 7290) | |
1681061797.792320: Worker 0: training step 3668 done (global step: 7292) | |
1681061797.797643: Worker 0: training step 3669 done (global step: 7294) | |
1681061797.803029: Worker 0: training step 3670 done (global step: 7296) | |
1681061797.809109: Worker 0: training step 3671 done (global step: 7298) | |
1681061797.814380: Worker 0: training step 3672 done (global step: 7300) | |
1681061797.819410: Worker 0: training step 3673 done (global step: 7302) | |
1681061797.824272: Worker 0: training step 3674 done (global step: 7304) | |
1681061797.829697: Worker 0: training step 3675 done (global step: 7306) | |
1681061797.835054: Worker 0: training step 3676 done (global step: 7308) | |
1681061797.840206: Worker 0: training step 3677 done (global step: 7310) | |
1681061797.845531: Worker 0: training step 3678 done (global step: 7312) | |
1681061797.850869: Worker 0: training step 3679 done (global step: 7314) | |
1681061797.855423: Worker 0: training step 3680 done (global step: 7316) | |
1681061797.861742: Worker 0: training step 3681 done (global step: 7317) | |
1681061797.867446: Worker 0: training step 3682 done (global step: 7320) | |
1681061797.872911: Worker 0: training step 3683 done (global step: 7322) | |
1681061797.878373: Worker 0: training step 3684 done (global step: 7324) | |
1681061797.883776: Worker 0: training step 3685 done (global step: 7326) | |
1681061797.889655: Worker 0: training step 3686 done (global step: 7328) | |
1681061797.895325: Worker 0: training step 3687 done (global step: 7330) | |
1681061797.900541: Worker 0: training step 3688 done (global step: 7332) | |
1681061797.905818: Worker 0: training step 3689 done (global step: 7334) | |
1681061797.911215: Worker 0: training step 3690 done (global step: 7336) | |
1681061797.916710: Worker 0: training step 3691 done (global step: 7338) | |
1681061797.922381: Worker 0: training step 3692 done (global step: 7340) | |
1681061797.928086: Worker 0: training step 3693 done (global step: 7342) | |
1681061797.933182: Worker 0: training step 3694 done (global step: 7344) | |
1681061797.938762: Worker 0: training step 3695 done (global step: 7346) | |
1681061797.945147: Worker 0: training step 3696 done (global step: 7348) | |
1681061797.951773: Worker 0: training step 3697 done (global step: 7350) | |
1681061797.960423: Worker 0: training step 3698 done (global step: 7351) | |
1681061797.966987: Worker 0: training step 3699 done (global step: 7354) | |
1681061797.972166: Worker 0: training step 3700 done (global step: 7355) | |
1681061797.977171: Worker 0: training step 3701 done (global step: 7357) | |
1681061797.982032: Worker 0: training step 3702 done (global step: 7359) | |
1681061797.987014: Worker 0: training step 3703 done (global step: 7361) | |
1681061797.992294: Worker 0: training step 3704 done (global step: 7363) | |
1681061797.997844: Worker 0: training step 3705 done (global step: 7365) | |
1681061798.003170: Worker 0: training step 3706 done (global step: 7367) | |
1681061798.008827: Worker 0: training step 3707 done (global step: 7369) | |
1681061798.017537: Worker 0: training step 3708 done (global step: 7371) | |
1681061798.023509: Worker 0: training step 3709 done (global step: 7373) | |
1681061798.029044: Worker 0: training step 3710 done (global step: 7375) | |
1681061798.034561: Worker 0: training step 3711 done (global step: 7377) | |
1681061798.040704: Worker 0: training step 3712 done (global step: 7379) | |
1681061798.046025: Worker 0: training step 3713 done (global step: 7381) | |
1681061798.052489: Worker 0: training step 3714 done (global step: 7384) | |
1681061798.060699: Worker 0: training step 3715 done (global step: 7385) | |
1681061798.068939: Worker 0: training step 3716 done (global step: 7387) | |
1681061798.074962: Worker 0: training step 3717 done (global step: 7390) | |
1681061798.080602: Worker 0: training step 3718 done (global step: 7392) | |
1681061798.089073: Worker 0: training step 3719 done (global step: 7394) | |
1681061798.096182: Worker 0: training step 3720 done (global step: 7396) | |
1681061798.101470: Worker 0: training step 3721 done (global step: 7398) | |
1681061798.109275: Worker 0: training step 3722 done (global step: 7400) | |
1681061798.114643: Worker 0: training step 3723 done (global step: 7402) | |
1681061798.119493: Worker 0: training step 3724 done (global step: 7404) | |
1681061798.124699: Worker 0: training step 3725 done (global step: 7406) | |
1681061798.130719: Worker 0: training step 3726 done (global step: 7408) | |
1681061798.136166: Worker 0: training step 3727 done (global step: 7410) | |
1681061798.142029: Worker 0: training step 3728 done (global step: 7412) | |
1681061798.148878: Worker 0: training step 3729 done (global step: 7414) | |
1681061798.155379: Worker 0: training step 3730 done (global step: 7417) | |
1681061798.163376: Worker 0: training step 3731 done (global step: 7419) | |
1681061798.168683: Worker 0: training step 3732 done (global step: 7421) | |
1681061798.175347: Worker 0: training step 3733 done (global step: 7423) | |
1681061798.180640: Worker 0: training step 3734 done (global step: 7425) | |
1681061798.185731: Worker 0: training step 3735 done (global step: 7427) | |
1681061798.191173: Worker 0: training step 3736 done (global step: 7429) | |
1681061798.196958: Worker 0: training step 3737 done (global step: 7431) | |
1681061798.202484: Worker 0: training step 3738 done (global step: 7433) | |
1681061798.208217: Worker 0: training step 3739 done (global step: 7435) | |
1681061798.212841: Worker 0: training step 3740 done (global step: 7437) | |
1681061798.217753: Worker 0: training step 3741 done (global step: 7438) | |
1681061798.223626: Worker 0: training step 3742 done (global step: 7440) | |
1681061798.228689: Worker 0: training step 3743 done (global step: 7442) | |
1681061798.233404: Worker 0: training step 3744 done (global step: 7444) | |
1681061798.238741: Worker 0: training step 3745 done (global step: 7446) | |
1681061798.244629: Worker 0: training step 3746 done (global step: 7448) | |
1681061798.250492: Worker 0: training step 3747 done (global step: 7450) | |
1681061798.256223: Worker 0: training step 3748 done (global step: 7452) | |
1681061798.262571: Worker 0: training step 3749 done (global step: 7454) | |
1681061798.267762: Worker 0: training step 3750 done (global step: 7456) | |
1681061798.273533: Worker 0: training step 3751 done (global step: 7458) | |
1681061798.278732: Worker 0: training step 3752 done (global step: 7460) | |
1681061798.283960: Worker 0: training step 3753 done (global step: 7462) | |
1681061798.289851: Worker 0: training step 3754 done (global step: 7464) | |
1681061798.295310: Worker 0: training step 3755 done (global step: 7466) | |
1681061798.301743: Worker 0: training step 3756 done (global step: 7468) | |
1681061798.310325: Worker 0: training step 3757 done (global step: 7470) | |
1681061798.316339: Worker 0: training step 3758 done (global step: 7472) | |
1681061798.321497: Worker 0: training step 3759 done (global step: 7474) | |
1681061798.327910: Worker 0: training step 3760 done (global step: 7476) | |
1681061798.332347: Worker 0: training step 3761 done (global step: 7478) | |
1681061798.338418: Worker 0: training step 3762 done (global step: 7480) | |
1681061798.342936: Worker 0: training step 3763 done (global step: 7482) | |
1681061798.348428: Worker 0: training step 3764 done (global step: 7484) | |
1681061798.353838: Worker 0: training step 3765 done (global step: 7486) | |
1681061798.358229: Worker 0: training step 3766 done (global step: 7488) | |
1681061798.365306: Worker 0: training step 3767 done (global step: 7490) | |
1681061798.371253: Worker 0: training step 3768 done (global step: 7492) | |
1681061798.376723: Worker 0: training step 3769 done (global step: 7494) | |
1681061798.382192: Worker 0: training step 3770 done (global step: 7496) | |
1681061798.387850: Worker 0: training step 3771 done (global step: 7498) | |
1681061798.393464: Worker 0: training step 3772 done (global step: 7500) | |
1681061798.399484: Worker 0: training step 3773 done (global step: 7502) | |
1681061798.405280: Worker 0: training step 3774 done (global step: 7504) | |
1681061798.411054: Worker 0: training step 3775 done (global step: 7506) | |
1681061798.417239: Worker 0: training step 3776 done (global step: 7508) | |
1681061798.423357: Worker 0: training step 3777 done (global step: 7510) | |
1681061798.429802: Worker 0: training step 3778 done (global step: 7512) | |
1681061798.435501: Worker 0: training step 3779 done (global step: 7515) | |
1681061798.440274: Worker 0: training step 3780 done (global step: 7516) | |
1681061798.446148: Worker 0: training step 3781 done (global step: 7518) | |
1681061798.451501: Worker 0: training step 3782 done (global step: 7520) | |
1681061798.457571: Worker 0: training step 3783 done (global step: 7522) | |
1681061798.464594: Worker 0: training step 3784 done (global step: 7524) | |
1681061798.472093: Worker 0: training step 3785 done (global step: 7526) | |
1681061798.477798: Worker 0: training step 3786 done (global step: 7528) | |
1681061798.483159: Worker 0: training step 3787 done (global step: 7530) | |
1681061798.488554: Worker 0: training step 3788 done (global step: 7532) | |
1681061798.493951: Worker 0: training step 3789 done (global step: 7534) | |
1681061798.499194: Worker 0: training step 3790 done (global step: 7536) | |
1681061798.504849: Worker 0: training step 3791 done (global step: 7538) | |
1681061798.510248: Worker 0: training step 3792 done (global step: 7540) | |
1681061798.515028: Worker 0: training step 3793 done (global step: 7542) | |
1681061798.519888: Worker 0: training step 3794 done (global step: 7543) | |
1681061798.525115: Worker 0: training step 3795 done (global step: 7545) | |
1681061798.531426: Worker 0: training step 3796 done (global step: 7547) | |
1681061798.536262: Worker 0: training step 3797 done (global step: 7549) | |
1681061798.541473: Worker 0: training step 3798 done (global step: 7551) | |
1681061798.546516: Worker 0: training step 3799 done (global step: 7553) | |
1681061798.552488: Worker 0: training step 3800 done (global step: 7555) | |
1681061798.560233: Worker 0: training step 3801 done (global step: 7557) | |
1681061798.570131: Worker 0: training step 3802 done (global step: 7559) | |
1681061798.575355: Worker 0: training step 3803 done (global step: 7561) | |
1681061798.582258: Worker 0: training step 3804 done (global step: 7563) | |
1681061798.588419: Worker 0: training step 3805 done (global step: 7565) | |
1681061798.594719: Worker 0: training step 3806 done (global step: 7567) | |
1681061798.600690: Worker 0: training step 3807 done (global step: 7570) | |
1681061798.605809: Worker 0: training step 3808 done (global step: 7572) | |
1681061798.610297: Worker 0: training step 3809 done (global step: 7573) | |
1681061798.615473: Worker 0: training step 3810 done (global step: 7575) | |
1681061798.620529: Worker 0: training step 3811 done (global step: 7577) | |
1681061798.625556: Worker 0: training step 3812 done (global step: 7579) | |
1681061798.631319: Worker 0: training step 3813 done (global step: 7581) | |
1681061798.636878: Worker 0: training step 3814 done (global step: 7583) | |
1681061798.642578: Worker 0: training step 3815 done (global step: 7585) | |
1681061798.648183: Worker 0: training step 3816 done (global step: 7587) | |
1681061798.653814: Worker 0: training step 3817 done (global step: 7589) | |
1681061798.659709: Worker 0: training step 3818 done (global step: 7591) | |
1681061798.665538: Worker 0: training step 3819 done (global step: 7593) | |
1681061798.671239: Worker 0: training step 3820 done (global step: 7595) | |
1681061798.676853: Worker 0: training step 3821 done (global step: 7597) | |
1681061798.683510: Worker 0: training step 3822 done (global step: 7599) | |
1681061798.688766: Worker 0: training step 3823 done (global step: 7601) | |
1681061798.694914: Worker 0: training step 3824 done (global step: 7603) | |
1681061798.700158: Worker 0: training step 3825 done (global step: 7605) | |
1681061798.704967: Worker 0: training step 3826 done (global step: 7607) | |
1681061798.709695: Worker 0: training step 3827 done (global step: 7609) | |
1681061798.715877: Worker 0: training step 3828 done (global step: 7611) | |
1681061798.721886: Worker 0: training step 3829 done (global step: 7613) | |
1681061798.728893: Worker 0: training step 3830 done (global step: 7615) | |
1681061798.733596: Worker 0: training step 3831 done (global step: 7617) | |
1681061798.739162: Worker 0: training step 3832 done (global step: 7619) | |
1681061798.744451: Worker 0: training step 3833 done (global step: 7621) | |
1681061798.750497: Worker 0: training step 3834 done (global step: 7623) | |
1681061798.755625: Worker 0: training step 3835 done (global step: 7625) | |
1681061798.762116: Worker 0: training step 3836 done (global step: 7627) | |
1681061798.767217: Worker 0: training step 3837 done (global step: 7629) | |
1681061798.772313: Worker 0: training step 3838 done (global step: 7631) | |
1681061798.777250: Worker 0: training step 3839 done (global step: 7632) | |
1681061798.782746: Worker 0: training step 3840 done (global step: 7634) | |
1681061798.790293: Worker 0: training step 3841 done (global step: 7636) | |
1681061798.795510: Worker 0: training step 3842 done (global step: 7639) | |
1681061798.800659: Worker 0: training step 3843 done (global step: 7641) | |
1681061798.806145: Worker 0: training step 3844 done (global step: 7643) | |
1681061798.811444: Worker 0: training step 3845 done (global step: 7645) | |
1681061798.816584: Worker 0: training step 3846 done (global step: 7647) | |
1681061798.822092: Worker 0: training step 3847 done (global step: 7649) | |
1681061798.827662: Worker 0: training step 3848 done (global step: 7651) | |
1681061798.832415: Worker 0: training step 3849 done (global step: 7653) | |
1681061798.837856: Worker 0: training step 3850 done (global step: 7655) | |
1681061798.997740: Worker 0: training step 3851 done (global step: 7690) | |
1681061799.003176: Worker 0: training step 3852 done (global step: 7692) | |
1681061799.008161: Worker 0: training step 3853 done (global step: 7694) | |
1681061799.014098: Worker 0: training step 3854 done (global step: 7696) | |
1681061799.019569: Worker 0: training step 3855 done (global step: 7698) | |
1681061799.024699: Worker 0: training step 3856 done (global step: 7700) | |
1681061799.029374: Worker 0: training step 3857 done (global step: 7701) | |
1681061799.034900: Worker 0: training step 3858 done (global step: 7703) | |
1681061799.041849: Worker 0: training step 3859 done (global step: 7704) | |
1681061799.050504: Worker 0: training step 3860 done (global step: 7705) | |
1681061799.058024: Worker 0: training step 3861 done (global step: 7706) | |
1681061799.064142: Worker 0: training step 3862 done (global step: 7707) | |
1681061799.072037: Worker 0: training step 3863 done (global step: 7708) | |
1681061799.080209: Worker 0: training step 3864 done (global step: 7709) | |
1681061799.088668: Worker 0: training step 3865 done (global step: 7710) | |
1681061799.098295: Worker 0: training step 3866 done (global step: 7711) | |
1681061799.106659: Worker 0: training step 3867 done (global step: 7712) | |
1681061799.123200: Worker 0: training step 3868 done (global step: 7713) | |
1681061799.142882: Worker 0: training step 3869 done (global step: 7714) | |
1681061799.157516: Worker 0: training step 3870 done (global step: 7715) | |
1681061799.173403: Worker 0: training step 3871 done (global step: 7716) | |
1681061799.199991: Worker 0: training step 3872 done (global step: 7717) | |
1681061799.213700: Worker 0: training step 3873 done (global step: 7718) | |
1681061799.224785: Worker 0: training step 3874 done (global step: 7719) | |
1681061799.232509: Worker 0: training step 3875 done (global step: 7721) | |
1681061799.246069: Worker 0: training step 3876 done (global step: 7722) | |
1681061799.263090: Worker 0: training step 3877 done (global step: 7724) | |
1681061799.280213: Worker 0: training step 3878 done (global step: 7726) | |
1681061799.287767: Worker 0: training step 3879 done (global step: 7729) | |
1681061799.296187: Worker 0: training step 3880 done (global step: 7731) | |
1681061799.308732: Worker 0: training step 3881 done (global step: 7733) | |
1681061799.321302: Worker 0: training step 3882 done (global step: 7736) | |
1681061799.331456: Worker 0: training step 3883 done (global step: 7738) | |
1681061799.343431: Worker 0: training step 3884 done (global step: 7739) | |
1681061799.355174: Worker 0: training step 3885 done (global step: 7741) | |
1681061799.362471: Worker 0: training step 3886 done (global step: 7743) | |
1681061799.370358: Worker 0: training step 3887 done (global step: 7745) | |
1681061799.377589: Worker 0: training step 3888 done (global step: 7747) | |
1681061799.385155: Worker 0: training step 3889 done (global step: 7749) | |
1681061799.391139: Worker 0: training step 3890 done (global step: 7751) | |
1681061799.396951: Worker 0: training step 3891 done (global step: 7753) | |
1681061799.402198: Worker 0: training step 3892 done (global step: 7755) | |
1681061799.407493: Worker 0: training step 3893 done (global step: 7757) | |
1681061799.413472: Worker 0: training step 3894 done (global step: 7759) | |
1681061799.419550: Worker 0: training step 3895 done (global step: 7761) | |
1681061799.425056: Worker 0: training step 3896 done (global step: 7763) | |
1681061799.430690: Worker 0: training step 3897 done (global step: 7765) | |
1681061799.435963: Worker 0: training step 3898 done (global step: 7767) | |
1681061799.441320: Worker 0: training step 3899 done (global step: 7769) | |
1681061799.446902: Worker 0: training step 3900 done (global step: 7771) | |
1681061799.452562: Worker 0: training step 3901 done (global step: 7772) | |
1681061799.458799: Worker 0: training step 3902 done (global step: 7775) | |
1681061799.463814: Worker 0: training step 3903 done (global step: 7777) | |
1681061799.469978: Worker 0: training step 3904 done (global step: 7778) | |
1681061799.480683: Worker 0: training step 3905 done (global step: 7781) | |
1681061799.486465: Worker 0: training step 3906 done (global step: 7783) | |
1681061799.492191: Worker 0: training step 3907 done (global step: 7785) | |
1681061799.498093: Worker 0: training step 3908 done (global step: 7787) | |
1681061799.503782: Worker 0: training step 3909 done (global step: 7789) | |
1681061799.509347: Worker 0: training step 3910 done (global step: 7791) | |
1681061799.515178: Worker 0: training step 3911 done (global step: 7793) | |
1681061799.521097: Worker 0: training step 3912 done (global step: 7795) | |
1681061799.527116: Worker 0: training step 3913 done (global step: 7797) | |
1681061799.533664: Worker 0: training step 3914 done (global step: 7799) | |
1681061799.538594: Worker 0: training step 3915 done (global step: 7801) | |
1681061799.545449: Worker 0: training step 3916 done (global step: 7803) | |
1681061799.550426: Worker 0: training step 3917 done (global step: 7805) | |
1681061799.555903: Worker 0: training step 3918 done (global step: 7807) | |
1681061799.560545: Worker 0: training step 3919 done (global step: 7809) | |
1681061799.566545: Worker 0: training step 3920 done (global step: 7811) | |
1681061799.571896: Worker 0: training step 3921 done (global step: 7813) | |
1681061799.576730: Worker 0: training step 3922 done (global step: 7815) | |
1681061799.581894: Worker 0: training step 3923 done (global step: 7816) | |
1681061799.588554: Worker 0: training step 3924 done (global step: 7819) | |
1681061799.594332: Worker 0: training step 3925 done (global step: 7821) | |
1681061799.601181: Worker 0: training step 3926 done (global step: 7823) | |
1681061799.607318: Worker 0: training step 3927 done (global step: 7825) | |
1681061799.613021: Worker 0: training step 3928 done (global step: 7827) | |
1681061799.618291: Worker 0: training step 3929 done (global step: 7829) | |
1681061799.623470: Worker 0: training step 3930 done (global step: 7831) | |
1681061799.629068: Worker 0: training step 3931 done (global step: 7833) | |
1681061799.635041: Worker 0: training step 3932 done (global step: 7835) | |
1681061799.640558: Worker 0: training step 3933 done (global step: 7837) | |
1681061799.646014: Worker 0: training step 3934 done (global step: 7839) | |
1681061799.651241: Worker 0: training step 3935 done (global step: 7841) | |
1681061799.657253: Worker 0: training step 3936 done (global step: 7843) | |
1681061799.662240: Worker 0: training step 3937 done (global step: 7845) | |
1681061799.667788: Worker 0: training step 3938 done (global step: 7847) | |
1681061799.673680: Worker 0: training step 3939 done (global step: 7849) | |
1681061799.679537: Worker 0: training step 3940 done (global step: 7851) | |
1681061799.685116: Worker 0: training step 3941 done (global step: 7853) | |
1681061799.691077: Worker 0: training step 3942 done (global step: 7855) | |
1681061799.696193: Worker 0: training step 3943 done (global step: 7857) | |
1681061799.702073: Worker 0: training step 3944 done (global step: 7859) | |
1681061799.707354: Worker 0: training step 3945 done (global step: 7861) | |
1681061799.712924: Worker 0: training step 3946 done (global step: 7863) | |
1681061799.718332: Worker 0: training step 3947 done (global step: 7865) | |
1681061799.723828: Worker 0: training step 3948 done (global step: 7867) | |
1681061799.729480: Worker 0: training step 3949 done (global step: 7869) | |
1681061799.735356: Worker 0: training step 3950 done (global step: 7871) | |
1681061799.741026: Worker 0: training step 3951 done (global step: 7873) | |
1681061799.747240: Worker 0: training step 3952 done (global step: 7875) | |
1681061799.752986: Worker 0: training step 3953 done (global step: 7877) | |
1681061799.759102: Worker 0: training step 3954 done (global step: 7879) | |
1681061799.764548: Worker 0: training step 3955 done (global step: 7881) | |
1681061799.770408: Worker 0: training step 3956 done (global step: 7883) | |
1681061799.775758: Worker 0: training step 3957 done (global step: 7885) | |
1681061799.781463: Worker 0: training step 3958 done (global step: 7887) | |
1681061799.786493: Worker 0: training step 3959 done (global step: 7889) | |
1681061799.791729: Worker 0: training step 3960 done (global step: 7891) | |
1681061799.796932: Worker 0: training step 3961 done (global step: 7893) | |
1681061799.802485: Worker 0: training step 3962 done (global step: 7895) | |
1681061799.808065: Worker 0: training step 3963 done (global step: 7897) | |
1681061799.813044: Worker 0: training step 3964 done (global step: 7899) | |
1681061799.818684: Worker 0: training step 3965 done (global step: 7901) | |
1681061799.824720: Worker 0: training step 3966 done (global step: 7903) | |
1681061799.830004: Worker 0: training step 3967 done (global step: 7905) | |
1681061799.835446: Worker 0: training step 3968 done (global step: 7907) | |
1681061799.841503: Worker 0: training step 3969 done (global step: 7909) | |
1681061799.846886: Worker 0: training step 3970 done (global step: 7911) | |
1681061799.852471: Worker 0: training step 3971 done (global step: 7913) | |
1681061799.857345: Worker 0: training step 3972 done (global step: 7915) | |
1681061799.863028: Worker 0: training step 3973 done (global step: 7917) | |
1681061799.867958: Worker 0: training step 3974 done (global step: 7919) | |
1681061799.873285: Worker 0: training step 3975 done (global step: 7921) | |
1681061799.878356: Worker 0: training step 3976 done (global step: 7923) | |
1681061799.883711: Worker 0: training step 3977 done (global step: 7925) | |
1681061799.890360: Worker 0: training step 3978 done (global step: 7927) | |
1681061799.896731: Worker 0: training step 3979 done (global step: 7929) | |
1681061799.902071: Worker 0: training step 3980 done (global step: 7931) | |
1681061799.907116: Worker 0: training step 3981 done (global step: 7933) | |
1681061799.912869: Worker 0: training step 3982 done (global step: 7935) | |
1681061799.918265: Worker 0: training step 3983 done (global step: 7937) | |
1681061799.924449: Worker 0: training step 3984 done (global step: 7939) | |
1681061799.931250: Worker 0: training step 3985 done (global step: 7941) | |
1681061799.936754: Worker 0: training step 3986 done (global step: 7943) | |
1681061799.942551: Worker 0: training step 3987 done (global step: 7945) | |
1681061799.948775: Worker 0: training step 3988 done (global step: 7947) | |
1681061799.953952: Worker 0: training step 3989 done (global step: 7949) | |
1681061799.961126: Worker 0: training step 3990 done (global step: 7951) | |
1681061799.968955: Worker 0: training step 3991 done (global step: 7953) | |
1681061799.977575: Worker 0: training step 3992 done (global step: 7955) | |
1681061799.984356: Worker 0: training step 3993 done (global step: 7957) | |
1681061799.989850: Worker 0: training step 3994 done (global step: 7959) | |
1681061799.995687: Worker 0: training step 3995 done (global step: 7961) | |
1681061800.001772: Worker 0: training step 3996 done (global step: 7963) | |
1681061800.007318: Worker 0: training step 3997 done (global step: 7965) | |
1681061800.012830: Worker 0: training step 3998 done (global step: 7967) | |
1681061800.018087: Worker 0: training step 3999 done (global step: 7969) | |
1681061800.023690: Worker 0: training step 4000 done (global step: 7971) | |
1681061800.029276: Worker 0: training step 4001 done (global step: 7973) | |
1681061800.034911: Worker 0: training step 4002 done (global step: 7975) | |
1681061800.040341: Worker 0: training step 4003 done (global step: 7977) | |
1681061800.046045: Worker 0: training step 4004 done (global step: 7979) | |
1681061800.052174: Worker 0: training step 4005 done (global step: 7981) | |
1681061800.057250: Worker 0: training step 4006 done (global step: 7983) | |
1681061800.062598: Worker 0: training step 4007 done (global step: 7985) | |
1681061800.068685: Worker 0: training step 4008 done (global step: 7987) | |
1681061800.074567: Worker 0: training step 4009 done (global step: 7989) | |
1681061800.079910: Worker 0: training step 4010 done (global step: 7991) | |
1681061800.085459: Worker 0: training step 4011 done (global step: 7993) | |
1681061800.091119: Worker 0: training step 4012 done (global step: 7995) | |
1681061800.099822: Worker 0: training step 4013 done (global step: 7997) | |
1681061800.107147: Worker 0: training step 4014 done (global step: 7999) | |
1681061800.112744: Worker 0: training step 4015 done (global step: 8001) | |
1681061800.117980: Worker 0: training step 4016 done (global step: 8003) | |
1681061800.123880: Worker 0: training step 4017 done (global step: 8005) | |
1681061800.129130: Worker 0: training step 4018 done (global step: 8007) | |
1681061800.134424: Worker 0: training step 4019 done (global step: 8009) | |
1681061800.140148: Worker 0: training step 4020 done (global step: 8011) | |
1681061800.145704: Worker 0: training step 4021 done (global step: 8013) | |
1681061800.151536: Worker 0: training step 4022 done (global step: 8015) | |
1681061800.157916: Worker 0: training step 4023 done (global step: 8017) | |
1681061800.163792: Worker 0: training step 4024 done (global step: 8019) | |
1681061800.169255: Worker 0: training step 4025 done (global step: 8021) | |
1681061800.174670: Worker 0: training step 4026 done (global step: 8023) | |
1681061800.180571: Worker 0: training step 4027 done (global step: 8025) | |
1681061800.186071: Worker 0: training step 4028 done (global step: 8027) | |
1681061800.194574: Worker 0: training step 4029 done (global step: 8029) | |
1681061800.205498: Worker 0: training step 4030 done (global step: 8031) | |
1681061800.214660: Worker 0: training step 4031 done (global step: 8034) | |
1681061800.220015: Worker 0: training step 4032 done (global step: 8036) | |
1681061800.226429: Worker 0: training step 4033 done (global step: 8038) | |
1681061800.232559: Worker 0: training step 4034 done (global step: 8040) | |
1681061800.237543: Worker 0: training step 4035 done (global step: 8042) | |
1681061800.244433: Worker 0: training step 4036 done (global step: 8044) | |
1681061800.253674: Worker 0: training step 4037 done (global step: 8046) | |
1681061800.262286: Worker 0: training step 4038 done (global step: 8048) | |
1681061800.268474: Worker 0: training step 4039 done (global step: 8050) | |
1681061800.274320: Worker 0: training step 4040 done (global step: 8052) | |
1681061800.280258: Worker 0: training step 4041 done (global step: 8054) | |
1681061800.286573: Worker 0: training step 4042 done (global step: 8056) | |
1681061800.293448: Worker 0: training step 4043 done (global step: 8059) | |
1681061800.299512: Worker 0: training step 4044 done (global step: 8061) | |
1681061800.307053: Worker 0: training step 4045 done (global step: 8063) | |
1681061800.317338: Worker 0: training step 4046 done (global step: 8065) | |
1681061800.326919: Worker 0: training step 4047 done (global step: 8067) | |
1681061800.334210: Worker 0: training step 4048 done (global step: 8070) | |
1681061800.340383: Worker 0: training step 4049 done (global step: 8072) | |
1681061800.349406: Worker 0: training step 4050 done (global step: 8074) | |
1681061800.357239: Worker 0: training step 4051 done (global step: 8076) | |
1681061800.364803: Worker 0: training step 4052 done (global step: 8078) | |
1681061800.376031: Worker 0: training step 4053 done (global step: 8080) | |
1681061800.385751: Worker 0: training step 4054 done (global step: 8082) | |
1681061800.395206: Worker 0: training step 4055 done (global step: 8084) | |
1681061800.403191: Worker 0: training step 4056 done (global step: 8086) | |
1681061800.408791: Worker 0: training step 4057 done (global step: 8088) | |
1681061800.414740: Worker 0: training step 4058 done (global step: 8090) | |
1681061800.420575: Worker 0: training step 4059 done (global step: 8092) | |
1681061800.430988: Worker 0: training step 4060 done (global step: 8094) | |
1681061800.441556: Worker 0: training step 4061 done (global step: 8096) | |
1681061800.456788: Worker 0: training step 4062 done (global step: 8099) | |
1681061800.469302: Worker 0: training step 4063 done (global step: 8101) | |
1681061800.480847: Worker 0: training step 4064 done (global step: 8102) | |
1681061800.486892: Worker 0: training step 4065 done (global step: 8105) | |
1681061800.495781: Worker 0: training step 4066 done (global step: 8106) | |
1681061800.501785: Worker 0: training step 4067 done (global step: 8108) | |
1681061800.507181: Worker 0: training step 4068 done (global step: 8110) | |
1681061800.512298: Worker 0: training step 4069 done (global step: 8113) | |
1681061800.519132: Worker 0: training step 4070 done (global step: 8114) | |
1681061800.525490: Worker 0: training step 4071 done (global step: 8116) | |
1681061800.530746: Worker 0: training step 4072 done (global step: 8118) | |
1681061800.536000: Worker 0: training step 4073 done (global step: 8120) | |
1681061800.541383: Worker 0: training step 4074 done (global step: 8122) | |
1681061800.545936: Worker 0: training step 4075 done (global step: 8124) | |
1681061800.551637: Worker 0: training step 4076 done (global step: 8126) | |
1681061800.556920: Worker 0: training step 4077 done (global step: 8128) | |
1681061800.562936: Worker 0: training step 4078 done (global step: 8130) | |
1681061800.568688: Worker 0: training step 4079 done (global step: 8132) | |
1681061800.573999: Worker 0: training step 4080 done (global step: 8134) | |
1681061800.578845: Worker 0: training step 4081 done (global step: 8136) | |
1681061800.585485: Worker 0: training step 4082 done (global step: 8138) | |
1681061800.590675: Worker 0: training step 4083 done (global step: 8140) | |
1681061800.598734: Worker 0: training step 4084 done (global step: 8142) | |
1681061800.605022: Worker 0: training step 4085 done (global step: 8144) | |
1681061800.613481: Worker 0: training step 4086 done (global step: 8147) | |
1681061800.623030: Worker 0: training step 4087 done (global step: 8149) | |
1681061800.631019: Worker 0: training step 4088 done (global step: 8151) | |
1681061800.638798: Worker 0: training step 4089 done (global step: 8152) | |
1681061800.643449: Worker 0: training step 4090 done (global step: 8154) | |
1681061800.648324: Worker 0: training step 4091 done (global step: 8156) | |
1681061800.655318: Worker 0: training step 4092 done (global step: 8158) | |
1681061800.660627: Worker 0: training step 4093 done (global step: 8161) | |
1681061800.666558: Worker 0: training step 4094 done (global step: 8162) | |
1681061800.674635: Worker 0: training step 4095 done (global step: 8164) | |
1681061800.682530: Worker 0: training step 4096 done (global step: 8166) | |
1681061800.687571: Worker 0: training step 4097 done (global step: 8169) | |
1681061800.692892: Worker 0: training step 4098 done (global step: 8171) | |
1681061800.698528: Worker 0: training step 4099 done (global step: 8173) | |
1681061800.703765: Worker 0: training step 4100 done (global step: 8175) | |
1681061800.709345: Worker 0: training step 4101 done (global step: 8177) | |
1681061800.716015: Worker 0: training step 4102 done (global step: 8179) | |
1681061800.721800: Worker 0: training step 4103 done (global step: 8181) | |
1681061800.727640: Worker 0: training step 4104 done (global step: 8183) | |
1681061800.733142: Worker 0: training step 4105 done (global step: 8185) | |
1681061800.738949: Worker 0: training step 4106 done (global step: 8187) | |
1681061800.744350: Worker 0: training step 4107 done (global step: 8189) | |
1681061800.750962: Worker 0: training step 4108 done (global step: 8191) | |
1681061800.758124: Worker 0: training step 4109 done (global step: 8194) | |
1681061800.763506: Worker 0: training step 4110 done (global step: 8196) | |
1681061800.769891: Worker 0: training step 4111 done (global step: 8198) | |
1681061800.776328: Worker 0: training step 4112 done (global step: 8200) | |
1681061800.782536: Worker 0: training step 4113 done (global step: 8202) | |
1681061800.790747: Worker 0: training step 4114 done (global step: 8204) | |
1681061800.799833: Worker 0: training step 4115 done (global step: 8206) | |
1681061800.805634: Worker 0: training step 4116 done (global step: 8208) | |
1681061800.810443: Worker 0: training step 4117 done (global step: 8210) | |
1681061800.815477: Worker 0: training step 4118 done (global step: 8212) | |
1681061800.821301: Worker 0: training step 4119 done (global step: 8214) | |
1681061800.826755: Worker 0: training step 4120 done (global step: 8216) | |
1681061800.832432: Worker 0: training step 4121 done (global step: 8218) | |
1681061800.837626: Worker 0: training step 4122 done (global step: 8220) | |
1681061800.843499: Worker 0: training step 4123 done (global step: 8222) | |
1681061800.848944: Worker 0: training step 4124 done (global step: 8224) | |
1681061800.854064: Worker 0: training step 4125 done (global step: 8226) | |
1681061800.859753: Worker 0: training step 4126 done (global step: 8228) | |
1681061800.864961: Worker 0: training step 4127 done (global step: 8230) | |
1681061800.870736: Worker 0: training step 4128 done (global step: 8232) | |
1681061800.876936: Worker 0: training step 4129 done (global step: 8234) | |
1681061800.882149: Worker 0: training step 4130 done (global step: 8236) | |
1681061800.887656: Worker 0: training step 4131 done (global step: 8238) | |
1681061800.893529: Worker 0: training step 4132 done (global step: 8240) | |
1681061800.898215: Worker 0: training step 4133 done (global step: 8242) | |
1681061800.905025: Worker 0: training step 4134 done (global step: 8244) | |
1681061800.910531: Worker 0: training step 4135 done (global step: 8246) | |
1681061800.917237: Worker 0: training step 4136 done (global step: 8248) | |
1681061800.922784: Worker 0: training step 4137 done (global step: 8250) | |
1681061800.927518: Worker 0: training step 4138 done (global step: 8252) | |
1681061800.936920: Worker 0: training step 4139 done (global step: 8254) | |
1681061800.947731: Worker 0: training step 4140 done (global step: 8256) | |
1681061800.957043: Worker 0: training step 4141 done (global step: 8258) | |
1681061800.963066: Worker 0: training step 4142 done (global step: 8260) | |
1681061800.970059: Worker 0: training step 4143 done (global step: 8262) | |
1681061800.975578: Worker 0: training step 4144 done (global step: 8264) | |
1681061800.981532: Worker 0: training step 4145 done (global step: 8266) | |
1681061800.987191: Worker 0: training step 4146 done (global step: 8268) | |
1681061800.992806: Worker 0: training step 4147 done (global step: 8270) | |
1681061800.998007: Worker 0: training step 4148 done (global step: 8272) | |
1681061801.003582: Worker 0: training step 4149 done (global step: 8274) | |
1681061801.008401: Worker 0: training step 4150 done (global step: 8276) | |
1681061801.014265: Worker 0: training step 4151 done (global step: 8278) | |
1681061801.019382: Worker 0: training step 4152 done (global step: 8280) | |
1681061801.025244: Worker 0: training step 4153 done (global step: 8282) | |
1681061801.030435: Worker 0: training step 4154 done (global step: 8284) | |
1681061801.036270: Worker 0: training step 4155 done (global step: 8286) | |
1681061801.042921: Worker 0: training step 4156 done (global step: 8288) | |
1681061801.048962: Worker 0: training step 4157 done (global step: 8290) | |
1681061801.054835: Worker 0: training step 4158 done (global step: 8292) | |
1681061801.061398: Worker 0: training step 4159 done (global step: 8295) | |
1681061801.066222: Worker 0: training step 4160 done (global step: 8297) | |
1681061801.070330: Worker 0: training step 4161 done (global step: 8298) | |
1681061801.075660: Worker 0: training step 4162 done (global step: 8300) | |
1681061801.081328: Worker 0: training step 4163 done (global step: 8302) | |
1681061801.086907: Worker 0: training step 4164 done (global step: 8304) | |
1681061801.092491: Worker 0: training step 4165 done (global step: 8306) | |
1681061801.097677: Worker 0: training step 4166 done (global step: 8308) | |
1681061801.103960: Worker 0: training step 4167 done (global step: 8310) | |
1681061801.110059: Worker 0: training step 4168 done (global step: 8312) | |
1681061801.115046: Worker 0: training step 4169 done (global step: 8314) | |
1681061801.120480: Worker 0: training step 4170 done (global step: 8316) | |
1681061801.125811: Worker 0: training step 4171 done (global step: 8318) | |
1681061801.131237: Worker 0: training step 4172 done (global step: 8320) | |
1681061801.137149: Worker 0: training step 4173 done (global step: 8322) | |
1681061801.142830: Worker 0: training step 4174 done (global step: 8324) | |
1681061801.148531: Worker 0: training step 4175 done (global step: 8325) | |
1681061801.155233: Worker 0: training step 4176 done (global step: 8327) | |
1681061801.160653: Worker 0: training step 4177 done (global step: 8329) | |
1681061801.165849: Worker 0: training step 4178 done (global step: 8331) | |
1681061801.172583: Worker 0: training step 4179 done (global step: 8333) | |
1681061801.178162: Worker 0: training step 4180 done (global step: 8336) | |
1681061801.183433: Worker 0: training step 4181 done (global step: 8337) | |
1681061801.188975: Worker 0: training step 4182 done (global step: 8340) | |
1681061801.198819: Worker 0: training step 4183 done (global step: 8342) | |
1681061801.205191: Worker 0: training step 4184 done (global step: 8344) | |
1681061801.209507: Worker 0: training step 4185 done (global step: 8346) | |
1681061801.214189: Worker 0: training step 4186 done (global step: 8347) | |
1681061801.219575: Worker 0: training step 4187 done (global step: 8349) | |
1681061801.225516: Worker 0: training step 4188 done (global step: 8351) | |
1681061801.230824: Worker 0: training step 4189 done (global step: 8353) | |
1681061801.236981: Worker 0: training step 4190 done (global step: 8355) | |
1681061801.243136: Worker 0: training step 4191 done (global step: 8357) | |
1681061801.249469: Worker 0: training step 4192 done (global step: 8359) | |
1681061801.254555: Worker 0: training step 4193 done (global step: 8361) | |
1681061801.260814: Worker 0: training step 4194 done (global step: 8363) | |
1681061801.266370: Worker 0: training step 4195 done (global step: 8365) | |
1681061801.272289: Worker 0: training step 4196 done (global step: 8367) | |
1681061801.278995: Worker 0: training step 4197 done (global step: 8369) | |
1681061801.283649: Worker 0: training step 4198 done (global step: 8371) | |
1681061801.288877: Worker 0: training step 4199 done (global step: 8373) | |
1681061801.294476: Worker 0: training step 4200 done (global step: 8375) | |
1681061801.299868: Worker 0: training step 4201 done (global step: 8377) | |
1681061801.306788: Worker 0: training step 4202 done (global step: 8379) | |
1681061801.314199: Worker 0: training step 4203 done (global step: 8381) | |
1681061801.319970: Worker 0: training step 4204 done (global step: 8383) | |
1681061801.326165: Worker 0: training step 4205 done (global step: 8386) | |
1681061801.331553: Worker 0: training step 4206 done (global step: 8387) | |
1681061801.337232: Worker 0: training step 4207 done (global step: 8389) | |
1681061801.342904: Worker 0: training step 4208 done (global step: 8391) | |
1681061801.348238: Worker 0: training step 4209 done (global step: 8394) | |
1681061801.353169: Worker 0: training step 4210 done (global step: 8395) | |
1681061801.359099: Worker 0: training step 4211 done (global step: 8397) | |
1681061801.365015: Worker 0: training step 4212 done (global step: 8399) | |
1681061801.371354: Worker 0: training step 4213 done (global step: 8401) | |
1681061801.376690: Worker 0: training step 4214 done (global step: 8403) | |
1681061801.381333: Worker 0: training step 4215 done (global step: 8405) | |
1681061801.386855: Worker 0: training step 4216 done (global step: 8407) | |
1681061801.393211: Worker 0: training step 4217 done (global step: 8409) | |
1681061801.397887: Worker 0: training step 4218 done (global step: 8411) | |
1681061801.403475: Worker 0: training step 4219 done (global step: 8413) | |
1681061801.408535: Worker 0: training step 4220 done (global step: 8415) | |
1681061801.415082: Worker 0: training step 4221 done (global step: 8417) | |
1681061801.419915: Worker 0: training step 4222 done (global step: 8419) | |
1681061801.425480: Worker 0: training step 4223 done (global step: 8421) | |
1681061801.431181: Worker 0: training step 4224 done (global step: 8423) | |
1681061801.436489: Worker 0: training step 4225 done (global step: 8425) | |
1681061801.442076: Worker 0: training step 4226 done (global step: 8427) | |
1681061801.448117: Worker 0: training step 4227 done (global step: 8429) | |
1681061801.454067: Worker 0: training step 4228 done (global step: 8431) | |
1681061801.459249: Worker 0: training step 4229 done (global step: 8433) | |
1681061801.466746: Worker 0: training step 4230 done (global step: 8435) | |
1681061801.473120: Worker 0: training step 4231 done (global step: 8437) | |
1681061801.481564: Worker 0: training step 4232 done (global step: 8439) | |
1681061801.489187: Worker 0: training step 4233 done (global step: 8441) | |
1681061801.495038: Worker 0: training step 4234 done (global step: 8443) | |
1681061801.503488: Worker 0: training step 4235 done (global step: 8445) | |
1681061801.513298: Worker 0: training step 4236 done (global step: 8448) | |
1681061801.520978: Worker 0: training step 4237 done (global step: 8450) | |
1681061801.527356: Worker 0: training step 4238 done (global step: 8452) | |
1681061801.537819: Worker 0: training step 4239 done (global step: 8454) | |
1681061801.546542: Worker 0: training step 4240 done (global step: 8456) | |
1681061801.554074: Worker 0: training step 4241 done (global step: 8458) | |
1681061801.562241: Worker 0: training step 4242 done (global step: 8460) | |
1681061801.570657: Worker 0: training step 4243 done (global step: 8462) | |
1681061801.580326: Worker 0: training step 4244 done (global step: 8464) | |
1681061801.588181: Worker 0: training step 4245 done (global step: 8466) | |
1681061801.596765: Worker 0: training step 4246 done (global step: 8469) | |
1681061801.604944: Worker 0: training step 4247 done (global step: 8471) | |
1681061801.610575: Worker 0: training step 4248 done (global step: 8473) | |
1681061801.616951: Worker 0: training step 4249 done (global step: 8475) | |
1681061801.626009: Worker 0: training step 4250 done (global step: 8477) | |
1681061801.633882: Worker 0: training step 4251 done (global step: 8480) | |
1681061801.639361: Worker 0: training step 4252 done (global step: 8481) | |
1681061801.644650: Worker 0: training step 4253 done (global step: 8483) | |
1681061801.650042: Worker 0: training step 4254 done (global step: 8485) | |
1681061801.655312: Worker 0: training step 4255 done (global step: 8487) | |
1681061801.660956: Worker 0: training step 4256 done (global step: 8489) | |
1681061801.666275: Worker 0: training step 4257 done (global step: 8491) | |
1681061801.671182: Worker 0: training step 4258 done (global step: 8493) | |
1681061801.677183: Worker 0: training step 4259 done (global step: 8495) | |
1681061801.682740: Worker 0: training step 4260 done (global step: 8497) | |
1681061801.687912: Worker 0: training step 4261 done (global step: 8499) | |
1681061801.693489: Worker 0: training step 4262 done (global step: 8501) | |
1681061801.698692: Worker 0: training step 4263 done (global step: 8503) | |
1681061801.704369: Worker 0: training step 4264 done (global step: 8505) | |
1681061801.709445: Worker 0: training step 4265 done (global step: 8507) | |
1681061801.715039: Worker 0: training step 4266 done (global step: 8509) | |
1681061801.720775: Worker 0: training step 4267 done (global step: 8511) | |
1681061801.725976: Worker 0: training step 4268 done (global step: 8513) | |
1681061801.731976: Worker 0: training step 4269 done (global step: 8515) | |
1681061801.737527: Worker 0: training step 4270 done (global step: 8517) | |
1681061801.743177: Worker 0: training step 4271 done (global step: 8519) | |
1681061801.748746: Worker 0: training step 4272 done (global step: 8521) | |
1681061801.755426: Worker 0: training step 4273 done (global step: 8523) | |
1681061801.762519: Worker 0: training step 4274 done (global step: 8525) | |
1681061801.772569: Worker 0: training step 4275 done (global step: 8527) | |
1681061801.780685: Worker 0: training step 4276 done (global step: 8529) | |
1681061801.787653: Worker 0: training step 4277 done (global step: 8531) | |
1681061801.794546: Worker 0: training step 4278 done (global step: 8533) | |
1681061801.802643: Worker 0: training step 4279 done (global step: 8535) | |
1681061801.808583: Worker 0: training step 4280 done (global step: 8537) | |
1681061801.816059: Worker 0: training step 4281 done (global step: 8538) | |
1681061801.824968: Worker 0: training step 4282 done (global step: 8540) | |
1681061801.833464: Worker 0: training step 4283 done (global step: 8543) | |
1681061801.842648: Worker 0: training step 4284 done (global step: 8545) | |
1681061801.850053: Worker 0: training step 4285 done (global step: 8548) | |
1681061801.856973: Worker 0: training step 4286 done (global step: 8550) | |
1681061801.865822: Worker 0: training step 4287 done (global step: 8552) | |
1681061801.874106: Worker 0: training step 4288 done (global step: 8554) | |
1681061801.880893: Worker 0: training step 4289 done (global step: 8556) | |
1681061801.890430: Worker 0: training step 4290 done (global step: 8558) | |
1681061801.896880: Worker 0: training step 4291 done (global step: 8560) | |
1681061801.903734: Worker 0: training step 4292 done (global step: 8562) | |
1681061801.911520: Worker 0: training step 4293 done (global step: 8564) | |
1681061801.918657: Worker 0: training step 4294 done (global step: 8566) | |
1681061801.927778: Worker 0: training step 4295 done (global step: 8568) | |
1681061801.934453: Worker 0: training step 4296 done (global step: 8570) | |
1681061801.941327: Worker 0: training step 4297 done (global step: 8572) | |
1681061801.950127: Worker 0: training step 4298 done (global step: 8574) | |
1681061801.957761: Worker 0: training step 4299 done (global step: 8576) | |
1681061801.967044: Worker 0: training step 4300 done (global step: 8578) | |
1681061801.974344: Worker 0: training step 4301 done (global step: 8580) | |
1681061801.982485: Worker 0: training step 4302 done (global step: 8582) | |
1681061801.991259: Worker 0: training step 4303 done (global step: 8584) | |
1681061802.006491: Worker 0: training step 4304 done (global step: 8586) | |
1681061802.017053: Worker 0: training step 4305 done (global step: 8588) | |
1681061802.024900: Worker 0: training step 4306 done (global step: 8590) | |
1681061802.032500: Worker 0: training step 4307 done (global step: 8593) | |
1681061802.047591: Worker 0: training step 4308 done (global step: 8594) | |
1681061802.055264: Worker 0: training step 4309 done (global step: 8596) | |
1681061802.064810: Worker 0: training step 4310 done (global step: 8598) | |
1681061802.071917: Worker 0: training step 4311 done (global step: 8600) | |
1681061802.082220: Worker 0: training step 4312 done (global step: 8603) | |
1681061802.089541: Worker 0: training step 4313 done (global step: 8605) | |
1681061802.096480: Worker 0: training step 4314 done (global step: 8607) | |
1681061802.103492: Worker 0: training step 4315 done (global step: 8608) | |
1681061802.110757: Worker 0: training step 4316 done (global step: 8611) | |
1681061802.120183: Worker 0: training step 4317 done (global step: 8612) | |
1681061802.126058: Worker 0: training step 4318 done (global step: 8615) | |
1681061802.132248: Worker 0: training step 4319 done (global step: 8617) | |
1681061802.139348: Worker 0: training step 4320 done (global step: 8619) | |
1681061802.145305: Worker 0: training step 4321 done (global step: 8621) | |
1681061802.152386: Worker 0: training step 4322 done (global step: 8623) | |
1681061802.158697: Worker 0: training step 4323 done (global step: 8626) | |
1681061802.164111: Worker 0: training step 4324 done (global step: 8628) | |
1681061802.169194: Worker 0: training step 4325 done (global step: 8630) | |
1681061802.174167: Worker 0: training step 4326 done (global step: 8631) | |
1681061802.180402: Worker 0: training step 4327 done (global step: 8633) | |
1681061802.186236: Worker 0: training step 4328 done (global step: 8636) | |
1681061802.191442: Worker 0: training step 4329 done (global step: 8638) | |
1681061802.197849: Worker 0: training step 4330 done (global step: 8640) | |
1681061802.202915: Worker 0: training step 4331 done (global step: 8642) | |
1681061802.208888: Worker 0: training step 4332 done (global step: 8643) | |
1681061802.214663: Worker 0: training step 4333 done (global step: 8646) | |
1681061802.220366: Worker 0: training step 4334 done (global step: 8648) | |
1681061802.226993: Worker 0: training step 4335 done (global step: 8650) | |
1681061802.232156: Worker 0: training step 4336 done (global step: 8652) | |
1681061802.237627: Worker 0: training step 4337 done (global step: 8653) | |
1681061802.242786: Worker 0: training step 4338 done (global step: 8655) | |
1681061802.248242: Worker 0: training step 4339 done (global step: 8657) | |
1681061802.254438: Worker 0: training step 4340 done (global step: 8659) | |
1681061802.259538: Worker 0: training step 4341 done (global step: 8661) | |
1681061802.265100: Worker 0: training step 4342 done (global step: 8663) | |
1681061802.270394: Worker 0: training step 4343 done (global step: 8665) | |
1681061802.275972: Worker 0: training step 4344 done (global step: 8667) | |
1681061802.281779: Worker 0: training step 4345 done (global step: 8669) | |
1681061802.286947: Worker 0: training step 4346 done (global step: 8671) | |
1681061802.292335: Worker 0: training step 4347 done (global step: 8673) | |
1681061802.298408: Worker 0: training step 4348 done (global step: 8675) | |
1681061802.304203: Worker 0: training step 4349 done (global step: 8677) | |
1681061802.311847: Worker 0: training step 4350 done (global step: 8679) | |
1681061802.321968: Worker 0: training step 4351 done (global step: 8681) | |
1681061802.327720: Worker 0: training step 4352 done (global step: 8683) | |
1681061802.333108: Worker 0: training step 4353 done (global step: 8685) | |
1681061802.338147: Worker 0: training step 4354 done (global step: 8687) | |
1681061802.343391: Worker 0: training step 4355 done (global step: 8689) | |
1681061802.348432: Worker 0: training step 4356 done (global step: 8691) | |
1681061802.353318: Worker 0: training step 4357 done (global step: 8693) | |
1681061802.358434: Worker 0: training step 4358 done (global step: 8694) | |
1681061802.363214: Worker 0: training step 4359 done (global step: 8696) | |
1681061802.368599: Worker 0: training step 4360 done (global step: 8697) | |
1681061802.374261: Worker 0: training step 4361 done (global step: 8699) | |
1681061802.379343: Worker 0: training step 4362 done (global step: 8701) | |
1681061802.386100: Worker 0: training step 4363 done (global step: 8703) | |
1681061802.391424: Worker 0: training step 4364 done (global step: 8706) | |
1681061802.396961: Worker 0: training step 4365 done (global step: 8707) | |
1681061802.402758: Worker 0: training step 4366 done (global step: 8709) | |
1681061802.407362: Worker 0: training step 4367 done (global step: 8712) | |
1681061802.414128: Worker 0: training step 4368 done (global step: 8713) | |
1681061802.419900: Worker 0: training step 4369 done (global step: 8715) | |
1681061802.426358: Worker 0: training step 4370 done (global step: 8718) | |
1681061802.432285: Worker 0: training step 4371 done (global step: 8720) | |
1681061802.437193: Worker 0: training step 4372 done (global step: 8722) | |
1681061802.442453: Worker 0: training step 4373 done (global step: 8724) | |
1681061802.448605: Worker 0: training step 4374 done (global step: 8726) | |
1681061802.453702: Worker 0: training step 4375 done (global step: 8728) | |
1681061802.459031: Worker 0: training step 4376 done (global step: 8730) | |
1681061802.466078: Worker 0: training step 4377 done (global step: 8732) | |
1681061802.472877: Worker 0: training step 4378 done (global step: 8734) | |
1681061802.478200: Worker 0: training step 4379 done (global step: 8736) | |
1681061802.484017: Worker 0: training step 4380 done (global step: 8738) | |
1681061802.489461: Worker 0: training step 4381 done (global step: 8740) | |
1681061802.494591: Worker 0: training step 4382 done (global step: 8742) | |
1681061802.500821: Worker 0: training step 4383 done (global step: 8744) | |
1681061802.505732: Worker 0: training step 4384 done (global step: 8746) | |
1681061802.510683: Worker 0: training step 4385 done (global step: 8748) | |
1681061802.515950: Worker 0: training step 4386 done (global step: 8750) | |
1681061802.522042: Worker 0: training step 4387 done (global step: 8751) | |
1681061802.527508: Worker 0: training step 4388 done (global step: 8754) | |
1681061802.532876: Worker 0: training step 4389 done (global step: 8756) | |
1681061802.538774: Worker 0: training step 4390 done (global step: 8758) | |
1681061802.544073: Worker 0: training step 4391 done (global step: 8760) | |
1681061802.549595: Worker 0: training step 4392 done (global step: 8762) | |
1681061802.554776: Worker 0: training step 4393 done (global step: 8764) | |
1681061802.560320: Worker 0: training step 4394 done (global step: 8766) | |
1681061802.565928: Worker 0: training step 4395 done (global step: 8768) | |
1681061802.571411: Worker 0: training step 4396 done (global step: 8770) | |
1681061802.576762: Worker 0: training step 4397 done (global step: 8772) | |
1681061802.582469: Worker 0: training step 4398 done (global step: 8774) | |
1681061802.587322: Worker 0: training step 4399 done (global step: 8776) | |
1681061802.592916: Worker 0: training step 4400 done (global step: 8778) | |
1681061802.785490: Worker 0: training step 4401 done (global step: 8795) | |
1681061802.793483: Worker 0: training step 4402 done (global step: 8796) | |
1681061802.802126: Worker 0: training step 4403 done (global step: 8797) | |
1681061802.806798: Worker 0: training step 4404 done (global step: 8798) | |
1681061802.811792: Worker 0: training step 4405 done (global step: 8799) | |
1681061802.816382: Worker 0: training step 4406 done (global step: 8800) | |
1681061802.826471: Worker 0: training step 4407 done (global step: 8801) | |
1681061802.839410: Worker 0: training step 4408 done (global step: 8802) | |
1681061802.848338: Worker 0: training step 4409 done (global step: 8803) | |
1681061802.858083: Worker 0: training step 4410 done (global step: 8804) | |
1681061802.867263: Worker 0: training step 4411 done (global step: 8805) | |
1681061802.873831: Worker 0: training step 4412 done (global step: 8806) | |
1681061802.879289: Worker 0: training step 4413 done (global step: 8807) | |
1681061802.884037: Worker 0: training step 4414 done (global step: 8808) | |
1681061802.889030: Worker 0: training step 4415 done (global step: 8809) | |
1681061802.893126: Worker 0: training step 4416 done (global step: 8810) | |
1681061802.897685: Worker 0: training step 4417 done (global step: 8811) | |
1681061802.901338: Worker 0: training step 4418 done (global step: 8812) | |
1681061802.905884: Worker 0: training step 4419 done (global step: 8813) | |
1681061802.912443: Worker 0: training step 4420 done (global step: 8814) | |
1681061802.916892: Worker 0: training step 4421 done (global step: 8817) | |
1681061802.922333: Worker 0: training step 4422 done (global step: 8818) | |
1681061802.927975: Worker 0: training step 4423 done (global step: 8820) | |
1681061802.934111: Worker 0: training step 4424 done (global step: 8823) | |
1681061802.939536: Worker 0: training step 4425 done (global step: 8825) | |
1681061802.945730: Worker 0: training step 4426 done (global step: 8827) | |
1681061802.951246: Worker 0: training step 4427 done (global step: 8829) | |
1681061802.956644: Worker 0: training step 4428 done (global step: 8831) | |
1681061802.962096: Worker 0: training step 4429 done (global step: 8833) | |
1681061802.968217: Worker 0: training step 4430 done (global step: 8835) | |
1681061802.973715: Worker 0: training step 4431 done (global step: 8837) | |
1681061802.979456: Worker 0: training step 4432 done (global step: 8839) | |
1681061802.984129: Worker 0: training step 4433 done (global step: 8841) | |
1681061802.989848: Worker 0: training step 4434 done (global step: 8843) | |
1681061802.995137: Worker 0: training step 4435 done (global step: 8845) | |
1681061803.001503: Worker 0: training step 4436 done (global step: 8847) | |
1681061803.007018: Worker 0: training step 4437 done (global step: 8849) | |
1681061803.012966: Worker 0: training step 4438 done (global step: 8851) | |
1681061803.018295: Worker 0: training step 4439 done (global step: 8853) | |
1681061803.023784: Worker 0: training step 4440 done (global step: 8855) | |
1681061803.029943: Worker 0: training step 4441 done (global step: 8857) | |
1681061803.035807: Worker 0: training step 4442 done (global step: 8859) | |
1681061803.041483: Worker 0: training step 4443 done (global step: 8861) | |
1681061803.046249: Worker 0: training step 4444 done (global step: 8863) | |
1681061803.052193: Worker 0: training step 4445 done (global step: 8865) | |
1681061803.057436: Worker 0: training step 4446 done (global step: 8867) | |
1681061803.063169: Worker 0: training step 4447 done (global step: 8869) | |
1681061803.067970: Worker 0: training step 4448 done (global step: 8871) | |
1681061803.073332: Worker 0: training step 4449 done (global step: 8873) | |
1681061803.078717: Worker 0: training step 4450 done (global step: 8875) | |
1681061803.084176: Worker 0: training step 4451 done (global step: 8876) | |
1681061803.089395: Worker 0: training step 4452 done (global step: 8879) | |
1681061803.094934: Worker 0: training step 4453 done (global step: 8881) | |
1681061803.100178: Worker 0: training step 4454 done (global step: 8882) | |
1681061803.105371: Worker 0: training step 4455 done (global step: 8884) | |
1681061803.111226: Worker 0: training step 4456 done (global step: 8886) | |
1681061803.117220: Worker 0: training step 4457 done (global step: 8888) | |
1681061803.122693: Worker 0: training step 4458 done (global step: 8890) | |
1681061803.128091: Worker 0: training step 4459 done (global step: 8892) | |
1681061803.133430: Worker 0: training step 4460 done (global step: 8894) | |
1681061803.138832: Worker 0: training step 4461 done (global step: 8896) | |
1681061803.143965: Worker 0: training step 4462 done (global step: 8898) | |
1681061803.149634: Worker 0: training step 4463 done (global step: 8900) | |
1681061803.155118: Worker 0: training step 4464 done (global step: 8902) | |
1681061803.161333: Worker 0: training step 4465 done (global step: 8904) | |
1681061803.166955: Worker 0: training step 4466 done (global step: 8906) | |
1681061803.172188: Worker 0: training step 4467 done (global step: 8908) | |
1681061803.177967: Worker 0: training step 4468 done (global step: 8910) | |
1681061803.182964: Worker 0: training step 4469 done (global step: 8912) | |
1681061803.189043: Worker 0: training step 4470 done (global step: 8914) | |
1681061803.194906: Worker 0: training step 4471 done (global step: 8916) | |
1681061803.200369: Worker 0: training step 4472 done (global step: 8918) | |
1681061803.205680: Worker 0: training step 4473 done (global step: 8920) | |
1681061803.211888: Worker 0: training step 4474 done (global step: 8922) | |
1681061803.217700: Worker 0: training step 4475 done (global step: 8924) | |
1681061803.223402: Worker 0: training step 4476 done (global step: 8926) | |
1681061803.229144: Worker 0: training step 4477 done (global step: 8928) | |
1681061803.234653: Worker 0: training step 4478 done (global step: 8930) | |
1681061803.239515: Worker 0: training step 4479 done (global step: 8932) | |
1681061803.245111: Worker 0: training step 4480 done (global step: 8934) | |
1681061803.250226: Worker 0: training step 4481 done (global step: 8936) | |
1681061803.258028: Worker 0: training step 4482 done (global step: 8938) | |
1681061803.263720: Worker 0: training step 4483 done (global step: 8940) | |
1681061803.270859: Worker 0: training step 4484 done (global step: 8942) | |
1681061803.276438: Worker 0: training step 4485 done (global step: 8944) | |
1681061803.281687: Worker 0: training step 4486 done (global step: 8946) | |
1681061803.288374: Worker 0: training step 4487 done (global step: 8948) | |
1681061803.295367: Worker 0: training step 4488 done (global step: 8950) | |
1681061803.306515: Worker 0: training step 4489 done (global step: 8951) | |
1681061803.316781: Worker 0: training step 4490 done (global step: 8953) | |
1681061803.326085: Worker 0: training step 4491 done (global step: 8956) | |
1681061803.331932: Worker 0: training step 4492 done (global step: 8958) | |
1681061803.337247: Worker 0: training step 4493 done (global step: 8960) | |
1681061803.341478: Worker 0: training step 4494 done (global step: 8962) | |
1681061803.346405: Worker 0: training step 4495 done (global step: 8963) | |
1681061803.351261: Worker 0: training step 4496 done (global step: 8965) | |
1681061803.356171: Worker 0: training step 4497 done (global step: 8967) | |
1681061803.361800: Worker 0: training step 4498 done (global step: 8969) | |
1681061803.366908: Worker 0: training step 4499 done (global step: 8971) | |
1681061803.372112: Worker 0: training step 4500 done (global step: 8973) | |
1681061803.377685: Worker 0: training step 4501 done (global step: 8975) | |
1681061803.383426: Worker 0: training step 4502 done (global step: 8977) | |
1681061803.389694: Worker 0: training step 4503 done (global step: 8979) | |
1681061803.395407: Worker 0: training step 4504 done (global step: 8981) | |
1681061803.400775: Worker 0: training step 4505 done (global step: 8983) | |
1681061803.406422: Worker 0: training step 4506 done (global step: 8985) | |
1681061803.412858: Worker 0: training step 4507 done (global step: 8987) | |
1681061803.417834: Worker 0: training step 4508 done (global step: 8989) | |
1681061803.423155: Worker 0: training step 4509 done (global step: 8991) | |
1681061803.428820: Worker 0: training step 4510 done (global step: 8993) | |
1681061803.433793: Worker 0: training step 4511 done (global step: 8995) | |
1681061803.439186: Worker 0: training step 4512 done (global step: 8997) | |
1681061803.444671: Worker 0: training step 4513 done (global step: 8999) | |
1681061803.450924: Worker 0: training step 4514 done (global step: 9001) | |
1681061803.456330: Worker 0: training step 4515 done (global step: 9003) | |
1681061803.462100: Worker 0: training step 4516 done (global step: 9005) | |
1681061803.467080: Worker 0: training step 4517 done (global step: 9007) | |
1681061803.472294: Worker 0: training step 4518 done (global step: 9009) | |
1681061803.478328: Worker 0: training step 4519 done (global step: 9011) | |
1681061803.483447: Worker 0: training step 4520 done (global step: 9013) | |
1681061803.489396: Worker 0: training step 4521 done (global step: 9015) | |
1681061803.494374: Worker 0: training step 4522 done (global step: 9017) | |
1681061803.499681: Worker 0: training step 4523 done (global step: 9019) | |
1681061803.505235: Worker 0: training step 4524 done (global step: 9021) | |
1681061803.510762: Worker 0: training step 4525 done (global step: 9023) | |
1681061803.516710: Worker 0: training step 4526 done (global step: 9025) | |
1681061803.522333: Worker 0: training step 4527 done (global step: 9027) | |
1681061803.527003: Worker 0: training step 4528 done (global step: 9029) | |
1681061803.532478: Worker 0: training step 4529 done (global step: 9031) | |
1681061803.537824: Worker 0: training step 4530 done (global step: 9033) | |
1681061803.542999: Worker 0: training step 4531 done (global step: 9035) | |
1681061803.547579: Worker 0: training step 4532 done (global step: 9037) | |
1681061803.553128: Worker 0: training step 4533 done (global step: 9038) | |
1681061803.558033: Worker 0: training step 4534 done (global step: 9040) | |
1681061803.563229: Worker 0: training step 4535 done (global step: 9042) | |
1681061803.569504: Worker 0: training step 4536 done (global step: 9044) | |
1681061803.575680: Worker 0: training step 4537 done (global step: 9046) | |
1681061803.581644: Worker 0: training step 4538 done (global step: 9048) | |
1681061803.586836: Worker 0: training step 4539 done (global step: 9050) | |
1681061803.592401: Worker 0: training step 4540 done (global step: 9052) | |
1681061803.597883: Worker 0: training step 4541 done (global step: 9054) | |
1681061803.603873: Worker 0: training step 4542 done (global step: 9056) | |
1681061803.608820: Worker 0: training step 4543 done (global step: 9058) | |
1681061803.614256: Worker 0: training step 4544 done (global step: 9060) | |
1681061803.619344: Worker 0: training step 4545 done (global step: 9062) | |
1681061803.625418: Worker 0: training step 4546 done (global step: 9064) | |
1681061803.631083: Worker 0: training step 4547 done (global step: 9066) | |
1681061803.636664: Worker 0: training step 4548 done (global step: 9068) | |
1681061803.643771: Worker 0: training step 4549 done (global step: 9070) | |
1681061803.649236: Worker 0: training step 4550 done (global step: 9072) | |
1681061803.654904: Worker 0: training step 4551 done (global step: 9074) | |
1681061803.661683: Worker 0: training step 4552 done (global step: 9076) | |
1681061803.666780: Worker 0: training step 4553 done (global step: 9078) | |
1681061803.672962: Worker 0: training step 4554 done (global step: 9080) | |
1681061803.679576: Worker 0: training step 4555 done (global step: 9082) | |
1681061803.684818: Worker 0: training step 4556 done (global step: 9084) | |
1681061803.690260: Worker 0: training step 4557 done (global step: 9086) | |
1681061803.695739: Worker 0: training step 4558 done (global step: 9088) | |
1681061803.701156: Worker 0: training step 4559 done (global step: 9090) | |
1681061803.706334: Worker 0: training step 4560 done (global step: 9092) | |
1681061803.711392: Worker 0: training step 4561 done (global step: 9094) | |
1681061803.715735: Worker 0: training step 4562 done (global step: 9096) | |
1681061803.721030: Worker 0: training step 4563 done (global step: 9098) | |
1681061803.726625: Worker 0: training step 4564 done (global step: 9100) | |
1681061803.732169: Worker 0: training step 4565 done (global step: 9102) | |
1681061803.739150: Worker 0: training step 4566 done (global step: 9104) | |
1681061803.744648: Worker 0: training step 4567 done (global step: 9106) | |
1681061803.751912: Worker 0: training step 4568 done (global step: 9108) | |
1681061803.758063: Worker 0: training step 4569 done (global step: 9111) | |
1681061803.763495: Worker 0: training step 4570 done (global step: 9113) | |
1681061803.768616: Worker 0: training step 4571 done (global step: 9115) | |
1681061803.774106: Worker 0: training step 4572 done (global step: 9117) | |
1681061803.779836: Worker 0: training step 4573 done (global step: 9119) | |
1681061803.784899: Worker 0: training step 4574 done (global step: 9121) | |
1681061803.790195: Worker 0: training step 4575 done (global step: 9122) | |
1681061803.795463: Worker 0: training step 4576 done (global step: 9124) | |
1681061803.801220: Worker 0: training step 4577 done (global step: 9126) | |
1681061803.805926: Worker 0: training step 4578 done (global step: 9128) | |
1681061803.811201: Worker 0: training step 4579 done (global step: 9130) | |
1681061803.815833: Worker 0: training step 4580 done (global step: 9132) | |
1681061803.821433: Worker 0: training step 4581 done (global step: 9134) | |
1681061803.826286: Worker 0: training step 4582 done (global step: 9136) | |
1681061803.831002: Worker 0: training step 4583 done (global step: 9138) | |
1681061803.836639: Worker 0: training step 4584 done (global step: 9139) | |
1681061803.842373: Worker 0: training step 4585 done (global step: 9142) | |
1681061803.849178: Worker 0: training step 4586 done (global step: 9143) | |
1681061803.857315: Worker 0: training step 4587 done (global step: 9145) | |
1681061803.863936: Worker 0: training step 4588 done (global step: 9148) | |
1681061803.869740: Worker 0: training step 4589 done (global step: 9150) | |
1681061803.881944: Worker 0: training step 4590 done (global step: 9152) | |
1681061803.892507: Worker 0: training step 4591 done (global step: 9154) | |
1681061803.902888: Worker 0: training step 4592 done (global step: 9157) | |
1681061803.909980: Worker 0: training step 4593 done (global step: 9158) | |
1681061803.915369: Worker 0: training step 4594 done (global step: 9160) | |
1681061803.923184: Worker 0: training step 4595 done (global step: 9163) | |
1681061803.929561: Worker 0: training step 4596 done (global step: 9165) | |
1681061803.935109: Worker 0: training step 4597 done (global step: 9167) | |
1681061803.940546: Worker 0: training step 4598 done (global step: 9169) | |
1681061803.945385: Worker 0: training step 4599 done (global step: 9171) | |
1681061803.951259: Worker 0: training step 4600 done (global step: 9173) | |
1681061803.956871: Worker 0: training step 4601 done (global step: 9175) | |
1681061803.962418: Worker 0: training step 4602 done (global step: 9177) | |
1681061803.967797: Worker 0: training step 4603 done (global step: 9179) | |
1681061803.973518: Worker 0: training step 4604 done (global step: 9181) | |
1681061803.978689: Worker 0: training step 4605 done (global step: 9183) | |
1681061803.984934: Worker 0: training step 4606 done (global step: 9185) | |
1681061803.990532: Worker 0: training step 4607 done (global step: 9187) | |
1681061803.996932: Worker 0: training step 4608 done (global step: 9189) | |
1681061804.004200: Worker 0: training step 4609 done (global step: 9191) | |
1681061804.011277: Worker 0: training step 4610 done (global step: 9193) | |
1681061804.018958: Worker 0: training step 4611 done (global step: 9195) | |
1681061804.024852: Worker 0: training step 4612 done (global step: 9197) | |
1681061804.030316: Worker 0: training step 4613 done (global step: 9199) | |
1681061804.035952: Worker 0: training step 4614 done (global step: 9201) | |
1681061804.043652: Worker 0: training step 4615 done (global step: 9203) | |
1681061804.049141: Worker 0: training step 4616 done (global step: 9205) | |
1681061804.055401: Worker 0: training step 4617 done (global step: 9207) | |
1681061804.061508: Worker 0: training step 4618 done (global step: 9210) | |
1681061804.066861: Worker 0: training step 4619 done (global step: 9211) | |
1681061804.073952: Worker 0: training step 4620 done (global step: 9213) | |
1681061804.079895: Worker 0: training step 4621 done (global step: 9216) | |
1681061804.085277: Worker 0: training step 4622 done (global step: 9218) | |
1681061804.091431: Worker 0: training step 4623 done (global step: 9220) | |
1681061804.096495: Worker 0: training step 4624 done (global step: 9222) | |
1681061804.102580: Worker 0: training step 4625 done (global step: 9224) | |
1681061804.107546: Worker 0: training step 4626 done (global step: 9226) | |
1681061804.113445: Worker 0: training step 4627 done (global step: 9228) | |
1681061804.119159: Worker 0: training step 4628 done (global step: 9230) | |
1681061804.126199: Worker 0: training step 4629 done (global step: 9232) | |
1681061804.132999: Worker 0: training step 4630 done (global step: 9234) | |
1681061804.138034: Worker 0: training step 4631 done (global step: 9236) | |
1681061804.143596: Worker 0: training step 4632 done (global step: 9238) | |
1681061804.149468: Worker 0: training step 4633 done (global step: 9240) | |
1681061804.154867: Worker 0: training step 4634 done (global step: 9242) | |
1681061804.160964: Worker 0: training step 4635 done (global step: 9244) | |
1681061804.165980: Worker 0: training step 4636 done (global step: 9246) | |
1681061804.170962: Worker 0: training step 4637 done (global step: 9248) | |
1681061804.176671: Worker 0: training step 4638 done (global step: 9249) | |
1681061804.182781: Worker 0: training step 4639 done (global step: 9251) | |
1681061804.187474: Worker 0: training step 4640 done (global step: 9254) | |
1681061804.192346: Worker 0: training step 4641 done (global step: 9255) | |
1681061804.197886: Worker 0: training step 4642 done (global step: 9257) | |
1681061804.203238: Worker 0: training step 4643 done (global step: 9259) | |
1681061804.208398: Worker 0: training step 4644 done (global step: 9261) | |
1681061804.214378: Worker 0: training step 4645 done (global step: 9263) | |
1681061804.219856: Worker 0: training step 4646 done (global step: 9265) | |
1681061804.225086: Worker 0: training step 4647 done (global step: 9267) | |
1681061804.230112: Worker 0: training step 4648 done (global step: 9269) | |
1681061804.235467: Worker 0: training step 4649 done (global step: 9270) | |
1681061804.241010: Worker 0: training step 4650 done (global step: 9272) | |
1681061804.246634: Worker 0: training step 4651 done (global step: 9274) | |
1681061804.252381: Worker 0: training step 4652 done (global step: 9277) | |
1681061804.258878: Worker 0: training step 4653 done (global step: 9279) | |
1681061804.264434: Worker 0: training step 4654 done (global step: 9281) | |
1681061804.269768: Worker 0: training step 4655 done (global step: 9283) | |
1681061804.275878: Worker 0: training step 4656 done (global step: 9285) | |
1681061804.282867: Worker 0: training step 4657 done (global step: 9287) | |
1681061804.288437: Worker 0: training step 4658 done (global step: 9289) | |
1681061804.294756: Worker 0: training step 4659 done (global step: 9291) | |
1681061804.299845: Worker 0: training step 4660 done (global step: 9293) | |
1681061804.305797: Worker 0: training step 4661 done (global step: 9295) | |
1681061804.313267: Worker 0: training step 4662 done (global step: 9297) | |
1681061804.319353: Worker 0: training step 4663 done (global step: 9299) | |
1681061804.326506: Worker 0: training step 4664 done (global step: 9301) | |
1681061804.333275: Worker 0: training step 4665 done (global step: 9303) | |
1681061804.339092: Worker 0: training step 4666 done (global step: 9305) | |
1681061804.344776: Worker 0: training step 4667 done (global step: 9307) | |
1681061804.350752: Worker 0: training step 4668 done (global step: 9309) | |
1681061804.355450: Worker 0: training step 4669 done (global step: 9311) | |
1681061804.361415: Worker 0: training step 4670 done (global step: 9313) | |
1681061804.366861: Worker 0: training step 4671 done (global step: 9315) | |
1681061804.371902: Worker 0: training step 4672 done (global step: 9317) | |
1681061804.378256: Worker 0: training step 4673 done (global step: 9319) | |
1681061804.383320: Worker 0: training step 4674 done (global step: 9321) | |
1681061804.389285: Worker 0: training step 4675 done (global step: 9323) | |
1681061804.396258: Worker 0: training step 4676 done (global step: 9325) | |
1681061804.400995: Worker 0: training step 4677 done (global step: 9327) | |
1681061804.406070: Worker 0: training step 4678 done (global step: 9329) | |
1681061804.411058: Worker 0: training step 4679 done (global step: 9331) | |
1681061804.415542: Worker 0: training step 4680 done (global step: 9333) | |
1681061804.422211: Worker 0: training step 4681 done (global step: 9334) | |
1681061804.427705: Worker 0: training step 4682 done (global step: 9337) | |
1681061804.433131: Worker 0: training step 4683 done (global step: 9339) | |
1681061804.438641: Worker 0: training step 4684 done (global step: 9341) | |
1681061804.444048: Worker 0: training step 4685 done (global step: 9343) | |
1681061804.449174: Worker 0: training step 4686 done (global step: 9345) | |
1681061804.454821: Worker 0: training step 4687 done (global step: 9346) | |
1681061804.460670: Worker 0: training step 4688 done (global step: 9348) | |
1681061804.468469: Worker 0: training step 4689 done (global step: 9350) | |
1681061804.474677: Worker 0: training step 4690 done (global step: 9352) | |
1681061804.480772: Worker 0: training step 4691 done (global step: 9354) | |
1681061804.485926: Worker 0: training step 4692 done (global step: 9356) | |
1681061804.491709: Worker 0: training step 4693 done (global step: 9358) | |
1681061804.496912: Worker 0: training step 4694 done (global step: 9360) | |
1681061804.502990: Worker 0: training step 4695 done (global step: 9362) | |
1681061804.508767: Worker 0: training step 4696 done (global step: 9364) | |
1681061804.514669: Worker 0: training step 4697 done (global step: 9366) | |
1681061804.520931: Worker 0: training step 4698 done (global step: 9368) | |
1681061804.527345: Worker 0: training step 4699 done (global step: 9370) | |
1681061804.533410: Worker 0: training step 4700 done (global step: 9372) | |
1681061804.540773: Worker 0: training step 4701 done (global step: 9374) | |
1681061804.546449: Worker 0: training step 4702 done (global step: 9377) | |
1681061804.552601: Worker 0: training step 4703 done (global step: 9378) | |
1681061804.558330: Worker 0: training step 4704 done (global step: 9381) | |
1681061804.564000: Worker 0: training step 4705 done (global step: 9383) | |
1681061804.569313: Worker 0: training step 4706 done (global step: 9385) | |
1681061804.575996: Worker 0: training step 4707 done (global step: 9387) | |
1681061804.580885: Worker 0: training step 4708 done (global step: 9389) | |
1681061804.586340: Worker 0: training step 4709 done (global step: 9391) | |
1681061804.591988: Worker 0: training step 4710 done (global step: 9393) | |
1681061804.597724: Worker 0: training step 4711 done (global step: 9395) | |
1681061804.602576: Worker 0: training step 4712 done (global step: 9397) | |
1681061804.608133: Worker 0: training step 4713 done (global step: 9398) | |
1681061804.613770: Worker 0: training step 4714 done (global step: 9401) | |
1681061804.619799: Worker 0: training step 4715 done (global step: 9402) | |
1681061804.625531: Worker 0: training step 4716 done (global step: 9405) | |
1681061804.631338: Worker 0: training step 4717 done (global step: 9407) | |
1681061804.635905: Worker 0: training step 4718 done (global step: 9409) | |
1681061804.641983: Worker 0: training step 4719 done (global step: 9410) | |
1681061804.647887: Worker 0: training step 4720 done (global step: 9413) | |
1681061804.653305: Worker 0: training step 4721 done (global step: 9415) | |
1681061804.659334: Worker 0: training step 4722 done (global step: 9417) | |
1681061804.665315: Worker 0: training step 4723 done (global step: 9419) | |
1681061804.670871: Worker 0: training step 4724 done (global step: 9421) | |
1681061804.675887: Worker 0: training step 4725 done (global step: 9423) | |
1681061804.682958: Worker 0: training step 4726 done (global step: 9425) | |
1681061804.688898: Worker 0: training step 4727 done (global step: 9427) | |
1681061804.695571: Worker 0: training step 4728 done (global step: 9429) | |
1681061804.701458: Worker 0: training step 4729 done (global step: 9431) | |
1681061804.707192: Worker 0: training step 4730 done (global step: 9433) | |
1681061804.712793: Worker 0: training step 4731 done (global step: 9435) | |
1681061804.718122: Worker 0: training step 4732 done (global step: 9437) | |
1681061804.723537: Worker 0: training step 4733 done (global step: 9439) | |
1681061804.729176: Worker 0: training step 4734 done (global step: 9441) | |
1681061804.735414: Worker 0: training step 4735 done (global step: 9443) | |
1681061804.741918: Worker 0: training step 4736 done (global step: 9445) | |
1681061804.747767: Worker 0: training step 4737 done (global step: 9447) | |
1681061804.753439: Worker 0: training step 4738 done (global step: 9449) | |
1681061804.758877: Worker 0: training step 4739 done (global step: 9451) | |
1681061804.765768: Worker 0: training step 4740 done (global step: 9453) | |
1681061804.771335: Worker 0: training step 4741 done (global step: 9455) | |
1681061804.777522: Worker 0: training step 4742 done (global step: 9457) | |
1681061804.783122: Worker 0: training step 4743 done (global step: 9460) | |
1681061804.788774: Worker 0: training step 4744 done (global step: 9461) | |
1681061804.794967: Worker 0: training step 4745 done (global step: 9464) | |
1681061804.800864: Worker 0: training step 4746 done (global step: 9466) | |
1681061804.806668: Worker 0: training step 4747 done (global step: 9468) | |
1681061804.812858: Worker 0: training step 4748 done (global step: 9470) | |
1681061804.820900: Worker 0: training step 4749 done (global step: 9472) | |
1681061804.830649: Worker 0: training step 4750 done (global step: 9474) | |
1681061804.838583: Worker 0: training step 4751 done (global step: 9477) | |
1681061804.845428: Worker 0: training step 4752 done (global step: 9479) | |
1681061804.851470: Worker 0: training step 4753 done (global step: 9481) | |
1681061804.861277: Worker 0: training step 4754 done (global step: 9483) | |
1681061804.866479: Worker 0: training step 4755 done (global step: 9484) | |
1681061804.872822: Worker 0: training step 4756 done (global step: 9486) | |
1681061804.879025: Worker 0: training step 4757 done (global step: 9488) | |
1681061804.886248: Worker 0: training step 4758 done (global step: 9490) | |
1681061804.893280: Worker 0: training step 4759 done (global step: 9492) | |
1681061804.900022: Worker 0: training step 4760 done (global step: 9494) | |
1681061804.906898: Worker 0: training step 4761 done (global step: 9496) | |
1681061804.916309: Worker 0: training step 4762 done (global step: 9498) | |
1681061804.923293: Worker 0: training step 4763 done (global step: 9500) | |
1681061804.929345: Worker 0: training step 4764 done (global step: 9502) | |
1681061804.935521: Worker 0: training step 4765 done (global step: 9504) | |
1681061804.940857: Worker 0: training step 4766 done (global step: 9507) | |
1681061804.946837: Worker 0: training step 4767 done (global step: 9508) | |
1681061804.953414: Worker 0: training step 4768 done (global step: 9510) | |
1681061804.958569: Worker 0: training step 4769 done (global step: 9512) | |
1681061804.964079: Worker 0: training step 4770 done (global step: 9514) | |
1681061804.969375: Worker 0: training step 4771 done (global step: 9516) | |
1681061804.975753: Worker 0: training step 4772 done (global step: 9518) | |
1681061804.980886: Worker 0: training step 4773 done (global step: 9520) | |
1681061804.986658: Worker 0: training step 4774 done (global step: 9522) | |
1681061804.992919: Worker 0: training step 4775 done (global step: 9524) | |
1681061804.998524: Worker 0: training step 4776 done (global step: 9526) | |
1681061805.003535: Worker 0: training step 4777 done (global step: 9528) | |
1681061805.010021: Worker 0: training step 4778 done (global step: 9530) | |
1681061805.015773: Worker 0: training step 4779 done (global step: 9532) | |
1681061805.022025: Worker 0: training step 4780 done (global step: 9534) | |
1681061805.027908: Worker 0: training step 4781 done (global step: 9536) | |
1681061805.033230: Worker 0: training step 4782 done (global step: 9538) | |
1681061805.038847: Worker 0: training step 4783 done (global step: 9540) | |
1681061805.043912: Worker 0: training step 4784 done (global step: 9542) | |
1681061805.050464: Worker 0: training step 4785 done (global step: 9543) | |
1681061805.056370: Worker 0: training step 4786 done (global step: 9546) | |
1681061805.062232: Worker 0: training step 4787 done (global step: 9547) | |
1681061805.067930: Worker 0: training step 4788 done (global step: 9549) | |
1681061805.073132: Worker 0: training step 4789 done (global step: 9551) | |
1681061805.079788: Worker 0: training step 4790 done (global step: 9553) | |
1681061805.084715: Worker 0: training step 4791 done (global step: 9555) | |
1681061805.090548: Worker 0: training step 4792 done (global step: 9557) | |
1681061805.097016: Worker 0: training step 4793 done (global step: 9559) | |
1681061805.101913: Worker 0: training step 4794 done (global step: 9562) | |
1681061805.106733: Worker 0: training step 4795 done (global step: 9563) | |
1681061805.111848: Worker 0: training step 4796 done (global step: 9565) | |
1681061805.117683: Worker 0: training step 4797 done (global step: 9567) | |
1681061805.122986: Worker 0: training step 4798 done (global step: 9569) | |
1681061805.128427: Worker 0: training step 4799 done (global step: 9571) | |
1681061805.133926: Worker 0: training step 4800 done (global step: 9573) | |
1681061805.138875: Worker 0: training step 4801 done (global step: 9575) | |
1681061805.144185: Worker 0: training step 4802 done (global step: 9576) | |
1681061805.151016: Worker 0: training step 4803 done (global step: 9579) | |
1681061805.157034: Worker 0: training step 4804 done (global step: 9581) | |
1681061805.162874: Worker 0: training step 4805 done (global step: 9583) | |
1681061805.168795: Worker 0: training step 4806 done (global step: 9585) | |
1681061805.174865: Worker 0: training step 4807 done (global step: 9587) | |
1681061805.180282: Worker 0: training step 4808 done (global step: 9589) | |
1681061805.185190: Worker 0: training step 4809 done (global step: 9591) | |
1681061805.190770: Worker 0: training step 4810 done (global step: 9593) | |
1681061805.196353: Worker 0: training step 4811 done (global step: 9595) | |
1681061805.201632: Worker 0: training step 4812 done (global step: 9597) | |
1681061805.207019: Worker 0: training step 4813 done (global step: 9599) | |
1681061805.212730: Worker 0: training step 4814 done (global step: 9601) | |
1681061805.218559: Worker 0: training step 4815 done (global step: 9603) | |
1681061805.224060: Worker 0: training step 4816 done (global step: 9605) | |
1681061805.229250: Worker 0: training step 4817 done (global step: 9607) | |
1681061805.234897: Worker 0: training step 4818 done (global step: 9609) | |
1681061805.240657: Worker 0: training step 4819 done (global step: 9611) | |
1681061805.246168: Worker 0: training step 4820 done (global step: 9613) | |
1681061805.251038: Worker 0: training step 4821 done (global step: 9615) | |
1681061805.257354: Worker 0: training step 4822 done (global step: 9617) | |
1681061805.262869: Worker 0: training step 4823 done (global step: 9619) | |
1681061805.268821: Worker 0: training step 4824 done (global step: 9621) | |
1681061805.274066: Worker 0: training step 4825 done (global step: 9623) | |
1681061805.279012: Worker 0: training step 4826 done (global step: 9625) | |
1681061805.284772: Worker 0: training step 4827 done (global step: 9627) | |
1681061805.290921: Worker 0: training step 4828 done (global step: 9629) | |
1681061805.298248: Worker 0: training step 4829 done (global step: 9631) | |
1681061805.304810: Worker 0: training step 4830 done (global step: 9633) | |
1681061805.310847: Worker 0: training step 4831 done (global step: 9635) | |
1681061805.316678: Worker 0: training step 4832 done (global step: 9637) | |
1681061805.323222: Worker 0: training step 4833 done (global step: 9639) | |
1681061805.327883: Worker 0: training step 4834 done (global step: 9641) | |
1681061805.333940: Worker 0: training step 4835 done (global step: 9643) | |
1681061805.339763: Worker 0: training step 4836 done (global step: 9645) | |
1681061805.345538: Worker 0: training step 4837 done (global step: 9647) | |
1681061805.351322: Worker 0: training step 4838 done (global step: 9649) | |
1681061805.357529: Worker 0: training step 4839 done (global step: 9652) | |
1681061805.362924: Worker 0: training step 4840 done (global step: 9654) | |
1681061805.368887: Worker 0: training step 4841 done (global step: 9656) | |
1681061805.374264: Worker 0: training step 4842 done (global step: 9658) | |
1681061805.379421: Worker 0: training step 4843 done (global step: 9660) | |
1681061805.385306: Worker 0: training step 4844 done (global step: 9662) | |
1681061805.391283: Worker 0: training step 4845 done (global step: 9664) | |
1681061805.396323: Worker 0: training step 4846 done (global step: 9666) | |
1681061805.402229: Worker 0: training step 4847 done (global step: 9668) | |
1681061805.407156: Worker 0: training step 4848 done (global step: 9670) | |
1681061805.412992: Worker 0: training step 4849 done (global step: 9672) | |
1681061805.418404: Worker 0: training step 4850 done (global step: 9674) | |
1681061805.423691: Worker 0: training step 4851 done (global step: 9676) | |
1681061805.429271: Worker 0: training step 4852 done (global step: 9678) | |
1681061805.434690: Worker 0: training step 4853 done (global step: 9680) | |
1681061805.440431: Worker 0: training step 4854 done (global step: 9682) | |
1681061805.446556: Worker 0: training step 4855 done (global step: 9684) | |
1681061805.452722: Worker 0: training step 4856 done (global step: 9686) | |
1681061805.458596: Worker 0: training step 4857 done (global step: 9688) | |
1681061805.464397: Worker 0: training step 4858 done (global step: 9690) | |
1681061805.469831: Worker 0: training step 4859 done (global step: 9692) | |
1681061805.475362: Worker 0: training step 4860 done (global step: 9694) | |
1681061805.482058: Worker 0: training step 4861 done (global step: 9696) | |
1681061805.486161: Worker 0: training step 4862 done (global step: 9698) | |
1681061805.491375: Worker 0: training step 4863 done (global step: 9700) | |
1681061805.496647: Worker 0: training step 4864 done (global step: 9702) | |
1681061805.502253: Worker 0: training step 4865 done (global step: 9704) | |
1681061805.507276: Worker 0: training step 4866 done (global step: 9706) | |
1681061805.513086: Worker 0: training step 4867 done (global step: 9708) | |
1681061805.518677: Worker 0: training step 4868 done (global step: 9710) | |
1681061805.523785: Worker 0: training step 4869 done (global step: 9712) | |
1681061805.529258: Worker 0: training step 4870 done (global step: 9714) | |
1681061805.535407: Worker 0: training step 4871 done (global step: 9716) | |
1681061805.541500: Worker 0: training step 4872 done (global step: 9718) | |
1681061805.546994: Worker 0: training step 4873 done (global step: 9720) | |
1681061805.552708: Worker 0: training step 4874 done (global step: 9722) | |
1681061805.558581: Worker 0: training step 4875 done (global step: 9724) | |
1681061805.563858: Worker 0: training step 4876 done (global step: 9726) | |
1681061805.569841: Worker 0: training step 4877 done (global step: 9728) | |
1681061805.575587: Worker 0: training step 4878 done (global step: 9730) | |
1681061805.582215: Worker 0: training step 4879 done (global step: 9732) | |
1681061805.587903: Worker 0: training step 4880 done (global step: 9735) | |
1681061805.593144: Worker 0: training step 4881 done (global step: 9736) | |
1681061805.598889: Worker 0: training step 4882 done (global step: 9738) | |
1681061805.603581: Worker 0: training step 4883 done (global step: 9740) | |
1681061805.609710: Worker 0: training step 4884 done (global step: 9742) | |
1681061805.616100: Worker 0: training step 4885 done (global step: 9744) | |
1681061805.621837: Worker 0: training step 4886 done (global step: 9746) | |
1681061805.627365: Worker 0: training step 4887 done (global step: 9748) | |
1681061805.633237: Worker 0: training step 4888 done (global step: 9750) | |
1681061805.640270: Worker 0: training step 4889 done (global step: 9752) | |
1681061805.658414: Worker 0: training step 4890 done (global step: 9755) | |
1681061805.664256: Worker 0: training step 4891 done (global step: 9757) | |
1681061805.669236: Worker 0: training step 4892 done (global step: 9759) | |
1681061805.674252: Worker 0: training step 4893 done (global step: 9761) | |
1681061805.679970: Worker 0: training step 4894 done (global step: 9763) | |
1681061805.685953: Worker 0: training step 4895 done (global step: 9765) | |
1681061805.692050: Worker 0: training step 4896 done (global step: 9767) | |
1681061805.697139: Worker 0: training step 4897 done (global step: 9769) | |
1681061805.702570: Worker 0: training step 4898 done (global step: 9771) | |
1681061805.707986: Worker 0: training step 4899 done (global step: 9773) | |
1681061805.713124: Worker 0: training step 4900 done (global step: 9775) | |
1681061805.720520: Worker 0: training step 4901 done (global step: 9776) | |
1681061805.725671: Worker 0: training step 4902 done (global step: 9778) | |
1681061805.732019: Worker 0: training step 4903 done (global step: 9780) | |
1681061805.737264: Worker 0: training step 4904 done (global step: 9783) | |
1681061805.741730: Worker 0: training step 4905 done (global step: 9785) | |
1681061805.747053: Worker 0: training step 4906 done (global step: 9786) | |
1681061805.751845: Worker 0: training step 4907 done (global step: 9788) | |
1681061805.757309: Worker 0: training step 4908 done (global step: 9790) | |
1681061805.762725: Worker 0: training step 4909 done (global step: 9792) | |
1681061805.768312: Worker 0: training step 4910 done (global step: 9794) | |
1681061805.773270: Worker 0: training step 4911 done (global step: 9796) | |
1681061805.779125: Worker 0: training step 4912 done (global step: 9798) | |
1681061805.784144: Worker 0: training step 4913 done (global step: 9800) | |
1681061805.789342: Worker 0: training step 4914 done (global step: 9802) | |
1681061805.794552: Worker 0: training step 4915 done (global step: 9804) | |
1681061805.799863: Worker 0: training step 4916 done (global step: 9806) | |
1681061805.805173: Worker 0: training step 4917 done (global step: 9808) | |
1681061805.809973: Worker 0: training step 4918 done (global step: 9810) | |
1681061805.815023: Worker 0: training step 4919 done (global step: 9812) | |
1681061805.820709: Worker 0: training step 4920 done (global step: 9814) | |
1681061805.825791: Worker 0: training step 4921 done (global step: 9816) | |
1681061805.831227: Worker 0: training step 4922 done (global step: 9818) | |
1681061805.836927: Worker 0: training step 4923 done (global step: 9820) | |
1681061805.842779: Worker 0: training step 4924 done (global step: 9822) | |
1681061805.848294: Worker 0: training step 4925 done (global step: 9824) | |
1681061805.853650: Worker 0: training step 4926 done (global step: 9826) | |
1681061805.859753: Worker 0: training step 4927 done (global step: 9828) | |
1681061805.865182: Worker 0: training step 4928 done (global step: 9830) | |
1681061805.870114: Worker 0: training step 4929 done (global step: 9832) | |
1681061805.876140: Worker 0: training step 4930 done (global step: 9834) | |
1681061805.881997: Worker 0: training step 4931 done (global step: 9836) | |
1681061805.887724: Worker 0: training step 4932 done (global step: 9838) | |
1681061805.892436: Worker 0: training step 4933 done (global step: 9840) | |
1681061805.898410: Worker 0: training step 4934 done (global step: 9842) | |
1681061805.903751: Worker 0: training step 4935 done (global step: 9844) | |
1681061805.908926: Worker 0: training step 4936 done (global step: 9846) | |
1681061805.914788: Worker 0: training step 4937 done (global step: 9848) | |
1681061805.919985: Worker 0: training step 4938 done (global step: 9850) | |
1681061805.926090: Worker 0: training step 4939 done (global step: 9852) | |
1681061805.931384: Worker 0: training step 4940 done (global step: 9854) | |
1681061805.936453: Worker 0: training step 4941 done (global step: 9856) | |
1681061805.941702: Worker 0: training step 4942 done (global step: 9858) | |
1681061805.947453: Worker 0: training step 4943 done (global step: 9860) | |
1681061805.953076: Worker 0: training step 4944 done (global step: 9862) | |
1681061805.958898: Worker 0: training step 4945 done (global step: 9864) | |
1681061805.964672: Worker 0: training step 4946 done (global step: 9866) | |
1681061805.969997: Worker 0: training step 4947 done (global step: 9868) | |
1681061805.975326: Worker 0: training step 4948 done (global step: 9870) | |
1681061805.980191: Worker 0: training step 4949 done (global step: 9872) | |
1681061805.985581: Worker 0: training step 4950 done (global step: 9874) | |
1681061806.143966: Worker 0: training step 4951 done (global step: 9895) | |
1681061806.148841: Worker 0: training step 4952 done (global step: 9896) | |
1681061806.153898: Worker 0: training step 4953 done (global step: 9897) | |
1681061806.159085: Worker 0: training step 4954 done (global step: 9898) | |
1681061806.165228: Worker 0: training step 4955 done (global step: 9899) | |
1681061806.171064: Worker 0: training step 4956 done (global step: 9900) | |
1681061806.175636: Worker 0: training step 4957 done (global step: 9901) | |
1681061806.180722: Worker 0: training step 4958 done (global step: 9902) | |
1681061806.186053: Worker 0: training step 4959 done (global step: 9903) | |
1681061806.190540: Worker 0: training step 4960 done (global step: 9904) | |
1681061806.196165: Worker 0: training step 4961 done (global step: 9905) | |
1681061806.201866: Worker 0: training step 4962 done (global step: 9906) | |
1681061806.206310: Worker 0: training step 4963 done (global step: 9907) | |
1681061806.210465: Worker 0: training step 4964 done (global step: 9908) | |
1681061806.214569: Worker 0: training step 4965 done (global step: 9909) | |
1681061806.219239: Worker 0: training step 4966 done (global step: 9910) | |
1681061806.224164: Worker 0: training step 4967 done (global step: 9911) | |
1681061806.229973: Worker 0: training step 4968 done (global step: 9912) | |
1681061806.235013: Worker 0: training step 4969 done (global step: 9913) | |
1681061806.240801: Worker 0: training step 4970 done (global step: 9914) | |
1681061806.246251: Worker 0: training step 4971 done (global step: 9916) | |
1681061806.252318: Worker 0: training step 4972 done (global step: 9918) | |
1681061806.258801: Worker 0: training step 4973 done (global step: 9920) | |
1681061806.264857: Worker 0: training step 4974 done (global step: 9922) | |
1681061806.270160: Worker 0: training step 4975 done (global step: 9924) | |
1681061806.276436: Worker 0: training step 4976 done (global step: 9926) | |
1681061806.282316: Worker 0: training step 4977 done (global step: 9928) | |
1681061806.287761: Worker 0: training step 4978 done (global step: 9930) | |
1681061806.294728: Worker 0: training step 4979 done (global step: 9932) | |
1681061806.300647: Worker 0: training step 4980 done (global step: 9934) | |
1681061806.306631: Worker 0: training step 4981 done (global step: 9936) | |
1681061806.314752: Worker 0: training step 4982 done (global step: 9938) | |
1681061806.322031: Worker 0: training step 4983 done (global step: 9940) | |
1681061806.328809: Worker 0: training step 4984 done (global step: 9942) | |
1681061806.334604: Worker 0: training step 4985 done (global step: 9945) | |
1681061806.340055: Worker 0: training step 4986 done (global step: 9946) | |
1681061806.345988: Worker 0: training step 4987 done (global step: 9948) | |
1681061806.353090: Worker 0: training step 4988 done (global step: 9950) | |
1681061806.358519: Worker 0: training step 4989 done (global step: 9953) | |
1681061806.364240: Worker 0: training step 4990 done (global step: 9955) | |
1681061806.369403: Worker 0: training step 4991 done (global step: 9956) | |
1681061806.375054: Worker 0: training step 4992 done (global step: 9958) | |
1681061806.379897: Worker 0: training step 4993 done (global step: 9960) | |
1681061806.386649: Worker 0: training step 4994 done (global step: 9962) | |
1681061806.394037: Worker 0: training step 4995 done (global step: 9964) | |
1681061806.399676: Worker 0: training step 4996 done (global step: 9966) | |
1681061806.406076: Worker 0: training step 4997 done (global step: 9968) | |
1681061806.412305: Worker 0: training step 4998 done (global step: 9970) | |
1681061806.418392: Worker 0: training step 4999 done (global step: 9972) | |
1681061806.423272: Worker 0: training step 5000 done (global step: 9974) | |
1681061806.428993: Worker 0: training step 5001 done (global step: 9976) | |
1681061806.434065: Worker 0: training step 5002 done (global step: 9978) | |
1681061806.439917: Worker 0: training step 5003 done (global step: 9980) | |
1681061806.447503: Worker 0: training step 5004 done (global step: 9982) | |
1681061806.453141: Worker 0: training step 5005 done (global step: 9984) | |
1681061806.460119: Worker 0: training step 5006 done (global step: 9986) | |
1681061806.469532: Worker 0: training step 5007 done (global step: 9988) | |
1681061806.475691: Worker 0: training step 5008 done (global step: 9991) | |
1681061806.481083: Worker 0: training step 5009 done (global step: 9992) | |
1681061806.486196: Worker 0: training step 5010 done (global step: 9994) | |
1681061806.492528: Worker 0: training step 5011 done (global step: 9996) | |
1681061806.497962: Worker 0: training step 5012 done (global step: 9998) | |
1681061806.504397: Worker 0: training step 5013 done (global step: 10000) | |
1681061806.509771: Worker 0: training step 5014 done (global step: 10003) | |
1681061806.515269: Worker 0: training step 5015 done (global step: 10005) | |
1681061806.519915: Worker 0: training step 5016 done (global step: 10007) | |
1681061806.525333: Worker 0: training step 5017 done (global step: 10008) | |
1681061806.531315: Worker 0: training step 5018 done (global step: 10010) | |
1681061806.537109: Worker 0: training step 5019 done (global step: 10012) | |
1681061806.542539: Worker 0: training step 5020 done (global step: 10014) | |
1681061806.547937: Worker 0: training step 5021 done (global step: 10016) | |
1681061806.552321: Worker 0: training step 5022 done (global step: 10018) | |
1681061806.557871: Worker 0: training step 5023 done (global step: 10020) | |
1681061806.563919: Worker 0: training step 5024 done (global step: 10022) | |
1681061806.569541: Worker 0: training step 5025 done (global step: 10025) | |
1681061806.574982: Worker 0: training step 5026 done (global step: 10027) | |
1681061806.579802: Worker 0: training step 5027 done (global step: 10028) | |
1681061806.584604: Worker 0: training step 5028 done (global step: 10030) | |
1681061806.590020: Worker 0: training step 5029 done (global step: 10032) | |
1681061806.595672: Worker 0: training step 5030 done (global step: 10034) | |
1681061806.600625: Worker 0: training step 5031 done (global step: 10036) | |
1681061806.605366: Worker 0: training step 5032 done (global step: 10038) | |
1681061806.611133: Worker 0: training step 5033 done (global step: 10040) | |
1681061806.616762: Worker 0: training step 5034 done (global step: 10042) | |
1681061806.622292: Worker 0: training step 5035 done (global step: 10044) | |
1681061806.627622: Worker 0: training step 5036 done (global step: 10046) | |
1681061806.633873: Worker 0: training step 5037 done (global step: 10048) | |
1681061806.640878: Worker 0: training step 5038 done (global step: 10050) | |
1681061806.646051: Worker 0: training step 5039 done (global step: 10052) | |
1681061806.651130: Worker 0: training step 5040 done (global step: 10054) | |
1681061806.656807: Worker 0: training step 5041 done (global step: 10056) | |
1681061806.662119: Worker 0: training step 5042 done (global step: 10058) | |
1681061806.668260: Worker 0: training step 5043 done (global step: 10060) | |
1681061806.673634: Worker 0: training step 5044 done (global step: 10062) | |
1681061806.679243: Worker 0: training step 5045 done (global step: 10064) | |
1681061806.684899: Worker 0: training step 5046 done (global step: 10066) | |
1681061806.691235: Worker 0: training step 5047 done (global step: 10068) | |
1681061806.696450: Worker 0: training step 5048 done (global step: 10070) | |
1681061806.701890: Worker 0: training step 5049 done (global step: 10073) | |
1681061806.707289: Worker 0: training step 5050 done (global step: 10074) | |
1681061806.712956: Worker 0: training step 5051 done (global step: 10076) | |
1681061806.718483: Worker 0: training step 5052 done (global step: 10078) | |
1681061806.723807: Worker 0: training step 5053 done (global step: 10080) | |
1681061806.729352: Worker 0: training step 5054 done (global step: 10082) | |
1681061806.735603: Worker 0: training step 5055 done (global step: 10084) | |
1681061806.740890: Worker 0: training step 5056 done (global step: 10086) | |
1681061806.746588: Worker 0: training step 5057 done (global step: 10088) | |
1681061806.752065: Worker 0: training step 5058 done (global step: 10090) | |
1681061806.757406: Worker 0: training step 5059 done (global step: 10092) | |
1681061806.762549: Worker 0: training step 5060 done (global step: 10094) | |
1681061806.767802: Worker 0: training step 5061 done (global step: 10096) | |
1681061806.773130: Worker 0: training step 5062 done (global step: 10098) | |
1681061806.779019: Worker 0: training step 5063 done (global step: 10100) | |
1681061806.784853: Worker 0: training step 5064 done (global step: 10102) | |
1681061806.790483: Worker 0: training step 5065 done (global step: 10104) | |
1681061806.796258: Worker 0: training step 5066 done (global step: 10106) | |
1681061806.801992: Worker 0: training step 5067 done (global step: 10108) | |
1681061806.808085: Worker 0: training step 5068 done (global step: 10110) | |
1681061806.814283: Worker 0: training step 5069 done (global step: 10112) | |
1681061806.820757: Worker 0: training step 5070 done (global step: 10114) | |
1681061806.826044: Worker 0: training step 5071 done (global step: 10116) | |
1681061806.831446: Worker 0: training step 5072 done (global step: 10118) | |
1681061806.837476: Worker 0: training step 5073 done (global step: 10120) | |
1681061806.842629: Worker 0: training step 5074 done (global step: 10122) | |
1681061806.847377: Worker 0: training step 5075 done (global step: 10124) | |
1681061806.851837: Worker 0: training step 5076 done (global step: 10125) | |
1681061806.856797: Worker 0: training step 5077 done (global step: 10127) | |
1681061806.861790: Worker 0: training step 5078 done (global step: 10129) | |
1681061806.867074: Worker 0: training step 5079 done (global step: 10131) | |
1681061806.872729: Worker 0: training step 5080 done (global step: 10133) | |
1681061806.878339: Worker 0: training step 5081 done (global step: 10134) | |
1681061806.883473: Worker 0: training step 5082 done (global step: 10136) | |
1681061806.889166: Worker 0: training step 5083 done (global step: 10138) | |
1681061806.894727: Worker 0: training step 5084 done (global step: 10140) | |
1681061806.900470: Worker 0: training step 5085 done (global step: 10142) | |
1681061806.905942: Worker 0: training step 5086 done (global step: 10144) | |
1681061806.911081: Worker 0: training step 5087 done (global step: 10146) | |
1681061806.916580: Worker 0: training step 5088 done (global step: 10148) | |
1681061806.922847: Worker 0: training step 5089 done (global step: 10150) | |
1681061806.928395: Worker 0: training step 5090 done (global step: 10152) | |
1681061806.934225: Worker 0: training step 5091 done (global step: 10154) | |
1681061806.939383: Worker 0: training step 5092 done (global step: 10156) | |
1681061806.945304: Worker 0: training step 5093 done (global step: 10158) | |
1681061806.951287: Worker 0: training step 5094 done (global step: 10160) | |
1681061806.957264: Worker 0: training step 5095 done (global step: 10162) | |
1681061806.963232: Worker 0: training step 5096 done (global step: 10164) | |
1681061806.968820: Worker 0: training step 5097 done (global step: 10166) | |
1681061806.974529: Worker 0: training step 5098 done (global step: 10168) | |
1681061806.979337: Worker 0: training step 5099 done (global step: 10170) | |
1681061806.985391: Worker 0: training step 5100 done (global step: 10172) | |
1681061806.991536: Worker 0: training step 5101 done (global step: 10174) | |
1681061806.997130: Worker 0: training step 5102 done (global step: 10176) | |
1681061807.003901: Worker 0: training step 5103 done (global step: 10178) | |
1681061807.009162: Worker 0: training step 5104 done (global step: 10180) | |
1681061807.015242: Worker 0: training step 5105 done (global step: 10182) | |
1681061807.020623: Worker 0: training step 5106 done (global step: 10184) | |
1681061807.026011: Worker 0: training step 5107 done (global step: 10186) | |
1681061807.031273: Worker 0: training step 5108 done (global step: 10188) | |
1681061807.036225: Worker 0: training step 5109 done (global step: 10190) | |
1681061807.043007: Worker 0: training step 5110 done (global step: 10192) | |
1681061807.049015: Worker 0: training step 5111 done (global step: 10194) | |
1681061807.054600: Worker 0: training step 5112 done (global step: 10196) | |
1681061807.060993: Worker 0: training step 5113 done (global step: 10198) | |
1681061807.068893: Worker 0: training step 5114 done (global step: 10200) | |
1681061807.075651: Worker 0: training step 5115 done (global step: 10202) | |
1681061807.084260: Worker 0: training step 5116 done (global step: 10203) | |
1681061807.090754: Worker 0: training step 5117 done (global step: 10205) | |
1681061807.098878: Worker 0: training step 5118 done (global step: 10207) | |
1681061807.107219: Worker 0: training step 5119 done (global step: 10209) | |
1681061807.118719: Worker 0: training step 5120 done (global step: 10211) | |
1681061807.125909: Worker 0: training step 5121 done (global step: 10213) | |
1681061807.131447: Worker 0: training step 5122 done (global step: 10215) | |
1681061807.137599: Worker 0: training step 5123 done (global step: 10217) | |
1681061807.143525: Worker 0: training step 5124 done (global step: 10219) | |
1681061807.151084: Worker 0: training step 5125 done (global step: 10221) | |
1681061807.156576: Worker 0: training step 5126 done (global step: 10223) | |
1681061807.161728: Worker 0: training step 5127 done (global step: 10225) | |
1681061807.167738: Worker 0: training step 5128 done (global step: 10227) | |
1681061807.173461: Worker 0: training step 5129 done (global step: 10229) | |
1681061807.182009: Worker 0: training step 5130 done (global step: 10231) | |
1681061807.188335: Worker 0: training step 5131 done (global step: 10234) | |
1681061807.194410: Worker 0: training step 5132 done (global step: 10236) | |
1681061807.200254: Worker 0: training step 5133 done (global step: 10238) | |
1681061807.205433: Worker 0: training step 5134 done (global step: 10240) | |
1681061807.210452: Worker 0: training step 5135 done (global step: 10242) | |
1681061807.215684: Worker 0: training step 5136 done (global step: 10244) | |
1681061807.221517: Worker 0: training step 5137 done (global step: 10246) | |
1681061807.226806: Worker 0: training step 5138 done (global step: 10248) | |
1681061807.233634: Worker 0: training step 5139 done (global step: 10249) | |
1681061807.238961: Worker 0: training step 5140 done (global step: 10252) | |
1681061807.244528: Worker 0: training step 5141 done (global step: 10254) | |
1681061807.250548: Worker 0: training step 5142 done (global step: 10256) | |
1681061807.256231: Worker 0: training step 5143 done (global step: 10258) | |
1681061807.262872: Worker 0: training step 5144 done (global step: 10260) | |
1681061807.267670: Worker 0: training step 5145 done (global step: 10262) | |
1681061807.273338: Worker 0: training step 5146 done (global step: 10263) | |
1681061807.280480: Worker 0: training step 5147 done (global step: 10265) | |
1681061807.286402: Worker 0: training step 5148 done (global step: 10268) | |
1681061807.291240: Worker 0: training step 5149 done (global step: 10269) | |
1681061807.296429: Worker 0: training step 5150 done (global step: 10271) | |
1681061807.303209: Worker 0: training step 5151 done (global step: 10273) | |
1681061807.313008: Worker 0: training step 5152 done (global step: 10275) | |
1681061807.318513: Worker 0: training step 5153 done (global step: 10277) | |
1681061807.324185: Worker 0: training step 5154 done (global step: 10279) | |
1681061807.330462: Worker 0: training step 5155 done (global step: 10281) | |
1681061807.336546: Worker 0: training step 5156 done (global step: 10283) | |
1681061807.343267: Worker 0: training step 5157 done (global step: 10286) | |
1681061807.349604: Worker 0: training step 5158 done (global step: 10288) | |
1681061807.355209: Worker 0: training step 5159 done (global step: 10290) | |
1681061807.361048: Worker 0: training step 5160 done (global step: 10292) | |
1681061807.365799: Worker 0: training step 5161 done (global step: 10294) | |
1681061807.371427: Worker 0: training step 5162 done (global step: 10295) | |
1681061807.376932: Worker 0: training step 5163 done (global step: 10297) | |
1681061807.382207: Worker 0: training step 5164 done (global step: 10299) | |
1681061807.387060: Worker 0: training step 5165 done (global step: 10301) | |
1681061807.393058: Worker 0: training step 5166 done (global step: 10303) | |
1681061807.398205: Worker 0: training step 5167 done (global step: 10305) | |
1681061807.404397: Worker 0: training step 5168 done (global step: 10307) | |
1681061807.409624: Worker 0: training step 5169 done (global step: 10309) | |
1681061807.414325: Worker 0: training step 5170 done (global step: 10310) | |
1681061807.419329: Worker 0: training step 5171 done (global step: 10312) | |
1681061807.425245: Worker 0: training step 5172 done (global step: 10314) | |
1681061807.430676: Worker 0: training step 5173 done (global step: 10316) | |
1681061807.437250: Worker 0: training step 5174 done (global step: 10318) | |
1681061807.443345: Worker 0: training step 5175 done (global step: 10320) | |
1681061807.449628: Worker 0: training step 5176 done (global step: 10323) | |
1681061807.454853: Worker 0: training step 5177 done (global step: 10325) | |
1681061807.460354: Worker 0: training step 5178 done (global step: 10326) | |
1681061807.465752: Worker 0: training step 5179 done (global step: 10328) | |
1681061807.471658: Worker 0: training step 5180 done (global step: 10330) | |
1681061807.477132: Worker 0: training step 5181 done (global step: 10332) | |
1681061807.481998: Worker 0: training step 5182 done (global step: 10334) | |
1681061807.487165: Worker 0: training step 5183 done (global step: 10336) | |
1681061807.492390: Worker 0: training step 5184 done (global step: 10338) | |
1681061807.498767: Worker 0: training step 5185 done (global step: 10340) | |
1681061807.504342: Worker 0: training step 5186 done (global step: 10342) | |
1681061807.510056: Worker 0: training step 5187 done (global step: 10344) | |
1681061807.515400: Worker 0: training step 5188 done (global step: 10346) | |
1681061807.520376: Worker 0: training step 5189 done (global step: 10348) | |
1681061807.526198: Worker 0: training step 5190 done (global step: 10350) | |
1681061807.531414: Worker 0: training step 5191 done (global step: 10352) | |
1681061807.536709: Worker 0: training step 5192 done (global step: 10354) | |
1681061807.542079: Worker 0: training step 5193 done (global step: 10356) | |
1681061807.547983: Worker 0: training step 5194 done (global step: 10357) | |
1681061807.552856: Worker 0: training step 5195 done (global step: 10359) | |
1681061807.559680: Worker 0: training step 5196 done (global step: 10362) | |
1681061807.564311: Worker 0: training step 5197 done (global step: 10364) | |
1681061807.571229: Worker 0: training step 5198 done (global step: 10365) | |
1681061807.578869: Worker 0: training step 5199 done (global step: 10368) | |
1681061807.587312: Worker 0: training step 5200 done (global step: 10370) | |
1681061807.592060: Worker 0: training step 5201 done (global step: 10372) | |
1681061807.598110: Worker 0: training step 5202 done (global step: 10374) | |
1681061807.603232: Worker 0: training step 5203 done (global step: 10376) | |
1681061807.609430: Worker 0: training step 5204 done (global step: 10378) | |
1681061807.614433: Worker 0: training step 5205 done (global step: 10380) | |
1681061807.619124: Worker 0: training step 5206 done (global step: 10382) | |
1681061807.624919: Worker 0: training step 5207 done (global step: 10384) | |
1681061807.629740: Worker 0: training step 5208 done (global step: 10386) | |
1681061807.634801: Worker 0: training step 5209 done (global step: 10388) | |
1681061807.640637: Worker 0: training step 5210 done (global step: 10390) | |
1681061807.646091: Worker 0: training step 5211 done (global step: 10392) | |
1681061807.651501: Worker 0: training step 5212 done (global step: 10394) | |
1681061807.657460: Worker 0: training step 5213 done (global step: 10396) | |
1681061807.663021: Worker 0: training step 5214 done (global step: 10398) | |
1681061807.667757: Worker 0: training step 5215 done (global step: 10400) | |
1681061807.673145: Worker 0: training step 5216 done (global step: 10402) | |
1681061807.678418: Worker 0: training step 5217 done (global step: 10404) | |
1681061807.683600: Worker 0: training step 5218 done (global step: 10406) | |
1681061807.688665: Worker 0: training step 5219 done (global step: 10408) | |
1681061807.694519: Worker 0: training step 5220 done (global step: 10410) | |
1681061807.699826: Worker 0: training step 5221 done (global step: 10411) | |
1681061807.704342: Worker 0: training step 5222 done (global step: 10413) | |
1681061807.710357: Worker 0: training step 5223 done (global step: 10415) | |
1681061807.715262: Worker 0: training step 5224 done (global step: 10417) | |
1681061807.720217: Worker 0: training step 5225 done (global step: 10419) | |
1681061807.725602: Worker 0: training step 5226 done (global step: 10421) | |
1681061807.730753: Worker 0: training step 5227 done (global step: 10423) | |
1681061807.735835: Worker 0: training step 5228 done (global step: 10425) | |
1681061807.741106: Worker 0: training step 5229 done (global step: 10427) | |
1681061807.747009: Worker 0: training step 5230 done (global step: 10428) | |
1681061807.753498: Worker 0: training step 5231 done (global step: 10431) | |
1681061807.759981: Worker 0: training step 5232 done (global step: 10433) | |
1681061807.765586: Worker 0: training step 5233 done (global step: 10435) | |
1681061807.771061: Worker 0: training step 5234 done (global step: 10437) | |
1681061807.776541: Worker 0: training step 5235 done (global step: 10439) | |
1681061807.781568: Worker 0: training step 5236 done (global step: 10441) | |
1681061807.786958: Worker 0: training step 5237 done (global step: 10442) | |
1681061807.791856: Worker 0: training step 5238 done (global step: 10444) | |
1681061807.798825: Worker 0: training step 5239 done (global step: 10447) | |
1681061807.803893: Worker 0: training step 5240 done (global step: 10449) | |
1681061807.809277: Worker 0: training step 5241 done (global step: 10451) | |
1681061807.814384: Worker 0: training step 5242 done (global step: 10453) | |
1681061807.820229: Worker 0: training step 5243 done (global step: 10454) | |
1681061807.826108: Worker 0: training step 5244 done (global step: 10457) | |
1681061807.831905: Worker 0: training step 5245 done (global step: 10459) | |
1681061807.837300: Worker 0: training step 5246 done (global step: 10461) | |
1681061807.843062: Worker 0: training step 5247 done (global step: 10463) | |
1681061807.847843: Worker 0: training step 5248 done (global step: 10465) | |
1681061807.852942: Worker 0: training step 5249 done (global step: 10467) | |
1681061807.858318: Worker 0: training step 5250 done (global step: 10469) | |
1681061807.863988: Worker 0: training step 5251 done (global step: 10471) | |
1681061807.870200: Worker 0: training step 5252 done (global step: 10473) | |
1681061807.875705: Worker 0: training step 5253 done (global step: 10475) | |
1681061807.881828: Worker 0: training step 5254 done (global step: 10477) | |
1681061807.887568: Worker 0: training step 5255 done (global step: 10479) | |
1681061807.893213: Worker 0: training step 5256 done (global step: 10481) | |
1681061807.898513: Worker 0: training step 5257 done (global step: 10483) | |
1681061807.904136: Worker 0: training step 5258 done (global step: 10485) | |
1681061807.909598: Worker 0: training step 5259 done (global step: 10487) | |
1681061807.914388: Worker 0: training step 5260 done (global step: 10489) | |
1681061807.919847: Worker 0: training step 5261 done (global step: 10491) | |
1681061807.924785: Worker 0: training step 5262 done (global step: 10492) | |
1681061807.930044: Worker 0: training step 5263 done (global step: 10494) | |
1681061807.934990: Worker 0: training step 5264 done (global step: 10496) | |
1681061807.940242: Worker 0: training step 5265 done (global step: 10498) | |
1681061807.945188: Worker 0: training step 5266 done (global step: 10500) | |
1681061807.950956: Worker 0: training step 5267 done (global step: 10502) | |
1681061807.957656: Worker 0: training step 5268 done (global step: 10504) | |
1681061807.963841: Worker 0: training step 5269 done (global step: 10506) | |
1681061807.969632: Worker 0: training step 5270 done (global step: 10508) | |
1681061807.974351: Worker 0: training step 5271 done (global step: 10510) | |
1681061807.979628: Worker 0: training step 5272 done (global step: 10512) | |
1681061807.984755: Worker 0: training step 5273 done (global step: 10514) | |
1681061807.991424: Worker 0: training step 5274 done (global step: 10516) | |
1681061807.996462: Worker 0: training step 5275 done (global step: 10518) | |
1681061808.002049: Worker 0: training step 5276 done (global step: 10520) | |
1681061808.007255: Worker 0: training step 5277 done (global step: 10522) | |
1681061808.013101: Worker 0: training step 5278 done (global step: 10524) | |
1681061808.018488: Worker 0: training step 5279 done (global step: 10526) | |
1681061808.023692: Worker 0: training step 5280 done (global step: 10528) | |
1681061808.028804: Worker 0: training step 5281 done (global step: 10530) | |
1681061808.034013: Worker 0: training step 5282 done (global step: 10532) | |
1681061808.040704: Worker 0: training step 5283 done (global step: 10534) | |
1681061808.046711: Worker 0: training step 5284 done (global step: 10535) | |
1681061808.053823: Worker 0: training step 5285 done (global step: 10537) | |
1681061808.064455: Worker 0: training step 5286 done (global step: 10538) | |
1681061808.070488: Worker 0: training step 5287 done (global step: 10541) | |
1681061808.083905: Worker 0: training step 5288 done (global step: 10543) | |
1681061808.099392: Worker 0: training step 5289 done (global step: 10544) | |
1681061808.109170: Worker 0: training step 5290 done (global step: 10547) | |
1681061808.117067: Worker 0: training step 5291 done (global step: 10549) | |
1681061808.126335: Worker 0: training step 5292 done (global step: 10551) | |
1681061808.136165: Worker 0: training step 5293 done (global step: 10553) | |
1681061808.144988: Worker 0: training step 5294 done (global step: 10554) | |
1681061808.157783: Worker 0: training step 5295 done (global step: 10556) | |
1681061808.167058: Worker 0: training step 5296 done (global step: 10559) | |
1681061808.178287: Worker 0: training step 5297 done (global step: 10561) | |
1681061808.184405: Worker 0: training step 5298 done (global step: 10563) | |
1681061808.194658: Worker 0: training step 5299 done (global step: 10565) | |
1681061808.202956: Worker 0: training step 5300 done (global step: 10567) | |
1681061808.211200: Worker 0: training step 5301 done (global step: 10568) | |
1681061808.225901: Worker 0: training step 5302 done (global step: 10570) | |
1681061808.231712: Worker 0: training step 5303 done (global step: 10573) | |
1681061808.237181: Worker 0: training step 5304 done (global step: 10575) | |
1681061808.243626: Worker 0: training step 5305 done (global step: 10577) | |
1681061808.250201: Worker 0: training step 5306 done (global step: 10579) | |
1681061808.256000: Worker 0: training step 5307 done (global step: 10581) | |
1681061808.266052: Worker 0: training step 5308 done (global step: 10582) | |
1681061808.277961: Worker 0: training step 5309 done (global step: 10584) | |
1681061808.288110: Worker 0: training step 5310 done (global step: 10586) | |
1681061808.299485: Worker 0: training step 5311 done (global step: 10588) | |
1681061808.306045: Worker 0: training step 5312 done (global step: 10590) | |
1681061808.312361: Worker 0: training step 5313 done (global step: 10592) | |
1681061808.319266: Worker 0: training step 5314 done (global step: 10594) | |
1681061808.326152: Worker 0: training step 5315 done (global step: 10596) | |
1681061808.332326: Worker 0: training step 5316 done (global step: 10598) | |
1681061808.338817: Worker 0: training step 5317 done (global step: 10600) | |
1681061808.344795: Worker 0: training step 5318 done (global step: 10602) | |
1681061808.350411: Worker 0: training step 5319 done (global step: 10604) | |
1681061808.355800: Worker 0: training step 5320 done (global step: 10606) | |
1681061808.362115: Worker 0: training step 5321 done (global step: 10608) | |
1681061808.367880: Worker 0: training step 5322 done (global step: 10610) | |
1681061808.372910: Worker 0: training step 5323 done (global step: 10612) | |
1681061808.378203: Worker 0: training step 5324 done (global step: 10614) | |
1681061808.383744: Worker 0: training step 5325 done (global step: 10616) | |
1681061808.389740: Worker 0: training step 5326 done (global step: 10618) | |
1681061808.394999: Worker 0: training step 5327 done (global step: 10620) | |
1681061808.400547: Worker 0: training step 5328 done (global step: 10622) | |
1681061808.405731: Worker 0: training step 5329 done (global step: 10624) | |
1681061808.411286: Worker 0: training step 5330 done (global step: 10626) | |
1681061808.416478: Worker 0: training step 5331 done (global step: 10627) | |
1681061808.422780: Worker 0: training step 5332 done (global step: 10629) | |
1681061808.429773: Worker 0: training step 5333 done (global step: 10631) | |
1681061808.436263: Worker 0: training step 5334 done (global step: 10634) | |
1681061808.442385: Worker 0: training step 5335 done (global step: 10636) | |
1681061808.448329: Worker 0: training step 5336 done (global step: 10638) | |
1681061808.453953: Worker 0: training step 5337 done (global step: 10640) | |
1681061808.459231: Worker 0: training step 5338 done (global step: 10642) | |
1681061808.467666: Worker 0: training step 5339 done (global step: 10644) | |
1681061808.473902: Worker 0: training step 5340 done (global step: 10646) | |
1681061808.479688: Worker 0: training step 5341 done (global step: 10648) | |
1681061808.485082: Worker 0: training step 5342 done (global step: 10650) | |
1681061808.490879: Worker 0: training step 5343 done (global step: 10652) | |
1681061808.497248: Worker 0: training step 5344 done (global step: 10654) | |
1681061808.503525: Worker 0: training step 5345 done (global step: 10656) | |
1681061808.509141: Worker 0: training step 5346 done (global step: 10658) | |
1681061808.515445: Worker 0: training step 5347 done (global step: 10660) | |
1681061808.520511: Worker 0: training step 5348 done (global step: 10662) | |
1681061808.525125: Worker 0: training step 5349 done (global step: 10664) | |
1681061808.531063: Worker 0: training step 5350 done (global step: 10666) | |
1681061808.535709: Worker 0: training step 5351 done (global step: 10668) | |
1681061808.540636: Worker 0: training step 5352 done (global step: 10670) | |
1681061808.546383: Worker 0: training step 5353 done (global step: 10671) | |
1681061808.552434: Worker 0: training step 5354 done (global step: 10673) | |
1681061808.558039: Worker 0: training step 5355 done (global step: 10675) | |
1681061808.563146: Worker 0: training step 5356 done (global step: 10677) | |
1681061808.568798: Worker 0: training step 5357 done (global step: 10679) | |
1681061808.574387: Worker 0: training step 5358 done (global step: 10681) | |
1681061808.579466: Worker 0: training step 5359 done (global step: 10683) | |
1681061808.584175: Worker 0: training step 5360 done (global step: 10685) | |
1681061808.590239: Worker 0: training step 5361 done (global step: 10687) | |
1681061808.596380: Worker 0: training step 5362 done (global step: 10689) | |
1681061808.602241: Worker 0: training step 5363 done (global step: 10692) | |
1681061808.608188: Worker 0: training step 5364 done (global step: 10694) | |
1681061808.613824: Worker 0: training step 5365 done (global step: 10696) | |
1681061808.619478: Worker 0: training step 5366 done (global step: 10698) | |
1681061808.624683: Worker 0: training step 5367 done (global step: 10700) | |
1681061808.630682: Worker 0: training step 5368 done (global step: 10702) | |
1681061808.637223: Worker 0: training step 5369 done (global step: 10704) | |
1681061808.643900: Worker 0: training step 5370 done (global step: 10706) | |
1681061808.650874: Worker 0: training step 5371 done (global step: 10708) | |
1681061808.659852: Worker 0: training step 5372 done (global step: 10710) | |
1681061808.669050: Worker 0: training step 5373 done (global step: 10711) | |
1681061808.676829: Worker 0: training step 5374 done (global step: 10713) | |
1681061808.686172: Worker 0: training step 5375 done (global step: 10715) | |
1681061808.693837: Worker 0: training step 5376 done (global step: 10717) | |
1681061808.699674: Worker 0: training step 5377 done (global step: 10719) | |
1681061808.708223: Worker 0: training step 5378 done (global step: 10720) | |
1681061808.714306: Worker 0: training step 5379 done (global step: 10723) | |
1681061808.721934: Worker 0: training step 5380 done (global step: 10724) | |
1681061808.728642: Worker 0: training step 5381 done (global step: 10726) | |
1681061808.735909: Worker 0: training step 5382 done (global step: 10728) | |
1681061808.742997: Worker 0: training step 5383 done (global step: 10730) | |
1681061808.749324: Worker 0: training step 5384 done (global step: 10731) | |
1681061808.757217: Worker 0: training step 5385 done (global step: 10733) | |
1681061808.766688: Worker 0: training step 5386 done (global step: 10735) | |
1681061808.775812: Worker 0: training step 5387 done (global step: 10738) | |
1681061808.782886: Worker 0: training step 5388 done (global step: 10740) | |
1681061808.789393: Worker 0: training step 5389 done (global step: 10741) | |
1681061808.797526: Worker 0: training step 5390 done (global step: 10743) | |
1681061808.805426: Worker 0: training step 5391 done (global step: 10745) | |
1681061808.811015: Worker 0: training step 5392 done (global step: 10747) | |
1681061808.816443: Worker 0: training step 5393 done (global step: 10749) | |
1681061808.822604: Worker 0: training step 5394 done (global step: 10751) | |
1681061808.828405: Worker 0: training step 5395 done (global step: 10753) | |
1681061808.834356: Worker 0: training step 5396 done (global step: 10755) | |
1681061808.839313: Worker 0: training step 5397 done (global step: 10757) | |
1681061808.845763: Worker 0: training step 5398 done (global step: 10759) | |
1681061808.850967: Worker 0: training step 5399 done (global step: 10761) | |
1681061808.856467: Worker 0: training step 5400 done (global step: 10763) | |
1681061808.863013: Worker 0: training step 5401 done (global step: 10765) | |
1681061808.868809: Worker 0: training step 5402 done (global step: 10767) | |
1681061808.873873: Worker 0: training step 5403 done (global step: 10769) | |
1681061808.880803: Worker 0: training step 5404 done (global step: 10771) | |
1681061808.886403: Worker 0: training step 5405 done (global step: 10774) | |
1681061808.893136: Worker 0: training step 5406 done (global step: 10776) | |
1681061808.899148: Worker 0: training step 5407 done (global step: 10778) | |
1681061808.904589: Worker 0: training step 5408 done (global step: 10780) | |
1681061808.909913: Worker 0: training step 5409 done (global step: 10782) | |
1681061808.915435: Worker 0: training step 5410 done (global step: 10784) | |
1681061808.920789: Worker 0: training step 5411 done (global step: 10786) | |
1681061808.926279: Worker 0: training step 5412 done (global step: 10788) | |
1681061808.931513: Worker 0: training step 5413 done (global step: 10790) | |
1681061808.937975: Worker 0: training step 5414 done (global step: 10792) | |
1681061808.943106: Worker 0: training step 5415 done (global step: 10794) | |
1681061808.948661: Worker 0: training step 5416 done (global step: 10796) | |
1681061808.954142: Worker 0: training step 5417 done (global step: 10798) | |
1681061808.960401: Worker 0: training step 5418 done (global step: 10800) | |
1681061808.965574: Worker 0: training step 5419 done (global step: 10802) | |
1681061808.971501: Worker 0: training step 5420 done (global step: 10804) | |
1681061808.976763: Worker 0: training step 5421 done (global step: 10806) | |
1681061808.982200: Worker 0: training step 5422 done (global step: 10808) | |
1681061808.987862: Worker 0: training step 5423 done (global step: 10810) | |
1681061808.993706: Worker 0: training step 5424 done (global step: 10812) | |
1681061808.998968: Worker 0: training step 5425 done (global step: 10814) | |
1681061809.004476: Worker 0: training step 5426 done (global step: 10816) | |
1681061809.010068: Worker 0: training step 5427 done (global step: 10818) | |
1681061809.015028: Worker 0: training step 5428 done (global step: 10820) | |
1681061809.021036: Worker 0: training step 5429 done (global step: 10822) | |
1681061809.026140: Worker 0: training step 5430 done (global step: 10824) | |
1681061809.032380: Worker 0: training step 5431 done (global step: 10826) | |
1681061809.037993: Worker 0: training step 5432 done (global step: 10828) | |
1681061809.042774: Worker 0: training step 5433 done (global step: 10829) | |
1681061809.049263: Worker 0: training step 5434 done (global step: 10831) | |
1681061809.054422: Worker 0: training step 5435 done (global step: 10834) | |
1681061809.059770: Worker 0: training step 5436 done (global step: 10835) | |
1681061809.065049: Worker 0: training step 5437 done (global step: 10837) | |
1681061809.069734: Worker 0: training step 5438 done (global step: 10839) | |
1681061809.075598: Worker 0: training step 5439 done (global step: 10841) | |
1681061809.080708: Worker 0: training step 5440 done (global step: 10843) | |
1681061809.087172: Worker 0: training step 5441 done (global step: 10845) | |
1681061809.092852: Worker 0: training step 5442 done (global step: 10847) | |
1681061809.098089: Worker 0: training step 5443 done (global step: 10849) | |
1681061809.103724: Worker 0: training step 5444 done (global step: 10851) | |
1681061809.109550: Worker 0: training step 5445 done (global step: 10853) | |
1681061809.125958: Worker 0: training step 5446 done (global step: 10855) | |
1681061809.136775: Worker 0: training step 5447 done (global step: 10857) | |
1681061809.145710: Worker 0: training step 5448 done (global step: 10859) | |
1681061809.154859: Worker 0: training step 5449 done (global step: 10861) | |
1681061809.166106: Worker 0: training step 5450 done (global step: 10863) | |
1681061809.173781: Worker 0: training step 5451 done (global step: 10865) | |
1681061809.181778: Worker 0: training step 5452 done (global step: 10867) | |
1681061809.190460: Worker 0: training step 5453 done (global step: 10869) | |
1681061809.200943: Worker 0: training step 5454 done (global step: 10871) | |
1681061809.208462: Worker 0: training step 5455 done (global step: 10873) | |
1681061809.218277: Worker 0: training step 5456 done (global step: 10875) | |
1681061809.225320: Worker 0: training step 5457 done (global step: 10877) | |
1681061809.232278: Worker 0: training step 5458 done (global step: 10879) | |
1681061809.239775: Worker 0: training step 5459 done (global step: 10881) | |
1681061809.250457: Worker 0: training step 5460 done (global step: 10883) | |
1681061809.259900: Worker 0: training step 5461 done (global step: 10885) | |
1681061809.266412: Worker 0: training step 5462 done (global step: 10887) | |
1681061809.271736: Worker 0: training step 5463 done (global step: 10888) | |
1681061809.278750: Worker 0: training step 5464 done (global step: 10891) | |
1681061809.283850: Worker 0: training step 5465 done (global step: 10892) | |
1681061809.289229: Worker 0: training step 5466 done (global step: 10895) | |
1681061809.295425: Worker 0: training step 5467 done (global step: 10896) | |
1681061809.301128: Worker 0: training step 5468 done (global step: 10898) | |
1681061809.310177: Worker 0: training step 5469 done (global step: 10901) | |
1681061809.315950: Worker 0: training step 5470 done (global step: 10903) | |
1681061809.322080: Worker 0: training step 5471 done (global step: 10905) | |
1681061809.327723: Worker 0: training step 5472 done (global step: 10907) | |
1681061809.333404: Worker 0: training step 5473 done (global step: 10909) | |
1681061809.340058: Worker 0: training step 5474 done (global step: 10912) | |
1681061809.344711: Worker 0: training step 5475 done (global step: 10913) | |
1681061809.350582: Worker 0: training step 5476 done (global step: 10915) | |
1681061809.358633: Worker 0: training step 5477 done (global step: 10917) | |
1681061809.367087: Worker 0: training step 5478 done (global step: 10919) | |
1681061809.375001: Worker 0: training step 5479 done (global step: 10921) | |
1681061809.381022: Worker 0: training step 5480 done (global step: 10924) | |
1681061809.386570: Worker 0: training step 5481 done (global step: 10926) | |
1681061809.393320: Worker 0: training step 5482 done (global step: 10928) | |
1681061809.398789: Worker 0: training step 5483 done (global step: 10930) | |
1681061809.404372: Worker 0: training step 5484 done (global step: 10932) | |
1681061809.409792: Worker 0: training step 5485 done (global step: 10934) | |
1681061809.415072: Worker 0: training step 5486 done (global step: 10936) | |
1681061809.420659: Worker 0: training step 5487 done (global step: 10938) | |
1681061809.427142: Worker 0: training step 5488 done (global step: 10940) | |
1681061809.432378: Worker 0: training step 5489 done (global step: 10942) | |
1681061809.439188: Worker 0: training step 5490 done (global step: 10944) | |
1681061809.445087: Worker 0: training step 5491 done (global step: 10946) | |
1681061809.450005: Worker 0: training step 5492 done (global step: 10948) | |
1681061809.454881: Worker 0: training step 5493 done (global step: 10950) | |
1681061809.460200: Worker 0: training step 5494 done (global step: 10951) | |
1681061809.465430: Worker 0: training step 5495 done (global step: 10953) | |
1681061809.470956: Worker 0: training step 5496 done (global step: 10955) | |
1681061809.476685: Worker 0: training step 5497 done (global step: 10957) | |
1681061809.482509: Worker 0: training step 5498 done (global step: 10959) | |
1681061809.487871: Worker 0: training step 5499 done (global step: 10961) | |
1681061809.493645: Worker 0: training step 5500 done (global step: 10963) | |
1681061809.662310: Worker 0: training step 5501 done (global step: 10995) | |
1681061809.666667: Worker 0: training step 5502 done (global step: 10996) | |
1681061809.671593: Worker 0: training step 5503 done (global step: 10997) | |
1681061809.677530: Worker 0: training step 5504 done (global step: 10998) | |
1681061809.681855: Worker 0: training step 5505 done (global step: 10999) | |
1681061809.687116: Worker 0: training step 5506 done (global step: 11000) | |
1681061809.694879: Worker 0: training step 5507 done (global step: 11001) | |
1681061809.700323: Worker 0: training step 5508 done (global step: 11002) | |
1681061809.705324: Worker 0: training step 5509 done (global step: 11003) | |
1681061809.710976: Worker 0: training step 5510 done (global step: 11004) | |
1681061809.715377: Worker 0: training step 5511 done (global step: 11005) | |
1681061809.721122: Worker 0: training step 5512 done (global step: 11006) | |
1681061809.725804: Worker 0: training step 5513 done (global step: 11007) | |
1681061809.730095: Worker 0: training step 5514 done (global step: 11008) | |
1681061809.734401: Worker 0: training step 5515 done (global step: 11009) | |
1681061809.738704: Worker 0: training step 5516 done (global step: 11010) | |
1681061809.743747: Worker 0: training step 5517 done (global step: 11011) | |
1681061809.749465: Worker 0: training step 5518 done (global step: 11012) | |
1681061809.757592: Worker 0: training step 5519 done (global step: 11013) | |
1681061809.763938: Worker 0: training step 5520 done (global step: 11014) | |
1681061809.768845: Worker 0: training step 5521 done (global step: 11015) | |
1681061809.773859: Worker 0: training step 5522 done (global step: 11016) | |
1681061809.778441: Worker 0: training step 5523 done (global step: 11017) | |
1681061809.782786: Worker 0: training step 5524 done (global step: 11018) | |
1681061809.786859: Worker 0: training step 5525 done (global step: 11019) | |
1681061809.791178: Worker 0: training step 5526 done (global step: 11020) | |
1681061809.795096: Worker 0: training step 5527 done (global step: 11021) | |
1681061809.799143: Worker 0: training step 5528 done (global step: 11022) | |
1681061809.804559: Worker 0: training step 5529 done (global step: 11023) | |
1681061809.810656: Worker 0: training step 5530 done (global step: 11025) | |
1681061809.816053: Worker 0: training step 5531 done (global step: 11027) | |
1681061809.822162: Worker 0: training step 5532 done (global step: 11029) | |
1681061809.832208: Worker 0: training step 5533 done (global step: 11031) | |
1681061809.837935: Worker 0: training step 5534 done (global step: 11033) | |
1681061809.843553: Worker 0: training step 5535 done (global step: 11035) | |
1681061809.848493: Worker 0: training step 5536 done (global step: 11037) | |
1681061809.853530: Worker 0: training step 5537 done (global step: 11039) | |
1681061809.859016: Worker 0: training step 5538 done (global step: 11041) | |
1681061809.864186: Worker 0: training step 5539 done (global step: 11043) | |
1681061809.869856: Worker 0: training step 5540 done (global step: 11045) | |
1681061809.875449: Worker 0: training step 5541 done (global step: 11047) | |
1681061809.881188: Worker 0: training step 5542 done (global step: 11049) | |
1681061809.888678: Worker 0: training step 5543 done (global step: 11051) | |
1681061809.895107: Worker 0: training step 5544 done (global step: 11053) | |
1681061809.901528: Worker 0: training step 5545 done (global step: 11055) | |
1681061809.906722: Worker 0: training step 5546 done (global step: 11058) | |
1681061809.912864: Worker 0: training step 5547 done (global step: 11060) | |
1681061809.918300: Worker 0: training step 5548 done (global step: 11061) | |
1681061809.924959: Worker 0: training step 5549 done (global step: 11064) | |
1681061809.929755: Worker 0: training step 5550 done (global step: 11066) | |
1681061809.935400: Worker 0: training step 5551 done (global step: 11067) | |
1681061809.941760: Worker 0: training step 5552 done (global step: 11070) | |
1681061809.946479: Worker 0: training step 5553 done (global step: 11072) | |
1681061809.951392: Worker 0: training step 5554 done (global step: 11074) | |
1681061809.957973: Worker 0: training step 5555 done (global step: 11075) | |
1681061809.964090: Worker 0: training step 5556 done (global step: 11077) | |
1681061809.970279: Worker 0: training step 5557 done (global step: 11080) | |
1681061809.975739: Worker 0: training step 5558 done (global step: 11082) | |
1681061809.980590: Worker 0: training step 5559 done (global step: 11084) | |
1681061809.986815: Worker 0: training step 5560 done (global step: 11085) | |
1681061809.992841: Worker 0: training step 5561 done (global step: 11087) | |
1681061809.998166: Worker 0: training step 5562 done (global step: 11090) | |
1681061810.003996: Worker 0: training step 5563 done (global step: 11091) | |
1681061810.010271: Worker 0: training step 5564 done (global step: 11093) | |
1681061810.016593: Worker 0: training step 5565 done (global step: 11096) | |
1681061810.022077: Worker 0: training step 5566 done (global step: 11098) | |
1681061810.028503: Worker 0: training step 5567 done (global step: 11100) | |
1681061810.033431: Worker 0: training step 5568 done (global step: 11102) | |
1681061810.038481: Worker 0: training step 5569 done (global step: 11104) | |
1681061810.043904: Worker 0: training step 5570 done (global step: 11106) | |
1681061810.049690: Worker 0: training step 5571 done (global step: 11108) | |
1681061810.054981: Worker 0: training step 5572 done (global step: 11110) | |
1681061810.062688: Worker 0: training step 5573 done (global step: 11112) | |
1681061810.073546: Worker 0: training step 5574 done (global step: 11114) | |
1681061810.082296: Worker 0: training step 5575 done (global step: 11116) | |
1681061810.087797: Worker 0: training step 5576 done (global step: 11118) | |
1681061810.095185: Worker 0: training step 5577 done (global step: 11120) | |
1681061810.099840: Worker 0: training step 5578 done (global step: 11123) | |
1681061810.106659: Worker 0: training step 5579 done (global step: 11124) | |
1681061810.112567: Worker 0: training step 5580 done (global step: 11127) | |
1681061810.118417: Worker 0: training step 5581 done (global step: 11129) | |
1681061810.123974: Worker 0: training step 5582 done (global step: 11131) | |
1681061810.130135: Worker 0: training step 5583 done (global step: 11133) | |
1681061810.136201: Worker 0: training step 5584 done (global step: 11135) | |
1681061810.141391: Worker 0: training step 5585 done (global step: 11137) | |
1681061810.148464: Worker 0: training step 5586 done (global step: 11139) | |
1681061810.153771: Worker 0: training step 5587 done (global step: 11141) | |
1681061810.159740: Worker 0: training step 5588 done (global step: 11143) | |
1681061810.166668: Worker 0: training step 5589 done (global step: 11145) | |
1681061810.175963: Worker 0: training step 5590 done (global step: 11147) | |
1681061810.181168: Worker 0: training step 5591 done (global step: 11149) | |
1681061810.187417: Worker 0: training step 5592 done (global step: 11151) | |
1681061810.192842: Worker 0: training step 5593 done (global step: 11153) | |
1681061810.198093: Worker 0: training step 5594 done (global step: 11155) | |
1681061810.203948: Worker 0: training step 5595 done (global step: 11157) | |
1681061810.209277: Worker 0: training step 5596 done (global step: 11159) | |
1681061810.215031: Worker 0: training step 5597 done (global step: 11162) | |
1681061810.221602: Worker 0: training step 5598 done (global step: 11164) | |
1681061810.227899: Worker 0: training step 5599 done (global step: 11166) | |
1681061810.233196: Worker 0: training step 5600 done (global step: 11168) | |
1681061810.238861: Worker 0: training step 5601 done (global step: 11170) | |
1681061810.245465: Worker 0: training step 5602 done (global step: 11172) | |
1681061810.254788: Worker 0: training step 5603 done (global step: 11174) | |
1681061810.261123: Worker 0: training step 5604 done (global step: 11176) | |
1681061810.266351: Worker 0: training step 5605 done (global step: 11178) | |
1681061810.271936: Worker 0: training step 5606 done (global step: 11180) | |
1681061810.277461: Worker 0: training step 5607 done (global step: 11182) | |
1681061810.283357: Worker 0: training step 5608 done (global step: 11184) | |
1681061810.289504: Worker 0: training step 5609 done (global step: 11186) | |
1681061810.295752: Worker 0: training step 5610 done (global step: 11187) | |
1681061810.300824: Worker 0: training step 5611 done (global step: 11189) | |
1681061810.311702: Worker 0: training step 5612 done (global step: 11191) | |
1681061810.319560: Worker 0: training step 5613 done (global step: 11194) | |
1681061810.326558: Worker 0: training step 5614 done (global step: 11196) | |
1681061810.333763: Worker 0: training step 5615 done (global step: 11198) | |
1681061810.339136: Worker 0: training step 5616 done (global step: 11200) | |
1681061810.344290: Worker 0: training step 5617 done (global step: 11202) | |
1681061810.349396: Worker 0: training step 5618 done (global step: 11204) | |
1681061810.354896: Worker 0: training step 5619 done (global step: 11206) | |
1681061810.360836: Worker 0: training step 5620 done (global step: 11208) | |
1681061810.366423: Worker 0: training step 5621 done (global step: 11210) | |
1681061810.371325: Worker 0: training step 5622 done (global step: 11212) | |
1681061810.376273: Worker 0: training step 5623 done (global step: 11213) | |
1681061810.381338: Worker 0: training step 5624 done (global step: 11215) | |
1681061810.386961: Worker 0: training step 5625 done (global step: 11217) | |
1681061810.393154: Worker 0: training step 5626 done (global step: 11219) | |
1681061810.397979: Worker 0: training step 5627 done (global step: 11221) | |
1681061810.403905: Worker 0: training step 5628 done (global step: 11223) | |
1681061810.409721: Worker 0: training step 5629 done (global step: 11225) | |
1681061810.417153: Worker 0: training step 5630 done (global step: 11227) | |
1681061810.423066: Worker 0: training step 5631 done (global step: 11229) | |
1681061810.428180: Worker 0: training step 5632 done (global step: 11231) | |
1681061810.432466: Worker 0: training step 5633 done (global step: 11233) | |
1681061810.438787: Worker 0: training step 5634 done (global step: 11235) | |
1681061810.444235: Worker 0: training step 5635 done (global step: 11237) | |
1681061810.449938: Worker 0: training step 5636 done (global step: 11239) | |
1681061810.456193: Worker 0: training step 5637 done (global step: 11241) | |
1681061810.463392: Worker 0: training step 5638 done (global step: 11243) | |
1681061810.469915: Worker 0: training step 5639 done (global step: 11245) | |
1681061810.475997: Worker 0: training step 5640 done (global step: 11247) | |
1681061810.481308: Worker 0: training step 5641 done (global step: 11248) | |
1681061810.486043: Worker 0: training step 5642 done (global step: 11250) | |
1681061810.492349: Worker 0: training step 5643 done (global step: 11252) | |
1681061810.497228: Worker 0: training step 5644 done (global step: 11254) | |
1681061810.502285: Worker 0: training step 5645 done (global step: 11256) | |
1681061810.507793: Worker 0: training step 5646 done (global step: 11258) | |
1681061810.513038: Worker 0: training step 5647 done (global step: 11260) | |
1681061810.518013: Worker 0: training step 5648 done (global step: 11262) | |
1681061810.523273: Worker 0: training step 5649 done (global step: 11263) | |
1681061810.528476: Worker 0: training step 5650 done (global step: 11265) | |
1681061810.534040: Worker 0: training step 5651 done (global step: 11267) | |
1681061810.540158: Worker 0: training step 5652 done (global step: 11269) | |
1681061810.547938: Worker 0: training step 5653 done (global step: 11271) | |
1681061810.552325: Worker 0: training step 5654 done (global step: 11273) | |
1681061810.557980: Worker 0: training step 5655 done (global step: 11275) | |
1681061810.563544: Worker 0: training step 5656 done (global step: 11277) | |
1681061810.568777: Worker 0: training step 5657 done (global step: 11279) | |
1681061810.573845: Worker 0: training step 5658 done (global step: 11281) | |
1681061810.578899: Worker 0: training step 5659 done (global step: 11283) | |
1681061810.584567: Worker 0: training step 5660 done (global step: 11285) | |
1681061810.589461: Worker 0: training step 5661 done (global step: 11287) | |
1681061810.595190: Worker 0: training step 5662 done (global step: 11289) | |
1681061810.600712: Worker 0: training step 5663 done (global step: 11291) | |
1681061810.605842: Worker 0: training step 5664 done (global step: 11293) | |
1681061810.611450: Worker 0: training step 5665 done (global step: 11295) | |
1681061810.616868: Worker 0: training step 5666 done (global step: 11297) | |
1681061810.622218: Worker 0: training step 5667 done (global step: 11299) | |
1681061810.627340: Worker 0: training step 5668 done (global step: 11301) | |
1681061810.632857: Worker 0: training step 5669 done (global step: 11303) | |
1681061810.638674: Worker 0: training step 5670 done (global step: 11305) | |
1681061810.643967: Worker 0: training step 5671 done (global step: 11307) | |
1681061810.649228: Worker 0: training step 5672 done (global step: 11309) | |
1681061810.654527: Worker 0: training step 5673 done (global step: 11311) | |
1681061810.659885: Worker 0: training step 5674 done (global step: 11313) | |
1681061810.664634: Worker 0: training step 5675 done (global step: 11315) | |
1681061810.669032: Worker 0: training step 5676 done (global step: 11317) | |
1681061810.675386: Worker 0: training step 5677 done (global step: 11318) | |
1681061810.683051: Worker 0: training step 5678 done (global step: 11321) | |
1681061810.688318: Worker 0: training step 5679 done (global step: 11323) | |
1681061810.693705: Worker 0: training step 5680 done (global step: 11325) | |
1681061810.699376: Worker 0: training step 5681 done (global step: 11327) | |
1681061810.705964: Worker 0: training step 5682 done (global step: 11329) | |
1681061810.711836: Worker 0: training step 5683 done (global step: 11331) | |
1681061810.719731: Worker 0: training step 5684 done (global step: 11333) | |
1681061810.725535: Worker 0: training step 5685 done (global step: 11336) | |
1681061810.731035: Worker 0: training step 5686 done (global step: 11338) | |
1681061810.736709: Worker 0: training step 5687 done (global step: 11340) | |
1681061810.742427: Worker 0: training step 5688 done (global step: 11342) | |
1681061810.747858: Worker 0: training step 5689 done (global step: 11344) | |
1681061810.753165: Worker 0: training step 5690 done (global step: 11346) | |
1681061810.757958: Worker 0: training step 5691 done (global step: 11348) | |
1681061810.763993: Worker 0: training step 5692 done (global step: 11350) | |
1681061810.771016: Worker 0: training step 5693 done (global step: 11352) | |
1681061810.776652: Worker 0: training step 5694 done (global step: 11354) | |
1681061810.782507: Worker 0: training step 5695 done (global step: 11356) | |
1681061810.787825: Worker 0: training step 5696 done (global step: 11358) | |
1681061810.793042: Worker 0: training step 5697 done (global step: 11360) | |
1681061810.798321: Worker 0: training step 5698 done (global step: 11362) | |
1681061810.805914: Worker 0: training step 5699 done (global step: 11364) | |
1681061810.811338: Worker 0: training step 5700 done (global step: 11365) | |
1681061810.816150: Worker 0: training step 5701 done (global step: 11367) | |
1681061810.820487: Worker 0: training step 5702 done (global step: 11369) | |
1681061810.825949: Worker 0: training step 5703 done (global step: 11371) | |
1681061810.831682: Worker 0: training step 5704 done (global step: 11373) | |
1681061810.837757: Worker 0: training step 5705 done (global step: 11375) | |
1681061810.842444: Worker 0: training step 5706 done (global step: 11377) | |
1681061810.848527: Worker 0: training step 5707 done (global step: 11379) | |
1681061810.853787: Worker 0: training step 5708 done (global step: 11381) | |
1681061810.859297: Worker 0: training step 5709 done (global step: 11383) | |
1681061810.864913: Worker 0: training step 5710 done (global step: 11385) | |
1681061810.870465: Worker 0: training step 5711 done (global step: 11387) | |
1681061810.876673: Worker 0: training step 5712 done (global step: 11389) | |
1681061810.882471: Worker 0: training step 5713 done (global step: 11391) | |
1681061810.888281: Worker 0: training step 5714 done (global step: 11393) | |
1681061810.893903: Worker 0: training step 5715 done (global step: 11395) | |
1681061810.899251: Worker 0: training step 5716 done (global step: 11397) | |
1681061810.904893: Worker 0: training step 5717 done (global step: 11399) | |
1681061810.910229: Worker 0: training step 5718 done (global step: 11401) | |
1681061810.915455: Worker 0: training step 5719 done (global step: 11403) | |
1681061810.920862: Worker 0: training step 5720 done (global step: 11405) | |
1681061810.926142: Worker 0: training step 5721 done (global step: 11407) | |
1681061810.931865: Worker 0: training step 5722 done (global step: 11409) | |
1681061810.937532: Worker 0: training step 5723 done (global step: 11411) | |
1681061810.942908: Worker 0: training step 5724 done (global step: 11413) | |
1681061810.948369: Worker 0: training step 5725 done (global step: 11415) | |
1681061810.954419: Worker 0: training step 5726 done (global step: 11417) | |
1681061810.959500: Worker 0: training step 5727 done (global step: 11419) | |
1681061810.965145: Worker 0: training step 5728 done (global step: 11421) | |
1681061810.970635: Worker 0: training step 5729 done (global step: 11423) | |
1681061810.975956: Worker 0: training step 5730 done (global step: 11425) | |
1681061810.981896: Worker 0: training step 5731 done (global step: 11427) | |
1681061810.986985: Worker 0: training step 5732 done (global step: 11429) | |
1681061810.992571: Worker 0: training step 5733 done (global step: 11431) | |
1681061810.998529: Worker 0: training step 5734 done (global step: 11433) | |
1681061811.003238: Worker 0: training step 5735 done (global step: 11435) | |
1681061811.008574: Worker 0: training step 5736 done (global step: 11437) | |
1681061811.013290: Worker 0: training step 5737 done (global step: 11439) | |
1681061811.018862: Worker 0: training step 5738 done (global step: 11440) | |
1681061811.024528: Worker 0: training step 5739 done (global step: 11443) | |
1681061811.029469: Worker 0: training step 5740 done (global step: 11444) | |
1681061811.035177: Worker 0: training step 5741 done (global step: 11446) | |
1681061811.041502: Worker 0: training step 5742 done (global step: 11449) | |
1681061811.047627: Worker 0: training step 5743 done (global step: 11451) | |
1681061811.054337: Worker 0: training step 5744 done (global step: 11453) | |
1681061811.059274: Worker 0: training step 5745 done (global step: 11455) | |
1681061811.071481: Worker 0: training step 5746 done (global step: 11456) | |
1681061811.080157: Worker 0: training step 5747 done (global step: 11459) | |
1681061811.088717: Worker 0: training step 5748 done (global step: 11460) | |
1681061811.096255: Worker 0: training step 5749 done (global step: 11462) | |
1681061811.102390: Worker 0: training step 5750 done (global step: 11464) | |
1681061811.108316: Worker 0: training step 5751 done (global step: 11466) | |
1681061811.113755: Worker 0: training step 5752 done (global step: 11468) | |
1681061811.119749: Worker 0: training step 5753 done (global step: 11470) | |
1681061811.124793: Worker 0: training step 5754 done (global step: 11472) | |
1681061811.130049: Worker 0: training step 5755 done (global step: 11474) | |
1681061811.135571: Worker 0: training step 5756 done (global step: 11475) | |
1681061811.141363: Worker 0: training step 5757 done (global step: 11477) | |
1681061811.147381: Worker 0: training step 5758 done (global step: 11479) | |
1681061811.152870: Worker 0: training step 5759 done (global step: 11482) | |
1681061811.159545: Worker 0: training step 5760 done (global step: 11483) | |
1681061811.165167: Worker 0: training step 5761 done (global step: 11486) | |
1681061811.170946: Worker 0: training step 5762 done (global step: 11488) | |
1681061811.176731: Worker 0: training step 5763 done (global step: 11490) | |
1681061811.182838: Worker 0: training step 5764 done (global step: 11492) | |
1681061811.189394: Worker 0: training step 5765 done (global step: 11494) | |
1681061811.195130: Worker 0: training step 5766 done (global step: 11496) | |
1681061811.200469: Worker 0: training step 5767 done (global step: 11498) | |
1681061811.205409: Worker 0: training step 5768 done (global step: 11500) | |
1681061811.210873: Worker 0: training step 5769 done (global step: 11501) | |
1681061811.216339: Worker 0: training step 5770 done (global step: 11503) | |
1681061811.222227: Worker 0: training step 5771 done (global step: 11505) | |
1681061811.227742: Worker 0: training step 5772 done (global step: 11507) | |
1681061811.233764: Worker 0: training step 5773 done (global step: 11509) | |
1681061811.238988: Worker 0: training step 5774 done (global step: 11511) | |
1681061811.244115: Worker 0: training step 5775 done (global step: 11513) | |
1681061811.250744: Worker 0: training step 5776 done (global step: 11515) | |
1681061811.257828: Worker 0: training step 5777 done (global step: 11517) | |
1681061811.263425: Worker 0: training step 5778 done (global step: 11519) | |
1681061811.269538: Worker 0: training step 5779 done (global step: 11521) | |
1681061811.275837: Worker 0: training step 5780 done (global step: 11523) | |
1681061811.280866: Worker 0: training step 5781 done (global step: 11525) | |
1681061811.287118: Worker 0: training step 5782 done (global step: 11527) | |
1681061811.293535: Worker 0: training step 5783 done (global step: 11529) | |
1681061811.300263: Worker 0: training step 5784 done (global step: 11531) | |
1681061811.307186: Worker 0: training step 5785 done (global step: 11533) | |
1681061811.314469: Worker 0: training step 5786 done (global step: 11535) | |
1681061811.320459: Worker 0: training step 5787 done (global step: 11538) | |
1681061811.327314: Worker 0: training step 5788 done (global step: 11540) | |
1681061811.333937: Worker 0: training step 5789 done (global step: 11542) | |
1681061811.340677: Worker 0: training step 5790 done (global step: 11544) | |
1681061811.346689: Worker 0: training step 5791 done (global step: 11546) | |
1681061811.352968: Worker 0: training step 5792 done (global step: 11548) | |
1681061811.358684: Worker 0: training step 5793 done (global step: 11550) | |
1681061811.364268: Worker 0: training step 5794 done (global step: 11552) | |
1681061811.369855: Worker 0: training step 5795 done (global step: 11554) | |
1681061811.375721: Worker 0: training step 5796 done (global step: 11556) | |
1681061811.381492: Worker 0: training step 5797 done (global step: 11558) | |
1681061811.389503: Worker 0: training step 5798 done (global step: 11560) | |
1681061811.395101: Worker 0: training step 5799 done (global step: 11562) | |
1681061811.401437: Worker 0: training step 5800 done (global step: 11564) | |
1681061811.406644: Worker 0: training step 5801 done (global step: 11566) | |
1681061811.412356: Worker 0: training step 5802 done (global step: 11568) | |
1681061811.418320: Worker 0: training step 5803 done (global step: 11570) | |
1681061811.424085: Worker 0: training step 5804 done (global step: 11572) | |
1681061811.429768: Worker 0: training step 5805 done (global step: 11574) | |
1681061811.435595: Worker 0: training step 5806 done (global step: 11576) | |
1681061811.440834: Worker 0: training step 5807 done (global step: 11578) | |
1681061811.446171: Worker 0: training step 5808 done (global step: 11580) | |
1681061811.452184: Worker 0: training step 5809 done (global step: 11582) | |
1681061811.458601: Worker 0: training step 5810 done (global step: 11584) | |
1681061811.465217: Worker 0: training step 5811 done (global step: 11586) | |
1681061811.469903: Worker 0: training step 5812 done (global step: 11588) | |
1681061811.475373: Worker 0: training step 5813 done (global step: 11590) | |
1681061811.481014: Worker 0: training step 5814 done (global step: 11592) | |
1681061811.487464: Worker 0: training step 5815 done (global step: 11594) | |
1681061811.493303: Worker 0: training step 5816 done (global step: 11596) | |
1681061811.498536: Worker 0: training step 5817 done (global step: 11598) | |
1681061811.504080: Worker 0: training step 5818 done (global step: 11600) | |
1681061811.509556: Worker 0: training step 5819 done (global step: 11602) | |
1681061811.515221: Worker 0: training step 5820 done (global step: 11604) | |
1681061811.521886: Worker 0: training step 5821 done (global step: 11606) | |
1681061811.526786: Worker 0: training step 5822 done (global step: 11608) | |
1681061811.532886: Worker 0: training step 5823 done (global step: 11610) | |
1681061811.538306: Worker 0: training step 5824 done (global step: 11612) | |
1681061811.543899: Worker 0: training step 5825 done (global step: 11614) | |
1681061811.550828: Worker 0: training step 5826 done (global step: 11616) | |
1681061811.556696: Worker 0: training step 5827 done (global step: 11618) | |
1681061811.561506: Worker 0: training step 5828 done (global step: 11620) | |
1681061811.567233: Worker 0: training step 5829 done (global step: 11622) | |
1681061811.572171: Worker 0: training step 5830 done (global step: 11624) | |
1681061811.578355: Worker 0: training step 5831 done (global step: 11626) | |
1681061811.583362: Worker 0: training step 5832 done (global step: 11628) | |
1681061811.590151: Worker 0: training step 5833 done (global step: 11629) | |
1681061811.595665: Worker 0: training step 5834 done (global step: 11631) | |
1681061811.601848: Worker 0: training step 5835 done (global step: 11633) | |
1681061811.607080: Worker 0: training step 5836 done (global step: 11635) | |
1681061811.611756: Worker 0: training step 5837 done (global step: 11637) | |
1681061811.617253: Worker 0: training step 5838 done (global step: 11639) | |
1681061811.623251: Worker 0: training step 5839 done (global step: 11641) | |
1681061811.628862: Worker 0: training step 5840 done (global step: 11643) | |
1681061811.634272: Worker 0: training step 5841 done (global step: 11645) | |
1681061811.639676: Worker 0: training step 5842 done (global step: 11647) | |
1681061811.646641: Worker 0: training step 5843 done (global step: 11649) | |
1681061811.651444: Worker 0: training step 5844 done (global step: 11651) | |
1681061811.658385: Worker 0: training step 5845 done (global step: 11653) | |
1681061811.663877: Worker 0: training step 5846 done (global step: 11655) | |
1681061811.669361: Worker 0: training step 5847 done (global step: 11657) | |
1681061811.675201: Worker 0: training step 5848 done (global step: 11659) | |
1681061811.680644: Worker 0: training step 5849 done (global step: 11661) | |
1681061811.685973: Worker 0: training step 5850 done (global step: 11663) | |
1681061811.692400: Worker 0: training step 5851 done (global step: 11665) | |
1681061811.699042: Worker 0: training step 5852 done (global step: 11667) | |
1681061811.705444: Worker 0: training step 5853 done (global step: 11669) | |
1681061811.710689: Worker 0: training step 5854 done (global step: 11671) | |
1681061811.717336: Worker 0: training step 5855 done (global step: 11673) | |
1681061811.725677: Worker 0: training step 5856 done (global step: 11675) | |
1681061811.734210: Worker 0: training step 5857 done (global step: 11677) | |
1681061811.742668: Worker 0: training step 5858 done (global step: 11679) | |
1681061811.751396: Worker 0: training step 5859 done (global step: 11681) | |
1681061811.758511: Worker 0: training step 5860 done (global step: 11683) | |
1681061811.766978: Worker 0: training step 5861 done (global step: 11685) | |
1681061811.776115: Worker 0: training step 5862 done (global step: 11687) | |
1681061811.784124: Worker 0: training step 5863 done (global step: 11689) | |
1681061811.792343: Worker 0: training step 5864 done (global step: 11691) | |
1681061811.799171: Worker 0: training step 5865 done (global step: 11693) | |
1681061811.806925: Worker 0: training step 5866 done (global step: 11695) | |
1681061811.815306: Worker 0: training step 5867 done (global step: 11697) | |
1681061811.821955: Worker 0: training step 5868 done (global step: 11699) | |
1681061811.829480: Worker 0: training step 5869 done (global step: 11701) | |
1681061811.837632: Worker 0: training step 5870 done (global step: 11703) | |
1681061811.846239: Worker 0: training step 5871 done (global step: 11704) | |
1681061811.852866: Worker 0: training step 5872 done (global step: 11707) | |
1681061811.859561: Worker 0: training step 5873 done (global step: 11709) | |
1681061811.867415: Worker 0: training step 5874 done (global step: 11711) | |
1681061811.874785: Worker 0: training step 5875 done (global step: 11713) | |
1681061811.883526: Worker 0: training step 5876 done (global step: 11715) | |
1681061811.890563: Worker 0: training step 5877 done (global step: 11717) | |
1681061811.896811: Worker 0: training step 5878 done (global step: 11719) | |
1681061811.902866: Worker 0: training step 5879 done (global step: 11721) | |
1681061811.908133: Worker 0: training step 5880 done (global step: 11723) | |
1681061811.914254: Worker 0: training step 5881 done (global step: 11725) | |
1681061811.919555: Worker 0: training step 5882 done (global step: 11727) | |
1681061811.924937: Worker 0: training step 5883 done (global step: 11729) | |
1681061811.930315: Worker 0: training step 5884 done (global step: 11731) | |
1681061811.936200: Worker 0: training step 5885 done (global step: 11733) | |
1681061811.942267: Worker 0: training step 5886 done (global step: 11735) | |
1681061811.947829: Worker 0: training step 5887 done (global step: 11737) | |
1681061811.953271: Worker 0: training step 5888 done (global step: 11739) | |
1681061811.959007: Worker 0: training step 5889 done (global step: 11741) | |
1681061811.964507: Worker 0: training step 5890 done (global step: 11743) | |
1681061811.969749: Worker 0: training step 5891 done (global step: 11745) | |
1681061811.975198: Worker 0: training step 5892 done (global step: 11747) | |
1681061811.980623: Worker 0: training step 5893 done (global step: 11749) | |
1681061811.985979: Worker 0: training step 5894 done (global step: 11751) | |
1681061811.991893: Worker 0: training step 5895 done (global step: 11753) | |
1681061811.997710: Worker 0: training step 5896 done (global step: 11755) | |
1681061812.003427: Worker 0: training step 5897 done (global step: 11757) | |
1681061812.009233: Worker 0: training step 5898 done (global step: 11759) | |
1681061812.015038: Worker 0: training step 5899 done (global step: 11761) | |
1681061812.019968: Worker 0: training step 5900 done (global step: 11763) | |
1681061812.026058: Worker 0: training step 5901 done (global step: 11765) | |
1681061812.030523: Worker 0: training step 5902 done (global step: 11767) | |
1681061812.036782: Worker 0: training step 5903 done (global step: 11768) | |
1681061812.043349: Worker 0: training step 5904 done (global step: 11770) | |
1681061812.048631: Worker 0: training step 5905 done (global step: 11772) | |
1681061812.053971: Worker 0: training step 5906 done (global step: 11774) | |
1681061812.059355: Worker 0: training step 5907 done (global step: 11776) | |
1681061812.065927: Worker 0: training step 5908 done (global step: 11778) | |
1681061812.071410: Worker 0: training step 5909 done (global step: 11780) | |
1681061812.077450: Worker 0: training step 5910 done (global step: 11782) | |
1681061812.087587: Worker 0: training step 5911 done (global step: 11784) | |
1681061812.097196: Worker 0: training step 5912 done (global step: 11786) | |
1681061812.104558: Worker 0: training step 5913 done (global step: 11789) | |
1681061812.112346: Worker 0: training step 5914 done (global step: 11790) | |
1681061812.120907: Worker 0: training step 5915 done (global step: 11792) | |
1681061812.129737: Worker 0: training step 5916 done (global step: 11794) | |
1681061812.142577: Worker 0: training step 5917 done (global step: 11796) | |
1681061812.152599: Worker 0: training step 5918 done (global step: 11799) | |
1681061812.161752: Worker 0: training step 5919 done (global step: 11801) | |
1681061812.169277: Worker 0: training step 5920 done (global step: 11803) | |
1681061812.177361: Worker 0: training step 5921 done (global step: 11805) | |
1681061812.189996: Worker 0: training step 5922 done (global step: 11807) | |
1681061812.200461: Worker 0: training step 5923 done (global step: 11809) | |
1681061812.209049: Worker 0: training step 5924 done (global step: 11811) | |
1681061812.220549: Worker 0: training step 5925 done (global step: 11813) | |
1681061812.227040: Worker 0: training step 5926 done (global step: 11815) | |
1681061812.234907: Worker 0: training step 5927 done (global step: 11817) | |
1681061812.243224: Worker 0: training step 5928 done (global step: 11819) | |
1681061812.252784: Worker 0: training step 5929 done (global step: 11821) | |
1681061812.260272: Worker 0: training step 5930 done (global step: 11823) | |
1681061812.267975: Worker 0: training step 5931 done (global step: 11825) | |
1681061812.275188: Worker 0: training step 5932 done (global step: 11827) | |
1681061812.284236: Worker 0: training step 5933 done (global step: 11829) | |
1681061812.291868: Worker 0: training step 5934 done (global step: 11831) | |
1681061812.298454: Worker 0: training step 5935 done (global step: 11833) | |
1681061812.309658: Worker 0: training step 5936 done (global step: 11835) | |
1681061812.318840: Worker 0: training step 5937 done (global step: 11837) | |
1681061812.328814: Worker 0: training step 5938 done (global step: 11839) | |
1681061812.336227: Worker 0: training step 5939 done (global step: 11841) | |
1681061812.343678: Worker 0: training step 5940 done (global step: 11843) | |
1681061812.351776: Worker 0: training step 5941 done (global step: 11845) | |
1681061812.360027: Worker 0: training step 5942 done (global step: 11847) | |
1681061812.368159: Worker 0: training step 5943 done (global step: 11849) | |
1681061812.373797: Worker 0: training step 5944 done (global step: 11851) | |
1681061812.380828: Worker 0: training step 5945 done (global step: 11852) | |
1681061812.389911: Worker 0: training step 5946 done (global step: 11854) | |
1681061812.398083: Worker 0: training step 5947 done (global step: 11856) | |
1681061812.406603: Worker 0: training step 5948 done (global step: 11858) | |
1681061812.416152: Worker 0: training step 5949 done (global step: 11860) | |
1681061812.425289: Worker 0: training step 5950 done (global step: 11862) | |
1681061812.433012: Worker 0: training step 5951 done (global step: 11864) | |
1681061812.439945: Worker 0: training step 5952 done (global step: 11866) | |
1681061812.447564: Worker 0: training step 5953 done (global step: 11868) | |
1681061812.455255: Worker 0: training step 5954 done (global step: 11870) | |
1681061812.468547: Worker 0: training step 5955 done (global step: 11873) | |
1681061812.475357: Worker 0: training step 5956 done (global step: 11875) | |
1681061812.481074: Worker 0: training step 5957 done (global step: 11877) | |
1681061812.485979: Worker 0: training step 5958 done (global step: 11878) | |
1681061812.491122: Worker 0: training step 5959 done (global step: 11880) | |
1681061812.496499: Worker 0: training step 5960 done (global step: 11882) | |
1681061812.502237: Worker 0: training step 5961 done (global step: 11884) | |
1681061812.507466: Worker 0: training step 5962 done (global step: 11886) | |
1681061812.512987: Worker 0: training step 5963 done (global step: 11888) | |
1681061812.518230: Worker 0: training step 5964 done (global step: 11890) | |
1681061812.523196: Worker 0: training step 5965 done (global step: 11892) | |
1681061812.528516: Worker 0: training step 5966 done (global step: 11894) | |
1681061812.533708: Worker 0: training step 5967 done (global step: 11896) | |
1681061812.539100: Worker 0: training step 5968 done (global step: 11898) | |
1681061812.544225: Worker 0: training step 5969 done (global step: 11900) | |
1681061812.549411: Worker 0: training step 5970 done (global step: 11902) | |
1681061812.555135: Worker 0: training step 5971 done (global step: 11904) | |
1681061812.560511: Worker 0: training step 5972 done (global step: 11906) | |
1681061812.565673: Worker 0: training step 5973 done (global step: 11908) | |
1681061812.570899: Worker 0: training step 5974 done (global step: 11910) | |
1681061812.576725: Worker 0: training step 5975 done (global step: 11912) | |
1681061812.582309: Worker 0: training step 5976 done (global step: 11914) | |
1681061812.587663: Worker 0: training step 5977 done (global step: 11916) | |
1681061812.592513: Worker 0: training step 5978 done (global step: 11918) | |
1681061812.597885: Worker 0: training step 5979 done (global step: 11920) | |
1681061812.603902: Worker 0: training step 5980 done (global step: 11922) | |
1681061812.610953: Worker 0: training step 5981 done (global step: 11924) | |
1681061812.615480: Worker 0: training step 5982 done (global step: 11926) | |
1681061812.620684: Worker 0: training step 5983 done (global step: 11928) | |
1681061812.625967: Worker 0: training step 5984 done (global step: 11930) | |
1681061812.631513: Worker 0: training step 5985 done (global step: 11932) | |
1681061812.636513: Worker 0: training step 5986 done (global step: 11934) | |
1681061812.641990: Worker 0: training step 5987 done (global step: 11936) | |
1681061812.647343: Worker 0: training step 5988 done (global step: 11938) | |
1681061812.653327: Worker 0: training step 5989 done (global step: 11940) | |
1681061812.658969: Worker 0: training step 5990 done (global step: 11942) | |
1681061812.664988: Worker 0: training step 5991 done (global step: 11944) | |
1681061812.670348: Worker 0: training step 5992 done (global step: 11946) | |
1681061812.675555: Worker 0: training step 5993 done (global step: 11948) | |
1681061812.680824: Worker 0: training step 5994 done (global step: 11950) | |
1681061812.686014: Worker 0: training step 5995 done (global step: 11952) | |
1681061812.690939: Worker 0: training step 5996 done (global step: 11954) | |
1681061812.696532: Worker 0: training step 5997 done (global step: 11956) | |
1681061812.706420: Worker 0: training step 5998 done (global step: 11958) | |
1681061812.712434: Worker 0: training step 5999 done (global step: 11960) | |
1681061812.718351: Worker 0: training step 6000 done (global step: 11962) | |
1681061812.724703: Worker 0: training step 6001 done (global step: 11964) | |
1681061812.731826: Worker 0: training step 6002 done (global step: 11966) | |
1681061812.738691: Worker 0: training step 6003 done (global step: 11969) | |
1681061812.743755: Worker 0: training step 6004 done (global step: 11971) | |
1681061812.748846: Worker 0: training step 6005 done (global step: 11973) | |
1681061812.754174: Worker 0: training step 6006 done (global step: 11975) | |
1681061812.760375: Worker 0: training step 6007 done (global step: 11977) | |
1681061812.765877: Worker 0: training step 6008 done (global step: 11979) | |
1681061812.770942: Worker 0: training step 6009 done (global step: 11981) | |
1681061812.777851: Worker 0: training step 6010 done (global step: 11983) | |
1681061812.784098: Worker 0: training step 6011 done (global step: 11985) | |
1681061812.789254: Worker 0: training step 6012 done (global step: 11987) | |
1681061812.795135: Worker 0: training step 6013 done (global step: 11989) | |
1681061812.800955: Worker 0: training step 6014 done (global step: 11991) | |
1681061812.807167: Worker 0: training step 6015 done (global step: 11993) | |
1681061812.812632: Worker 0: training step 6016 done (global step: 11995) | |
1681061812.818669: Worker 0: training step 6017 done (global step: 11997) | |
1681061812.824042: Worker 0: training step 6018 done (global step: 11999) | |
1681061812.829905: Worker 0: training step 6019 done (global step: 12001) | |
1681061812.835294: Worker 0: training step 6020 done (global step: 12003) | |
1681061812.840700: Worker 0: training step 6021 done (global step: 12005) | |
1681061812.846721: Worker 0: training step 6022 done (global step: 12007) | |
1681061812.852784: Worker 0: training step 6023 done (global step: 12009) | |
1681061812.859197: Worker 0: training step 6024 done (global step: 12011) | |
1681061812.864654: Worker 0: training step 6025 done (global step: 12013) | |
1681061812.869854: Worker 0: training step 6026 done (global step: 12015) | |
1681061812.874953: Worker 0: training step 6027 done (global step: 12017) | |
1681061812.880656: Worker 0: training step 6028 done (global step: 12019) | |
1681061812.886452: Worker 0: training step 6029 done (global step: 12021) | |
1681061812.892395: Worker 0: training step 6030 done (global step: 12023) | |
1681061812.898260: Worker 0: training step 6031 done (global step: 12025) | |
1681061812.903463: Worker 0: training step 6032 done (global step: 12027) | |
1681061812.909250: Worker 0: training step 6033 done (global step: 12029) | |
1681061812.915584: Worker 0: training step 6034 done (global step: 12031) | |
1681061812.920780: Worker 0: training step 6035 done (global step: 12033) | |
1681061812.925855: Worker 0: training step 6036 done (global step: 12035) | |
1681061812.930932: Worker 0: training step 6037 done (global step: 12036) | |
1681061812.936391: Worker 0: training step 6038 done (global step: 12038) | |
1681061812.941945: Worker 0: training step 6039 done (global step: 12040) | |
1681061812.946602: Worker 0: training step 6040 done (global step: 12043) | |
1681061812.952601: Worker 0: training step 6041 done (global step: 12044) | |
1681061812.959140: Worker 0: training step 6042 done (global step: 12046) | |
1681061812.965319: Worker 0: training step 6043 done (global step: 12049) | |
1681061812.971858: Worker 0: training step 6044 done (global step: 12051) | |
1681061812.977765: Worker 0: training step 6045 done (global step: 12053) | |
1681061812.982944: Worker 0: training step 6046 done (global step: 12055) | |
1681061812.988570: Worker 0: training step 6047 done (global step: 12057) | |
1681061812.994212: Worker 0: training step 6048 done (global step: 12059) | |
1681061813.000347: Worker 0: training step 6049 done (global step: 12061) | |
1681061813.005552: Worker 0: training step 6050 done (global step: 12063) | |
1681061813.168905: Worker 0: training step 6051 done (global step: 12095) | |
1681061813.173197: Worker 0: training step 6052 done (global step: 12096) | |
1681061813.177399: Worker 0: training step 6053 done (global step: 12097) | |
1681061813.181733: Worker 0: training step 6054 done (global step: 12098) | |
1681061813.185833: Worker 0: training step 6055 done (global step: 12099) | |
1681061813.190305: Worker 0: training step 6056 done (global step: 12100) | |
1681061813.194995: Worker 0: training step 6057 done (global step: 12101) | |
1681061813.199991: Worker 0: training step 6058 done (global step: 12102) | |
1681061813.204590: Worker 0: training step 6059 done (global step: 12103) | |
1681061813.208923: Worker 0: training step 6060 done (global step: 12104) | |
1681061813.213594: Worker 0: training step 6061 done (global step: 12105) | |
1681061813.218431: Worker 0: training step 6062 done (global step: 12106) | |
1681061813.223248: Worker 0: training step 6063 done (global step: 12107) | |
1681061813.228491: Worker 0: training step 6064 done (global step: 12108) | |
1681061813.233652: Worker 0: training step 6065 done (global step: 12109) | |
1681061813.238702: Worker 0: training step 6066 done (global step: 12110) | |
1681061813.243777: Worker 0: training step 6067 done (global step: 12111) | |
1681061813.248958: Worker 0: training step 6068 done (global step: 12112) | |
1681061813.253635: Worker 0: training step 6069 done (global step: 12113) | |
1681061813.259457: Worker 0: training step 6070 done (global step: 12114) | |
1681061813.264840: Worker 0: training step 6071 done (global step: 12115) | |
1681061813.269783: Worker 0: training step 6072 done (global step: 12116) | |
1681061813.274968: Worker 0: training step 6073 done (global step: 12117) | |
1681061813.280153: Worker 0: training step 6074 done (global step: 12118) | |
1681061813.284868: Worker 0: training step 6075 done (global step: 12119) | |
1681061813.288967: Worker 0: training step 6076 done (global step: 12120) | |
1681061813.293217: Worker 0: training step 6077 done (global step: 12121) | |
1681061813.297243: Worker 0: training step 6078 done (global step: 12122) | |
1681061813.301467: Worker 0: training step 6079 done (global step: 12123) | |
1681061813.307654: Worker 0: training step 6080 done (global step: 12124) | |
1681061813.313998: Worker 0: training step 6081 done (global step: 12125) | |
1681061813.320369: Worker 0: training step 6082 done (global step: 12127) | |
1681061813.326754: Worker 0: training step 6083 done (global step: 12129) | |
1681061813.333676: Worker 0: training step 6084 done (global step: 12131) | |
1681061813.338500: Worker 0: training step 6085 done (global step: 12133) | |
1681061813.345117: Worker 0: training step 6086 done (global step: 12135) | |
1681061813.350325: Worker 0: training step 6087 done (global step: 12138) | |
1681061813.354581: Worker 0: training step 6088 done (global step: 12139) | |
1681061813.360126: Worker 0: training step 6089 done (global step: 12141) | |
1681061813.365776: Worker 0: training step 6090 done (global step: 12143) | |
1681061813.370996: Worker 0: training step 6091 done (global step: 12145) | |
1681061813.376061: Worker 0: training step 6092 done (global step: 12147) | |
1681061813.382212: Worker 0: training step 6093 done (global step: 12149) | |
1681061813.387056: Worker 0: training step 6094 done (global step: 12151) | |
1681061813.393422: Worker 0: training step 6095 done (global step: 12153) | |
1681061813.399134: Worker 0: training step 6096 done (global step: 12155) | |
1681061813.403773: Worker 0: training step 6097 done (global step: 12157) | |
1681061813.409592: Worker 0: training step 6098 done (global step: 12159) | |
1681061813.415278: Worker 0: training step 6099 done (global step: 12161) | |
1681061813.420475: Worker 0: training step 6100 done (global step: 12163) | |
1681061813.425846: Worker 0: training step 6101 done (global step: 12165) | |
1681061813.430857: Worker 0: training step 6102 done (global step: 12167) | |
1681061813.435796: Worker 0: training step 6103 done (global step: 12169) | |
1681061813.440327: Worker 0: training step 6104 done (global step: 12170) | |
1681061813.446577: Worker 0: training step 6105 done (global step: 12172) | |
1681061813.451820: Worker 0: training step 6106 done (global step: 12174) | |
1681061813.458157: Worker 0: training step 6107 done (global step: 12176) | |
1681061813.463985: Worker 0: training step 6108 done (global step: 12178) | |
1681061813.470087: Worker 0: training step 6109 done (global step: 12180) | |
1681061813.475825: Worker 0: training step 6110 done (global step: 12182) | |
1681061813.480851: Worker 0: training step 6111 done (global step: 12184) | |
1681061813.486543: Worker 0: training step 6112 done (global step: 12186) | |
1681061813.491395: Worker 0: training step 6113 done (global step: 12188) | |
1681061813.497471: Worker 0: training step 6114 done (global step: 12190) | |
1681061813.502894: Worker 0: training step 6115 done (global step: 12192) | |
1681061813.508288: Worker 0: training step 6116 done (global step: 12194) | |
1681061813.514821: Worker 0: training step 6117 done (global step: 12196) | |
1681061813.520394: Worker 0: training step 6118 done (global step: 12198) | |
1681061813.525678: Worker 0: training step 6119 done (global step: 12200) | |
1681061813.531315: Worker 0: training step 6120 done (global step: 12202) | |
1681061813.536921: Worker 0: training step 6121 done (global step: 12204) | |
1681061813.542230: Worker 0: training step 6122 done (global step: 12206) | |
1681061813.547337: Worker 0: training step 6123 done (global step: 12208) | |
1681061813.553171: Worker 0: training step 6124 done (global step: 12209) | |
1681061813.558810: Worker 0: training step 6125 done (global step: 12212) | |
1681061813.564377: Worker 0: training step 6126 done (global step: 12214) | |
1681061813.570083: Worker 0: training step 6127 done (global step: 12216) | |
1681061813.574885: Worker 0: training step 6128 done (global step: 12218) | |
1681061813.581035: Worker 0: training step 6129 done (global step: 12220) | |
1681061813.586277: Worker 0: training step 6130 done (global step: 12222) | |
1681061813.591637: Worker 0: training step 6131 done (global step: 12224) | |
1681061813.597147: Worker 0: training step 6132 done (global step: 12226) | |
1681061813.601917: Worker 0: training step 6133 done (global step: 12228) | |
1681061813.607593: Worker 0: training step 6134 done (global step: 12230) | |
1681061813.612813: Worker 0: training step 6135 done (global step: 12232) | |
1681061813.618826: Worker 0: training step 6136 done (global step: 12234) | |
1681061813.624912: Worker 0: training step 6137 done (global step: 12236) | |
1681061813.630405: Worker 0: training step 6138 done (global step: 12238) | |
1681061813.635309: Worker 0: training step 6139 done (global step: 12240) | |
1681061813.643768: Worker 0: training step 6140 done (global step: 12242) | |
1681061813.649041: Worker 0: training step 6141 done (global step: 12244) | |
1681061813.654108: Worker 0: training step 6142 done (global step: 12246) | |
1681061813.659239: Worker 0: training step 6143 done (global step: 12248) | |
1681061813.664802: Worker 0: training step 6144 done (global step: 12250) | |
1681061813.670760: Worker 0: training step 6145 done (global step: 12252) | |
1681061813.676487: Worker 0: training step 6146 done (global step: 12254) | |
1681061813.681944: Worker 0: training step 6147 done (global step: 12256) | |
1681061813.686675: Worker 0: training step 6148 done (global step: 12258) | |
1681061813.692786: Worker 0: training step 6149 done (global step: 12260) | |
1681061813.697989: Worker 0: training step 6150 done (global step: 12262) | |
1681061813.703497: Worker 0: training step 6151 done (global step: 12264) | |
1681061813.710405: Worker 0: training step 6152 done (global step: 12266) | |
1681061813.715418: Worker 0: training step 6153 done (global step: 12268) | |
1681061813.721781: Worker 0: training step 6154 done (global step: 12270) | |
1681061813.727405: Worker 0: training step 6155 done (global step: 12272) | |
1681061813.733350: Worker 0: training step 6156 done (global step: 12274) | |
1681061813.739013: Worker 0: training step 6157 done (global step: 12276) | |
1681061813.744457: Worker 0: training step 6158 done (global step: 12278) | |
1681061813.750283: Worker 0: training step 6159 done (global step: 12280) | |
1681061813.756084: Worker 0: training step 6160 done (global step: 12282) | |
1681061813.761174: Worker 0: training step 6161 done (global step: 12284) | |
1681061813.767417: Worker 0: training step 6162 done (global step: 12286) | |
1681061813.772508: Worker 0: training step 6163 done (global step: 12288) | |
1681061813.778474: Worker 0: training step 6164 done (global step: 12290) | |
1681061813.783795: Worker 0: training step 6165 done (global step: 12292) | |
1681061813.789289: Worker 0: training step 6166 done (global step: 12294) | |
1681061813.794786: Worker 0: training step 6167 done (global step: 12296) | |
1681061813.800384: Worker 0: training step 6168 done (global step: 12298) | |
1681061813.805833: Worker 0: training step 6169 done (global step: 12300) | |
1681061813.811936: Worker 0: training step 6170 done (global step: 12302) | |
1681061813.816878: Worker 0: training step 6171 done (global step: 12304) | |
1681061813.822927: Worker 0: training step 6172 done (global step: 12306) | |
1681061813.829332: Worker 0: training step 6173 done (global step: 12308) | |
1681061813.835138: Worker 0: training step 6174 done (global step: 12310) | |
1681061813.841938: Worker 0: training step 6175 done (global step: 12313) | |
1681061813.847247: Worker 0: training step 6176 done (global step: 12315) | |
1681061813.851811: Worker 0: training step 6177 done (global step: 12317) | |
1681061813.856517: Worker 0: training step 6178 done (global step: 12318) | |
1681061813.861821: Worker 0: training step 6179 done (global step: 12320) | |
1681061813.867162: Worker 0: training step 6180 done (global step: 12322) | |
1681061813.876488: Worker 0: training step 6181 done (global step: 12324) | |
1681061813.888219: Worker 0: training step 6182 done (global step: 12326) | |
1681061813.900325: Worker 0: training step 6183 done (global step: 12328) | |
1681061813.906183: Worker 0: training step 6184 done (global step: 12331) | |
1681061813.911668: Worker 0: training step 6185 done (global step: 12332) | |
1681061813.919204: Worker 0: training step 6186 done (global step: 12334) | |
1681061813.925761: Worker 0: training step 6187 done (global step: 12337) | |
1681061813.931686: Worker 0: training step 6188 done (global step: 12339) | |
1681061813.937389: Worker 0: training step 6189 done (global step: 12341) | |
1681061813.943553: Worker 0: training step 6190 done (global step: 12343) | |
1681061813.948951: Worker 0: training step 6191 done (global step: 12345) | |
1681061813.954999: Worker 0: training step 6192 done (global step: 12347) | |
1681061813.961442: Worker 0: training step 6193 done (global step: 12349) | |
1681061813.966707: Worker 0: training step 6194 done (global step: 12351) | |
1681061813.971959: Worker 0: training step 6195 done (global step: 12353) | |
1681061813.977194: Worker 0: training step 6196 done (global step: 12355) | |
1681061813.982450: Worker 0: training step 6197 done (global step: 12357) | |
1681061813.987830: Worker 0: training step 6198 done (global step: 12359) | |
1681061813.992932: Worker 0: training step 6199 done (global step: 12361) | |
1681061813.998156: Worker 0: training step 6200 done (global step: 12363) | |
1681061814.003181: Worker 0: training step 6201 done (global step: 12365) | |
1681061814.008512: Worker 0: training step 6202 done (global step: 12367) | |
1681061814.014409: Worker 0: training step 6203 done (global step: 12369) | |
1681061814.019525: Worker 0: training step 6204 done (global step: 12371) | |
1681061814.025376: Worker 0: training step 6205 done (global step: 12373) | |
1681061814.031096: Worker 0: training step 6206 done (global step: 12375) | |
1681061814.037203: Worker 0: training step 6207 done (global step: 12377) | |
1681061814.043839: Worker 0: training step 6208 done (global step: 12379) | |
1681061814.050685: Worker 0: training step 6209 done (global step: 12381) | |
1681061814.057515: Worker 0: training step 6210 done (global step: 12384) | |
1681061814.062930: Worker 0: training step 6211 done (global step: 12386) | |
1681061814.068439: Worker 0: training step 6212 done (global step: 12388) | |
1681061814.073916: Worker 0: training step 6213 done (global step: 12390) | |
1681061814.079964: Worker 0: training step 6214 done (global step: 12392) | |
1681061814.085757: Worker 0: training step 6215 done (global step: 12394) | |
1681061814.090794: Worker 0: training step 6216 done (global step: 12396) | |
1681061814.098119: Worker 0: training step 6217 done (global step: 12398) | |
1681061814.106267: Worker 0: training step 6218 done (global step: 12400) | |
1681061814.113916: Worker 0: training step 6219 done (global step: 12402) | |
1681061814.119402: Worker 0: training step 6220 done (global step: 12404) | |
1681061814.124918: Worker 0: training step 6221 done (global step: 12406) | |
1681061814.130688: Worker 0: training step 6222 done (global step: 12408) | |
1681061814.136331: Worker 0: training step 6223 done (global step: 12410) | |
1681061814.145791: Worker 0: training step 6224 done (global step: 12412) | |
1681061814.151983: Worker 0: training step 6225 done (global step: 12414) | |
1681061814.157696: Worker 0: training step 6226 done (global step: 12416) | |
1681061814.162565: Worker 0: training step 6227 done (global step: 12418) | |
1681061814.168095: Worker 0: training step 6228 done (global step: 12420) | |
1681061814.173303: Worker 0: training step 6229 done (global step: 12422) | |
1681061814.178747: Worker 0: training step 6230 done (global step: 12424) | |
1681061814.184279: Worker 0: training step 6231 done (global step: 12426) | |
1681061814.190463: Worker 0: training step 6232 done (global step: 12428) | |
1681061814.197503: Worker 0: training step 6233 done (global step: 12430) | |
1681061814.206337: Worker 0: training step 6234 done (global step: 12432) | |
1681061814.211599: Worker 0: training step 6235 done (global step: 12434) | |
1681061814.217954: Worker 0: training step 6236 done (global step: 12436) | |
1681061814.223169: Worker 0: training step 6237 done (global step: 12438) | |
1681061814.228735: Worker 0: training step 6238 done (global step: 12440) | |
1681061814.235371: Worker 0: training step 6239 done (global step: 12442) | |
1681061814.240337: Worker 0: training step 6240 done (global step: 12445) | |
1681061814.245839: Worker 0: training step 6241 done (global step: 12446) | |
1681061814.251199: Worker 0: training step 6242 done (global step: 12448) | |
1681061814.257465: Worker 0: training step 6243 done (global step: 12450) | |
1681061814.263507: Worker 0: training step 6244 done (global step: 12452) | |
1681061814.268334: Worker 0: training step 6245 done (global step: 12454) | |
1681061814.273586: Worker 0: training step 6246 done (global step: 12456) | |
1681061814.280140: Worker 0: training step 6247 done (global step: 12458) | |
1681061814.285570: Worker 0: training step 6248 done (global step: 12460) | |
1681061814.290312: Worker 0: training step 6249 done (global step: 12462) | |
1681061814.295962: Worker 0: training step 6250 done (global step: 12464) | |
1681061814.301739: Worker 0: training step 6251 done (global step: 12466) | |
1681061814.308165: Worker 0: training step 6252 done (global step: 12468) | |
1681061814.314492: Worker 0: training step 6253 done (global step: 12470) | |
1681061814.319979: Worker 0: training step 6254 done (global step: 12472) | |
1681061814.325895: Worker 0: training step 6255 done (global step: 12474) | |
1681061814.331764: Worker 0: training step 6256 done (global step: 12476) | |
1681061814.337020: Worker 0: training step 6257 done (global step: 12478) | |
1681061814.343103: Worker 0: training step 6258 done (global step: 12480) | |
1681061814.347925: Worker 0: training step 6259 done (global step: 12482) | |
1681061814.352932: Worker 0: training step 6260 done (global step: 12484) | |
1681061814.357946: Worker 0: training step 6261 done (global step: 12486) | |
1681061814.363646: Worker 0: training step 6262 done (global step: 12488) | |
1681061814.368565: Worker 0: training step 6263 done (global step: 12490) | |
1681061814.374676: Worker 0: training step 6264 done (global step: 12492) | |
1681061814.379594: Worker 0: training step 6265 done (global step: 12494) | |
1681061814.384974: Worker 0: training step 6266 done (global step: 12495) | |
1681061814.390884: Worker 0: training step 6267 done (global step: 12498) | |
1681061814.397372: Worker 0: training step 6268 done (global step: 12499) | |
1681061814.402828: Worker 0: training step 6269 done (global step: 12502) | |
1681061814.408380: Worker 0: training step 6270 done (global step: 12504) | |
1681061814.416707: Worker 0: training step 6271 done (global step: 12506) | |
1681061814.421170: Worker 0: training step 6272 done (global step: 12508) | |
1681061814.426231: Worker 0: training step 6273 done (global step: 12510) | |
1681061814.431226: Worker 0: training step 6274 done (global step: 12512) | |
1681061814.437725: Worker 0: training step 6275 done (global step: 12514) | |
1681061814.443361: Worker 0: training step 6276 done (global step: 12516) | |
1681061814.449115: Worker 0: training step 6277 done (global step: 12518) | |
1681061814.454729: Worker 0: training step 6278 done (global step: 12520) | |
1681061814.461430: Worker 0: training step 6279 done (global step: 12522) | |
1681061814.470245: Worker 0: training step 6280 done (global step: 12524) | |
1681061814.475506: Worker 0: training step 6281 done (global step: 12526) | |
1681061814.480715: Worker 0: training step 6282 done (global step: 12528) | |
1681061814.485750: Worker 0: training step 6283 done (global step: 12530) | |
1681061814.491117: Worker 0: training step 6284 done (global step: 12532) | |
1681061814.496451: Worker 0: training step 6285 done (global step: 12534) | |
1681061814.501476: Worker 0: training step 6286 done (global step: 12536) | |
1681061814.507106: Worker 0: training step 6287 done (global step: 12538) | |
1681061814.513186: Worker 0: training step 6288 done (global step: 12540) | |
1681061814.518705: Worker 0: training step 6289 done (global step: 12542) | |
1681061814.523935: Worker 0: training step 6290 done (global step: 12544) | |
1681061814.530233: Worker 0: training step 6291 done (global step: 12546) | |
1681061814.535402: Worker 0: training step 6292 done (global step: 12548) | |
1681061814.541021: Worker 0: training step 6293 done (global step: 12550) | |
1681061814.547770: Worker 0: training step 6294 done (global step: 12552) | |
1681061814.554029: Worker 0: training step 6295 done (global step: 12554) | |
1681061814.559886: Worker 0: training step 6296 done (global step: 12556) | |
1681061814.565506: Worker 0: training step 6297 done (global step: 12558) | |
1681061814.570881: Worker 0: training step 6298 done (global step: 12560) | |
1681061814.575966: Worker 0: training step 6299 done (global step: 12562) | |
1681061814.581345: Worker 0: training step 6300 done (global step: 12564) | |
1681061814.586960: Worker 0: training step 6301 done (global step: 12566) | |
1681061814.592556: Worker 0: training step 6302 done (global step: 12568) | |
1681061814.597704: Worker 0: training step 6303 done (global step: 12570) | |
1681061814.603748: Worker 0: training step 6304 done (global step: 12572) | |
1681061814.609311: Worker 0: training step 6305 done (global step: 12574) | |
1681061814.613673: Worker 0: training step 6306 done (global step: 12576) | |
1681061814.620050: Worker 0: training step 6307 done (global step: 12578) | |
1681061814.624878: Worker 0: training step 6308 done (global step: 12580) | |
1681061814.629947: Worker 0: training step 6309 done (global step: 12582) | |
1681061814.636056: Worker 0: training step 6310 done (global step: 12584) | |
1681061814.641410: Worker 0: training step 6311 done (global step: 12586) | |
1681061814.646619: Worker 0: training step 6312 done (global step: 12588) | |
1681061814.651998: Worker 0: training step 6313 done (global step: 12590) | |
1681061814.659585: Worker 0: training step 6314 done (global step: 12591) | |
1681061814.669583: Worker 0: training step 6315 done (global step: 12593) | |
1681061814.677712: Worker 0: training step 6316 done (global step: 12595) | |
1681061814.687293: Worker 0: training step 6317 done (global step: 12597) | |
1681061814.693818: Worker 0: training step 6318 done (global step: 12599) | |
1681061814.701298: Worker 0: training step 6319 done (global step: 12601) | |
1681061814.709628: Worker 0: training step 6320 done (global step: 12603) | |
1681061814.717300: Worker 0: training step 6321 done (global step: 12605) | |
1681061814.724333: Worker 0: training step 6322 done (global step: 12607) | |
1681061814.732022: Worker 0: training step 6323 done (global step: 12609) | |
1681061814.738987: Worker 0: training step 6324 done (global step: 12611) | |
1681061814.745485: Worker 0: training step 6325 done (global step: 12613) | |
1681061814.753742: Worker 0: training step 6326 done (global step: 12615) | |
1681061814.762722: Worker 0: training step 6327 done (global step: 12617) | |
1681061814.770371: Worker 0: training step 6328 done (global step: 12619) | |
1681061814.779431: Worker 0: training step 6329 done (global step: 12621) | |
1681061814.786976: Worker 0: training step 6330 done (global step: 12623) | |
1681061814.794396: Worker 0: training step 6331 done (global step: 12625) | |
1681061814.803962: Worker 0: training step 6332 done (global step: 12627) | |
1681061814.812762: Worker 0: training step 6333 done (global step: 12629) | |
1681061814.819936: Worker 0: training step 6334 done (global step: 12631) | |
1681061814.829029: Worker 0: training step 6335 done (global step: 12633) | |
1681061814.837159: Worker 0: training step 6336 done (global step: 12634) | |
1681061814.844817: Worker 0: training step 6337 done (global step: 12636) | |
1681061814.852338: Worker 0: training step 6338 done (global step: 12638) | |
1681061814.859373: Worker 0: training step 6339 done (global step: 12640) | |
1681061814.866642: Worker 0: training step 6340 done (global step: 12642) | |
1681061814.873764: Worker 0: training step 6341 done (global step: 12644) | |
1681061814.881142: Worker 0: training step 6342 done (global step: 12646) | |
1681061814.890228: Worker 0: training step 6343 done (global step: 12647) | |
1681061814.898955: Worker 0: training step 6344 done (global step: 12649) | |
1681061814.909159: Worker 0: training step 6345 done (global step: 12651) | |
1681061814.924942: Worker 0: training step 6346 done (global step: 12654) | |
1681061814.938948: Worker 0: training step 6347 done (global step: 12656) | |
1681061814.951692: Worker 0: training step 6348 done (global step: 12657) | |
1681061814.969192: Worker 0: training step 6349 done (global step: 12659) | |
1681061814.984058: Worker 0: training step 6350 done (global step: 12662) | |
1681061814.995963: Worker 0: training step 6351 done (global step: 12664) | |
1681061815.022352: Worker 0: training step 6352 done (global step: 12666) | |
1681061815.032596: Worker 0: training step 6353 done (global step: 12669) | |
1681061815.040319: Worker 0: training step 6354 done (global step: 12671) | |
1681061815.049961: Worker 0: training step 6355 done (global step: 12673) | |
1681061815.056944: Worker 0: training step 6356 done (global step: 12675) | |
1681061815.063648: Worker 0: training step 6357 done (global step: 12677) | |
1681061815.071353: Worker 0: training step 6358 done (global step: 12679) | |
1681061815.077281: Worker 0: training step 6359 done (global step: 12681) | |
1681061815.082905: Worker 0: training step 6360 done (global step: 12683) | |
1681061815.088795: Worker 0: training step 6361 done (global step: 12685) | |
1681061815.095698: Worker 0: training step 6362 done (global step: 12687) | |
1681061815.102835: Worker 0: training step 6363 done (global step: 12689) | |
1681061815.108957: Worker 0: training step 6364 done (global step: 12691) | |
1681061815.115508: Worker 0: training step 6365 done (global step: 12693) | |
1681061815.121813: Worker 0: training step 6366 done (global step: 12695) | |
1681061815.128292: Worker 0: training step 6367 done (global step: 12697) | |
1681061815.134000: Worker 0: training step 6368 done (global step: 12699) | |
1681061815.140354: Worker 0: training step 6369 done (global step: 12701) | |
1681061815.146303: Worker 0: training step 6370 done (global step: 12703) | |
1681061815.151678: Worker 0: training step 6371 done (global step: 12705) | |
1681061815.161255: Worker 0: training step 6372 done (global step: 12707) | |
1681061815.167060: Worker 0: training step 6373 done (global step: 12709) | |
1681061815.172884: Worker 0: training step 6374 done (global step: 12711) | |
1681061815.181990: Worker 0: training step 6375 done (global step: 12713) | |
1681061815.194313: Worker 0: training step 6376 done (global step: 12715) | |
1681061815.200524: Worker 0: training step 6377 done (global step: 12717) | |
1681061815.205600: Worker 0: training step 6378 done (global step: 12719) | |
1681061815.211196: Worker 0: training step 6379 done (global step: 12721) | |
1681061815.217335: Worker 0: training step 6380 done (global step: 12723) | |
1681061815.227625: Worker 0: training step 6381 done (global step: 12725) | |
1681061815.233936: Worker 0: training step 6382 done (global step: 12727) | |
1681061815.240534: Worker 0: training step 6383 done (global step: 12729) | |
1681061815.248193: Worker 0: training step 6384 done (global step: 12731) | |
1681061815.254646: Worker 0: training step 6385 done (global step: 12733) | |
1681061815.262159: Worker 0: training step 6386 done (global step: 12735) | |
1681061815.267649: Worker 0: training step 6387 done (global step: 12737) | |
1681061815.273211: Worker 0: training step 6388 done (global step: 12739) | |
1681061815.281519: Worker 0: training step 6389 done (global step: 12741) | |
1681061815.292243: Worker 0: training step 6390 done (global step: 12743) | |
1681061815.300107: Worker 0: training step 6391 done (global step: 12745) | |
1681061815.309129: Worker 0: training step 6392 done (global step: 12747) | |
1681061815.314470: Worker 0: training step 6393 done (global step: 12749) | |
1681061815.320659: Worker 0: training step 6394 done (global step: 12751) | |
1681061815.326037: Worker 0: training step 6395 done (global step: 12753) | |
1681061815.331873: Worker 0: training step 6396 done (global step: 12755) | |
1681061815.337428: Worker 0: training step 6397 done (global step: 12757) | |
1681061815.342929: Worker 0: training step 6398 done (global step: 12759) | |
1681061815.348872: Worker 0: training step 6399 done (global step: 12761) | |
1681061815.354556: Worker 0: training step 6400 done (global step: 12763) | |
1681061815.360089: Worker 0: training step 6401 done (global step: 12765) | |
1681061815.365140: Worker 0: training step 6402 done (global step: 12766) | |
1681061815.370385: Worker 0: training step 6403 done (global step: 12768) | |
1681061815.377502: Worker 0: training step 6404 done (global step: 12770) | |
1681061815.382812: Worker 0: training step 6405 done (global step: 12773) | |
1681061815.388810: Worker 0: training step 6406 done (global step: 12775) | |
1681061815.394423: Worker 0: training step 6407 done (global step: 12777) | |
1681061815.399628: Worker 0: training step 6408 done (global step: 12779) | |
1681061815.405725: Worker 0: training step 6409 done (global step: 12781) | |
1681061815.411399: Worker 0: training step 6410 done (global step: 12783) | |
1681061815.417251: Worker 0: training step 6411 done (global step: 12785) | |
1681061815.423161: Worker 0: training step 6412 done (global step: 12787) | |
1681061815.428629: Worker 0: training step 6413 done (global step: 12789) | |
1681061815.434212: Worker 0: training step 6414 done (global step: 12791) | |
1681061815.440154: Worker 0: training step 6415 done (global step: 12793) | |
1681061815.445944: Worker 0: training step 6416 done (global step: 12795) | |
1681061815.452688: Worker 0: training step 6417 done (global step: 12797) | |
1681061815.458121: Worker 0: training step 6418 done (global step: 12799) | |
1681061815.463604: Worker 0: training step 6419 done (global step: 12801) | |
1681061815.469220: Worker 0: training step 6420 done (global step: 12803) | |
1681061815.475373: Worker 0: training step 6421 done (global step: 12805) | |
1681061815.481816: Worker 0: training step 6422 done (global step: 12807) | |
1681061815.486750: Worker 0: training step 6423 done (global step: 12809) | |
1681061815.492013: Worker 0: training step 6424 done (global step: 12811) | |
1681061815.497350: Worker 0: training step 6425 done (global step: 12813) | |
1681061815.503249: Worker 0: training step 6426 done (global step: 12815) | |
1681061815.509322: Worker 0: training step 6427 done (global step: 12817) | |
1681061815.514637: Worker 0: training step 6428 done (global step: 12819) | |
1681061815.520208: Worker 0: training step 6429 done (global step: 12821) | |
1681061815.525784: Worker 0: training step 6430 done (global step: 12823) | |
1681061815.531089: Worker 0: training step 6431 done (global step: 12825) | |
1681061815.536308: Worker 0: training step 6432 done (global step: 12827) | |
1681061815.541878: Worker 0: training step 6433 done (global step: 12829) | |
1681061815.546480: Worker 0: training step 6434 done (global step: 12831) | |
1681061815.551921: Worker 0: training step 6435 done (global step: 12832) | |
1681061815.557778: Worker 0: training step 6436 done (global step: 12834) | |
1681061815.563497: Worker 0: training step 6437 done (global step: 12836) | |
1681061815.568886: Worker 0: training step 6438 done (global step: 12838) | |
1681061815.580724: Worker 0: training step 6439 done (global step: 12840) | |
1681061815.589339: Worker 0: training step 6440 done (global step: 12843) | |
1681061815.599095: Worker 0: training step 6441 done (global step: 12845) | |
1681061815.605514: Worker 0: training step 6442 done (global step: 12847) | |
1681061815.611180: Worker 0: training step 6443 done (global step: 12849) | |
1681061815.616671: Worker 0: training step 6444 done (global step: 12851) | |
1681061815.622050: Worker 0: training step 6445 done (global step: 12853) | |
1681061815.628962: Worker 0: training step 6446 done (global step: 12855) | |
1681061815.634718: Worker 0: training step 6447 done (global step: 12857) | |
1681061815.640728: Worker 0: training step 6448 done (global step: 12858) | |
1681061815.647264: Worker 0: training step 6449 done (global step: 12860) | |
1681061815.653230: Worker 0: training step 6450 done (global step: 12862) | |
1681061815.658659: Worker 0: training step 6451 done (global step: 12864) | |
1681061815.664110: Worker 0: training step 6452 done (global step: 12866) | |
1681061815.670017: Worker 0: training step 6453 done (global step: 12868) | |
1681061815.674428: Worker 0: training step 6454 done (global step: 12870) | |
1681061815.679413: Worker 0: training step 6455 done (global step: 12872) | |
1681061815.686197: Worker 0: training step 6456 done (global step: 12874) | |
1681061815.692424: Worker 0: training step 6457 done (global step: 12876) | |
1681061815.699229: Worker 0: training step 6458 done (global step: 12878) | |
1681061815.704944: Worker 0: training step 6459 done (global step: 12880) | |
1681061815.710933: Worker 0: training step 6460 done (global step: 12882) | |
1681061815.718492: Worker 0: training step 6461 done (global step: 12884) | |
1681061815.725949: Worker 0: training step 6462 done (global step: 12886) | |
1681061815.732023: Worker 0: training step 6463 done (global step: 12888) | |
1681061815.738566: Worker 0: training step 6464 done (global step: 12890) | |
1681061815.744921: Worker 0: training step 6465 done (global step: 12892) | |
1681061815.751176: Worker 0: training step 6466 done (global step: 12894) | |
1681061815.758772: Worker 0: training step 6467 done (global step: 12896) | |
1681061815.765701: Worker 0: training step 6468 done (global step: 12898) | |
1681061815.771662: Worker 0: training step 6469 done (global step: 12900) | |
1681061815.777134: Worker 0: training step 6470 done (global step: 12902) | |
1681061815.783054: Worker 0: training step 6471 done (global step: 12904) | |
1681061815.789139: Worker 0: training step 6472 done (global step: 12906) | |
1681061815.795178: Worker 0: training step 6473 done (global step: 12908) | |
1681061815.800882: Worker 0: training step 6474 done (global step: 12910) | |
1681061815.806122: Worker 0: training step 6475 done (global step: 12912) | |
1681061815.812497: Worker 0: training step 6476 done (global step: 12914) | |
1681061815.817767: Worker 0: training step 6477 done (global step: 12916) | |
1681061815.823231: Worker 0: training step 6478 done (global step: 12918) | |
1681061815.828549: Worker 0: training step 6479 done (global step: 12920) | |
1681061815.833757: Worker 0: training step 6480 done (global step: 12922) | |
1681061815.839104: Worker 0: training step 6481 done (global step: 12924) | |
1681061815.844054: Worker 0: training step 6482 done (global step: 12926) | |
1681061815.849379: Worker 0: training step 6483 done (global step: 12928) | |
1681061815.854660: Worker 0: training step 6484 done (global step: 12930) | |
1681061815.860281: Worker 0: training step 6485 done (global step: 12932) | |
1681061815.865773: Worker 0: training step 6486 done (global step: 12934) | |
1681061815.871048: Worker 0: training step 6487 done (global step: 12936) | |
1681061815.876552: Worker 0: training step 6488 done (global step: 12938) | |
1681061815.882187: Worker 0: training step 6489 done (global step: 12940) | |
1681061815.887361: Worker 0: training step 6490 done (global step: 12942) | |
1681061815.893569: Worker 0: training step 6491 done (global step: 12944) | |
1681061815.899094: Worker 0: training step 6492 done (global step: 12946) | |
1681061815.904164: Worker 0: training step 6493 done (global step: 12948) | |
1681061815.909740: Worker 0: training step 6494 done (global step: 12950) | |
1681061815.915299: Worker 0: training step 6495 done (global step: 12952) | |
1681061815.920816: Worker 0: training step 6496 done (global step: 12954) | |
1681061815.926322: Worker 0: training step 6497 done (global step: 12956) | |
1681061815.931949: Worker 0: training step 6498 done (global step: 12958) | |
1681061815.938162: Worker 0: training step 6499 done (global step: 12960) | |
1681061815.943244: Worker 0: training step 6500 done (global step: 12962) | |
1681061815.948214: Worker 0: training step 6501 done (global step: 12964) | |
1681061815.953843: Worker 0: training step 6502 done (global step: 12966) | |
1681061815.959774: Worker 0: training step 6503 done (global step: 12968) | |
1681061815.966143: Worker 0: training step 6504 done (global step: 12970) | |
1681061815.972786: Worker 0: training step 6505 done (global step: 12973) | |
1681061815.978414: Worker 0: training step 6506 done (global step: 12975) | |
1681061815.983780: Worker 0: training step 6507 done (global step: 12976) | |
1681061815.989548: Worker 0: training step 6508 done (global step: 12978) | |
1681061815.995238: Worker 0: training step 6509 done (global step: 12980) | |
1681061816.001179: Worker 0: training step 6510 done (global step: 12982) | |
1681061816.006495: Worker 0: training step 6511 done (global step: 12985) | |
1681061816.013124: Worker 0: training step 6512 done (global step: 12986) | |
1681061816.018438: Worker 0: training step 6513 done (global step: 12989) | |
1681061816.023912: Worker 0: training step 6514 done (global step: 12991) | |
1681061816.029742: Worker 0: training step 6515 done (global step: 12993) | |
1681061816.035346: Worker 0: training step 6516 done (global step: 12995) | |
1681061816.041092: Worker 0: training step 6517 done (global step: 12997) | |
1681061816.046897: Worker 0: training step 6518 done (global step: 12999) | |
1681061816.053408: Worker 0: training step 6519 done (global step: 13001) | |
1681061816.058779: Worker 0: training step 6520 done (global step: 13004) | |
1681061816.063749: Worker 0: training step 6521 done (global step: 13005) | |
1681061816.068602: Worker 0: training step 6522 done (global step: 13007) | |
1681061816.074271: Worker 0: training step 6523 done (global step: 13009) | |
1681061816.079571: Worker 0: training step 6524 done (global step: 13011) | |
1681061816.085091: Worker 0: training step 6525 done (global step: 13013) | |
1681061816.090272: Worker 0: training step 6526 done (global step: 13015) | |
1681061816.095112: Worker 0: training step 6527 done (global step: 13017) | |
1681061816.100467: Worker 0: training step 6528 done (global step: 13019) | |
1681061816.106562: Worker 0: training step 6529 done (global step: 13021) | |
1681061816.111770: Worker 0: training step 6530 done (global step: 13023) | |
1681061816.117649: Worker 0: training step 6531 done (global step: 13024) | |
1681061816.125394: Worker 0: training step 6532 done (global step: 13026) | |
1681061816.137487: Worker 0: training step 6533 done (global step: 13028) | |
1681061816.144070: Worker 0: training step 6534 done (global step: 13030) | |
1681061816.149742: Worker 0: training step 6535 done (global step: 13032) | |
1681061816.154987: Worker 0: training step 6536 done (global step: 13034) | |
1681061816.160779: Worker 0: training step 6537 done (global step: 13036) | |
1681061816.166336: Worker 0: training step 6538 done (global step: 13038) | |
1681061816.171108: Worker 0: training step 6539 done (global step: 13040) | |
1681061816.176931: Worker 0: training step 6540 done (global step: 13042) | |
1681061816.183743: Worker 0: training step 6541 done (global step: 13044) | |
1681061816.190312: Worker 0: training step 6542 done (global step: 13046) | |
1681061816.196355: Worker 0: training step 6543 done (global step: 13048) | |
1681061816.202092: Worker 0: training step 6544 done (global step: 13051) | |
1681061816.207541: Worker 0: training step 6545 done (global step: 13053) | |
1681061816.214712: Worker 0: training step 6546 done (global step: 13055) | |
1681061816.221306: Worker 0: training step 6547 done (global step: 13056) | |
1681061816.226569: Worker 0: training step 6548 done (global step: 13058) | |
1681061816.232110: Worker 0: training step 6549 done (global step: 13060) | |
1681061816.237854: Worker 0: training step 6550 done (global step: 13062) | |
1681061816.243783: Worker 0: training step 6551 done (global step: 13064) | |
1681061816.250420: Worker 0: training step 6552 done (global step: 13066) | |
1681061816.255738: Worker 0: training step 6553 done (global step: 13068) | |
1681061816.263956: Worker 0: training step 6554 done (global step: 13070) | |
1681061816.269604: Worker 0: training step 6555 done (global step: 13072) | |
1681061816.275306: Worker 0: training step 6556 done (global step: 13075) | |
1681061816.280494: Worker 0: training step 6557 done (global step: 13076) | |
1681061816.285786: Worker 0: training step 6558 done (global step: 13078) | |
1681061816.290928: Worker 0: training step 6559 done (global step: 13080) | |
1681061816.296779: Worker 0: training step 6560 done (global step: 13082) | |
1681061816.302929: Worker 0: training step 6561 done (global step: 13084) | |
1681061816.310328: Worker 0: training step 6562 done (global step: 13086) | |
1681061816.315997: Worker 0: training step 6563 done (global step: 13088) | |
1681061816.320681: Worker 0: training step 6564 done (global step: 13090) | |
1681061816.326715: Worker 0: training step 6565 done (global step: 13092) | |
1681061816.333256: Worker 0: training step 6566 done (global step: 13094) | |
1681061816.339675: Worker 0: training step 6567 done (global step: 13096) | |
1681061816.345644: Worker 0: training step 6568 done (global step: 13098) | |
1681061816.351193: Worker 0: training step 6569 done (global step: 13100) | |
1681061816.357318: Worker 0: training step 6570 done (global step: 13102) | |
1681061816.362025: Worker 0: training step 6571 done (global step: 13104) | |
1681061816.367813: Worker 0: training step 6572 done (global step: 13106) | |
1681061816.372962: Worker 0: training step 6573 done (global step: 13108) | |
1681061816.378156: Worker 0: training step 6574 done (global step: 13110) | |
1681061816.383640: Worker 0: training step 6575 done (global step: 13112) | |
1681061816.389099: Worker 0: training step 6576 done (global step: 13114) | |
1681061816.394748: Worker 0: training step 6577 done (global step: 13116) | |
1681061816.400537: Worker 0: training step 6578 done (global step: 13118) | |
1681061816.405835: Worker 0: training step 6579 done (global step: 13120) | |
1681061816.411983: Worker 0: training step 6580 done (global step: 13122) | |
1681061816.416878: Worker 0: training step 6581 done (global step: 13124) | |
1681061816.421881: Worker 0: training step 6582 done (global step: 13126) | |
1681061816.427403: Worker 0: training step 6583 done (global step: 13128) | |
1681061816.432772: Worker 0: training step 6584 done (global step: 13130) | |
1681061816.438702: Worker 0: training step 6585 done (global step: 13132) | |
1681061816.443407: Worker 0: training step 6586 done (global step: 13134) | |
1681061816.448829: Worker 0: training step 6587 done (global step: 13136) | |
1681061816.454104: Worker 0: training step 6588 done (global step: 13138) | |
1681061816.461644: Worker 0: training step 6589 done (global step: 13140) | |
1681061816.470633: Worker 0: training step 6590 done (global step: 13142) | |
1681061816.483795: Worker 0: training step 6591 done (global step: 13144) | |
1681061816.491223: Worker 0: training step 6592 done (global step: 13146) | |
1681061816.499981: Worker 0: training step 6593 done (global step: 13148) | |
1681061816.506440: Worker 0: training step 6594 done (global step: 13149) | |
1681061816.512267: Worker 0: training step 6595 done (global step: 13151) | |
1681061816.517803: Worker 0: training step 6596 done (global step: 13153) | |
1681061816.523262: Worker 0: training step 6597 done (global step: 13155) | |
1681061816.529710: Worker 0: training step 6598 done (global step: 13157) | |
1681061816.534574: Worker 0: training step 6599 done (global step: 13159) | |
1681061816.539690: Worker 0: training step 6600 done (global step: 13161) | |
1681061816.699727: Worker 0: training step 6601 done (global step: 13194) | |
1681061816.704021: Worker 0: training step 6602 done (global step: 13195) | |
1681061816.708661: Worker 0: training step 6603 done (global step: 13196) | |
1681061816.713309: Worker 0: training step 6604 done (global step: 13197) | |
1681061816.717402: Worker 0: training step 6605 done (global step: 13198) | |
1681061816.722919: Worker 0: training step 6606 done (global step: 13199) | |
1681061816.727358: Worker 0: training step 6607 done (global step: 13200) | |
1681061816.732046: Worker 0: training step 6608 done (global step: 13201) | |
1681061816.736449: Worker 0: training step 6609 done (global step: 13202) | |
1681061816.741375: Worker 0: training step 6610 done (global step: 13203) | |
1681061816.746308: Worker 0: training step 6611 done (global step: 13204) | |
1681061816.751143: Worker 0: training step 6612 done (global step: 13205) | |
1681061816.755453: Worker 0: training step 6613 done (global step: 13206) | |
1681061816.761591: Worker 0: training step 6614 done (global step: 13207) | |
1681061816.766123: Worker 0: training step 6615 done (global step: 13208) | |
1681061816.770818: Worker 0: training step 6616 done (global step: 13209) | |
1681061816.774970: Worker 0: training step 6617 done (global step: 13210) | |
1681061816.779657: Worker 0: training step 6618 done (global step: 13211) | |
1681061816.784010: Worker 0: training step 6619 done (global step: 13212) | |
1681061816.789093: Worker 0: training step 6620 done (global step: 13213) | |
1681061816.793589: Worker 0: training step 6621 done (global step: 13214) | |
1681061816.798126: Worker 0: training step 6622 done (global step: 13215) | |
1681061816.802781: Worker 0: training step 6623 done (global step: 13216) | |
1681061816.807541: Worker 0: training step 6624 done (global step: 13217) | |
1681061816.811707: Worker 0: training step 6625 done (global step: 13218) | |
1681061816.816073: Worker 0: training step 6626 done (global step: 13219) | |
1681061816.820467: Worker 0: training step 6627 done (global step: 13220) | |
1681061816.825273: Worker 0: training step 6628 done (global step: 13221) | |
1681061816.829233: Worker 0: training step 6629 done (global step: 13222) | |
1681061816.833565: Worker 0: training step 6630 done (global step: 13223) | |
1681061816.837590: Worker 0: training step 6631 done (global step: 13224) | |
1681061816.842791: Worker 0: training step 6632 done (global step: 13225) | |
1681061816.847918: Worker 0: training step 6633 done (global step: 13227) | |
1681061816.853198: Worker 0: training step 6634 done (global step: 13229) | |
1681061816.858925: Worker 0: training step 6635 done (global step: 13231) | |
1681061816.864555: Worker 0: training step 6636 done (global step: 13233) | |
1681061816.869704: Worker 0: training step 6637 done (global step: 13235) | |
1681061816.876413: Worker 0: training step 6638 done (global step: 13237) | |
1681061816.882709: Worker 0: training step 6639 done (global step: 13239) | |
1681061816.887775: Worker 0: training step 6640 done (global step: 13242) | |
1681061816.893479: Worker 0: training step 6641 done (global step: 13243) | |
1681061816.899531: Worker 0: training step 6642 done (global step: 13245) | |
1681061816.905906: Worker 0: training step 6643 done (global step: 13247) | |
1681061816.911873: Worker 0: training step 6644 done (global step: 13250) | |
1681061816.917683: Worker 0: training step 6645 done (global step: 13252) | |
1681061816.923079: Worker 0: training step 6646 done (global step: 13254) | |
1681061816.928420: Worker 0: training step 6647 done (global step: 13256) | |
1681061816.934351: Worker 0: training step 6648 done (global step: 13258) | |
1681061816.939948: Worker 0: training step 6649 done (global step: 13260) | |
1681061816.945838: Worker 0: training step 6650 done (global step: 13262) | |
1681061816.951679: Worker 0: training step 6651 done (global step: 13264) | |
1681061816.956968: Worker 0: training step 6652 done (global step: 13266) | |
1681061816.962496: Worker 0: training step 6653 done (global step: 13268) | |
1681061816.967922: Worker 0: training step 6654 done (global step: 13270) | |
1681061816.974042: Worker 0: training step 6655 done (global step: 13272) | |
1681061816.980129: Worker 0: training step 6656 done (global step: 13274) | |
1681061816.985485: Worker 0: training step 6657 done (global step: 13276) | |
1681061816.990988: Worker 0: training step 6658 done (global step: 13277) | |
1681061816.997371: Worker 0: training step 6659 done (global step: 13279) | |
1681061817.002585: Worker 0: training step 6660 done (global step: 13282) | |
1681061817.007845: Worker 0: training step 6661 done (global step: 13283) | |
1681061817.014112: Worker 0: training step 6662 done (global step: 13285) | |
1681061817.019849: Worker 0: training step 6663 done (global step: 13287) | |
1681061817.026451: Worker 0: training step 6664 done (global step: 13289) | |
1681061817.032110: Worker 0: training step 6665 done (global step: 13292) | |
1681061817.038056: Worker 0: training step 6666 done (global step: 13294) | |
1681061817.045683: Worker 0: training step 6667 done (global step: 13296) | |
1681061817.052457: Worker 0: training step 6668 done (global step: 13298) | |
1681061817.058372: Worker 0: training step 6669 done (global step: 13300) | |
1681061817.064404: Worker 0: training step 6670 done (global step: 13302) | |
1681061817.070980: Worker 0: training step 6671 done (global step: 13304) | |
1681061817.078015: Worker 0: training step 6672 done (global step: 13306) | |
1681061817.083054: Worker 0: training step 6673 done (global step: 13308) | |
1681061817.088036: Worker 0: training step 6674 done (global step: 13310) | |
1681061817.093812: Worker 0: training step 6675 done (global step: 13312) | |
1681061817.099408: Worker 0: training step 6676 done (global step: 13314) | |
1681061817.105484: Worker 0: training step 6677 done (global step: 13316) | |
1681061817.113046: Worker 0: training step 6678 done (global step: 13318) | |
1681061817.119140: Worker 0: training step 6679 done (global step: 13320) | |
1681061817.124911: Worker 0: training step 6680 done (global step: 13323) | |
1681061817.130208: Worker 0: training step 6681 done (global step: 13324) | |
1681061817.136179: Worker 0: training step 6682 done (global step: 13326) | |
1681061817.142582: Worker 0: training step 6683 done (global step: 13328) | |
1681061817.149103: Worker 0: training step 6684 done (global step: 13331) | |
1681061817.155249: Worker 0: training step 6685 done (global step: 13333) | |
1681061817.160648: Worker 0: training step 6686 done (global step: 13335) | |
1681061817.166138: Worker 0: training step 6687 done (global step: 13337) | |
1681061817.172134: Worker 0: training step 6688 done (global step: 13339) | |
1681061817.177025: Worker 0: training step 6689 done (global step: 13341) | |
1681061817.183518: Worker 0: training step 6690 done (global step: 13343) | |
1681061817.189682: Worker 0: training step 6691 done (global step: 13345) | |
1681061817.194656: Worker 0: training step 6692 done (global step: 13347) | |
1681061817.199777: Worker 0: training step 6693 done (global step: 13349) | |
1681061817.205171: Worker 0: training step 6694 done (global step: 13351) | |
1681061817.209968: Worker 0: training step 6695 done (global step: 13353) | |
1681061817.215249: Worker 0: training step 6696 done (global step: 13355) | |
1681061817.220580: Worker 0: training step 6697 done (global step: 13357) | |
1681061817.225562: Worker 0: training step 6698 done (global step: 13359) | |
1681061817.231521: Worker 0: training step 6699 done (global step: 13361) | |
1681061817.237310: Worker 0: training step 6700 done (global step: 13363) | |
1681061817.242927: Worker 0: training step 6701 done (global step: 13365) | |
1681061817.249646: Worker 0: training step 6702 done (global step: 13367) | |
1681061817.255735: Worker 0: training step 6703 done (global step: 13369) | |
1681061817.260726: Worker 0: training step 6704 done (global step: 13371) | |
1681061817.266314: Worker 0: training step 6705 done (global step: 13373) | |
1681061817.271503: Worker 0: training step 6706 done (global step: 13375) | |
1681061817.276961: Worker 0: training step 6707 done (global step: 13377) | |
1681061817.282816: Worker 0: training step 6708 done (global step: 13379) | |
1681061817.289515: Worker 0: training step 6709 done (global step: 13381) | |
1681061817.295241: Worker 0: training step 6710 done (global step: 13383) | |
1681061817.300657: Worker 0: training step 6711 done (global step: 13386) | |
1681061817.307555: Worker 0: training step 6712 done (global step: 13387) | |
1681061817.315397: Worker 0: training step 6713 done (global step: 13389) | |
1681061817.321114: Worker 0: training step 6714 done (global step: 13392) | |
1681061817.326139: Worker 0: training step 6715 done (global step: 13394) | |
1681061817.330633: Worker 0: training step 6716 done (global step: 13395) | |
1681061817.335985: Worker 0: training step 6717 done (global step: 13397) | |
1681061817.341277: Worker 0: training step 6718 done (global step: 13399) | |
1681061817.346592: Worker 0: training step 6719 done (global step: 13401) | |
1681061817.351912: Worker 0: training step 6720 done (global step: 13403) | |
1681061817.357238: Worker 0: training step 6721 done (global step: 13405) | |
1681061817.362990: Worker 0: training step 6722 done (global step: 13407) | |
1681061817.368567: Worker 0: training step 6723 done (global step: 13409) | |
1681061817.373968: Worker 0: training step 6724 done (global step: 13411) | |
1681061817.379177: Worker 0: training step 6725 done (global step: 13413) | |
1681061817.384735: Worker 0: training step 6726 done (global step: 13415) | |
1681061817.390557: Worker 0: training step 6727 done (global step: 13417) | |
1681061817.396534: Worker 0: training step 6728 done (global step: 13419) | |
1681061817.401918: Worker 0: training step 6729 done (global step: 13421) | |
1681061817.406991: Worker 0: training step 6730 done (global step: 13423) | |
1681061817.412927: Worker 0: training step 6731 done (global step: 13425) | |
1681061817.418274: Worker 0: training step 6732 done (global step: 13427) | |
1681061817.423953: Worker 0: training step 6733 done (global step: 13429) | |
1681061817.428776: Worker 0: training step 6734 done (global step: 13431) | |
1681061817.433971: Worker 0: training step 6735 done (global step: 13433) | |
1681061817.439649: Worker 0: training step 6736 done (global step: 13435) | |
1681061817.444604: Worker 0: training step 6737 done (global step: 13437) | |
1681061817.451011: Worker 0: training step 6738 done (global step: 13438) | |
1681061817.457507: Worker 0: training step 6739 done (global step: 13440) | |
1681061817.464520: Worker 0: training step 6740 done (global step: 13443) | |
1681061817.469978: Worker 0: training step 6741 done (global step: 13445) | |
1681061817.476626: Worker 0: training step 6742 done (global step: 13447) | |
1681061817.482378: Worker 0: training step 6743 done (global step: 13449) | |
1681061817.487444: Worker 0: training step 6744 done (global step: 13451) | |
1681061817.493202: Worker 0: training step 6745 done (global step: 13453) | |
1681061817.498275: Worker 0: training step 6746 done (global step: 13455) | |
1681061817.504056: Worker 0: training step 6747 done (global step: 13457) | |
1681061817.509690: Worker 0: training step 6748 done (global step: 13459) | |
1681061817.515456: Worker 0: training step 6749 done (global step: 13461) | |
1681061817.520506: Worker 0: training step 6750 done (global step: 13463) | |
1681061817.525763: Worker 0: training step 6751 done (global step: 13465) | |
1681061817.531396: Worker 0: training step 6752 done (global step: 13467) | |
1681061817.536817: Worker 0: training step 6753 done (global step: 13469) | |
1681061817.542464: Worker 0: training step 6754 done (global step: 13471) | |
1681061817.548686: Worker 0: training step 6755 done (global step: 13473) | |
1681061817.554739: Worker 0: training step 6756 done (global step: 13475) | |
1681061817.560088: Worker 0: training step 6757 done (global step: 13477) | |
1681061817.565752: Worker 0: training step 6758 done (global step: 13479) | |
1681061817.571061: Worker 0: training step 6759 done (global step: 13481) | |
1681061817.576796: Worker 0: training step 6760 done (global step: 13483) | |
1681061817.582240: Worker 0: training step 6761 done (global step: 13485) | |
1681061817.589224: Worker 0: training step 6762 done (global step: 13487) | |
1681061817.594825: Worker 0: training step 6763 done (global step: 13489) | |
1681061817.600828: Worker 0: training step 6764 done (global step: 13491) | |
1681061817.607671: Worker 0: training step 6765 done (global step: 13493) | |
1681061817.613568: Worker 0: training step 6766 done (global step: 13496) | |
1681061817.619230: Worker 0: training step 6767 done (global step: 13498) | |
1681061817.624426: Worker 0: training step 6768 done (global step: 13500) | |
1681061817.630415: Worker 0: training step 6769 done (global step: 13502) | |
1681061817.636094: Worker 0: training step 6770 done (global step: 13504) | |
1681061817.641602: Worker 0: training step 6771 done (global step: 13506) | |
1681061817.647110: Worker 0: training step 6772 done (global step: 13508) | |
1681061817.652876: Worker 0: training step 6773 done (global step: 13510) | |
1681061817.658503: Worker 0: training step 6774 done (global step: 13512) | |
1681061817.664170: Worker 0: training step 6775 done (global step: 13514) | |
1681061817.668836: Worker 0: training step 6776 done (global step: 13516) | |
1681061817.674557: Worker 0: training step 6777 done (global step: 13518) | |
1681061817.680781: Worker 0: training step 6778 done (global step: 13520) | |
1681061817.685975: Worker 0: training step 6779 done (global step: 13522) | |
1681061817.691990: Worker 0: training step 6780 done (global step: 13524) | |
1681061817.698027: Worker 0: training step 6781 done (global step: 13526) | |
1681061817.704736: Worker 0: training step 6782 done (global step: 13528) | |
1681061817.710045: Worker 0: training step 6783 done (global step: 13530) | |
1681061817.715835: Worker 0: training step 6784 done (global step: 13532) | |
1681061817.722059: Worker 0: training step 6785 done (global step: 13534) | |
1681061817.727419: Worker 0: training step 6786 done (global step: 13536) | |
1681061817.732245: Worker 0: training step 6787 done (global step: 13538) | |
1681061817.738272: Worker 0: training step 6788 done (global step: 13540) | |
1681061817.743762: Worker 0: training step 6789 done (global step: 13542) | |
1681061817.749093: Worker 0: training step 6790 done (global step: 13544) | |
1681061817.754157: Worker 0: training step 6791 done (global step: 13546) | |
1681061817.760373: Worker 0: training step 6792 done (global step: 13548) | |
1681061817.766045: Worker 0: training step 6793 done (global step: 13550) | |
1681061817.771795: Worker 0: training step 6794 done (global step: 13552) | |
1681061817.777776: Worker 0: training step 6795 done (global step: 13554) | |
1681061817.783598: Worker 0: training step 6796 done (global step: 13556) | |
1681061817.789158: Worker 0: training step 6797 done (global step: 13558) | |
1681061817.795231: Worker 0: training step 6798 done (global step: 13560) | |
1681061817.800646: Worker 0: training step 6799 done (global step: 13562) | |
1681061817.806573: Worker 0: training step 6800 done (global step: 13564) | |
1681061817.812313: Worker 0: training step 6801 done (global step: 13566) | |
1681061817.818587: Worker 0: training step 6802 done (global step: 13568) | |
1681061817.824389: Worker 0: training step 6803 done (global step: 13570) | |
1681061817.830875: Worker 0: training step 6804 done (global step: 13573) | |
1681061817.836830: Worker 0: training step 6805 done (global step: 13575) | |
1681061817.842121: Worker 0: training step 6806 done (global step: 13577) | |
1681061817.847523: Worker 0: training step 6807 done (global step: 13579) | |
1681061817.852432: Worker 0: training step 6808 done (global step: 13581) | |
1681061817.857978: Worker 0: training step 6809 done (global step: 13583) | |
1681061817.862887: Worker 0: training step 6810 done (global step: 13585) | |
1681061817.868381: Worker 0: training step 6811 done (global step: 13587) | |
1681061817.873589: Worker 0: training step 6812 done (global step: 13589) | |
1681061817.878800: Worker 0: training step 6813 done (global step: 13591) | |
1681061817.883831: Worker 0: training step 6814 done (global step: 13593) | |
1681061817.891005: Worker 0: training step 6815 done (global step: 13595) | |
1681061817.896518: Worker 0: training step 6816 done (global step: 13597) | |
1681061817.901935: Worker 0: training step 6817 done (global step: 13599) | |
1681061817.907133: Worker 0: training step 6818 done (global step: 13601) | |
1681061817.912680: Worker 0: training step 6819 done (global step: 13603) | |
1681061817.918412: Worker 0: training step 6820 done (global step: 13605) | |
1681061817.924068: Worker 0: training step 6821 done (global step: 13607) | |
1681061817.928768: Worker 0: training step 6822 done (global step: 13609) | |
1681061817.934714: Worker 0: training step 6823 done (global step: 13611) | |
1681061817.940056: Worker 0: training step 6824 done (global step: 13613) | |
1681061817.946467: Worker 0: training step 6825 done (global step: 13615) | |
1681061817.954127: Worker 0: training step 6826 done (global step: 13617) | |
1681061817.959972: Worker 0: training step 6827 done (global step: 13620) | |
1681061817.965585: Worker 0: training step 6828 done (global step: 13622) | |
1681061817.971110: Worker 0: training step 6829 done (global step: 13624) | |
1681061817.976966: Worker 0: training step 6830 done (global step: 13626) | |
1681061817.984293: Worker 0: training step 6831 done (global step: 13628) | |
1681061817.989441: Worker 0: training step 6832 done (global step: 13631) | |
1681061817.994935: Worker 0: training step 6833 done (global step: 13633) | |
1681061818.000540: Worker 0: training step 6834 done (global step: 13635) | |
1681061818.005930: Worker 0: training step 6835 done (global step: 13637) | |
1681061818.012465: Worker 0: training step 6836 done (global step: 13639) | |
1681061818.017662: Worker 0: training step 6837 done (global step: 13641) | |
1681061818.023040: Worker 0: training step 6838 done (global step: 13643) | |
1681061818.028593: Worker 0: training step 6839 done (global step: 13645) | |
1681061818.033897: Worker 0: training step 6840 done (global step: 13647) | |
1681061818.038971: Worker 0: training step 6841 done (global step: 13649) | |
1681061818.044413: Worker 0: training step 6842 done (global step: 13651) | |
1681061818.050709: Worker 0: training step 6843 done (global step: 13653) | |
1681061818.056064: Worker 0: training step 6844 done (global step: 13655) | |
1681061818.061346: Worker 0: training step 6845 done (global step: 13657) | |
1681061818.067348: Worker 0: training step 6846 done (global step: 13659) | |
1681061818.072834: Worker 0: training step 6847 done (global step: 13661) | |
1681061818.077761: Worker 0: training step 6848 done (global step: 13663) | |
1681061818.083058: Worker 0: training step 6849 done (global step: 13665) | |
1681061818.088588: Worker 0: training step 6850 done (global step: 13667) | |
1681061818.095042: Worker 0: training step 6851 done (global step: 13668) | |
1681061818.100992: Worker 0: training step 6852 done (global step: 13671) | |
1681061818.106397: Worker 0: training step 6853 done (global step: 13673) | |
1681061818.111945: Worker 0: training step 6854 done (global step: 13675) | |
1681061818.117351: Worker 0: training step 6855 done (global step: 13677) | |
1681061818.123024: Worker 0: training step 6856 done (global step: 13679) | |
1681061818.129408: Worker 0: training step 6857 done (global step: 13681) | |
1681061818.139283: Worker 0: training step 6858 done (global step: 13683) | |
1681061818.148693: Worker 0: training step 6859 done (global step: 13686) | |
1681061818.153893: Worker 0: training step 6860 done (global step: 13688) | |
1681061818.161347: Worker 0: training step 6861 done (global step: 13690) | |
1681061818.167043: Worker 0: training step 6862 done (global step: 13692) | |
1681061818.172551: Worker 0: training step 6863 done (global step: 13694) | |
1681061818.178479: Worker 0: training step 6864 done (global step: 13696) | |
1681061818.183933: Worker 0: training step 6865 done (global step: 13698) | |
1681061818.189326: Worker 0: training step 6866 done (global step: 13700) | |
1681061818.194377: Worker 0: training step 6867 done (global step: 13702) | |
1681061818.200027: Worker 0: training step 6868 done (global step: 13704) | |
1681061818.205788: Worker 0: training step 6869 done (global step: 13706) | |
1681061818.210778: Worker 0: training step 6870 done (global step: 13708) | |
1681061818.216696: Worker 0: training step 6871 done (global step: 13710) | |
1681061818.223039: Worker 0: training step 6872 done (global step: 13712) | |
1681061818.230622: Worker 0: training step 6873 done (global step: 13714) | |
1681061818.236675: Worker 0: training step 6874 done (global step: 13715) | |
1681061818.241597: Worker 0: training step 6875 done (global step: 13717) | |
1681061818.246846: Worker 0: training step 6876 done (global step: 13719) | |
1681061818.252273: Worker 0: training step 6877 done (global step: 13721) | |
1681061818.258354: Worker 0: training step 6878 done (global step: 13723) | |
1681061818.264905: Worker 0: training step 6879 done (global step: 13725) | |
1681061818.270515: Worker 0: training step 6880 done (global step: 13727) | |
1681061818.275851: Worker 0: training step 6881 done (global step: 13729) | |
1681061818.281593: Worker 0: training step 6882 done (global step: 13731) | |
1681061818.286938: Worker 0: training step 6883 done (global step: 13733) | |
1681061818.292569: Worker 0: training step 6884 done (global step: 13735) | |
1681061818.298273: Worker 0: training step 6885 done (global step: 13737) | |
1681061818.305210: Worker 0: training step 6886 done (global step: 13739) | |
1681061818.312296: Worker 0: training step 6887 done (global step: 13741) | |
1681061818.318984: Worker 0: training step 6888 done (global step: 13743) | |
1681061818.325738: Worker 0: training step 6889 done (global step: 13745) | |
1681061818.332539: Worker 0: training step 6890 done (global step: 13747) | |
1681061818.338780: Worker 0: training step 6891 done (global step: 13750) | |
1681061818.344089: Worker 0: training step 6892 done (global step: 13752) | |
1681061818.349789: Worker 0: training step 6893 done (global step: 13754) | |
1681061818.355376: Worker 0: training step 6894 done (global step: 13756) | |
1681061818.360477: Worker 0: training step 6895 done (global step: 13758) | |
1681061818.365798: Worker 0: training step 6896 done (global step: 13760) | |
1681061818.371436: Worker 0: training step 6897 done (global step: 13762) | |
1681061818.376878: Worker 0: training step 6898 done (global step: 13764) | |
1681061818.383355: Worker 0: training step 6899 done (global step: 13765) | |
1681061818.388921: Worker 0: training step 6900 done (global step: 13767) | |
1681061818.394756: Worker 0: training step 6901 done (global step: 13769) | |
1681061818.401380: Worker 0: training step 6902 done (global step: 13771) | |
1681061818.407725: Worker 0: training step 6903 done (global step: 13773) | |
1681061818.413999: Worker 0: training step 6904 done (global step: 13776) | |
1681061818.419852: Worker 0: training step 6905 done (global step: 13778) | |
1681061818.425410: Worker 0: training step 6906 done (global step: 13780) | |
1681061818.431390: Worker 0: training step 6907 done (global step: 13782) | |
1681061818.436701: Worker 0: training step 6908 done (global step: 13784) | |
1681061818.443385: Worker 0: training step 6909 done (global step: 13786) | |
1681061818.449349: Worker 0: training step 6910 done (global step: 13788) | |
1681061818.455031: Worker 0: training step 6911 done (global step: 13790) | |
1681061818.461654: Worker 0: training step 6912 done (global step: 13792) | |
1681061818.468809: Worker 0: training step 6913 done (global step: 13794) | |
1681061818.474802: Worker 0: training step 6914 done (global step: 13796) | |
1681061818.480592: Worker 0: training step 6915 done (global step: 13798) | |
1681061818.485540: Worker 0: training step 6916 done (global step: 13800) | |
1681061818.491104: Worker 0: training step 6917 done (global step: 13802) | |
1681061818.496316: Worker 0: training step 6918 done (global step: 13804) | |
1681061818.501839: Worker 0: training step 6919 done (global step: 13806) | |
1681061818.507038: Worker 0: training step 6920 done (global step: 13808) | |
1681061818.512844: Worker 0: training step 6921 done (global step: 13810) | |
1681061818.519937: Worker 0: training step 6922 done (global step: 13812) | |
1681061818.525302: Worker 0: training step 6923 done (global step: 13814) | |
1681061818.531464: Worker 0: training step 6924 done (global step: 13816) | |
1681061818.536510: Worker 0: training step 6925 done (global step: 13818) | |
1681061818.541904: Worker 0: training step 6926 done (global step: 13820) | |
1681061818.546928: Worker 0: training step 6927 done (global step: 13822) | |
1681061818.552761: Worker 0: training step 6928 done (global step: 13824) | |
1681061818.558480: Worker 0: training step 6929 done (global step: 13826) | |
1681061818.563777: Worker 0: training step 6930 done (global step: 13828) | |
1681061818.569597: Worker 0: training step 6931 done (global step: 13830) | |
1681061818.575047: Worker 0: training step 6932 done (global step: 13832) | |
1681061818.580581: Worker 0: training step 6933 done (global step: 13834) | |
1681061818.585428: Worker 0: training step 6934 done (global step: 13835) | |
1681061818.590780: Worker 0: training step 6935 done (global step: 13837) | |
1681061818.598181: Worker 0: training step 6936 done (global step: 13839) | |
1681061818.603833: Worker 0: training step 6937 done (global step: 13842) | |
1681061818.609301: Worker 0: training step 6938 done (global step: 13844) | |
1681061818.614991: Worker 0: training step 6939 done (global step: 13846) | |
1681061818.620792: Worker 0: training step 6940 done (global step: 13848) | |
1681061818.626915: Worker 0: training step 6941 done (global step: 13850) | |
1681061818.633296: Worker 0: training step 6942 done (global step: 13851) | |
1681061818.638233: Worker 0: training step 6943 done (global step: 13853) | |
1681061818.644165: Worker 0: training step 6944 done (global step: 13855) | |
1681061818.650470: Worker 0: training step 6945 done (global step: 13857) | |
1681061818.656835: Worker 0: training step 6946 done (global step: 13860) | |
1681061818.662195: Worker 0: training step 6947 done (global step: 13862) | |
1681061818.667408: Worker 0: training step 6948 done (global step: 13864) | |
1681061818.673108: Worker 0: training step 6949 done (global step: 13866) | |
1681061818.678598: Worker 0: training step 6950 done (global step: 13868) | |
1681061818.683959: Worker 0: training step 6951 done (global step: 13870) | |
1681061818.689840: Worker 0: training step 6952 done (global step: 13872) | |
1681061818.695476: Worker 0: training step 6953 done (global step: 13874) | |
1681061818.700673: Worker 0: training step 6954 done (global step: 13876) | |
1681061818.706030: Worker 0: training step 6955 done (global step: 13878) | |
1681061818.711674: Worker 0: training step 6956 done (global step: 13880) | |
1681061818.716912: Worker 0: training step 6957 done (global step: 13882) | |
1681061818.723684: Worker 0: training step 6958 done (global step: 13884) | |
1681061818.730117: Worker 0: training step 6959 done (global step: 13886) | |
1681061818.735931: Worker 0: training step 6960 done (global step: 13888) | |
1681061818.742350: Worker 0: training step 6961 done (global step: 13890) | |
1681061818.756462: Worker 0: training step 6962 done (global step: 13892) | |
1681061818.767287: Worker 0: training step 6963 done (global step: 13894) | |
1681061818.774241: Worker 0: training step 6964 done (global step: 13896) | |
1681061818.780339: Worker 0: training step 6965 done (global step: 13897) | |
1681061818.786049: Worker 0: training step 6966 done (global step: 13900) | |
1681061818.791813: Worker 0: training step 6967 done (global step: 13901) | |
1681061818.798625: Worker 0: training step 6968 done (global step: 13903) | |
1681061818.804520: Worker 0: training step 6969 done (global step: 13905) | |
1681061818.812402: Worker 0: training step 6970 done (global step: 13907) | |
1681061818.818903: Worker 0: training step 6971 done (global step: 13910) | |
1681061818.824026: Worker 0: training step 6972 done (global step: 13912) | |
1681061818.829181: Worker 0: training step 6973 done (global step: 13914) | |
1681061818.835742: Worker 0: training step 6974 done (global step: 13915) | |
1681061818.841881: Worker 0: training step 6975 done (global step: 13918) | |
1681061818.847892: Worker 0: training step 6976 done (global step: 13920) | |
1681061818.854696: Worker 0: training step 6977 done (global step: 13922) | |
1681061818.860024: Worker 0: training step 6978 done (global step: 13924) | |
1681061818.865966: Worker 0: training step 6979 done (global step: 13926) | |
1681061818.872543: Worker 0: training step 6980 done (global step: 13928) | |
1681061818.878129: Worker 0: training step 6981 done (global step: 13930) | |
1681061818.883321: Worker 0: training step 6982 done (global step: 13932) | |
1681061818.889804: Worker 0: training step 6983 done (global step: 13934) | |
1681061818.897665: Worker 0: training step 6984 done (global step: 13936) | |
1681061818.904717: Worker 0: training step 6985 done (global step: 13938) | |
1681061818.909733: Worker 0: training step 6986 done (global step: 13940) | |
1681061818.915277: Worker 0: training step 6987 done (global step: 13942) | |
1681061818.921725: Worker 0: training step 6988 done (global step: 13944) | |
1681061818.927424: Worker 0: training step 6989 done (global step: 13946) | |
1681061818.933756: Worker 0: training step 6990 done (global step: 13948) | |
1681061818.940727: Worker 0: training step 6991 done (global step: 13950) | |
1681061818.945868: Worker 0: training step 6992 done (global step: 13952) | |
1681061818.952123: Worker 0: training step 6993 done (global step: 13954) | |
1681061818.959202: Worker 0: training step 6994 done (global step: 13956) | |
1681061818.965085: Worker 0: training step 6995 done (global step: 13958) | |
1681061818.971205: Worker 0: training step 6996 done (global step: 13960) | |
1681061818.979111: Worker 0: training step 6997 done (global step: 13962) | |
1681061818.984515: Worker 0: training step 6998 done (global step: 13965) | |
1681061818.990191: Worker 0: training step 6999 done (global step: 13967) | |
1681061818.995784: Worker 0: training step 7000 done (global step: 13968) | |
1681061819.001005: Worker 0: training step 7001 done (global step: 13970) | |
1681061819.007055: Worker 0: training step 7002 done (global step: 13972) | |
1681061819.011503: Worker 0: training step 7003 done (global step: 13974) | |
1681061819.016942: Worker 0: training step 7004 done (global step: 13976) | |
1681061819.022750: Worker 0: training step 7005 done (global step: 13978) | |
1681061819.029490: Worker 0: training step 7006 done (global step: 13980) | |
1681061819.035654: Worker 0: training step 7007 done (global step: 13982) | |
1681061819.040430: Worker 0: training step 7008 done (global step: 13984) | |
1681061819.046077: Worker 0: training step 7009 done (global step: 13986) | |
1681061819.051631: Worker 0: training step 7010 done (global step: 13988) | |
1681061819.057079: Worker 0: training step 7011 done (global step: 13990) | |
1681061819.062987: Worker 0: training step 7012 done (global step: 13992) | |
1681061819.069008: Worker 0: training step 7013 done (global step: 13994) | |
1681061819.075720: Worker 0: training step 7014 done (global step: 13996) | |
1681061819.081478: Worker 0: training step 7015 done (global step: 13998) | |
1681061819.087698: Worker 0: training step 7016 done (global step: 14000) | |
1681061819.093703: Worker 0: training step 7017 done (global step: 14002) | |
1681061819.099161: Worker 0: training step 7018 done (global step: 14004) | |
1681061819.104122: Worker 0: training step 7019 done (global step: 14006) | |
1681061819.111162: Worker 0: training step 7020 done (global step: 14008) | |
1681061819.118482: Worker 0: training step 7021 done (global step: 14010) | |
1681061819.130769: Worker 0: training step 7022 done (global step: 14012) | |
1681061819.143857: Worker 0: training step 7023 done (global step: 14014) | |
1681061819.152722: Worker 0: training step 7024 done (global step: 14016) | |
1681061819.162284: Worker 0: training step 7025 done (global step: 14018) | |
1681061819.172954: Worker 0: training step 7026 done (global step: 14020) | |
1681061819.180203: Worker 0: training step 7027 done (global step: 14022) | |
1681061819.188021: Worker 0: training step 7028 done (global step: 14024) | |
1681061819.197685: Worker 0: training step 7029 done (global step: 14026) | |
1681061819.207537: Worker 0: training step 7030 done (global step: 14029) | |
1681061819.215039: Worker 0: training step 7031 done (global step: 14030) | |
1681061819.221315: Worker 0: training step 7032 done (global step: 14032) | |
1681061819.230078: Worker 0: training step 7033 done (global step: 14034) | |
1681061819.236534: Worker 0: training step 7034 done (global step: 14036) | |
1681061819.248171: Worker 0: training step 7035 done (global step: 14038) | |
1681061819.255939: Worker 0: training step 7036 done (global step: 14040) | |
1681061819.266690: Worker 0: training step 7037 done (global step: 14043) | |
1681061819.273130: Worker 0: training step 7038 done (global step: 14045) | |
1681061819.279402: Worker 0: training step 7039 done (global step: 14047) | |
1681061819.285048: Worker 0: training step 7040 done (global step: 14049) | |
1681061819.291005: Worker 0: training step 7041 done (global step: 14051) | |
1681061819.298483: Worker 0: training step 7042 done (global step: 14053) | |
1681061819.304349: Worker 0: training step 7043 done (global step: 14055) | |
1681061819.310851: Worker 0: training step 7044 done (global step: 14057) | |
1681061819.315726: Worker 0: training step 7045 done (global step: 14058) | |
1681061819.322205: Worker 0: training step 7046 done (global step: 14060) | |
1681061819.328986: Worker 0: training step 7047 done (global step: 14063) | |
1681061819.335113: Worker 0: training step 7048 done (global step: 14064) | |
1681061819.339347: Worker 0: training step 7049 done (global step: 14066) | |
1681061819.345232: Worker 0: training step 7050 done (global step: 14068) | |
1681061819.350544: Worker 0: training step 7051 done (global step: 14070) | |
1681061819.355654: Worker 0: training step 7052 done (global step: 14072) | |
1681061819.363023: Worker 0: training step 7053 done (global step: 14074) | |
1681061819.369009: Worker 0: training step 7054 done (global step: 14076) | |
1681061819.374317: Worker 0: training step 7055 done (global step: 14078) | |
1681061819.379749: Worker 0: training step 7056 done (global step: 14080) | |
1681061819.385363: Worker 0: training step 7057 done (global step: 14082) | |
1681061819.391929: Worker 0: training step 7058 done (global step: 14084) | |
1681061819.397822: Worker 0: training step 7059 done (global step: 14086) | |
1681061819.403064: Worker 0: training step 7060 done (global step: 14088) | |
1681061819.408668: Worker 0: training step 7061 done (global step: 14090) | |
1681061819.413506: Worker 0: training step 7062 done (global step: 14091) | |
1681061819.420510: Worker 0: training step 7063 done (global step: 14093) | |
1681061819.425407: Worker 0: training step 7064 done (global step: 14096) | |
1681061819.433137: Worker 0: training step 7065 done (global step: 14097) | |
1681061819.439089: Worker 0: training step 7066 done (global step: 14099) | |
1681061819.443438: Worker 0: training step 7067 done (global step: 14101) | |
1681061819.448707: Worker 0: training step 7068 done (global step: 14103) | |
1681061819.454346: Worker 0: training step 7069 done (global step: 14105) | |
1681061819.459431: Worker 0: training step 7070 done (global step: 14107) | |
1681061819.466279: Worker 0: training step 7071 done (global step: 14109) | |
1681061819.471757: Worker 0: training step 7072 done (global step: 14111) | |
1681061819.477848: Worker 0: training step 7073 done (global step: 14113) | |
1681061819.483675: Worker 0: training step 7074 done (global step: 14115) | |
1681061819.488514: Worker 0: training step 7075 done (global step: 14117) | |
1681061819.493526: Worker 0: training step 7076 done (global step: 14118) | |
1681061819.498655: Worker 0: training step 7077 done (global step: 14120) | |
1681061819.503646: Worker 0: training step 7078 done (global step: 14122) | |
1681061819.508277: Worker 0: training step 7079 done (global step: 14124) | |
1681061819.515397: Worker 0: training step 7080 done (global step: 14126) | |
1681061819.521345: Worker 0: training step 7081 done (global step: 14128) | |
1681061819.527453: Worker 0: training step 7082 done (global step: 14130) | |
1681061819.533704: Worker 0: training step 7083 done (global step: 14132) | |
1681061819.539489: Worker 0: training step 7084 done (global step: 14134) | |
1681061819.544992: Worker 0: training step 7085 done (global step: 14136) | |
1681061819.551703: Worker 0: training step 7086 done (global step: 14138) | |
1681061819.558063: Worker 0: training step 7087 done (global step: 14140) | |
1681061819.564916: Worker 0: training step 7088 done (global step: 14142) | |
1681061819.570436: Worker 0: training step 7089 done (global step: 14144) | |
1681061819.576031: Worker 0: training step 7090 done (global step: 14146) | |
1681061819.582023: Worker 0: training step 7091 done (global step: 14148) | |
1681061819.587865: Worker 0: training step 7092 done (global step: 14150) | |
1681061819.593953: Worker 0: training step 7093 done (global step: 14152) | |
1681061819.599665: Worker 0: training step 7094 done (global step: 14154) | |
1681061819.605063: Worker 0: training step 7095 done (global step: 14156) | |
1681061819.611301: Worker 0: training step 7096 done (global step: 14158) | |
1681061819.616625: Worker 0: training step 7097 done (global step: 14160) | |
1681061819.623217: Worker 0: training step 7098 done (global step: 14162) | |
1681061819.629238: Worker 0: training step 7099 done (global step: 14164) | |
1681061819.635270: Worker 0: training step 7100 done (global step: 14166) | |
1681061819.641265: Worker 0: training step 7101 done (global step: 14168) | |
1681061819.647776: Worker 0: training step 7102 done (global step: 14170) | |
1681061819.653561: Worker 0: training step 7103 done (global step: 14172) | |
1681061819.660185: Worker 0: training step 7104 done (global step: 14174) | |
1681061819.665766: Worker 0: training step 7105 done (global step: 14176) | |
1681061819.671218: Worker 0: training step 7106 done (global step: 14178) | |
1681061819.677045: Worker 0: training step 7107 done (global step: 14180) | |
1681061819.683084: Worker 0: training step 7108 done (global step: 14182) | |
1681061819.688879: Worker 0: training step 7109 done (global step: 14184) | |
1681061819.694052: Worker 0: training step 7110 done (global step: 14186) | |
1681061819.701684: Worker 0: training step 7111 done (global step: 14188) | |
1681061819.707090: Worker 0: training step 7112 done (global step: 14191) | |
1681061819.711889: Worker 0: training step 7113 done (global step: 14193) | |
1681061819.717323: Worker 0: training step 7114 done (global step: 14194) | |
1681061819.722795: Worker 0: training step 7115 done (global step: 14196) | |
1681061819.730196: Worker 0: training step 7116 done (global step: 14199) | |
1681061819.736447: Worker 0: training step 7117 done (global step: 14201) | |
1681061819.741270: Worker 0: training step 7118 done (global step: 14203) | |
1681061819.748121: Worker 0: training step 7119 done (global step: 14205) | |
1681061819.753558: Worker 0: training step 7120 done (global step: 14207) | |
1681061819.760495: Worker 0: training step 7121 done (global step: 14209) | |
1681061819.765992: Worker 0: training step 7122 done (global step: 14211) | |
1681061819.771336: Worker 0: training step 7123 done (global step: 14213) | |
1681061819.776247: Worker 0: training step 7124 done (global step: 14215) | |
1681061819.782486: Worker 0: training step 7125 done (global step: 14217) | |
1681061819.788629: Worker 0: training step 7126 done (global step: 14219) | |
1681061819.794313: Worker 0: training step 7127 done (global step: 14221) | |
1681061819.799838: Worker 0: training step 7128 done (global step: 14223) | |
1681061819.805335: Worker 0: training step 7129 done (global step: 14225) | |
1681061819.810913: Worker 0: training step 7130 done (global step: 14227) | |
1681061819.816233: Worker 0: training step 7131 done (global step: 14229) | |
1681061819.822062: Worker 0: training step 7132 done (global step: 14231) | |
1681061819.827660: Worker 0: training step 7133 done (global step: 14233) | |
1681061819.832536: Worker 0: training step 7134 done (global step: 14235) | |
1681061819.838136: Worker 0: training step 7135 done (global step: 14237) | |
1681061819.843459: Worker 0: training step 7136 done (global step: 14238) | |
1681061819.847666: Worker 0: training step 7137 done (global step: 14240) | |
1681061819.854006: Worker 0: training step 7138 done (global step: 14242) | |
1681061819.860803: Worker 0: training step 7139 done (global step: 14244) | |
1681061819.867156: Worker 0: training step 7140 done (global step: 14247) | |
1681061819.872908: Worker 0: training step 7141 done (global step: 14249) | |
1681061819.878439: Worker 0: training step 7142 done (global step: 14251) | |
1681061819.884588: Worker 0: training step 7143 done (global step: 14253) | |
1681061819.891261: Worker 0: training step 7144 done (global step: 14255) | |
1681061819.896735: Worker 0: training step 7145 done (global step: 14257) | |
1681061819.901884: Worker 0: training step 7146 done (global step: 14259) | |
1681061819.907476: Worker 0: training step 7147 done (global step: 14261) | |
1681061819.913774: Worker 0: training step 7148 done (global step: 14263) | |
1681061819.919623: Worker 0: training step 7149 done (global step: 14265) | |
1681061819.925022: Worker 0: training step 7150 done (global step: 14267) | |
1681061820.076634: Worker 0: training step 7151 done (global step: 14293) | |
1681061820.080930: Worker 0: training step 7152 done (global step: 14294) | |
1681061820.085550: Worker 0: training step 7153 done (global step: 14295) | |
1681061820.089930: Worker 0: training step 7154 done (global step: 14296) | |
1681061820.094420: Worker 0: training step 7155 done (global step: 14297) | |
1681061820.098599: Worker 0: training step 7156 done (global step: 14298) | |
1681061820.103174: Worker 0: training step 7157 done (global step: 14299) | |
1681061820.107861: Worker 0: training step 7158 done (global step: 14300) | |
1681061820.112296: Worker 0: training step 7159 done (global step: 14301) | |
1681061820.117033: Worker 0: training step 7160 done (global step: 14302) | |
1681061820.121919: Worker 0: training step 7161 done (global step: 14303) | |
1681061820.126447: Worker 0: training step 7162 done (global step: 14304) | |
1681061820.133487: Worker 0: training step 7163 done (global step: 14305) | |
1681061820.139516: Worker 0: training step 7164 done (global step: 14306) | |
1681061820.147346: Worker 0: training step 7165 done (global step: 14307) | |
1681061820.161006: Worker 0: training step 7166 done (global step: 14308) | |
1681061820.171982: Worker 0: training step 7167 done (global step: 14309) | |
1681061820.177583: Worker 0: training step 7168 done (global step: 14310) | |
1681061820.185219: Worker 0: training step 7169 done (global step: 14311) | |
1681061820.191267: Worker 0: training step 7170 done (global step: 14312) | |
1681061820.197651: Worker 0: training step 7171 done (global step: 14313) | |
1681061820.205070: Worker 0: training step 7172 done (global step: 14314) | |
1681061820.214297: Worker 0: training step 7173 done (global step: 14315) | |
1681061820.224125: Worker 0: training step 7174 done (global step: 14318) | |
1681061820.231682: Worker 0: training step 7175 done (global step: 14320) | |
1681061820.249568: Worker 0: training step 7176 done (global step: 14322) | |
1681061820.261930: Worker 0: training step 7177 done (global step: 14324) | |
1681061820.268243: Worker 0: training step 7178 done (global step: 14326) | |
1681061820.275166: Worker 0: training step 7179 done (global step: 14328) | |
1681061820.281776: Worker 0: training step 7180 done (global step: 14330) | |
1681061820.287477: Worker 0: training step 7181 done (global step: 14332) | |
1681061820.292109: Worker 0: training step 7182 done (global step: 14334) | |
1681061820.299193: Worker 0: training step 7183 done (global step: 14336) | |
1681061820.304985: Worker 0: training step 7184 done (global step: 14338) | |
1681061820.318134: Worker 0: training step 7185 done (global step: 14340) | |
1681061820.323125: Worker 0: training step 7186 done (global step: 14342) | |
1681061820.328422: Worker 0: training step 7187 done (global step: 14344) | |
1681061820.333530: Worker 0: training step 7188 done (global step: 14346) | |
1681061820.339291: Worker 0: training step 7189 done (global step: 14348) | |
1681061820.344947: Worker 0: training step 7190 done (global step: 14350) | |
1681061820.350571: Worker 0: training step 7191 done (global step: 14352) | |
1681061820.357879: Worker 0: training step 7192 done (global step: 14354) | |
1681061820.364882: Worker 0: training step 7193 done (global step: 14356) | |
1681061820.372422: Worker 0: training step 7194 done (global step: 14358) | |
1681061820.378117: Worker 0: training step 7195 done (global step: 14360) | |
1681061820.384039: Worker 0: training step 7196 done (global step: 14362) | |
1681061820.391245: Worker 0: training step 7197 done (global step: 14364) | |
1681061820.396595: Worker 0: training step 7198 done (global step: 14366) | |
1681061820.402849: Worker 0: training step 7199 done (global step: 14368) | |
1681061820.408225: Worker 0: training step 7200 done (global step: 14370) | |
1681061820.413939: Worker 0: training step 7201 done (global step: 14372) | |
1681061820.419108: Worker 0: training step 7202 done (global step: 14374) | |
1681061820.424382: Worker 0: training step 7203 done (global step: 14376) | |
1681061820.429823: Worker 0: training step 7204 done (global step: 14378) | |
1681061820.435097: Worker 0: training step 7205 done (global step: 14380) | |
1681061820.441570: Worker 0: training step 7206 done (global step: 14382) | |
1681061820.448477: Worker 0: training step 7207 done (global step: 14384) | |
1681061820.453470: Worker 0: training step 7208 done (global step: 14386) | |
1681061820.463222: Worker 0: training step 7209 done (global step: 14388) | |
1681061820.477037: Worker 0: training step 7210 done (global step: 14390) | |
1681061820.487504: Worker 0: training step 7211 done (global step: 14392) | |
1681061820.495078: Worker 0: training step 7212 done (global step: 14394) | |
1681061820.500924: Worker 0: training step 7213 done (global step: 14396) | |
1681061820.507283: Worker 0: training step 7214 done (global step: 14398) | |
1681061820.512970: Worker 0: training step 7215 done (global step: 14400) | |
1681061820.518978: Worker 0: training step 7216 done (global step: 14402) | |
1681061820.525778: Worker 0: training step 7217 done (global step: 14403) | |
1681061820.531741: Worker 0: training step 7218 done (global step: 14406) | |
1681061820.537484: Worker 0: training step 7219 done (global step: 14408) | |
1681061820.542823: Worker 0: training step 7220 done (global step: 14410) | |
1681061820.547915: Worker 0: training step 7221 done (global step: 14412) | |
1681061820.554143: Worker 0: training step 7222 done (global step: 14414) | |
1681061820.558960: Worker 0: training step 7223 done (global step: 14416) | |
1681061820.564198: Worker 0: training step 7224 done (global step: 14418) | |
1681061820.569478: Worker 0: training step 7225 done (global step: 14420) | |
1681061820.575503: Worker 0: training step 7226 done (global step: 14422) | |
1681061820.580859: Worker 0: training step 7227 done (global step: 14423) | |
1681061820.586279: Worker 0: training step 7228 done (global step: 14425) | |
1681061820.591653: Worker 0: training step 7229 done (global step: 14427) | |
1681061820.597373: Worker 0: training step 7230 done (global step: 14429) | |
1681061820.602538: Worker 0: training step 7231 done (global step: 14431) | |
1681061820.607337: Worker 0: training step 7232 done (global step: 14433) | |
1681061820.614173: Worker 0: training step 7233 done (global step: 14435) | |
1681061820.618255: Worker 0: training step 7234 done (global step: 14437) | |
1681061820.623656: Worker 0: training step 7235 done (global step: 14439) | |
1681061820.629252: Worker 0: training step 7236 done (global step: 14441) | |
1681061820.635141: Worker 0: training step 7237 done (global step: 14443) | |
1681061820.640230: Worker 0: training step 7238 done (global step: 14445) | |
1681061820.645576: Worker 0: training step 7239 done (global step: 14447) | |
1681061820.651175: Worker 0: training step 7240 done (global step: 14449) | |
1681061820.655966: Worker 0: training step 7241 done (global step: 14451) | |
1681061820.661106: Worker 0: training step 7242 done (global step: 14453) | |
1681061820.668542: Worker 0: training step 7243 done (global step: 14455) | |
1681061820.675965: Worker 0: training step 7244 done (global step: 14457) | |
1681061820.682769: Worker 0: training step 7245 done (global step: 14459) | |
1681061820.688222: Worker 0: training step 7246 done (global step: 14461) | |
1681061820.693572: Worker 0: training step 7247 done (global step: 14463) | |
1681061820.699315: Worker 0: training step 7248 done (global step: 14465) | |
1681061820.704844: Worker 0: training step 7249 done (global step: 14467) | |
1681061820.710146: Worker 0: training step 7250 done (global step: 14469) | |
1681061820.716638: Worker 0: training step 7251 done (global step: 14471) | |
1681061820.722642: Worker 0: training step 7252 done (global step: 14473) | |
1681061820.728787: Worker 0: training step 7253 done (global step: 14475) | |
1681061820.735130: Worker 0: training step 7254 done (global step: 14477) | |
1681061820.740686: Worker 0: training step 7255 done (global step: 14479) | |
1681061820.745957: Worker 0: training step 7256 done (global step: 14481) | |
1681061820.751081: Worker 0: training step 7257 done (global step: 14483) | |
1681061820.756564: Worker 0: training step 7258 done (global step: 14485) | |
1681061820.762410: Worker 0: training step 7259 done (global step: 14487) | |
1681061820.767889: Worker 0: training step 7260 done (global step: 14489) | |
1681061820.772826: Worker 0: training step 7261 done (global step: 14491) | |
1681061820.778518: Worker 0: training step 7262 done (global step: 14493) | |
1681061820.784085: Worker 0: training step 7263 done (global step: 14495) | |
1681061820.789505: Worker 0: training step 7264 done (global step: 14497) | |
1681061820.794857: Worker 0: training step 7265 done (global step: 14499) | |
1681061820.800940: Worker 0: training step 7266 done (global step: 14501) | |
1681061820.806105: Worker 0: training step 7267 done (global step: 14503) | |
1681061820.814738: Worker 0: training step 7268 done (global step: 14505) | |
1681061820.819589: Worker 0: training step 7269 done (global step: 14507) | |
1681061820.825481: Worker 0: training step 7270 done (global step: 14509) | |
1681061820.830549: Worker 0: training step 7271 done (global step: 14511) | |
1681061820.836063: Worker 0: training step 7272 done (global step: 14513) | |
1681061820.841392: Worker 0: training step 7273 done (global step: 14515) | |
1681061820.846740: Worker 0: training step 7274 done (global step: 14517) | |
1681061820.851918: Worker 0: training step 7275 done (global step: 14519) | |
1681061820.857463: Worker 0: training step 7276 done (global step: 14521) | |
1681061820.862787: Worker 0: training step 7277 done (global step: 14523) | |
1681061820.868546: Worker 0: training step 7278 done (global step: 14525) | |
1681061820.875105: Worker 0: training step 7279 done (global step: 14527) | |
1681061820.880987: Worker 0: training step 7280 done (global step: 14529) | |
1681061820.887590: Worker 0: training step 7281 done (global step: 14532) | |
1681061820.892540: Worker 0: training step 7282 done (global step: 14534) | |
1681061820.898780: Worker 0: training step 7283 done (global step: 14536) | |
1681061820.909301: Worker 0: training step 7284 done (global step: 14538) | |
1681061820.918696: Worker 0: training step 7285 done (global step: 14539) | |
1681061820.927716: Worker 0: training step 7286 done (global step: 14541) | |
1681061820.934680: Worker 0: training step 7287 done (global step: 14543) | |
1681061820.940657: Worker 0: training step 7288 done (global step: 14545) | |
1681061820.947402: Worker 0: training step 7289 done (global step: 14547) | |
1681061820.954003: Worker 0: training step 7290 done (global step: 14549) | |
1681061820.959569: Worker 0: training step 7291 done (global step: 14551) | |
1681061820.966048: Worker 0: training step 7292 done (global step: 14553) | |
1681061820.970827: Worker 0: training step 7293 done (global step: 14555) | |
1681061820.976306: Worker 0: training step 7294 done (global step: 14557) | |
1681061820.982495: Worker 0: training step 7295 done (global step: 14559) | |
1681061820.989403: Worker 0: training step 7296 done (global step: 14561) | |
1681061820.995474: Worker 0: training step 7297 done (global step: 14563) | |
1681061821.002017: Worker 0: training step 7298 done (global step: 14565) | |
1681061821.007323: Worker 0: training step 7299 done (global step: 14567) | |
1681061821.013733: Worker 0: training step 7300 done (global step: 14568) | |
1681061821.019177: Worker 0: training step 7301 done (global step: 14571) | |
1681061821.025118: Worker 0: training step 7302 done (global step: 14572) | |
1681061821.030365: Worker 0: training step 7303 done (global step: 14574) | |
1681061821.036395: Worker 0: training step 7304 done (global step: 14576) | |
1681061821.042201: Worker 0: training step 7305 done (global step: 14578) | |
1681061821.047674: Worker 0: training step 7306 done (global step: 14580) | |
1681061821.055075: Worker 0: training step 7307 done (global step: 14582) | |
1681061821.060881: Worker 0: training step 7308 done (global step: 14584) | |
1681061821.066689: Worker 0: training step 7309 done (global step: 14586) | |
1681061821.071683: Worker 0: training step 7310 done (global step: 14588) | |
1681061821.078084: Worker 0: training step 7311 done (global step: 14590) | |
1681061821.083169: Worker 0: training step 7312 done (global step: 14592) | |
1681061821.090060: Worker 0: training step 7313 done (global step: 14594) | |
1681061821.095885: Worker 0: training step 7314 done (global step: 14596) | |
1681061821.101531: Worker 0: training step 7315 done (global step: 14598) | |
1681061821.106959: Worker 0: training step 7316 done (global step: 14600) | |
1681061821.112489: Worker 0: training step 7317 done (global step: 14602) | |
1681061821.119070: Worker 0: training step 7318 done (global step: 14604) | |
1681061821.124992: Worker 0: training step 7319 done (global step: 14606) | |
1681061821.130375: Worker 0: training step 7320 done (global step: 14608) | |
1681061821.135518: Worker 0: training step 7321 done (global step: 14610) | |
1681061821.140940: Worker 0: training step 7322 done (global step: 14612) | |
1681061821.146785: Worker 0: training step 7323 done (global step: 14614) | |
1681061821.152201: Worker 0: training step 7324 done (global step: 14616) | |
1681061821.159029: Worker 0: training step 7325 done (global step: 14618) | |
1681061821.164773: Worker 0: training step 7326 done (global step: 14620) | |
1681061821.170719: Worker 0: training step 7327 done (global step: 14622) | |
1681061821.176088: Worker 0: training step 7328 done (global step: 14624) | |
1681061821.181986: Worker 0: training step 7329 done (global step: 14626) | |
1681061821.187915: Worker 0: training step 7330 done (global step: 14628) | |
1681061821.193663: Worker 0: training step 7331 done (global step: 14630) | |
1681061821.199015: Worker 0: training step 7332 done (global step: 14632) | |
1681061821.204521: Worker 0: training step 7333 done (global step: 14633) | |
1681061821.209756: Worker 0: training step 7334 done (global step: 14635) | |
1681061821.215153: Worker 0: training step 7335 done (global step: 14637) | |
1681061821.221191: Worker 0: training step 7336 done (global step: 14639) | |
1681061821.227972: Worker 0: training step 7337 done (global step: 14641) | |
1681061821.234341: Worker 0: training step 7338 done (global step: 14644) | |
1681061821.239865: Worker 0: training step 7339 done (global step: 14646) | |
1681061821.244583: Worker 0: training step 7340 done (global step: 14647) | |
1681061821.250958: Worker 0: training step 7341 done (global step: 14649) | |
1681061821.256744: Worker 0: training step 7342 done (global step: 14651) | |
1681061821.263496: Worker 0: training step 7343 done (global step: 14653) | |
1681061821.269853: Worker 0: training step 7344 done (global step: 14655) | |
1681061821.275212: Worker 0: training step 7345 done (global step: 14657) | |
1681061821.280813: Worker 0: training step 7346 done (global step: 14659) | |
1681061821.286406: Worker 0: training step 7347 done (global step: 14661) | |
1681061821.291830: Worker 0: training step 7348 done (global step: 14663) | |
1681061821.297792: Worker 0: training step 7349 done (global step: 14665) | |
1681061821.304541: Worker 0: training step 7350 done (global step: 14667) | |
1681061821.311796: Worker 0: training step 7351 done (global step: 14669) | |
1681061821.317229: Worker 0: training step 7352 done (global step: 14671) | |
1681061821.322888: Worker 0: training step 7353 done (global step: 14673) | |
1681061821.329271: Worker 0: training step 7354 done (global step: 14675) | |
1681061821.335782: Worker 0: training step 7355 done (global step: 14677) | |
1681061821.341555: Worker 0: training step 7356 done (global step: 14679) | |
1681061821.347410: Worker 0: training step 7357 done (global step: 14681) | |
1681061821.352936: Worker 0: training step 7358 done (global step: 14683) | |
1681061821.358010: Worker 0: training step 7359 done (global step: 14685) | |
1681061821.364645: Worker 0: training step 7360 done (global step: 14687) | |
1681061821.370280: Worker 0: training step 7361 done (global step: 14689) | |
1681061821.375764: Worker 0: training step 7362 done (global step: 14691) | |
1681061821.381524: Worker 0: training step 7363 done (global step: 14693) | |
1681061821.386554: Worker 0: training step 7364 done (global step: 14695) | |
1681061821.391746: Worker 0: training step 7365 done (global step: 14697) | |
1681061821.398449: Worker 0: training step 7366 done (global step: 14699) | |
1681061821.404170: Worker 0: training step 7367 done (global step: 14701) | |
1681061821.410295: Worker 0: training step 7368 done (global step: 14703) | |
1681061821.415477: Worker 0: training step 7369 done (global step: 14705) | |
1681061821.421064: Worker 0: training step 7370 done (global step: 14707) | |
1681061821.426797: Worker 0: training step 7371 done (global step: 14709) | |
1681061821.434066: Worker 0: training step 7372 done (global step: 14711) | |
1681061821.439755: Worker 0: training step 7373 done (global step: 14713) | |
1681061821.445694: Worker 0: training step 7374 done (global step: 14715) | |
1681061821.451544: Worker 0: training step 7375 done (global step: 14717) | |
1681061821.457746: Worker 0: training step 7376 done (global step: 14719) | |
1681061821.464706: Worker 0: training step 7377 done (global step: 14721) | |
1681061821.470242: Worker 0: training step 7378 done (global step: 14723) | |
1681061821.475906: Worker 0: training step 7379 done (global step: 14725) | |
1681061821.481189: Worker 0: training step 7380 done (global step: 14727) | |
1681061821.486431: Worker 0: training step 7381 done (global step: 14729) | |
1681061821.492118: Worker 0: training step 7382 done (global step: 14731) | |
1681061821.499056: Worker 0: training step 7383 done (global step: 14733) | |
1681061821.504693: Worker 0: training step 7384 done (global step: 14735) | |
1681061821.510076: Worker 0: training step 7385 done (global step: 14737) | |
1681061821.515674: Worker 0: training step 7386 done (global step: 14739) | |
1681061821.520791: Worker 0: training step 7387 done (global step: 14741) | |
1681061821.526307: Worker 0: training step 7388 done (global step: 14743) | |
1681061821.531802: Worker 0: training step 7389 done (global step: 14745) | |
1681061821.537230: Worker 0: training step 7390 done (global step: 14747) | |
1681061821.543034: Worker 0: training step 7391 done (global step: 14749) | |
1681061821.547997: Worker 0: training step 7392 done (global step: 14751) | |
1681061821.552912: Worker 0: training step 7393 done (global step: 14753) | |
1681061821.558532: Worker 0: training step 7394 done (global step: 14754) | |
1681061821.563572: Worker 0: training step 7395 done (global step: 14756) | |
1681061821.569163: Worker 0: training step 7396 done (global step: 14758) | |
1681061821.574422: Worker 0: training step 7397 done (global step: 14760) | |
1681061821.581026: Worker 0: training step 7398 done (global step: 14762) | |
1681061821.585865: Worker 0: training step 7399 done (global step: 14765) | |
1681061821.590893: Worker 0: training step 7400 done (global step: 14766) | |
1681061821.597316: Worker 0: training step 7401 done (global step: 14768) | |
1681061821.603714: Worker 0: training step 7402 done (global step: 14771) | |
1681061821.609343: Worker 0: training step 7403 done (global step: 14773) | |
1681061821.614894: Worker 0: training step 7404 done (global step: 14775) | |
1681061821.620001: Worker 0: training step 7405 done (global step: 14777) | |
1681061821.625416: Worker 0: training step 7406 done (global step: 14779) | |
1681061821.630580: Worker 0: training step 7407 done (global step: 14781) | |
1681061821.635831: Worker 0: training step 7408 done (global step: 14783) | |
1681061821.642171: Worker 0: training step 7409 done (global step: 14785) | |
1681061821.647562: Worker 0: training step 7410 done (global step: 14787) | |
1681061821.653196: Worker 0: training step 7411 done (global step: 14789) | |
1681061821.658843: Worker 0: training step 7412 done (global step: 14791) | |
1681061821.664412: Worker 0: training step 7413 done (global step: 14793) | |
1681061821.670214: Worker 0: training step 7414 done (global step: 14795) | |
1681061821.675850: Worker 0: training step 7415 done (global step: 14797) | |
1681061821.682354: Worker 0: training step 7416 done (global step: 14799) | |
1681061821.687912: Worker 0: training step 7417 done (global step: 14801) | |
1681061821.693803: Worker 0: training step 7418 done (global step: 14803) | |
1681061821.699702: Worker 0: training step 7419 done (global step: 14805) | |
1681061821.705442: Worker 0: training step 7420 done (global step: 14807) | |
1681061821.712824: Worker 0: training step 7421 done (global step: 14809) | |
1681061821.719465: Worker 0: training step 7422 done (global step: 14811) | |
1681061821.725518: Worker 0: training step 7423 done (global step: 14813) | |
1681061821.734246: Worker 0: training step 7424 done (global step: 14814) | |
1681061821.738738: Worker 0: training step 7425 done (global step: 14817) | |
1681061821.743377: Worker 0: training step 7426 done (global step: 14818) | |
1681061821.748964: Worker 0: training step 7427 done (global step: 14820) | |
1681061821.754965: Worker 0: training step 7428 done (global step: 14822) | |
1681061821.760749: Worker 0: training step 7429 done (global step: 14824) | |
1681061821.766119: Worker 0: training step 7430 done (global step: 14826) | |
1681061821.771730: Worker 0: training step 7431 done (global step: 14828) | |
1681061821.778402: Worker 0: training step 7432 done (global step: 14830) | |
1681061821.783781: Worker 0: training step 7433 done (global step: 14832) | |
1681061821.788882: Worker 0: training step 7434 done (global step: 14834) | |
1681061821.794338: Worker 0: training step 7435 done (global step: 14836) | |
1681061821.801117: Worker 0: training step 7436 done (global step: 14838) | |
1681061821.806257: Worker 0: training step 7437 done (global step: 14840) | |
1681061821.811529: Worker 0: training step 7438 done (global step: 14842) | |
1681061821.817691: Worker 0: training step 7439 done (global step: 14844) | |
1681061821.823218: Worker 0: training step 7440 done (global step: 14846) | |
1681061821.828033: Worker 0: training step 7441 done (global step: 14848) | |
1681061821.832797: Worker 0: training step 7442 done (global step: 14850) | |
1681061821.838099: Worker 0: training step 7443 done (global step: 14851) | |
1681061821.842961: Worker 0: training step 7444 done (global step: 14853) | |
1681061821.848692: Worker 0: training step 7445 done (global step: 14855) | |
1681061821.854662: Worker 0: training step 7446 done (global step: 14858) | |
1681061821.860835: Worker 0: training step 7447 done (global step: 14860) | |
1681061821.867644: Worker 0: training step 7448 done (global step: 14862) | |
1681061821.873434: Worker 0: training step 7449 done (global step: 14864) | |
1681061821.878978: Worker 0: training step 7450 done (global step: 14866) | |
1681061821.885175: Worker 0: training step 7451 done (global step: 14868) | |
1681061821.890855: Worker 0: training step 7452 done (global step: 14870) | |
1681061821.898759: Worker 0: training step 7453 done (global step: 14872) | |
1681061821.904763: Worker 0: training step 7454 done (global step: 14874) | |
1681061821.910535: Worker 0: training step 7455 done (global step: 14876) | |
1681061821.916378: Worker 0: training step 7456 done (global step: 14878) | |
1681061821.921914: Worker 0: training step 7457 done (global step: 14880) | |
1681061821.927739: Worker 0: training step 7458 done (global step: 14882) | |
1681061821.933180: Worker 0: training step 7459 done (global step: 14884) | |
1681061821.938327: Worker 0: training step 7460 done (global step: 14886) | |
1681061821.946104: Worker 0: training step 7461 done (global step: 14888) | |
1681061821.951714: Worker 0: training step 7462 done (global step: 14890) | |
1681061821.956937: Worker 0: training step 7463 done (global step: 14892) | |
1681061821.962599: Worker 0: training step 7464 done (global step: 14894) | |
1681061821.968910: Worker 0: training step 7465 done (global step: 14896) | |
1681061821.974847: Worker 0: training step 7466 done (global step: 14898) | |
1681061821.982225: Worker 0: training step 7467 done (global step: 14900) | |
1681061821.989459: Worker 0: training step 7468 done (global step: 14902) | |
1681061821.997564: Worker 0: training step 7469 done (global step: 14904) | |
1681061822.004534: Worker 0: training step 7470 done (global step: 14906) | |
1681061822.012683: Worker 0: training step 7471 done (global step: 14908) | |
1681061822.021453: Worker 0: training step 7472 done (global step: 14910) | |
1681061822.028786: Worker 0: training step 7473 done (global step: 14912) | |
1681061822.035687: Worker 0: training step 7474 done (global step: 14914) | |
1681061822.044067: Worker 0: training step 7475 done (global step: 14916) | |
1681061822.052420: Worker 0: training step 7476 done (global step: 14918) | |
1681061822.059708: Worker 0: training step 7477 done (global step: 14920) | |
1681061822.066660: Worker 0: training step 7478 done (global step: 14922) | |
1681061822.076693: Worker 0: training step 7479 done (global step: 14924) | |
1681061822.085131: Worker 0: training step 7480 done (global step: 14926) | |
1681061822.091668: Worker 0: training step 7481 done (global step: 14928) | |
1681061822.098048: Worker 0: training step 7482 done (global step: 14930) | |
1681061822.104443: Worker 0: training step 7483 done (global step: 14932) | |
1681061822.110600: Worker 0: training step 7484 done (global step: 14934) | |
1681061822.118956: Worker 0: training step 7485 done (global step: 14936) | |
1681061822.126233: Worker 0: training step 7486 done (global step: 14938) | |
1681061822.133354: Worker 0: training step 7487 done (global step: 14940) | |
1681061822.139063: Worker 0: training step 7488 done (global step: 14942) | |
1681061822.146696: Worker 0: training step 7489 done (global step: 14944) | |
1681061822.152362: Worker 0: training step 7490 done (global step: 14946) | |
1681061822.157464: Worker 0: training step 7491 done (global step: 14948) | |
1681061822.163174: Worker 0: training step 7492 done (global step: 14951) | |
1681061822.168928: Worker 0: training step 7493 done (global step: 14952) | |
1681061822.175548: Worker 0: training step 7494 done (global step: 14954) | |
1681061822.182390: Worker 0: training step 7495 done (global step: 14956) | |
1681061822.189885: Worker 0: training step 7496 done (global step: 14958) | |
1681061822.195400: Worker 0: training step 7497 done (global step: 14960) | |
1681061822.200819: Worker 0: training step 7498 done (global step: 14962) | |
1681061822.206383: Worker 0: training step 7499 done (global step: 14964) | |
1681061822.212319: Worker 0: training step 7500 done (global step: 14966) | |
1681061822.217597: Worker 0: training step 7501 done (global step: 14968) | |
1681061822.223151: Worker 0: training step 7502 done (global step: 14970) | |
1681061822.228932: Worker 0: training step 7503 done (global step: 14972) | |
1681061822.234271: Worker 0: training step 7504 done (global step: 14974) | |
1681061822.240117: Worker 0: training step 7505 done (global step: 14976) | |
1681061822.245075: Worker 0: training step 7506 done (global step: 14978) | |
1681061822.251067: Worker 0: training step 7507 done (global step: 14980) | |
1681061822.258105: Worker 0: training step 7508 done (global step: 14982) | |
1681061822.266148: Worker 0: training step 7509 done (global step: 14983) | |
1681061822.273865: Worker 0: training step 7510 done (global step: 14985) | |
1681061822.280932: Worker 0: training step 7511 done (global step: 14988) | |
1681061822.286727: Worker 0: training step 7512 done (global step: 14990) | |
1681061822.292369: Worker 0: training step 7513 done (global step: 14991) | |
1681061822.298400: Worker 0: training step 7514 done (global step: 14994) | |
1681061822.304852: Worker 0: training step 7515 done (global step: 14996) | |
1681061822.311471: Worker 0: training step 7516 done (global step: 14998) | |
1681061822.316299: Worker 0: training step 7517 done (global step: 15000) | |
1681061822.321130: Worker 0: training step 7518 done (global step: 15002) | |
1681061822.326547: Worker 0: training step 7519 done (global step: 15003) | |
1681061822.332409: Worker 0: training step 7520 done (global step: 15005) | |
1681061822.337850: Worker 0: training step 7521 done (global step: 15007) | |
1681061822.343541: Worker 0: training step 7522 done (global step: 15009) | |
1681061822.349669: Worker 0: training step 7523 done (global step: 15011) | |
1681061822.354830: Worker 0: training step 7524 done (global step: 15013) | |
1681061822.360234: Worker 0: training step 7525 done (global step: 15015) | |
1681061822.365928: Worker 0: training step 7526 done (global step: 15017) | |
1681061822.372579: Worker 0: training step 7527 done (global step: 15019) | |
1681061822.378581: Worker 0: training step 7528 done (global step: 15021) | |
1681061822.384122: Worker 0: training step 7529 done (global step: 15023) | |
1681061822.390626: Worker 0: training step 7530 done (global step: 15025) | |
1681061822.397184: Worker 0: training step 7531 done (global step: 15027) | |
1681061822.402354: Worker 0: training step 7532 done (global step: 15029) | |
1681061822.408551: Worker 0: training step 7533 done (global step: 15031) | |
1681061822.414645: Worker 0: training step 7534 done (global step: 15033) | |
1681061822.420015: Worker 0: training step 7535 done (global step: 15035) | |
1681061822.425350: Worker 0: training step 7536 done (global step: 15037) | |
1681061822.430591: Worker 0: training step 7537 done (global step: 15039) | |
1681061822.435695: Worker 0: training step 7538 done (global step: 15041) | |
1681061822.441444: Worker 0: training step 7539 done (global step: 15043) | |
1681061822.448084: Worker 0: training step 7540 done (global step: 15045) | |
1681061822.455279: Worker 0: training step 7541 done (global step: 15047) | |
1681061822.473153: Worker 0: training step 7542 done (global step: 15049) | |
1681061822.481576: Worker 0: training step 7543 done (global step: 15051) | |
1681061822.489499: Worker 0: training step 7544 done (global step: 15053) | |
1681061822.496629: Worker 0: training step 7545 done (global step: 15055) | |
1681061822.504400: Worker 0: training step 7546 done (global step: 15057) | |
1681061822.512307: Worker 0: training step 7547 done (global step: 15059) | |
1681061822.518499: Worker 0: training step 7548 done (global step: 15061) | |
1681061822.526217: Worker 0: training step 7549 done (global step: 15062) | |
1681061822.535946: Worker 0: training step 7550 done (global step: 15064) | |
1681061822.543882: Worker 0: training step 7551 done (global step: 15067) | |
1681061822.551218: Worker 0: training step 7552 done (global step: 15069) | |
1681061822.559220: Worker 0: training step 7553 done (global step: 15071) | |
1681061822.569151: Worker 0: training step 7554 done (global step: 15073) | |
1681061822.578466: Worker 0: training step 7555 done (global step: 15075) | |
1681061822.586761: Worker 0: training step 7556 done (global step: 15077) | |
1681061822.594532: Worker 0: training step 7557 done (global step: 15079) | |
1681061822.602418: Worker 0: training step 7558 done (global step: 15081) | |
1681061822.610978: Worker 0: training step 7559 done (global step: 15083) | |
1681061822.618328: Worker 0: training step 7560 done (global step: 15086) | |
1681061822.628284: Worker 0: training step 7561 done (global step: 15088) | |
1681061822.634044: Worker 0: training step 7562 done (global step: 15090) | |
1681061822.639788: Worker 0: training step 7563 done (global step: 15092) | |
1681061822.648082: Worker 0: training step 7564 done (global step: 15093) | |
1681061822.655944: Worker 0: training step 7565 done (global step: 15095) | |
1681061822.665353: Worker 0: training step 7566 done (global step: 15097) | |
1681061822.673155: Worker 0: training step 7567 done (global step: 15100) | |
1681061822.681962: Worker 0: training step 7568 done (global step: 15102) | |
1681061822.689952: Worker 0: training step 7569 done (global step: 15104) | |
1681061822.697572: Worker 0: training step 7570 done (global step: 15106) | |
1681061822.704578: Worker 0: training step 7571 done (global step: 15108) | |
1681061822.710947: Worker 0: training step 7572 done (global step: 15109) | |
1681061822.719337: Worker 0: training step 7573 done (global step: 15111) | |
1681061822.728722: Worker 0: training step 7574 done (global step: 15114) | |
1681061822.735775: Worker 0: training step 7575 done (global step: 15116) | |
1681061822.741509: Worker 0: training step 7576 done (global step: 15117) | |
1681061822.751075: Worker 0: training step 7577 done (global step: 15119) | |
1681061822.758576: Worker 0: training step 7578 done (global step: 15121) | |
1681061822.766775: Worker 0: training step 7579 done (global step: 15124) | |
1681061822.774988: Worker 0: training step 7580 done (global step: 15125) | |
1681061822.781497: Worker 0: training step 7581 done (global step: 15127) | |
1681061822.788394: Worker 0: training step 7582 done (global step: 15129) | |
1681061822.796071: Worker 0: training step 7583 done (global step: 15131) | |
1681061822.801906: Worker 0: training step 7584 done (global step: 15133) | |
1681061822.807352: Worker 0: training step 7585 done (global step: 15135) | |
1681061822.812882: Worker 0: training step 7586 done (global step: 15137) | |
1681061822.818404: Worker 0: training step 7587 done (global step: 15139) | |
1681061822.823852: Worker 0: training step 7588 done (global step: 15141) | |
1681061822.829143: Worker 0: training step 7589 done (global step: 15143) | |
1681061822.834413: Worker 0: training step 7590 done (global step: 15145) | |
1681061822.839887: Worker 0: training step 7591 done (global step: 15147) | |
1681061822.845354: Worker 0: training step 7592 done (global step: 15149) | |
1681061822.850544: Worker 0: training step 7593 done (global step: 15151) | |
1681061822.856201: Worker 0: training step 7594 done (global step: 15153) | |
1681061822.861603: Worker 0: training step 7595 done (global step: 15155) | |
1681061822.867938: Worker 0: training step 7596 done (global step: 15157) | |
1681061822.873239: Worker 0: training step 7597 done (global step: 15159) | |
1681061822.879074: Worker 0: training step 7598 done (global step: 15161) | |
1681061822.884773: Worker 0: training step 7599 done (global step: 15163) | |
1681061822.890225: Worker 0: training step 7600 done (global step: 15165) | |
1681061822.896389: Worker 0: training step 7601 done (global step: 15167) | |
1681061822.904388: Worker 0: training step 7602 done (global step: 15169) | |
1681061822.910057: Worker 0: training step 7603 done (global step: 15172) | |
1681061822.916273: Worker 0: training step 7604 done (global step: 15174) | |
1681061822.922582: Worker 0: training step 7605 done (global step: 15176) | |
1681061822.928489: Worker 0: training step 7606 done (global step: 15178) | |
1681061822.935397: Worker 0: training step 7607 done (global step: 15180) | |
1681061822.940945: Worker 0: training step 7608 done (global step: 15182) | |
1681061822.945785: Worker 0: training step 7609 done (global step: 15184) | |
1681061822.951188: Worker 0: training step 7610 done (global step: 15186) | |
1681061822.956084: Worker 0: training step 7611 done (global step: 15188) | |
1681061822.962106: Worker 0: training step 7612 done (global step: 15190) | |
1681061822.968316: Worker 0: training step 7613 done (global step: 15192) | |
1681061822.974013: Worker 0: training step 7614 done (global step: 15194) | |
1681061822.979841: Worker 0: training step 7615 done (global step: 15196) | |
1681061822.985029: Worker 0: training step 7616 done (global step: 15198) | |
1681061822.991066: Worker 0: training step 7617 done (global step: 15200) | |
1681061822.996044: Worker 0: training step 7618 done (global step: 15202) | |
1681061823.001323: Worker 0: training step 7619 done (global step: 15204) | |
1681061823.006474: Worker 0: training step 7620 done (global step: 15206) | |
1681061823.012436: Worker 0: training step 7621 done (global step: 15208) | |
1681061823.017865: Worker 0: training step 7622 done (global step: 15210) | |
1681061823.022799: Worker 0: training step 7623 done (global step: 15212) | |
1681061823.029103: Worker 0: training step 7624 done (global step: 15214) | |
1681061823.034202: Worker 0: training step 7625 done (global step: 15216) | |
1681061823.039932: Worker 0: training step 7626 done (global step: 15218) | |
1681061823.046283: Worker 0: training step 7627 done (global step: 15220) | |
1681061823.053148: Worker 0: training step 7628 done (global step: 15222) | |
1681061823.058974: Worker 0: training step 7629 done (global step: 15224) | |
1681061823.064749: Worker 0: training step 7630 done (global step: 15226) | |
1681061823.070003: Worker 0: training step 7631 done (global step: 15228) | |
1681061823.075467: Worker 0: training step 7632 done (global step: 15230) | |
1681061823.081478: Worker 0: training step 7633 done (global step: 15232) | |
1681061823.087097: Worker 0: training step 7634 done (global step: 15234) | |
1681061823.094312: Worker 0: training step 7635 done (global step: 15236) | |
1681061823.099325: Worker 0: training step 7636 done (global step: 15238) | |
1681061823.103859: Worker 0: training step 7637 done (global step: 15240) | |
1681061823.108929: Worker 0: training step 7638 done (global step: 15242) | |
1681061823.114837: Worker 0: training step 7639 done (global step: 15244) | |
1681061823.120387: Worker 0: training step 7640 done (global step: 15246) | |
1681061823.125514: Worker 0: training step 7641 done (global step: 15248) | |
1681061823.131206: Worker 0: training step 7642 done (global step: 15250) | |
1681061823.137746: Worker 0: training step 7643 done (global step: 15252) | |
1681061823.142685: Worker 0: training step 7644 done (global step: 15254) | |
1681061823.148535: Worker 0: training step 7645 done (global step: 15256) | |
1681061823.154895: Worker 0: training step 7646 done (global step: 15258) | |
1681061823.160818: Worker 0: training step 7647 done (global step: 15260) | |
1681061823.166868: Worker 0: training step 7648 done (global step: 15262) | |
1681061823.171986: Worker 0: training step 7649 done (global step: 15264) | |
1681061823.177454: Worker 0: training step 7650 done (global step: 15266) | |
1681061823.183285: Worker 0: training step 7651 done (global step: 15268) | |
1681061823.188721: Worker 0: training step 7652 done (global step: 15270) | |
1681061823.194118: Worker 0: training step 7653 done (global step: 15272) | |
1681061823.199315: Worker 0: training step 7654 done (global step: 15274) | |
1681061823.204704: Worker 0: training step 7655 done (global step: 15276) | |
1681061823.209600: Worker 0: training step 7656 done (global step: 15278) | |
1681061823.214781: Worker 0: training step 7657 done (global step: 15280) | |
1681061823.220375: Worker 0: training step 7658 done (global step: 15282) | |
1681061823.226064: Worker 0: training step 7659 done (global step: 15284) | |
1681061823.231226: Worker 0: training step 7660 done (global step: 15286) | |
1681061823.236289: Worker 0: training step 7661 done (global step: 15288) | |
1681061823.242244: Worker 0: training step 7662 done (global step: 15290) | |
1681061823.247257: Worker 0: training step 7663 done (global step: 15292) | |
1681061823.252457: Worker 0: training step 7664 done (global step: 15294) | |
1681061823.258167: Worker 0: training step 7665 done (global step: 15296) | |
1681061823.263952: Worker 0: training step 7666 done (global step: 15298) | |
1681061823.269179: Worker 0: training step 7667 done (global step: 15300) | |
1681061823.274286: Worker 0: training step 7668 done (global step: 15301) | |
1681061823.279964: Worker 0: training step 7669 done (global step: 15303) | |
1681061823.285009: Worker 0: training step 7670 done (global step: 15305) | |
1681061823.290466: Worker 0: training step 7671 done (global step: 15307) | |
1681061823.297034: Worker 0: training step 7672 done (global step: 15309) | |
1681061823.306038: Worker 0: training step 7673 done (global step: 15311) | |
1681061823.311720: Worker 0: training step 7674 done (global step: 15313) | |
1681061823.318070: Worker 0: training step 7675 done (global step: 15315) | |
1681061823.324138: Worker 0: training step 7676 done (global step: 15317) | |
1681061823.329462: Worker 0: training step 7677 done (global step: 15320) | |
1681061823.335693: Worker 0: training step 7678 done (global step: 15322) | |
1681061823.341950: Worker 0: training step 7679 done (global step: 15324) | |
1681061823.347409: Worker 0: training step 7680 done (global step: 15326) | |
1681061823.352741: Worker 0: training step 7681 done (global step: 15328) | |
1681061823.358922: Worker 0: training step 7682 done (global step: 15330) | |
1681061823.364126: Worker 0: training step 7683 done (global step: 15332) | |
1681061823.369552: Worker 0: training step 7684 done (global step: 15334) | |
1681061823.374730: Worker 0: training step 7685 done (global step: 15336) | |
1681061823.380034: Worker 0: training step 7686 done (global step: 15338) | |
1681061823.385819: Worker 0: training step 7687 done (global step: 15340) | |
1681061823.391177: Worker 0: training step 7688 done (global step: 15342) | |
1681061823.396495: Worker 0: training step 7689 done (global step: 15344) | |
1681061823.402177: Worker 0: training step 7690 done (global step: 15346) | |
1681061823.407438: Worker 0: training step 7691 done (global step: 15348) | |
1681061823.413189: Worker 0: training step 7692 done (global step: 15350) | |
1681061823.418877: Worker 0: training step 7693 done (global step: 15352) | |
1681061823.424366: Worker 0: training step 7694 done (global step: 15354) | |
1681061823.430182: Worker 0: training step 7695 done (global step: 15356) | |
1681061823.435120: Worker 0: training step 7696 done (global step: 15358) | |
1681061823.440665: Worker 0: training step 7697 done (global step: 15360) | |
1681061823.446943: Worker 0: training step 7698 done (global step: 15362) | |
1681061823.452375: Worker 0: training step 7699 done (global step: 15364) | |
1681061823.457585: Worker 0: training step 7700 done (global step: 15366) | |
1681061823.608770: Worker 0: training step 7701 done (global step: 15392) | |
1681061823.613619: Worker 0: training step 7702 done (global step: 15393) | |
1681061823.618725: Worker 0: training step 7703 done (global step: 15394) | |
1681061823.623177: Worker 0: training step 7704 done (global step: 15395) | |
1681061823.628624: Worker 0: training step 7705 done (global step: 15396) | |
1681061823.633276: Worker 0: training step 7706 done (global step: 15397) | |
1681061823.638501: Worker 0: training step 7707 done (global step: 15398) | |
1681061823.644794: Worker 0: training step 7708 done (global step: 15399) | |
1681061823.648985: Worker 0: training step 7709 done (global step: 15400) | |
1681061823.653287: Worker 0: training step 7710 done (global step: 15401) | |
1681061823.657877: Worker 0: training step 7711 done (global step: 15402) | |
1681061823.662170: Worker 0: training step 7712 done (global step: 15403) | |
1681061823.666363: Worker 0: training step 7713 done (global step: 15404) | |
1681061823.671780: Worker 0: training step 7714 done (global step: 15405) | |
1681061823.676300: Worker 0: training step 7715 done (global step: 15406) | |
1681061823.680469: Worker 0: training step 7716 done (global step: 15407) | |
1681061823.684696: Worker 0: training step 7717 done (global step: 15408) | |
1681061823.690541: Worker 0: training step 7718 done (global step: 15409) | |
1681061823.695228: Worker 0: training step 7719 done (global step: 15410) | |
1681061823.699925: Worker 0: training step 7720 done (global step: 15411) | |
1681061823.704869: Worker 0: training step 7721 done (global step: 15412) | |
1681061823.708866: Worker 0: training step 7722 done (global step: 15413) | |
1681061823.712837: Worker 0: training step 7723 done (global step: 15414) | |
1681061823.717543: Worker 0: training step 7724 done (global step: 15415) | |
1681061823.722170: Worker 0: training step 7725 done (global step: 15416) | |
1681061823.727412: Worker 0: training step 7726 done (global step: 15417) | |
1681061823.732492: Worker 0: training step 7727 done (global step: 15419) | |
1681061823.738522: Worker 0: training step 7728 done (global step: 15421) | |
1681061823.743305: Worker 0: training step 7729 done (global step: 15423) | |
1681061823.748253: Worker 0: training step 7730 done (global step: 15424) | |
1681061823.754123: Worker 0: training step 7731 done (global step: 15426) | |
1681061823.760471: Worker 0: training step 7732 done (global step: 15428) | |
1681061823.766541: Worker 0: training step 7733 done (global step: 15431) | |
1681061823.772165: Worker 0: training step 7734 done (global step: 15433) | |
1681061823.777467: Worker 0: training step 7735 done (global step: 15435) | |
1681061823.783279: Worker 0: training step 7736 done (global step: 15437) | |
1681061823.788732: Worker 0: training step 7737 done (global step: 15439) | |
1681061823.793155: Worker 0: training step 7738 done (global step: 15441) | |
1681061823.798216: Worker 0: training step 7739 done (global step: 15442) | |
1681061823.803694: Worker 0: training step 7740 done (global step: 15444) | |
1681061823.809220: Worker 0: training step 7741 done (global step: 15446) | |
1681061823.814518: Worker 0: training step 7742 done (global step: 15448) | |
1681061823.820013: Worker 0: training step 7743 done (global step: 15450) | |
1681061823.825115: Worker 0: training step 7744 done (global step: 15452) | |
1681061823.830764: Worker 0: training step 7745 done (global step: 15454) | |
1681061823.836383: Worker 0: training step 7746 done (global step: 15456) | |
1681061823.842238: Worker 0: training step 7747 done (global step: 15458) | |
1681061823.847637: Worker 0: training step 7748 done (global step: 15460) | |
1681061823.853220: Worker 0: training step 7749 done (global step: 15462) | |
1681061823.858556: Worker 0: training step 7750 done (global step: 15464) | |
1681061823.863526: Worker 0: training step 7751 done (global step: 15466) | |
1681061823.869269: Worker 0: training step 7752 done (global step: 15468) | |
1681061823.874592: Worker 0: training step 7753 done (global step: 15470) | |
1681061823.880164: Worker 0: training step 7754 done (global step: 15472) | |
1681061823.885390: Worker 0: training step 7755 done (global step: 15474) | |
1681061823.890776: Worker 0: training step 7756 done (global step: 15476) | |
1681061823.896787: Worker 0: training step 7757 done (global step: 15478) | |
1681061823.902878: Worker 0: training step 7758 done (global step: 15480) | |
1681061823.908442: Worker 0: training step 7759 done (global step: 15482) | |
1681061823.914485: Worker 0: training step 7760 done (global step: 15484) | |
1681061823.920181: Worker 0: training step 7761 done (global step: 15486) | |
1681061823.926097: Worker 0: training step 7762 done (global step: 15488) | |
1681061823.931517: Worker 0: training step 7763 done (global step: 15490) | |
1681061823.937186: Worker 0: training step 7764 done (global step: 15492) | |
1681061823.942015: Worker 0: training step 7765 done (global step: 15494) | |
1681061823.947180: Worker 0: training step 7766 done (global step: 15496) | |
1681061823.953026: Worker 0: training step 7767 done (global step: 15498) | |
1681061823.958766: Worker 0: training step 7768 done (global step: 15500) | |
1681061823.964743: Worker 0: training step 7769 done (global step: 15502) | |
1681061823.969649: Worker 0: training step 7770 done (global step: 15504) | |
1681061823.974524: Worker 0: training step 7771 done (global step: 15506) | |
1681061823.980671: Worker 0: training step 7772 done (global step: 15508) | |
1681061823.985712: Worker 0: training step 7773 done (global step: 15510) | |
1681061823.992318: Worker 0: training step 7774 done (global step: 15512) | |
1681061823.997975: Worker 0: training step 7775 done (global step: 15514) | |
1681061824.003215: Worker 0: training step 7776 done (global step: 15516) | |
1681061824.009181: Worker 0: training step 7777 done (global step: 15518) | |
1681061824.014204: Worker 0: training step 7778 done (global step: 15520) | |
1681061824.019986: Worker 0: training step 7779 done (global step: 15522) | |
1681061824.025571: Worker 0: training step 7780 done (global step: 15524) | |
1681061824.031662: Worker 0: training step 7781 done (global step: 15526) | |
1681061824.037083: Worker 0: training step 7782 done (global step: 15528) | |
1681061824.044306: Worker 0: training step 7783 done (global step: 15530) | |
1681061824.050524: Worker 0: training step 7784 done (global step: 15532) | |
1681061824.056878: Worker 0: training step 7785 done (global step: 15534) | |
1681061824.061734: Worker 0: training step 7786 done (global step: 15536) | |
1681061824.067358: Worker 0: training step 7787 done (global step: 15538) | |
1681061824.072572: Worker 0: training step 7788 done (global step: 15540) | |
1681061824.077774: Worker 0: training step 7789 done (global step: 15542) | |
1681061824.084050: Worker 0: training step 7790 done (global step: 15544) | |
1681061824.088938: Worker 0: training step 7791 done (global step: 15546) | |
1681061824.093783: Worker 0: training step 7792 done (global step: 15548) | |
1681061824.099307: Worker 0: training step 7793 done (global step: 15549) | |
1681061824.104318: Worker 0: training step 7794 done (global step: 15551) | |
1681061824.109456: Worker 0: training step 7795 done (global step: 15553) | |
1681061824.114928: Worker 0: training step 7796 done (global step: 15555) | |
1681061824.119844: Worker 0: training step 7797 done (global step: 15557) | |
1681061824.125368: Worker 0: training step 7798 done (global step: 15559) | |
1681061824.131056: Worker 0: training step 7799 done (global step: 15561) | |
1681061824.136215: Worker 0: training step 7800 done (global step: 15563) | |
1681061824.141560: Worker 0: training step 7801 done (global step: 15564) | |
1681061824.148274: Worker 0: training step 7802 done (global step: 15566) | |
1681061824.153305: Worker 0: training step 7803 done (global step: 15568) | |
1681061824.158542: Worker 0: training step 7804 done (global step: 15570) | |
1681061824.164465: Worker 0: training step 7805 done (global step: 15572) | |
1681061824.170787: Worker 0: training step 7806 done (global step: 15574) | |
1681061824.177467: Worker 0: training step 7807 done (global step: 15576) | |
1681061824.185425: Worker 0: training step 7808 done (global step: 15578) | |
1681061824.192978: Worker 0: training step 7809 done (global step: 15580) | |
1681061824.200976: Worker 0: training step 7810 done (global step: 15582) | |
1681061824.208399: Worker 0: training step 7811 done (global step: 15584) | |
1681061824.213894: Worker 0: training step 7812 done (global step: 15586) | |
1681061824.219176: Worker 0: training step 7813 done (global step: 15588) | |
1681061824.224477: Worker 0: training step 7814 done (global step: 15590) | |
1681061824.230103: Worker 0: training step 7815 done (global step: 15592) | |
1681061824.235514: Worker 0: training step 7816 done (global step: 15594) | |
1681061824.243272: Worker 0: training step 7817 done (global step: 15596) | |
1681061824.251720: Worker 0: training step 7818 done (global step: 15598) | |
1681061824.259868: Worker 0: training step 7819 done (global step: 15600) | |
1681061824.267689: Worker 0: training step 7820 done (global step: 15602) | |
1681061824.288802: Worker 0: training step 7821 done (global step: 15604) | |
1681061824.297784: Worker 0: training step 7822 done (global step: 15606) | |
1681061824.308160: Worker 0: training step 7823 done (global step: 15607) | |
1681061824.315895: Worker 0: training step 7824 done (global step: 15609) | |
1681061824.324411: Worker 0: training step 7825 done (global step: 15611) | |
1681061824.331080: Worker 0: training step 7826 done (global step: 15613) | |
1681061824.339353: Worker 0: training step 7827 done (global step: 15615) | |
1681061824.348663: Worker 0: training step 7828 done (global step: 15617) | |
1681061824.366796: Worker 0: training step 7829 done (global step: 15619) | |
1681061824.404346: Worker 0: training step 7830 done (global step: 15622) | |
1681061824.436152: Worker 0: training step 7831 done (global step: 15624) | |
1681061824.452476: Worker 0: training step 7832 done (global step: 15626) | |
1681061824.469922: Worker 0: training step 7833 done (global step: 15627) | |
1681061824.479330: Worker 0: training step 7834 done (global step: 15629) | |
1681061824.497549: Worker 0: training step 7835 done (global step: 15631) | |
1681061824.515237: Worker 0: training step 7836 done (global step: 15634) | |
1681061824.524634: Worker 0: training step 7837 done (global step: 15636) | |
1681061824.530725: Worker 0: training step 7838 done (global step: 15638) | |
1681061824.536176: Worker 0: training step 7839 done (global step: 15640) | |
1681061824.542394: Worker 0: training step 7840 done (global step: 15642) | |
1681061824.550132: Worker 0: training step 7841 done (global step: 15644) | |
1681061824.562676: Worker 0: training step 7842 done (global step: 15646) | |
1681061824.580067: Worker 0: training step 7843 done (global step: 15648) | |
1681061824.589349: Worker 0: training step 7844 done (global step: 15650) | |
1681061824.597601: Worker 0: training step 7845 done (global step: 15653) | |
1681061824.602726: Worker 0: training step 7846 done (global step: 15654) | |
1681061824.607467: Worker 0: training step 7847 done (global step: 15656) | |
1681061824.613003: Worker 0: training step 7848 done (global step: 15658) | |
1681061824.618756: Worker 0: training step 7849 done (global step: 15660) | |
1681061824.635187: Worker 0: training step 7850 done (global step: 15662) | |
1681061824.646258: Worker 0: training step 7851 done (global step: 15664) | |
1681061824.657770: Worker 0: training step 7852 done (global step: 15666) | |
1681061824.666432: Worker 0: training step 7853 done (global step: 15668) | |
1681061824.672881: Worker 0: training step 7854 done (global step: 15670) | |
1681061824.681045: Worker 0: training step 7855 done (global step: 15672) | |
1681061824.688924: Worker 0: training step 7856 done (global step: 15674) | |
1681061824.694644: Worker 0: training step 7857 done (global step: 15676) | |
1681061824.699346: Worker 0: training step 7858 done (global step: 15678) | |
1681061824.704537: Worker 0: training step 7859 done (global step: 15680) | |
1681061824.710363: Worker 0: training step 7860 done (global step: 15682) | |
1681061824.715647: Worker 0: training step 7861 done (global step: 15684) | |
1681061824.720475: Worker 0: training step 7862 done (global step: 15686) | |
1681061824.726883: Worker 0: training step 7863 done (global step: 15687) | |
1681061824.731873: Worker 0: training step 7864 done (global step: 15690) | |
1681061824.737325: Worker 0: training step 7865 done (global step: 15691) | |
1681061824.743838: Worker 0: training step 7866 done (global step: 15693) | |
1681061824.749669: Worker 0: training step 7867 done (global step: 15695) | |
1681061824.755795: Worker 0: training step 7868 done (global step: 15697) | |
1681061824.761322: Worker 0: training step 7869 done (global step: 15699) | |
1681061824.768141: Worker 0: training step 7870 done (global step: 15702) | |
1681061824.775647: Worker 0: training step 7871 done (global step: 15704) | |
1681061824.781561: Worker 0: training step 7872 done (global step: 15706) | |
1681061824.787849: Worker 0: training step 7873 done (global step: 15708) | |
1681061824.793828: Worker 0: training step 7874 done (global step: 15710) | |
1681061824.800301: Worker 0: training step 7875 done (global step: 15712) | |
1681061824.808008: Worker 0: training step 7876 done (global step: 15714) | |
1681061824.815177: Worker 0: training step 7877 done (global step: 15717) | |
1681061824.822949: Worker 0: training step 7878 done (global step: 15719) | |
1681061824.829633: Worker 0: training step 7879 done (global step: 15721) | |
1681061824.835011: Worker 0: training step 7880 done (global step: 15723) | |
1681061824.840147: Worker 0: training step 7881 done (global step: 15725) | |
1681061824.846680: Worker 0: training step 7882 done (global step: 15727) | |
1681061824.852249: Worker 0: training step 7883 done (global step: 15729) | |
1681061824.857983: Worker 0: training step 7884 done (global step: 15731) | |
1681061824.864372: Worker 0: training step 7885 done (global step: 15733) | |
1681061824.870068: Worker 0: training step 7886 done (global step: 15735) | |
1681061824.875781: Worker 0: training step 7887 done (global step: 15737) | |
1681061824.881320: Worker 0: training step 7888 done (global step: 15739) | |
1681061824.886998: Worker 0: training step 7889 done (global step: 15741) | |
1681061824.892390: Worker 0: training step 7890 done (global step: 15743) | |
1681061824.897924: Worker 0: training step 7891 done (global step: 15745) | |
1681061824.903847: Worker 0: training step 7892 done (global step: 15747) | |
1681061824.909265: Worker 0: training step 7893 done (global step: 15749) | |
1681061824.915896: Worker 0: training step 7894 done (global step: 15751) | |
1681061824.921650: Worker 0: training step 7895 done (global step: 15753) | |
1681061824.927534: Worker 0: training step 7896 done (global step: 15755) | |
1681061824.933348: Worker 0: training step 7897 done (global step: 15757) | |
1681061824.939752: Worker 0: training step 7898 done (global step: 15759) | |
1681061824.945592: Worker 0: training step 7899 done (global step: 15761) | |
1681061824.951043: Worker 0: training step 7900 done (global step: 15763) | |
1681061824.956601: Worker 0: training step 7901 done (global step: 15765) | |
1681061824.961313: Worker 0: training step 7902 done (global step: 15767) | |
1681061824.966754: Worker 0: training step 7903 done (global step: 15768) | |
1681061824.971781: Worker 0: training step 7904 done (global step: 15770) | |
1681061824.977260: Worker 0: training step 7905 done (global step: 15772) | |
1681061824.982723: Worker 0: training step 7906 done (global step: 15774) | |
1681061824.988253: Worker 0: training step 7907 done (global step: 15776) | |
1681061824.994290: Worker 0: training step 7908 done (global step: 15778) | |
1681061824.999973: Worker 0: training step 7909 done (global step: 15780) | |
1681061825.004499: Worker 0: training step 7910 done (global step: 15782) | |
1681061825.009554: Worker 0: training step 7911 done (global step: 15783) | |
1681061825.017631: Worker 0: training step 7912 done (global step: 15785) | |
1681061825.028945: Worker 0: training step 7913 done (global step: 15788) | |
1681061825.039499: Worker 0: training step 7914 done (global step: 15790) | |
1681061825.067705: Worker 0: training step 7915 done (global step: 15792) | |
1681061825.076053: Worker 0: training step 7916 done (global step: 15794) | |
1681061825.084349: Worker 0: training step 7917 done (global step: 15796) | |
1681061825.094485: Worker 0: training step 7918 done (global step: 15798) | |
1681061825.107874: Worker 0: training step 7919 done (global step: 15799) | |
1681061825.113163: Worker 0: training step 7920 done (global step: 15801) | |
1681061825.118665: Worker 0: training step 7921 done (global step: 15803) | |
1681061825.130462: Worker 0: training step 7922 done (global step: 15805) | |
1681061825.138473: Worker 0: training step 7923 done (global step: 15807) | |
1681061825.144377: Worker 0: training step 7924 done (global step: 15809) | |
1681061825.150001: Worker 0: training step 7925 done (global step: 15811) | |
1681061825.157201: Worker 0: training step 7926 done (global step: 15813) | |
1681061825.164172: Worker 0: training step 7927 done (global step: 15815) | |
1681061825.171673: Worker 0: training step 7928 done (global step: 15817) | |
1681061825.177371: Worker 0: training step 7929 done (global step: 15819) | |
1681061825.184270: Worker 0: training step 7930 done (global step: 15821) | |
1681061825.190892: Worker 0: training step 7931 done (global step: 15823) | |
1681061825.197094: Worker 0: training step 7932 done (global step: 15825) | |
1681061825.203646: Worker 0: training step 7933 done (global step: 15827) | |
1681061825.210599: Worker 0: training step 7934 done (global step: 15829) | |
1681061825.216859: Worker 0: training step 7935 done (global step: 15832) | |
1681061825.224969: Worker 0: training step 7936 done (global step: 15834) | |
1681061825.231234: Worker 0: training step 7937 done (global step: 15836) | |
1681061825.237296: Worker 0: training step 7938 done (global step: 15838) | |
1681061825.244293: Worker 0: training step 7939 done (global step: 15840) | |
1681061825.251044: Worker 0: training step 7940 done (global step: 15842) | |
1681061825.256798: Worker 0: training step 7941 done (global step: 15844) | |
1681061825.263135: Worker 0: training step 7942 done (global step: 15846) | |
1681061825.269030: Worker 0: training step 7943 done (global step: 15848) | |
1681061825.274914: Worker 0: training step 7944 done (global step: 15850) | |
1681061825.281271: Worker 0: training step 7945 done (global step: 15852) | |
1681061825.287865: Worker 0: training step 7946 done (global step: 15854) | |
1681061825.294719: Worker 0: training step 7947 done (global step: 15856) | |
1681061825.306474: Worker 0: training step 7948 done (global step: 15858) | |
1681061825.314336: Worker 0: training step 7949 done (global step: 15860) | |
1681061825.321071: Worker 0: training step 7950 done (global step: 15862) | |
1681061825.326953: Worker 0: training step 7951 done (global step: 15864) | |
1681061825.332459: Worker 0: training step 7952 done (global step: 15866) | |
1681061825.337889: Worker 0: training step 7953 done (global step: 15868) | |
1681061825.343345: Worker 0: training step 7954 done (global step: 15870) | |
1681061825.349144: Worker 0: training step 7955 done (global step: 15872) | |
1681061825.356006: Worker 0: training step 7956 done (global step: 15874) | |
1681061825.363659: Worker 0: training step 7957 done (global step: 15876) | |
1681061825.369884: Worker 0: training step 7958 done (global step: 15879) | |
1681061825.374866: Worker 0: training step 7959 done (global step: 15881) | |
1681061825.380740: Worker 0: training step 7960 done (global step: 15883) | |
1681061825.386900: Worker 0: training step 7961 done (global step: 15885) | |
1681061825.392313: Worker 0: training step 7962 done (global step: 15887) | |
1681061825.398244: Worker 0: training step 7963 done (global step: 15889) | |
1681061825.404113: Worker 0: training step 7964 done (global step: 15891) | |
1681061825.409242: Worker 0: training step 7965 done (global step: 15893) | |
1681061825.414689: Worker 0: training step 7966 done (global step: 15895) | |
1681061825.420191: Worker 0: training step 7967 done (global step: 15897) | |
1681061825.427188: Worker 0: training step 7968 done (global step: 15899) | |
1681061825.432732: Worker 0: training step 7969 done (global step: 15901) | |
1681061825.437769: Worker 0: training step 7970 done (global step: 15903) | |
1681061825.443802: Worker 0: training step 7971 done (global step: 15905) | |
1681061825.450104: Worker 0: training step 7972 done (global step: 15907) | |
1681061825.455919: Worker 0: training step 7973 done (global step: 15909) | |
1681061825.462070: Worker 0: training step 7974 done (global step: 15911) | |
1681061825.467465: Worker 0: training step 7975 done (global step: 15913) | |
1681061825.472838: Worker 0: training step 7976 done (global step: 15915) | |
1681061825.478559: Worker 0: training step 7977 done (global step: 15917) | |
1681061825.485344: Worker 0: training step 7978 done (global step: 15919) | |
1681061825.491383: Worker 0: training step 7979 done (global step: 15921) | |
1681061825.496714: Worker 0: training step 7980 done (global step: 15923) | |
1681061825.502353: Worker 0: training step 7981 done (global step: 15925) | |
1681061825.508579: Worker 0: training step 7982 done (global step: 15927) | |
1681061825.515536: Worker 0: training step 7983 done (global step: 15929) | |
1681061825.521081: Worker 0: training step 7984 done (global step: 15931) | |
1681061825.526071: Worker 0: training step 7985 done (global step: 15933) | |
1681061825.531651: Worker 0: training step 7986 done (global step: 15935) | |
1681061825.536957: Worker 0: training step 7987 done (global step: 15937) | |
1681061825.542883: Worker 0: training step 7988 done (global step: 15939) | |
1681061825.547866: Worker 0: training step 7989 done (global step: 15941) | |
1681061825.553258: Worker 0: training step 7990 done (global step: 15943) | |
1681061825.559499: Worker 0: training step 7991 done (global step: 15945) | |
1681061825.565061: Worker 0: training step 7992 done (global step: 15947) | |
1681061825.570073: Worker 0: training step 7993 done (global step: 15949) | |
1681061825.575666: Worker 0: training step 7994 done (global step: 15951) | |
1681061825.580748: Worker 0: training step 7995 done (global step: 15953) | |
1681061825.586274: Worker 0: training step 7996 done (global step: 15955) | |
1681061825.591895: Worker 0: training step 7997 done (global step: 15957) | |
1681061825.598406: Worker 0: training step 7998 done (global step: 15959) | |
1681061825.605770: Worker 0: training step 7999 done (global step: 15961) | |
1681061825.612120: Worker 0: training step 8000 done (global step: 15964) | |
1681061825.617534: Worker 0: training step 8001 done (global step: 15966) | |
1681061825.622396: Worker 0: training step 8002 done (global step: 15968) | |
1681061825.627556: Worker 0: training step 8003 done (global step: 15970) | |
1681061825.633604: Worker 0: training step 8004 done (global step: 15972) | |
1681061825.638963: Worker 0: training step 8005 done (global step: 15974) | |
1681061825.644392: Worker 0: training step 8006 done (global step: 15976) | |
1681061825.649189: Worker 0: training step 8007 done (global step: 15978) | |
1681061825.654460: Worker 0: training step 8008 done (global step: 15980) | |
1681061825.660572: Worker 0: training step 8009 done (global step: 15982) | |
1681061825.665878: Worker 0: training step 8010 done (global step: 15984) | |
1681061825.671375: Worker 0: training step 8011 done (global step: 15986) | |
1681061825.676827: Worker 0: training step 8012 done (global step: 15988) | |
1681061825.682097: Worker 0: training step 8013 done (global step: 15989) | |
1681061825.687255: Worker 0: training step 8014 done (global step: 15991) | |
1681061825.692829: Worker 0: training step 8015 done (global step: 15993) | |
1681061825.698481: Worker 0: training step 8016 done (global step: 15995) | |
1681061825.704601: Worker 0: training step 8017 done (global step: 15997) | |
1681061825.709330: Worker 0: training step 8018 done (global step: 15999) | |
1681061825.716879: Worker 0: training step 8019 done (global step: 16001) | |
1681061825.722578: Worker 0: training step 8020 done (global step: 16003) | |
1681061825.728367: Worker 0: training step 8021 done (global step: 16005) | |
1681061825.734468: Worker 0: training step 8022 done (global step: 16007) | |
1681061825.741782: Worker 0: training step 8023 done (global step: 16009) | |
1681061825.748687: Worker 0: training step 8024 done (global step: 16011) | |
1681061825.759945: Worker 0: training step 8025 done (global step: 16013) | |
1681061825.767089: Worker 0: training step 8026 done (global step: 16015) | |
1681061825.772681: Worker 0: training step 8027 done (global step: 16018) | |
1681061825.778553: Worker 0: training step 8028 done (global step: 16020) | |
1681061825.784018: Worker 0: training step 8029 done (global step: 16022) | |
1681061825.794966: Worker 0: training step 8030 done (global step: 16024) | |
1681061825.802433: Worker 0: training step 8031 done (global step: 16026) | |
1681061825.807541: Worker 0: training step 8032 done (global step: 16028) | |
1681061825.812698: Worker 0: training step 8033 done (global step: 16030) | |
1681061825.817882: Worker 0: training step 8034 done (global step: 16032) | |
1681061825.823563: Worker 0: training step 8035 done (global step: 16034) | |
1681061825.828887: Worker 0: training step 8036 done (global step: 16036) | |
1681061825.834400: Worker 0: training step 8037 done (global step: 16038) | |
1681061825.840159: Worker 0: training step 8038 done (global step: 16040) | |
1681061825.845342: Worker 0: training step 8039 done (global step: 16042) | |
1681061825.850693: Worker 0: training step 8040 done (global step: 16044) | |
1681061825.856407: Worker 0: training step 8041 done (global step: 16046) | |
1681061825.862591: Worker 0: training step 8042 done (global step: 16048) | |
1681061825.867882: Worker 0: training step 8043 done (global step: 16050) | |
1681061825.873840: Worker 0: training step 8044 done (global step: 16052) | |
1681061825.879279: Worker 0: training step 8045 done (global step: 16054) | |
1681061825.885021: Worker 0: training step 8046 done (global step: 16057) | |
1681061825.897418: Worker 0: training step 8047 done (global step: 16058) | |
1681061825.903971: Worker 0: training step 8048 done (global step: 16060) | |
1681061825.909891: Worker 0: training step 8049 done (global step: 16062) | |
1681061825.914853: Worker 0: training step 8050 done (global step: 16063) | |
1681061825.922802: Worker 0: training step 8051 done (global step: 16065) | |
1681061825.929347: Worker 0: training step 8052 done (global step: 16068) | |
1681061825.943052: Worker 0: training step 8053 done (global step: 16070) | |
1681061825.957856: Worker 0: training step 8054 done (global step: 16071) | |
1681061826.001421: Worker 0: training step 8055 done (global step: 16073) | |
1681061826.015927: Worker 0: training step 8056 done (global step: 16075) | |
1681061826.060736: Worker 0: training step 8057 done (global step: 16077) | |
1681061826.069136: Worker 0: training step 8058 done (global step: 16079) | |
1681061826.095270: Worker 0: training step 8059 done (global step: 16083) | |
1681061826.112290: Worker 0: training step 8060 done (global step: 16083) | |
1681061826.127066: Worker 0: training step 8061 done (global step: 16085) | |
1681061826.153906: Worker 0: training step 8062 done (global step: 16087) | |
1681061826.204946: Worker 0: training step 8063 done (global step: 16089) | |
1681061826.240185: Worker 0: training step 8064 done (global step: 16091) | |
1681061826.272988: Worker 0: training step 8065 done (global step: 16092) | |
1681061826.286575: Worker 0: training step 8066 done (global step: 16095) | |
1681061826.311003: Worker 0: training step 8067 done (global step: 16097) | |
1681061826.318377: Worker 0: training step 8068 done (global step: 16098) | |
1681061826.335190: Worker 0: training step 8069 done (global step: 16101) | |
1681061826.345913: Worker 0: training step 8070 done (global step: 16103) | |
1681061826.352423: Worker 0: training step 8071 done (global step: 16105) | |
1681061826.368738: Worker 0: training step 8072 done (global step: 16107) | |
1681061826.375651: Worker 0: training step 8073 done (global step: 16109) | |
1681061826.381279: Worker 0: training step 8074 done (global step: 16111) | |
1681061826.392751: Worker 0: training step 8075 done (global step: 16113) | |
1681061826.405330: Worker 0: training step 8076 done (global step: 16115) | |
1681061826.411286: Worker 0: training step 8077 done (global step: 16117) | |
1681061826.416638: Worker 0: training step 8078 done (global step: 16119) | |
1681061826.430729: Worker 0: training step 8079 done (global step: 16121) | |
1681061826.439190: Worker 0: training step 8080 done (global step: 16123) | |
1681061826.445011: Worker 0: training step 8081 done (global step: 16125) | |
1681061826.451543: Worker 0: training step 8082 done (global step: 16127) | |
1681061826.468882: Worker 0: training step 8083 done (global step: 16129) | |
1681061826.485230: Worker 0: training step 8084 done (global step: 16132) | |
1681061826.498523: Worker 0: training step 8085 done (global step: 16134) | |
1681061826.506785: Worker 0: training step 8086 done (global step: 16136) | |
1681061826.512255: Worker 0: training step 8087 done (global step: 16138) | |
1681061826.518748: Worker 0: training step 8088 done (global step: 16139) | |
1681061826.533406: Worker 0: training step 8089 done (global step: 16142) | |
1681061826.541239: Worker 0: training step 8090 done (global step: 16144) | |
1681061826.547258: Worker 0: training step 8091 done (global step: 16146) | |
1681061826.554141: Worker 0: training step 8092 done (global step: 16148) | |
1681061826.569822: Worker 0: training step 8093 done (global step: 16150) | |
1681061826.576714: Worker 0: training step 8094 done (global step: 16152) | |
1681061826.582067: Worker 0: training step 8095 done (global step: 16154) | |
1681061826.594862: Worker 0: training step 8096 done (global step: 16156) | |
1681061826.604686: Worker 0: training step 8097 done (global step: 16158) | |
1681061826.609264: Worker 0: training step 8098 done (global step: 16159) | |
1681061826.615524: Worker 0: training step 8099 done (global step: 16161) | |
1681061826.623351: Worker 0: training step 8100 done (global step: 16163) | |
1681061826.638007: Worker 0: training step 8101 done (global step: 16165) | |
1681061826.643914: Worker 0: training step 8102 done (global step: 16167) | |
1681061826.649450: Worker 0: training step 8103 done (global step: 16169) | |
1681061826.669829: Worker 0: training step 8104 done (global step: 16171) | |
1681061826.676775: Worker 0: training step 8105 done (global step: 16173) | |
1681061826.682580: Worker 0: training step 8106 done (global step: 16176) | |
1681061826.693129: Worker 0: training step 8107 done (global step: 16178) | |
1681061826.702042: Worker 0: training step 8108 done (global step: 16180) | |
1681061826.708357: Worker 0: training step 8109 done (global step: 16181) | |
1681061826.713919: Worker 0: training step 8110 done (global step: 16183) | |
1681061826.721494: Worker 0: training step 8111 done (global step: 16185) | |
1681061826.731771: Worker 0: training step 8112 done (global step: 16187) | |
1681061826.744773: Worker 0: training step 8113 done (global step: 16190) | |
1681061826.755489: Worker 0: training step 8114 done (global step: 16192) | |
1681061826.768978: Worker 0: training step 8115 done (global step: 16194) | |
1681061826.779965: Worker 0: training step 8116 done (global step: 16196) | |
1681061826.788587: Worker 0: training step 8117 done (global step: 16198) | |
1681061826.799667: Worker 0: training step 8118 done (global step: 16200) | |
1681061826.812994: Worker 0: training step 8119 done (global step: 16203) | |
1681061826.819503: Worker 0: training step 8120 done (global step: 16205) | |
1681061826.826334: Worker 0: training step 8121 done (global step: 16207) | |
1681061826.834584: Worker 0: training step 8122 done (global step: 16209) | |
1681061826.843287: Worker 0: training step 8123 done (global step: 16210) | |
1681061826.852271: Worker 0: training step 8124 done (global step: 16212) | |
1681061826.860936: Worker 0: training step 8125 done (global step: 16214) | |
1681061826.868280: Worker 0: training step 8126 done (global step: 16216) | |
1681061826.877273: Worker 0: training step 8127 done (global step: 16218) | |
1681061826.886972: Worker 0: training step 8128 done (global step: 16220) | |
1681061826.892421: Worker 0: training step 8129 done (global step: 16223) | |
1681061826.898345: Worker 0: training step 8130 done (global step: 16224) | |
1681061826.909057: Worker 0: training step 8131 done (global step: 16226) | |
1681061826.916443: Worker 0: training step 8132 done (global step: 16229) | |
1681061826.923248: Worker 0: training step 8133 done (global step: 16231) | |
1681061826.931440: Worker 0: training step 8134 done (global step: 16233) | |
1681061826.939104: Worker 0: training step 8135 done (global step: 16235) | |
1681061826.949302: Worker 0: training step 8136 done (global step: 16237) | |
1681061826.956120: Worker 0: training step 8137 done (global step: 16239) | |
1681061826.961722: Worker 0: training step 8138 done (global step: 16241) | |
1681061826.969159: Worker 0: training step 8139 done (global step: 16243) | |
1681061826.981945: Worker 0: training step 8140 done (global step: 16245) | |
1681061826.989488: Worker 0: training step 8141 done (global step: 16247) | |
1681061826.995309: Worker 0: training step 8142 done (global step: 16249) | |
1681061827.000376: Worker 0: training step 8143 done (global step: 16251) | |
1681061827.010923: Worker 0: training step 8144 done (global step: 16253) | |
1681061827.022105: Worker 0: training step 8145 done (global step: 16255) | |
1681061827.030944: Worker 0: training step 8146 done (global step: 16257) | |
1681061827.041100: Worker 0: training step 8147 done (global step: 16259) | |
1681061827.051221: Worker 0: training step 8148 done (global step: 16261) | |
1681061827.059129: Worker 0: training step 8149 done (global step: 16263) | |
1681061827.066886: Worker 0: training step 8150 done (global step: 16265) | |
1681061827.078279: Worker 0: training step 8151 done (global step: 16268) | |
1681061827.088001: Worker 0: training step 8152 done (global step: 16270) | |
1681061827.094141: Worker 0: training step 8153 done (global step: 16272) | |
1681061827.099000: Worker 0: training step 8154 done (global step: 16273) | |
1681061827.106514: Worker 0: training step 8155 done (global step: 16275) | |
1681061827.115714: Worker 0: training step 8156 done (global step: 16277) | |
1681061827.123955: Worker 0: training step 8157 done (global step: 16279) | |
1681061827.129723: Worker 0: training step 8158 done (global step: 16281) | |
1681061827.140667: Worker 0: training step 8159 done (global step: 16283) | |
1681061827.151696: Worker 0: training step 8160 done (global step: 16285) | |
1681061827.159004: Worker 0: training step 8161 done (global step: 16287) | |
1681061827.165345: Worker 0: training step 8162 done (global step: 16289) | |
1681061827.175128: Worker 0: training step 8163 done (global step: 16291) | |
1681061827.188478: Worker 0: training step 8164 done (global step: 16293) | |
1681061827.199638: Worker 0: training step 8165 done (global step: 16295) | |
1681061827.219846: Worker 0: training step 8166 done (global step: 16298) | |
1681061827.230597: Worker 0: training step 8167 done (global step: 16300) | |
1681061827.240829: Worker 0: training step 8168 done (global step: 16302) | |
1681061827.251912: Worker 0: training step 8169 done (global step: 16304) | |
1681061827.265217: Worker 0: training step 8170 done (global step: 16306) | |
1681061827.281855: Worker 0: training step 8171 done (global step: 16308) | |
1681061827.290810: Worker 0: training step 8172 done (global step: 16310) | |
1681061827.300293: Worker 0: training step 8173 done (global step: 16312) | |
1681061827.311915: Worker 0: training step 8174 done (global step: 16314) | |
1681061827.321104: Worker 0: training step 8175 done (global step: 16317) | |
1681061827.326195: Worker 0: training step 8176 done (global step: 16319) | |
1681061827.332254: Worker 0: training step 8177 done (global step: 16321) | |
1681061827.339989: Worker 0: training step 8178 done (global step: 16323) | |
1681061827.345566: Worker 0: training step 8179 done (global step: 16325) | |
1681061827.351869: Worker 0: training step 8180 done (global step: 16327) | |
1681061827.357443: Worker 0: training step 8181 done (global step: 16329) | |
1681061827.363534: Worker 0: training step 8182 done (global step: 16331) | |
1681061827.370140: Worker 0: training step 8183 done (global step: 16333) | |
1681061827.376186: Worker 0: training step 8184 done (global step: 16335) | |
1681061827.381687: Worker 0: training step 8185 done (global step: 16337) | |
1681061827.386955: Worker 0: training step 8186 done (global step: 16339) | |
1681061827.393014: Worker 0: training step 8187 done (global step: 16341) | |
1681061827.398217: Worker 0: training step 8188 done (global step: 16343) | |
1681061827.404324: Worker 0: training step 8189 done (global step: 16345) | |
1681061827.409949: Worker 0: training step 8190 done (global step: 16347) | |
1681061827.416466: Worker 0: training step 8191 done (global step: 16349) | |
1681061827.421906: Worker 0: training step 8192 done (global step: 16351) | |
1681061827.427571: Worker 0: training step 8193 done (global step: 16353) | |
1681061827.435065: Worker 0: training step 8194 done (global step: 16355) | |
1681061827.443301: Worker 0: training step 8195 done (global step: 16357) | |
1681061827.451742: Worker 0: training step 8196 done (global step: 16359) | |
1681061827.458209: Worker 0: training step 8197 done (global step: 16361) | |
1681061827.464626: Worker 0: training step 8198 done (global step: 16363) | |
1681061827.471740: Worker 0: training step 8199 done (global step: 16365) | |
1681061827.478885: Worker 0: training step 8200 done (global step: 16367) | |
1681061827.484828: Worker 0: training step 8201 done (global step: 16369) | |
1681061827.490254: Worker 0: training step 8202 done (global step: 16371) | |
1681061827.495157: Worker 0: training step 8203 done (global step: 16373) | |
1681061827.500693: Worker 0: training step 8204 done (global step: 16375) | |
1681061827.506361: Worker 0: training step 8205 done (global step: 16377) | |
1681061827.512899: Worker 0: training step 8206 done (global step: 16379) | |
1681061827.518423: Worker 0: training step 8207 done (global step: 16381) | |
1681061827.524268: Worker 0: training step 8208 done (global step: 16383) | |
1681061827.529870: Worker 0: training step 8209 done (global step: 16385) | |
1681061827.534855: Worker 0: training step 8210 done (global step: 16387) | |
1681061827.539955: Worker 0: training step 8211 done (global step: 16389) | |
1681061827.545891: Worker 0: training step 8212 done (global step: 16391) | |
1681061827.552065: Worker 0: training step 8213 done (global step: 16393) | |
1681061827.557451: Worker 0: training step 8214 done (global step: 16395) | |
1681061827.562821: Worker 0: training step 8215 done (global step: 16397) | |
1681061827.567873: Worker 0: training step 8216 done (global step: 16399) | |
1681061827.572644: Worker 0: training step 8217 done (global step: 16401) | |
1681061827.578740: Worker 0: training step 8218 done (global step: 16402) | |
1681061827.583657: Worker 0: training step 8219 done (global step: 16405) | |
1681061827.588655: Worker 0: training step 8220 done (global step: 16406) | |
1681061827.594812: Worker 0: training step 8221 done (global step: 16408) | |
1681061827.600361: Worker 0: training step 8222 done (global step: 16410) | |
1681061827.605884: Worker 0: training step 8223 done (global step: 16412) | |
1681061827.611042: Worker 0: training step 8224 done (global step: 16414) | |
1681061827.617260: Worker 0: training step 8225 done (global step: 16416) | |
1681061827.622405: Worker 0: training step 8226 done (global step: 16418) | |
1681061827.628280: Worker 0: training step 8227 done (global step: 16420) | |
1681061827.634174: Worker 0: training step 8228 done (global step: 16422) | |
1681061827.640099: Worker 0: training step 8229 done (global step: 16424) | |
1681061827.645815: Worker 0: training step 8230 done (global step: 16426) | |
1681061827.651578: Worker 0: training step 8231 done (global step: 16428) | |
1681061827.657811: Worker 0: training step 8232 done (global step: 16430) | |
1681061827.663640: Worker 0: training step 8233 done (global step: 16432) | |
1681061827.669234: Worker 0: training step 8234 done (global step: 16434) | |
1681061827.675010: Worker 0: training step 8235 done (global step: 16436) | |
1681061827.680851: Worker 0: training step 8236 done (global step: 16438) | |
1681061827.686256: Worker 0: training step 8237 done (global step: 16440) | |
1681061827.693240: Worker 0: training step 8238 done (global step: 16442) | |
1681061827.698238: Worker 0: training step 8239 done (global step: 16444) | |
1681061827.704652: Worker 0: training step 8240 done (global step: 16446) | |
1681061827.710164: Worker 0: training step 8241 done (global step: 16448) | |
1681061827.716748: Worker 0: training step 8242 done (global step: 16450) | |
1681061827.722973: Worker 0: training step 8243 done (global step: 16453) | |
1681061827.728163: Worker 0: training step 8244 done (global step: 16455) | |
1681061827.734487: Worker 0: training step 8245 done (global step: 16457) | |
1681061827.741032: Worker 0: training step 8246 done (global step: 16459) | |
1681061827.747401: Worker 0: training step 8247 done (global step: 16461) | |
1681061827.754419: Worker 0: training step 8248 done (global step: 16463) | |
1681061827.759196: Worker 0: training step 8249 done (global step: 16465) | |
1681061827.765141: Worker 0: training step 8250 done (global step: 16467) | |
1681061827.927275: Worker 0: training step 8251 done (global step: 16491) | |
1681061827.933319: Worker 0: training step 8252 done (global step: 16492) | |
1681061827.938243: Worker 0: training step 8253 done (global step: 16493) | |
1681061827.942909: Worker 0: training step 8254 done (global step: 16494) | |
1681061827.947983: Worker 0: training step 8255 done (global step: 16495) | |
1681061827.953223: Worker 0: training step 8256 done (global step: 16496) | |
1681061827.958757: Worker 0: training step 8257 done (global step: 16497) | |
1681061827.966430: Worker 0: training step 8258 done (global step: 16498) | |
1681061827.972388: Worker 0: training step 8259 done (global step: 16499) | |
1681061827.978534: Worker 0: training step 8260 done (global step: 16500) | |
1681061827.985072: Worker 0: training step 8261 done (global step: 16501) | |
1681061827.992073: Worker 0: training step 8262 done (global step: 16502) | |
1681061827.998306: Worker 0: training step 8263 done (global step: 16503) | |
1681061828.003713: Worker 0: training step 8264 done (global step: 16504) | |
1681061828.008408: Worker 0: training step 8265 done (global step: 16505) | |
1681061828.013864: Worker 0: training step 8266 done (global step: 16506) | |
1681061828.018697: Worker 0: training step 8267 done (global step: 16507) | |
1681061828.023142: Worker 0: training step 8268 done (global step: 16508) | |
1681061828.028131: Worker 0: training step 8269 done (global step: 16509) | |
1681061828.032302: Worker 0: training step 8270 done (global step: 16510) | |
1681061828.036598: Worker 0: training step 8271 done (global step: 16511) | |
1681061828.041112: Worker 0: training step 8272 done (global step: 16512) | |
1681061828.045715: Worker 0: training step 8273 done (global step: 16513) | |
1681061828.049895: Worker 0: training step 8274 done (global step: 16514) | |
1681061828.055577: Worker 0: training step 8275 done (global step: 16515) | |
1681061828.062294: Worker 0: training step 8276 done (global step: 16517) | |
1681061828.067761: Worker 0: training step 8277 done (global step: 16519) | |
1681061828.072582: Worker 0: training step 8278 done (global step: 16521) | |
1681061828.077711: Worker 0: training step 8279 done (global step: 16523) | |
1681061828.083483: Worker 0: training step 8280 done (global step: 16525) | |
1681061828.089298: Worker 0: training step 8281 done (global step: 16527) | |
1681061828.094328: Worker 0: training step 8282 done (global step: 16529) | |
1681061828.100093: Worker 0: training step 8283 done (global step: 16531) | |
1681061828.105422: Worker 0: training step 8284 done (global step: 16533) | |
1681061828.111350: Worker 0: training step 8285 done (global step: 16535) | |
1681061828.116895: Worker 0: training step 8286 done (global step: 16537) | |
1681061828.121900: Worker 0: training step 8287 done (global step: 16539) | |
1681061828.126740: Worker 0: training step 8288 done (global step: 16541) | |
1681061828.132773: Worker 0: training step 8289 done (global step: 16542) | |
1681061828.138586: Worker 0: training step 8290 done (global step: 16545) | |
1681061828.144083: Worker 0: training step 8291 done (global step: 16547) | |
1681061828.149123: Worker 0: training step 8292 done (global step: 16548) | |
1681061828.153855: Worker 0: training step 8293 done (global step: 16550) | |
1681061828.158984: Worker 0: training step 8294 done (global step: 16552) | |
1681061828.164115: Worker 0: training step 8295 done (global step: 16554) | |
1681061828.169458: Worker 0: training step 8296 done (global step: 16556) | |
1681061828.174890: Worker 0: training step 8297 done (global step: 16558) | |
1681061828.180135: Worker 0: training step 8298 done (global step: 16560) | |
1681061828.185889: Worker 0: training step 8299 done (global step: 16562) | |
1681061828.191233: Worker 0: training step 8300 done (global step: 16564) | |
1681061828.198476: Worker 0: training step 8301 done (global step: 16566) | |
1681061828.204913: Worker 0: training step 8302 done (global step: 16568) | |
1681061828.210909: Worker 0: training step 8303 done (global step: 16570) | |
1681061828.216623: Worker 0: training step 8304 done (global step: 16573) | |
1681061828.222852: Worker 0: training step 8305 done (global step: 16575) | |
1681061828.228285: Worker 0: training step 8306 done (global step: 16577) | |
1681061828.233667: Worker 0: training step 8307 done (global step: 16579) | |
1681061828.239575: Worker 0: training step 8308 done (global step: 16581) | |
1681061828.245008: Worker 0: training step 8309 done (global step: 16583) | |
1681061828.252436: Worker 0: training step 8310 done (global step: 16585) | |
1681061828.260280: Worker 0: training step 8311 done (global step: 16587) | |
1681061828.266523: Worker 0: training step 8312 done (global step: 16588) | |
1681061828.272754: Worker 0: training step 8313 done (global step: 16590) | |
1681061828.278358: Worker 0: training step 8314 done (global step: 16592) | |
1681061828.284018: Worker 0: training step 8315 done (global step: 16594) | |
1681061828.289953: Worker 0: training step 8316 done (global step: 16596) | |
1681061828.295566: Worker 0: training step 8317 done (global step: 16598) | |
1681061828.300894: Worker 0: training step 8318 done (global step: 16600) | |
1681061828.307822: Worker 0: training step 8319 done (global step: 16602) | |
1681061828.314920: Worker 0: training step 8320 done (global step: 16604) | |
1681061828.321809: Worker 0: training step 8321 done (global step: 16606) | |
1681061828.329205: Worker 0: training step 8322 done (global step: 16608) | |
1681061828.334597: Worker 0: training step 8323 done (global step: 16610) | |
1681061828.342548: Worker 0: training step 8324 done (global step: 16612) | |
1681061828.350031: Worker 0: training step 8325 done (global step: 16614) | |
1681061828.358472: Worker 0: training step 8326 done (global step: 16616) | |
1681061828.364999: Worker 0: training step 8327 done (global step: 16618) | |
1681061828.371261: Worker 0: training step 8328 done (global step: 16620) | |
1681061828.377997: Worker 0: training step 8329 done (global step: 16622) | |
1681061828.383959: Worker 0: training step 8330 done (global step: 16624) | |
1681061828.390540: Worker 0: training step 8331 done (global step: 16626) | |
1681061828.396717: Worker 0: training step 8332 done (global step: 16629) | |
1681061828.402410: Worker 0: training step 8333 done (global step: 16631) | |
1681061828.407769: Worker 0: training step 8334 done (global step: 16632) | |
1681061828.413934: Worker 0: training step 8335 done (global step: 16634) | |
1681061828.419658: Worker 0: training step 8336 done (global step: 16636) | |
1681061828.426037: Worker 0: training step 8337 done (global step: 16639) | |
1681061828.432428: Worker 0: training step 8338 done (global step: 16641) | |
1681061828.438107: Worker 0: training step 8339 done (global step: 16642) | |
1681061828.444469: Worker 0: training step 8340 done (global step: 16644) | |
1681061828.450515: Worker 0: training step 8341 done (global step: 16646) | |
1681061828.458433: Worker 0: training step 8342 done (global step: 16648) | |
1681061828.464983: Worker 0: training step 8343 done (global step: 16650) | |
1681061828.473164: Worker 0: training step 8344 done (global step: 16651) | |
1681061828.478440: Worker 0: training step 8345 done (global step: 16653) | |
1681061828.483741: Worker 0: training step 8346 done (global step: 16655) | |
1681061828.488945: Worker 0: training step 8347 done (global step: 16657) | |
1681061828.494675: Worker 0: training step 8348 done (global step: 16659) | |
1681061828.500146: Worker 0: training step 8349 done (global step: 16661) | |
1681061828.505494: Worker 0: training step 8350 done (global step: 16663) | |
1681061828.511036: Worker 0: training step 8351 done (global step: 16665) | |
1681061828.516270: Worker 0: training step 8352 done (global step: 16667) | |
1681061828.522100: Worker 0: training step 8353 done (global step: 16669) | |
1681061828.526986: Worker 0: training step 8354 done (global step: 16671) | |
1681061828.532268: Worker 0: training step 8355 done (global step: 16673) | |
1681061828.539029: Worker 0: training step 8356 done (global step: 16675) | |
1681061828.546033: Worker 0: training step 8357 done (global step: 16676) | |
1681061828.553080: Worker 0: training step 8358 done (global step: 16678) | |
1681061828.560277: Worker 0: training step 8359 done (global step: 16680) | |
1681061828.570578: Worker 0: training step 8360 done (global step: 16681) | |
1681061828.585890: Worker 0: training step 8361 done (global step: 16683) | |
1681061828.594234: Worker 0: training step 8362 done (global step: 16685) | |
1681061828.602694: Worker 0: training step 8363 done (global step: 16686) | |
1681061828.622503: Worker 0: training step 8364 done (global step: 16689) | |
1681061828.629098: Worker 0: training step 8365 done (global step: 16691) | |
1681061828.635849: Worker 0: training step 8366 done (global step: 16692) | |
1681061828.645302: Worker 0: training step 8367 done (global step: 16694) | |
1681061828.650818: Worker 0: training step 8368 done (global step: 16696) | |
1681061828.656557: Worker 0: training step 8369 done (global step: 16698) | |
1681061828.662485: Worker 0: training step 8370 done (global step: 16700) | |
1681061828.670675: Worker 0: training step 8371 done (global step: 16702) | |
1681061828.677542: Worker 0: training step 8372 done (global step: 16704) | |
1681061828.686738: Worker 0: training step 8373 done (global step: 16707) | |
1681061828.700735: Worker 0: training step 8374 done (global step: 16709) | |
1681061828.711714: Worker 0: training step 8375 done (global step: 16711) | |
1681061828.718799: Worker 0: training step 8376 done (global step: 16714) | |
1681061828.726012: Worker 0: training step 8377 done (global step: 16716) | |
1681061828.734911: Worker 0: training step 8378 done (global step: 16718) | |
1681061828.745893: Worker 0: training step 8379 done (global step: 16719) | |
1681061828.754654: Worker 0: training step 8380 done (global step: 16721) | |
1681061828.762673: Worker 0: training step 8381 done (global step: 16723) | |
1681061828.773091: Worker 0: training step 8382 done (global step: 16725) | |
1681061828.779814: Worker 0: training step 8383 done (global step: 16727) | |
1681061828.784881: Worker 0: training step 8384 done (global step: 16729) | |
1681061828.791669: Worker 0: training step 8385 done (global step: 16731) | |
1681061828.797014: Worker 0: training step 8386 done (global step: 16733) | |
1681061828.809341: Worker 0: training step 8387 done (global step: 16735) | |
1681061828.814852: Worker 0: training step 8388 done (global step: 16737) | |
1681061828.820633: Worker 0: training step 8389 done (global step: 16739) | |
1681061828.830273: Worker 0: training step 8390 done (global step: 16741) | |
1681061828.836040: Worker 0: training step 8391 done (global step: 16743) | |
1681061828.845774: Worker 0: training step 8392 done (global step: 16745) | |
1681061828.852893: Worker 0: training step 8393 done (global step: 16747) | |
1681061828.861286: Worker 0: training step 8394 done (global step: 16749) | |
1681061828.869129: Worker 0: training step 8395 done (global step: 16751) | |
1681061828.874083: Worker 0: training step 8396 done (global step: 16753) | |
1681061828.881697: Worker 0: training step 8397 done (global step: 16755) | |
1681061828.895549: Worker 0: training step 8398 done (global step: 16757) | |
1681061828.903845: Worker 0: training step 8399 done (global step: 16758) | |
1681061828.909441: Worker 0: training step 8400 done (global step: 16761) | |
1681061828.915167: Worker 0: training step 8401 done (global step: 16763) | |
1681061828.921559: Worker 0: training step 8402 done (global step: 16765) | |
1681061828.927012: Worker 0: training step 8403 done (global step: 16767) | |
1681061828.934417: Worker 0: training step 8404 done (global step: 16769) | |
1681061828.940475: Worker 0: training step 8405 done (global step: 16771) | |
1681061828.950647: Worker 0: training step 8406 done (global step: 16773) | |
1681061828.957920: Worker 0: training step 8407 done (global step: 16775) | |
1681061828.964433: Worker 0: training step 8408 done (global step: 16777) | |
1681061828.970328: Worker 0: training step 8409 done (global step: 16779) | |
1681061828.975820: Worker 0: training step 8410 done (global step: 16781) | |
1681061828.981269: Worker 0: training step 8411 done (global step: 16783) | |
1681061828.986595: Worker 0: training step 8412 done (global step: 16785) | |
1681061828.992081: Worker 0: training step 8413 done (global step: 16787) | |
1681061828.997438: Worker 0: training step 8414 done (global step: 16788) | |
1681061829.003134: Worker 0: training step 8415 done (global step: 16791) | |
1681061829.008735: Worker 0: training step 8416 done (global step: 16793) | |
1681061829.014729: Worker 0: training step 8417 done (global step: 16795) | |
1681061829.020515: Worker 0: training step 8418 done (global step: 16797) | |
1681061829.025925: Worker 0: training step 8419 done (global step: 16799) | |
1681061829.032103: Worker 0: training step 8420 done (global step: 16801) | |
1681061829.037483: Worker 0: training step 8421 done (global step: 16803) | |
1681061829.044039: Worker 0: training step 8422 done (global step: 16805) | |
1681061829.050542: Worker 0: training step 8423 done (global step: 16807) | |
1681061829.056533: Worker 0: training step 8424 done (global step: 16809) | |
1681061829.062847: Worker 0: training step 8425 done (global step: 16811) | |
1681061829.067967: Worker 0: training step 8426 done (global step: 16813) | |
1681061829.074751: Worker 0: training step 8427 done (global step: 16815) | |
1681061829.079950: Worker 0: training step 8428 done (global step: 16817) | |
1681061829.085269: Worker 0: training step 8429 done (global step: 16819) | |
1681061829.091062: Worker 0: training step 8430 done (global step: 16821) | |
1681061829.098443: Worker 0: training step 8431 done (global step: 16823) | |
1681061829.103382: Worker 0: training step 8432 done (global step: 16825) | |
1681061829.110178: Worker 0: training step 8433 done (global step: 16828) | |
1681061829.119496: Worker 0: training step 8434 done (global step: 16829) | |
1681061829.128900: Worker 0: training step 8435 done (global step: 16831) | |
1681061829.138424: Worker 0: training step 8436 done (global step: 16834) | |
1681061829.144719: Worker 0: training step 8437 done (global step: 16835) | |
1681061829.152978: Worker 0: training step 8438 done (global step: 16837) | |
1681061829.162131: Worker 0: training step 8439 done (global step: 16839) | |
1681061829.174987: Worker 0: training step 8440 done (global step: 16842) | |
1681061829.184309: Worker 0: training step 8441 done (global step: 16844) | |
1681061829.193789: Worker 0: training step 8442 done (global step: 16846) | |
1681061829.215116: Worker 0: training step 8443 done (global step: 16848) | |
1681061829.221849: Worker 0: training step 8444 done (global step: 16850) | |
1681061829.228886: Worker 0: training step 8445 done (global step: 16852) | |
1681061829.236376: Worker 0: training step 8446 done (global step: 16854) | |
1681061829.247592: Worker 0: training step 8447 done (global step: 16856) | |
1681061829.255884: Worker 0: training step 8448 done (global step: 16858) | |
1681061829.263323: Worker 0: training step 8449 done (global step: 16860) | |
1681061829.269154: Worker 0: training step 8450 done (global step: 16862) | |
1681061829.274056: Worker 0: training step 8451 done (global step: 16864) | |
1681061829.280450: Worker 0: training step 8452 done (global step: 16866) | |
1681061829.286882: Worker 0: training step 8453 done (global step: 16868) | |
1681061829.292883: Worker 0: training step 8454 done (global step: 16870) | |
1681061829.308773: Worker 0: training step 8455 done (global step: 16872) | |
1681061829.317491: Worker 0: training step 8456 done (global step: 16874) | |
1681061829.323102: Worker 0: training step 8457 done (global step: 16876) | |
1681061829.329063: Worker 0: training step 8458 done (global step: 16878) | |
1681061829.335325: Worker 0: training step 8459 done (global step: 16880) | |
1681061829.340838: Worker 0: training step 8460 done (global step: 16882) | |
1681061829.345892: Worker 0: training step 8461 done (global step: 16884) | |
1681061829.351446: Worker 0: training step 8462 done (global step: 16886) | |
1681061829.357014: Worker 0: training step 8463 done (global step: 16888) | |
1681061829.362621: Worker 0: training step 8464 done (global step: 16890) | |
1681061829.368685: Worker 0: training step 8465 done (global step: 16892) | |
1681061829.374766: Worker 0: training step 8466 done (global step: 16894) | |
1681061829.380109: Worker 0: training step 8467 done (global step: 16896) | |
1681061829.385019: Worker 0: training step 8468 done (global step: 16898) | |
1681061829.390600: Worker 0: training step 8469 done (global step: 16899) | |
1681061829.396527: Worker 0: training step 8470 done (global step: 16901) | |
1681061829.403999: Worker 0: training step 8471 done (global step: 16903) | |
1681061829.409745: Worker 0: training step 8472 done (global step: 16906) | |
1681061829.415154: Worker 0: training step 8473 done (global step: 16908) | |
1681061829.421072: Worker 0: training step 8474 done (global step: 16910) | |
1681061829.427417: Worker 0: training step 8475 done (global step: 16912) | |
1681061829.432868: Worker 0: training step 8476 done (global step: 16914) | |
1681061829.439891: Worker 0: training step 8477 done (global step: 16916) | |
1681061829.446250: Worker 0: training step 8478 done (global step: 16918) | |
1681061829.451798: Worker 0: training step 8479 done (global step: 16920) | |
1681061829.457475: Worker 0: training step 8480 done (global step: 16922) | |
1681061829.464116: Worker 0: training step 8481 done (global step: 16924) | |
1681061829.469665: Worker 0: training step 8482 done (global step: 16926) | |
1681061829.475767: Worker 0: training step 8483 done (global step: 16928) | |
1681061829.481386: Worker 0: training step 8484 done (global step: 16930) | |
1681061829.487188: Worker 0: training step 8485 done (global step: 16933) | |
1681061829.492771: Worker 0: training step 8486 done (global step: 16935) | |
1681061829.497884: Worker 0: training step 8487 done (global step: 16936) | |
1681061829.504858: Worker 0: training step 8488 done (global step: 16938) | |
1681061829.509788: Worker 0: training step 8489 done (global step: 16940) | |
1681061829.515937: Worker 0: training step 8490 done (global step: 16942) | |
1681061829.521023: Worker 0: training step 8491 done (global step: 16944) | |
1681061829.527165: Worker 0: training step 8492 done (global step: 16946) | |
1681061829.533635: Worker 0: training step 8493 done (global step: 16948) | |
1681061829.540700: Worker 0: training step 8494 done (global step: 16951) | |
1681061829.546517: Worker 0: training step 8495 done (global step: 16953) | |
1681061829.552888: Worker 0: training step 8496 done (global step: 16955) | |
1681061829.559261: Worker 0: training step 8497 done (global step: 16957) | |
1681061829.566266: Worker 0: training step 8498 done (global step: 16959) | |
1681061829.574577: Worker 0: training step 8499 done (global step: 16961) | |
1681061829.583510: Worker 0: training step 8500 done (global step: 16964) | |
1681061829.589067: Worker 0: training step 8501 done (global step: 16966) | |
1681061829.594704: Worker 0: training step 8502 done (global step: 16968) | |
1681061829.599735: Worker 0: training step 8503 done (global step: 16970) | |
1681061829.605311: Worker 0: training step 8504 done (global step: 16971) | |
1681061829.610600: Worker 0: training step 8505 done (global step: 16973) | |
1681061829.617767: Worker 0: training step 8506 done (global step: 16975) | |
1681061829.623744: Worker 0: training step 8507 done (global step: 16977) | |
1681061829.630149: Worker 0: training step 8508 done (global step: 16979) | |
1681061829.640057: Worker 0: training step 8509 done (global step: 16981) | |
1681061829.645604: Worker 0: training step 8510 done (global step: 16984) | |
1681061829.651551: Worker 0: training step 8511 done (global step: 16986) | |
1681061829.657143: Worker 0: training step 8512 done (global step: 16988) | |
1681061829.663288: Worker 0: training step 8513 done (global step: 16989) | |
1681061829.669327: Worker 0: training step 8514 done (global step: 16992) | |
1681061829.674407: Worker 0: training step 8515 done (global step: 16993) | |
1681061829.680061: Worker 0: training step 8516 done (global step: 16995) | |
1681061829.686913: Worker 0: training step 8517 done (global step: 16997) | |
1681061829.700217: Worker 0: training step 8518 done (global step: 17000) | |
1681061829.707366: Worker 0: training step 8519 done (global step: 17002) | |
1681061829.729248: Worker 0: training step 8520 done (global step: 17003) | |
1681061829.739852: Worker 0: training step 8521 done (global step: 17005) | |
1681061829.746626: Worker 0: training step 8522 done (global step: 17007) | |
1681061829.753789: Worker 0: training step 8523 done (global step: 17009) | |
1681061829.762133: Worker 0: training step 8524 done (global step: 17012) | |
1681061829.768846: Worker 0: training step 8525 done (global step: 17013) | |
1681061829.776467: Worker 0: training step 8526 done (global step: 17015) | |
1681061829.791013: Worker 0: training step 8527 done (global step: 17017) | |
1681061829.800755: Worker 0: training step 8528 done (global step: 17019) | |
1681061829.811598: Worker 0: training step 8529 done (global step: 17021) | |
1681061829.820816: Worker 0: training step 8530 done (global step: 17023) | |
1681061829.830499: Worker 0: training step 8531 done (global step: 17026) | |
1681061829.838970: Worker 0: training step 8532 done (global step: 17029) | |
1681061829.845233: Worker 0: training step 8533 done (global step: 17031) | |
1681061829.852794: Worker 0: training step 8534 done (global step: 17032) | |
1681061829.861702: Worker 0: training step 8535 done (global step: 17034) | |
1681061829.870239: Worker 0: training step 8536 done (global step: 17036) | |
1681061829.878239: Worker 0: training step 8537 done (global step: 17039) | |
1681061829.885506: Worker 0: training step 8538 done (global step: 17041) | |
1681061829.896292: Worker 0: training step 8539 done (global step: 17043) | |
1681061829.909554: Worker 0: training step 8540 done (global step: 17045) | |
1681061829.916875: Worker 0: training step 8541 done (global step: 17047) | |
1681061829.929792: Worker 0: training step 8542 done (global step: 17049) | |
1681061829.938023: Worker 0: training step 8543 done (global step: 17051) | |
1681061829.945307: Worker 0: training step 8544 done (global step: 17053) | |
1681061829.954064: Worker 0: training step 8545 done (global step: 17056) | |
1681061829.963785: Worker 0: training step 8546 done (global step: 17058) | |
1681061829.972117: Worker 0: training step 8547 done (global step: 17059) | |
1681061829.985346: Worker 0: training step 8548 done (global step: 17062) | |
1681061830.001830: Worker 0: training step 8549 done (global step: 17064) | |
1681061830.028577: Worker 0: training step 8550 done (global step: 17066) | |
1681061830.053763: Worker 0: training step 8551 done (global step: 17068) | |
1681061830.068790: Worker 0: training step 8552 done (global step: 17070) | |
1681061830.089593: Worker 0: training step 8553 done (global step: 17073) | |
1681061830.101476: Worker 0: training step 8554 done (global step: 17074) | |
1681061830.127289: Worker 0: training step 8555 done (global step: 17076) | |
1681061830.145479: Worker 0: training step 8556 done (global step: 17078) | |
1681061830.160353: Worker 0: training step 8557 done (global step: 17080) | |
1681061830.167905: Worker 0: training step 8558 done (global step: 17082) | |
1681061830.176692: Worker 0: training step 8559 done (global step: 17084) | |
1681061830.186385: Worker 0: training step 8560 done (global step: 17087) | |
1681061830.192514: Worker 0: training step 8561 done (global step: 17089) | |
1681061830.198095: Worker 0: training step 8562 done (global step: 17091) | |
1681061830.206712: Worker 0: training step 8563 done (global step: 17092) | |
1681061830.212916: Worker 0: training step 8564 done (global step: 17094) | |
1681061830.220587: Worker 0: training step 8565 done (global step: 17096) | |
1681061830.231680: Worker 0: training step 8566 done (global step: 17098) | |
1681061830.239826: Worker 0: training step 8567 done (global step: 17100) | |
1681061830.246790: Worker 0: training step 8568 done (global step: 17102) | |
1681061830.254370: Worker 0: training step 8569 done (global step: 17104) | |
1681061830.261561: Worker 0: training step 8570 done (global step: 17106) | |
1681061830.270112: Worker 0: training step 8571 done (global step: 17108) | |
1681061830.278877: Worker 0: training step 8572 done (global step: 17110) | |
1681061830.292305: Worker 0: training step 8573 done (global step: 17112) | |
1681061830.302435: Worker 0: training step 8574 done (global step: 17114) | |
1681061830.312873: Worker 0: training step 8575 done (global step: 17115) | |
1681061830.326501: Worker 0: training step 8576 done (global step: 17117) | |
1681061830.340668: Worker 0: training step 8577 done (global step: 17119) | |
1681061830.355678: Worker 0: training step 8578 done (global step: 17121) | |
1681061830.362998: Worker 0: training step 8579 done (global step: 17123) | |
1681061830.370342: Worker 0: training step 8580 done (global step: 17125) | |
1681061830.375974: Worker 0: training step 8581 done (global step: 17127) | |
1681061830.381776: Worker 0: training step 8582 done (global step: 17129) | |
1681061830.388483: Worker 0: training step 8583 done (global step: 17131) | |
1681061830.393580: Worker 0: training step 8584 done (global step: 17133) | |
1681061830.400058: Worker 0: training step 8585 done (global step: 17135) | |
1681061830.405227: Worker 0: training step 8586 done (global step: 17137) | |
1681061830.411108: Worker 0: training step 8587 done (global step: 17139) | |
1681061830.416651: Worker 0: training step 8588 done (global step: 17141) | |
1681061830.423251: Worker 0: training step 8589 done (global step: 17143) | |
1681061830.428866: Worker 0: training step 8590 done (global step: 17145) | |
1681061830.434859: Worker 0: training step 8591 done (global step: 17147) | |
1681061830.442039: Worker 0: training step 8592 done (global step: 17149) | |
1681061830.447269: Worker 0: training step 8593 done (global step: 17151) | |
1681061830.452999: Worker 0: training step 8594 done (global step: 17153) | |
1681061830.461175: Worker 0: training step 8595 done (global step: 17155) | |
1681061830.469191: Worker 0: training step 8596 done (global step: 17157) | |
1681061830.475260: Worker 0: training step 8597 done (global step: 17159) | |
1681061830.479542: Worker 0: training step 8598 done (global step: 17161) | |
1681061830.485076: Worker 0: training step 8599 done (global step: 17162) | |
1681061830.490560: Worker 0: training step 8600 done (global step: 17164) | |
1681061830.496144: Worker 0: training step 8601 done (global step: 17166) | |
1681061830.506419: Worker 0: training step 8602 done (global step: 17168) | |
1681061830.516645: Worker 0: training step 8603 done (global step: 17170) | |
1681061830.524068: Worker 0: training step 8604 done (global step: 17172) | |
1681061830.531739: Worker 0: training step 8605 done (global step: 17174) | |
1681061830.541156: Worker 0: training step 8606 done (global step: 17176) | |
1681061830.551070: Worker 0: training step 8607 done (global step: 17178) | |
1681061830.559200: Worker 0: training step 8608 done (global step: 17180) | |
1681061830.564477: Worker 0: training step 8609 done (global step: 17182) | |
1681061830.572226: Worker 0: training step 8610 done (global step: 17184) | |
1681061830.582464: Worker 0: training step 8611 done (global step: 17186) | |
1681061830.587989: Worker 0: training step 8612 done (global step: 17188) | |
1681061830.593213: Worker 0: training step 8613 done (global step: 17190) | |
1681061830.599393: Worker 0: training step 8614 done (global step: 17192) | |
1681061830.605322: Worker 0: training step 8615 done (global step: 17194) | |
1681061830.610687: Worker 0: training step 8616 done (global step: 17196) | |
1681061830.616105: Worker 0: training step 8617 done (global step: 17198) | |
1681061830.621628: Worker 0: training step 8618 done (global step: 17200) | |
1681061830.627357: Worker 0: training step 8619 done (global step: 17202) | |
1681061830.633071: Worker 0: training step 8620 done (global step: 17204) | |
1681061830.638122: Worker 0: training step 8621 done (global step: 17206) | |
1681061830.645444: Worker 0: training step 8622 done (global step: 17208) | |
1681061830.650815: Worker 0: training step 8623 done (global step: 17210) | |
1681061830.656418: Worker 0: training step 8624 done (global step: 17212) | |
1681061830.663845: Worker 0: training step 8625 done (global step: 17214) | |
1681061830.670304: Worker 0: training step 8626 done (global step: 17217) | |
1681061830.675789: Worker 0: training step 8627 done (global step: 17219) | |
1681061830.682018: Worker 0: training step 8628 done (global step: 17221) | |
1681061830.687494: Worker 0: training step 8629 done (global step: 17223) | |
1681061830.693119: Worker 0: training step 8630 done (global step: 17225) | |
1681061830.698437: Worker 0: training step 8631 done (global step: 17227) | |
1681061830.704053: Worker 0: training step 8632 done (global step: 17229) | |
1681061830.710166: Worker 0: training step 8633 done (global step: 17231) | |
1681061830.716644: Worker 0: training step 8634 done (global step: 17233) | |
1681061830.721853: Worker 0: training step 8635 done (global step: 17235) | |
1681061830.728100: Worker 0: training step 8636 done (global step: 17237) | |
1681061830.734715: Worker 0: training step 8637 done (global step: 17239) | |
1681061830.740646: Worker 0: training step 8638 done (global step: 17241) | |
1681061830.745565: Worker 0: training step 8639 done (global step: 17243) | |
1681061830.751178: Worker 0: training step 8640 done (global step: 17245) | |
1681061830.758112: Worker 0: training step 8641 done (global step: 17247) | |
1681061830.765006: Worker 0: training step 8642 done (global step: 17249) | |
1681061830.770797: Worker 0: training step 8643 done (global step: 17251) | |
1681061830.776194: Worker 0: training step 8644 done (global step: 17253) | |
1681061830.781785: Worker 0: training step 8645 done (global step: 17255) | |
1681061830.786596: Worker 0: training step 8646 done (global step: 17257) | |
1681061830.791922: Worker 0: training step 8647 done (global step: 17259) | |
1681061830.799872: Worker 0: training step 8648 done (global step: 17261) | |
1681061830.805997: Worker 0: training step 8649 done (global step: 17264) | |
1681061830.815253: Worker 0: training step 8650 done (global step: 17266) | |
1681061830.826100: Worker 0: training step 8651 done (global step: 17269) | |
1681061830.832569: Worker 0: training step 8652 done (global step: 17270) | |
1681061830.838341: Worker 0: training step 8653 done (global step: 17273) | |
1681061830.845061: Worker 0: training step 8654 done (global step: 17275) | |
1681061830.851921: Worker 0: training step 8655 done (global step: 17277) | |
1681061830.857665: Worker 0: training step 8656 done (global step: 17279) | |
1681061830.863194: Worker 0: training step 8657 done (global step: 17281) | |
1681061830.868367: Worker 0: training step 8658 done (global step: 17283) | |
1681061830.873744: Worker 0: training step 8659 done (global step: 17285) | |
1681061830.880294: Worker 0: training step 8660 done (global step: 17287) | |
1681061830.886691: Worker 0: training step 8661 done (global step: 17289) | |
1681061830.898002: Worker 0: training step 8662 done (global step: 17291) | |
1681061830.908210: Worker 0: training step 8663 done (global step: 17293) | |
1681061830.919312: Worker 0: training step 8664 done (global step: 17295) | |
1681061830.927684: Worker 0: training step 8665 done (global step: 17297) | |
1681061830.941026: Worker 0: training step 8666 done (global step: 17299) | |
1681061830.953946: Worker 0: training step 8667 done (global step: 17302) | |
1681061830.963247: Worker 0: training step 8668 done (global step: 17304) | |
1681061830.969994: Worker 0: training step 8669 done (global step: 17306) | |
1681061830.976871: Worker 0: training step 8670 done (global step: 17308) | |
1681061830.985040: Worker 0: training step 8671 done (global step: 17310) | |
1681061830.993388: Worker 0: training step 8672 done (global step: 17312) | |
1681061831.001431: Worker 0: training step 8673 done (global step: 17314) | |
1681061831.014945: Worker 0: training step 8674 done (global step: 17316) | |
1681061831.051777: Worker 0: training step 8675 done (global step: 17318) | |
1681061831.066149: Worker 0: training step 8676 done (global step: 17322) | |
1681061831.074966: Worker 0: training step 8677 done (global step: 17324) | |
1681061831.086875: Worker 0: training step 8678 done (global step: 17326) | |
1681061831.104431: Worker 0: training step 8679 done (global step: 17328) | |
1681061831.122293: Worker 0: training step 8680 done (global step: 17330) | |
1681061831.132040: Worker 0: training step 8681 done (global step: 17332) | |
1681061831.143536: Worker 0: training step 8682 done (global step: 17334) | |
1681061831.150706: Worker 0: training step 8683 done (global step: 17336) | |
1681061831.156937: Worker 0: training step 8684 done (global step: 17338) | |
1681061831.161992: Worker 0: training step 8685 done (global step: 17340) | |
1681061831.167943: Worker 0: training step 8686 done (global step: 17342) | |
1681061831.173740: Worker 0: training step 8687 done (global step: 17344) | |
1681061831.181201: Worker 0: training step 8688 done (global step: 17346) | |
1681061831.187171: Worker 0: training step 8689 done (global step: 17348) | |
1681061831.194809: Worker 0: training step 8690 done (global step: 17350) | |
1681061831.200969: Worker 0: training step 8691 done (global step: 17353) | |
1681061831.207635: Worker 0: training step 8692 done (global step: 17355) | |
1681061831.212879: Worker 0: training step 8693 done (global step: 17357) | |
1681061831.218514: Worker 0: training step 8694 done (global step: 17359) | |
1681061831.223971: Worker 0: training step 8695 done (global step: 17361) | |
1681061831.229459: Worker 0: training step 8696 done (global step: 17363) | |
1681061831.235437: Worker 0: training step 8697 done (global step: 17365) | |
1681061831.241023: Worker 0: training step 8698 done (global step: 17367) | |
1681061831.245943: Worker 0: training step 8699 done (global step: 17368) | |
1681061831.251375: Worker 0: training step 8700 done (global step: 17370) | |
1681061831.256905: Worker 0: training step 8701 done (global step: 17372) | |
1681061831.266840: Worker 0: training step 8702 done (global step: 17375) | |
1681061831.273773: Worker 0: training step 8703 done (global step: 17377) | |
1681061831.280474: Worker 0: training step 8704 done (global step: 17379) | |
1681061831.288722: Worker 0: training step 8705 done (global step: 17381) | |
1681061831.295650: Worker 0: training step 8706 done (global step: 17383) | |
1681061831.301272: Worker 0: training step 8707 done (global step: 17385) | |
1681061831.316768: Worker 0: training step 8708 done (global step: 17388) | |
1681061831.326562: Worker 0: training step 8709 done (global step: 17389) | |
1681061831.334392: Worker 0: training step 8710 done (global step: 17392) | |
1681061831.345592: Worker 0: training step 8711 done (global step: 17393) | |
1681061831.353387: Worker 0: training step 8712 done (global step: 17395) | |
1681061831.359395: Worker 0: training step 8713 done (global step: 17398) | |
1681061831.364942: Worker 0: training step 8714 done (global step: 17400) | |
1681061831.372320: Worker 0: training step 8715 done (global step: 17402) | |
1681061831.378191: Worker 0: training step 8716 done (global step: 17404) | |
1681061831.383506: Worker 0: training step 8717 done (global step: 17406) | |
1681061831.389868: Worker 0: training step 8718 done (global step: 17408) | |
1681061831.398916: Worker 0: training step 8719 done (global step: 17410) | |
1681061831.405839: Worker 0: training step 8720 done (global step: 17412) | |
1681061831.411336: Worker 0: training step 8721 done (global step: 17414) | |
1681061831.416959: Worker 0: training step 8722 done (global step: 17416) | |
1681061831.423056: Worker 0: training step 8723 done (global step: 17418) | |
1681061831.429526: Worker 0: training step 8724 done (global step: 17420) | |
1681061831.434040: Worker 0: training step 8725 done (global step: 17421) | |
1681061831.442583: Worker 0: training step 8726 done (global step: 17423) | |
1681061831.447929: Worker 0: training step 8727 done (global step: 17426) | |
1681061831.453787: Worker 0: training step 8728 done (global step: 17427) | |
1681061831.460223: Worker 0: training step 8729 done (global step: 17429) | |
1681061831.465589: Worker 0: training step 8730 done (global step: 17431) | |
1681061831.470934: Worker 0: training step 8731 done (global step: 17433) | |
1681061831.476528: Worker 0: training step 8732 done (global step: 17435) | |
1681061831.481300: Worker 0: training step 8733 done (global step: 17437) | |
1681061831.486337: Worker 0: training step 8734 done (global step: 17439) | |
1681061831.491763: Worker 0: training step 8735 done (global step: 17440) | |
1681061831.498414: Worker 0: training step 8736 done (global step: 17442) | |
1681061831.506054: Worker 0: training step 8737 done (global step: 17444) | |
1681061831.513602: Worker 0: training step 8738 done (global step: 17446) | |
1681061831.520648: Worker 0: training step 8739 done (global step: 17449) | |
1681061831.527241: Worker 0: training step 8740 done (global step: 17451) | |
1681061831.537406: Worker 0: training step 8741 done (global step: 17453) | |
1681061831.550642: Worker 0: training step 8742 done (global step: 17455) | |
1681061831.558836: Worker 0: training step 8743 done (global step: 17457) | |
1681061831.581140: Worker 0: training step 8744 done (global step: 17459) | |
1681061831.597042: Worker 0: training step 8745 done (global step: 17461) | |
1681061831.621463: Worker 0: training step 8746 done (global step: 17463) | |
1681061831.633012: Worker 0: training step 8747 done (global step: 17466) | |
1681061831.639822: Worker 0: training step 8748 done (global step: 17467) | |
1681061831.646770: Worker 0: training step 8749 done (global step: 17469) | |
1681061831.656547: Worker 0: training step 8750 done (global step: 17471) | |
1681061831.664260: Worker 0: training step 8751 done (global step: 17473) | |
1681061831.669635: Worker 0: training step 8752 done (global step: 17475) | |
1681061831.674659: Worker 0: training step 8753 done (global step: 17477) | |
1681061831.680018: Worker 0: training step 8754 done (global step: 17478) | |
1681061831.685086: Worker 0: training step 8755 done (global step: 17480) | |
1681061831.690228: Worker 0: training step 8756 done (global step: 17482) | |
1681061831.695802: Worker 0: training step 8757 done (global step: 17484) | |
1681061831.700970: Worker 0: training step 8758 done (global step: 17486) | |
1681061831.707516: Worker 0: training step 8759 done (global step: 17488) | |
1681061831.714827: Worker 0: training step 8760 done (global step: 17490) | |
1681061831.721004: Worker 0: training step 8761 done (global step: 17492) | |
1681061831.728691: Worker 0: training step 8762 done (global step: 17494) | |
1681061831.741956: Worker 0: training step 8763 done (global step: 17496) | |
1681061831.750967: Worker 0: training step 8764 done (global step: 17498) | |
1681061831.760924: Worker 0: training step 8765 done (global step: 17500) | |
1681061831.766249: Worker 0: training step 8766 done (global step: 17502) | |
1681061831.771509: Worker 0: training step 8767 done (global step: 17503) | |
1681061831.776647: Worker 0: training step 8768 done (global step: 17505) | |
1681061831.783238: Worker 0: training step 8769 done (global step: 17508) | |
1681061831.789469: Worker 0: training step 8770 done (global step: 17510) | |
1681061831.794479: Worker 0: training step 8771 done (global step: 17512) | |
1681061831.800345: Worker 0: training step 8772 done (global step: 17514) | |
1681061831.806575: Worker 0: training step 8773 done (global step: 17516) | |
1681061831.811679: Worker 0: training step 8774 done (global step: 17518) | |
1681061831.817817: Worker 0: training step 8775 done (global step: 17520) | |
1681061831.823832: Worker 0: training step 8776 done (global step: 17522) | |
1681061831.829754: Worker 0: training step 8777 done (global step: 17524) | |
1681061831.837809: Worker 0: training step 8778 done (global step: 17526) | |
1681061831.844123: Worker 0: training step 8779 done (global step: 17528) | |
1681061831.850193: Worker 0: training step 8780 done (global step: 17530) | |
1681061831.855826: Worker 0: training step 8781 done (global step: 17532) | |
1681061831.860714: Worker 0: training step 8782 done (global step: 17534) | |
1681061831.865752: Worker 0: training step 8783 done (global step: 17536) | |
1681061831.870832: Worker 0: training step 8784 done (global step: 17538) | |
1681061831.876936: Worker 0: training step 8785 done (global step: 17540) | |
1681061831.882479: Worker 0: training step 8786 done (global step: 17542) | |
1681061831.889045: Worker 0: training step 8787 done (global step: 17544) | |
1681061831.895748: Worker 0: training step 8788 done (global step: 17546) | |
1681061831.902335: Worker 0: training step 8789 done (global step: 17548) | |
1681061831.908368: Worker 0: training step 8790 done (global step: 17550) | |
1681061831.914580: Worker 0: training step 8791 done (global step: 17553) | |
1681061831.920497: Worker 0: training step 8792 done (global step: 17555) | |
1681061831.927245: Worker 0: training step 8793 done (global step: 17557) | |
1681061831.933283: Worker 0: training step 8794 done (global step: 17559) | |
1681061831.939386: Worker 0: training step 8795 done (global step: 17561) | |
1681061831.944894: Worker 0: training step 8796 done (global step: 17563) | |
1681061831.950471: Worker 0: training step 8797 done (global step: 17565) | |
1681061831.955584: Worker 0: training step 8798 done (global step: 17567) | |
1681061831.961788: Worker 0: training step 8799 done (global step: 17569) | |
1681061831.967906: Worker 0: training step 8800 done (global step: 17571) | |
1681061832.138671: Worker 0: training step 8801 done (global step: 17591) | |
1681061832.146979: Worker 0: training step 8802 done (global step: 17592) | |
1681061832.161387: Worker 0: training step 8803 done (global step: 17593) | |
1681061832.177890: Worker 0: training step 8804 done (global step: 17594) | |
1681061832.199224: Worker 0: training step 8805 done (global step: 17595) | |
1681061832.217273: Worker 0: training step 8806 done (global step: 17596) | |
1681061832.227447: Worker 0: training step 8807 done (global step: 17597) | |
1681061832.238143: Worker 0: training step 8808 done (global step: 17598) | |
1681061832.246630: Worker 0: training step 8809 done (global step: 17599) | |
1681061832.258019: Worker 0: training step 8810 done (global step: 17600) | |
1681061832.267843: Worker 0: training step 8811 done (global step: 17602) | |
1681061832.274241: Worker 0: training step 8812 done (global step: 17604) | |
1681061832.281862: Worker 0: training step 8813 done (global step: 17605) | |
1681061832.288514: Worker 0: training step 8814 done (global step: 17607) | |
1681061832.296713: Worker 0: training step 8815 done (global step: 17609) | |
1681061832.325951: Worker 0: training step 8816 done (global step: 17611) | |
1681061832.333865: Worker 0: training step 8817 done (global step: 17613) | |
1681061832.346989: Worker 0: training step 8818 done (global step: 17615) | |
1681061832.376751: Worker 0: training step 8819 done (global step: 17617) | |
1681061832.388149: Worker 0: training step 8820 done (global step: 17620) | |
1681061832.396312: Worker 0: training step 8821 done (global step: 17622) | |
1681061832.405377: Worker 0: training step 8822 done (global step: 17623) | |
1681061832.423252: Worker 0: training step 8823 done (global step: 17625) | |
1681061832.432103: Worker 0: training step 8824 done (global step: 17627) | |
1681061832.442316: Worker 0: training step 8825 done (global step: 17628) | |
1681061832.456871: Worker 0: training step 8826 done (global step: 17631) | |
1681061832.491506: Worker 0: training step 8827 done (global step: 17633) | |
1681061832.500794: Worker 0: training step 8828 done (global step: 17636) | |
1681061832.508469: Worker 0: training step 8829 done (global step: 17638) | |
1681061832.515773: Worker 0: training step 8830 done (global step: 17641) | |
1681061832.526998: Worker 0: training step 8831 done (global step: 17642) | |
1681061832.573317: Worker 0: training step 8832 done (global step: 17644) | |
1681061832.586792: Worker 0: training step 8833 done (global step: 17646) | |
1681061832.595098: Worker 0: training step 8834 done (global step: 17648) | |
1681061832.607976: Worker 0: training step 8835 done (global step: 17649) | |
1681061832.616219: Worker 0: training step 8836 done (global step: 17652) | |
1681061832.621843: Worker 0: training step 8837 done (global step: 17654) | |
1681061832.627274: Worker 0: training step 8838 done (global step: 17656) | |
1681061832.633274: Worker 0: training step 8839 done (global step: 17657) | |
1681061832.638577: Worker 0: training step 8840 done (global step: 17659) | |
1681061832.644480: Worker 0: training step 8841 done (global step: 17661) | |
1681061832.650343: Worker 0: training step 8842 done (global step: 17663) | |
1681061832.655141: Worker 0: training step 8843 done (global step: 17665) | |
1681061832.659639: Worker 0: training step 8844 done (global step: 17667) | |
1681061832.664743: Worker 0: training step 8845 done (global step: 17669) | |
1681061832.670022: Worker 0: training step 8846 done (global step: 17671) | |
1681061832.674519: Worker 0: training step 8847 done (global step: 17672) | |
1681061832.681180: Worker 0: training step 8848 done (global step: 17674) | |
1681061832.688678: Worker 0: training step 8849 done (global step: 17676) | |
1681061832.698023: Worker 0: training step 8850 done (global step: 17677) | |
1681061832.708522: Worker 0: training step 8851 done (global step: 17679) | |
1681061832.734593: Worker 0: training step 8852 done (global step: 17681) | |
1681061832.761716: Worker 0: training step 8853 done (global step: 17683) | |
1681061832.786400: Worker 0: training step 8854 done (global step: 17685) | |
1681061832.808412: Worker 0: training step 8855 done (global step: 17687) | |
1681061832.829338: Worker 0: training step 8856 done (global step: 17689) | |
1681061832.846223: Worker 0: training step 8857 done (global step: 17691) | |
1681061832.854894: Worker 0: training step 8858 done (global step: 17692) | |
1681061832.866548: Worker 0: training step 8859 done (global step: 17694) | |
1681061832.877861: Worker 0: training step 8860 done (global step: 17696) | |
1681061832.889520: Worker 0: training step 8861 done (global step: 17698) | |
1681061832.915846: Worker 0: training step 8862 done (global step: 17699) | |
1681061832.928337: Worker 0: training step 8863 done (global step: 17701) | |
1681061832.941792: Worker 0: training step 8864 done (global step: 17703) | |
1681061832.954468: Worker 0: training step 8865 done (global step: 17705) | |
1681061832.970589: Worker 0: training step 8866 done (global step: 17707) | |
1681061832.981540: Worker 0: training step 8867 done (global step: 17710) | |
1681061832.993058: Worker 0: training step 8868 done (global step: 17712) | |
1681061833.006079: Worker 0: training step 8869 done (global step: 17714) | |
1681061833.014346: Worker 0: training step 8870 done (global step: 17716) | |
1681061833.021839: Worker 0: training step 8871 done (global step: 17718) | |
1681061833.029414: Worker 0: training step 8872 done (global step: 17720) | |
1681061833.037564: Worker 0: training step 8873 done (global step: 17722) | |
1681061833.045603: Worker 0: training step 8874 done (global step: 17724) | |
1681061833.054265: Worker 0: training step 8875 done (global step: 17726) | |
1681061833.059974: Worker 0: training step 8876 done (global step: 17728) | |
1681061833.067665: Worker 0: training step 8877 done (global step: 17729) | |
1681061833.075691: Worker 0: training step 8878 done (global step: 17731) | |
1681061833.084838: Worker 0: training step 8879 done (global step: 17733) | |
1681061833.093258: Worker 0: training step 8880 done (global step: 17735) | |
1681061833.099927: Worker 0: training step 8881 done (global step: 17738) | |
1681061833.108271: Worker 0: training step 8882 done (global step: 17739) | |
1681061833.115455: Worker 0: training step 8883 done (global step: 17741) | |
1681061833.126270: Worker 0: training step 8884 done (global step: 17743) | |
1681061833.135462: Worker 0: training step 8885 done (global step: 17746) | |
1681061833.143772: Worker 0: training step 8886 done (global step: 17748) | |
1681061833.150973: Worker 0: training step 8887 done (global step: 17750) | |
1681061833.158837: Worker 0: training step 8888 done (global step: 17752) | |
1681061833.165782: Worker 0: training step 8889 done (global step: 17754) | |
1681061833.172501: Worker 0: training step 8890 done (global step: 17756) | |
1681061833.179826: Worker 0: training step 8891 done (global step: 17757) | |
1681061833.187859: Worker 0: training step 8892 done (global step: 17759) | |
1681061833.194600: Worker 0: training step 8893 done (global step: 17761) | |
1681061833.210270: Worker 0: training step 8894 done (global step: 17763) | |
1681061833.225354: Worker 0: training step 8895 done (global step: 17766) | |
1681061833.242810: Worker 0: training step 8896 done (global step: 17768) | |
1681061833.256058: Worker 0: training step 8897 done (global step: 17770) | |
1681061833.279634: Worker 0: training step 8898 done (global step: 17772) | |
1681061833.287410: Worker 0: training step 8899 done (global step: 17774) | |
1681061833.306671: Worker 0: training step 8900 done (global step: 17776) | |
1681061833.324239: Worker 0: training step 8901 done (global step: 17778) | |
1681061833.335407: Worker 0: training step 8902 done (global step: 17781) | |
1681061833.343158: Worker 0: training step 8903 done (global step: 17783) | |
1681061833.349326: Worker 0: training step 8904 done (global step: 17785) | |
1681061833.355160: Worker 0: training step 8905 done (global step: 17787) | |
1681061833.361507: Worker 0: training step 8906 done (global step: 17789) | |
1681061833.366929: Worker 0: training step 8907 done (global step: 17791) | |
1681061833.372731: Worker 0: training step 8908 done (global step: 17793) | |
1681061833.378192: Worker 0: training step 8909 done (global step: 17795) | |
1681061833.384586: Worker 0: training step 8910 done (global step: 17797) | |
1681061833.391070: Worker 0: training step 8911 done (global step: 17799) | |
1681061833.396205: Worker 0: training step 8912 done (global step: 17801) | |
1681061833.402697: Worker 0: training step 8913 done (global step: 17803) | |
1681061833.408168: Worker 0: training step 8914 done (global step: 17805) | |
1681061833.413404: Worker 0: training step 8915 done (global step: 17807) | |
1681061833.418678: Worker 0: training step 8916 done (global step: 17809) | |
1681061833.424799: Worker 0: training step 8917 done (global step: 17811) | |
1681061833.430469: Worker 0: training step 8918 done (global step: 17813) | |
1681061833.435766: Worker 0: training step 8919 done (global step: 17815) | |
1681061833.441706: Worker 0: training step 8920 done (global step: 17817) | |
1681061833.447538: Worker 0: training step 8921 done (global step: 17819) | |
1681061833.453277: Worker 0: training step 8922 done (global step: 17821) | |
1681061833.459282: Worker 0: training step 8923 done (global step: 17823) | |
1681061833.465041: Worker 0: training step 8924 done (global step: 17825) | |
1681061833.471967: Worker 0: training step 8925 done (global step: 17827) | |
1681061833.477096: Worker 0: training step 8926 done (global step: 17829) | |
1681061833.482669: Worker 0: training step 8927 done (global step: 17831) | |
1681061833.487943: Worker 0: training step 8928 done (global step: 17833) | |
1681061833.494232: Worker 0: training step 8929 done (global step: 17835) | |
1681061833.508035: Worker 0: training step 8930 done (global step: 17837) | |
1681061833.517187: Worker 0: training step 8931 done (global step: 17839) | |
1681061833.523340: Worker 0: training step 8932 done (global step: 17841) | |
1681061833.528811: Worker 0: training step 8933 done (global step: 17843) | |
1681061833.535861: Worker 0: training step 8934 done (global step: 17845) | |
1681061833.542035: Worker 0: training step 8935 done (global step: 17847) | |
1681061833.548364: Worker 0: training step 8936 done (global step: 17849) | |
1681061833.553866: Worker 0: training step 8937 done (global step: 17851) | |
1681061833.558455: Worker 0: training step 8938 done (global step: 17853) | |
1681061833.565123: Worker 0: training step 8939 done (global step: 17855) | |
1681061833.573595: Worker 0: training step 8940 done (global step: 17857) | |
1681061833.582235: Worker 0: training step 8941 done (global step: 17860) | |
1681061833.592317: Worker 0: training step 8942 done (global step: 17862) | |
1681061833.602301: Worker 0: training step 8943 done (global step: 17864) | |
1681061833.609987: Worker 0: training step 8944 done (global step: 17866) | |
1681061833.614642: Worker 0: training step 8945 done (global step: 17868) | |
1681061833.620998: Worker 0: training step 8946 done (global step: 17870) | |
1681061833.627094: Worker 0: training step 8947 done (global step: 17872) | |
1681061833.632734: Worker 0: training step 8948 done (global step: 17875) | |
1681061833.639709: Worker 0: training step 8949 done (global step: 17876) | |
1681061833.645805: Worker 0: training step 8950 done (global step: 17878) | |
1681061833.651033: Worker 0: training step 8951 done (global step: 17880) | |
1681061833.656255: Worker 0: training step 8952 done (global step: 17882) | |
1681061833.661631: Worker 0: training step 8953 done (global step: 17884) | |
1681061833.666793: Worker 0: training step 8954 done (global step: 17886) | |
1681061833.674198: Worker 0: training step 8955 done (global step: 17888) | |
1681061833.685425: Worker 0: training step 8956 done (global step: 17890) | |
1681061833.699173: Worker 0: training step 8957 done (global step: 17892) | |
1681061833.709966: Worker 0: training step 8958 done (global step: 17894) | |
1681061833.719960: Worker 0: training step 8959 done (global step: 17896) | |
1681061833.731814: Worker 0: training step 8960 done (global step: 17898) | |
1681061833.743951: Worker 0: training step 8961 done (global step: 17900) | |
1681061833.751944: Worker 0: training step 8962 done (global step: 17902) | |
1681061833.788229: Worker 0: training step 8963 done (global step: 17904) | |
1681061833.810745: Worker 0: training step 8964 done (global step: 17906) | |
1681061833.819908: Worker 0: training step 8965 done (global step: 17908) | |
1681061833.825124: Worker 0: training step 8966 done (global step: 17911) | |
1681061833.830522: Worker 0: training step 8967 done (global step: 17912) | |
1681061833.835541: Worker 0: training step 8968 done (global step: 17914) | |
1681061833.841450: Worker 0: training step 8969 done (global step: 17916) | |
1681061833.846514: Worker 0: training step 8970 done (global step: 17918) | |
1681061833.851700: Worker 0: training step 8971 done (global step: 17920) | |
1681061833.856232: Worker 0: training step 8972 done (global step: 17922) | |
1681061833.861279: Worker 0: training step 8973 done (global step: 17924) | |
1681061833.866941: Worker 0: training step 8974 done (global step: 17926) | |
1681061833.872978: Worker 0: training step 8975 done (global step: 17928) | |
1681061833.878802: Worker 0: training step 8976 done (global step: 17930) | |
1681061833.884384: Worker 0: training step 8977 done (global step: 17932) | |
1681061833.891111: Worker 0: training step 8978 done (global step: 17934) | |
1681061833.896873: Worker 0: training step 8979 done (global step: 17936) | |
1681061833.903304: Worker 0: training step 8980 done (global step: 17938) | |
1681061833.908844: Worker 0: training step 8981 done (global step: 17940) | |
1681061833.914931: Worker 0: training step 8982 done (global step: 17942) | |
1681061833.920460: Worker 0: training step 8983 done (global step: 17944) | |
1681061833.925543: Worker 0: training step 8984 done (global step: 17946) | |
1681061833.931087: Worker 0: training step 8985 done (global step: 17948) | |
1681061833.936108: Worker 0: training step 8986 done (global step: 17950) | |
1681061833.941848: Worker 0: training step 8987 done (global step: 17952) | |
1681061833.947905: Worker 0: training step 8988 done (global step: 17954) | |
1681061833.954091: Worker 0: training step 8989 done (global step: 17956) | |
1681061833.959426: Worker 0: training step 8990 done (global step: 17958) | |
1681061833.968831: Worker 0: training step 8991 done (global step: 17960) | |
1681061833.974591: Worker 0: training step 8992 done (global step: 17962) | |
1681061833.980002: Worker 0: training step 8993 done (global step: 17964) | |
1681061833.985728: Worker 0: training step 8994 done (global step: 17966) | |
1681061833.992491: Worker 0: training step 8995 done (global step: 17968) | |
1681061833.997598: Worker 0: training step 8996 done (global step: 17970) | |
1681061834.003125: Worker 0: training step 8997 done (global step: 17972) | |
1681061834.008981: Worker 0: training step 8998 done (global step: 17974) | |
1681061834.015350: Worker 0: training step 8999 done (global step: 17976) | |
1681061834.021371: Worker 0: training step 9000 done (global step: 17978) | |
1681061834.028085: Worker 0: training step 9001 done (global step: 17980) | |
1681061834.033838: Worker 0: training step 9002 done (global step: 17982) | |
1681061834.039151: Worker 0: training step 9003 done (global step: 17984) | |
1681061834.044984: Worker 0: training step 9004 done (global step: 17986) | |
1681061834.050907: Worker 0: training step 9005 done (global step: 17988) | |
1681061834.057042: Worker 0: training step 9006 done (global step: 17990) | |
1681061834.062105: Worker 0: training step 9007 done (global step: 17992) | |
1681061834.067548: Worker 0: training step 9008 done (global step: 17994) | |
1681061834.073744: Worker 0: training step 9009 done (global step: 17996) | |
1681061834.079346: Worker 0: training step 9010 done (global step: 17998) | |
1681061834.084834: Worker 0: training step 9011 done (global step: 18000) | |
1681061834.090026: Worker 0: training step 9012 done (global step: 18002) | |
1681061834.101204: Worker 0: training step 9013 done (global step: 18004) | |
1681061834.111410: Worker 0: training step 9014 done (global step: 18006) | |
1681061834.119079: Worker 0: training step 9015 done (global step: 18008) | |
1681061834.125143: Worker 0: training step 9016 done (global step: 18010) | |
1681061834.131265: Worker 0: training step 9017 done (global step: 18012) | |
1681061834.137105: Worker 0: training step 9018 done (global step: 18014) | |
1681061834.142303: Worker 0: training step 9019 done (global step: 18016) | |
1681061834.148139: Worker 0: training step 9020 done (global step: 18018) | |
1681061834.154647: Worker 0: training step 9021 done (global step: 18020) | |
1681061834.166260: Worker 0: training step 9022 done (global step: 18022) | |
1681061834.175013: Worker 0: training step 9023 done (global step: 18024) | |
1681061834.185212: Worker 0: training step 9024 done (global step: 18026) | |
1681061834.194435: Worker 0: training step 9025 done (global step: 18028) | |
1681061834.204087: Worker 0: training step 9026 done (global step: 18030) | |
1681061834.211808: Worker 0: training step 9027 done (global step: 18032) | |
1681061834.228585: Worker 0: training step 9028 done (global step: 18034) | |
1681061834.237915: Worker 0: training step 9029 done (global step: 18036) | |
1681061834.245571: Worker 0: training step 9030 done (global step: 18038) | |
1681061834.258147: Worker 0: training step 9031 done (global step: 18040) | |
1681061834.269865: Worker 0: training step 9032 done (global step: 18042) | |
1681061834.277978: Worker 0: training step 9033 done (global step: 18044) | |
1681061834.286964: Worker 0: training step 9034 done (global step: 18045) | |
1681061834.299176: Worker 0: training step 9035 done (global step: 18047) | |
1681061834.307550: Worker 0: training step 9036 done (global step: 18049) | |
1681061834.314048: Worker 0: training step 9037 done (global step: 18051) | |
1681061834.319214: Worker 0: training step 9038 done (global step: 18053) | |
1681061834.326213: Worker 0: training step 9039 done (global step: 18055) | |
1681061834.333277: Worker 0: training step 9040 done (global step: 18057) | |
1681061834.341160: Worker 0: training step 9041 done (global step: 18059) | |
1681061834.350085: Worker 0: training step 9042 done (global step: 18061) | |
1681061834.356226: Worker 0: training step 9043 done (global step: 18063) | |
1681061834.362296: Worker 0: training step 9044 done (global step: 18065) | |
1681061834.370014: Worker 0: training step 9045 done (global step: 18067) | |
1681061834.377952: Worker 0: training step 9046 done (global step: 18069) | |
1681061834.383852: Worker 0: training step 9047 done (global step: 18071) | |
1681061834.390849: Worker 0: training step 9048 done (global step: 18073) | |
1681061834.396096: Worker 0: training step 9049 done (global step: 18075) | |
1681061834.402215: Worker 0: training step 9050 done (global step: 18077) | |
1681061834.408887: Worker 0: training step 9051 done (global step: 18079) | |
1681061834.414004: Worker 0: training step 9052 done (global step: 18081) | |
1681061834.419500: Worker 0: training step 9053 done (global step: 18083) | |
1681061834.425402: Worker 0: training step 9054 done (global step: 18085) | |
1681061834.431066: Worker 0: training step 9055 done (global step: 18087) | |
1681061834.436845: Worker 0: training step 9056 done (global step: 18089) | |
1681061834.442703: Worker 0: training step 9057 done (global step: 18091) | |
1681061834.448517: Worker 0: training step 9058 done (global step: 18093) | |
1681061834.454217: Worker 0: training step 9059 done (global step: 18095) | |
1681061834.460198: Worker 0: training step 9060 done (global step: 18097) | |
1681061834.467575: Worker 0: training step 9061 done (global step: 18099) | |
1681061834.474664: Worker 0: training step 9062 done (global step: 18101) | |
1681061834.480505: Worker 0: training step 9063 done (global step: 18102) | |
1681061834.486139: Worker 0: training step 9064 done (global step: 18104) | |
1681061834.492924: Worker 0: training step 9065 done (global step: 18106) | |
1681061834.499373: Worker 0: training step 9066 done (global step: 18109) | |
1681061834.504600: Worker 0: training step 9067 done (global step: 18111) | |
1681061834.510898: Worker 0: training step 9068 done (global step: 18113) | |
1681061834.517526: Worker 0: training step 9069 done (global step: 18115) | |
1681061834.522726: Worker 0: training step 9070 done (global step: 18117) | |
1681061834.528567: Worker 0: training step 9071 done (global step: 18119) | |
1681061834.535000: Worker 0: training step 9072 done (global step: 18121) | |
1681061834.542392: Worker 0: training step 9073 done (global step: 18123) | |
1681061834.548092: Worker 0: training step 9074 done (global step: 18125) | |
1681061834.553719: Worker 0: training step 9075 done (global step: 18128) | |
1681061834.558758: Worker 0: training step 9076 done (global step: 18129) | |
1681061834.564762: Worker 0: training step 9077 done (global step: 18131) | |
1681061834.569580: Worker 0: training step 9078 done (global step: 18133) | |
1681061834.578233: Worker 0: training step 9079 done (global step: 18135) | |
1681061834.583359: Worker 0: training step 9080 done (global step: 18137) | |
1681061834.588060: Worker 0: training step 9081 done (global step: 18139) | |
1681061834.593749: Worker 0: training step 9082 done (global step: 18141) | |
1681061834.599313: Worker 0: training step 9083 done (global step: 18143) | |
1681061834.605199: Worker 0: training step 9084 done (global step: 18145) | |
1681061834.610624: Worker 0: training step 9085 done (global step: 18147) | |
1681061834.616902: Worker 0: training step 9086 done (global step: 18149) | |
1681061834.622200: Worker 0: training step 9087 done (global step: 18151) | |
1681061834.628515: Worker 0: training step 9088 done (global step: 18152) | |
1681061834.633776: Worker 0: training step 9089 done (global step: 18154) | |
1681061834.639960: Worker 0: training step 9090 done (global step: 18156) | |
1681061834.645282: Worker 0: training step 9091 done (global step: 18159) | |
1681061834.650253: Worker 0: training step 9092 done (global step: 18161) | |
1681061834.657222: Worker 0: training step 9093 done (global step: 18162) | |
1681061834.663412: Worker 0: training step 9094 done (global step: 18165) | |
1681061834.668464: Worker 0: training step 9095 done (global step: 18167) | |
1681061834.674290: Worker 0: training step 9096 done (global step: 18169) | |
1681061834.680359: Worker 0: training step 9097 done (global step: 18171) | |
1681061834.686433: Worker 0: training step 9098 done (global step: 18173) | |
1681061834.692067: Worker 0: training step 9099 done (global step: 18175) | |
1681061834.700989: Worker 0: training step 9100 done (global step: 18177) | |
1681061834.710058: Worker 0: training step 9101 done (global step: 18179) | |
1681061834.719036: Worker 0: training step 9102 done (global step: 18181) | |
1681061834.724317: Worker 0: training step 9103 done (global step: 18183) | |
1681061834.730065: Worker 0: training step 9104 done (global step: 18185) | |
1681061834.735811: Worker 0: training step 9105 done (global step: 18187) | |
1681061834.741812: Worker 0: training step 9106 done (global step: 18189) | |
1681061834.746556: Worker 0: training step 9107 done (global step: 18191) | |
1681061834.754435: Worker 0: training step 9108 done (global step: 18193) | |
1681061834.767072: Worker 0: training step 9109 done (global step: 18195) | |
1681061834.777263: Worker 0: training step 9110 done (global step: 18197) | |
1681061834.784055: Worker 0: training step 9111 done (global step: 18199) | |
1681061834.792728: Worker 0: training step 9112 done (global step: 18201) | |
1681061834.799454: Worker 0: training step 9113 done (global step: 18204) | |
1681061834.805123: Worker 0: training step 9114 done (global step: 18206) | |
1681061834.810293: Worker 0: training step 9115 done (global step: 18207) | |
1681061834.816000: Worker 0: training step 9116 done (global step: 18209) | |
1681061834.821602: Worker 0: training step 9117 done (global step: 18211) | |
1681061834.826541: Worker 0: training step 9118 done (global step: 18213) | |
1681061834.831547: Worker 0: training step 9119 done (global step: 18215) | |
1681061834.836266: Worker 0: training step 9120 done (global step: 18217) | |
1681061834.842247: Worker 0: training step 9121 done (global step: 18218) | |
1681061834.848117: Worker 0: training step 9122 done (global step: 18220) | |
1681061834.854746: Worker 0: training step 9123 done (global step: 18222) | |
1681061834.860547: Worker 0: training step 9124 done (global step: 18225) | |
1681061834.865790: Worker 0: training step 9125 done (global step: 18227) | |
1681061834.871289: Worker 0: training step 9126 done (global step: 18229) | |
1681061834.876816: Worker 0: training step 9127 done (global step: 18231) | |
1681061834.882185: Worker 0: training step 9128 done (global step: 18233) | |
1681061834.887178: Worker 0: training step 9129 done (global step: 18235) | |
1681061834.895039: Worker 0: training step 9130 done (global step: 18236) | |
1681061834.900779: Worker 0: training step 9131 done (global step: 18238) | |
1681061834.906289: Worker 0: training step 9132 done (global step: 18240) | |
1681061834.912419: Worker 0: training step 9133 done (global step: 18242) | |
1681061834.918518: Worker 0: training step 9134 done (global step: 18244) | |
1681061834.926969: Worker 0: training step 9135 done (global step: 18246) | |
1681061834.937139: Worker 0: training step 9136 done (global step: 18249) | |
1681061834.946590: Worker 0: training step 9137 done (global step: 18251) | |
1681061834.954286: Worker 0: training step 9138 done (global step: 18253) | |
1681061834.960847: Worker 0: training step 9139 done (global step: 18255) | |
1681061834.966602: Worker 0: training step 9140 done (global step: 18257) | |
1681061834.972379: Worker 0: training step 9141 done (global step: 18258) | |
1681061834.978360: Worker 0: training step 9142 done (global step: 18260) | |
1681061834.983967: Worker 0: training step 9143 done (global step: 18263) | |
1681061834.990700: Worker 0: training step 9144 done (global step: 18265) | |
1681061834.997694: Worker 0: training step 9145 done (global step: 18267) | |
1681061835.003863: Worker 0: training step 9146 done (global step: 18269) | |
1681061835.010380: Worker 0: training step 9147 done (global step: 18271) | |
1681061835.015539: Worker 0: training step 9148 done (global step: 18273) | |
1681061835.021026: Worker 0: training step 9149 done (global step: 18275) | |
1681061835.040793: Worker 0: training step 9150 done (global step: 18276) | |
1681061835.051205: Worker 0: training step 9151 done (global step: 18278) | |
1681061835.060549: Worker 0: training step 9152 done (global step: 18280) | |
1681061835.072496: Worker 0: training step 9153 done (global step: 18282) | |
1681061835.095130: Worker 0: training step 9154 done (global step: 18284) | |
1681061835.106994: Worker 0: training step 9155 done (global step: 18286) | |
1681061835.134230: Worker 0: training step 9156 done (global step: 18288) | |
1681061835.149062: Worker 0: training step 9157 done (global step: 18290) | |
1681061835.158484: Worker 0: training step 9158 done (global step: 18292) | |
1681061835.166579: Worker 0: training step 9159 done (global step: 18294) | |
1681061835.186305: Worker 0: training step 9160 done (global step: 18296) | |
1681061835.199323: Worker 0: training step 9161 done (global step: 18298) | |
1681061835.209110: Worker 0: training step 9162 done (global step: 18300) | |
1681061835.215885: Worker 0: training step 9163 done (global step: 18302) | |
1681061835.222617: Worker 0: training step 9164 done (global step: 18304) | |
1681061835.234919: Worker 0: training step 9165 done (global step: 18306) | |
1681061835.247274: Worker 0: training step 9166 done (global step: 18308) | |
1681061835.253921: Worker 0: training step 9167 done (global step: 18310) | |
1681061835.260308: Worker 0: training step 9168 done (global step: 18312) | |
1681061835.265796: Worker 0: training step 9169 done (global step: 18314) | |
1681061835.273465: Worker 0: training step 9170 done (global step: 18316) | |
1681061835.279818: Worker 0: training step 9171 done (global step: 18318) | |
1681061835.286096: Worker 0: training step 9172 done (global step: 18320) | |
1681061835.292154: Worker 0: training step 9173 done (global step: 18323) | |
1681061835.298006: Worker 0: training step 9174 done (global step: 18324) | |
1681061835.304232: Worker 0: training step 9175 done (global step: 18326) | |
1681061835.310906: Worker 0: training step 9176 done (global step: 18328) | |
1681061835.317061: Worker 0: training step 9177 done (global step: 18330) | |
1681061835.323827: Worker 0: training step 9178 done (global step: 18332) | |
1681061835.328669: Worker 0: training step 9179 done (global step: 18334) | |
1681061835.333544: Worker 0: training step 9180 done (global step: 18336) | |
1681061835.338507: Worker 0: training step 9181 done (global step: 18338) | |
1681061835.343807: Worker 0: training step 9182 done (global step: 18340) | |
1681061835.349144: Worker 0: training step 9183 done (global step: 18342) | |
1681061835.353921: Worker 0: training step 9184 done (global step: 18344) | |
1681061835.359496: Worker 0: training step 9185 done (global step: 18345) | |
1681061835.364216: Worker 0: training step 9186 done (global step: 18347) | |
1681061835.370395: Worker 0: training step 9187 done (global step: 18349) | |
1681061835.377091: Worker 0: training step 9188 done (global step: 18351) | |
1681061835.382261: Worker 0: training step 9189 done (global step: 18354) | |
1681061835.387832: Worker 0: training step 9190 done (global step: 18356) | |
1681061835.392478: Worker 0: training step 9191 done (global step: 18357) | |
1681061835.398178: Worker 0: training step 9192 done (global step: 18359) | |
1681061835.403505: Worker 0: training step 9193 done (global step: 18361) | |
1681061835.409117: Worker 0: training step 9194 done (global step: 18363) | |
1681061835.414938: Worker 0: training step 9195 done (global step: 18365) | |
1681061835.420682: Worker 0: training step 9196 done (global step: 18367) | |
1681061835.426307: Worker 0: training step 9197 done (global step: 18369) | |
1681061835.432485: Worker 0: training step 9198 done (global step: 18371) | |
1681061835.438504: Worker 0: training step 9199 done (global step: 18373) | |
1681061835.443538: Worker 0: training step 9200 done (global step: 18375) | |
1681061835.449896: Worker 0: training step 9201 done (global step: 18377) | |
1681061835.455938: Worker 0: training step 9202 done (global step: 18379) | |
1681061835.463280: Worker 0: training step 9203 done (global step: 18381) | |
1681061835.468705: Worker 0: training step 9204 done (global step: 18383) | |
1681061835.476103: Worker 0: training step 9205 done (global step: 18385) | |
1681061835.481883: Worker 0: training step 9206 done (global step: 18388) | |
1681061835.487177: Worker 0: training step 9207 done (global step: 18390) | |
1681061835.492333: Worker 0: training step 9208 done (global step: 18391) | |
1681061835.498688: Worker 0: training step 9209 done (global step: 18393) | |
1681061835.504424: Worker 0: training step 9210 done (global step: 18395) | |
1681061835.510080: Worker 0: training step 9211 done (global step: 18397) | |
1681061835.517272: Worker 0: training step 9212 done (global step: 18399) | |
1681061835.524212: Worker 0: training step 9213 done (global step: 18402) | |
1681061835.529792: Worker 0: training step 9214 done (global step: 18404) | |
1681061835.535696: Worker 0: training step 9215 done (global step: 18406) | |
1681061835.540844: Worker 0: training step 9216 done (global step: 18408) | |
1681061835.546805: Worker 0: training step 9217 done (global step: 18410) | |
1681061835.552913: Worker 0: training step 9218 done (global step: 18412) | |
1681061835.558477: Worker 0: training step 9219 done (global step: 18414) | |
1681061835.563922: Worker 0: training step 9220 done (global step: 18416) | |
1681061835.569438: Worker 0: training step 9221 done (global step: 18418) | |
1681061835.574754: Worker 0: training step 9222 done (global step: 18420) | |
1681061835.580563: Worker 0: training step 9223 done (global step: 18422) | |
1681061835.586233: Worker 0: training step 9224 done (global step: 18424) | |
1681061835.591972: Worker 0: training step 9225 done (global step: 18426) | |
1681061835.598809: Worker 0: training step 9226 done (global step: 18428) | |
1681061835.604706: Worker 0: training step 9227 done (global step: 18430) | |
1681061835.609801: Worker 0: training step 9228 done (global step: 18433) | |
1681061835.615423: Worker 0: training step 9229 done (global step: 18434) | |
1681061835.621829: Worker 0: training step 9230 done (global step: 18437) | |
1681061835.628196: Worker 0: training step 9231 done (global step: 18439) | |
1681061835.633537: Worker 0: training step 9232 done (global step: 18441) | |
1681061835.639736: Worker 0: training step 9233 done (global step: 18443) | |
1681061835.645876: Worker 0: training step 9234 done (global step: 18445) | |
1681061835.651988: Worker 0: training step 9235 done (global step: 18447) | |
1681061835.657519: Worker 0: training step 9236 done (global step: 18449) | |
1681061835.663708: Worker 0: training step 9237 done (global step: 18450) | |
1681061835.673642: Worker 0: training step 9238 done (global step: 18452) | |
1681061835.680830: Worker 0: training step 9239 done (global step: 18454) | |
1681061835.687265: Worker 0: training step 9240 done (global step: 18455) | |
1681061835.692448: Worker 0: training step 9241 done (global step: 18457) | |
1681061835.697501: Worker 0: training step 9242 done (global step: 18458) | |
1681061835.702882: Worker 0: training step 9243 done (global step: 18460) | |
1681061835.708673: Worker 0: training step 9244 done (global step: 18462) | |
1681061835.716580: Worker 0: training step 9245 done (global step: 18464) | |
1681061835.722037: Worker 0: training step 9246 done (global step: 18466) | |
1681061835.727953: Worker 0: training step 9247 done (global step: 18468) | |
1681061835.734087: Worker 0: training step 9248 done (global step: 18470) | |
1681061835.740779: Worker 0: training step 9249 done (global step: 18472) | |
1681061835.748253: Worker 0: training step 9250 done (global step: 18475) | |
1681061835.756216: Worker 0: training step 9251 done (global step: 18477) | |
1681061835.769644: Worker 0: training step 9252 done (global step: 18479) | |
1681061835.782082: Worker 0: training step 9253 done (global step: 18481) | |
1681061835.799776: Worker 0: training step 9254 done (global step: 18482) | |
1681061835.806401: Worker 0: training step 9255 done (global step: 18484) | |
1681061835.811807: Worker 0: training step 9256 done (global step: 18485) | |
1681061835.818200: Worker 0: training step 9257 done (global step: 18487) | |
1681061835.826766: Worker 0: training step 9258 done (global step: 18489) | |
1681061835.833819: Worker 0: training step 9259 done (global step: 18492) | |
1681061835.840502: Worker 0: training step 9260 done (global step: 18494) | |
1681061835.847293: Worker 0: training step 9261 done (global step: 18496) | |
1681061835.853036: Worker 0: training step 9262 done (global step: 18498) | |
1681061835.860348: Worker 0: training step 9263 done (global step: 18500) | |
1681061835.866255: Worker 0: training step 9264 done (global step: 18502) | |
1681061835.872146: Worker 0: training step 9265 done (global step: 18503) | |
1681061835.879012: Worker 0: training step 9266 done (global step: 18505) | |
1681061835.886870: Worker 0: training step 9267 done (global step: 18508) | |
1681061835.893696: Worker 0: training step 9268 done (global step: 18510) | |
1681061835.899588: Worker 0: training step 9269 done (global step: 18512) | |
1681061835.907144: Worker 0: training step 9270 done (global step: 18514) | |
1681061835.913280: Worker 0: training step 9271 done (global step: 18516) | |
1681061835.918841: Worker 0: training step 9272 done (global step: 18518) | |
1681061835.926306: Worker 0: training step 9273 done (global step: 18519) | |
1681061835.931972: Worker 0: training step 9274 done (global step: 18522) | |
1681061835.938002: Worker 0: training step 9275 done (global step: 18523) | |
1681061835.944055: Worker 0: training step 9276 done (global step: 18525) | |
1681061835.951289: Worker 0: training step 9277 done (global step: 18527) | |
1681061835.957898: Worker 0: training step 9278 done (global step: 18530) | |
1681061835.964557: Worker 0: training step 9279 done (global step: 18531) | |
1681061835.970809: Worker 0: training step 9280 done (global step: 18534) | |
1681061835.977368: Worker 0: training step 9281 done (global step: 18536) | |
1681061835.982738: Worker 0: training step 9282 done (global step: 18538) | |
1681061835.989436: Worker 0: training step 9283 done (global step: 18540) | |
1681061835.994892: Worker 0: training step 9284 done (global step: 18542) | |
1681061836.000904: Worker 0: training step 9285 done (global step: 18544) | |
1681061836.007809: Worker 0: training step 9286 done (global step: 18546) | |
1681061836.013624: Worker 0: training step 9287 done (global step: 18548) | |
1681061836.020003: Worker 0: training step 9288 done (global step: 18550) | |
1681061836.025976: Worker 0: training step 9289 done (global step: 18552) | |
1681061836.031951: Worker 0: training step 9290 done (global step: 18554) | |
1681061836.037502: Worker 0: training step 9291 done (global step: 18556) | |
1681061836.042774: Worker 0: training step 9292 done (global step: 18558) | |
1681061836.049149: Worker 0: training step 9293 done (global step: 18559) | |
1681061836.055027: Worker 0: training step 9294 done (global step: 18562) | |
1681061836.061118: Worker 0: training step 9295 done (global step: 18563) | |
1681061836.067486: Worker 0: training step 9296 done (global step: 18566) | |
1681061836.073349: Worker 0: training step 9297 done (global step: 18568) | |
1681061836.078683: Worker 0: training step 9298 done (global step: 18570) | |
1681061836.084757: Worker 0: training step 9299 done (global step: 18572) | |
1681061836.091067: Worker 0: training step 9300 done (global step: 18574) | |
1681061836.097222: Worker 0: training step 9301 done (global step: 18576) | |
1681061836.103819: Worker 0: training step 9302 done (global step: 18578) | |
1681061836.109953: Worker 0: training step 9303 done (global step: 18580) | |
1681061836.115419: Worker 0: training step 9304 done (global step: 18582) | |
1681061836.121145: Worker 0: training step 9305 done (global step: 18583) | |
1681061836.127256: Worker 0: training step 9306 done (global step: 18586) | |
1681061836.132986: Worker 0: training step 9307 done (global step: 18587) | |
1681061836.139168: Worker 0: training step 9308 done (global step: 18590) | |
1681061836.145061: Worker 0: training step 9309 done (global step: 18592) | |
1681061836.151665: Worker 0: training step 9310 done (global step: 18594) | |
1681061836.158047: Worker 0: training step 9311 done (global step: 18596) | |
1681061836.163479: Worker 0: training step 9312 done (global step: 18598) | |
1681061836.169206: Worker 0: training step 9313 done (global step: 18600) | |
1681061836.174800: Worker 0: training step 9314 done (global step: 18602) | |
1681061836.182678: Worker 0: training step 9315 done (global step: 18604) | |
1681061836.188536: Worker 0: training step 9316 done (global step: 18606) | |
1681061836.194549: Worker 0: training step 9317 done (global step: 18608) | |
1681061836.200800: Worker 0: training step 9318 done (global step: 18610) | |
1681061836.207657: Worker 0: training step 9319 done (global step: 18613) | |
1681061836.216790: Worker 0: training step 9320 done (global step: 18615) | |
1681061836.229903: Worker 0: training step 9321 done (global step: 18617) | |
1681061836.265372: Worker 0: training step 9322 done (global step: 18619) | |
1681061836.278757: Worker 0: training step 9323 done (global step: 18621) | |
1681061836.288791: Worker 0: training step 9324 done (global step: 18623) | |
1681061836.315564: Worker 0: training step 9325 done (global step: 18626) | |
1681061836.323670: Worker 0: training step 9326 done (global step: 18628) | |
1681061836.342496: Worker 0: training step 9327 done (global step: 18630) | |
1681061836.369162: Worker 0: training step 9328 done (global step: 18632) | |
1681061836.390745: Worker 0: training step 9329 done (global step: 18634) | |
1681061836.407254: Worker 0: training step 9330 done (global step: 18636) | |
1681061836.412850: Worker 0: training step 9331 done (global step: 18638) | |
1681061836.418205: Worker 0: training step 9332 done (global step: 18640) | |
1681061836.435589: Worker 0: training step 9333 done (global step: 18642) | |
1681061836.443204: Worker 0: training step 9334 done (global step: 18644) | |
1681061836.448830: Worker 0: training step 9335 done (global step: 18645) | |
1681061836.468294: Worker 0: training step 9336 done (global step: 18647) | |
1681061836.478640: Worker 0: training step 9337 done (global step: 18649) | |
1681061836.483655: Worker 0: training step 9338 done (global step: 18651) | |
1681061836.491769: Worker 0: training step 9339 done (global step: 18653) | |
1681061836.498219: Worker 0: training step 9340 done (global step: 18655) | |
1681061836.505004: Worker 0: training step 9341 done (global step: 18657) | |
1681061836.510136: Worker 0: training step 9342 done (global step: 18659) | |
1681061836.516177: Worker 0: training step 9343 done (global step: 18661) | |
1681061836.521808: Worker 0: training step 9344 done (global step: 18663) | |
1681061836.527487: Worker 0: training step 9345 done (global step: 18665) | |
1681061836.533387: Worker 0: training step 9346 done (global step: 18667) | |
1681061836.538850: Worker 0: training step 9347 done (global step: 18669) | |
1681061836.544642: Worker 0: training step 9348 done (global step: 18671) | |
1681061836.551124: Worker 0: training step 9349 done (global step: 18673) | |
1681061836.557272: Worker 0: training step 9350 done (global step: 18675) | |
1681061836.714948: Worker 0: training step 9351 done (global step: 18691) | |
1681061836.719526: Worker 0: training step 9352 done (global step: 18692) | |
1681061836.724355: Worker 0: training step 9353 done (global step: 18693) | |
1681061836.729000: Worker 0: training step 9354 done (global step: 18694) | |
1681061836.733726: Worker 0: training step 9355 done (global step: 18695) | |
1681061836.738991: Worker 0: training step 9356 done (global step: 18696) | |
1681061836.743729: Worker 0: training step 9357 done (global step: 18697) | |
1681061836.748342: Worker 0: training step 9358 done (global step: 18698) | |
1681061836.752909: Worker 0: training step 9359 done (global step: 18699) | |
1681061836.757467: Worker 0: training step 9360 done (global step: 18700) | |
1681061836.761831: Worker 0: training step 9361 done (global step: 18701) | |
1681061836.766494: Worker 0: training step 9362 done (global step: 18702) | |
1681061836.770418: Worker 0: training step 9363 done (global step: 18703) | |
1681061836.774187: Worker 0: training step 9364 done (global step: 18704) | |
1681061836.778489: Worker 0: training step 9365 done (global step: 18705) | |
1681061836.783312: Worker 0: training step 9366 done (global step: 18706) | |
1681061836.787400: Worker 0: training step 9367 done (global step: 18707) | |
1681061836.794044: Worker 0: training step 9368 done (global step: 18708) | |
1681061836.800216: Worker 0: training step 9369 done (global step: 18709) | |
1681061836.805206: Worker 0: training step 9370 done (global step: 18711) | |
1681061836.810437: Worker 0: training step 9371 done (global step: 18713) | |
1681061836.816702: Worker 0: training step 9372 done (global step: 18715) | |
1681061836.822593: Worker 0: training step 9373 done (global step: 18717) | |
1681061836.829055: Worker 0: training step 9374 done (global step: 18719) | |
1681061836.834192: Worker 0: training step 9375 done (global step: 18721) | |
1681061836.840058: Worker 0: training step 9376 done (global step: 18723) | |
1681061836.845767: Worker 0: training step 9377 done (global step: 18725) | |
1681061836.852755: Worker 0: training step 9378 done (global step: 18727) | |
1681061836.860798: Worker 0: training step 9379 done (global step: 18729) | |
1681061836.867835: Worker 0: training step 9380 done (global step: 18732) | |
1681061836.872554: Worker 0: training step 9381 done (global step: 18733) | |
1681061836.879025: Worker 0: training step 9382 done (global step: 18735) | |
1681061836.884409: Worker 0: training step 9383 done (global step: 18737) | |
1681061836.890566: Worker 0: training step 9384 done (global step: 18739) | |
1681061836.896385: Worker 0: training step 9385 done (global step: 18741) | |
1681061836.902211: Worker 0: training step 9386 done (global step: 18743) | |
1681061836.907594: Worker 0: training step 9387 done (global step: 18745) | |
1681061836.913629: Worker 0: training step 9388 done (global step: 18747) | |
1681061836.919315: Worker 0: training step 9389 done (global step: 18749) | |
1681061836.925294: Worker 0: training step 9390 done (global step: 18751) | |
1681061836.934235: Worker 0: training step 9391 done (global step: 18753) | |
1681061836.941818: Worker 0: training step 9392 done (global step: 18756) | |
1681061836.948041: Worker 0: training step 9393 done (global step: 18758) | |
1681061836.961251: Worker 0: training step 9394 done (global step: 18760) | |
1681061836.977391: Worker 0: training step 9395 done (global step: 18763) | |
1681061836.983633: Worker 0: training step 9396 done (global step: 18765) | |
1681061836.989223: Worker 0: training step 9397 done (global step: 18767) | |
1681061836.997549: Worker 0: training step 9398 done (global step: 18769) | |
1681061837.005369: Worker 0: training step 9399 done (global step: 18771) | |
1681061837.012730: Worker 0: training step 9400 done (global step: 18773) | |
1681061837.020327: Worker 0: training step 9401 done (global step: 18775) | |
1681061837.027758: Worker 0: training step 9402 done (global step: 18778) | |
1681061837.033065: Worker 0: training step 9403 done (global step: 18780) | |
1681061837.041717: Worker 0: training step 9404 done (global step: 18782) | |
1681061837.046838: Worker 0: training step 9405 done (global step: 18784) | |
1681061837.053272: Worker 0: training step 9406 done (global step: 18786) | |
1681061837.058891: Worker 0: training step 9407 done (global step: 18788) | |
1681061837.065197: Worker 0: training step 9408 done (global step: 18790) | |
1681061837.071013: Worker 0: training step 9409 done (global step: 18792) | |
1681061837.076891: Worker 0: training step 9410 done (global step: 18794) | |
1681061837.082290: Worker 0: training step 9411 done (global step: 18796) | |
1681061837.088868: Worker 0: training step 9412 done (global step: 18798) | |
1681061837.095331: Worker 0: training step 9413 done (global step: 18800) | |
1681061837.102522: Worker 0: training step 9414 done (global step: 18802) | |
1681061837.108578: Worker 0: training step 9415 done (global step: 18804) | |
1681061837.114215: Worker 0: training step 9416 done (global step: 18806) | |
1681061837.120082: Worker 0: training step 9417 done (global step: 18808) | |
1681061837.126450: Worker 0: training step 9418 done (global step: 18810) | |
1681061837.132417: Worker 0: training step 9419 done (global step: 18812) | |
1681061837.147648: Worker 0: training step 9420 done (global step: 18814) | |
1681061837.160526: Worker 0: training step 9421 done (global step: 18816) | |
1681061837.189001: Worker 0: training step 9422 done (global step: 18818) | |
1681061837.206461: Worker 0: training step 9423 done (global step: 18820) | |
1681061837.217747: Worker 0: training step 9424 done (global step: 18821) | |
1681061837.236502: Worker 0: training step 9425 done (global step: 18823) | |
1681061837.252457: Worker 0: training step 9426 done (global step: 18826) | |
1681061837.263424: Worker 0: training step 9427 done (global step: 18827) | |
1681061837.273785: Worker 0: training step 9428 done (global step: 18829) | |
1681061837.282715: Worker 0: training step 9429 done (global step: 18831) | |
1681061837.297776: Worker 0: training step 9430 done (global step: 18834) | |
1681061837.322877: Worker 0: training step 9431 done (global step: 18836) | |
1681061837.333106: Worker 0: training step 9432 done (global step: 18837) | |
1681061837.338549: Worker 0: training step 9433 done (global step: 18839) | |
1681061837.345353: Worker 0: training step 9434 done (global step: 18841) | |
1681061837.351541: Worker 0: training step 9435 done (global step: 18843) | |
1681061837.384063: Worker 0: training step 9436 done (global step: 18844) | |
1681061837.397539: Worker 0: training step 9437 done (global step: 18846) | |
1681061837.417676: Worker 0: training step 9438 done (global step: 18848) | |
1681061837.430372: Worker 0: training step 9439 done (global step: 18850) | |
1681061837.438767: Worker 0: training step 9440 done (global step: 18853) | |
1681061837.445277: Worker 0: training step 9441 done (global step: 18855) | |
1681061837.451242: Worker 0: training step 9442 done (global step: 18857) | |
1681061837.461603: Worker 0: training step 9443 done (global step: 18859) | |
1681061837.467833: Worker 0: training step 9444 done (global step: 18861) | |
1681061837.473563: Worker 0: training step 9445 done (global step: 18863) | |
1681061837.479219: Worker 0: training step 9446 done (global step: 18865) | |
1681061837.484190: Worker 0: training step 9447 done (global step: 18867) | |
1681061837.490777: Worker 0: training step 9448 done (global step: 18869) | |
1681061837.496562: Worker 0: training step 9449 done (global step: 18871) | |
1681061837.501706: Worker 0: training step 9450 done (global step: 18873) | |
1681061837.507680: Worker 0: training step 9451 done (global step: 18875) | |
1681061837.513719: Worker 0: training step 9452 done (global step: 18877) | |
1681061837.519325: Worker 0: training step 9453 done (global step: 18879) | |
1681061837.525743: Worker 0: training step 9454 done (global step: 18881) | |
1681061837.531678: Worker 0: training step 9455 done (global step: 18883) | |
1681061837.536601: Worker 0: training step 9456 done (global step: 18885) | |
1681061837.542339: Worker 0: training step 9457 done (global step: 18887) | |
1681061837.548656: Worker 0: training step 9458 done (global step: 18889) | |
1681061837.554632: Worker 0: training step 9459 done (global step: 18891) | |
1681061837.560817: Worker 0: training step 9460 done (global step: 18893) | |
1681061837.567078: Worker 0: training step 9461 done (global step: 18895) | |
1681061837.574046: Worker 0: training step 9462 done (global step: 18897) | |
1681061837.579942: Worker 0: training step 9463 done (global step: 18899) | |
1681061837.585216: Worker 0: training step 9464 done (global step: 18901) | |
1681061837.591505: Worker 0: training step 9465 done (global step: 18903) | |
1681061837.596906: Worker 0: training step 9466 done (global step: 18905) | |
1681061837.602256: Worker 0: training step 9467 done (global step: 18907) | |
1681061837.608407: Worker 0: training step 9468 done (global step: 18909) | |
1681061837.614198: Worker 0: training step 9469 done (global step: 18911) | |
1681061837.619694: Worker 0: training step 9470 done (global step: 18913) | |
1681061837.625109: Worker 0: training step 9471 done (global step: 18915) | |
1681061837.631011: Worker 0: training step 9472 done (global step: 18917) | |
1681061837.636133: Worker 0: training step 9473 done (global step: 18919) | |
1681061837.641642: Worker 0: training step 9474 done (global step: 18921) | |
1681061837.646996: Worker 0: training step 9475 done (global step: 18923) | |
1681061837.652408: Worker 0: training step 9476 done (global step: 18924) | |
1681061837.659023: Worker 0: training step 9477 done (global step: 18926) | |
1681061837.664721: Worker 0: training step 9478 done (global step: 18929) | |
1681061837.670099: Worker 0: training step 9479 done (global step: 18931) | |
1681061837.676154: Worker 0: training step 9480 done (global step: 18933) | |
1681061837.680961: Worker 0: training step 9481 done (global step: 18934) | |
1681061837.686565: Worker 0: training step 9482 done (global step: 18937) | |
1681061837.692917: Worker 0: training step 9483 done (global step: 18938) | |
1681061837.699601: Worker 0: training step 9484 done (global step: 18940) | |
1681061837.705166: Worker 0: training step 9485 done (global step: 18943) | |
1681061837.710507: Worker 0: training step 9486 done (global step: 18945) | |
1681061837.715421: Worker 0: training step 9487 done (global step: 18946) | |
1681061837.720379: Worker 0: training step 9488 done (global step: 18949) | |
1681061837.726246: Worker 0: training step 9489 done (global step: 18951) | |
1681061837.731058: Worker 0: training step 9490 done (global step: 18952) | |
1681061837.735985: Worker 0: training step 9491 done (global step: 18954) | |
1681061837.741589: Worker 0: training step 9492 done (global step: 18956) | |
1681061837.747604: Worker 0: training step 9493 done (global step: 18958) | |
1681061837.753551: Worker 0: training step 9494 done (global step: 18960) | |
1681061837.760740: Worker 0: training step 9495 done (global step: 18962) | |
1681061837.766840: Worker 0: training step 9496 done (global step: 18964) | |
1681061837.773460: Worker 0: training step 9497 done (global step: 18966) | |
1681061837.778907: Worker 0: training step 9498 done (global step: 18968) | |
1681061837.784536: Worker 0: training step 9499 done (global step: 18970) | |
1681061837.789784: Worker 0: training step 9500 done (global step: 18972) | |
1681061837.797258: Worker 0: training step 9501 done (global step: 18974) | |
1681061837.802700: Worker 0: training step 9502 done (global step: 18976) | |
1681061837.808105: Worker 0: training step 9503 done (global step: 18978) | |
1681061837.813172: Worker 0: training step 9504 done (global step: 18980) | |
1681061837.819103: Worker 0: training step 9505 done (global step: 18982) | |
1681061837.824899: Worker 0: training step 9506 done (global step: 18984) | |
1681061837.832072: Worker 0: training step 9507 done (global step: 18986) | |
1681061837.837479: Worker 0: training step 9508 done (global step: 18988) | |
1681061837.843148: Worker 0: training step 9509 done (global step: 18990) | |
1681061837.848509: Worker 0: training step 9510 done (global step: 18992) | |
1681061837.854926: Worker 0: training step 9511 done (global step: 18994) | |
1681061837.862349: Worker 0: training step 9512 done (global step: 18996) | |
1681061837.867750: Worker 0: training step 9513 done (global step: 18998) | |
1681061837.873978: Worker 0: training step 9514 done (global step: 19000) | |
1681061837.880070: Worker 0: training step 9515 done (global step: 19002) | |
1681061837.885274: Worker 0: training step 9516 done (global step: 19005) | |
1681061837.890450: Worker 0: training step 9517 done (global step: 19006) | |
1681061837.896966: Worker 0: training step 9518 done (global step: 19008) | |
1681061837.902388: Worker 0: training step 9519 done (global step: 19010) | |
1681061837.910475: Worker 0: training step 9520 done (global step: 19012) | |
1681061837.916235: Worker 0: training step 9521 done (global step: 19015) | |
1681061837.922162: Worker 0: training step 9522 done (global step: 19017) | |
1681061837.927669: Worker 0: training step 9523 done (global step: 19019) | |
1681061837.933847: Worker 0: training step 9524 done (global step: 19021) | |
1681061837.939543: Worker 0: training step 9525 done (global step: 19023) | |
1681061837.945662: Worker 0: training step 9526 done (global step: 19025) | |
1681061837.950711: Worker 0: training step 9527 done (global step: 19027) | |
1681061837.956267: Worker 0: training step 9528 done (global step: 19029) | |
1681061837.962268: Worker 0: training step 9529 done (global step: 19031) | |
1681061837.968557: Worker 0: training step 9530 done (global step: 19033) | |
1681061837.974399: Worker 0: training step 9531 done (global step: 19035) | |
1681061837.979264: Worker 0: training step 9532 done (global step: 19037) | |
1681061837.985046: Worker 0: training step 9533 done (global step: 19039) | |
1681061837.990388: Worker 0: training step 9534 done (global step: 19041) | |
1681061837.996277: Worker 0: training step 9535 done (global step: 19043) | |
1681061838.001375: Worker 0: training step 9536 done (global step: 19045) | |
1681061838.007988: Worker 0: training step 9537 done (global step: 19047) | |
1681061838.014400: Worker 0: training step 9538 done (global step: 19049) | |
1681061838.020718: Worker 0: training step 9539 done (global step: 19051) | |
1681061838.026869: Worker 0: training step 9540 done (global step: 19053) | |
1681061838.031479: Worker 0: training step 9541 done (global step: 19055) | |
1681061838.037093: Worker 0: training step 9542 done (global step: 19057) | |
1681061838.043103: Worker 0: training step 9543 done (global step: 19059) | |
1681061838.048738: Worker 0: training step 9544 done (global step: 19061) | |
1681061838.054129: Worker 0: training step 9545 done (global step: 19063) | |
1681061838.059988: Worker 0: training step 9546 done (global step: 19065) | |
1681061838.066202: Worker 0: training step 9547 done (global step: 19067) | |
1681061838.071651: Worker 0: training step 9548 done (global step: 19069) | |
1681061838.077431: Worker 0: training step 9549 done (global step: 19071) | |
1681061838.082787: Worker 0: training step 9550 done (global step: 19073) | |
1681061838.088971: Worker 0: training step 9551 done (global step: 19075) | |
1681061838.094105: Worker 0: training step 9552 done (global step: 19077) | |
1681061838.099460: Worker 0: training step 9553 done (global step: 19079) | |
1681061838.105271: Worker 0: training step 9554 done (global step: 19081) | |
1681061838.110814: Worker 0: training step 9555 done (global step: 19083) | |
1681061838.115938: Worker 0: training step 9556 done (global step: 19085) | |
1681061838.121686: Worker 0: training step 9557 done (global step: 19087) | |
1681061838.129195: Worker 0: training step 9558 done (global step: 19089) | |
1681061838.136792: Worker 0: training step 9559 done (global step: 19090) | |
1681061838.142032: Worker 0: training step 9560 done (global step: 19092) | |
1681061838.148068: Worker 0: training step 9561 done (global step: 19094) | |
1681061838.159412: Worker 0: training step 9562 done (global step: 19096) | |
1681061838.165969: Worker 0: training step 9563 done (global step: 19098) | |
1681061838.172065: Worker 0: training step 9564 done (global step: 19100) | |
1681061838.179148: Worker 0: training step 9565 done (global step: 19102) | |
1681061838.184793: Worker 0: training step 9566 done (global step: 19103) | |
1681061838.191624: Worker 0: training step 9567 done (global step: 19105) | |
1681061838.198672: Worker 0: training step 9568 done (global step: 19108) | |
1681061838.203407: Worker 0: training step 9569 done (global step: 19110) | |
1681061838.208677: Worker 0: training step 9570 done (global step: 19111) | |
1681061838.214636: Worker 0: training step 9571 done (global step: 19113) | |
1681061838.226160: Worker 0: training step 9572 done (global step: 19115) | |
1681061838.233830: Worker 0: training step 9573 done (global step: 19117) | |
1681061838.240480: Worker 0: training step 9574 done (global step: 19119) | |
1681061838.246994: Worker 0: training step 9575 done (global step: 19121) | |
1681061838.253265: Worker 0: training step 9576 done (global step: 19123) | |
1681061838.261827: Worker 0: training step 9577 done (global step: 19125) | |
1681061838.267483: Worker 0: training step 9578 done (global step: 19127) | |
1681061838.273438: Worker 0: training step 9579 done (global step: 19129) | |
1681061838.280059: Worker 0: training step 9580 done (global step: 19131) | |
1681061838.286881: Worker 0: training step 9581 done (global step: 19133) | |
1681061838.295925: Worker 0: training step 9582 done (global step: 19135) | |
1681061838.303179: Worker 0: training step 9583 done (global step: 19138) | |
1681061838.311508: Worker 0: training step 9584 done (global step: 19140) | |
1681061838.317515: Worker 0: training step 9585 done (global step: 19142) | |
1681061838.323832: Worker 0: training step 9586 done (global step: 19144) | |
1681061838.329442: Worker 0: training step 9587 done (global step: 19146) | |
1681061838.335300: Worker 0: training step 9588 done (global step: 19148) | |
1681061838.340726: Worker 0: training step 9589 done (global step: 19150) | |
1681061838.346078: Worker 0: training step 9590 done (global step: 19152) | |
1681061838.351123: Worker 0: training step 9591 done (global step: 19154) | |
1681061838.357333: Worker 0: training step 9592 done (global step: 19156) | |
1681061838.363571: Worker 0: training step 9593 done (global step: 19158) | |
1681061838.369470: Worker 0: training step 9594 done (global step: 19160) | |
1681061838.375479: Worker 0: training step 9595 done (global step: 19162) | |
1681061838.386393: Worker 0: training step 9596 done (global step: 19164) | |
1681061838.405254: Worker 0: training step 9597 done (global step: 19166) | |
1681061838.415687: Worker 0: training step 9598 done (global step: 19169) | |
1681061838.420938: Worker 0: training step 9599 done (global step: 19172) | |
1681061838.426756: Worker 0: training step 9600 done (global step: 19174) | |
1681061838.432343: Worker 0: training step 9601 done (global step: 19176) | |
1681061838.439043: Worker 0: training step 9602 done (global step: 19178) | |
1681061838.445107: Worker 0: training step 9603 done (global step: 19180) | |
1681061838.451593: Worker 0: training step 9604 done (global step: 19182) | |
1681061838.458452: Worker 0: training step 9605 done (global step: 19184) | |
1681061838.467886: Worker 0: training step 9606 done (global step: 19186) | |
1681061838.474397: Worker 0: training step 9607 done (global step: 19188) | |
1681061838.480500: Worker 0: training step 9608 done (global step: 19190) | |
1681061838.486934: Worker 0: training step 9609 done (global step: 19192) | |
1681061838.492994: Worker 0: training step 9610 done (global step: 19194) | |
1681061838.500050: Worker 0: training step 9611 done (global step: 19196) | |
1681061838.506091: Worker 0: training step 9612 done (global step: 19198) | |
1681061838.513653: Worker 0: training step 9613 done (global step: 19200) | |
1681061838.519765: Worker 0: training step 9614 done (global step: 19202) | |
1681061838.526755: Worker 0: training step 9615 done (global step: 19204) | |
1681061838.533778: Worker 0: training step 9616 done (global step: 19206) | |
1681061838.539240: Worker 0: training step 9617 done (global step: 19208) | |
1681061838.544303: Worker 0: training step 9618 done (global step: 19210) | |
1681061838.551347: Worker 0: training step 9619 done (global step: 19212) | |
1681061838.560567: Worker 0: training step 9620 done (global step: 19214) | |
1681061838.565531: Worker 0: training step 9621 done (global step: 19217) | |
1681061838.570529: Worker 0: training step 9622 done (global step: 19218) | |
1681061838.575586: Worker 0: training step 9623 done (global step: 19220) | |
1681061838.580852: Worker 0: training step 9624 done (global step: 19222) | |
1681061838.585380: Worker 0: training step 9625 done (global step: 19223) | |
1681061838.591691: Worker 0: training step 9626 done (global step: 19225) | |
1681061838.597996: Worker 0: training step 9627 done (global step: 19227) | |
1681061838.604577: Worker 0: training step 9628 done (global step: 19229) | |
1681061838.611327: Worker 0: training step 9629 done (global step: 19231) | |
1681061838.617245: Worker 0: training step 9630 done (global step: 19233) | |
1681061838.621743: Worker 0: training step 9631 done (global step: 19235) | |
1681061838.630094: Worker 0: training step 9632 done (global step: 19237) | |
1681061838.636144: Worker 0: training step 9633 done (global step: 19239) | |
1681061838.641589: Worker 0: training step 9634 done (global step: 19241) | |
1681061838.646646: Worker 0: training step 9635 done (global step: 19243) | |
1681061838.651459: Worker 0: training step 9636 done (global step: 19245) | |
1681061838.658746: Worker 0: training step 9637 done (global step: 19247) | |
1681061838.664775: Worker 0: training step 9638 done (global step: 19249) | |
1681061838.670921: Worker 0: training step 9639 done (global step: 19251) | |
1681061838.676667: Worker 0: training step 9640 done (global step: 19253) | |
1681061838.682977: Worker 0: training step 9641 done (global step: 19255) | |
1681061838.689678: Worker 0: training step 9642 done (global step: 19257) | |
1681061838.696326: Worker 0: training step 9643 done (global step: 19259) | |
1681061838.702038: Worker 0: training step 9644 done (global step: 19261) | |
1681061838.707659: Worker 0: training step 9645 done (global step: 19263) | |
1681061838.715268: Worker 0: training step 9646 done (global step: 19265) | |
1681061838.720694: Worker 0: training step 9647 done (global step: 19268) | |
1681061838.727303: Worker 0: training step 9648 done (global step: 19270) | |
1681061838.733272: Worker 0: training step 9649 done (global step: 19271) | |
1681061838.739054: Worker 0: training step 9650 done (global step: 19273) | |
1681061838.743833: Worker 0: training step 9651 done (global step: 19275) | |
1681061838.750173: Worker 0: training step 9652 done (global step: 19277) | |
1681061838.756553: Worker 0: training step 9653 done (global step: 19279) | |
1681061838.762491: Worker 0: training step 9654 done (global step: 19281) | |
1681061838.767737: Worker 0: training step 9655 done (global step: 19283) | |
1681061838.774271: Worker 0: training step 9656 done (global step: 19285) | |
1681061838.779928: Worker 0: training step 9657 done (global step: 19287) | |
1681061838.784799: Worker 0: training step 9658 done (global step: 19289) | |
1681061838.791073: Worker 0: training step 9659 done (global step: 19291) | |
1681061838.797708: Worker 0: training step 9660 done (global step: 19293) | |
1681061838.803540: Worker 0: training step 9661 done (global step: 19295) | |
1681061838.809707: Worker 0: training step 9662 done (global step: 19297) | |
1681061838.815174: Worker 0: training step 9663 done (global step: 19299) | |
1681061838.821497: Worker 0: training step 9664 done (global step: 19301) | |
1681061838.828547: Worker 0: training step 9665 done (global step: 19303) | |
1681061838.834681: Worker 0: training step 9666 done (global step: 19306) | |
1681061838.840852: Worker 0: training step 9667 done (global step: 19308) | |
1681061838.846191: Worker 0: training step 9668 done (global step: 19310) | |
1681061838.850975: Worker 0: training step 9669 done (global step: 19312) | |
1681061838.855944: Worker 0: training step 9670 done (global step: 19314) | |
1681061838.861772: Worker 0: training step 9671 done (global step: 19316) | |
1681061838.867669: Worker 0: training step 9672 done (global step: 19318) | |
1681061838.874027: Worker 0: training step 9673 done (global step: 19320) | |
1681061838.879120: Worker 0: training step 9674 done (global step: 19322) | |
1681061838.884773: Worker 0: training step 9675 done (global step: 19324) | |
1681061838.890202: Worker 0: training step 9676 done (global step: 19326) | |
1681061838.896112: Worker 0: training step 9677 done (global step: 19328) | |
1681061838.902826: Worker 0: training step 9678 done (global step: 19330) | |
1681061838.908274: Worker 0: training step 9679 done (global step: 19332) | |
1681061838.916283: Worker 0: training step 9680 done (global step: 19334) | |
1681061838.921396: Worker 0: training step 9681 done (global step: 19336) | |
1681061838.927481: Worker 0: training step 9682 done (global step: 19338) | |
1681061838.932260: Worker 0: training step 9683 done (global step: 19340) | |
1681061838.938436: Worker 0: training step 9684 done (global step: 19342) | |
1681061838.944933: Worker 0: training step 9685 done (global step: 19344) | |
1681061838.949807: Worker 0: training step 9686 done (global step: 19346) | |
1681061838.954999: Worker 0: training step 9687 done (global step: 19348) | |
1681061838.961641: Worker 0: training step 9688 done (global step: 19350) | |
1681061838.967177: Worker 0: training step 9689 done (global step: 19352) | |
1681061838.973519: Worker 0: training step 9690 done (global step: 19354) | |
1681061838.979492: Worker 0: training step 9691 done (global step: 19356) | |
1681061838.985109: Worker 0: training step 9692 done (global step: 19358) | |
1681061838.990516: Worker 0: training step 9693 done (global step: 19360) | |
1681061838.995058: Worker 0: training step 9694 done (global step: 19362) | |
1681061838.999808: Worker 0: training step 9695 done (global step: 19364) | |
1681061839.005676: Worker 0: training step 9696 done (global step: 19365) | |
1681061839.010924: Worker 0: training step 9697 done (global step: 19367) | |
1681061839.018091: Worker 0: training step 9698 done (global step: 19369) | |
1681061839.025044: Worker 0: training step 9699 done (global step: 19372) | |
1681061839.031151: Worker 0: training step 9700 done (global step: 19374) | |
1681061839.036871: Worker 0: training step 9701 done (global step: 19376) | |
1681061839.042775: Worker 0: training step 9702 done (global step: 19378) | |
1681061839.048307: Worker 0: training step 9703 done (global step: 19380) | |
1681061839.053659: Worker 0: training step 9704 done (global step: 19382) | |
1681061839.059542: Worker 0: training step 9705 done (global step: 19384) | |
1681061839.065825: Worker 0: training step 9706 done (global step: 19386) | |
1681061839.070899: Worker 0: training step 9707 done (global step: 19388) | |
1681061839.077158: Worker 0: training step 9708 done (global step: 19390) | |
1681061839.083453: Worker 0: training step 9709 done (global step: 19392) | |
1681061839.088747: Worker 0: training step 9710 done (global step: 19394) | |
1681061839.095177: Worker 0: training step 9711 done (global step: 19395) | |
1681061839.100406: Worker 0: training step 9712 done (global step: 19397) | |
1681061839.105997: Worker 0: training step 9713 done (global step: 19399) | |
1681061839.116853: Worker 0: training step 9714 done (global step: 19402) | |
1681061839.123665: Worker 0: training step 9715 done (global step: 19404) | |
1681061839.131422: Worker 0: training step 9716 done (global step: 19406) | |
1681061839.141840: Worker 0: training step 9717 done (global step: 19408) | |
1681061839.148142: Worker 0: training step 9718 done (global step: 19410) | |
1681061839.157252: Worker 0: training step 9719 done (global step: 19412) | |
1681061839.163898: Worker 0: training step 9720 done (global step: 19414) | |
1681061839.173647: Worker 0: training step 9721 done (global step: 19416) | |
1681061839.180882: Worker 0: training step 9722 done (global step: 19418) | |
1681061839.189712: Worker 0: training step 9723 done (global step: 19419) | |
1681061839.196310: Worker 0: training step 9724 done (global step: 19421) | |
1681061839.203313: Worker 0: training step 9725 done (global step: 19423) | |
1681061839.211704: Worker 0: training step 9726 done (global step: 19425) | |
1681061839.220401: Worker 0: training step 9727 done (global step: 19427) | |
1681061839.231471: Worker 0: training step 9728 done (global step: 19429) | |
1681061839.238628: Worker 0: training step 9729 done (global step: 19431) | |
1681061839.247464: Worker 0: training step 9730 done (global step: 19433) | |
1681061839.257948: Worker 0: training step 9731 done (global step: 19435) | |
1681061839.267321: Worker 0: training step 9732 done (global step: 19438) | |
1681061839.272017: Worker 0: training step 9733 done (global step: 19440) | |
1681061839.276361: Worker 0: training step 9734 done (global step: 19441) | |
1681061839.281213: Worker 0: training step 9735 done (global step: 19442) | |
1681061839.287948: Worker 0: training step 9736 done (global step: 19444) | |
1681061839.293948: Worker 0: training step 9737 done (global step: 19446) | |
1681061839.299755: Worker 0: training step 9738 done (global step: 19448) | |
1681061839.306194: Worker 0: training step 9739 done (global step: 19450) | |
1681061839.312917: Worker 0: training step 9740 done (global step: 19452) | |
1681061839.319461: Worker 0: training step 9741 done (global step: 19454) | |
1681061839.325344: Worker 0: training step 9742 done (global step: 19456) | |
1681061839.330549: Worker 0: training step 9743 done (global step: 19458) | |
1681061839.336194: Worker 0: training step 9744 done (global step: 19460) | |
1681061839.342952: Worker 0: training step 9745 done (global step: 19462) | |
1681061839.348658: Worker 0: training step 9746 done (global step: 19464) | |
1681061839.354684: Worker 0: training step 9747 done (global step: 19466) | |
1681061839.361372: Worker 0: training step 9748 done (global step: 19468) | |
1681061839.367046: Worker 0: training step 9749 done (global step: 19471) | |
1681061839.372708: Worker 0: training step 9750 done (global step: 19472) | |
1681061839.377849: Worker 0: training step 9751 done (global step: 19474) | |
1681061839.384366: Worker 0: training step 9752 done (global step: 19476) | |
1681061839.390772: Worker 0: training step 9753 done (global step: 19478) | |
1681061839.396660: Worker 0: training step 9754 done (global step: 19481) | |
1681061839.403578: Worker 0: training step 9755 done (global step: 19483) | |
1681061839.409352: Worker 0: training step 9756 done (global step: 19485) | |
1681061839.414933: Worker 0: training step 9757 done (global step: 19487) | |
1681061839.420934: Worker 0: training step 9758 done (global step: 19489) | |
1681061839.426853: Worker 0: training step 9759 done (global step: 19491) | |
1681061839.433041: Worker 0: training step 9760 done (global step: 19493) | |
1681061839.439123: Worker 0: training step 9761 done (global step: 19495) | |
1681061839.446413: Worker 0: training step 9762 done (global step: 19497) | |
1681061839.451482: Worker 0: training step 9763 done (global step: 19500) | |
1681061839.457767: Worker 0: training step 9764 done (global step: 19502) | |
1681061839.463589: Worker 0: training step 9765 done (global step: 19504) | |
1681061839.469825: Worker 0: training step 9766 done (global step: 19505) | |
1681061839.475591: Worker 0: training step 9767 done (global step: 19508) | |
1681061839.481442: Worker 0: training step 9768 done (global step: 19510) | |
1681061839.487073: Worker 0: training step 9769 done (global step: 19512) | |
1681061839.493496: Worker 0: training step 9770 done (global step: 19514) | |
1681061839.498111: Worker 0: training step 9771 done (global step: 19516) | |
1681061839.502398: Worker 0: training step 9772 done (global step: 19517) | |
1681061839.507519: Worker 0: training step 9773 done (global step: 19519) | |
1681061839.513420: Worker 0: training step 9774 done (global step: 19521) | |
1681061839.519280: Worker 0: training step 9775 done (global step: 19523) | |
1681061839.524726: Worker 0: training step 9776 done (global step: 19525) | |
1681061839.529978: Worker 0: training step 9777 done (global step: 19527) | |
1681061839.535477: Worker 0: training step 9778 done (global step: 19529) | |
1681061839.542649: Worker 0: training step 9779 done (global step: 19531) | |
1681061839.549367: Worker 0: training step 9780 done (global step: 19533) | |
1681061839.557791: Worker 0: training step 9781 done (global step: 19535) | |
1681061839.566554: Worker 0: training step 9782 done (global step: 19537) | |
1681061839.573045: Worker 0: training step 9783 done (global step: 19539) | |
1681061839.578830: Worker 0: training step 9784 done (global step: 19541) | |
1681061839.584219: Worker 0: training step 9785 done (global step: 19543) | |
1681061839.592007: Worker 0: training step 9786 done (global step: 19545) | |
1681061839.597382: Worker 0: training step 9787 done (global step: 19547) | |
1681061839.603284: Worker 0: training step 9788 done (global step: 19549) | |
1681061839.609090: Worker 0: training step 9789 done (global step: 19551) | |
1681061839.615552: Worker 0: training step 9790 done (global step: 19553) | |
1681061839.624661: Worker 0: training step 9791 done (global step: 19555) | |
1681061839.629960: Worker 0: training step 9792 done (global step: 19557) | |
1681061839.635214: Worker 0: training step 9793 done (global step: 19559) | |
1681061839.641116: Worker 0: training step 9794 done (global step: 19561) | |
1681061839.646813: Worker 0: training step 9795 done (global step: 19563) | |
1681061839.653103: Worker 0: training step 9796 done (global step: 19565) | |
1681061839.661271: Worker 0: training step 9797 done (global step: 19567) | |
1681061839.667100: Worker 0: training step 9798 done (global step: 19569) | |
1681061839.673292: Worker 0: training step 9799 done (global step: 19571) | |
1681061839.679019: Worker 0: training step 9800 done (global step: 19573) | |
1681061839.684121: Worker 0: training step 9801 done (global step: 19575) | |
1681061839.692162: Worker 0: training step 9802 done (global step: 19577) | |
1681061839.697349: Worker 0: training step 9803 done (global step: 19579) | |
1681061839.703275: Worker 0: training step 9804 done (global step: 19581) | |
1681061839.709324: Worker 0: training step 9805 done (global step: 19583) | |
1681061839.714587: Worker 0: training step 9806 done (global step: 19585) | |
1681061839.720663: Worker 0: training step 9807 done (global step: 19587) | |
1681061839.727589: Worker 0: training step 9808 done (global step: 19589) | |
1681061839.732522: Worker 0: training step 9809 done (global step: 19591) | |
1681061839.738711: Worker 0: training step 9810 done (global step: 19592) | |
1681061839.744396: Worker 0: training step 9811 done (global step: 19594) | |
1681061839.750357: Worker 0: training step 9812 done (global step: 19597) | |
1681061839.757957: Worker 0: training step 9813 done (global step: 19598) | |
1681061839.762973: Worker 0: training step 9814 done (global step: 19600) | |
1681061839.768304: Worker 0: training step 9815 done (global step: 19602) | |
1681061839.773863: Worker 0: training step 9816 done (global step: 19604) | |
1681061839.779327: Worker 0: training step 9817 done (global step: 19606) | |
1681061839.784716: Worker 0: training step 9818 done (global step: 19608) | |
1681061839.793648: Worker 0: training step 9819 done (global step: 19610) | |
1681061839.799684: Worker 0: training step 9820 done (global step: 19612) | |
1681061839.805007: Worker 0: training step 9821 done (global step: 19614) | |
1681061839.810560: Worker 0: training step 9822 done (global step: 19616) | |
1681061839.816501: Worker 0: training step 9823 done (global step: 19618) | |
1681061839.826235: Worker 0: training step 9824 done (global step: 19620) | |
1681061839.832013: Worker 0: training step 9825 done (global step: 19623) | |
1681061839.836887: Worker 0: training step 9826 done (global step: 19625) | |
1681061839.842455: Worker 0: training step 9827 done (global step: 19626) | |
1681061839.847434: Worker 0: training step 9828 done (global step: 19629) | |
1681061839.854538: Worker 0: training step 9829 done (global step: 19631) | |
1681061839.862529: Worker 0: training step 9830 done (global step: 19633) | |
1681061839.867443: Worker 0: training step 9831 done (global step: 19635) | |
1681061839.872869: Worker 0: training step 9832 done (global step: 19637) | |
1681061839.878966: Worker 0: training step 9833 done (global step: 19639) | |
1681061839.884595: Worker 0: training step 9834 done (global step: 19641) | |
1681061839.895521: Worker 0: training step 9835 done (global step: 19643) | |
1681061839.901838: Worker 0: training step 9836 done (global step: 19645) | |
1681061839.908805: Worker 0: training step 9837 done (global step: 19647) | |
1681061839.914425: Worker 0: training step 9838 done (global step: 19650) | |
1681061839.922898: Worker 0: training step 9839 done (global step: 19651) | |
1681061839.929070: Worker 0: training step 9840 done (global step: 19654) | |
1681061839.937215: Worker 0: training step 9841 done (global step: 19656) | |
1681061839.942638: Worker 0: training step 9842 done (global step: 19658) | |
1681061839.948404: Worker 0: training step 9843 done (global step: 19660) | |
1681061839.958294: Worker 0: training step 9844 done (global step: 19662) | |
1681061839.965101: Worker 0: training step 9845 done (global step: 19665) | |
1681061839.970734: Worker 0: training step 9846 done (global step: 19667) | |
1681061839.976239: Worker 0: training step 9847 done (global step: 19669) | |
1681061839.982325: Worker 0: training step 9848 done (global step: 19671) | |
1681061839.988968: Worker 0: training step 9849 done (global step: 19673) | |
1681061839.995841: Worker 0: training step 9850 done (global step: 19675) | |
1681061840.001794: Worker 0: training step 9851 done (global step: 19677) | |
1681061840.007093: Worker 0: training step 9852 done (global step: 19679) | |
1681061840.012729: Worker 0: training step 9853 done (global step: 19681) | |
1681061840.018524: Worker 0: training step 9854 done (global step: 19683) | |
1681061840.024281: Worker 0: training step 9855 done (global step: 19685) | |
1681061840.029197: Worker 0: training step 9856 done (global step: 19686) | |
1681061840.035712: Worker 0: training step 9857 done (global step: 19688) | |
1681061840.042496: Worker 0: training step 9858 done (global step: 19690) | |
1681061840.048346: Worker 0: training step 9859 done (global step: 19692) | |
1681061840.053845: Worker 0: training step 9860 done (global step: 19694) | |
1681061840.059945: Worker 0: training step 9861 done (global step: 19696) | |
1681061840.065195: Worker 0: training step 9862 done (global step: 19698) | |
1681061840.070920: Worker 0: training step 9863 done (global step: 19700) | |
1681061840.076839: Worker 0: training step 9864 done (global step: 19702) | |
1681061840.082455: Worker 0: training step 9865 done (global step: 19704) | |
1681061840.088631: Worker 0: training step 9866 done (global step: 19706) | |
1681061840.094397: Worker 0: training step 9867 done (global step: 19708) | |
1681061840.100321: Worker 0: training step 9868 done (global step: 19710) | |
1681061840.105744: Worker 0: training step 9869 done (global step: 19712) | |
1681061840.111419: Worker 0: training step 9870 done (global step: 19714) | |
1681061840.118253: Worker 0: training step 9871 done (global step: 19716) | |
1681061840.123270: Worker 0: training step 9872 done (global step: 19719) | |
1681061840.129715: Worker 0: training step 9873 done (global step: 19720) | |
1681061840.134712: Worker 0: training step 9874 done (global step: 19722) | |
1681061840.139858: Worker 0: training step 9875 done (global step: 19724) | |
1681061840.145740: Worker 0: training step 9876 done (global step: 19726) | |
1681061840.151060: Worker 0: training step 9877 done (global step: 19728) | |
1681061840.156242: Worker 0: training step 9878 done (global step: 19730) | |
1681061840.161674: Worker 0: training step 9879 done (global step: 19732) | |
1681061840.167777: Worker 0: training step 9880 done (global step: 19733) | |
1681061840.174128: Worker 0: training step 9881 done (global step: 19736) | |
1681061840.181806: Worker 0: training step 9882 done (global step: 19737) | |
1681061840.188348: Worker 0: training step 9883 done (global step: 19740) | |
1681061840.193814: Worker 0: training step 9884 done (global step: 19742) | |
1681061840.199080: Worker 0: training step 9885 done (global step: 19744) | |
1681061840.205244: Worker 0: training step 9886 done (global step: 19746) | |
1681061840.210776: Worker 0: training step 9887 done (global step: 19748) | |
1681061840.217333: Worker 0: training step 9888 done (global step: 19750) | |
1681061840.222377: Worker 0: training step 9889 done (global step: 19752) | |
1681061840.227819: Worker 0: training step 9890 done (global step: 19754) | |
1681061840.233640: Worker 0: training step 9891 done (global step: 19756) | |
1681061840.239710: Worker 0: training step 9892 done (global step: 19758) | |
1681061840.245533: Worker 0: training step 9893 done (global step: 19760) | |
1681061840.254300: Worker 0: training step 9894 done (global step: 19762) | |
1681061840.264808: Worker 0: training step 9895 done (global step: 19764) | |
1681061840.270841: Worker 0: training step 9896 done (global step: 19767) | |
1681061840.277140: Worker 0: training step 9897 done (global step: 19769) | |
1681061840.282682: Worker 0: training step 9898 done (global step: 19771) | |
1681061840.288528: Worker 0: training step 9899 done (global step: 19773) | |
1681061840.295531: Worker 0: training step 9900 done (global step: 19775) | |
1681061840.445131: Worker 0: training step 9901 done (global step: 19790) | |
1681061840.449592: Worker 0: training step 9902 done (global step: 19791) | |
1681061840.455016: Worker 0: training step 9903 done (global step: 19792) | |
1681061840.460135: Worker 0: training step 9904 done (global step: 19793) | |
1681061840.466868: Worker 0: training step 9905 done (global step: 19794) | |
1681061840.474374: Worker 0: training step 9906 done (global step: 19795) | |
1681061840.479689: Worker 0: training step 9907 done (global step: 19796) | |
1681061840.484357: Worker 0: training step 9908 done (global step: 19797) | |
1681061840.489740: Worker 0: training step 9909 done (global step: 19798) | |
1681061840.494155: Worker 0: training step 9910 done (global step: 19799) | |
1681061840.498724: Worker 0: training step 9911 done (global step: 19800) | |
1681061840.502940: Worker 0: training step 9912 done (global step: 19801) | |
1681061840.506857: Worker 0: training step 9913 done (global step: 19802) | |
1681061840.512028: Worker 0: training step 9914 done (global step: 19803) | |
1681061840.518897: Worker 0: training step 9915 done (global step: 19804) | |
1681061840.525203: Worker 0: training step 9916 done (global step: 19806) | |
1681061840.529883: Worker 0: training step 9917 done (global step: 19807) | |
1681061840.536044: Worker 0: training step 9918 done (global step: 19809) | |
1681061840.540664: Worker 0: training step 9919 done (global step: 19811) | |
1681061840.546845: Worker 0: training step 9920 done (global step: 19813) | |
1681061840.553145: Worker 0: training step 9921 done (global step: 19815) | |
1681061840.560559: Worker 0: training step 9922 done (global step: 19817) | |
1681061840.566961: Worker 0: training step 9923 done (global step: 19819) | |
1681061840.572273: Worker 0: training step 9924 done (global step: 19822) | |
1681061840.576978: Worker 0: training step 9925 done (global step: 19824) | |
1681061840.582360: Worker 0: training step 9926 done (global step: 19825) | |
1681061840.588065: Worker 0: training step 9927 done (global step: 19827) | |
1681061840.593224: Worker 0: training step 9928 done (global step: 19829) | |
1681061840.598706: Worker 0: training step 9929 done (global step: 19831) | |
1681061840.603861: Worker 0: training step 9930 done (global step: 19833) | |
1681061840.610818: Worker 0: training step 9931 done (global step: 19834) | |
1681061840.616733: Worker 0: training step 9932 done (global step: 19837) | |
1681061840.622698: Worker 0: training step 9933 done (global step: 19839) | |
1681061840.628584: Worker 0: training step 9934 done (global step: 19841) | |
1681061840.633122: Worker 0: training step 9935 done (global step: 19843) | |
1681061840.639107: Worker 0: training step 9936 done (global step: 19844) | |
1681061840.645503: Worker 0: training step 9937 done (global step: 19846) | |
1681061840.650867: Worker 0: training step 9938 done (global step: 19848) | |
1681061840.655305: Worker 0: training step 9939 done (global step: 19850) | |
1681061840.660791: Worker 0: training step 9940 done (global step: 19852) | |
1681061840.666628: Worker 0: training step 9941 done (global step: 19854) | |
1681061840.672148: Worker 0: training step 9942 done (global step: 19856) | |
1681061840.677290: Worker 0: training step 9943 done (global step: 19858) | |
1681061840.683002: Worker 0: training step 9944 done (global step: 19860) | |
1681061840.689098: Worker 0: training step 9945 done (global step: 19862) | |
1681061840.694732: Worker 0: training step 9946 done (global step: 19864) | |
1681061840.700686: Worker 0: training step 9947 done (global step: 19866) | |
1681061840.705599: Worker 0: training step 9948 done (global step: 19868) | |
1681061840.711700: Worker 0: training step 9949 done (global step: 19870) | |
1681061840.718682: Worker 0: training step 9950 done (global step: 19872) | |
1681061840.724157: Worker 0: training step 9951 done (global step: 19874) | |
1681061840.730333: Worker 0: training step 9952 done (global step: 19876) | |
1681061840.735313: Worker 0: training step 9953 done (global step: 19878) | |
1681061840.740443: Worker 0: training step 9954 done (global step: 19880) | |
1681061840.744914: Worker 0: training step 9955 done (global step: 19882) | |
1681061840.751573: Worker 0: training step 9956 done (global step: 19883) | |
1681061840.759126: Worker 0: training step 9957 done (global step: 19886) | |
1681061840.764978: Worker 0: training step 9958 done (global step: 19888) | |
1681061840.770927: Worker 0: training step 9959 done (global step: 19890) | |
1681061840.776119: Worker 0: training step 9960 done (global step: 19892) | |
1681061840.781792: Worker 0: training step 9961 done (global step: 19894) | |
1681061840.786803: Worker 0: training step 9962 done (global step: 19896) | |
1681061840.792684: Worker 0: training step 9963 done (global step: 19898) | |
1681061840.797601: Worker 0: training step 9964 done (global step: 19900) | |
1681061840.804143: Worker 0: training step 9965 done (global step: 19902) | |
1681061840.809438: Worker 0: training step 9966 done (global step: 19904) | |
1681061840.815101: Worker 0: training step 9967 done (global step: 19906) | |
1681061840.820349: Worker 0: training step 9968 done (global step: 19908) | |
1681061840.828145: Worker 0: training step 9969 done (global step: 19910) | |
1681061840.834460: Worker 0: training step 9970 done (global step: 19912) | |
1681061840.840355: Worker 0: training step 9971 done (global step: 19914) | |
1681061840.846172: Worker 0: training step 9972 done (global step: 19916) | |
1681061840.852525: Worker 0: training step 9973 done (global step: 19918) | |
1681061840.859551: Worker 0: training step 9974 done (global step: 19921) | |
1681061840.864290: Worker 0: training step 9975 done (global step: 19923) | |
1681061840.870843: Worker 0: training step 9976 done (global step: 19925) | |
1681061840.876836: Worker 0: training step 9977 done (global step: 19927) | |
1681061840.881356: Worker 0: training step 9978 done (global step: 19928) | |
1681061840.887348: Worker 0: training step 9979 done (global step: 19930) | |
1681061840.892764: Worker 0: training step 9980 done (global step: 19932) | |
1681061840.897999: Worker 0: training step 9981 done (global step: 19934) | |
1681061840.903977: Worker 0: training step 9982 done (global step: 19936) | |
1681061840.908945: Worker 0: training step 9983 done (global step: 19938) | |
1681061840.914378: Worker 0: training step 9984 done (global step: 19939) | |
1681061840.920948: Worker 0: training step 9985 done (global step: 19941) | |
1681061840.927326: Worker 0: training step 9986 done (global step: 19944) | |
1681061840.932932: Worker 0: training step 9987 done (global step: 19946) | |
1681061840.938639: Worker 0: training step 9988 done (global step: 19948) | |
1681061840.945020: Worker 0: training step 9989 done (global step: 19950) | |
1681061840.950778: Worker 0: training step 9990 done (global step: 19952) | |
1681061840.956662: Worker 0: training step 9991 done (global step: 19954) | |
1681061840.962189: Worker 0: training step 9992 done (global step: 19956) | |
1681061840.967711: Worker 0: training step 9993 done (global step: 19958) | |
1681061840.973688: Worker 0: training step 9994 done (global step: 19960) | |
1681061840.979308: Worker 0: training step 9995 done (global step: 19962) | |
1681061840.985047: Worker 0: training step 9996 done (global step: 19964) | |
1681061840.990976: Worker 0: training step 9997 done (global step: 19966) | |
1681061840.997217: Worker 0: training step 9998 done (global step: 19968) | |
1681061841.002671: Worker 0: training step 9999 done (global step: 19970) | |
1681061841.008485: Worker 0: training step 10000 done (global step: 19972) | |
1681061841.014459: Worker 0: training step 10001 done (global step: 19974) | |
1681061841.019506: Worker 0: training step 10002 done (global step: 19976) | |
1681061841.024869: Worker 0: training step 10003 done (global step: 19977) | |
1681061841.030782: Worker 0: training step 10004 done (global step: 19979) | |
1681061841.037421: Worker 0: training step 10005 done (global step: 19982) | |
1681061841.044853: Worker 0: training step 10006 done (global step: 19984) | |
1681061841.054040: Worker 0: training step 10007 done (global step: 19986) | |
1681061841.065100: Worker 0: training step 10008 done (global step: 19988) | |
1681061841.080750: Worker 0: training step 10009 done (global step: 19990) | |
1681061841.101212: Worker 0: training step 10010 done (global step: 19991) | |
1681061841.119485: Worker 0: training step 10011 done (global step: 19994) | |
1681061841.128046: Worker 0: training step 10012 done (global step: 19996) | |
1681061841.135979: Worker 0: training step 10013 done (global step: 19998) | |
1681061841.152361: Worker 0: training step 10014 done (global step: 20000) | |
Training ends @ 1681061841.152470 | |
Training elapsed time: 67.009724 s | |
After 20000 training step(s), validation cross entropy = 1684.84 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment