Skip to content

Instantly share code, notes, and snippets.

@crizCraig

crizCraig/gist:2e15fff780a28b4757adbf81e9e9dbd0

Created December 7, 2019 01:52
Show Gist options
  • Save crizCraig/2e15fff780a28b4757adbf81e9e9dbd0 to your computer and use it in GitHub Desktop.
Save crizCraig/2e15fff780a28b4757adbf81e9e9dbd0 to your computer and use it in GitHub Desktop.
Download ZIP
ppo dd2d plus accel STRAIGHT_TEST
Raw
gistfile1.txt
This file has been truncated, but you can view the full file.
:27.232 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 266.12, Steps: 708, Distance 19.58, Angular velocity 0.0, Speed: 2.61, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.28, Angle accuracy 0.0, Num episodes 521
2019-12-06 17:31:27.963 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 819
2019-12-06 17:31:27.963 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.97, Steps: 820, Distance 24.26, Angular velocity 0.0, Speed: 2.71, Max gforce: 0.09, Avg gforce: 0.02, Trip pct 96.07, Angle accuracy 0.0, Num episodes 522
2019-12-06 17:31:28.836 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 972
2019-12-06 17:31:28.837 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.85, Steps: 973, Distance 31.91, Angular velocity 0.0, Speed: 2.8, Max gforce: 0.09, Avg gforce: 0.02, Trip pct 97.01, Angle accuracy 0.0, Num episodes 523
2019-12-06 17:31:29.696 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 956
2019-12-06 17:31:29.696 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 335.08, Steps: 957, Distance 30.95, Angular velocity 0.0, Speed: 2.75, Max gforce: 0.1, Avg gforce: 0.02, Trip pct 96.91, Angle accuracy 0.0, Num episodes 524
Warning: trajectory cut off by epoch at 542 steps.
---------------------------------------
| Epoch | 106 |
| AverageEpRet | 307 |
| StdEpRet | 26.8 |
| MaxEpRet | 335 |
| MinEpRet | 266 |
| EpLen | 864 |
| AverageVVals | 30.2 |
| StdVVals | 0.000339 |
| MaxVVals | 30.2 |
| MinVVals | 30.2 |
| TotalEnvInteracts | 4.28e+05 |
| LossPi | 2.5e-09 |
| LossV | 100 |
| DeltaLossPi | -0.00224 |
| DeltaLossV | -3.49 |
| Entropy | -0.745 |
| KL | 0.00332 |
| ClipFrac | 0.0373 |
| StopIter | 79 |
| Time | 406 |
---------------------------------------
2019-12-06 17:31:30.695 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 415
2019-12-06 17:31:30.695 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 177.4, Steps: 416, Distance 7.79, Angular velocity 0.0, Speed: 2.19, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 88.69, Angle accuracy 0.0, Num episodes 525
2019-12-06 17:31:31.510 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 890
2019-12-06 17:31:31.511 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.28, Steps: 891, Distance 28.0, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.1, Avg gforce: 0.02, Trip pct 96.7, Angle accuracy 0.0, Num episodes 526
2019-12-06 17:31:32.371 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 954
2019-12-06 17:31:32.372 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 319.86, Steps: 955, Distance 32.38, Angular velocity 0.0, Speed: 2.8, Max gforce: 0.09, Avg gforce: 0.02, Trip pct 97.02, Angle accuracy 0.0, Num episodes 527
2019-12-06 17:31:32.981 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 670
2019-12-06 17:31:32.981 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 242.34, Steps: 671, Distance 18.85, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 95.05, Angle accuracy 0.0, Num episodes 528
2019-12-06 17:31:33.437 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 500
2019-12-06 17:31:33.438 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 198.16, Steps: 501, Distance 10.93, Angular velocity 0.0, Speed: 2.37, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 91.66, Angle accuracy 0.0, Num episodes 529
Warning: trajectory cut off by epoch at 566 steps.
---------------------------------------
| Epoch | 107 |
| AverageEpRet | 250 |
| StdEpRet | 57.7 |
| MaxEpRet | 320 |
| MinEpRet | 177 |
| EpLen | 687 |
| AverageVVals | 32 |
| StdVVals | 0.000356 |
| MaxVVals | 32 |
| MinVVals | 32 |
| TotalEnvInteracts | 4.32e+05 |
| LossPi | -1.19e-08 |
| LossV | 106 |
| DeltaLossPi | -0.00172 |
| DeltaLossV | -0.0169 |
| Entropy | -0.774 |
| KL | 0.00122 |
| ClipFrac | 0.0237 |
| StopIter | 79 |
| Time | 410 |
---------------------------------------
2019-12-06 17:31:34.747 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 681
2019-12-06 17:31:34.747 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 267.94, Steps: 682, Distance 19.46, Angular velocity 0.0, Speed: 2.71, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 95.24, Angle accuracy 0.0, Num episodes 530
2019-12-06 17:31:35.409 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 737
2019-12-06 17:31:35.409 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 272.29, Steps: 738, Distance 21.35, Angular velocity 0.0, Speed: 2.67, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 531
2019-12-06 17:31:35.937 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 570
2019-12-06 17:31:35.938 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 231.56, Steps: 571, Distance 13.57, Angular velocity 0.0, Speed: 2.5, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.2, Angle accuracy 0.0, Num episodes 532
2019-12-06 17:31:36.362 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 465
2019-12-06 17:31:36.362 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 195.7, Steps: 466, Distance 9.68, Angular velocity 0.0, Speed: 2.31, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 90.91, Angle accuracy 0.0, Num episodes 533
2019-12-06 17:31:37.168 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 895
2019-12-06 17:31:37.168 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 307.04, Steps: 896, Distance 28.34, Angular velocity 0.0, Speed: 2.76, Max gforce: 0.1, Avg gforce: 0.02, Trip pct 96.69, Angle accuracy 0.0, Num episodes 534
Warning: trajectory cut off by epoch at 647 steps.
---------------------------------------
| Epoch | 108 |
| AverageEpRet | 255 |
| StdEpRet | 38.1 |
| MaxEpRet | 307 |
| MinEpRet | 196 |
| EpLen | 671 |
| AverageVVals | 31.9 |
| StdVVals | 0.000304 |
| MaxVVals | 31.9 |
| MinVVals | 31.9 |
| TotalEnvInteracts | 4.36e+05 |
| LossPi | -9.6e-09 |
| LossV | 116 |
| DeltaLossPi | -0.00237 |
| DeltaLossV | -0.623 |
| Entropy | -0.8 |
| KL | 0.00394 |
| ClipFrac | 0.0322 |
| StopIter | 79 |
| Time | 414 |
---------------------------------------
2019-12-06 17:31:38.275 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 451
2019-12-06 17:31:38.276 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 193.79, Steps: 452, Distance 9.3, Angular velocity 0.0, Speed: 2.3, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 90.46, Angle accuracy 0.0, Num episodes 535
2019-12-06 17:31:38.820 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 610
2019-12-06 17:31:38.821 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 240.24, Steps: 611, Distance 15.54, Angular velocity 0.0, Speed: 2.6, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 94.05, Angle accuracy 0.0, Num episodes 536
2019-12-06 17:31:39.328 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 548
2019-12-06 17:31:39.329 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 215.82, Steps: 549, Distance 13.59, Angular velocity 0.0, Speed: 2.55, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 93.31, Angle accuracy 0.0, Num episodes 537
2019-12-06 17:31:39.921 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 664
2019-12-06 17:31:39.921 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 243.95, Steps: 665, Distance 18.2, Angular velocity 0.0, Speed: 2.74, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 94.94, Angle accuracy 0.0, Num episodes 538
2019-12-06 17:31:40.671 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 819
2019-12-06 17:31:40.671 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 302.18, Steps: 820, Distance 25.51, Angular velocity 0.0, Speed: 2.82, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.27, Angle accuracy 0.0, Num episodes 539
2019-12-06 17:31:41.060 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 409
2019-12-06 17:31:41.061 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 177.15, Steps: 410, Distance 7.74, Angular velocity 0.0, Speed: 2.13, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 88.72, Angle accuracy 0.0, Num episodes 540
Warning: trajectory cut off by epoch at 493 steps.
---------------------------------------
| Epoch | 109 |
| AverageEpRet | 229 |
| StdEpRet | 40.4 |
| MaxEpRet | 302 |
| MinEpRet | 177 |
| EpLen | 584 |
| AverageVVals | 32.7 |
| StdVVals | 0.000296 |
| MaxVVals | 32.7 |
| MinVVals | 32.7 |
| TotalEnvInteracts | 4.4e+05 |
| LossPi | -3.04e-09 |
| LossV | 109 |
| DeltaLossPi | -0.00297 |
| DeltaLossV | -0.00272 |
| Entropy | -0.784 |
| KL | 0.00453 |
| ClipFrac | 0.0432 |
| StopIter | 79 |
| Time | 418 |
---------------------------------------
2019-12-06 17:31:42.370 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 785
2019-12-06 17:31:42.370 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.55, Steps: 786, Distance 23.26, Angular velocity 0.0, Speed: 2.92, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.95, Angle accuracy 0.0, Num episodes 541
2019-12-06 17:31:42.806 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 489
2019-12-06 17:31:42.806 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 206.35, Steps: 490, Distance 10.46, Angular velocity 0.0, Speed: 2.44, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 91.52, Angle accuracy 0.0, Num episodes 542
2019-12-06 17:31:43.436 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 682
2019-12-06 17:31:43.437 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 262.13, Steps: 683, Distance 19.36, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.14, Angle accuracy 0.0, Num episodes 543
2019-12-06 17:31:44.193 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 843
2019-12-06 17:31:44.193 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 318.8, Steps: 844, Distance 27.52, Angular velocity 0.0, Speed: 2.94, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 96.52, Angle accuracy 0.0, Num episodes 544
2019-12-06 17:31:44.873 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 759
2019-12-06 17:31:44.873 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 289.4, Steps: 760, Distance 23.01, Angular velocity 0.0, Speed: 2.88, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.84, Angle accuracy 0.0, Num episodes 545
Warning: trajectory cut off by epoch at 437 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 110 |
| AverageEpRet | 275 |
| StdEpRet | 39 |
| MaxEpRet | 319 |
| MinEpRet | 206 |
| EpLen | 713 |
| AverageVVals | 32.7 |
| StdVVals | 0.000257 |
| MaxVVals | 32.7 |
| MinVVals | 32.7 |
| TotalEnvInteracts | 4.44e+05 |
| LossPi | 3.1e-09 |
| LossV | 109 |
| DeltaLossPi | -0.000671 |
| DeltaLossV | -0.854 |
| Entropy | -0.771 |
| KL | 0.00117 |
| ClipFrac | 0.012 |
| StopIter | 79 |
| Time | 422 |
---------------------------------------
2019-12-06 17:31:46.494 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 966
2019-12-06 17:31:46.494 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.89, Steps: 967, Distance 32.9, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.1, Avg gforce: 0.02, Trip pct 97.12, Angle accuracy 0.0, Num episodes 546
2019-12-06 17:31:46.991 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 546
2019-12-06 17:31:46.992 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 213.04, Steps: 547, Distance 13.27, Angular velocity 0.0, Speed: 2.63, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 93.17, Angle accuracy 0.0, Num episodes 547
2019-12-06 17:31:47.331 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 348
2019-12-06 17:31:47.331 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 142.62, Steps: 349, Distance 5.59, Angular velocity 0.0, Speed: 1.98, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 85.04, Angle accuracy 0.0, Num episodes 548
2019-12-06 17:31:47.816 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:31:47.817 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 223.5, Steps: 548, Distance 13.19, Angular velocity 0.0, Speed: 2.58, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 92.97, Angle accuracy 0.0, Num episodes 549
2019-12-06 17:31:48.620 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 887
2019-12-06 17:31:48.620 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.13, Steps: 888, Distance 28.98, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.1, Avg gforce: 0.02, Trip pct 96.73, Angle accuracy 0.0, Num episodes 550
Warning: trajectory cut off by epoch at 701 steps.
---------------------------------------
| Epoch | 111 |
| AverageEpRet | 249 |
| StdEpRet | 73.6 |
| MaxEpRet | 338 |
| MinEpRet | 143 |
| EpLen | 660 |
| AverageVVals | 33.6 |
| StdVVals | 0.00025 |
| MaxVVals | 33.6 |
| MinVVals | 33.6 |
| TotalEnvInteracts | 4.48e+05 |
| LossPi | 2.74e-09 |
| LossV | 98.9 |
| DeltaLossPi | -0.0019 |
| DeltaLossV | -0.378 |
| Entropy | -0.754 |
| KL | 0.00279 |
| ClipFrac | 0.0237 |
| StopIter | 79 |
| Time | 425 |
---------------------------------------
2019-12-06 17:31:49.893 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 577
2019-12-06 17:31:49.893 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 223.85, Steps: 578, Distance 15.29, Angular velocity 0.0, Speed: 2.73, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.0, Angle accuracy 0.0, Num episodes 551
2019-12-06 17:31:50.492 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:31:50.493 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 249.06, Steps: 675, Distance 19.73, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.23, Angle accuracy 0.0, Num episodes 552
2019-12-06 17:31:50.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 456
2019-12-06 17:31:50.902 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 187.92, Steps: 457, Distance 9.86, Angular velocity 0.0, Speed: 2.39, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 90.84, Angle accuracy 0.0, Num episodes 553
2019-12-06 17:31:51.278 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 418
2019-12-06 17:31:51.278 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 175.74, Steps: 419, Distance 7.86, Angular velocity 0.0, Speed: 2.19, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 88.78, Angle accuracy 0.0, Num episodes 554
2019-12-06 17:31:51.954 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 758
2019-12-06 17:31:51.955 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 278.93, Steps: 759, Distance 23.23, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.11, Avg gforce: 0.03, Trip pct 95.94, Angle accuracy 0.0, Num episodes 555
2019-12-06 17:31:52.686 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 825
2019-12-06 17:31:52.687 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.21, Steps: 826, Distance 26.4, Angular velocity 0.0, Speed: 3.02, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 556
Warning: trajectory cut off by epoch at 286 steps.
---------------------------------------
| Epoch | 112 |
| AverageEpRet | 238 |
| StdEpRet | 48.6 |
| MaxEpRet | 314 |
| MinEpRet | 176 |
| EpLen | 619 |
| AverageVVals | 33 |
| StdVVals | 0.000229 |
| MaxVVals | 33 |
| MinVVals | 33 |
| TotalEnvInteracts | 4.52e+05 |
| LossPi | 4.05e-09 |
| LossV | 114 |
| DeltaLossPi | -0.00251 |
| DeltaLossV | -0.0155 |
| Entropy | -0.772 |
| KL | 0.00427 |
| ClipFrac | 0.0353 |
| StopIter | 79 |
| Time | 429 |
---------------------------------------
2019-12-06 17:31:53.832 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 840
2019-12-06 17:31:53.833 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 316.95, Steps: 841, Distance 26.87, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 96.56, Angle accuracy 0.0, Num episodes 557
2019-12-06 17:31:54.324 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 540
2019-12-06 17:31:54.325 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 219.92, Steps: 541, Distance 12.37, Angular velocity 0.0, Speed: 2.55, Max gforce: 0.11, Avg gforce: 0.03, Trip pct 92.75, Angle accuracy 0.0, Num episodes 558
2019-12-06 17:31:54.731 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 453
2019-12-06 17:31:54.731 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 185.74, Steps: 454, Distance 8.25, Angular velocity 0.0, Speed: 2.12, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 89.23, Angle accuracy 0.0, Num episodes 559
2019-12-06 17:31:55.570 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 929
2019-12-06 17:31:55.570 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.54, Steps: 930, Distance 32.31, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.1, Avg gforce: 0.02, Trip pct 97.0, Angle accuracy 0.0, Num episodes 560
2019-12-06 17:31:56.228 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 731
2019-12-06 17:31:56.228 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 274.39, Steps: 732, Distance 22.05, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 95.7, Angle accuracy 0.0, Num episodes 561
Warning: trajectory cut off by epoch at 502 steps.
---------------------------------------
| Epoch | 113 |
| AverageEpRet | 269 |
| StdEpRet | 59.2 |
| MaxEpRet | 346 |
| MinEpRet | 186 |
| EpLen | 700 |
| AverageVVals | 32.9 |
| StdVVals | 0.000206 |
| MaxVVals | 32.9 |
| MinVVals | 32.9 |
| TotalEnvInteracts | 4.56e+05 |
| LossPi | 4.52e-08 |
| LossV | 102 |
| DeltaLossPi | -0.00255 |
| DeltaLossV | -0.726 |
| Entropy | -0.782 |
| KL | 0.006 |
| ClipFrac | 0.0395 |
| StopIter | 79 |
| Time | 433 |
---------------------------------------
2019-12-06 17:31:57.275 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 501
2019-12-06 17:31:57.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 208.33, Steps: 502, Distance 11.2, Angular velocity 0.0, Speed: 2.46, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 91.87, Angle accuracy 0.0, Num episodes 562
2019-12-06 17:31:57.991 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 799
2019-12-06 17:31:57.992 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.88, Steps: 800, Distance 25.08, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.21, Angle accuracy 0.0, Num episodes 563
2019-12-06 17:31:58.656 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:31:58.657 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 285.95, Steps: 739, Distance 21.85, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.69, Angle accuracy 0.0, Num episodes 564
2019-12-06 17:31:59.255 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:31:59.255 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 264.52, Steps: 666, Distance 18.39, Angular velocity 0.0, Speed: 2.82, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.96, Angle accuracy 0.0, Num episodes 565
2019-12-06 17:31:59.706 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:31:59.706 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 218.58, Steps: 503, Distance 11.44, Angular velocity 0.0, Speed: 2.58, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 91.96, Angle accuracy 0.0, Num episodes 566
2019-12-06 17:32:00.291 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:32:00.292 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 269.56, Steps: 655, Distance 18.21, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.85, Angle accuracy 0.0, Num episodes 567
Warning: trajectory cut off by epoch at 135 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 114 |
| AverageEpRet | 260 |
| StdEpRet | 37.2 |
| MaxEpRet | 316 |
| MinEpRet | 208 |
| EpLen | 644 |
| AverageVVals | 33.7 |
| StdVVals | 0.000207 |
| MaxVVals | 33.7 |
| MinVVals | 33.7 |
| TotalEnvInteracts | 4.6e+05 |
| LossPi | -9.54e-09 |
| LossV | 120 |
| DeltaLossPi | -0.0044 |
| DeltaLossV | -0.0657 |
| Entropy | -0.841 |
| KL | 0.0034 |
| ClipFrac | 0.02 |
| StopIter | 2 |
| Time | 437 |
---------------------------------------
2019-12-06 17:32:01.033 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:32:01.034 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 246.25, Steps: 586, Distance 15.1, Angular velocity 0.0, Speed: 2.78, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 93.89, Angle accuracy 0.0, Num episodes 568
2019-12-06 17:32:01.843 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 893
2019-12-06 17:32:01.844 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 349.55, Steps: 894, Distance 30.71, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.96, Angle accuracy 0.0, Num episodes 569
2019-12-06 17:32:02.553 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 788
2019-12-06 17:32:02.553 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.25, Steps: 789, Distance 25.53, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.3, Angle accuracy 0.0, Num episodes 570
2019-12-06 17:32:03.205 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:32:03.206 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 285.14, Steps: 729, Distance 21.75, Angular velocity 0.0, Speed: 3.02, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.77, Angle accuracy 0.0, Num episodes 571
2019-12-06 17:32:03.743 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:32:03.743 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 253.01, Steps: 593, Distance 15.88, Angular velocity 0.0, Speed: 2.79, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.22, Angle accuracy 0.0, Num episodes 572
Warning: trajectory cut off by epoch at 409 steps.
---------------------------------------
| Epoch | 115 |
| AverageEpRet | 290 |
| StdEpRet | 38.6 |
| MaxEpRet | 350 |
| MinEpRet | 246 |
| EpLen | 718 |
| AverageVVals | 34 |
| StdVVals | 0.000186 |
| MaxVVals | 34 |
| MinVVals | 34 |
| TotalEnvInteracts | 4.64e+05 |
| LossPi | -2.38e-08 |
| LossV | 121 |
| DeltaLossPi | -0.00246 |
| DeltaLossV | -0.892 |
| Entropy | -0.832 |
| KL | 0.00446 |
| ClipFrac | 0.0503 |
| StopIter | 79 |
| Time | 440 |
---------------------------------------
2019-12-06 17:32:04.940 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:32:04.940 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 308.79, Steps: 743, Distance 24.18, Angular velocity 0.0, Speed: 3.11, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.17, Angle accuracy 0.0, Num episodes 573
2019-12-06 17:32:05.667 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 804
2019-12-06 17:32:05.667 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 317.63, Steps: 805, Distance 25.65, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 574
2019-12-06 17:32:06.347 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:32:06.348 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 293.32, Steps: 730, Distance 22.23, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.77, Angle accuracy 0.0, Num episodes 575
2019-12-06 17:32:06.879 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 589
2019-12-06 17:32:06.879 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 257.87, Steps: 590, Distance 15.68, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 94.21, Angle accuracy 0.0, Num episodes 576
2019-12-06 17:32:07.494 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:32:07.494 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.64, Steps: 689, Distance 20.41, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.55, Angle accuracy 0.0, Num episodes 577
Warning: trajectory cut off by epoch at 443 steps.
---------------------------------------
| Epoch | 116 |
| AverageEpRet | 292 |
| StdEpRet | 20.8 |
| MaxEpRet | 318 |
| MinEpRet | 258 |
| EpLen | 711 |
| AverageVVals | 34.9 |
| StdVVals | 0.000175 |
| MaxVVals | 34.9 |
| MinVVals | 34.9 |
| TotalEnvInteracts | 4.68e+05 |
| LossPi | 1.79e-08 |
| LossV | 140 |
| DeltaLossPi | -0.00142 |
| DeltaLossV | -0.989 |
| Entropy | -0.873 |
| KL | 0.00086 |
| ClipFrac | 0.00975 |
| StopIter | 79 |
| Time | 444 |
---------------------------------------
2019-12-06 17:32:08.681 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:32:08.682 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 277.52, Steps: 714, Distance 22.1, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.71, Angle accuracy 0.0, Num episodes 578
2019-12-06 17:32:09.358 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 720
2019-12-06 17:32:09.359 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 275.93, Steps: 721, Distance 22.86, Angular velocity 0.0, Speed: 3.07, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.91, Angle accuracy 0.0, Num episodes 579
2019-12-06 17:32:10.140 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 880
2019-12-06 17:32:10.141 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 336.02, Steps: 881, Distance 30.41, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.86, Angle accuracy 0.0, Num episodes 580
2019-12-06 17:32:10.569 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 477
2019-12-06 17:32:10.569 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 209.63, Steps: 478, Distance 10.93, Angular velocity 0.0, Speed: 2.6, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 91.67, Angle accuracy 0.0, Num episodes 581
2019-12-06 17:32:11.093 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:32:11.094 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 251.75, Steps: 589, Distance 15.85, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 94.33, Angle accuracy 0.0, Num episodes 582
Warning: trajectory cut off by epoch at 617 steps.
---------------------------------------
| Epoch | 117 |
| AverageEpRet | 270 |
| StdEpRet | 41.1 |
| MaxEpRet | 336 |
| MinEpRet | 210 |
| EpLen | 677 |
| AverageVVals | 35.9 |
| StdVVals | 0.000165 |
| MaxVVals | 35.9 |
| MinVVals | 35.9 |
| TotalEnvInteracts | 4.72e+05 |
| LossPi | -1.45e-08 |
| LossV | 135 |
| DeltaLossPi | -0.000394 |
| DeltaLossV | -0.702 |
| Entropy | -0.878 |
| KL | 0.00211 |
| ClipFrac | 0.01 |
| StopIter | 79 |
| Time | 448 |
---------------------------------------
2019-12-06 17:32:12.629 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 917
2019-12-06 17:32:12.629 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 342.99, Steps: 918, Distance 31.94, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.09, Avg gforce: 0.02, Trip pct 97.02, Angle accuracy 0.0, Num episodes 583
2019-12-06 17:32:13.216 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 667
2019-12-06 17:32:13.217 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 273.82, Steps: 668, Distance 20.07, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.35, Angle accuracy 0.0, Num episodes 584
2019-12-06 17:32:13.866 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:32:13.866 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 285.11, Steps: 729, Distance 22.78, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.91, Angle accuracy 0.0, Num episodes 585
2019-12-06 17:32:14.436 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 620
2019-12-06 17:32:14.436 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 275.74, Steps: 621, Distance 17.4, Angular velocity 0.0, Speed: 2.89, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.6, Angle accuracy 0.0, Num episodes 586
2019-12-06 17:32:15.138 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 779
2019-12-06 17:32:15.138 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 316.62, Steps: 780, Distance 24.54, Angular velocity 0.0, Speed: 3.0, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.19, Angle accuracy 0.0, Num episodes 587
Warning: trajectory cut off by epoch at 284 steps.
---------------------------------------
| Epoch | 118 |
| AverageEpRet | 299 |
| StdEpRet | 26.9 |
| MaxEpRet | 343 |
| MinEpRet | 274 |
| EpLen | 743 |
| AverageVVals | 35.1 |
| StdVVals | 0.000154 |
| MaxVVals | 35.1 |
| MinVVals | 35.1 |
| TotalEnvInteracts | 4.76e+05 |
| LossPi | 2.41e-08 |
| LossV | 144 |
| DeltaLossPi | -0.0033 |
| DeltaLossV | -0.114 |
| Entropy | -0.898 |
| KL | 0.00162 |
| ClipFrac | 0.0335 |
| StopIter | 79 |
| Time | 452 |
---------------------------------------
2019-12-06 17:32:16.173 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 720
2019-12-06 17:32:16.174 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 276.97, Steps: 721, Distance 22.56, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 588
2019-12-06 17:32:16.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 476
2019-12-06 17:32:16.601 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 224.84, Steps: 477, Distance 11.07, Angular velocity 0.0, Speed: 2.59, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 91.84, Angle accuracy 0.0, Num episodes 589
2019-12-06 17:32:17.238 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 708
2019-12-06 17:32:17.238 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.71, Steps: 709, Distance 22.33, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.72, Angle accuracy 0.0, Num episodes 590
2019-12-06 17:32:17.915 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:32:17.916 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 307.63, Steps: 763, Distance 24.95, Angular velocity 0.0, Speed: 2.94, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.24, Angle accuracy 0.0, Num episodes 591
2019-12-06 17:32:18.329 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 449
2019-12-06 17:32:18.329 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 207.54, Steps: 450, Distance 10.29, Angular velocity 0.0, Speed: 2.54, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 91.16, Angle accuracy 0.0, Num episodes 592
2019-12-06 17:32:18.946 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 692
2019-12-06 17:32:18.946 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 293.11, Steps: 693, Distance 20.71, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.4, Angle accuracy 0.0, Num episodes 593
Warning: trajectory cut off by epoch at 187 steps.
---------------------------------------
| Epoch | 119 |
| AverageEpRet | 266 |
| StdEpRet | 36.9 |
| MaxEpRet | 308 |
| MinEpRet | 208 |
| EpLen | 636 |
| AverageVVals | 34.7 |
| StdVVals | 0.00014 |
| MaxVVals | 34.7 |
| MinVVals | 34.7 |
| TotalEnvInteracts | 4.8e+05 |
| LossPi | -2.51e-08 |
| LossV | 170 |
| DeltaLossPi | -0.00198 |
| DeltaLossV | -0.141 |
| Entropy | -0.926 |
| KL | 0.00367 |
| ClipFrac | 0.0485 |
| StopIter | 79 |
| Time | 455 |
---------------------------------------
2019-12-06 17:32:19.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 687
2019-12-06 17:32:19.903 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 277.49, Steps: 688, Distance 20.86, Angular velocity 0.0, Speed: 2.89, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.56, Angle accuracy 0.0, Num episodes 594
2019-12-06 17:32:20.382 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 532
2019-12-06 17:32:20.383 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 233.82, Steps: 533, Distance 13.84, Angular velocity 0.0, Speed: 2.7, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 93.31, Angle accuracy 0.0, Num episodes 595
2019-12-06 17:32:20.868 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 552
2019-12-06 17:32:20.869 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 245.16, Steps: 553, Distance 14.18, Angular velocity 0.0, Speed: 2.71, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.56, Angle accuracy 0.0, Num episodes 596
2019-12-06 17:32:21.486 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:32:21.486 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 294.03, Steps: 695, Distance 21.52, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.75, Angle accuracy 0.0, Num episodes 597
2019-12-06 17:32:22.351 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 964
2019-12-06 17:32:22.351 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.88, Steps: 965, Distance 33.79, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.08, Avg gforce: 0.02, Trip pct 97.23, Angle accuracy 0.0, Num episodes 598
Warning: trajectory cut off by epoch at 566 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 120 |
| AverageEpRet | 283 |
| StdEpRet | 46.3 |
| MaxEpRet | 365 |
| MinEpRet | 234 |
| EpLen | 687 |
| AverageVVals | 35.1 |
| StdVVals | 0.000121 |
| MaxVVals | 35.1 |
| MinVVals | 35.1 |
| TotalEnvInteracts | 4.84e+05 |
| LossPi | -8.12e-09 |
| LossV | 145 |
| DeltaLossPi | -0.00204 |
| DeltaLossV | -0.0637 |
| Entropy | -0.94 |
| KL | 0.00489 |
| ClipFrac | 0.0455 |
| StopIter | 79 |
| Time | 459 |
---------------------------------------
2019-12-06 17:32:23.701 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 524
2019-12-06 17:32:23.702 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 250.3, Steps: 525, Distance 12.74, Angular velocity 0.0, Speed: 2.63, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 92.93, Angle accuracy 0.0, Num episodes 599
2019-12-06 17:32:24.333 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 685
2019-12-06 17:32:24.334 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 291.08, Steps: 686, Distance 20.52, Angular velocity 0.0, Speed: 3.0, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.49, Angle accuracy 0.0, Num episodes 600
2019-12-06 17:32:24.718 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 425
2019-12-06 17:32:24.719 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 199.61, Steps: 426, Distance 8.71, Angular velocity 0.0, Speed: 2.32, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 89.71, Angle accuracy 0.0, Num episodes 601
2019-12-06 17:32:25.427 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 793
2019-12-06 17:32:25.427 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.18, Steps: 794, Distance 26.14, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.44, Angle accuracy 0.0, Num episodes 602
2019-12-06 17:32:26.087 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:32:26.087 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 302.54, Steps: 726, Distance 22.09, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.7, Angle accuracy 0.0, Num episodes 603
2019-12-06 17:32:26.826 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 804
2019-12-06 17:32:26.827 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.32, Steps: 805, Distance 26.48, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 604
Warning: trajectory cut off by epoch at 38 steps.
---------------------------------------
| Epoch | 121 |
| AverageEpRet | 284 |
| StdEpRet | 46.6 |
| MaxEpRet | 338 |
| MinEpRet | 200 |
| EpLen | 660 |
| AverageVVals | 35.4 |
| StdVVals | 0.000128 |
| MaxVVals | 35.4 |
| MinVVals | 35.4 |
| TotalEnvInteracts | 4.88e+05 |
| LossPi | 2.79e-08 |
| LossV | 178 |
| DeltaLossPi | -0.00219 |
| DeltaLossV | -0.355 |
| Entropy | -0.962 |
| KL | 0.000839 |
| ClipFrac | 0.0288 |
| StopIter | 79 |
| Time | 463 |
---------------------------------------
2019-12-06 17:32:27.532 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 553
2019-12-06 17:32:27.533 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 248.3, Steps: 554, Distance 13.71, Angular velocity 0.0, Speed: 2.71, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.42, Angle accuracy 0.0, Num episodes 605
2019-12-06 17:32:28.201 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:32:28.201 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 317.97, Steps: 730, Distance 21.73, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.65, Angle accuracy 0.0, Num episodes 606
2019-12-06 17:32:28.873 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:32:28.874 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.95, Steps: 746, Distance 23.84, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.02, Angle accuracy 0.0, Num episodes 607
2019-12-06 17:32:29.581 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 767
2019-12-06 17:32:29.582 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 316.7, Steps: 768, Distance 24.08, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.11, Angle accuracy 0.0, Num episodes 608
2019-12-06 17:32:30.290 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 795
2019-12-06 17:32:30.291 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.85, Steps: 796, Distance 25.27, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 609
Warning: trajectory cut off by epoch at 406 steps.
---------------------------------------
| Epoch | 122 |
| AverageEpRet | 304 |
| StdEpRet | 28.3 |
| MaxEpRet | 326 |
| MinEpRet | 248 |
| EpLen | 719 |
| AverageVVals | 36 |
| StdVVals | 0.000113 |
| MaxVVals | 36 |
| MinVVals | 36 |
| TotalEnvInteracts | 4.92e+05 |
| LossPi | 1.76e-08 |
| LossV | 166 |
| DeltaLossPi | -0.00199 |
| DeltaLossV | -0.475 |
| Entropy | -0.993 |
| KL | 0.00319 |
| ClipFrac | 0.0245 |
| StopIter | 79 |
| Time | 467 |
---------------------------------------
2019-12-06 17:32:31.565 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 849
2019-12-06 17:32:31.565 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.53, Steps: 850, Distance 28.19, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.07, Avg gforce: 0.02, Trip pct 96.6, Angle accuracy 0.0, Num episodes 610
2019-12-06 17:32:31.919 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 397
2019-12-06 17:32:31.919 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 196.92, Steps: 398, Distance 7.53, Angular velocity 0.0, Speed: 2.27, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 88.59, Angle accuracy 0.0, Num episodes 611
2019-12-06 17:32:32.595 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 756
2019-12-06 17:32:32.595 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 308.72, Steps: 757, Distance 23.28, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 612
2019-12-06 17:32:33.275 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 734
2019-12-06 17:32:33.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 313.18, Steps: 735, Distance 22.29, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.71, Angle accuracy 0.0, Num episodes 613
2019-12-06 17:32:34.073 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 891
2019-12-06 17:32:34.074 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 356.11, Steps: 892, Distance 30.59, Angular velocity 0.0, Speed: 3.07, Max gforce: 0.09, Avg gforce: 0.02, Trip pct 96.89, Angle accuracy 0.0, Num episodes 614
Warning: trajectory cut off by epoch at 368 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 123 |
| AverageEpRet | 299 |
| StdEpRet | 53.9 |
| MaxEpRet | 356 |
| MinEpRet | 197 |
| EpLen | 726 |
| AverageVVals | 36.6 |
| StdVVals | 0.000108 |
| MaxVVals | 36.6 |
| MinVVals | 36.6 |
| TotalEnvInteracts | 4.96e+05 |
| LossPi | 6.62e-09 |
| LossV | 183 |
| DeltaLossPi | -0.00331 |
| DeltaLossV | -0.751 |
| Entropy | -0.981 |
| KL | 0.00675 |
| ClipFrac | 0.0755 |
| StopIter | 2 |
| Time | 471 |
---------------------------------------
2019-12-06 17:32:35.238 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 833
2019-12-06 17:32:35.238 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.71, Steps: 834, Distance 27.57, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.53, Angle accuracy 0.0, Num episodes 615
2019-12-06 17:32:35.916 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 746
2019-12-06 17:32:35.916 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.62, Steps: 747, Distance 23.63, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.07, Angle accuracy 0.0, Num episodes 616
2019-12-06 17:32:36.469 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 623
2019-12-06 17:32:36.469 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 274.39, Steps: 624, Distance 17.61, Angular velocity 0.0, Speed: 2.93, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.87, Angle accuracy 0.0, Num episodes 617
2019-12-06 17:32:36.984 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 574
2019-12-06 17:32:36.985 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 259.98, Steps: 575, Distance 15.13, Angular velocity 0.0, Speed: 2.81, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.01, Angle accuracy 0.0, Num episodes 618
2019-12-06 17:32:37.573 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:32:37.573 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 272.85, Steps: 625, Distance 17.23, Angular velocity 0.0, Speed: 2.92, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.58, Angle accuracy 0.0, Num episodes 619
Warning: trajectory cut off by epoch at 595 steps.
---------------------------------------
| Epoch | 124 |
| AverageEpRet | 293 |
| StdEpRet | 30.1 |
| MaxEpRet | 340 |
| MinEpRet | 260 |
| EpLen | 681 |
| AverageVVals | 35.8 |
| StdVVals | 9.49e-05 |
| MaxVVals | 35.8 |
| MinVVals | 35.8 |
| TotalEnvInteracts | 5e+05 |
| LossPi | 1.44e-08 |
| LossV | 170 |
| DeltaLossPi | -0.00461 |
| DeltaLossV | -2.37 |
| Entropy | -0.974 |
| KL | 0.00422 |
| ClipFrac | 0.0437 |
| StopIter | 79 |
| Time | 474 |
---------------------------------------
2019-12-06 17:32:38.845 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 675
2019-12-06 17:32:38.845 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 308.58, Steps: 676, Distance 19.46, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.31, Angle accuracy 0.0, Num episodes 620
2019-12-06 17:32:39.644 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 882
2019-12-06 17:32:39.645 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.56, Steps: 883, Distance 31.6, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 97.03, Angle accuracy 0.0, Num episodes 621
2019-12-06 17:32:40.298 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:32:40.298 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 304.63, Steps: 730, Distance 23.45, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.06, Angle accuracy 0.0, Num episodes 622
2019-12-06 17:32:40.835 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 605
2019-12-06 17:32:40.835 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 259.9, Steps: 606, Distance 16.41, Angular velocity 0.0, Speed: 2.92, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.33, Angle accuracy 0.0, Num episodes 623
2019-12-06 17:32:41.209 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:32:41.209 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 199.36, Steps: 413, Distance 8.12, Angular velocity 0.0, Speed: 2.34, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 89.04, Angle accuracy 0.0, Num episodes 624
Warning: trajectory cut off by epoch at 692 steps.
---------------------------------------
| Epoch | 125 |
| AverageEpRet | 282 |
| StdEpRet | 48.7 |
| MaxEpRet | 340 |
| MinEpRet | 199 |
| EpLen | 662 |
| AverageVVals | 37.3 |
| StdVVals | 9.4e-05 |
| MaxVVals | 37.3 |
| MinVVals | 37.3 |
| TotalEnvInteracts | 5.04e+05 |
| LossPi | 1.84e-08 |
| LossV | 143 |
| DeltaLossPi | -0.0022 |
| DeltaLossV | -0.243 |
| Entropy | -0.977 |
| KL | 0.00212 |
| ClipFrac | 0.0335 |
| StopIter | 79 |
| Time | 478 |
---------------------------------------
2019-12-06 17:32:42.593 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 697
2019-12-06 17:32:42.594 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.4, Steps: 698, Distance 20.22, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.37, Angle accuracy 0.0, Num episodes 625
2019-12-06 17:32:42.868 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 306
2019-12-06 17:32:42.868 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 145.9, Steps: 307, Distance 4.62, Angular velocity 0.0, Speed: 1.82, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 82.3, Angle accuracy 0.0, Num episodes 626
2019-12-06 17:32:43.450 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:32:43.451 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 264.95, Steps: 639, Distance 17.73, Angular velocity 0.0, Speed: 2.88, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 94.86, Angle accuracy 0.0, Num episodes 627
2019-12-06 17:32:43.911 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:32:43.912 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 249.19, Steps: 521, Distance 12.94, Angular velocity 0.0, Speed: 2.76, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 92.96, Angle accuracy 0.0, Num episodes 628
2019-12-06 17:32:44.377 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 516
2019-12-06 17:32:44.377 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 238.02, Steps: 517, Distance 12.21, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 92.65, Angle accuracy 0.0, Num episodes 629
2019-12-06 17:32:45.025 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:32:45.026 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.81, Steps: 675, Distance 19.9, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.33, Angle accuracy 0.0, Num episodes 630
2019-12-06 17:32:45.517 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:32:45.517 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 252.09, Steps: 548, Distance 13.3, Angular velocity 0.0, Speed: 2.72, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.17, Angle accuracy 0.0, Num episodes 631
Warning: trajectory cut off by epoch at 95 steps.
---------------------------------------
| Epoch | 126 |
| AverageEpRet | 250 |
| StdEpRet | 49.2 |
| MaxEpRet | 315 |
| MinEpRet | 146 |
| EpLen | 558 |
| AverageVVals | 36.8 |
| StdVVals | 9.75e-05 |
| MaxVVals | 36.8 |
| MinVVals | 36.8 |
| TotalEnvInteracts | 5.08e+05 |
| LossPi | 5.39e-08 |
| LossV | 163 |
| DeltaLossPi | -0.00257 |
| DeltaLossV | -0.0022 |
| Entropy | -0.964 |
| KL | 0.00714 |
| ClipFrac | 0.0432 |
| StopIter | 79 |
| Time | 482 |
---------------------------------------
2019-12-06 17:32:46.251 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 561
2019-12-06 17:32:46.251 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 252.58, Steps: 562, Distance 14.28, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 93.54, Angle accuracy 0.0, Num episodes 632
2019-12-06 17:32:46.881 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:32:46.882 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 297.07, Steps: 705, Distance 21.76, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.68, Angle accuracy 0.0, Num episodes 633
2019-12-06 17:32:47.602 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 808
2019-12-06 17:32:47.603 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.77, Steps: 809, Distance 26.71, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 634
2019-12-06 17:32:48.394 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 879
2019-12-06 17:32:48.395 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.01, Steps: 880, Distance 29.59, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.08, Avg gforce: 0.02, Trip pct 96.82, Angle accuracy 0.0, Num episodes 635
2019-12-06 17:32:49.074 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 764
2019-12-06 17:32:49.075 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 305.37, Steps: 765, Distance 24.61, Angular velocity 0.0, Speed: 3.11, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.15, Angle accuracy 0.0, Num episodes 636
Warning: trajectory cut off by epoch at 279 steps.
---------------------------------------
| Epoch | 127 |
| AverageEpRet | 311 |
| StdEpRet | 36.4 |
| MaxEpRet | 354 |
| MinEpRet | 253 |
| EpLen | 744 |
| AverageVVals | 36.9 |
| StdVVals | 8.54e-05 |
| MaxVVals | 36.9 |
| MinVVals | 36.9 |
| TotalEnvInteracts | 5.12e+05 |
| LossPi | 2.6e-08 |
| LossV | 193 |
| DeltaLossPi | -0.00306 |
| DeltaLossV | -0.745 |
| Entropy | -1.02 |
| KL | 0.00393 |
| ClipFrac | 0.0397 |
| StopIter | 79 |
| Time | 486 |
---------------------------------------
2019-12-06 17:32:50.304 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 894
2019-12-06 17:32:50.304 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.99, Steps: 895, Distance 31.41, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 97.05, Angle accuracy 0.0, Num episodes 637
2019-12-06 17:32:50.990 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 767
2019-12-06 17:32:50.990 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 309.77, Steps: 768, Distance 25.24, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.36, Angle accuracy 0.0, Num episodes 638
2019-12-06 17:32:51.583 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 644
2019-12-06 17:32:51.583 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.26, Steps: 645, Distance 18.24, Angular velocity 0.0, Speed: 3.02, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.01, Angle accuracy 0.0, Num episodes 639
2019-12-06 17:32:52.046 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 508
2019-12-06 17:32:52.046 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 228.43, Steps: 509, Distance 12.37, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 92.69, Angle accuracy 0.0, Num episodes 640
2019-12-06 17:32:52.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 620
2019-12-06 17:32:52.601 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.61, Steps: 621, Distance 16.95, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.43, Angle accuracy 0.0, Num episodes 641
Warning: trajectory cut off by epoch at 562 steps.
---------------------------------------
| Epoch | 128 |
| AverageEpRet | 297 |
| StdEpRet | 43 |
| MaxEpRet | 362 |
| MinEpRet | 228 |
| EpLen | 688 |
| AverageVVals | 36 |
| StdVVals | 7.56e-05 |
| MaxVVals | 36 |
| MinVVals | 36 |
| TotalEnvInteracts | 5.16e+05 |
| LossPi | -1.43e-09 |
| LossV | 173 |
| DeltaLossPi | -0.00293 |
| DeltaLossV | -1.39 |
| Entropy | -1.02 |
| KL | 0.00323 |
| ClipFrac | 0.0553 |
| StopIter | 79 |
| Time | 489 |
---------------------------------------
2019-12-06 17:32:53.957 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 763
2019-12-06 17:32:53.958 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.99, Steps: 764, Distance 25.09, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 642
2019-12-06 17:32:54.601 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:32:54.601 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 294.66, Steps: 716, Distance 22.49, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.81, Angle accuracy 0.0, Num episodes 643
2019-12-06 17:32:55.368 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 851
2019-12-06 17:32:55.368 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.44, Steps: 852, Distance 29.73, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.86, Angle accuracy 0.0, Num episodes 644
2019-12-06 17:32:56.111 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 779
2019-12-06 17:32:56.111 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.71, Steps: 780, Distance 25.81, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.43, Angle accuracy 0.0, Num episodes 645
2019-12-06 17:32:56.779 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:32:56.779 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.65, Steps: 739, Distance 23.73, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.06, Angle accuracy 0.0, Num episodes 646
Warning: trajectory cut off by epoch at 149 steps.
---------------------------------------
| Epoch | 129 |
| AverageEpRet | 326 |
| StdEpRet | 17.5 |
| MaxEpRet | 345 |
| MinEpRet | 295 |
| EpLen | 770 |
| AverageVVals | 37.2 |
| StdVVals | 7.31e-05 |
| MaxVVals | 37.2 |
| MinVVals | 37.2 |
| TotalEnvInteracts | 5.2e+05 |
| LossPi | 3.42e-08 |
| LossV | 190 |
| DeltaLossPi | -0.000353 |
| DeltaLossV | -0.501 |
| Entropy | -1.02 |
| KL | 0.00127 |
| ClipFrac | 0.0065 |
| StopIter | 79 |
| Time | 493 |
---------------------------------------
2019-12-06 17:32:57.543 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:32:57.544 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 251.15, Steps: 539, Distance 13.31, Angular velocity 0.0, Speed: 2.81, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.15, Angle accuracy 0.0, Num episodes 647
2019-12-06 17:32:58.209 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:32:58.209 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 310.97, Steps: 739, Distance 24.27, Angular velocity 0.0, Speed: 3.25, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.07, Angle accuracy 0.0, Num episodes 648
2019-12-06 17:32:59.005 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 886
2019-12-06 17:32:59.005 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.6, Steps: 887, Distance 32.13, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 97.03, Angle accuracy 0.0, Num episodes 649
2019-12-06 17:32:59.582 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:32:59.583 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.25, Steps: 641, Distance 18.93, Angular velocity 0.0, Speed: 3.11, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.19, Angle accuracy 0.0, Num episodes 650
2019-12-06 17:33:00.028 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 479
2019-12-06 17:33:00.028 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 242.69, Steps: 480, Distance 10.5, Angular velocity 0.0, Speed: 2.6, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 91.48, Angle accuracy 0.0, Num episodes 651
2019-12-06 17:33:00.559 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 597
2019-12-06 17:33:00.559 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 276.16, Steps: 598, Distance 16.32, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.26, Angle accuracy 0.0, Num episodes 652
Warning: trajectory cut off by epoch at 116 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 130 |
| AverageEpRet | 288 |
| StdEpRet | 39.8 |
| MaxEpRet | 362 |
| MinEpRet | 243 |
| EpLen | 647 |
| AverageVVals | 36.5 |
| StdVVals | 7.1e-05 |
| MaxVVals | 36.5 |
| MinVVals | 36.5 |
| TotalEnvInteracts | 5.24e+05 |
| LossPi | 9.18e-09 |
| LossV | 170 |
| DeltaLossPi | -0.00168 |
| DeltaLossV | -0.81 |
| Entropy | -1 |
| KL | 0.00174 |
| ClipFrac | 0.0213 |
| StopIter | 79 |
| Time | 497 |
---------------------------------------
2019-12-06 17:33:01.741 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 789
2019-12-06 17:33:01.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.95, Steps: 790, Distance 27.39, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 653
2019-12-06 17:33:02.439 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 773
2019-12-06 17:33:02.440 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 327.62, Steps: 774, Distance 26.26, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 654
2019-12-06 17:33:03.030 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 651
2019-12-06 17:33:03.030 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.78, Steps: 652, Distance 19.89, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.35, Angle accuracy 0.0, Num episodes 655
2019-12-06 17:33:03.672 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 714
2019-12-06 17:33:03.672 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 316.42, Steps: 715, Distance 22.7, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.93, Angle accuracy 0.0, Num episodes 656
2019-12-06 17:33:04.082 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 452
2019-12-06 17:33:04.082 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 215.02, Steps: 453, Distance 10.06, Angular velocity 0.0, Speed: 2.58, Max gforce: 0.09, Avg gforce: 0.04, Trip pct 91.1, Angle accuracy 0.0, Num episodes 657
Warning: trajectory cut off by epoch at 616 steps.
---------------------------------------
| Epoch | 131 |
| AverageEpRet | 298 |
| StdEpRet | 45.6 |
| MaxEpRet | 345 |
| MinEpRet | 215 |
| EpLen | 677 |
| AverageVVals | 37.4 |
| StdVVals | 6.01e-05 |
| MaxVVals | 37.4 |
| MinVVals | 37.4 |
| TotalEnvInteracts | 5.28e+05 |
| LossPi | 6.68e-09 |
| LossV | 173 |
| DeltaLossPi | -0.00183 |
| DeltaLossV | -0.973 |
| Entropy | -1.02 |
| KL | 0.00254 |
| ClipFrac | 0.0542 |
| StopIter | 79 |
| Time | 501 |
---------------------------------------
2019-12-06 17:33:05.415 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 709
2019-12-06 17:33:05.415 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.25, Steps: 710, Distance 23.47, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 658
2019-12-06 17:33:05.781 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 413
2019-12-06 17:33:05.781 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 200.39, Steps: 414, Distance 8.7, Angular velocity 0.0, Speed: 2.54, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 89.83, Angle accuracy 0.0, Num episodes 659
2019-12-06 17:33:06.281 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:33:06.282 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 286.15, Steps: 564, Distance 15.73, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.15, Angle accuracy 0.0, Num episodes 660
2019-12-06 17:33:07.060 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 836
2019-12-06 17:33:07.060 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.97, Steps: 837, Distance 30.33, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.98, Angle accuracy 0.0, Num episodes 661
2019-12-06 17:33:07.795 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 817
2019-12-06 17:33:07.795 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.21, Steps: 818, Distance 29.14, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.86, Angle accuracy 0.0, Num episodes 662
Warning: trajectory cut off by epoch at 657 steps.
---------------------------------------
| Epoch | 132 |
| AverageEpRet | 300 |
| StdEpRet | 55.4 |
| MaxEpRet | 351 |
| MinEpRet | 200 |
| EpLen | 669 |
| AverageVVals | 38.3 |
| StdVVals | 5.78e-05 |
| MaxVVals | 38.3 |
| MinVVals | 38.3 |
| TotalEnvInteracts | 5.32e+05 |
| LossPi | -1.31e-08 |
| LossV | 188 |
| DeltaLossPi | -0.00113 |
| DeltaLossV | -0.0212 |
| Entropy | -1.07 |
| KL | 0.0021 |
| ClipFrac | 0.0162 |
| StopIter | 79 |
| Time | 505 |
---------------------------------------
2019-12-06 17:33:09.082 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:33:09.083 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.08, Steps: 607, Distance 17.86, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.74, Angle accuracy 0.0, Num episodes 663
2019-12-06 17:33:09.437 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 395
2019-12-06 17:33:09.438 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 195.16, Steps: 396, Distance 8.28, Angular velocity 0.0, Speed: 2.47, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 89.6, Angle accuracy 0.0, Num episodes 664
2019-12-06 17:33:10.021 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:33:10.021 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 301.74, Steps: 641, Distance 19.13, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.17, Angle accuracy 0.0, Num episodes 665
2019-12-06 17:33:10.737 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 803
2019-12-06 17:33:10.737 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.42, Steps: 804, Distance 28.27, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.1, Avg gforce: 0.03, Trip pct 96.71, Angle accuracy 0.0, Num episodes 666
2019-12-06 17:33:11.461 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 787
2019-12-06 17:33:11.461 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 335.8, Steps: 788, Distance 26.98, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.54, Angle accuracy 0.0, Num episodes 667
2019-12-06 17:33:11.976 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 580
2019-12-06 17:33:11.976 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 280.25, Steps: 581, Distance 16.7, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.61, Angle accuracy 0.0, Num episodes 668
Warning: trajectory cut off by epoch at 183 steps.
---------------------------------------
| Epoch | 133 |
| AverageEpRet | 288 |
| StdEpRet | 49.6 |
| MaxEpRet | 344 |
| MinEpRet | 195 |
| EpLen | 636 |
| AverageVVals | 38.5 |
| StdVVals | 5.76e-05 |
| MaxVVals | 38.5 |
| MinVVals | 38.5 |
| TotalEnvInteracts | 5.36e+05 |
| LossPi | -1.86e-08 |
| LossV | 176 |
| DeltaLossPi | -0.000799 |
| DeltaLossV | -0.182 |
| Entropy | -1.04 |
| KL | 0.0003 |
| ClipFrac | 0.0117 |
| StopIter | 79 |
| Time | 508 |
---------------------------------------
2019-12-06 17:33:12.815 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 594
2019-12-06 17:33:12.815 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 272.63, Steps: 595, Distance 16.8, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.46, Angle accuracy 0.0, Num episodes 669
2019-12-06 17:33:13.317 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 564
2019-12-06 17:33:13.317 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 281.81, Steps: 565, Distance 15.49, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.98, Angle accuracy 0.0, Num episodes 670
2019-12-06 17:33:13.900 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:33:13.900 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 271.03, Steps: 567, Distance 15.78, Angular velocity 0.0, Speed: 3.0, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.18, Angle accuracy 0.0, Num episodes 671
2019-12-06 17:33:14.571 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 753
2019-12-06 17:33:14.571 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.06, Steps: 754, Distance 26.24, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.43, Angle accuracy 0.0, Num episodes 672
2019-12-06 17:33:14.998 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 483
2019-12-06 17:33:14.998 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 239.62, Steps: 484, Distance 11.46, Angular velocity 0.0, Speed: 2.71, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 92.14, Angle accuracy 0.0, Num episodes 673
2019-12-06 17:33:15.713 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 804
2019-12-06 17:33:15.713 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 340.57, Steps: 805, Distance 28.78, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.71, Angle accuracy 0.0, Num episodes 674
Warning: trajectory cut off by epoch at 230 steps.
---------------------------------------
| Epoch | 134 |
| AverageEpRet | 288 |
| StdEpRet | 33.7 |
| MaxEpRet | 341 |
| MinEpRet | 240 |
| EpLen | 628 |
| AverageVVals | 38.1 |
| StdVVals | 5.33e-05 |
| MaxVVals | 38.1 |
| MinVVals | 38.1 |
| TotalEnvInteracts | 5.4e+05 |
| LossPi | 4.92e-08 |
| LossV | 184 |
| DeltaLossPi | -0.00284 |
| DeltaLossV | -0.133 |
| Entropy | -1.04 |
| KL | 0.00565 |
| ClipFrac | 0.0472 |
| StopIter | 79 |
| Time | 512 |
---------------------------------------
2019-12-06 17:33:16.353 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 329
2019-12-06 17:33:16.353 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 163.33, Steps: 330, Distance 5.46, Angular velocity 0.0, Speed: 2.0, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 84.63, Angle accuracy 0.0, Num episodes 675
2019-12-06 17:33:17.016 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 727
2019-12-06 17:33:17.017 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.02, Steps: 728, Distance 24.15, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.08, Angle accuracy 0.0, Num episodes 676
2019-12-06 17:33:17.816 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 870
2019-12-06 17:33:17.817 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.72, Steps: 871, Distance 31.39, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.92, Angle accuracy 0.0, Num episodes 677
2019-12-06 17:33:18.249 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 480
2019-12-06 17:33:18.249 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 248.6, Steps: 481, Distance 11.63, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.09, Avg gforce: 0.04, Trip pct 92.18, Angle accuracy 0.0, Num episodes 678
2019-12-06 17:33:18.775 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 567
2019-12-06 17:33:18.775 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.49, Steps: 568, Distance 15.61, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.25, Angle accuracy 0.0, Num episodes 679
2019-12-06 17:33:19.366 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 668
2019-12-06 17:33:19.366 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 313.35, Steps: 669, Distance 21.28, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.54, Angle accuracy 0.0, Num episodes 680
Warning: trajectory cut off by epoch at 353 steps.
---------------------------------------
| Epoch | 135 |
| AverageEpRet | 280 |
| StdEpRet | 62.4 |
| MaxEpRet | 362 |
| MinEpRet | 163 |
| EpLen | 608 |
| AverageVVals | 38.4 |
| StdVVals | 5.16e-05 |
| MaxVVals | 38.4 |
| MinVVals | 38.4 |
| TotalEnvInteracts | 5.44e+05 |
| LossPi | -2.85e-08 |
| LossV | 210 |
| DeltaLossPi | -0.00162 |
| DeltaLossV | -0.151 |
| Entropy | -1.11 |
| KL | 0.00248 |
| ClipFrac | 0.0258 |
| StopIter | 79 |
| Time | 516 |
---------------------------------------
2019-12-06 17:33:20.556 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 821
2019-12-06 17:33:20.556 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 356.01, Steps: 822, Distance 29.89, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.91, Angle accuracy 0.0, Num episodes 681
2019-12-06 17:33:20.988 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 481
2019-12-06 17:33:20.988 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 244.6, Steps: 482, Distance 11.32, Angular velocity 0.0, Speed: 2.75, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 92.0, Angle accuracy 0.0, Num episodes 682
2019-12-06 17:33:21.348 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 368
2019-12-06 17:33:21.348 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 191.78, Steps: 369, Distance 6.77, Angular velocity 0.0, Speed: 2.22, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 87.42, Angle accuracy 0.0, Num episodes 683
2019-12-06 17:33:21.881 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 582
2019-12-06 17:33:21.881 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 293.43, Steps: 583, Distance 16.75, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.52, Angle accuracy 0.0, Num episodes 684
2019-12-06 17:33:22.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 775
2019-12-06 17:33:22.600 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 346.63, Steps: 776, Distance 27.21, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.48, Angle accuracy 0.0, Num episodes 685
2019-12-06 17:33:23.361 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 854
2019-12-06 17:33:23.361 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.25, Steps: 855, Distance 31.33, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.91, Angle accuracy 0.0, Num episodes 686
Warning: trajectory cut off by epoch at 113 steps.
---------------------------------------
| Epoch | 136 |
| AverageEpRet | 299 |
| StdEpRet | 63.6 |
| MaxEpRet | 364 |
| MinEpRet | 192 |
| EpLen | 648 |
| AverageVVals | 38.8 |
| StdVVals | 4.97e-05 |
| MaxVVals | 38.8 |
| MinVVals | 38.8 |
| TotalEnvInteracts | 5.48e+05 |
| LossPi | 2.48e-08 |
| LossV | 223 |
| DeltaLossPi | -0.00381 |
| DeltaLossV | -0.0362 |
| Entropy | -1.1 |
| KL | 0.00473 |
| ClipFrac | 0.0475 |
| StopIter | 79 |
| Time | 520 |
---------------------------------------
2019-12-06 17:33:24.144 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:33:24.145 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.52, Steps: 601, Distance 17.81, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.7, Angle accuracy 0.0, Num episodes 687
2019-12-06 17:33:24.758 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 682
2019-12-06 17:33:24.758 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 317.57, Steps: 683, Distance 22.63, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.91, Angle accuracy 0.0, Num episodes 688
2019-12-06 17:33:25.183 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 482
2019-12-06 17:33:25.184 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 249.42, Steps: 483, Distance 12.21, Angular velocity 0.0, Speed: 2.86, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 92.46, Angle accuracy 0.0, Num episodes 689
2019-12-06 17:33:25.683 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 552
2019-12-06 17:33:25.683 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 279.31, Steps: 553, Distance 15.58, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.09, Angle accuracy 0.0, Num episodes 690
2019-12-06 17:33:26.179 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:33:26.179 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 276.14, Steps: 545, Distance 14.88, Angular velocity 0.0, Speed: 3.0, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.73, Angle accuracy 0.0, Num episodes 691
2019-12-06 17:33:26.745 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:33:26.746 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.31, Steps: 636, Distance 19.57, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.17, Angle accuracy 0.0, Num episodes 692
Warning: trajectory cut off by epoch at 499 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 137 |
| AverageEpRet | 283 |
| StdEpRet | 20.1 |
| MaxEpRet | 318 |
| MinEpRet | 249 |
| EpLen | 584 |
| AverageVVals | 38.6 |
| StdVVals | 4.53e-05 |
| MaxVVals | 38.6 |
| MinVVals | 38.6 |
| TotalEnvInteracts | 5.52e+05 |
| LossPi | -5.26e-08 |
| LossV | 207 |
| DeltaLossPi | -0.000127 |
| DeltaLossV | -6.22 |
| Entropy | -1.13 |
| KL | 0.000287 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 523 |
---------------------------------------
2019-12-06 17:33:27.999 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 812
2019-12-06 17:33:28.000 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 349.71, Steps: 813, Distance 29.42, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 693
2019-12-06 17:33:28.478 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:33:28.478 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 271.28, Steps: 532, Distance 13.92, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 93.46, Angle accuracy 0.0, Num episodes 694
2019-12-06 17:33:29.143 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 733
2019-12-06 17:33:29.144 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.77, Steps: 734, Distance 24.81, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.13, Angle accuracy 0.0, Num episodes 695
2019-12-06 17:33:29.671 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:33:29.671 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 302.61, Steps: 596, Distance 18.0, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.82, Angle accuracy 0.0, Num episodes 696
2019-12-06 17:33:30.020 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 386
2019-12-06 17:33:30.020 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 207.14, Steps: 387, Distance 7.65, Angular velocity 0.0, Speed: 2.41, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 88.76, Angle accuracy 0.0, Num episodes 697
2019-12-06 17:33:30.415 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 442
2019-12-06 17:33:30.416 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 233.4, Steps: 443, Distance 9.89, Angular velocity 0.0, Speed: 2.64, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 91.02, Angle accuracy 0.0, Num episodes 698
Warning: trajectory cut off by epoch at 495 steps.
---------------------------------------
| Epoch | 138 |
| AverageEpRet | 281 |
| StdEpRet | 49.4 |
| MaxEpRet | 350 |
| MinEpRet | 207 |
| EpLen | 584 |
| AverageVVals | 41.1 |
| StdVVals | 4.54e-05 |
| MaxVVals | 41.1 |
| MinVVals | 41.1 |
| TotalEnvInteracts | 5.56e+05 |
| LossPi | 2.1e-08 |
| LossV | 205 |
| DeltaLossPi | -0.00347 |
| DeltaLossV | -0.134 |
| Entropy | -1.15 |
| KL | 0.0015 |
| ClipFrac | 0.037 |
| StopIter | 79 |
| Time | 527 |
---------------------------------------
2019-12-06 17:33:31.613 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:33:31.613 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 324.0, Steps: 680, Distance 22.09, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.76, Angle accuracy 0.0, Num episodes 699
2019-12-06 17:33:32.203 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 658
2019-12-06 17:33:32.204 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 296.99, Steps: 659, Distance 20.9, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.46, Angle accuracy 0.0, Num episodes 700
2019-12-06 17:33:32.930 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 818
2019-12-06 17:33:32.930 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.75, Steps: 819, Distance 29.4, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.84, Angle accuracy 0.0, Num episodes 701
2019-12-06 17:33:33.589 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 698
2019-12-06 17:33:33.589 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.36, Steps: 699, Distance 23.05, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.96, Angle accuracy 0.0, Num episodes 702
2019-12-06 17:33:34.100 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:33:34.101 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 270.13, Steps: 545, Distance 14.75, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.88, Angle accuracy 0.0, Num episodes 703
Warning: trajectory cut off by epoch at 598 steps.
---------------------------------------
| Epoch | 139 |
| AverageEpRet | 312 |
| StdEpRet | 24.9 |
| MaxEpRet | 339 |
| MinEpRet | 270 |
| EpLen | 680 |
| AverageVVals | 40.7 |
| StdVVals | 4.02e-05 |
| MaxVVals | 40.7 |
| MinVVals | 40.7 |
| TotalEnvInteracts | 5.6e+05 |
| LossPi | 7.61e-08 |
| LossV | 208 |
| DeltaLossPi | -0.00264 |
| DeltaLossV | -0.839 |
| Entropy | -1.15 |
| KL | 0.00412 |
| ClipFrac | 0.0477 |
| StopIter | 79 |
| Time | 531 |
---------------------------------------
2019-12-06 17:33:35.401 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:33:35.402 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.46, Steps: 695, Distance 22.68, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.83, Angle accuracy 0.0, Num episodes 704
2019-12-06 17:33:35.840 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 492
2019-12-06 17:33:35.840 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 253.73, Steps: 493, Distance 12.93, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.1, Avg gforce: 0.04, Trip pct 93.11, Angle accuracy 0.0, Num episodes 705
2019-12-06 17:33:36.387 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:33:36.387 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 292.56, Steps: 607, Distance 18.53, Angular velocity 0.0, Speed: 3.26, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.93, Angle accuracy 0.0, Num episodes 706
2019-12-06 17:33:36.988 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 649
2019-12-06 17:33:36.988 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 300.63, Steps: 650, Distance 20.86, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.44, Angle accuracy 0.0, Num episodes 707
2019-12-06 17:33:37.402 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 458
2019-12-06 17:33:37.402 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 228.23, Steps: 459, Distance 10.89, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.09, Avg gforce: 0.04, Trip pct 91.82, Angle accuracy 0.0, Num episodes 708
2019-12-06 17:33:38.165 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 841
2019-12-06 17:33:38.165 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.65, Steps: 842, Distance 31.71, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 97.06, Angle accuracy 0.0, Num episodes 709
Warning: trajectory cut off by epoch at 254 steps.
Warning: could not pickle state_dict.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 140 |
| AverageEpRet | 292 |
| StdEpRet | 41.8 |
| MaxEpRet | 355 |
| MinEpRet | 228 |
| EpLen | 624 |
| AverageVVals | 39.8 |
| StdVVals | 3.96e-05 |
| MaxVVals | 39.8 |
| MinVVals | 39.8 |
| TotalEnvInteracts | 5.64e+05 |
| LossPi | -4.92e-09 |
| LossV | 209 |
| DeltaLossPi | -0.00129 |
| DeltaLossV | -0.375 |
| Entropy | -1.17 |
| KL | 0.00132 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 535 |
---------------------------------------
2019-12-06 17:33:39.278 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:33:39.279 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 313.37, Steps: 639, Distance 19.92, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.41, Angle accuracy 0.0, Num episodes 710
2019-12-06 17:33:39.678 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 449
2019-12-06 17:33:39.678 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 251.75, Steps: 450, Distance 10.36, Angular velocity 0.0, Speed: 2.76, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 91.22, Angle accuracy 0.0, Num episodes 711
2019-12-06 17:33:40.284 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:33:40.284 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 294.72, Steps: 666, Distance 21.8, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.75, Angle accuracy 0.0, Num episodes 712
2019-12-06 17:33:40.941 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 731
2019-12-06 17:33:40.941 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 335.54, Steps: 732, Distance 25.06, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 713
2019-12-06 17:33:41.452 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:33:41.453 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 280.79, Steps: 572, Distance 16.72, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.61, Angle accuracy 0.0, Num episodes 714
2019-12-06 17:33:41.982 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:33:41.982 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 301.89, Steps: 601, Distance 17.99, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.89, Angle accuracy 0.0, Num episodes 715
Warning: trajectory cut off by epoch at 340 steps.
---------------------------------------
| Epoch | 141 |
| AverageEpRet | 296 |
| StdEpRet | 26.1 |
| MaxEpRet | 336 |
| MinEpRet | 252 |
| EpLen | 610 |
| AverageVVals | 39.2 |
| StdVVals | 3.48e-05 |
| MaxVVals | 39.2 |
| MinVVals | 39.2 |
| TotalEnvInteracts | 5.68e+05 |
| LossPi | 2.81e-08 |
| LossV | 201 |
| DeltaLossPi | -0.00233 |
| DeltaLossV | -2.16 |
| Entropy | -1.16 |
| KL | 0.00182 |
| ClipFrac | 0.0143 |
| StopIter | 79 |
| Time | 539 |
---------------------------------------
2019-12-06 17:33:42.955 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 568
2019-12-06 17:33:42.955 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.27, Steps: 569, Distance 16.45, Angular velocity 0.0, Speed: 3.21, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.27, Angle accuracy 0.0, Num episodes 716
2019-12-06 17:33:43.454 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:33:43.454 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.6, Steps: 557, Distance 15.74, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.15, Angle accuracy 0.0, Num episodes 717
2019-12-06 17:33:43.964 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:33:43.965 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 283.4, Steps: 567, Distance 16.08, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.24, Angle accuracy 0.0, Num episodes 718
2019-12-06 17:33:44.561 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:33:44.561 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.04, Steps: 655, Distance 21.47, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.65, Angle accuracy 0.0, Num episodes 719
2019-12-06 17:33:45.321 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 849
2019-12-06 17:33:45.321 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.55, Steps: 850, Distance 32.51, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.03, Angle accuracy 0.0, Num episodes 720
2019-12-06 17:33:45.940 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 701
2019-12-06 17:33:45.941 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 336.27, Steps: 702, Distance 23.74, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 721
Warning: trajectory cut off by epoch at 100 steps.
---------------------------------------
| Epoch | 142 |
| AverageEpRet | 313 |
| StdEpRet | 32.6 |
| MaxEpRet | 373 |
| MinEpRet | 283 |
| EpLen | 650 |
| AverageVVals | 40.6 |
| StdVVals | 3.54e-05 |
| MaxVVals | 40.6 |
| MinVVals | 40.6 |
| TotalEnvInteracts | 5.72e+05 |
| LossPi | 1.08e-08 |
| LossV | 223 |
| DeltaLossPi | -0.00125 |
| DeltaLossV | -0.0199 |
| Entropy | -1.16 |
| KL | 0.00141 |
| ClipFrac | 0.0388 |
| StopIter | 79 |
| Time | 542 |
---------------------------------------
2019-12-06 17:33:46.845 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 737
2019-12-06 17:33:46.845 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 312.35, Steps: 738, Distance 27.08, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 722
2019-12-06 17:33:47.482 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 687
2019-12-06 17:33:47.483 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 332.07, Steps: 688, Distance 24.09, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.13, Angle accuracy 0.0, Num episodes 723
2019-12-06 17:33:47.960 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:33:47.960 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 266.72, Steps: 528, Distance 14.54, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 93.83, Angle accuracy 0.0, Num episodes 724
2019-12-06 17:33:48.608 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:33:48.609 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 352.43, Steps: 726, Distance 25.67, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 725
2019-12-06 17:33:49.188 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 643
2019-12-06 17:33:49.189 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.51, Steps: 644, Distance 21.06, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.71, Angle accuracy 0.0, Num episodes 726
Warning: trajectory cut off by epoch at 676 steps.
---------------------------------------
| Epoch | 143 |
| AverageEpRet | 316 |
| StdEpRet | 28.4 |
| MaxEpRet | 352 |
| MinEpRet | 267 |
| EpLen | 665 |
| AverageVVals | 40.5 |
| StdVVals | 3.16e-05 |
| MaxVVals | 40.5 |
| MinVVals | 40.5 |
| TotalEnvInteracts | 5.76e+05 |
| LossPi | -4.22e-08 |
| LossV | 201 |
| DeltaLossPi | -0.00171 |
| DeltaLossV | -0.0678 |
| Entropy | -1.19 |
| KL | 0.00195 |
| ClipFrac | 0.019 |
| StopIter | 79 |
| Time | 546 |
---------------------------------------
2019-12-06 17:33:50.468 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 597
2019-12-06 17:33:50.468 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.72, Steps: 598, Distance 18.64, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.93, Angle accuracy 0.0, Num episodes 727
2019-12-06 17:33:51.144 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 760
2019-12-06 17:33:51.145 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.5, Steps: 761, Distance 28.73, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.79, Angle accuracy 0.0, Num episodes 728
2019-12-06 17:33:51.491 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 388
2019-12-06 17:33:51.491 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 202.15, Steps: 389, Distance 8.47, Angular velocity 0.0, Speed: 2.56, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 89.82, Angle accuracy 0.0, Num episodes 729
2019-12-06 17:33:52.166 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 730
2019-12-06 17:33:52.167 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.02, Steps: 731, Distance 26.08, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 730
2019-12-06 17:33:52.769 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:33:52.770 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 310.69, Steps: 680, Distance 23.54, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 731
2019-12-06 17:33:53.334 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:33:53.335 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 298.17, Steps: 632, Distance 20.61, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.53, Angle accuracy 0.0, Num episodes 732
Warning: trajectory cut off by epoch at 209 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 144 |
| AverageEpRet | 292 |
| StdEpRet | 42.4 |
| MaxEpRet | 329 |
| MinEpRet | 202 |
| EpLen | 632 |
| AverageVVals | 40.3 |
| StdVVals | 2.98e-05 |
| MaxVVals | 40.3 |
| MinVVals | 40.3 |
| TotalEnvInteracts | 5.8e+05 |
| LossPi | -2.26e-09 |
| LossV | 226 |
| DeltaLossPi | -0.000423 |
| DeltaLossV | -1.81 |
| Entropy | -1.2 |
| KL | 0.000538 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 550 |
---------------------------------------
2019-12-06 17:33:54.203 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:33:54.204 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.63, Steps: 678, Distance 23.1, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.93, Angle accuracy 0.0, Num episodes 733
2019-12-06 17:33:54.855 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 741
2019-12-06 17:33:54.856 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.97, Steps: 742, Distance 26.47, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.53, Angle accuracy 0.0, Num episodes 734
2019-12-06 17:33:55.538 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 766
2019-12-06 17:33:55.539 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.89, Steps: 767, Distance 28.18, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.64, Angle accuracy 0.0, Num episodes 735
2019-12-06 17:33:56.163 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 681
2019-12-06 17:33:56.164 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.48, Steps: 682, Distance 23.56, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.0, Angle accuracy 0.0, Num episodes 736
2019-12-06 17:33:56.624 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 514
2019-12-06 17:33:56.624 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 278.14, Steps: 515, Distance 14.41, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 93.73, Angle accuracy 0.0, Num episodes 737
Warning: trajectory cut off by epoch at 616 steps.
---------------------------------------
| Epoch | 145 |
| AverageEpRet | 319 |
| StdEpRet | 22.3 |
| MaxEpRet | 345 |
| MinEpRet | 278 |
| EpLen | 677 |
| AverageVVals | 38.9 |
| StdVVals | 2.69e-05 |
| MaxVVals | 38.9 |
| MinVVals | 38.9 |
| TotalEnvInteracts | 5.84e+05 |
| LossPi | -4.13e-08 |
| LossV | 224 |
| DeltaLossPi | -0.00327 |
| DeltaLossV | -3.15 |
| Entropy | -1.2 |
| KL | 0.00407 |
| ClipFrac | 0.044 |
| StopIter | 79 |
| Time | 553 |
---------------------------------------
2019-12-06 17:33:57.952 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:33:57.952 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.94, Steps: 695, Distance 23.88, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.05, Angle accuracy 0.0, Num episodes 738
2019-12-06 17:33:58.265 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 347
2019-12-06 17:33:58.265 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 200.16, Steps: 348, Distance 6.0, Angular velocity 0.0, Speed: 2.17, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 86.12, Angle accuracy 0.0, Num episodes 739
2019-12-06 17:33:58.669 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 451
2019-12-06 17:33:58.669 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 230.03, Steps: 452, Distance 10.87, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.09, Avg gforce: 0.04, Trip pct 91.91, Angle accuracy 0.0, Num episodes 740
2019-12-06 17:33:59.220 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 615
2019-12-06 17:33:59.220 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 310.5, Steps: 616, Distance 19.28, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.17, Angle accuracy 0.0, Num episodes 741
2019-12-06 17:33:59.850 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 705
2019-12-06 17:33:59.850 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 347.5, Steps: 706, Distance 24.51, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.17, Angle accuracy 0.0, Num episodes 742
2019-12-06 17:34:00.373 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 589
2019-12-06 17:34:00.374 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 306.22, Steps: 590, Distance 17.69, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.75, Angle accuracy 0.0, Num episodes 743
Warning: trajectory cut off by epoch at 593 steps.
---------------------------------------
| Epoch | 146 |
| AverageEpRet | 288 |
| StdEpRet | 54.1 |
| MaxEpRet | 347 |
| MinEpRet | 200 |
| EpLen | 568 |
| AverageVVals | 40.7 |
| StdVVals | 2.69e-05 |
| MaxVVals | 40.7 |
| MinVVals | 40.7 |
| TotalEnvInteracts | 5.88e+05 |
| LossPi | -2e-08 |
| LossV | 229 |
| DeltaLossPi | -0.00131 |
| DeltaLossV | -3.7 |
| Entropy | -1.24 |
| KL | 0.00144 |
| ClipFrac | 0.0272 |
| StopIter | 79 |
| Time | 557 |
---------------------------------------
2019-12-06 17:34:01.769 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 783
2019-12-06 17:34:01.769 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 352.96, Steps: 784, Distance 28.93, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.69, Angle accuracy 0.0, Num episodes 744
2019-12-06 17:34:02.256 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 543
2019-12-06 17:34:02.257 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 279.38, Steps: 544, Distance 15.24, Angular velocity 0.0, Speed: 3.21, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.02, Angle accuracy 0.0, Num episodes 745
2019-12-06 17:34:02.867 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:34:02.868 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 324.08, Steps: 689, Distance 23.3, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.1, Angle accuracy 0.0, Num episodes 746
2019-12-06 17:34:03.374 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:34:03.375 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 298.27, Steps: 557, Distance 15.71, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 94.26, Angle accuracy 0.0, Num episodes 747
2019-12-06 17:34:03.740 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:34:03.740 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 228.76, Steps: 413, Distance 8.57, Angular velocity 0.0, Speed: 2.58, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 89.65, Angle accuracy 0.0, Num episodes 748
2019-12-06 17:34:04.153 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 436
2019-12-06 17:34:04.153 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 239.13, Steps: 437, Distance 9.93, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 91.01, Angle accuracy 0.0, Num episodes 749
2019-12-06 17:34:04.546 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 444
2019-12-06 17:34:04.547 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 243.98, Steps: 445, Distance 10.48, Angular velocity 0.0, Speed: 2.83, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 91.62, Angle accuracy 0.0, Num episodes 750
Warning: trajectory cut off by epoch at 131 steps.
---------------------------------------
| Epoch | 147 |
| AverageEpRet | 281 |
| StdEpRet | 43.4 |
| MaxEpRet | 353 |
| MinEpRet | 229 |
| EpLen | 553 |
| AverageVVals | 42.6 |
| StdVVals | 3.1e-05 |
| MaxVVals | 42.6 |
| MinVVals | 42.6 |
| TotalEnvInteracts | 5.92e+05 |
| LossPi | 8.83e-08 |
| LossV | 219 |
| DeltaLossPi | -0.00155 |
| DeltaLossV | -1.29 |
| Entropy | -1.25 |
| KL | 0.00613 |
| ClipFrac | 0.0573 |
| StopIter | 79 |
| Time | 561 |
---------------------------------------
2019-12-06 17:34:05.307 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 541
2019-12-06 17:34:05.308 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 297.12, Steps: 542, Distance 13.86, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.48, Angle accuracy 0.0, Num episodes 751
2019-12-06 17:34:06.042 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 818
2019-12-06 17:34:06.042 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.32, Steps: 819, Distance 30.37, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 96.98, Angle accuracy 0.0, Num episodes 752
2019-12-06 17:34:06.782 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 830
2019-12-06 17:34:06.782 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.46, Steps: 831, Distance 31.18, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.99, Angle accuracy 0.0, Num episodes 753
2019-12-06 17:34:07.269 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 548
2019-12-06 17:34:07.270 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 303.22, Steps: 549, Distance 14.84, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 93.93, Angle accuracy 0.0, Num episodes 754
2019-12-06 17:34:07.684 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 466
2019-12-06 17:34:07.684 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 263.4, Steps: 467, Distance 10.78, Angular velocity 0.0, Speed: 2.79, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 91.73, Angle accuracy 0.0, Num episodes 755
2019-12-06 17:34:08.293 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 673
2019-12-06 17:34:08.294 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.88, Steps: 674, Distance 21.57, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 95.62, Angle accuracy 0.0, Num episodes 756
Warning: trajectory cut off by epoch at 118 steps.
---------------------------------------
| Epoch | 148 |
| AverageEpRet | 326 |
| StdEpRet | 42.5 |
| MaxEpRet | 381 |
| MinEpRet | 263 |
| EpLen | 647 |
| AverageVVals | 41.5 |
| StdVVals | 2.52e-05 |
| MaxVVals | 41.5 |
| MinVVals | 41.5 |
| TotalEnvInteracts | 5.96e+05 |
| LossPi | -2.33e-08 |
| LossV | 255 |
| DeltaLossPi | -0.00233 |
| DeltaLossV | -0.285 |
| Entropy | -1.28 |
| KL | 0.00232 |
| ClipFrac | 0.0272 |
| StopIter | 79 |
| Time | 565 |
---------------------------------------
2019-12-06 17:34:09.197 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:34:09.198 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.7, Steps: 719, Distance 24.15, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.16, Angle accuracy 0.0, Num episodes 757
2019-12-06 17:34:09.743 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:34:09.744 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.64, Steps: 609, Distance 17.94, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.86, Angle accuracy 0.0, Num episodes 758
2019-12-06 17:34:10.211 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 514
2019-12-06 17:34:10.211 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 283.48, Steps: 515, Distance 13.18, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 93.17, Angle accuracy 0.0, Num episodes 759
2019-12-06 17:34:10.735 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 579
2019-12-06 17:34:10.736 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 308.28, Steps: 580, Distance 16.29, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.09, Avg gforce: 0.03, Trip pct 94.48, Angle accuracy 0.0, Num episodes 760
2019-12-06 17:34:11.365 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 668
2019-12-06 17:34:11.366 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.08, Steps: 669, Distance 21.37, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.64, Angle accuracy 0.0, Num episodes 761
2019-12-06 17:34:12.008 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:34:12.009 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 346.72, Steps: 714, Distance 24.18, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.09, Angle accuracy 0.0, Num episodes 762
Warning: trajectory cut off by epoch at 194 steps.
---------------------------------------
| Epoch | 149 |
| AverageEpRet | 326 |
| StdEpRet | 26.3 |
| MaxEpRet | 360 |
| MinEpRet | 283 |
| EpLen | 634 |
| AverageVVals | 42 |
| StdVVals | 2.39e-05 |
| MaxVVals | 42 |
| MinVVals | 42 |
| TotalEnvInteracts | 6e+05 |
| LossPi | -2.47e-08 |
| LossV | 241 |
| DeltaLossPi | -0.00132 |
| DeltaLossV | -1.48 |
| Entropy | -1.28 |
| KL | 0.00125 |
| ClipFrac | 0.00625 |
| StopIter | 79 |
| Time | 568 |
---------------------------------------
2019-12-06 17:34:13.073 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 831
2019-12-06 17:34:13.073 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.07, Steps: 832, Distance 30.55, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.93, Angle accuracy 0.0, Num episodes 763
2019-12-06 17:34:13.611 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 597
2019-12-06 17:34:13.611 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 307.95, Steps: 598, Distance 17.45, Angular velocity 0.0, Speed: 3.26, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.61, Angle accuracy 0.0, Num episodes 764
2019-12-06 17:34:14.057 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 501
2019-12-06 17:34:14.057 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.59, Steps: 502, Distance 11.99, Angular velocity 0.0, Speed: 2.91, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 92.6, Angle accuracy 0.0, Num episodes 765
2019-12-06 17:34:14.697 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 700
2019-12-06 17:34:14.697 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.79, Steps: 701, Distance 22.91, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.84, Angle accuracy 0.0, Num episodes 766
2019-12-06 17:34:15.385 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 770
2019-12-06 17:34:15.386 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.11, Steps: 771, Distance 27.34, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.58, Angle accuracy 0.0, Num episodes 767
2019-12-06 17:34:15.714 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 366
2019-12-06 17:34:15.715 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 198.87, Steps: 367, Distance 6.71, Angular velocity 0.0, Speed: 2.26, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 87.32, Angle accuracy 0.0, Num episodes 768
Warning: trajectory cut off by epoch at 229 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 150 |
| AverageEpRet | 317 |
| StdEpRet | 64.5 |
| MaxEpRet | 397 |
| MinEpRet | 199 |
| EpLen | 628 |
| AverageVVals | 43.2 |
| StdVVals | 2.57e-05 |
| MaxVVals | 43.2 |
| MinVVals | 43.2 |
| TotalEnvInteracts | 6.04e+05 |
| LossPi | -1.14e-08 |
| LossV | 267 |
| DeltaLossPi | -0.000662 |
| DeltaLossV | -1.03 |
| Entropy | -1.3 |
| KL | 0.00318 |
| ClipFrac | 0.0137 |
| StopIter | 79 |
| Time | 572 |
---------------------------------------
2019-12-06 17:34:16.714 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 449
2019-12-06 17:34:16.715 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 262.99, Steps: 450, Distance 10.37, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.09, Avg gforce: 0.04, Trip pct 91.44, Angle accuracy 0.0, Num episodes 769
2019-12-06 17:34:17.363 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 733
2019-12-06 17:34:17.363 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.42, Steps: 734, Distance 25.21, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 770
2019-12-06 17:34:17.869 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:34:17.869 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 312.18, Steps: 572, Distance 15.53, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.13, Angle accuracy 0.0, Num episodes 771
2019-12-06 17:34:18.434 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 626
2019-12-06 17:34:18.435 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.15, Steps: 627, Distance 18.69, Angular velocity 0.0, Speed: 3.25, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.14, Angle accuracy 0.0, Num episodes 772
2019-12-06 17:34:19.097 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:34:19.098 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.72, Steps: 743, Distance 25.43, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.36, Angle accuracy 0.0, Num episodes 773
2019-12-06 17:34:19.765 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:34:19.765 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 366.75, Steps: 746, Distance 25.71, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 774
Warning: trajectory cut off by epoch at 128 steps.
---------------------------------------
| Epoch | 151 |
| AverageEpRet | 331 |
| StdEpRet | 35.2 |
| MaxEpRet | 367 |
| MinEpRet | 263 |
| EpLen | 645 |
| AverageVVals | 42.2 |
| StdVVals | 2.33e-05 |
| MaxVVals | 42.2 |
| MinVVals | 42.2 |
| TotalEnvInteracts | 6.08e+05 |
| LossPi | 2.28e-08 |
| LossV | 279 |
| DeltaLossPi | -0.00174 |
| DeltaLossV | -0.377 |
| Entropy | -1.31 |
| KL | 0.00329 |
| ClipFrac | 0.0327 |
| StopIter | 79 |
| Time | 576 |
---------------------------------------
2019-12-06 17:34:20.512 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 534
2019-12-06 17:34:20.512 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 280.9, Steps: 535, Distance 13.97, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 93.58, Angle accuracy 0.0, Num episodes 775
2019-12-06 17:34:20.993 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 539
2019-12-06 17:34:20.993 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.91, Steps: 540, Distance 14.4, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 93.71, Angle accuracy 0.0, Num episodes 776
2019-12-06 17:34:21.556 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:34:21.557 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 330.69, Steps: 629, Distance 18.82, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.01, Angle accuracy 0.0, Num episodes 777
2019-12-06 17:34:22.125 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:34:22.125 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 330.28, Steps: 638, Distance 19.21, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.29, Angle accuracy 0.0, Num episodes 778
2019-12-06 17:34:22.429 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 345
2019-12-06 17:34:22.430 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 203.13, Steps: 346, Distance 5.92, Angular velocity 0.0, Speed: 2.11, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 85.83, Angle accuracy 0.0, Num episodes 779
2019-12-06 17:34:23.047 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:34:23.047 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 331.78, Steps: 697, Distance 23.29, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 780
Warning: trajectory cut off by epoch at 615 steps.
---------------------------------------
| Epoch | 152 |
| AverageEpRet | 294 |
| StdEpRet | 45.7 |
| MaxEpRet | 332 |
| MinEpRet | 203 |
| EpLen | 564 |
| AverageVVals | 42.8 |
| StdVVals | 2.09e-05 |
| MaxVVals | 42.8 |
| MinVVals | 42.8 |
| TotalEnvInteracts | 6.12e+05 |
| LossPi | -6.97e-08 |
| LossV | 218 |
| DeltaLossPi | -0.0037 |
| DeltaLossV | -1.76 |
| Entropy | -1.29 |
| KL | 0.00222 |
| ClipFrac | 0.0397 |
| StopIter | 79 |
| Time | 580 |
---------------------------------------
2019-12-06 17:34:24.257 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 577
2019-12-06 17:34:24.257 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.04, Steps: 578, Distance 16.17, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.28, Angle accuracy 0.0, Num episodes 781
2019-12-06 17:34:24.934 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 763
2019-12-06 17:34:24.934 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.25, Steps: 764, Distance 26.37, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 782
2019-12-06 17:34:25.471 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:34:25.472 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.61, Steps: 603, Distance 17.49, Angular velocity 0.0, Speed: 3.26, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.73, Angle accuracy 0.0, Num episodes 783
2019-12-06 17:34:26.069 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:34:26.070 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 343.53, Steps: 675, Distance 21.25, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.61, Angle accuracy 0.0, Num episodes 784
2019-12-06 17:34:26.575 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:34:26.575 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.49, Steps: 572, Distance 15.97, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.38, Angle accuracy 0.0, Num episodes 785
2019-12-06 17:34:26.841 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 301
2019-12-06 17:34:26.842 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 178.77, Steps: 302, Distance 4.34, Angular velocity 0.0, Speed: 1.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 81.49, Angle accuracy 0.0, Num episodes 786
Warning: trajectory cut off by epoch at 506 steps.
---------------------------------------
| Epoch | 153 |
| AverageEpRet | 308 |
| StdEpRet | 60.6 |
| MaxEpRet | 367 |
| MinEpRet | 179 |
| EpLen | 582 |
| AverageVVals | 44.1 |
| StdVVals | 2.08e-05 |
| MaxVVals | 44.1 |
| MinVVals | 44.1 |
| TotalEnvInteracts | 6.16e+05 |
| LossPi | -1.19e-10 |
| LossV | 233 |
| DeltaLossPi | -0.002 |
| DeltaLossV | -0.84 |
| Entropy | -1.31 |
| KL | 0.00257 |
| ClipFrac | 0.0253 |
| StopIter | 79 |
| Time | 584 |
---------------------------------------
2019-12-06 17:34:28.113 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:34:28.113 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.43, Steps: 763, Distance 26.77, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.52, Angle accuracy 0.0, Num episodes 787
2019-12-06 17:34:28.563 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 501
2019-12-06 17:34:28.563 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 289.86, Steps: 502, Distance 12.43, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.59, Angle accuracy 0.0, Num episodes 788
2019-12-06 17:34:29.174 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 681
2019-12-06 17:34:29.174 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 360.93, Steps: 682, Distance 22.64, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 789
2019-12-06 17:34:29.780 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:34:29.781 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.63, Steps: 684, Distance 22.1, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.81, Angle accuracy 0.0, Num episodes 790
2019-12-06 17:34:30.445 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 736
2019-12-06 17:34:30.446 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.31, Steps: 737, Distance 25.44, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 791
Warning: trajectory cut off by epoch at 632 steps.
---------------------------------------
| Epoch | 154 |
| AverageEpRet | 354 |
| StdEpRet | 33 |
| MaxEpRet | 382 |
| MinEpRet | 290 |
| EpLen | 674 |
| AverageVVals | 45 |
| StdVVals | 1.65e-05 |
| MaxVVals | 45 |
| MinVVals | 45 |
| TotalEnvInteracts | 6.2e+05 |
| LossPi | -3.66e-08 |
| LossV | 261 |
| DeltaLossPi | -0.00138 |
| DeltaLossV | -0.173 |
| Entropy | -1.33 |
| KL | 0.00277 |
| ClipFrac | 0.0243 |
| StopIter | 79 |
| Time | 587 |
---------------------------------------
2019-12-06 17:34:31.658 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:34:31.658 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.37, Steps: 564, Distance 15.41, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 93.96, Angle accuracy 0.0, Num episodes 792
2019-12-06 17:34:32.188 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 596
2019-12-06 17:34:32.189 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 341.27, Steps: 597, Distance 17.92, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.83, Angle accuracy 0.0, Num episodes 793
2019-12-06 17:34:32.931 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 818
2019-12-06 17:34:32.932 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.09, Steps: 819, Distance 30.86, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.91, Angle accuracy 0.0, Num episodes 794
2019-12-06 17:34:33.459 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:34:33.460 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.6, Steps: 572, Distance 16.02, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.25, Angle accuracy 0.0, Num episodes 795
2019-12-06 17:34:34.063 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 673
2019-12-06 17:34:34.064 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.48, Steps: 674, Distance 21.63, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.59, Angle accuracy 0.0, Num episodes 796
2019-12-06 17:34:34.761 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 754
2019-12-06 17:34:34.761 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.17, Steps: 755, Distance 26.34, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 797
Warning: trajectory cut off by epoch at 19 steps.
---------------------------------------
| Epoch | 155 |
| AverageEpRet | 358 |
| StdEpRet | 23.7 |
| MaxEpRet | 397 |
| MinEpRet | 334 |
| EpLen | 664 |
| AverageVVals | 45.4 |
| StdVVals | 1.76e-05 |
| MaxVVals | 45.4 |
| MinVVals | 45.4 |
| TotalEnvInteracts | 6.24e+05 |
| LossPi | 3.03e-08 |
| LossV | 306 |
| DeltaLossPi | -0.00326 |
| DeltaLossV | -0.0333 |
| Entropy | -1.35 |
| KL | 0.00587 |
| ClipFrac | 0.0613 |
| StopIter | 79 |
| Time | 591 |
---------------------------------------
2019-12-06 17:34:35.448 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 581
2019-12-06 17:34:35.449 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.38, Steps: 582, Distance 16.58, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.59, Angle accuracy 0.0, Num episodes 798
2019-12-06 17:34:36.135 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 759
2019-12-06 17:34:36.136 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.37, Steps: 760, Distance 27.26, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 799
2019-12-06 17:34:36.872 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 829
2019-12-06 17:34:36.872 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.02, Steps: 830, Distance 31.73, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.95, Angle accuracy 0.0, Num episodes 800
2019-12-06 17:34:37.464 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 668
2019-12-06 17:34:37.464 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.67, Steps: 669, Distance 21.86, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.7, Angle accuracy 0.0, Num episodes 801
2019-12-06 17:34:37.741 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 291
2019-12-06 17:34:37.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 165.95, Steps: 292, Distance 4.35, Angular velocity 0.0, Speed: 1.8, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 81.74, Angle accuracy 0.0, Num episodes 802
2019-12-06 17:34:38.170 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 484
2019-12-06 17:34:38.170 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 274.95, Steps: 485, Distance 11.53, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.18, Angle accuracy 0.0, Num episodes 803
Warning: trajectory cut off by epoch at 382 steps.
---------------------------------------
| Epoch | 156 |
| AverageEpRet | 316 |
| StdEpRet | 77.8 |
| MaxEpRet | 400 |
| MinEpRet | 166 |
| EpLen | 603 |
| AverageVVals | 45.2 |
| StdVVals | 1.62e-05 |
| MaxVVals | 45.2 |
| MinVVals | 45.2 |
| TotalEnvInteracts | 6.28e+05 |
| LossPi | -2.55e-08 |
| LossV | 253 |
| DeltaLossPi | -0.00102 |
| DeltaLossV | -0.459 |
| Entropy | -1.33 |
| KL | 0.00138 |
| ClipFrac | 0.014 |
| StopIter | 79 |
| Time | 595 |
---------------------------------------
2019-12-06 17:34:39.338 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 758
2019-12-06 17:34:39.338 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 391.46, Steps: 759, Distance 27.19, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.54, Angle accuracy 0.0, Num episodes 804
2019-12-06 17:34:39.829 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 529
2019-12-06 17:34:39.830 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 319.59, Steps: 530, Distance 14.0, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.55, Angle accuracy 0.0, Num episodes 805
2019-12-06 17:34:40.424 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:34:40.424 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.48, Steps: 655, Distance 21.65, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.64, Angle accuracy 0.0, Num episodes 806
2019-12-06 17:34:40.889 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:34:40.890 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.1, Steps: 520, Distance 13.76, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.33, Angle accuracy 0.0, Num episodes 807
2019-12-06 17:34:41.568 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 730
2019-12-06 17:34:41.569 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.41, Steps: 731, Distance 25.35, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.35, Angle accuracy 0.0, Num episodes 808
2019-12-06 17:34:42.116 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:34:42.117 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 346.85, Steps: 609, Distance 18.31, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.94, Angle accuracy 0.0, Num episodes 809
Warning: trajectory cut off by epoch at 196 steps.
---------------------------------------
| Epoch | 157 |
| AverageEpRet | 350 |
| StdEpRet | 29.7 |
| MaxEpRet | 391 |
| MinEpRet | 311 |
| EpLen | 634 |
| AverageVVals | 44.6 |
| StdVVals | 1.52e-05 |
| MaxVVals | 44.6 |
| MinVVals | 44.6 |
| TotalEnvInteracts | 6.32e+05 |
| LossPi | 4.75e-08 |
| LossV | 259 |
| DeltaLossPi | -0.00168 |
| DeltaLossV | -3.78 |
| Entropy | -1.37 |
| KL | 0.0015 |
| ClipFrac | 0.0165 |
| StopIter | 79 |
| Time | 599 |
---------------------------------------
2019-12-06 17:34:42.986 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:34:42.987 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 347.3, Steps: 609, Distance 18.51, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.02, Angle accuracy 0.0, Num episodes 810
2019-12-06 17:34:43.567 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:34:43.567 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.78, Steps: 646, Distance 20.24, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.41, Angle accuracy 0.0, Num episodes 811
2019-12-06 17:34:44.112 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 610
2019-12-06 17:34:44.112 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.78, Steps: 611, Distance 18.43, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.93, Angle accuracy 0.0, Num episodes 812
2019-12-06 17:34:44.718 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:34:44.718 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 373.27, Steps: 678, Distance 22.34, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.87, Angle accuracy 0.0, Num episodes 813
2019-12-06 17:34:45.275 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:34:45.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 347.83, Steps: 623, Distance 19.24, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.2, Angle accuracy 0.0, Num episodes 814
2019-12-06 17:34:45.830 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 621
2019-12-06 17:34:45.831 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.05, Steps: 622, Distance 19.68, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.41, Angle accuracy 0.0, Num episodes 815
Warning: trajectory cut off by epoch at 211 steps.
---------------------------------------
| Epoch | 158 |
| AverageEpRet | 350 |
| StdEpRet | 12.1 |
| MaxEpRet | 373 |
| MinEpRet | 334 |
| EpLen | 632 |
| AverageVVals | 46.5 |
| StdVVals | 1.39e-05 |
| MaxVVals | 46.5 |
| MinVVals | 46.5 |
| TotalEnvInteracts | 6.36e+05 |
| LossPi | 4.16e-08 |
| LossV | 264 |
| DeltaLossPi | -0.00204 |
| DeltaLossV | -0.126 |
| Entropy | -1.37 |
| KL | 0.00101 |
| ClipFrac | 0.0127 |
| StopIter | 79 |
| Time | 602 |
---------------------------------------
2019-12-06 17:34:46.511 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 393
2019-12-06 17:34:46.511 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 242.39, Steps: 394, Distance 8.12, Angular velocity 0.0, Speed: 2.44, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 89.19, Angle accuracy 0.0, Num episodes 816
2019-12-06 17:34:47.051 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:34:47.051 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.64, Steps: 587, Distance 16.98, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 94.67, Angle accuracy 0.0, Num episodes 817
2019-12-06 17:34:47.637 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 666
2019-12-06 17:34:47.638 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.1, Steps: 667, Distance 21.58, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.79, Angle accuracy 0.0, Num episodes 818
2019-12-06 17:34:48.052 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 459
2019-12-06 17:34:48.052 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.49, Steps: 460, Distance 10.76, Angular velocity 0.0, Speed: 2.79, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 91.82, Angle accuracy 0.0, Num episodes 819
2019-12-06 17:34:48.590 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:34:48.591 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 330.94, Steps: 593, Distance 17.48, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.78, Angle accuracy 0.0, Num episodes 820
2019-12-06 17:34:49.219 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:34:49.219 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.0, Steps: 689, Distance 23.26, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.02, Angle accuracy 0.0, Num episodes 821
2019-12-06 17:34:49.696 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 536
2019-12-06 17:34:49.697 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.83, Steps: 537, Distance 14.67, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.69, Angle accuracy 0.0, Num episodes 822
Warning: trajectory cut off by epoch at 73 steps.
---------------------------------------
| Epoch | 159 |
| AverageEpRet | 320 |
| StdEpRet | 44.7 |
| MaxEpRet | 378 |
| MinEpRet | 242 |
| EpLen | 561 |
| AverageVVals | 46.8 |
| StdVVals | 1.55e-05 |
| MaxVVals | 46.8 |
| MinVVals | 46.8 |
| TotalEnvInteracts | 6.4e+05 |
| LossPi | -2.75e-08 |
| LossV | 245 |
| DeltaLossPi | -0.00102 |
| DeltaLossV | -0.0148 |
| Entropy | -1.38 |
| KL | 0.00114 |
| ClipFrac | 0.00425 |
| StopIter | 79 |
| Time | 606 |
---------------------------------------
2019-12-06 17:34:50.562 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 709
2019-12-06 17:34:50.562 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.71, Steps: 710, Distance 24.23, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 823
2019-12-06 17:34:51.167 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 667
2019-12-06 17:34:51.168 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.57, Steps: 668, Distance 21.9, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 824
2019-12-06 17:34:51.798 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 690
2019-12-06 17:34:51.799 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.9, Steps: 691, Distance 23.16, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.93, Angle accuracy 0.0, Num episodes 825
2019-12-06 17:34:52.488 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 760
2019-12-06 17:34:52.488 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.45, Steps: 761, Distance 27.52, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.69, Angle accuracy 0.0, Num episodes 826
2019-12-06 17:34:52.993 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 557
2019-12-06 17:34:52.994 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 324.3, Steps: 558, Distance 16.0, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 94.32, Angle accuracy 0.0, Num episodes 827
Warning: trajectory cut off by epoch at 612 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 160 |
| AverageEpRet | 364 |
| StdEpRet | 21.6 |
| MaxEpRet | 383 |
| MinEpRet | 324 |
| EpLen | 678 |
| AverageVVals | 46.7 |
| StdVVals | 1.28e-05 |
| MaxVVals | 46.7 |
| MinVVals | 46.7 |
| TotalEnvInteracts | 6.44e+05 |
| LossPi | -1.26e-08 |
| LossV | 265 |
| DeltaLossPi | -0.0014 |
| DeltaLossV | -0.106 |
| Entropy | -1.38 |
| KL | 0.00229 |
| ClipFrac | 0.0518 |
| StopIter | 79 |
| Time | 610 |
---------------------------------------
2019-12-06 17:34:54.616 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 660
2019-12-06 17:34:54.617 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 363.62, Steps: 661, Distance 21.39, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.65, Angle accuracy 0.0, Num episodes 828
2019-12-06 17:34:55.323 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 744
2019-12-06 17:34:55.324 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 373.9, Steps: 745, Distance 26.59, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 829
2019-12-06 17:34:56.013 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:34:56.013 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.51, Steps: 743, Distance 26.33, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.52, Angle accuracy 0.0, Num episodes 830
2019-12-06 17:34:56.521 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 568
2019-12-06 17:34:56.521 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.31, Steps: 569, Distance 16.39, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.34, Angle accuracy 0.0, Num episodes 831
2019-12-06 17:34:57.117 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:34:57.117 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 363.55, Steps: 662, Distance 21.8, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.68, Angle accuracy 0.0, Num episodes 832
Warning: trajectory cut off by epoch at 620 steps.
---------------------------------------
| Epoch | 161 |
| AverageEpRet | 365 |
| StdEpRet | 24.5 |
| MaxEpRet | 400 |
| MinEpRet | 323 |
| EpLen | 676 |
| AverageVVals | 46.4 |
| StdVVals | 1.54e-05 |
| MaxVVals | 46.4 |
| MinVVals | 46.4 |
| TotalEnvInteracts | 6.48e+05 |
| LossPi | -5.26e-08 |
| LossV | 245 |
| DeltaLossPi | -0.000947 |
| DeltaLossV | -0.088 |
| Entropy | -1.37 |
| KL | 0.00356 |
| ClipFrac | 0.0278 |
| StopIter | 79 |
| Time | 614 |
---------------------------------------
2019-12-06 17:34:58.550 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 781
2019-12-06 17:34:58.551 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.14, Steps: 782, Distance 28.44, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 833
2019-12-06 17:34:59.306 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 850
2019-12-06 17:34:59.307 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.5, Steps: 851, Distance 33.09, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.13, Angle accuracy 0.0, Num episodes 834
2019-12-06 17:34:59.979 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 759
2019-12-06 17:34:59.979 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.06, Steps: 760, Distance 27.45, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 835
2019-12-06 17:35:00.723 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 821
2019-12-06 17:35:00.724 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.36, Steps: 822, Distance 30.9, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.0, Angle accuracy 0.0, Num episodes 836
2019-12-06 17:35:01.237 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 539
2019-12-06 17:35:01.237 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.05, Steps: 540, Distance 14.56, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.88, Angle accuracy 0.0, Num episodes 837
Warning: trajectory cut off by epoch at 245 steps.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 162 |
| AverageEpRet | 396 |
| StdEpRet | 36.6 |
| MaxEpRet | 423 |
| MinEpRet | 325 |
| EpLen | 751 |
| AverageVVals | 46.7 |
| StdVVals | 1.21e-05 |
| MaxVVals | 46.7 |
| MinVVals | 46.7 |
| TotalEnvInteracts | 6.52e+05 |
| LossPi | -2.73e-08 |
| LossV | 333 |
| DeltaLossPi | 0.0012 |
| DeltaLossV | -1.58 |
| Entropy | -1.41 |
| KL | 0.00613 |
| ClipFrac | 0.158 |
| StopIter | 4 |
| Time | 618 |
---------------------------------------
2019-12-06 17:35:02.010 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:35:02.010 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.87, Steps: 520, Distance 13.84, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.42, Angle accuracy 0.0, Num episodes 838
2019-12-06 17:35:02.548 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 601
2019-12-06 17:35:02.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.83, Steps: 602, Distance 18.3, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.87, Angle accuracy 0.0, Num episodes 839
2019-12-06 17:35:03.158 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:35:03.158 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 368.16, Steps: 684, Distance 22.99, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.99, Angle accuracy 0.0, Num episodes 840
2019-12-06 17:35:03.738 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:35:03.739 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.35, Steps: 643, Distance 20.36, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.55, Angle accuracy 0.0, Num episodes 841
2019-12-06 17:35:04.401 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 702
2019-12-06 17:35:04.402 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.58, Steps: 703, Distance 24.12, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.03, Angle accuracy 0.0, Num episodes 842
2019-12-06 17:35:04.848 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 503
2019-12-06 17:35:04.849 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.84, Steps: 504, Distance 13.03, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 92.91, Angle accuracy 0.0, Num episodes 843
Warning: trajectory cut off by epoch at 344 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 163 |
| AverageEpRet | 346 |
| StdEpRet | 26.1 |
| MaxEpRet | 371 |
| MinEpRet | 300 |
| EpLen | 609 |
| AverageVVals | 45.4 |
| StdVVals | 1.36e-05 |
| MaxVVals | 45.4 |
| MinVVals | 45.4 |
| TotalEnvInteracts | 6.56e+05 |
| LossPi | -3.93e-09 |
| LossV | 252 |
| DeltaLossPi | 0.000127 |
| DeltaLossV | -5.32 |
| Entropy | -1.4 |
| KL | 3.47e-05 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 621 |
---------------------------------------
2019-12-06 17:35:05.599 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 416
2019-12-06 17:35:05.599 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 244.3, Steps: 417, Distance 8.9, Angular velocity 0.0, Speed: 2.58, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 89.93, Angle accuracy 0.0, Num episodes 844
2019-12-06 17:35:06.120 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 584
2019-12-06 17:35:06.120 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 353.61, Steps: 585, Distance 17.33, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.64, Angle accuracy 0.0, Num episodes 845
2019-12-06 17:35:06.747 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 705
2019-12-06 17:35:06.748 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.79, Steps: 706, Distance 24.31, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 846
2019-12-06 17:35:07.344 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:35:07.344 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 363.95, Steps: 666, Distance 22.17, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.91, Angle accuracy 0.0, Num episodes 847
2019-12-06 17:35:07.954 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 685
2019-12-06 17:35:07.954 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.07, Steps: 686, Distance 23.43, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.94, Angle accuracy 0.0, Num episodes 848
2019-12-06 17:35:08.549 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 671
2019-12-06 17:35:08.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.98, Steps: 672, Distance 22.6, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.81, Angle accuracy 0.0, Num episodes 849
Warning: trajectory cut off by epoch at 268 steps.
---------------------------------------
| Epoch | 164 |
| AverageEpRet | 345 |
| StdEpRet | 46.1 |
| MaxEpRet | 384 |
| MinEpRet | 244 |
| EpLen | 622 |
| AverageVVals | 47.7 |
| StdVVals | 1.19e-05 |
| MaxVVals | 47.7 |
| MinVVals | 47.7 |
| TotalEnvInteracts | 6.6e+05 |
| LossPi | -5.63e-08 |
| LossV | 268 |
| DeltaLossPi | -0.000872 |
| DeltaLossV | -0.929 |
| Entropy | -1.4 |
| KL | 0.00288 |
| ClipFrac | 0.00975 |
| StopIter | 79 |
| Time | 625 |
---------------------------------------
2019-12-06 17:35:09.497 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 639
2019-12-06 17:35:09.497 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.13, Steps: 640, Distance 20.77, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.59, Angle accuracy 0.0, Num episodes 850
2019-12-06 17:35:10.015 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 578
2019-12-06 17:35:10.015 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 332.95, Steps: 579, Distance 17.51, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.76, Angle accuracy 0.0, Num episodes 851
2019-12-06 17:35:10.664 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 676
2019-12-06 17:35:10.664 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 366.16, Steps: 677, Distance 23.17, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.02, Angle accuracy 0.0, Num episodes 852
2019-12-06 17:35:11.156 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 534
2019-12-06 17:35:11.156 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 301.17, Steps: 535, Distance 15.28, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.87, Angle accuracy 0.0, Num episodes 853
2019-12-06 17:35:11.733 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:35:11.734 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.7, Steps: 635, Distance 20.2, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.37, Angle accuracy 0.0, Num episodes 854
2019-12-06 17:35:12.303 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:35:12.304 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 360.25, Steps: 638, Distance 20.88, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 855
Warning: trajectory cut off by epoch at 296 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 165 |
| AverageEpRet | 347 |
| StdEpRet | 23.4 |
| MaxEpRet | 366 |
| MinEpRet | 301 |
| EpLen | 617 |
| AverageVVals | 46.8 |
| StdVVals | 9.74e-06 |
| MaxVVals | 46.8 |
| MinVVals | 46.8 |
| TotalEnvInteracts | 6.64e+05 |
| LossPi | 1.13e-09 |
| LossV | 240 |
| DeltaLossPi | -0.00158 |
| DeltaLossV | -0.641 |
| Entropy | -1.39 |
| KL | 0.00157 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 629 |
---------------------------------------
2019-12-06 17:35:13.161 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:35:13.161 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 340.98, Steps: 589, Distance 17.78, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 94.74, Angle accuracy 0.0, Num episodes 856
2019-12-06 17:35:13.826 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:35:13.826 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.31, Steps: 739, Distance 27.3, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 857
2019-12-06 17:35:14.525 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 779
2019-12-06 17:35:14.525 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.83, Steps: 780, Distance 29.49, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.74, Angle accuracy 0.0, Num episodes 858
2019-12-06 17:35:15.010 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 536
2019-12-06 17:35:15.010 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 319.24, Steps: 537, Distance 14.64, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.69, Angle accuracy 0.0, Num episodes 859
2019-12-06 17:35:15.484 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 530
2019-12-06 17:35:15.484 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 319.24, Steps: 531, Distance 14.6, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.73, Angle accuracy 0.0, Num episodes 860
2019-12-06 17:35:16.021 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 574
2019-12-06 17:35:16.022 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.67, Steps: 575, Distance 16.75, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.66, Angle accuracy 0.0, Num episodes 861
Warning: trajectory cut off by epoch at 249 steps.
---------------------------------------
| Epoch | 166 |
| AverageEpRet | 350 |
| StdEpRet | 30.8 |
| MaxEpRet | 400 |
| MinEpRet | 319 |
| EpLen | 625 |
| AverageVVals | 47.6 |
| StdVVals | 1.51e-05 |
| MaxVVals | 47.6 |
| MinVVals | 47.6 |
| TotalEnvInteracts | 6.68e+05 |
| LossPi | 1.7e-08 |
| LossV | 256 |
| DeltaLossPi | -0.00113 |
| DeltaLossV | -0.167 |
| Entropy | -1.41 |
| KL | 0.00114 |
| ClipFrac | 0.0025 |
| StopIter | 79 |
| Time | 633 |
---------------------------------------
2019-12-06 17:35:17.008 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 698
2019-12-06 17:35:17.008 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.85, Steps: 699, Distance 23.83, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.02, Angle accuracy 0.0, Num episodes 862
2019-12-06 17:35:17.430 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 475
2019-12-06 17:35:17.430 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 291.57, Steps: 476, Distance 11.77, Angular velocity 0.0, Speed: 2.94, Max gforce: 0.08, Avg gforce: 0.04, Trip pct 92.38, Angle accuracy 0.0, Num episodes 863
2019-12-06 17:35:17.999 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:35:17.999 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.78, Steps: 638, Distance 20.5, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.48, Angle accuracy 0.0, Num episodes 864
2019-12-06 17:35:18.293 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 320
2019-12-06 17:35:18.293 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 199.62, Steps: 321, Distance 5.08, Angular velocity 0.0, Speed: 1.93, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 83.71, Angle accuracy 0.0, Num episodes 865
2019-12-06 17:35:18.916 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 709
2019-12-06 17:35:18.916 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 387.47, Steps: 710, Distance 24.88, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.29, Angle accuracy 0.0, Num episodes 866
2019-12-06 17:35:19.546 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:35:19.546 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.02, Steps: 700, Distance 24.65, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.15, Angle accuracy 0.0, Num episodes 867
Warning: trajectory cut off by epoch at 456 steps.
---------------------------------------
| Epoch | 167 |
| AverageEpRet | 334 |
| StdEpRet | 69 |
| MaxEpRet | 392 |
| MinEpRet | 200 |
| EpLen | 591 |
| AverageVVals | 47.2 |
| StdVVals | 1.07e-05 |
| MaxVVals | 47.2 |
| MinVVals | 47.2 |
| TotalEnvInteracts | 6.72e+05 |
| LossPi | 1.73e-08 |
| LossV | 283 |
| DeltaLossPi | -0.00302 |
| DeltaLossV | -0.71 |
| Entropy | -1.43 |
| KL | 0.00179 |
| ClipFrac | 0.0225 |
| StopIter | 79 |
| Time | 636 |
---------------------------------------
2019-12-06 17:35:20.564 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:35:20.565 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.11, Steps: 521, Distance 13.99, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.56, Angle accuracy 0.0, Num episodes 868
2019-12-06 17:35:21.232 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 746
2019-12-06 17:35:21.232 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.65, Steps: 747, Distance 27.57, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.66, Angle accuracy 0.0, Num episodes 869
2019-12-06 17:35:21.777 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:35:21.777 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 346.08, Steps: 613, Distance 19.18, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.18, Angle accuracy 0.0, Num episodes 870
2019-12-06 17:35:22.402 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 703
2019-12-06 17:35:22.402 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.68, Steps: 704, Distance 24.28, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.09, Angle accuracy 0.0, Num episodes 871
2019-12-06 17:35:22.812 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 462
2019-12-06 17:35:22.812 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 273.29, Steps: 463, Distance 10.99, Angular velocity 0.0, Speed: 2.83, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 91.72, Angle accuracy 0.0, Num episodes 872
2019-12-06 17:35:23.408 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 670
2019-12-06 17:35:23.408 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.66, Steps: 671, Distance 22.49, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.86, Angle accuracy 0.0, Num episodes 873
Warning: trajectory cut off by epoch at 281 steps.
---------------------------------------
| Epoch | 168 |
| AverageEpRet | 347 |
| StdEpRet | 42.8 |
| MaxEpRet | 391 |
| MinEpRet | 273 |
| EpLen | 620 |
| AverageVVals | 48 |
| StdVVals | 1.08e-05 |
| MaxVVals | 48 |
| MinVVals | 48 |
| TotalEnvInteracts | 6.76e+05 |
| LossPi | 3.76e-08 |
| LossV | 261 |
| DeltaLossPi | -0.00172 |
| DeltaLossV | -0.47 |
| Entropy | -1.4 |
| KL | 0.00506 |
| ClipFrac | 0.0443 |
| StopIter | 79 |
| Time | 640 |
---------------------------------------
2019-12-06 17:35:24.351 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:35:24.351 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.54, Steps: 623, Distance 19.42, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.15, Angle accuracy 0.0, Num episodes 874
2019-12-06 17:35:24.964 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 647
2019-12-06 17:35:24.964 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.53, Steps: 648, Distance 20.84, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.5, Angle accuracy 0.0, Num episodes 875
2019-12-06 17:35:25.577 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:35:25.577 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.86, Steps: 692, Distance 23.31, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.05, Angle accuracy 0.0, Num episodes 876
2019-12-06 17:35:26.278 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 789
2019-12-06 17:35:26.279 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.1, Steps: 790, Distance 29.57, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.8, Angle accuracy 0.0, Num episodes 877
2019-12-06 17:35:26.866 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:35:26.867 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 374.29, Steps: 663, Distance 21.78, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.84, Angle accuracy 0.0, Num episodes 878
Warning: trajectory cut off by epoch at 584 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 169 |
| AverageEpRet | 382 |
| StdEpRet | 15.6 |
| MaxEpRet | 412 |
| MinEpRet | 368 |
| EpLen | 683 |
| AverageVVals | 47.3 |
| StdVVals | 7.93e-06 |
| MaxVVals | 47.3 |
| MinVVals | 47.3 |
| TotalEnvInteracts | 6.8e+05 |
| LossPi | -2.16e-08 |
| LossV | 271 |
| DeltaLossPi | -0.000175 |
| DeltaLossV | -2.29 |
| Entropy | -1.45 |
| KL | 0.000447 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 644 |
---------------------------------------
2019-12-06 17:35:28.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:35:28.012 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.31, Steps: 625, Distance 19.18, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.2, Angle accuracy 0.0, Num episodes 879
2019-12-06 17:35:28.467 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 511
2019-12-06 17:35:28.467 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 308.95, Steps: 512, Distance 13.55, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.32, Angle accuracy 0.0, Num episodes 880
2019-12-06 17:35:28.948 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 542
2019-12-06 17:35:28.948 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 319.19, Steps: 543, Distance 14.93, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.84, Angle accuracy 0.0, Num episodes 881
2019-12-06 17:35:29.528 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 647
2019-12-06 17:35:29.529 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.19, Steps: 648, Distance 21.16, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.58, Angle accuracy 0.0, Num episodes 882
2019-12-06 17:35:30.202 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 757
2019-12-06 17:35:30.203 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.76, Steps: 758, Distance 27.49, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.54, Angle accuracy 0.0, Num episodes 883
2019-12-06 17:35:30.666 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 514
2019-12-06 17:35:30.666 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.31, Steps: 515, Distance 13.62, Angular velocity 0.0, Speed: 3.07, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.3, Angle accuracy 0.0, Num episodes 884
Warning: trajectory cut off by epoch at 399 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 170 |
| AverageEpRet | 346 |
| StdEpRet | 34.9 |
| MaxEpRet | 405 |
| MinEpRet | 309 |
| EpLen | 600 |
| AverageVVals | 48.8 |
| StdVVals | 9.18e-06 |
| MaxVVals | 48.8 |
| MinVVals | 48.8 |
| TotalEnvInteracts | 6.84e+05 |
| LossPi | -1.47e-08 |
| LossV | 259 |
| DeltaLossPi | -0.00299 |
| DeltaLossV | -0.0581 |
| Entropy | -1.44 |
| KL | 0.00653 |
| ClipFrac | 0.04 |
| StopIter | 79 |
| Time | 648 |
---------------------------------------
2019-12-06 17:35:31.732 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 339
2019-12-06 17:35:31.733 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 203.91, Steps: 340, Distance 5.74, Angular velocity 0.0, Speed: 2.04, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 85.2, Angle accuracy 0.0, Num episodes 885
2019-12-06 17:35:32.369 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:35:32.369 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.94, Steps: 719, Distance 24.85, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 886
2019-12-06 17:35:32.685 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 352
2019-12-06 17:35:32.685 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 210.85, Steps: 353, Distance 6.16, Angular velocity 0.0, Speed: 2.16, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 86.41, Angle accuracy 0.0, Num episodes 887
2019-12-06 17:35:33.297 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 675
2019-12-06 17:35:33.298 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.62, Steps: 676, Distance 22.37, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.75, Angle accuracy 0.0, Num episodes 888
2019-12-06 17:35:34.037 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 808
2019-12-06 17:35:34.038 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.8, Steps: 809, Distance 30.69, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.91, Angle accuracy 0.0, Num episodes 889
2019-12-06 17:35:34.808 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 844
2019-12-06 17:35:34.808 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.62, Steps: 845, Distance 32.92, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.14, Angle accuracy 0.0, Num episodes 890
Warning: trajectory cut off by epoch at 258 steps.
---------------------------------------
| Epoch | 171 |
| AverageEpRet | 341 |
| StdEpRet | 95.2 |
| MaxEpRet | 426 |
| MinEpRet | 204 |
| EpLen | 624 |
| AverageVVals | 49 |
| StdVVals | 8.5e-06 |
| MaxVVals | 49 |
| MinVVals | 49 |
| TotalEnvInteracts | 6.88e+05 |
| LossPi | 1.08e-08 |
| LossV | 325 |
| DeltaLossPi | -0.000428 |
| DeltaLossV | -10.1 |
| Entropy | -1.48 |
| KL | 0.000897 |
| ClipFrac | 0.0075 |
| StopIter | 79 |
| Time | 651 |
---------------------------------------
2019-12-06 17:35:35.813 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 706
2019-12-06 17:35:35.814 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.67, Steps: 707, Distance 23.93, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.13, Angle accuracy 0.0, Num episodes 891
2019-12-06 17:35:36.448 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:35:36.449 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.25, Steps: 700, Distance 23.62, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.16, Angle accuracy 0.0, Num episodes 892
2019-12-06 17:35:36.970 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:35:36.971 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.84, Steps: 587, Distance 17.12, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.67, Angle accuracy 0.0, Num episodes 893
2019-12-06 17:35:37.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 740
2019-12-06 17:35:37.656 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.23, Steps: 741, Distance 25.92, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.42, Angle accuracy 0.0, Num episodes 894
2019-12-06 17:35:38.422 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 850
2019-12-06 17:35:38.422 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.44, Steps: 851, Distance 33.26, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.13, Angle accuracy 0.0, Num episodes 895
Warning: trajectory cut off by epoch at 414 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 172 |
| AverageEpRet | 394 |
| StdEpRet | 24.4 |
| MaxEpRet | 431 |
| MinEpRet | 356 |
| EpLen | 717 |
| AverageVVals | 45.9 |
| StdVVals | 7.13e-06 |
| MaxVVals | 45.9 |
| MinVVals | 45.9 |
| TotalEnvInteracts | 6.92e+05 |
| LossPi | 2.86e-08 |
| LossV | 327 |
| DeltaLossPi | -0.000536 |
| DeltaLossV | -2.45 |
| Entropy | -1.49 |
| KL | 0.00124 |
| ClipFrac | 0.0005 |
| StopIter | 2 |
| Time | 655 |
---------------------------------------
2019-12-06 17:35:39.477 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:35:39.477 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.54, Steps: 690, Distance 22.64, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.89, Angle accuracy 0.0, Num episodes 896
2019-12-06 17:35:40.048 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:35:40.048 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.66, Steps: 599, Distance 17.56, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.75, Angle accuracy 0.0, Num episodes 897
2019-12-06 17:35:40.517 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 514
2019-12-06 17:35:40.517 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 306.55, Steps: 515, Distance 12.75, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.99, Angle accuracy 0.0, Num episodes 898
2019-12-06 17:35:40.975 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 512
2019-12-06 17:35:40.975 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.86, Steps: 513, Distance 12.98, Angular velocity 0.0, Speed: 3.02, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.06, Angle accuracy 0.0, Num episodes 899
2019-12-06 17:35:41.548 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 619
2019-12-06 17:35:41.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.53, Steps: 620, Distance 18.23, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.83, Angle accuracy 0.0, Num episodes 900
2019-12-06 17:35:42.098 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 597
2019-12-06 17:35:42.098 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.32, Steps: 598, Distance 17.12, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.55, Angle accuracy 0.0, Num episodes 901
Warning: trajectory cut off by epoch at 465 steps.
Early stopping at step 8 due to reaching max kl.
---------------------------------------
| Epoch | 173 |
| AverageEpRet | 353 |
| StdEpRet | 29 |
| MaxEpRet | 391 |
| MinEpRet | 307 |
| EpLen | 589 |
| AverageVVals | 47.4 |
| StdVVals | 8.72e-06 |
| MaxVVals | 47.4 |
| MinVVals | 47.4 |
| TotalEnvInteracts | 6.96e+05 |
| LossPi | 1.51e-08 |
| LossV | 265 |
| DeltaLossPi | -0.00166 |
| DeltaLossV | -11.5 |
| Entropy | -1.49 |
| KL | 0.00263 |
| ClipFrac | 0.008 |
| StopIter | 8 |
| Time | 659 |
---------------------------------------
2019-12-06 17:35:43.263 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 735
2019-12-06 17:35:43.263 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.36, Steps: 736, Distance 26.37, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 902
2019-12-06 17:35:43.936 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 732
2019-12-06 17:35:43.936 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.43, Steps: 733, Distance 25.59, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 903
2019-12-06 17:35:44.656 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 802
2019-12-06 17:35:44.657 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.14, Steps: 803, Distance 30.0, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.89, Angle accuracy 0.0, Num episodes 904
2019-12-06 17:35:45.191 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:35:45.192 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.7, Steps: 596, Distance 17.19, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.77, Angle accuracy 0.0, Num episodes 905
2019-12-06 17:35:45.702 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:35:45.702 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.33, Steps: 572, Distance 16.21, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.35, Angle accuracy 0.0, Num episodes 906
Warning: trajectory cut off by epoch at 560 steps.
---------------------------------------
| Epoch | 174 |
| AverageEpRet | 389 |
| StdEpRet | 27.1 |
| MaxEpRet | 417 |
| MinEpRet | 350 |
| EpLen | 688 |
| AverageVVals | 50.9 |
| StdVVals | 8.78e-06 |
| MaxVVals | 50.9 |
| MinVVals | 50.9 |
| TotalEnvInteracts | 7e+05 |
| LossPi | 1.93e-08 |
| LossV | 310 |
| DeltaLossPi | -0.0025 |
| DeltaLossV | -1.67 |
| Entropy | -1.5 |
| KL | 0.000576 |
| ClipFrac | 0.0115 |
| StopIter | 79 |
| Time | 662 |
---------------------------------------
2019-12-06 17:35:46.943 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 664
2019-12-06 17:35:46.943 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.95, Steps: 665, Distance 20.94, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 95.44, Angle accuracy 0.0, Num episodes 907
2019-12-06 17:35:47.647 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 780
2019-12-06 17:35:47.648 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.03, Steps: 781, Distance 28.75, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.72, Angle accuracy 0.0, Num episodes 908
2019-12-06 17:35:47.939 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 314
2019-12-06 17:35:47.939 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 197.42, Steps: 315, Distance 4.73, Angular velocity 0.0, Speed: 1.81, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 82.61, Angle accuracy 0.0, Num episodes 909
2019-12-06 17:35:48.681 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 832
2019-12-06 17:35:48.681 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.09, Steps: 833, Distance 31.54, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.95, Angle accuracy 0.0, Num episodes 910
2019-12-06 17:35:49.244 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 632
2019-12-06 17:35:49.245 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.07, Steps: 633, Distance 19.21, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.16, Angle accuracy 0.0, Num episodes 911
2019-12-06 17:35:49.829 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:35:49.829 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.26, Steps: 655, Distance 21.02, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.57, Angle accuracy 0.0, Num episodes 912
Warning: trajectory cut off by epoch at 118 steps.
---------------------------------------
| Epoch | 175 |
| AverageEpRet | 371 |
| StdEpRet | 81.6 |
| MaxEpRet | 446 |
| MinEpRet | 197 |
| EpLen | 647 |
| AverageVVals | 49.6 |
| StdVVals | 9.21e-06 |
| MaxVVals | 49.6 |
| MinVVals | 49.6 |
| TotalEnvInteracts | 7.04e+05 |
| LossPi | 2.28e-08 |
| LossV | 329 |
| DeltaLossPi | -0.00118 |
| DeltaLossV | -2.35 |
| Entropy | -1.52 |
| KL | 0.00131 |
| ClipFrac | 0.0168 |
| StopIter | 79 |
| Time | 666 |
---------------------------------------
2019-12-06 17:35:50.559 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:35:50.560 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.49, Steps: 528, Distance 13.57, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.2, Angle accuracy 0.0, Num episodes 913
2019-12-06 17:35:50.895 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 378
2019-12-06 17:35:50.896 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 245.73, Steps: 379, Distance 6.66, Angular velocity 0.0, Speed: 2.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.21, Angle accuracy 0.0, Num episodes 914
2019-12-06 17:35:51.563 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 746
2019-12-06 17:35:51.563 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.28, Steps: 747, Distance 25.86, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 915
2019-12-06 17:35:52.206 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 692
2019-12-06 17:35:52.206 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.95, Steps: 693, Distance 22.64, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.92, Angle accuracy 0.0, Num episodes 916
2019-12-06 17:35:52.652 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 495
2019-12-06 17:35:52.652 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 308.69, Steps: 496, Distance 11.65, Angular velocity 0.0, Speed: 2.88, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.11, Angle accuracy 0.0, Num episodes 917
2019-12-06 17:35:53.373 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 808
2019-12-06 17:35:53.374 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.01, Steps: 809, Distance 30.1, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.82, Angle accuracy 0.0, Num episodes 918
Warning: trajectory cut off by epoch at 348 steps.
---------------------------------------
| Epoch | 176 |
| AverageEpRet | 354 |
| StdEpRet | 65.7 |
| MaxEpRet | 433 |
| MinEpRet | 246 |
| EpLen | 609 |
| AverageVVals | 48 |
| StdVVals | 6.84e-06 |
| MaxVVals | 48 |
| MinVVals | 48 |
| TotalEnvInteracts | 7.08e+05 |
| LossPi | -2.53e-08 |
| LossV | 293 |
| DeltaLossPi | -0.00185 |
| DeltaLossV | -1.23 |
| Entropy | -1.51 |
| KL | 0.0034 |
| ClipFrac | 0.0205 |
| StopIter | 79 |
| Time | 670 |
---------------------------------------
2019-12-06 17:35:54.543 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 792
2019-12-06 17:35:54.543 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.35, Steps: 793, Distance 28.78, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.81, Angle accuracy 0.0, Num episodes 919
2019-12-06 17:35:55.242 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 749
2019-12-06 17:35:55.243 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.48, Steps: 750, Distance 26.34, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.38, Angle accuracy 0.0, Num episodes 920
2019-12-06 17:35:55.840 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 672
2019-12-06 17:35:55.840 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.18, Steps: 673, Distance 21.56, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.79, Angle accuracy 0.0, Num episodes 921
2019-12-06 17:35:56.391 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 597
2019-12-06 17:35:56.392 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 368.83, Steps: 598, Distance 17.33, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.66, Angle accuracy 0.0, Num episodes 922
2019-12-06 17:35:56.983 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:35:56.984 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.6, Steps: 662, Distance 20.55, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.49, Angle accuracy 0.0, Num episodes 923
Warning: trajectory cut off by epoch at 524 steps.
---------------------------------------
| Epoch | 177 |
| AverageEpRet | 401 |
| StdEpRet | 21.5 |
| MaxEpRet | 430 |
| MinEpRet | 369 |
| EpLen | 695 |
| AverageVVals | 49.1 |
| StdVVals | 8.32e-06 |
| MaxVVals | 49.1 |
| MinVVals | 49.1 |
| TotalEnvInteracts | 7.12e+05 |
| LossPi | -4.82e-08 |
| LossV | 287 |
| DeltaLossPi | -0.000753 |
| DeltaLossV | -1.41 |
| Entropy | -1.53 |
| KL | 0.00106 |
| ClipFrac | 0.0108 |
| StopIter | 79 |
| Time | 674 |
---------------------------------------
2019-12-06 17:35:58.211 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 641
2019-12-06 17:35:58.211 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.83, Steps: 642, Distance 20.05, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.26, Angle accuracy 0.0, Num episodes 924
2019-12-06 17:35:58.692 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 529
2019-12-06 17:35:58.692 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.22, Steps: 530, Distance 13.74, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.23, Angle accuracy 0.0, Num episodes 925
2019-12-06 17:35:59.358 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 717
2019-12-06 17:35:59.358 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.83, Steps: 718, Distance 24.48, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 926
2019-12-06 17:35:59.840 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 542
2019-12-06 17:35:59.840 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.51, Steps: 543, Distance 14.59, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.68, Angle accuracy 0.0, Num episodes 927
2019-12-06 17:36:00.278 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 484
2019-12-06 17:36:00.278 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 300.59, Steps: 485, Distance 11.75, Angular velocity 0.0, Speed: 2.91, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.39, Angle accuracy 0.0, Num episodes 928
2019-12-06 17:36:00.960 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 778
2019-12-06 17:36:00.960 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.39, Steps: 779, Distance 28.27, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.59, Angle accuracy 0.0, Num episodes 929
Warning: trajectory cut off by epoch at 303 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 178 |
| AverageEpRet | 363 |
| StdEpRet | 43.3 |
| MaxEpRet | 417 |
| MinEpRet | 301 |
| EpLen | 616 |
| AverageVVals | 50.3 |
| StdVVals | 8.39e-06 |
| MaxVVals | 50.3 |
| MinVVals | 50.3 |
| TotalEnvInteracts | 7.16e+05 |
| LossPi | 1.67e-09 |
| LossV | 269 |
| DeltaLossPi | -0.000742 |
| DeltaLossV | -0.205 |
| Entropy | -1.51 |
| KL | 0.000727 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 677 |
---------------------------------------
2019-12-06 17:36:01.790 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 536
2019-12-06 17:36:01.791 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.41, Steps: 537, Distance 14.26, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.53, Angle accuracy 0.0, Num episodes 930
2019-12-06 17:36:02.514 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 795
2019-12-06 17:36:02.515 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.64, Steps: 796, Distance 29.57, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.85, Angle accuracy 0.0, Num episodes 931
2019-12-06 17:36:03.037 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 583
2019-12-06 17:36:03.037 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.93, Steps: 584, Distance 16.92, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.57, Angle accuracy 0.0, Num episodes 932
2019-12-06 17:36:03.646 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 680
2019-12-06 17:36:03.647 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 391.02, Steps: 681, Distance 22.06, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.72, Angle accuracy 0.0, Num episodes 933
2019-12-06 17:36:04.088 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 494
2019-12-06 17:36:04.088 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 306.87, Steps: 495, Distance 12.03, Angular velocity 0.0, Speed: 2.91, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.35, Angle accuracy 0.0, Num episodes 934
2019-12-06 17:36:04.733 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 720
2019-12-06 17:36:04.734 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.61, Steps: 721, Distance 24.85, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.16, Angle accuracy 0.0, Num episodes 935
Warning: trajectory cut off by epoch at 186 steps.
---------------------------------------
| Epoch | 179 |
| AverageEpRet | 368 |
| StdEpRet | 40.3 |
| MaxEpRet | 418 |
| MinEpRet | 307 |
| EpLen | 636 |
| AverageVVals | 49.9 |
| StdVVals | 6.97e-06 |
| MaxVVals | 49.9 |
| MinVVals | 49.9 |
| TotalEnvInteracts | 7.2e+05 |
| LossPi | -8.46e-09 |
| LossV | 293 |
| DeltaLossPi | -0.0016 |
| DeltaLossV | -1.31 |
| Entropy | -1.53 |
| KL | 0.000414 |
| ClipFrac | 0.0198 |
| StopIter | 79 |
| Time | 681 |
---------------------------------------
2019-12-06 17:36:05.737 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 757
2019-12-06 17:36:05.738 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.08, Steps: 758, Distance 27.01, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.58, Angle accuracy 0.0, Num episodes 936
2019-12-06 17:36:06.234 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:36:06.234 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.95, Steps: 557, Distance 15.27, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.05, Angle accuracy 0.0, Num episodes 937
2019-12-06 17:36:06.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 748
2019-12-06 17:36:06.903 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.1, Steps: 749, Distance 26.22, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.45, Angle accuracy 0.0, Num episodes 938
2019-12-06 17:36:07.429 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:36:07.430 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.56, Steps: 564, Distance 15.41, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.01, Angle accuracy 0.0, Num episodes 939
2019-12-06 17:36:08.080 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:36:08.080 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.86, Steps: 684, Distance 22.64, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.92, Angle accuracy 0.0, Num episodes 940
Warning: trajectory cut off by epoch at 688 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 180 |
| AverageEpRet | 383 |
| StdEpRet | 33.1 |
| MaxEpRet | 422 |
| MinEpRet | 339 |
| EpLen | 662 |
| AverageVVals | 48.7 |
| StdVVals | 8.21e-06 |
| MaxVVals | 48.7 |
| MinVVals | 48.7 |
| TotalEnvInteracts | 7.24e+05 |
| LossPi | 1.35e-08 |
| LossV | 283 |
| DeltaLossPi | -0.00124 |
| DeltaLossV | -1.39 |
| Entropy | -1.51 |
| KL | 0.00548 |
| ClipFrac | 0.037 |
| StopIter | 79 |
| Time | 685 |
---------------------------------------
2019-12-06 17:36:09.703 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 646
2019-12-06 17:36:09.703 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.74, Steps: 647, Distance 19.4, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.27, Angle accuracy 0.0, Num episodes 941
2019-12-06 17:36:10.049 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 391
2019-12-06 17:36:10.049 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 253.86, Steps: 392, Distance 7.35, Angular velocity 0.0, Speed: 2.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.22, Angle accuracy 0.0, Num episodes 942
2019-12-06 17:36:10.692 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:36:10.693 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.93, Steps: 729, Distance 24.55, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.17, Angle accuracy 0.0, Num episodes 943
2019-12-06 17:36:11.331 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:36:11.332 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.57, Steps: 726, Distance 24.6, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.27, Angle accuracy 0.0, Num episodes 944
2019-12-06 17:36:11.966 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:36:11.966 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.33, Steps: 700, Distance 23.34, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 945
2019-12-06 17:36:12.621 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:36:12.621 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.57, Steps: 729, Distance 24.77, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.14, Angle accuracy 0.0, Num episodes 946
Warning: trajectory cut off by epoch at 77 steps.
Early stopping at step 5 due to reaching max kl.
---------------------------------------
| Epoch | 181 |
| AverageEpRet | 378 |
| StdEpRet | 56.2 |
| MaxEpRet | 415 |
| MinEpRet | 254 |
| EpLen | 654 |
| AverageVVals | 49.9 |
| StdVVals | 4.98e-06 |
| MaxVVals | 49.9 |
| MinVVals | 49.9 |
| TotalEnvInteracts | 7.28e+05 |
| LossPi | -1.28e-08 |
| LossV | 326 |
| DeltaLossPi | -0.00312 |
| DeltaLossV | -1.83 |
| Entropy | -1.55 |
| KL | 0.0109 |
| ClipFrac | 0.0935 |
| StopIter | 5 |
| Time | 689 |
---------------------------------------
2019-12-06 17:36:13.345 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 648
2019-12-06 17:36:13.345 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.25, Steps: 649, Distance 19.97, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.35, Angle accuracy 0.0, Num episodes 947
2019-12-06 17:36:13.892 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:36:13.892 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 368.79, Steps: 615, Distance 18.58, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.99, Angle accuracy 0.0, Num episodes 948
2019-12-06 17:36:14.568 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 763
2019-12-06 17:36:14.569 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.3, Steps: 764, Distance 26.71, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 949
2019-12-06 17:36:15.298 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 820
2019-12-06 17:36:15.299 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.07, Steps: 821, Distance 30.71, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.97, Angle accuracy 0.0, Num episodes 950
2019-12-06 17:36:15.815 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 577
2019-12-06 17:36:15.816 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.79, Steps: 578, Distance 16.3, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.51, Angle accuracy 0.0, Num episodes 951
2019-12-06 17:36:16.223 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 456
2019-12-06 17:36:16.223 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.62, Steps: 457, Distance 10.23, Angular velocity 0.0, Speed: 2.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.42, Angle accuracy 0.0, Num episodes 952
Warning: trajectory cut off by epoch at 116 steps.
---------------------------------------
| Epoch | 182 |
| AverageEpRet | 371 |
| StdEpRet | 44.9 |
| MaxEpRet | 420 |
| MinEpRet | 285 |
| EpLen | 647 |
| AverageVVals | 48.6 |
| StdVVals | 1.05e-05 |
| MaxVVals | 48.6 |
| MinVVals | 48.6 |
| TotalEnvInteracts | 7.32e+05 |
| LossPi | 4.84e-08 |
| LossV | 342 |
| DeltaLossPi | -0.000931 |
| DeltaLossV | -0.244 |
| Entropy | -1.55 |
| KL | 0.00678 |
| ClipFrac | 0.0845 |
| StopIter | 79 |
| Time | 693 |
---------------------------------------
2019-12-06 17:36:17.028 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 625
2019-12-06 17:36:17.029 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.62, Steps: 626, Distance 19.26, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.22, Angle accuracy 0.0, Num episodes 953
2019-12-06 17:36:17.571 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:36:17.572 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.29, Steps: 609, Distance 17.91, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.95, Angle accuracy 0.0, Num episodes 954
2019-12-06 17:36:18.235 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 741
2019-12-06 17:36:18.235 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.12, Steps: 742, Distance 26.63, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.53, Angle accuracy 0.0, Num episodes 955
2019-12-06 17:36:18.918 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 755
2019-12-06 17:36:18.918 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.25, Steps: 756, Distance 27.35, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 956
2019-12-06 17:36:19.520 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 669
2019-12-06 17:36:19.521 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.07, Steps: 670, Distance 21.27, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.52, Angle accuracy 0.0, Num episodes 957
2019-12-06 17:36:20.025 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 564
2019-12-06 17:36:20.025 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 343.78, Steps: 565, Distance 15.75, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.17, Angle accuracy 0.0, Num episodes 958
Warning: trajectory cut off by epoch at 32 steps.
---------------------------------------
| Epoch | 183 |
| AverageEpRet | 385 |
| StdEpRet | 21.4 |
| MaxEpRet | 407 |
| MinEpRet | 344 |
| EpLen | 661 |
| AverageVVals | 48.1 |
| StdVVals | 6.9e-06 |
| MaxVVals | 48.1 |
| MinVVals | 48.1 |
| TotalEnvInteracts | 7.36e+05 |
| LossPi | -7.61e-08 |
| LossV | 354 |
| DeltaLossPi | -0.000989 |
| DeltaLossV | -0.707 |
| Entropy | -1.56 |
| KL | 0.000734 |
| ClipFrac | 0.026 |
| StopIter | 79 |
| Time | 696 |
---------------------------------------
2019-12-06 17:36:20.929 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 816
2019-12-06 17:36:20.929 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.38, Steps: 817, Distance 30.18, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.81, Angle accuracy 0.0, Num episodes 959
2019-12-06 17:36:21.378 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 504
2019-12-06 17:36:21.378 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 324.07, Steps: 505, Distance 12.61, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.86, Angle accuracy 0.0, Num episodes 960
2019-12-06 17:36:22.042 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 744
2019-12-06 17:36:22.043 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.47, Steps: 745, Distance 26.17, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.47, Angle accuracy 0.0, Num episodes 961
2019-12-06 17:36:22.507 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:36:22.508 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.47, Steps: 520, Distance 13.08, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.18, Angle accuracy 0.0, Num episodes 962
2019-12-06 17:36:23.056 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 611
2019-12-06 17:36:23.056 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.55, Steps: 612, Distance 18.44, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.05, Angle accuracy 0.0, Num episodes 963
2019-12-06 17:36:23.708 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:36:23.708 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.2, Steps: 730, Distance 25.11, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.38, Angle accuracy 0.0, Num episodes 964
Warning: trajectory cut off by epoch at 71 steps.
---------------------------------------
| Epoch | 184 |
| AverageEpRet | 382 |
| StdEpRet | 39.6 |
| MaxEpRet | 430 |
| MinEpRet | 324 |
| EpLen | 655 |
| AverageVVals | 48.9 |
| StdVVals | 7.56e-06 |
| MaxVVals | 48.9 |
| MinVVals | 48.9 |
| TotalEnvInteracts | 7.4e+05 |
| LossPi | -5.29e-08 |
| LossV | 355 |
| DeltaLossPi | -0.000479 |
| DeltaLossV | -0.0072 |
| Entropy | -1.58 |
| KL | 0.000639 |
| ClipFrac | 0.0035 |
| StopIter | 79 |
| Time | 700 |
---------------------------------------
2019-12-06 17:36:24.470 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:36:24.471 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.69, Steps: 625, Distance 18.58, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.16, Angle accuracy 0.0, Num episodes 965
2019-12-06 17:36:24.972 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 567
2019-12-06 17:36:24.972 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.11, Steps: 568, Distance 16.03, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.21, Angle accuracy 0.0, Num episodes 966
2019-12-06 17:36:25.420 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 485
2019-12-06 17:36:25.420 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 303.39, Steps: 486, Distance 11.24, Angular velocity 0.0, Speed: 2.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.15, Angle accuracy 0.0, Num episodes 967
2019-12-06 17:36:25.927 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 552
2019-12-06 17:36:25.927 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.51, Steps: 553, Distance 15.01, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.9, Angle accuracy 0.0, Num episodes 968
2019-12-06 17:36:26.635 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 793
2019-12-06 17:36:26.635 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.72, Steps: 794, Distance 29.18, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.78, Angle accuracy 0.0, Num episodes 969
2019-12-06 17:36:27.142 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 572
2019-12-06 17:36:27.142 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.35, Steps: 573, Distance 15.82, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.33, Angle accuracy 0.0, Num episodes 970
Warning: trajectory cut off by epoch at 401 steps.
---------------------------------------
| Epoch | 185 |
| AverageEpRet | 362 |
| StdEpRet | 36.6 |
| MaxEpRet | 425 |
| MinEpRet | 303 |
| EpLen | 600 |
| AverageVVals | 49 |
| StdVVals | 7.24e-06 |
| MaxVVals | 49 |
| MinVVals | 49 |
| TotalEnvInteracts | 7.44e+05 |
| LossPi | -7.87e-09 |
| LossV | 312 |
| DeltaLossPi | -0.00231 |
| DeltaLossV | -4.12 |
| Entropy | -1.57 |
| KL | 0.00521 |
| ClipFrac | 0.028 |
| StopIter | 79 |
| Time | 704 |
---------------------------------------
2019-12-06 17:36:28.229 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:36:28.229 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.6, Steps: 660, Distance 21.05, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.63, Angle accuracy 0.0, Num episodes 971
2019-12-06 17:36:28.658 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 486
2019-12-06 17:36:28.659 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 310.45, Steps: 487, Distance 11.9, Angular velocity 0.0, Speed: 2.91, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.29, Angle accuracy 0.0, Num episodes 972
2019-12-06 17:36:29.340 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:36:29.340 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.74, Steps: 762, Distance 27.38, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.56, Angle accuracy 0.0, Num episodes 973
2019-12-06 17:36:29.897 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 632
2019-12-06 17:36:29.898 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.71, Steps: 633, Distance 19.9, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.45, Angle accuracy 0.0, Num episodes 974
2019-12-06 17:36:30.252 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 368
2019-12-06 17:36:30.252 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 232.28, Steps: 369, Distance 6.64, Angular velocity 0.0, Speed: 2.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.24, Angle accuracy 0.0, Num episodes 975
2019-12-06 17:36:30.713 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 515
2019-12-06 17:36:30.713 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 331.53, Steps: 516, Distance 13.32, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.3, Angle accuracy 0.0, Num episodes 976
2019-12-06 17:36:31.092 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 426
2019-12-06 17:36:31.092 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 283.31, Steps: 427, Distance 9.14, Angular velocity 0.0, Speed: 2.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.36, Angle accuracy 0.0, Num episodes 977
Warning: trajectory cut off by epoch at 146 steps.
---------------------------------------
| Epoch | 186 |
| AverageEpRet | 336 |
| StdEpRet | 61.4 |
| MaxEpRet | 415 |
| MinEpRet | 232 |
| EpLen | 551 |
| AverageVVals | 51 |
| StdVVals | 6.33e-06 |
| MaxVVals | 51 |
| MinVVals | 51 |
| TotalEnvInteracts | 7.48e+05 |
| LossPi | 4.89e-08 |
| LossV | 313 |
| DeltaLossPi | -0.00133 |
| DeltaLossV | -0.941 |
| Entropy | -1.6 |
| KL | 0.000888 |
| ClipFrac | 0.008 |
| StopIter | 79 |
| Time | 707 |
---------------------------------------
2019-12-06 17:36:31.752 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 438
2019-12-06 17:36:31.752 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.21, Steps: 439, Distance 9.77, Angular velocity 0.0, Speed: 2.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.81, Angle accuracy 0.0, Num episodes 978
2019-12-06 17:36:32.414 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 744
2019-12-06 17:36:32.414 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.66, Steps: 745, Distance 26.45, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.44, Angle accuracy 0.0, Num episodes 979
2019-12-06 17:36:33.017 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 686
2019-12-06 17:36:33.017 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.36, Steps: 687, Distance 22.95, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.83, Angle accuracy 0.0, Num episodes 980
2019-12-06 17:36:33.588 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:36:33.588 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 388.8, Steps: 646, Distance 20.55, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.39, Angle accuracy 0.0, Num episodes 981
2019-12-06 17:36:33.951 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 409
2019-12-06 17:36:33.952 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 273.82, Steps: 410, Distance 8.45, Angular velocity 0.0, Speed: 2.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.77, Angle accuracy 0.0, Num episodes 982
2019-12-06 17:36:34.551 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 651
2019-12-06 17:36:34.552 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 387.64, Steps: 652, Distance 20.64, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.44, Angle accuracy 0.0, Num episodes 983
Warning: trajectory cut off by epoch at 421 steps.
---------------------------------------
| Epoch | 187 |
| AverageEpRet | 358 |
| StdEpRet | 55.5 |
| MaxEpRet | 414 |
| MinEpRet | 274 |
| EpLen | 596 |
| AverageVVals | 50.1 |
| StdVVals | 6.4e-06 |
| MaxVVals | 50.1 |
| MinVVals | 50.1 |
| TotalEnvInteracts | 7.52e+05 |
| LossPi | -1.61e-08 |
| LossV | 321 |
| DeltaLossPi | -0.00192 |
| DeltaLossV | -0.239 |
| Entropy | -1.61 |
| KL | 0.00174 |
| ClipFrac | 0.0148 |
| StopIter | 79 |
| Time | 711 |
---------------------------------------
2019-12-06 17:36:35.384 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 323
2019-12-06 17:36:35.385 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 208.85, Steps: 324, Distance 5.21, Angular velocity 0.0, Speed: 1.96, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 84.23, Angle accuracy 0.0, Num episodes 984
2019-12-06 17:36:36.060 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 755
2019-12-06 17:36:36.061 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.67, Steps: 756, Distance 27.27, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 985
2019-12-06 17:36:36.326 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 296
2019-12-06 17:36:36.327 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 192.52, Steps: 297, Distance 4.34, Angular velocity 0.0, Speed: 1.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 81.43, Angle accuracy 0.0, Num episodes 986
2019-12-06 17:36:36.936 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 670
2019-12-06 17:36:36.936 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.23, Steps: 671, Distance 21.6, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.8, Angle accuracy 0.0, Num episodes 987
2019-12-06 17:36:37.557 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 651
2019-12-06 17:36:37.557 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.13, Steps: 652, Distance 21.08, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.64, Angle accuracy 0.0, Num episodes 988
2019-12-06 17:36:38.269 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 802
2019-12-06 17:36:38.270 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.84, Steps: 803, Distance 30.18, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.9, Angle accuracy 0.0, Num episodes 989
Warning: trajectory cut off by epoch at 497 steps.
---------------------------------------
| Epoch | 188 |
| AverageEpRet | 334 |
| StdEpRet | 95 |
| MaxEpRet | 417 |
| MinEpRet | 193 |
| EpLen | 584 |
| AverageVVals | 50.5 |
| StdVVals | 4.62e-06 |
| MaxVVals | 50.5 |
| MinVVals | 50.5 |
| TotalEnvInteracts | 7.56e+05 |
| LossPi | 5.92e-08 |
| LossV | 370 |
| DeltaLossPi | -0.00124 |
| DeltaLossV | -4.82 |
| Entropy | -1.61 |
| KL | 0.00226 |
| ClipFrac | 0.0103 |
| StopIter | 79 |
| Time | 715 |
---------------------------------------
2019-12-06 17:36:39.384 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 568
2019-12-06 17:36:39.384 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 360.24, Steps: 569, Distance 16.49, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.3, Angle accuracy 0.0, Num episodes 990
2019-12-06 17:36:39.795 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 463
2019-12-06 17:36:39.795 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 294.9, Steps: 464, Distance 11.11, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 91.91, Angle accuracy 0.0, Num episodes 991
2019-12-06 17:36:40.395 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 680
2019-12-06 17:36:40.395 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.39, Steps: 681, Distance 22.98, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.99, Angle accuracy 0.0, Num episodes 992
2019-12-06 17:36:40.981 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:36:40.981 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 388.07, Steps: 651, Distance 21.18, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.64, Angle accuracy 0.0, Num episodes 993
2019-12-06 17:36:41.440 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 522
2019-12-06 17:36:41.441 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 332.78, Steps: 523, Distance 14.0, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.53, Angle accuracy 0.0, Num episodes 994
2019-12-06 17:36:41.723 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 320
2019-12-06 17:36:41.724 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 209.9, Steps: 321, Distance 5.27, Angular velocity 0.0, Speed: 1.99, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.23, Angle accuracy 0.0, Num episodes 995
2019-12-06 17:36:42.192 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 521
2019-12-06 17:36:42.192 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 332.64, Steps: 522, Distance 14.08, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.62, Angle accuracy 0.0, Num episodes 996
Warning: trajectory cut off by epoch at 269 steps.
---------------------------------------
| Epoch | 189 |
| AverageEpRet | 328 |
| StdEpRet | 56.2 |
| MaxEpRet | 388 |
| MinEpRet | 210 |
| EpLen | 533 |
| AverageVVals | 48.3 |
| StdVVals | 2.82e-06 |
| MaxVVals | 48.3 |
| MinVVals | 48.3 |
| TotalEnvInteracts | 7.6e+05 |
| LossPi | 2.03e-08 |
| LossV | 305 |
| DeltaLossPi | -0.000695 |
| DeltaLossV | -4.25 |
| Entropy | -1.59 |
| KL | 0.000181 |
| ClipFrac | 0.00075 |
| StopIter | 79 |
| Time | 719 |
---------------------------------------
2019-12-06 17:36:43.260 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 764
2019-12-06 17:36:43.260 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.34, Steps: 765, Distance 28.02, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.71, Angle accuracy 0.0, Num episodes 997
2019-12-06 17:36:43.873 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 666
2019-12-06 17:36:43.873 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.09, Steps: 667, Distance 21.82, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.77, Angle accuracy 0.0, Num episodes 998
2019-12-06 17:36:44.284 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 461
2019-12-06 17:36:44.284 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 298.97, Steps: 462, Distance 11.17, Angular velocity 0.0, Speed: 2.88, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 91.91, Angle accuracy 0.0, Num episodes 999
2019-12-06 17:36:44.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 414
2019-12-06 17:36:44.655 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 272.29, Steps: 415, Distance 8.96, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 90.21, Angle accuracy 0.0, Num episodes 1000
2019-12-06 17:36:44.919 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 290
2019-12-06 17:36:44.919 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 193.22, Steps: 291, Distance 4.33, Angular velocity 0.0, Speed: 1.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 81.36, Angle accuracy 0.0, Num episodes 1001
2019-12-06 17:36:45.545 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:36:45.545 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.06, Steps: 697, Distance 24.18, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.22, Angle accuracy 0.0, Num episodes 1002
2019-12-06 17:36:46.004 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 504
2019-12-06 17:36:46.005 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.63, Steps: 505, Distance 13.21, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.05, Angle accuracy 0.0, Num episodes 1003
Warning: trajectory cut off by epoch at 198 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 190 |
| AverageEpRet | 327 |
| StdEpRet | 72.4 |
| MaxEpRet | 406 |
| MinEpRet | 193 |
| EpLen | 543 |
| AverageVVals | 50.4 |
| StdVVals | 7.26e-06 |
| MaxVVals | 50.4 |
| MinVVals | 50.4 |
| TotalEnvInteracts | 7.64e+05 |
| LossPi | -1.83e-08 |
| LossV | 349 |
| DeltaLossPi | -0.00323 |
| DeltaLossV | -1.5 |
| Entropy | -1.61 |
| KL | 0.00276 |
| ClipFrac | 0.0465 |
| StopIter | 79 |
| Time | 723 |
---------------------------------------
2019-12-06 17:36:47.253 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 712
2019-12-06 17:36:47.254 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.63, Steps: 713, Distance 25.1, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.3, Angle accuracy 0.0, Num episodes 1004
2019-12-06 17:36:47.806 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:36:47.806 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.18, Steps: 600, Distance 18.26, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.08, Angle accuracy 0.0, Num episodes 1005
2019-12-06 17:36:48.440 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 710
2019-12-06 17:36:48.440 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.25, Steps: 711, Distance 25.04, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 1006
2019-12-06 17:36:48.972 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 577
2019-12-06 17:36:48.973 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.32, Steps: 578, Distance 17.22, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.71, Angle accuracy 0.0, Num episodes 1007
2019-12-06 17:36:49.613 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:36:49.614 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.38, Steps: 729, Distance 26.28, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.53, Angle accuracy 0.0, Num episodes 1008
2019-12-06 17:36:50.049 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 484
2019-12-06 17:36:50.049 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.24, Steps: 485, Distance 12.14, Angular velocity 0.0, Speed: 2.93, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.56, Angle accuracy 0.0, Num episodes 1009
Warning: trajectory cut off by epoch at 184 steps.
---------------------------------------
| Epoch | 191 |
| AverageEpRet | 379 |
| StdEpRet | 35.3 |
| MaxEpRet | 411 |
| MinEpRet | 314 |
| EpLen | 636 |
| AverageVVals | 49.2 |
| StdVVals | 7.46e-06 |
| MaxVVals | 49.2 |
| MinVVals | 49.2 |
| TotalEnvInteracts | 7.68e+05 |
| LossPi | -7.63e-09 |
| LossV | 377 |
| DeltaLossPi | -0.0013 |
| DeltaLossV | -0.588 |
| Entropy | -1.66 |
| KL | 0.00159 |
| ClipFrac | 0.039 |
| StopIter | 79 |
| Time | 726 |
---------------------------------------
2019-12-06 17:36:50.937 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:36:50.937 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.05, Steps: 629, Distance 20.45, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.34, Angle accuracy 0.0, Num episodes 1010
2019-12-06 17:36:51.582 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:36:51.583 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.15, Steps: 697, Distance 24.47, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.18, Angle accuracy 0.0, Num episodes 1011
2019-12-06 17:36:51.893 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 349
2019-12-06 17:36:51.894 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 236.93, Steps: 350, Distance 6.54, Angular velocity 0.0, Speed: 2.23, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 87.06, Angle accuracy 0.0, Num episodes 1012
2019-12-06 17:36:52.567 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 748
2019-12-06 17:36:52.568 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.12, Steps: 749, Distance 27.39, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.53, Angle accuracy 0.0, Num episodes 1013
2019-12-06 17:36:52.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 375
2019-12-06 17:36:52.902 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 256.48, Steps: 376, Distance 7.51, Angular velocity 0.0, Speed: 2.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.29, Angle accuracy 0.0, Num episodes 1014
2019-12-06 17:36:53.541 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 722
2019-12-06 17:36:53.541 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.09, Steps: 723, Distance 25.94, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.48, Angle accuracy 0.0, Num episodes 1015
2019-12-06 17:36:53.857 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 354
2019-12-06 17:36:53.857 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 242.27, Steps: 355, Distance 6.57, Angular velocity 0.0, Speed: 2.23, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 86.9, Angle accuracy 0.0, Num episodes 1016
Warning: trajectory cut off by epoch at 121 steps.
Early stopping at step 16 due to reaching max kl.
---------------------------------------
| Epoch | 192 |
| AverageEpRet | 333 |
| StdEpRet | 77.3 |
| MaxEpRet | 417 |
| MinEpRet | 237 |
| EpLen | 554 |
| AverageVVals | 50 |
| StdVVals | 4.36e-06 |
| MaxVVals | 50 |
| MinVVals | 50 |
| TotalEnvInteracts | 7.72e+05 |
| LossPi | 2.34e-08 |
| LossV | 381 |
| DeltaLossPi | -0.000533 |
| DeltaLossV | -0.683 |
| Entropy | -1.68 |
| KL | 0.0017 |
| ClipFrac | 0.00025 |
| StopIter | 16 |
| Time | 730 |
---------------------------------------
2019-12-06 17:36:54.509 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:36:54.509 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.12, Steps: 503, Distance 13.18, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.27, Angle accuracy 0.0, Num episodes 1017
2019-12-06 17:36:54.773 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 294
2019-12-06 17:36:54.774 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 200.38, Steps: 295, Distance 4.7, Angular velocity 0.0, Speed: 1.92, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 82.64, Angle accuracy 0.0, Num episodes 1018
2019-12-06 17:36:55.345 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 627
2019-12-06 17:36:55.345 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 374.14, Steps: 628, Distance 20.23, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.32, Angle accuracy 0.0, Num episodes 1019
2019-12-06 17:36:55.792 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 503
2019-12-06 17:36:55.792 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.44, Steps: 504, Distance 13.6, Angular velocity 0.0, Speed: 3.11, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.41, Angle accuracy 0.0, Num episodes 1020
2019-12-06 17:36:56.464 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 743
2019-12-06 17:36:56.464 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.68, Steps: 744, Distance 27.37, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.53, Angle accuracy 0.0, Num episodes 1021
2019-12-06 17:36:56.906 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:36:56.907 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.92, Steps: 503, Distance 13.18, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.22, Angle accuracy 0.0, Num episodes 1022
2019-12-06 17:36:57.601 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 766
2019-12-06 17:36:57.602 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.95, Steps: 767, Distance 28.44, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.67, Angle accuracy 0.0, Num episodes 1023
Warning: trajectory cut off by epoch at 56 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 193 |
| AverageEpRet | 342 |
| StdEpRet | 68.4 |
| MaxEpRet | 424 |
| MinEpRet | 200 |
| EpLen | 563 |
| AverageVVals | 49.1 |
| StdVVals | 7.31e-06 |
| MaxVVals | 49.1 |
| MinVVals | 49.1 |
| TotalEnvInteracts | 7.76e+05 |
| LossPi | -3.04e-08 |
| LossV | 391 |
| DeltaLossPi | -0.00014 |
| DeltaLossV | -0.127 |
| Entropy | -1.67 |
| KL | 0.00632 |
| ClipFrac | 0.034 |
| StopIter | 1 |
| Time | 734 |
---------------------------------------
2019-12-06 17:36:58.263 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:36:58.263 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 371.41, Steps: 603, Distance 19.11, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1024
2019-12-06 17:36:58.842 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 653
2019-12-06 17:36:58.843 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.95, Steps: 654, Distance 22.19, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.71, Angle accuracy 0.0, Num episodes 1025
2019-12-06 17:36:59.240 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 442
2019-12-06 17:36:59.241 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 293.78, Steps: 443, Distance 10.74, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 91.83, Angle accuracy 0.0, Num episodes 1026
2019-12-06 17:36:59.918 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 714
2019-12-06 17:36:59.919 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.3, Steps: 715, Distance 26.08, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1027
2019-12-06 17:37:00.490 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 647
2019-12-06 17:37:00.491 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.07, Steps: 648, Distance 21.94, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.87, Angle accuracy 0.0, Num episodes 1028
2019-12-06 17:37:01.158 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:37:01.158 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.09, Steps: 746, Distance 27.8, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 1029
Warning: trajectory cut off by epoch at 191 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 194 |
| AverageEpRet | 374 |
| StdEpRet | 38.8 |
| MaxEpRet | 418 |
| MinEpRet | 294 |
| EpLen | 635 |
| AverageVVals | 49.5 |
| StdVVals | 7.23e-06 |
| MaxVVals | 49.5 |
| MinVVals | 49.5 |
| TotalEnvInteracts | 7.8e+05 |
| LossPi | 5.25e-09 |
| LossV | 405 |
| DeltaLossPi | -0.000223 |
| DeltaLossV | -0.00104 |
| Entropy | -1.67 |
| KL | 0.000435 |
| ClipFrac | 0 |
| StopIter | 3 |
| Time | 738 |
---------------------------------------
2019-12-06 17:37:01.947 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 526
2019-12-06 17:37:01.948 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 347.8, Steps: 527, Distance 14.88, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.97, Angle accuracy 0.0, Num episodes 1030
2019-12-06 17:37:02.540 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:37:02.541 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.94, Steps: 646, Distance 21.86, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.68, Angle accuracy 0.0, Num episodes 1031
2019-12-06 17:37:03.068 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:37:03.069 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.58, Steps: 586, Distance 18.21, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.81, Angle accuracy 0.0, Num episodes 1032
2019-12-06 17:37:03.729 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:37:03.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.81, Steps: 714, Distance 25.66, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 1033
2019-12-06 17:37:04.259 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:37:04.260 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.81, Steps: 596, Distance 18.55, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.9, Angle accuracy 0.0, Num episodes 1034
2019-12-06 17:37:04.727 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:37:04.727 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.01, Steps: 503, Distance 13.87, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.35, Angle accuracy 0.0, Num episodes 1035
Warning: trajectory cut off by epoch at 428 steps.
---------------------------------------
| Epoch | 195 |
| AverageEpRet | 367 |
| StdEpRet | 27.9 |
| MaxEpRet | 410 |
| MinEpRet | 322 |
| EpLen | 595 |
| AverageVVals | 49.4 |
| StdVVals | 5.14e-06 |
| MaxVVals | 49.4 |
| MinVVals | 49.4 |
| TotalEnvInteracts | 7.84e+05 |
| LossPi | -4.53e-09 |
| LossV | 359 |
| DeltaLossPi | -0.000912 |
| DeltaLossV | -6.9 |
| Entropy | -1.69 |
| KL | 0.000256 |
| ClipFrac | 0.0045 |
| StopIter | 79 |
| Time | 741 |
---------------------------------------
2019-12-06 17:37:05.951 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 770
2019-12-06 17:37:05.951 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.98, Steps: 771, Distance 29.3, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.89, Angle accuracy 0.0, Num episodes 1036
2019-12-06 17:37:06.428 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 532
2019-12-06 17:37:06.428 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.82, Steps: 533, Distance 15.43, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.09, Angle accuracy 0.0, Num episodes 1037
2019-12-06 17:37:07.100 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 750
2019-12-06 17:37:07.101 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.83, Steps: 751, Distance 28.18, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.64, Angle accuracy 0.0, Num episodes 1038
2019-12-06 17:37:07.746 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 711
2019-12-06 17:37:07.747 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.39, Steps: 712, Distance 25.88, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 1039
2019-12-06 17:37:08.115 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 409
2019-12-06 17:37:08.115 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.65, Steps: 410, Distance 9.22, Angular velocity 0.0, Speed: 2.7, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 90.42, Angle accuracy 0.0, Num episodes 1040
2019-12-06 17:37:08.663 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 601
2019-12-06 17:37:08.664 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.24, Steps: 602, Distance 19.23, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.26, Angle accuracy 0.0, Num episodes 1041
Warning: trajectory cut off by epoch at 221 steps.
---------------------------------------
| Epoch | 196 |
| AverageEpRet | 371 |
| StdEpRet | 49.4 |
| MaxEpRet | 431 |
| MinEpRet | 283 |
| EpLen | 630 |
| AverageVVals | 52.1 |
| StdVVals | 3.91e-06 |
| MaxVVals | 52.1 |
| MinVVals | 52.1 |
| TotalEnvInteracts | 7.88e+05 |
| LossPi | 8.15e-08 |
| LossV | 416 |
| DeltaLossPi | -0.00104 |
| DeltaLossV | -6.4 |
| Entropy | -1.7 |
| KL | 0.00262 |
| ClipFrac | 0.0105 |
| StopIter | 79 |
| Time | 745 |
---------------------------------------
2019-12-06 17:37:09.583 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:37:09.583 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.46, Steps: 636, Distance 21.26, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.63, Angle accuracy 0.0, Num episodes 1042
2019-12-06 17:37:10.250 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 753
2019-12-06 17:37:10.251 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.79, Steps: 754, Distance 28.53, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.68, Angle accuracy 0.0, Num episodes 1043
2019-12-06 17:37:10.801 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:37:10.802 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.12, Steps: 608, Distance 19.35, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.12, Angle accuracy 0.0, Num episodes 1044
2019-12-06 17:37:11.393 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 658
2019-12-06 17:37:11.394 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.66, Steps: 659, Distance 22.45, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1045
2019-12-06 17:37:11.813 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 475
2019-12-06 17:37:11.814 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 318.52, Steps: 476, Distance 12.52, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.88, Angle accuracy 0.0, Num episodes 1046
2019-12-06 17:37:12.443 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 682
2019-12-06 17:37:12.444 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.1, Steps: 683, Distance 23.82, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.0, Angle accuracy 0.0, Num episodes 1047
Warning: trajectory cut off by epoch at 184 steps.
Early stopping at step 16 due to reaching max kl.
---------------------------------------
| Epoch | 197 |
| AverageEpRet | 383 |
| StdEpRet | 31.3 |
| MaxEpRet | 409 |
| MinEpRet | 319 |
| EpLen | 636 |
| AverageVVals | 49.5 |
| StdVVals | 7.17e-06 |
| MaxVVals | 49.5 |
| MinVVals | 49.5 |
| TotalEnvInteracts | 7.92e+05 |
| LossPi | -1.34e-08 |
| LossV | 393 |
| DeltaLossPi | -0.0011 |
| DeltaLossV | -0.982 |
| Entropy | -1.71 |
| KL | 0.000323 |
| ClipFrac | 0.0253 |
| StopIter | 16 |
| Time | 749 |
---------------------------------------
2019-12-06 17:37:13.318 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:37:13.319 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.19, Steps: 690, Distance 24.62, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 1048
2019-12-06 17:37:13.992 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 751
2019-12-06 17:37:13.993 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.04, Steps: 752, Distance 28.82, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.81, Angle accuracy 0.0, Num episodes 1049
2019-12-06 17:37:14.488 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 550
2019-12-06 17:37:14.488 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.16, Steps: 551, Distance 16.45, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.36, Angle accuracy 0.0, Num episodes 1050
2019-12-06 17:37:15.136 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 719
2019-12-06 17:37:15.137 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.18, Steps: 720, Distance 26.36, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.48, Angle accuracy 0.0, Num episodes 1051
2019-12-06 17:37:15.780 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 710
2019-12-06 17:37:15.780 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.59, Steps: 711, Distance 26.16, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.37, Angle accuracy 0.0, Num episodes 1052
Warning: trajectory cut off by epoch at 576 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 198 |
| AverageEpRet | 394 |
| StdEpRet | 17 |
| MaxEpRet | 407 |
| MinEpRet | 362 |
| EpLen | 685 |
| AverageVVals | 50.5 |
| StdVVals | 9.11e-06 |
| MaxVVals | 50.5 |
| MinVVals | 50.5 |
| TotalEnvInteracts | 7.96e+05 |
| LossPi | -7.75e-09 |
| LossV | 415 |
| DeltaLossPi | 0.000614 |
| DeltaLossV | -0.195 |
| Entropy | -1.71 |
| KL | 0.00198 |
| ClipFrac | 0.0075 |
| StopIter | 1 |
| Time | 753 |
---------------------------------------
2019-12-06 17:37:16.850 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 478
2019-12-06 17:37:16.850 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 304.24, Steps: 479, Distance 12.38, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.66, Angle accuracy 0.0, Num episodes 1053
2019-12-06 17:37:17.471 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 690
2019-12-06 17:37:17.471 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.49, Steps: 691, Distance 24.49, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 1054
2019-12-06 17:37:17.781 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 348
2019-12-06 17:37:17.781 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 235.57, Steps: 349, Distance 6.62, Angular velocity 0.0, Speed: 2.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.25, Angle accuracy 0.0, Num episodes 1055
2019-12-06 17:37:18.189 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 435
2019-12-06 17:37:18.189 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 303.92, Steps: 436, Distance 10.5, Angular velocity 0.0, Speed: 2.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.65, Angle accuracy 0.0, Num episodes 1056
2019-12-06 17:37:18.817 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:37:18.818 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.25, Steps: 705, Distance 25.63, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 1057
2019-12-06 17:37:19.530 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 778
2019-12-06 17:37:19.530 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.88, Steps: 779, Distance 30.13, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.08, Avg gforce: 0.03, Trip pct 96.83, Angle accuracy 0.0, Num episodes 1058
Warning: trajectory cut off by epoch at 561 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 199 |
| AverageEpRet | 339 |
| StdEpRet | 62.1 |
| MaxEpRet | 402 |
| MinEpRet | 236 |
| EpLen | 573 |
| AverageVVals | 50.1 |
| StdVVals | 5.63e-06 |
| MaxVVals | 50.1 |
| MinVVals | 50.1 |
| TotalEnvInteracts | 8e+05 |
| LossPi | 9.42e-09 |
| LossV | 369 |
| DeltaLossPi | 0.000128 |
| DeltaLossV | -0.0294 |
| Entropy | -1.7 |
| KL | 0.00071 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 756 |
---------------------------------------
2019-12-06 17:37:20.681 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 644
2019-12-06 17:37:20.682 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 388.26, Steps: 645, Distance 21.48, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.65, Angle accuracy 0.0, Num episodes 1059
2019-12-06 17:37:21.177 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:37:21.177 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.6, Steps: 545, Distance 16.19, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.27, Angle accuracy 0.0, Num episodes 1060
2019-12-06 17:37:21.725 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:37:21.725 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.46, Steps: 603, Distance 19.19, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.23, Angle accuracy 0.0, Num episodes 1061
2019-12-06 17:37:22.402 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 752
2019-12-06 17:37:22.402 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.71, Steps: 753, Distance 28.4, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.71, Angle accuracy 0.0, Num episodes 1062
2019-12-06 17:37:22.965 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:37:22.965 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.24, Steps: 630, Distance 20.91, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.57, Angle accuracy 0.0, Num episodes 1063
2019-12-06 17:37:23.411 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 489
2019-12-06 17:37:23.412 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.06, Steps: 490, Distance 12.98, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.91, Angle accuracy 0.0, Num episodes 1064
Warning: trajectory cut off by epoch at 334 steps.
Warning: could not pickle state_dict.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 200 |
| AverageEpRet | 372 |
| StdEpRet | 25.3 |
| MaxEpRet | 406 |
| MinEpRet | 329 |
| EpLen | 611 |
| AverageVVals | 49.9 |
| StdVVals | 7.2e-06 |
| MaxVVals | 49.9 |
| MinVVals | 49.9 |
| TotalEnvInteracts | 8.04e+05 |
| LossPi | 1.86e-08 |
| LossV | 391 |
| DeltaLossPi | 0.000712 |
| DeltaLossV | -2.3 |
| Entropy | -1.69 |
| KL | 0.00213 |
| ClipFrac | 0.0145 |
| StopIter | 1 |
| Time | 760 |
---------------------------------------
2019-12-06 17:37:24.362 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 334
2019-12-06 17:37:24.363 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 222.31, Steps: 335, Distance 6.05, Angular velocity 0.0, Speed: 2.18, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 86.08, Angle accuracy 0.0, Num episodes 1065
2019-12-06 17:37:24.878 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:37:24.878 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.26, Steps: 587, Distance 18.2, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.85, Angle accuracy 0.0, Num episodes 1066
2019-12-06 17:37:25.161 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 316
2019-12-06 17:37:25.162 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 204.94, Steps: 317, Distance 5.49, Angular velocity 0.0, Speed: 2.08, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.99, Angle accuracy 0.0, Num episodes 1067
2019-12-06 17:37:25.690 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 593
2019-12-06 17:37:25.690 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.07, Steps: 594, Distance 18.44, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.04, Angle accuracy 0.0, Num episodes 1068
2019-12-06 17:37:26.298 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 678
2019-12-06 17:37:26.299 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.53, Steps: 679, Distance 23.7, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.96, Angle accuracy 0.0, Num episodes 1069
2019-12-06 17:37:26.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 409
2019-12-06 17:37:26.656 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.65, Steps: 410, Distance 9.04, Angular velocity 0.0, Speed: 2.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.1, Angle accuracy 0.0, Num episodes 1070
2019-12-06 17:37:27.278 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 700
2019-12-06 17:37:27.278 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.33, Steps: 701, Distance 25.1, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.28, Angle accuracy 0.0, Num episodes 1071
Warning: trajectory cut off by epoch at 377 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 201 |
| AverageEpRet | 319 |
| StdEpRet | 75.9 |
| MaxEpRet | 397 |
| MinEpRet | 205 |
| EpLen | 518 |
| AverageVVals | 51.5 |
| StdVVals | 7.1e-06 |
| MaxVVals | 51.5 |
| MinVVals | 51.5 |
| TotalEnvInteracts | 8.08e+05 |
| LossPi | -3.93e-08 |
| LossV | 375 |
| DeltaLossPi | 0.000221 |
| DeltaLossV | -0.237 |
| Entropy | -1.7 |
| KL | 0.00831 |
| ClipFrac | 0.0772 |
| StopIter | 3 |
| Time | 764 |
---------------------------------------
2019-12-06 17:37:28.306 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 708
2019-12-06 17:37:28.306 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.11, Steps: 709, Distance 25.91, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.42, Angle accuracy 0.0, Num episodes 1072
2019-12-06 17:37:28.783 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 530
2019-12-06 17:37:28.783 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 353.16, Steps: 531, Distance 15.43, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.15, Angle accuracy 0.0, Num episodes 1073
2019-12-06 17:37:29.470 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:37:29.470 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.74, Steps: 763, Distance 29.1, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.75, Angle accuracy 0.0, Num episodes 1074
2019-12-06 17:37:29.994 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 580
2019-12-06 17:37:29.994 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.2, Steps: 581, Distance 18.13, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.82, Angle accuracy 0.0, Num episodes 1075
2019-12-06 17:37:30.612 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 668
2019-12-06 17:37:30.612 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.56, Steps: 669, Distance 23.15, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.93, Angle accuracy 0.0, Num episodes 1076
2019-12-06 17:37:30.907 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 329
2019-12-06 17:37:30.908 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 220.56, Steps: 330, Distance 6.06, Angular velocity 0.0, Speed: 2.2, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 85.96, Angle accuracy 0.0, Num episodes 1077
Warning: trajectory cut off by epoch at 417 steps.
---------------------------------------
| Epoch | 202 |
| AverageEpRet | 356 |
| StdEpRet | 64 |
| MaxEpRet | 411 |
| MinEpRet | 221 |
| EpLen | 597 |
| AverageVVals | 51 |
| StdVVals | 8.39e-06 |
| MaxVVals | 51 |
| MinVVals | 51 |
| TotalEnvInteracts | 8.12e+05 |
| LossPi | 3.83e-08 |
| LossV | 397 |
| DeltaLossPi | -0.00192 |
| DeltaLossV | -0.232 |
| Entropy | -1.72 |
| KL | 0.00329 |
| ClipFrac | 0.036 |
| StopIter | 79 |
| Time | 768 |
---------------------------------------
2019-12-06 17:37:31.721 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 333
2019-12-06 17:37:31.722 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 237.81, Steps: 334, Distance 6.14, Angular velocity 0.0, Speed: 2.24, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 86.27, Angle accuracy 0.0, Num episodes 1078
2019-12-06 17:37:32.410 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 777
2019-12-06 17:37:32.411 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.43, Steps: 778, Distance 30.16, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.84, Angle accuracy 0.0, Num episodes 1079
2019-12-06 17:37:33.033 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 708
2019-12-06 17:37:33.033 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.07, Steps: 709, Distance 25.82, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.44, Angle accuracy 0.0, Num episodes 1080
2019-12-06 17:37:33.608 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 652
2019-12-06 17:37:33.609 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.15, Steps: 653, Distance 22.33, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.78, Angle accuracy 0.0, Num episodes 1081
2019-12-06 17:37:34.159 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 615
2019-12-06 17:37:34.160 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.91, Steps: 616, Distance 20.13, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 1082
2019-12-06 17:37:34.846 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 780
2019-12-06 17:37:34.847 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.43, Steps: 781, Distance 30.52, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.87, Angle accuracy 0.0, Num episodes 1083
Warning: trajectory cut off by epoch at 129 steps.
---------------------------------------
| Epoch | 203 |
| AverageEpRet | 374 |
| StdEpRet | 62.6 |
| MaxEpRet | 417 |
| MinEpRet | 238 |
| EpLen | 645 |
| AverageVVals | 50.5 |
| StdVVals | 8.64e-06 |
| MaxVVals | 50.5 |
| MinVVals | 50.5 |
| TotalEnvInteracts | 8.16e+05 |
| LossPi | 3.99e-08 |
| LossV | 446 |
| DeltaLossPi | -0.00119 |
| DeltaLossV | -5.28 |
| Entropy | -1.73 |
| KL | 0.000379 |
| ClipFrac | 0.035 |
| StopIter | 79 |
| Time | 771 |
---------------------------------------
2019-12-06 17:37:35.692 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 648
2019-12-06 17:37:35.692 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 373.67, Steps: 649, Distance 22.26, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.74, Angle accuracy 0.0, Num episodes 1084
2019-12-06 17:37:36.260 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:37:36.261 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.42, Steps: 646, Distance 22.2, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.85, Angle accuracy 0.0, Num episodes 1085
2019-12-06 17:37:36.851 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:37:36.851 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.34, Steps: 662, Distance 23.01, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1086
2019-12-06 17:37:37.549 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:37:37.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.5, Steps: 746, Distance 28.29, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 1087
2019-12-06 17:37:38.126 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 652
2019-12-06 17:37:38.127 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.64, Steps: 653, Distance 22.51, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 1088
2019-12-06 17:37:38.652 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:37:38.653 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.79, Steps: 600, Distance 19.18, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.12, Angle accuracy 0.0, Num episodes 1089
Warning: trajectory cut off by epoch at 44 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 204 |
| AverageEpRet | 383 |
| StdEpRet | 11.2 |
| MaxEpRet | 406 |
| MinEpRet | 371 |
| EpLen | 659 |
| AverageVVals | 48.2 |
| StdVVals | 3.69e-06 |
| MaxVVals | 48.2 |
| MinVVals | 48.2 |
| TotalEnvInteracts | 8.2e+05 |
| LossPi | 9.55e-08 |
| LossV | 405 |
| DeltaLossPi | 0.00166 |
| DeltaLossV | -0.044 |
| Entropy | -1.74 |
| KL | 0.00305 |
| ClipFrac | 0.0188 |
| StopIter | 6 |
| Time | 775 |
---------------------------------------
2019-12-06 17:37:39.362 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 672
2019-12-06 17:37:39.362 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.52, Steps: 673, Distance 23.28, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.94, Angle accuracy 0.0, Num episodes 1090
2019-12-06 17:37:40.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 733
2019-12-06 17:37:40.012 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.68, Steps: 734, Distance 26.86, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 1091
2019-12-06 17:37:40.603 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:37:40.604 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.01, Steps: 655, Distance 22.37, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1092
2019-12-06 17:37:41.327 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 770
2019-12-06 17:37:41.328 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.49, Steps: 771, Distance 29.4, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.73, Angle accuracy 0.0, Num episodes 1093
2019-12-06 17:37:41.847 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 569
2019-12-06 17:37:41.848 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.31, Steps: 570, Distance 16.87, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.42, Angle accuracy 0.0, Num episodes 1094
Warning: trajectory cut off by epoch at 597 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 205 |
| AverageEpRet | 396 |
| StdEpRet | 21.1 |
| MaxEpRet | 419 |
| MinEpRet | 359 |
| EpLen | 681 |
| AverageVVals | 48.4 |
| StdVVals | 1.32e-06 |
| MaxVVals | 48.4 |
| MinVVals | 48.4 |
| TotalEnvInteracts | 8.24e+05 |
| LossPi | -4.55e-08 |
| LossV | 397 |
| DeltaLossPi | 0.00381 |
| DeltaLossV | -2.5 |
| Entropy | -1.75 |
| KL | 0.013 |
| ClipFrac | 0.228 |
| StopIter | 1 |
| Time | 779 |
---------------------------------------
2019-12-06 17:37:42.949 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 543
2019-12-06 17:37:42.950 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 356.85, Steps: 544, Distance 15.46, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.15, Angle accuracy 0.0, Num episodes 1095
2019-12-06 17:37:43.375 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 476
2019-12-06 17:37:43.375 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.75, Steps: 477, Distance 12.05, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.54, Angle accuracy 0.0, Num episodes 1096
2019-12-06 17:37:43.905 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 603
2019-12-06 17:37:43.906 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.14, Steps: 604, Distance 18.88, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.02, Angle accuracy 0.0, Num episodes 1097
2019-12-06 17:37:44.452 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:37:44.453 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.82, Steps: 618, Distance 19.6, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.39, Angle accuracy 0.0, Num episodes 1098
2019-12-06 17:37:45.035 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:37:45.036 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.8, Steps: 660, Distance 22.03, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.79, Angle accuracy 0.0, Num episodes 1099
2019-12-06 17:37:45.583 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 618
2019-12-06 17:37:45.584 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.84, Steps: 619, Distance 20.0, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.32, Angle accuracy 0.0, Num episodes 1100
Warning: trajectory cut off by epoch at 478 steps.
---------------------------------------
| Epoch | 206 |
| AverageEpRet | 371 |
| StdEpRet | 24.7 |
| MaxEpRet | 393 |
| MinEpRet | 323 |
| EpLen | 587 |
| AverageVVals | 50 |
| StdVVals | 3.82e-06 |
| MaxVVals | 50 |
| MinVVals | 50 |
| TotalEnvInteracts | 8.28e+05 |
| LossPi | -6.51e-08 |
| LossV | 381 |
| DeltaLossPi | -0.00211 |
| DeltaLossV | -12.1 |
| Entropy | -1.75 |
| KL | 0.00139 |
| ClipFrac | 0.015 |
| StopIter | 79 |
| Time | 782 |
---------------------------------------
2019-12-06 17:37:46.823 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:37:46.824 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.36, Steps: 730, Distance 26.4, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 1101
2019-12-06 17:37:47.481 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:37:47.481 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.91, Steps: 729, Distance 26.09, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1102
2019-12-06 17:37:48.019 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:37:48.020 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.55, Steps: 608, Distance 19.07, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.16, Angle accuracy 0.0, Num episodes 1103
2019-12-06 17:37:48.700 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 760
2019-12-06 17:37:48.701 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.89, Steps: 761, Distance 27.98, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.66, Angle accuracy 0.0, Num episodes 1104
2019-12-06 17:37:49.160 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 515
2019-12-06 17:37:49.160 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.14, Steps: 516, Distance 13.81, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.47, Angle accuracy 0.0, Num episodes 1105
Warning: trajectory cut off by epoch at 656 steps.
---------------------------------------
| Epoch | 207 |
| AverageEpRet | 396 |
| StdEpRet | 26.7 |
| MaxEpRet | 426 |
| MinEpRet | 350 |
| EpLen | 669 |
| AverageVVals | 53.5 |
| StdVVals | 4.15e-06 |
| MaxVVals | 53.5 |
| MinVVals | 53.5 |
| TotalEnvInteracts | 8.32e+05 |
| LossPi | 1.19e-09 |
| LossV | 404 |
| DeltaLossPi | -7.04e-05 |
| DeltaLossV | -5.91 |
| Entropy | -1.74 |
| KL | 0.000557 |
| ClipFrac | 0.008 |
| StopIter | 79 |
| Time | 786 |
---------------------------------------
2019-12-06 17:37:50.248 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:37:50.248 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.45, Steps: 413, Distance 8.85, Angular velocity 0.0, Speed: 2.59, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 90.08, Angle accuracy 0.0, Num episodes 1106
2019-12-06 17:37:50.831 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:37:50.832 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.81, Steps: 660, Distance 21.83, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1107
2019-12-06 17:37:51.294 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:37:51.295 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.83, Steps: 520, Distance 14.01, Angular velocity 0.0, Speed: 3.11, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.4, Angle accuracy 0.0, Num episodes 1108
2019-12-06 17:37:51.823 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:37:51.824 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.98, Steps: 596, Distance 18.28, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 94.89, Angle accuracy 0.0, Num episodes 1109
2019-12-06 17:37:52.092 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 297
2019-12-06 17:37:52.093 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 200.77, Steps: 298, Distance 4.62, Angular velocity 0.0, Speed: 1.88, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 82.33, Angle accuracy 0.0, Num episodes 1110
2019-12-06 17:37:52.518 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 485
2019-12-06 17:37:52.518 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 320.46, Steps: 486, Distance 12.36, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.55, Angle accuracy 0.0, Num episodes 1111
2019-12-06 17:37:53.211 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 768
2019-12-06 17:37:53.212 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.22, Steps: 769, Distance 28.76, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 1112
Warning: trajectory cut off by epoch at 258 steps.
---------------------------------------
| Epoch | 208 |
| AverageEpRet | 334 |
| StdEpRet | 69.4 |
| MaxEpRet | 413 |
| MinEpRet | 201 |
| EpLen | 535 |
| AverageVVals | 51 |
| StdVVals | 4.2e-06 |
| MaxVVals | 51 |
| MinVVals | 51 |
| TotalEnvInteracts | 8.36e+05 |
| LossPi | -1.66e-08 |
| LossV | 356 |
| DeltaLossPi | -0.0018 |
| DeltaLossV | -0.043 |
| Entropy | -1.71 |
| KL | 0.00294 |
| ClipFrac | 0.0377 |
| StopIter | 79 |
| Time | 790 |
---------------------------------------
2019-12-06 17:37:54.159 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 633
2019-12-06 17:37:54.159 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.65, Steps: 634, Distance 20.98, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.49, Angle accuracy 0.0, Num episodes 1113
2019-12-06 17:37:54.809 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:37:54.810 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.2, Steps: 726, Distance 26.26, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1114
2019-12-06 17:37:55.199 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 443
2019-12-06 17:37:55.199 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 311.23, Steps: 444, Distance 10.55, Angular velocity 0.0, Speed: 2.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.35, Angle accuracy 0.0, Num episodes 1115
2019-12-06 17:37:55.784 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:37:55.785 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.53, Steps: 589, Distance 17.94, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.84, Angle accuracy 0.0, Num episodes 1116
2019-12-06 17:37:56.457 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:37:56.458 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.58, Steps: 719, Distance 25.51, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 1117
2019-12-06 17:37:57.036 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 625
2019-12-06 17:37:57.037 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.03, Steps: 626, Distance 20.09, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.43, Angle accuracy 0.0, Num episodes 1118
Warning: trajectory cut off by epoch at 262 steps.
---------------------------------------
| Epoch | 209 |
| AverageEpRet | 383 |
| StdEpRet | 34.3 |
| MaxEpRet | 414 |
| MinEpRet | 311 |
| EpLen | 623 |
| AverageVVals | 51.2 |
| StdVVals | 7.32e-06 |
| MaxVVals | 51.2 |
| MinVVals | 51.2 |
| TotalEnvInteracts | 8.4e+05 |
| LossPi | -3.23e-08 |
| LossV | 410 |
| DeltaLossPi | -0.00179 |
| DeltaLossV | -0.107 |
| Entropy | -1.74 |
| KL | 0.00186 |
| ClipFrac | 0.0192 |
| StopIter | 79 |
| Time | 794 |
---------------------------------------
2019-12-06 17:37:57.963 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 589
2019-12-06 17:37:57.964 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.83, Steps: 590, Distance 17.98, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.8, Angle accuracy 0.0, Num episodes 1119
2019-12-06 17:37:58.329 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 407
2019-12-06 17:37:58.329 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 285.5, Steps: 408, Distance 8.98, Angular velocity 0.0, Speed: 2.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.08, Angle accuracy 0.0, Num episodes 1120
2019-12-06 17:37:58.803 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 528
2019-12-06 17:37:58.803 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.07, Steps: 529, Distance 14.85, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.74, Angle accuracy 0.0, Num episodes 1121
2019-12-06 17:37:59.430 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 660
2019-12-06 17:37:59.431 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.15, Steps: 661, Distance 22.15, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.8, Angle accuracy 0.0, Num episodes 1122
2019-12-06 17:38:00.071 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 721
2019-12-06 17:38:00.072 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.21, Steps: 722, Distance 25.87, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.29, Angle accuracy 0.0, Num episodes 1123
2019-12-06 17:38:00.671 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:38:00.671 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.08, Steps: 651, Distance 21.55, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.8, Angle accuracy 0.0, Num episodes 1124
2019-12-06 17:38:01.042 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 382
2019-12-06 17:38:01.043 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.8, Steps: 383, Distance 7.87, Angular velocity 0.0, Speed: 2.48, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 89.09, Angle accuracy 0.0, Num episodes 1125
Warning: trajectory cut off by epoch at 56 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 210 |
| AverageEpRet | 357 |
| StdEpRet | 53.7 |
| MaxEpRet | 414 |
| MinEpRet | 269 |
| EpLen | 563 |
| AverageVVals | 51.6 |
| StdVVals | 8.79e-06 |
| MaxVVals | 51.6 |
| MinVVals | 51.6 |
| TotalEnvInteracts | 8.44e+05 |
| LossPi | 1.79e-09 |
| LossV | 391 |
| DeltaLossPi | -0.00158 |
| DeltaLossV | -0.0547 |
| Entropy | -1.75 |
| KL | 0.00243 |
| ClipFrac | 0.031 |
| StopIter | 79 |
| Time | 798 |
---------------------------------------
2019-12-06 17:38:02.206 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:38:02.206 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.45, Steps: 763, Distance 28.35, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 1126
2019-12-06 17:38:02.846 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:38:02.846 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.31, Steps: 714, Distance 25.47, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 1127
2019-12-06 17:38:03.416 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:38:03.416 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.94, Steps: 635, Distance 20.57, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.6, Angle accuracy 0.0, Num episodes 1128
2019-12-06 17:38:03.899 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:38:03.899 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.82, Steps: 539, Distance 15.35, Angular velocity 0.0, Speed: 3.26, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.13, Angle accuracy 0.0, Num episodes 1129
2019-12-06 17:38:04.292 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 438
2019-12-06 17:38:04.293 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 309.69, Steps: 439, Distance 10.2, Angular velocity 0.0, Speed: 2.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.13, Angle accuracy 0.0, Num episodes 1130
2019-12-06 17:38:04.916 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:38:04.917 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.73, Steps: 690, Distance 23.79, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.07, Angle accuracy 0.0, Num episodes 1131
Warning: trajectory cut off by epoch at 220 steps.
Early stopping at step 15 due to reaching max kl.
---------------------------------------
| Epoch | 211 |
| AverageEpRet | 385 |
| StdEpRet | 40.3 |
| MaxEpRet | 434 |
| MinEpRet | 310 |
| EpLen | 630 |
| AverageVVals | 51.8 |
| StdVVals | 1.17e-05 |
| MaxVVals | 51.8 |
| MinVVals | 51.8 |
| TotalEnvInteracts | 8.48e+05 |
| LossPi | -7.16e-08 |
| LossV | 414 |
| DeltaLossPi | -9.74e-05 |
| DeltaLossV | -0.488 |
| Entropy | -1.79 |
| KL | 2.99e-05 |
| ClipFrac | 0.00025 |
| StopIter | 15 |
| Time | 801 |
---------------------------------------
2019-12-06 17:38:05.848 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 727
2019-12-06 17:38:05.848 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.72, Steps: 728, Distance 26.25, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.37, Angle accuracy 0.0, Num episodes 1132
2019-12-06 17:38:06.451 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 680
2019-12-06 17:38:06.452 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.81, Steps: 681, Distance 23.62, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 1133
2019-12-06 17:38:07.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:38:07.011 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.22, Steps: 618, Distance 19.89, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.33, Angle accuracy 0.0, Num episodes 1134
2019-12-06 17:38:07.481 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:38:07.482 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 349.42, Steps: 520, Distance 14.53, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.58, Angle accuracy 0.0, Num episodes 1135
2019-12-06 17:38:08.193 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 785
2019-12-06 17:38:08.194 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.77, Steps: 786, Distance 29.93, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.84, Angle accuracy 0.0, Num episodes 1136
2019-12-06 17:38:08.748 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 601
2019-12-06 17:38:08.748 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.11, Steps: 602, Distance 18.91, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.1, Angle accuracy 0.0, Num episodes 1137
Warning: trajectory cut off by epoch at 65 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 212 |
| AverageEpRet | 397 |
| StdEpRet | 29.3 |
| MaxEpRet | 441 |
| MinEpRet | 349 |
| EpLen | 656 |
| AverageVVals | 51.1 |
| StdVVals | 1.17e-05 |
| MaxVVals | 51.1 |
| MinVVals | 51.1 |
| TotalEnvInteracts | 8.52e+05 |
| LossPi | -2.62e-09 |
| LossV | 450 |
| DeltaLossPi | -4.63e-05 |
| DeltaLossV | -0.301 |
| Entropy | -1.79 |
| KL | -1.35e-05 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 805 |
---------------------------------------
2019-12-06 17:38:09.225 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 387
2019-12-06 17:38:09.225 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 269.42, Steps: 388, Distance 8.16, Angular velocity 0.0, Speed: 2.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.17, Angle accuracy 0.0, Num episodes 1138
2019-12-06 17:38:09.792 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:38:09.792 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.8, Steps: 636, Distance 20.95, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.57, Angle accuracy 0.0, Num episodes 1139
2019-12-06 17:38:10.332 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:38:10.332 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.62, Steps: 600, Distance 18.89, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.02, Angle accuracy 0.0, Num episodes 1140
2019-12-06 17:38:10.697 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 410
2019-12-06 17:38:10.697 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.74, Steps: 411, Distance 9.11, Angular velocity 0.0, Speed: 2.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.23, Angle accuracy 0.0, Num episodes 1141
2019-12-06 17:38:11.180 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 550
2019-12-06 17:38:11.180 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.29, Steps: 551, Distance 16.12, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.45, Angle accuracy 0.0, Num episodes 1142
2019-12-06 17:38:11.864 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 759
2019-12-06 17:38:11.864 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.65, Steps: 760, Distance 28.48, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.67, Angle accuracy 0.0, Num episodes 1143
2019-12-06 17:38:12.277 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 456
2019-12-06 17:38:12.277 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 314.16, Steps: 457, Distance 11.26, Angular velocity 0.0, Speed: 2.91, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.02, Angle accuracy 0.0, Num episodes 1144
Warning: trajectory cut off by epoch at 197 steps.
---------------------------------------
| Epoch | 213 |
| AverageEpRet | 347 |
| StdEpRet | 52.3 |
| MaxEpRet | 424 |
| MinEpRet | 269 |
| EpLen | 543 |
| AverageVVals | 50.5 |
| StdVVals | 8.08e-06 |
| MaxVVals | 50.5 |
| MinVVals | 50.5 |
| TotalEnvInteracts | 8.56e+05 |
| LossPi | 3.42e-08 |
| LossV | 383 |
| DeltaLossPi | -0.00202 |
| DeltaLossV | -2.23 |
| Entropy | -1.78 |
| KL | 0.00127 |
| ClipFrac | 0.031 |
| StopIter | 79 |
| Time | 809 |
---------------------------------------
2019-12-06 17:38:13.184 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:38:13.185 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.4, Steps: 666, Distance 22.71, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.88, Angle accuracy 0.0, Num episodes 1145
2019-12-06 17:38:13.491 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 345
2019-12-06 17:38:13.492 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 240.09, Steps: 346, Distance 6.44, Angular velocity 0.0, Speed: 2.24, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.59, Angle accuracy 0.0, Num episodes 1146
2019-12-06 17:38:13.859 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 411
2019-12-06 17:38:13.860 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.88, Steps: 412, Distance 8.98, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.22, Angle accuracy 0.0, Num episodes 1147
2019-12-06 17:38:14.474 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 693
2019-12-06 17:38:14.475 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.4, Steps: 694, Distance 24.66, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.3, Angle accuracy 0.0, Num episodes 1148
2019-12-06 17:38:14.995 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:38:14.996 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.62, Steps: 593, Distance 18.18, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.87, Angle accuracy 0.0, Num episodes 1149
2019-12-06 17:38:15.372 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 415
2019-12-06 17:38:15.372 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 291.65, Steps: 416, Distance 9.38, Angular velocity 0.0, Speed: 2.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.54, Angle accuracy 0.0, Num episodes 1150
2019-12-06 17:38:16.058 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 777
2019-12-06 17:38:16.058 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.59, Steps: 778, Distance 29.72, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.91, Angle accuracy 0.0, Num episodes 1151
Warning: trajectory cut off by epoch at 95 steps.
---------------------------------------
| Epoch | 214 |
| AverageEpRet | 350 |
| StdEpRet | 70.4 |
| MaxEpRet | 432 |
| MinEpRet | 240 |
| EpLen | 558 |
| AverageVVals | 52.1 |
| StdVVals | 3.73e-06 |
| MaxVVals | 52.1 |
| MinVVals | 52.1 |
| TotalEnvInteracts | 8.6e+05 |
| LossPi | -3.23e-08 |
| LossV | 414 |
| DeltaLossPi | -0.00243 |
| DeltaLossV | -1.07 |
| Entropy | -1.79 |
| KL | 0.00407 |
| ClipFrac | 0.0452 |
| StopIter | 79 |
| Time | 812 |
---------------------------------------
2019-12-06 17:38:16.987 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 782
2019-12-06 17:38:16.988 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.29, Steps: 783, Distance 29.63, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.93, Angle accuracy 0.0, Num episodes 1152
2019-12-06 17:38:17.448 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 507
2019-12-06 17:38:17.448 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.11, Steps: 508, Distance 13.71, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.42, Angle accuracy 0.0, Num episodes 1153
2019-12-06 17:38:17.849 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 449
2019-12-06 17:38:17.850 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 312.7, Steps: 450, Distance 10.97, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.99, Angle accuracy 0.0, Num episodes 1154
2019-12-06 17:38:18.463 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:38:18.463 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.92, Steps: 680, Distance 23.46, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.0, Angle accuracy 0.0, Num episodes 1155
2019-12-06 17:38:18.983 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 568
2019-12-06 17:38:18.983 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.22, Steps: 569, Distance 16.83, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.55, Angle accuracy 0.0, Num episodes 1156
2019-12-06 17:38:19.446 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 514
2019-12-06 17:38:19.446 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.42, Steps: 515, Distance 14.19, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.42, Angle accuracy 0.0, Num episodes 1157
Warning: trajectory cut off by epoch at 495 steps.
Early stopping at step 8 due to reaching max kl.
---------------------------------------
| Epoch | 215 |
| AverageEpRet | 374 |
| StdEpRet | 42.5 |
| MaxEpRet | 441 |
| MinEpRet | 313 |
| EpLen | 584 |
| AverageVVals | 51 |
| StdVVals | 7.52e-06 |
| MaxVVals | 51 |
| MinVVals | 51 |
| TotalEnvInteracts | 8.64e+05 |
| LossPi | 1.49e-08 |
| LossV | 398 |
| DeltaLossPi | -0.00169 |
| DeltaLossV | -9.16 |
| Entropy | -1.81 |
| KL | 0.00329 |
| ClipFrac | 0.0113 |
| StopIter | 8 |
| Time | 816 |
---------------------------------------
2019-12-06 17:38:20.573 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 668
2019-12-06 17:38:20.574 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.98, Steps: 669, Distance 22.92, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.94, Angle accuracy 0.0, Num episodes 1158
2019-12-06 17:38:21.046 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:38:21.047 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.99, Steps: 532, Distance 15.08, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.03, Angle accuracy 0.0, Num episodes 1159
2019-12-06 17:38:21.591 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:38:21.592 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 387.05, Steps: 607, Distance 19.19, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.07, Angle accuracy 0.0, Num episodes 1160
2019-12-06 17:38:22.251 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 746
2019-12-06 17:38:22.251 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.45, Steps: 747, Distance 27.46, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 1161
2019-12-06 17:38:22.819 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:38:22.819 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.41, Steps: 643, Distance 21.17, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1162
2019-12-06 17:38:23.160 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 380
2019-12-06 17:38:23.161 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 258.03, Steps: 381, Distance 7.61, Angular velocity 0.0, Speed: 2.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.74, Angle accuracy 0.0, Num episodes 1163
Warning: trajectory cut off by epoch at 421 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 216 |
| AverageEpRet | 376 |
| StdEpRet | 57.8 |
| MaxEpRet | 436 |
| MinEpRet | 258 |
| EpLen | 596 |
| AverageVVals | 54.1 |
| StdVVals | 4.22e-06 |
| MaxVVals | 54.1 |
| MinVVals | 54.1 |
| TotalEnvInteracts | 8.68e+05 |
| LossPi | -2.54e-08 |
| LossV | 385 |
| DeltaLossPi | -0.00242 |
| DeltaLossV | -0.387 |
| Entropy | -1.8 |
| KL | 0.00226 |
| ClipFrac | 0.00175 |
| StopIter | 1 |
| Time | 820 |
---------------------------------------
2019-12-06 17:38:24.221 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:38:24.222 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.13, Steps: 663, Distance 22.46, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1164
2019-12-06 17:38:24.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 427
2019-12-06 17:38:24.600 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 294.14, Steps: 428, Distance 9.87, Angular velocity 0.0, Speed: 2.72, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 90.8, Angle accuracy 0.0, Num episodes 1165
2019-12-06 17:38:25.199 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 675
2019-12-06 17:38:25.199 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.33, Steps: 676, Distance 23.23, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.05, Angle accuracy 0.0, Num episodes 1166
2019-12-06 17:38:25.748 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 621
2019-12-06 17:38:25.748 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.39, Steps: 622, Distance 20.02, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.29, Angle accuracy 0.0, Num episodes 1167
2019-12-06 17:38:26.426 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 765
2019-12-06 17:38:26.426 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.88, Steps: 766, Distance 28.56, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.66, Angle accuracy 0.0, Num episodes 1168
2019-12-06 17:38:27.061 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 703
2019-12-06 17:38:27.061 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.17, Steps: 704, Distance 24.67, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 1169
Warning: trajectory cut off by epoch at 141 steps.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 217 |
| AverageEpRet | 395 |
| StdEpRet | 46.8 |
| MaxEpRet | 440 |
| MinEpRet | 294 |
| EpLen | 643 |
| AverageVVals | 53.5 |
| StdVVals | 3.72e-06 |
| MaxVVals | 53.5 |
| MinVVals | 53.5 |
| TotalEnvInteracts | 8.72e+05 |
| LossPi | -2.5e-08 |
| LossV | 429 |
| DeltaLossPi | -0.0015 |
| DeltaLossV | -4.17 |
| Entropy | -1.79 |
| KL | 0.00255 |
| ClipFrac | 0.009 |
| StopIter | 4 |
| Time | 823 |
---------------------------------------
2019-12-06 17:38:27.816 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 625
2019-12-06 17:38:27.817 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.2, Steps: 626, Distance 20.23, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.43, Angle accuracy 0.0, Num episodes 1170
2019-12-06 17:38:28.498 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 764
2019-12-06 17:38:28.498 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.98, Steps: 765, Distance 28.6, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.73, Angle accuracy 0.0, Num episodes 1171
2019-12-06 17:38:29.020 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 591
2019-12-06 17:38:29.021 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.79, Steps: 592, Distance 18.29, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.99, Angle accuracy 0.0, Num episodes 1172
2019-12-06 17:38:29.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:38:29.601 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.66, Steps: 651, Distance 21.67, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.73, Angle accuracy 0.0, Num episodes 1173
2019-12-06 17:38:30.232 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:38:30.233 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.12, Steps: 705, Distance 25.17, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 1174
2019-12-06 17:38:30.687 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 499
2019-12-06 17:38:30.688 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 331.94, Steps: 500, Distance 13.5, Angular velocity 0.0, Speed: 3.07, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.21, Angle accuracy 0.0, Num episodes 1175
Warning: trajectory cut off by epoch at 161 steps.
---------------------------------------
| Epoch | 218 |
| AverageEpRet | 393 |
| StdEpRet | 32.9 |
| MaxEpRet | 432 |
| MinEpRet | 332 |
| EpLen | 640 |
| AverageVVals | 51.4 |
| StdVVals | 7.53e-06 |
| MaxVVals | 51.4 |
| MinVVals | 51.4 |
| TotalEnvInteracts | 8.76e+05 |
| LossPi | -1.25e-08 |
| LossV | 410 |
| DeltaLossPi | -0.00148 |
| DeltaLossV | -0.0123 |
| Entropy | -1.8 |
| KL | 0.00352 |
| ClipFrac | 0.0245 |
| StopIter | 79 |
| Time | 827 |
---------------------------------------
2019-12-06 17:38:31.531 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 621
2019-12-06 17:38:31.531 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.4, Steps: 622, Distance 20.04, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.44, Angle accuracy 0.0, Num episodes 1176
2019-12-06 17:38:32.183 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:38:32.183 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.97, Steps: 675, Distance 23.4, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 1177
2019-12-06 17:38:32.747 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:38:32.748 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 391.03, Steps: 635, Distance 21.02, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.47, Angle accuracy 0.0, Num episodes 1178
2019-12-06 17:38:33.185 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 484
2019-12-06 17:38:33.186 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 337.65, Steps: 485, Distance 12.8, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.03, Angle accuracy 0.0, Num episodes 1179
2019-12-06 17:38:33.857 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 765
2019-12-06 17:38:33.857 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.71, Steps: 766, Distance 29.15, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.71, Angle accuracy 0.0, Num episodes 1180
2019-12-06 17:38:34.551 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 776
2019-12-06 17:38:34.551 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.61, Steps: 777, Distance 29.68, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.78, Angle accuracy 0.0, Num episodes 1181
Warning: trajectory cut off by epoch at 40 steps.
Early stopping at step 5 due to reaching max kl.
---------------------------------------
| Epoch | 219 |
| AverageEpRet | 397 |
| StdEpRet | 30.8 |
| MaxEpRet | 433 |
| MinEpRet | 338 |
| EpLen | 660 |
| AverageVVals | 51.5 |
| StdVVals | 7.41e-06 |
| MaxVVals | 51.5 |
| MinVVals | 51.5 |
| TotalEnvInteracts | 8.8e+05 |
| LossPi | 1.76e-09 |
| LossV | 468 |
| DeltaLossPi | 7.93e-05 |
| DeltaLossV | -2.22 |
| Entropy | -1.83 |
| KL | -0.00131 |
| ClipFrac | 0.0015 |
| StopIter | 5 |
| Time | 831 |
---------------------------------------
2019-12-06 17:38:35.239 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:38:35.239 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.07, Steps: 651, Distance 22.07, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1182
2019-12-06 17:38:35.708 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 526
2019-12-06 17:38:35.708 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.35, Steps: 527, Distance 14.93, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.02, Angle accuracy 0.0, Num episodes 1183
2019-12-06 17:38:36.300 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 603
2019-12-06 17:38:36.300 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.63, Steps: 604, Distance 18.94, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.21, Angle accuracy 0.0, Num episodes 1184
2019-12-06 17:38:36.945 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:38:36.946 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.31, Steps: 716, Distance 25.81, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.32, Angle accuracy 0.0, Num episodes 1185
2019-12-06 17:38:37.473 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 594
2019-12-06 17:38:37.473 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.67, Steps: 595, Distance 18.33, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.89, Angle accuracy 0.0, Num episodes 1186
2019-12-06 17:38:37.889 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 467
2019-12-06 17:38:37.889 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.13, Steps: 468, Distance 11.83, Angular velocity 0.0, Speed: 2.95, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.3, Angle accuracy 0.0, Num episodes 1187
Warning: trajectory cut off by epoch at 439 steps.
Warning: could not pickle state_dict.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 220 |
| AverageEpRet | 375 |
| StdEpRet | 29.8 |
| MaxEpRet | 409 |
| MinEpRet | 321 |
| EpLen | 594 |
| AverageVVals | 50 |
| StdVVals | 1.74e-06 |
| MaxVVals | 50 |
| MinVVals | 50 |
| TotalEnvInteracts | 8.84e+05 |
| LossPi | 2.53e-08 |
| LossV | 408 |
| DeltaLossPi | -0.000156 |
| DeltaLossV | -13.8 |
| Entropy | -1.81 |
| KL | 0.00163 |
| ClipFrac | 0.0143 |
| StopIter | 3 |
| Time | 835 |
---------------------------------------
2019-12-06 17:38:39.220 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:38:39.221 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.65, Steps: 613, Distance 19.37, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.14, Angle accuracy 0.0, Num episodes 1188
2019-12-06 17:38:39.777 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 580
2019-12-06 17:38:39.778 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.3, Steps: 581, Distance 17.58, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.88, Angle accuracy 0.0, Num episodes 1189
2019-12-06 17:38:40.347 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:38:40.348 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.85, Steps: 638, Distance 21.0, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.61, Angle accuracy 0.0, Num episodes 1190
2019-12-06 17:38:41.018 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 741
2019-12-06 17:38:41.019 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.33, Steps: 742, Distance 27.22, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.48, Angle accuracy 0.0, Num episodes 1191
2019-12-06 17:38:41.482 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:38:41.483 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.23, Steps: 503, Distance 13.47, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.25, Angle accuracy 0.0, Num episodes 1192
2019-12-06 17:38:42.270 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 832
2019-12-06 17:38:42.270 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.11, Steps: 833, Distance 32.8, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.21, Angle accuracy 0.0, Num episodes 1193
Warning: trajectory cut off by epoch at 90 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 221 |
| AverageEpRet | 397 |
| StdEpRet | 33.9 |
| MaxEpRet | 446 |
| MinEpRet | 338 |
| EpLen | 652 |
| AverageVVals | 53.8 |
| StdVVals | 1.16e-05 |
| MaxVVals | 53.8 |
| MinVVals | 53.8 |
| TotalEnvInteracts | 8.88e+05 |
| LossPi | -3.65e-08 |
| LossV | 461 |
| DeltaLossPi | -0.0023 |
| DeltaLossV | -9.33 |
| Entropy | -1.83 |
| KL | 0.00438 |
| ClipFrac | 0.0382 |
| StopIter | 3 |
| Time | 839 |
---------------------------------------
2019-12-06 17:38:42.964 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:38:42.964 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.52, Steps: 613, Distance 19.45, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.2, Angle accuracy 0.0, Num episodes 1194
2019-12-06 17:38:43.639 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 758
2019-12-06 17:38:43.639 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.83, Steps: 759, Distance 27.78, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.72, Angle accuracy 0.0, Num episodes 1195
2019-12-06 17:38:44.202 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:38:44.202 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.08, Steps: 618, Distance 19.75, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.42, Angle accuracy 0.0, Num episodes 1196
2019-12-06 17:38:44.676 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:38:44.676 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.66, Steps: 532, Distance 14.85, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.99, Angle accuracy 0.0, Num episodes 1197
2019-12-06 17:38:45.326 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:38:45.326 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.1, Steps: 730, Distance 26.25, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 1198
2019-12-06 17:38:45.632 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 338
2019-12-06 17:38:45.632 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 239.98, Steps: 339, Distance 6.21, Angular velocity 0.0, Speed: 2.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.32, Angle accuracy 0.0, Num episodes 1199
Warning: trajectory cut off by epoch at 409 steps.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 222 |
| AverageEpRet | 375 |
| StdEpRet | 65.1 |
| MaxEpRet | 438 |
| MinEpRet | 240 |
| EpLen | 598 |
| AverageVVals | 50.7 |
| StdVVals | 4.57e-06 |
| MaxVVals | 50.7 |
| MinVVals | 50.7 |
| TotalEnvInteracts | 8.92e+05 |
| LossPi | 8.92e-08 |
| LossV | 417 |
| DeltaLossPi | -0.000321 |
| DeltaLossV | -5.1 |
| Entropy | -1.82 |
| KL | 0.00256 |
| ClipFrac | 0.0235 |
| StopIter | 4 |
| Time | 842 |
---------------------------------------
2019-12-06 17:38:46.794 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 813
2019-12-06 17:38:46.794 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.28, Steps: 814, Distance 31.35, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.06, Angle accuracy 0.0, Num episodes 1200
2019-12-06 17:38:47.447 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:38:47.448 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.64, Steps: 716, Distance 25.28, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.22, Angle accuracy 0.0, Num episodes 1201
2019-12-06 17:38:47.925 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 535
2019-12-06 17:38:47.926 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.78, Steps: 536, Distance 14.88, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.87, Angle accuracy 0.0, Num episodes 1202
2019-12-06 17:38:48.368 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 496
2019-12-06 17:38:48.369 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.82, Steps: 497, Distance 12.72, Angular velocity 0.0, Speed: 3.0, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.85, Angle accuracy 0.0, Num episodes 1203
2019-12-06 17:38:49.075 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 786
2019-12-06 17:38:49.075 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.25, Steps: 787, Distance 29.86, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.78, Angle accuracy 0.0, Num episodes 1204
Warning: trajectory cut off by epoch at 650 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 223 |
| AverageEpRet | 406 |
| StdEpRet | 47.3 |
| MaxEpRet | 449 |
| MinEpRet | 339 |
| EpLen | 670 |
| AverageVVals | 52.9 |
| StdVVals | 1.17e-05 |
| MaxVVals | 52.9 |
| MinVVals | 52.9 |
| TotalEnvInteracts | 8.96e+05 |
| LossPi | 3.03e-08 |
| LossV | 412 |
| DeltaLossPi | 0.0128 |
| DeltaLossV | -0.863 |
| Entropy | -1.79 |
| KL | 0.0179 |
| ClipFrac | 0.282 |
| StopIter | 3 |
| Time | 846 |
---------------------------------------
2019-12-06 17:38:50.373 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 706
2019-12-06 17:38:50.374 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.68, Steps: 707, Distance 23.97, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.2, Angle accuracy 0.0, Num episodes 1205
2019-12-06 17:38:50.851 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:38:50.852 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.54, Steps: 532, Distance 14.04, Angular velocity 0.0, Speed: 3.07, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.5, Angle accuracy 0.0, Num episodes 1206
2019-12-06 17:38:51.610 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 843
2019-12-06 17:38:51.610 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.31, Steps: 844, Distance 32.52, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.15, Angle accuracy 0.0, Num episodes 1207
2019-12-06 17:38:52.373 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 854
2019-12-06 17:38:52.374 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 456.54, Steps: 855, Distance 33.35, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.15, Angle accuracy 0.0, Num episodes 1208
2019-12-06 17:38:52.958 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:38:52.958 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.88, Steps: 643, Distance 20.38, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.54, Angle accuracy 0.0, Num episodes 1209
Warning: trajectory cut off by epoch at 419 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 224 |
| AverageEpRet | 417 |
| StdEpRet | 37.2 |
| MaxEpRet | 457 |
| MinEpRet | 355 |
| EpLen | 716 |
| AverageVVals | 52 |
| StdVVals | 1.17e-05 |
| MaxVVals | 52 |
| MinVVals | 52 |
| TotalEnvInteracts | 9e+05 |
| LossPi | 5.6e-09 |
| LossV | 447 |
| DeltaLossPi | 0.00565 |
| DeltaLossV | -1.55 |
| Entropy | -1.8 |
| KL | 0.00832 |
| ClipFrac | 0.163 |
| StopIter | 1 |
| Time | 850 |
---------------------------------------
2019-12-06 17:38:53.746 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 383
2019-12-06 17:38:53.747 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.33, Steps: 384, Distance 7.55, Angular velocity 0.0, Speed: 2.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.55, Angle accuracy 0.0, Num episodes 1210
2019-12-06 17:38:54.414 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 752
2019-12-06 17:38:54.415 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.14, Steps: 753, Distance 26.67, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.52, Angle accuracy 0.0, Num episodes 1211
2019-12-06 17:38:54.839 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 442
2019-12-06 17:38:54.840 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 306.44, Steps: 443, Distance 9.75, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.95, Angle accuracy 0.0, Num episodes 1212
2019-12-06 17:38:55.485 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:38:55.485 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.89, Steps: 719, Distance 24.29, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.05, Angle accuracy 0.0, Num episodes 1213
2019-12-06 17:38:56.115 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 703
2019-12-06 17:38:56.115 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.03, Steps: 704, Distance 23.78, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.1, Angle accuracy 0.0, Num episodes 1214
2019-12-06 17:38:56.731 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:38:56.732 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.05, Steps: 662, Distance 21.13, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.69, Angle accuracy 0.0, Num episodes 1215
Warning: trajectory cut off by epoch at 335 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 225 |
| AverageEpRet | 375 |
| StdEpRet | 63.3 |
| MaxEpRet | 435 |
| MinEpRet | 268 |
| EpLen | 611 |
| AverageVVals | 50.7 |
| StdVVals | 4.3e-06 |
| MaxVVals | 50.7 |
| MinVVals | 50.7 |
| TotalEnvInteracts | 9.04e+05 |
| LossPi | 5.26e-08 |
| LossV | 395 |
| DeltaLossPi | -0.00125 |
| DeltaLossV | -0.597 |
| Entropy | -1.81 |
| KL | 0.00186 |
| ClipFrac | 0.008 |
| StopIter | 3 |
| Time | 853 |
---------------------------------------
2019-12-06 17:38:57.719 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 697
2019-12-06 17:38:57.720 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.02, Steps: 698, Distance 23.28, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.05, Angle accuracy 0.0, Num episodes 1216
2019-12-06 17:38:58.448 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 812
2019-12-06 17:38:58.448 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.11, Steps: 813, Distance 30.35, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.95, Angle accuracy 0.0, Num episodes 1217
2019-12-06 17:38:58.936 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 542
2019-12-06 17:38:58.937 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.51, Steps: 543, Distance 14.8, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 93.95, Angle accuracy 0.0, Num episodes 1218
2019-12-06 17:38:59.322 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 417
2019-12-06 17:38:59.322 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 290.63, Steps: 418, Distance 9.0, Angular velocity 0.0, Speed: 2.53, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 90.27, Angle accuracy 0.0, Num episodes 1219
2019-12-06 17:39:00.044 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 812
2019-12-06 17:39:00.045 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.95, Steps: 813, Distance 30.5, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.85, Angle accuracy 0.0, Num episodes 1220
2019-12-06 17:39:00.671 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 697
2019-12-06 17:39:00.672 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.16, Steps: 698, Distance 23.3, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 95.92, Angle accuracy 0.0, Num episodes 1221
Warning: trajectory cut off by epoch at 17 steps.
---------------------------------------
| Epoch | 226 |
| AverageEpRet | 394 |
| StdEpRet | 53 |
| MaxEpRet | 436 |
| MinEpRet | 291 |
| EpLen | 664 |
| AverageVVals | 51.5 |
| StdVVals | 8.19e-06 |
| MaxVVals | 51.5 |
| MinVVals | 51.5 |
| TotalEnvInteracts | 9.08e+05 |
| LossPi | 9.24e-09 |
| LossV | 454 |
| DeltaLossPi | -0.00241 |
| DeltaLossV | -5.81 |
| Entropy | -1.84 |
| KL | 0.00419 |
| ClipFrac | 0.0322 |
| StopIter | 79 |
| Time | 857 |
---------------------------------------
2019-12-06 17:39:01.478 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:39:01.479 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.24, Steps: 719, Distance 24.73, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.32, Angle accuracy 0.0, Num episodes 1222
2019-12-06 17:39:02.186 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 796
2019-12-06 17:39:02.186 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.47, Steps: 797, Distance 29.42, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.82, Angle accuracy 0.0, Num episodes 1223
2019-12-06 17:39:02.779 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:39:02.779 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.17, Steps: 639, Distance 20.05, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.27, Angle accuracy 0.0, Num episodes 1224
2019-12-06 17:39:03.288 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 562
2019-12-06 17:39:03.289 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.59, Steps: 563, Distance 16.06, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.25, Angle accuracy 0.0, Num episodes 1225
2019-12-06 17:39:03.835 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 583
2019-12-06 17:39:03.836 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.82, Steps: 584, Distance 17.0, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.66, Angle accuracy 0.0, Num episodes 1226
2019-12-06 17:39:04.381 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 611
2019-12-06 17:39:04.381 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.45, Steps: 612, Distance 18.6, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.16, Angle accuracy 0.0, Num episodes 1227
Warning: trajectory cut off by epoch at 86 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 227 |
| AverageEpRet | 394 |
| StdEpRet | 21.1 |
| MaxEpRet | 430 |
| MinEpRet | 373 |
| EpLen | 652 |
| AverageVVals | 49.1 |
| StdVVals | 3.76e-06 |
| MaxVVals | 49.1 |
| MinVVals | 49.1 |
| TotalEnvInteracts | 9.12e+05 |
| LossPi | -8.65e-08 |
| LossV | 436 |
| DeltaLossPi | -0.000855 |
| DeltaLossV | -0.982 |
| Entropy | -1.8 |
| KL | 0.000105 |
| ClipFrac | 0 |
| StopIter | 2 |
| Time | 861 |
---------------------------------------
2019-12-06 17:39:05.078 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:39:05.079 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.87, Steps: 599, Distance 17.81, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.92, Angle accuracy 0.0, Num episodes 1228
2019-12-06 17:39:05.590 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 560
2019-12-06 17:39:05.590 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.21, Steps: 561, Distance 15.85, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 94.16, Angle accuracy 0.0, Num episodes 1229
2019-12-06 17:39:06.018 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 471
2019-12-06 17:39:06.018 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.32, Steps: 472, Distance 11.15, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.85, Angle accuracy 0.0, Num episodes 1230
2019-12-06 17:39:06.594 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:39:06.594 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.12, Steps: 643, Distance 20.26, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.3, Angle accuracy 0.0, Num episodes 1231
2019-12-06 17:39:07.245 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:39:07.245 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.03, Steps: 729, Distance 25.44, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.43, Angle accuracy 0.0, Num episodes 1232
2019-12-06 17:39:07.918 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 754
2019-12-06 17:39:07.919 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.33, Steps: 755, Distance 26.74, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.43, Angle accuracy 0.0, Num episodes 1233
Warning: trajectory cut off by epoch at 241 steps.
---------------------------------------
| Epoch | 228 |
| AverageEpRet | 384 |
| StdEpRet | 31.4 |
| MaxEpRet | 421 |
| MinEpRet | 328 |
| EpLen | 626 |
| AverageVVals | 50.1 |
| StdVVals | 3.76e-06 |
| MaxVVals | 50.1 |
| MinVVals | 50.1 |
| TotalEnvInteracts | 9.16e+05 |
| LossPi | -4.66e-08 |
| LossV | 406 |
| DeltaLossPi | -0.000793 |
| DeltaLossV | -1.56 |
| Entropy | -1.79 |
| KL | 0.00289 |
| ClipFrac | 0.0127 |
| StopIter | 79 |
| Time | 864 |
---------------------------------------
2019-12-06 17:39:08.731 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 497
2019-12-06 17:39:08.731 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 336.11, Steps: 498, Distance 12.58, Angular velocity 0.0, Speed: 2.93, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.87, Angle accuracy 0.0, Num episodes 1234
2019-12-06 17:39:09.389 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:39:09.390 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.08, Steps: 743, Distance 26.19, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 1235
2019-12-06 17:39:09.992 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 669
2019-12-06 17:39:09.993 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.79, Steps: 670, Distance 21.62, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.7, Angle accuracy 0.0, Num episodes 1236
2019-12-06 17:39:10.294 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 327
2019-12-06 17:39:10.295 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 230.04, Steps: 328, Distance 5.61, Angular velocity 0.0, Speed: 2.05, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.97, Angle accuracy 0.0, Num episodes 1237
2019-12-06 17:39:10.857 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:39:10.857 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.93, Steps: 635, Distance 19.8, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.4, Angle accuracy 0.0, Num episodes 1238
2019-12-06 17:39:11.473 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 675
2019-12-06 17:39:11.473 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.29, Steps: 676, Distance 22.2, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.74, Angle accuracy 0.0, Num episodes 1239
Warning: trajectory cut off by epoch at 450 steps.
---------------------------------------
| Epoch | 229 |
| AverageEpRet | 363 |
| StdEpRet | 64.7 |
| MaxEpRet | 416 |
| MinEpRet | 230 |
| EpLen | 592 |
| AverageVVals | 51.4 |
| StdVVals | 1.14e-05 |
| MaxVVals | 51.4 |
| MinVVals | 51.4 |
| TotalEnvInteracts | 9.2e+05 |
| LossPi | 3.03e-08 |
| LossV | 403 |
| DeltaLossPi | -0.000886 |
| DeltaLossV | -0.34 |
| Entropy | -1.82 |
| KL | 0.00258 |
| ClipFrac | 0.021 |
| StopIter | 79 |
| Time | 868 |
---------------------------------------
2019-12-06 17:39:12.639 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 702
2019-12-06 17:39:12.639 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.79, Steps: 703, Distance 24.04, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.08, Angle accuracy 0.0, Num episodes 1240
2019-12-06 17:39:13.116 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 529
2019-12-06 17:39:13.116 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.3, Steps: 530, Distance 14.38, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.8, Angle accuracy 0.0, Num episodes 1241
2019-12-06 17:39:13.809 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 747
2019-12-06 17:39:13.809 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.95, Steps: 748, Distance 26.75, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 1242
2019-12-06 17:39:14.477 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 754
2019-12-06 17:39:14.477 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.25, Steps: 755, Distance 27.03, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.59, Angle accuracy 0.0, Num episodes 1243
2019-12-06 17:39:15.248 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 804
2019-12-06 17:39:15.249 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.16, Steps: 805, Distance 30.24, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.97, Angle accuracy 0.0, Num episodes 1244
2019-12-06 17:39:15.634 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 433
2019-12-06 17:39:15.635 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.24, Steps: 434, Distance 9.84, Angular velocity 0.0, Speed: 2.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.1, Angle accuracy 0.0, Num episodes 1245
Warning: trajectory cut off by epoch at 25 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 230 |
| AverageEpRet | 392 |
| StdEpRet | 50.3 |
| MaxEpRet | 434 |
| MinEpRet | 299 |
| EpLen | 662 |
| AverageVVals | 52 |
| StdVVals | 1.16e-05 |
| MaxVVals | 52 |
| MinVVals | 52 |
| TotalEnvInteracts | 9.24e+05 |
| LossPi | 9.75e-08 |
| LossV | 482 |
| DeltaLossPi | -0.00176 |
| DeltaLossV | -9.74 |
| Entropy | -1.79 |
| KL | 0.0093 |
| ClipFrac | 0.0895 |
| StopIter | 79 |
| Time | 872 |
---------------------------------------
2019-12-06 17:39:16.527 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 459
2019-12-06 17:39:16.528 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 318.19, Steps: 460, Distance 11.16, Angular velocity 0.0, Speed: 2.84, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.0, Angle accuracy 0.0, Num episodes 1246
2019-12-06 17:39:17.128 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:39:17.129 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.44, Steps: 662, Distance 22.11, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.91, Angle accuracy 0.0, Num episodes 1247
2019-12-06 17:39:17.802 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:39:17.802 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.72, Steps: 726, Distance 25.77, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 1248
2019-12-06 17:39:18.350 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:39:18.351 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.73, Steps: 625, Distance 19.87, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.42, Angle accuracy 0.0, Num episodes 1249
2019-12-06 17:39:19.003 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 730
2019-12-06 17:39:19.003 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.33, Steps: 731, Distance 26.14, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 1250
2019-12-06 17:39:19.567 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:39:19.567 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.01, Steps: 639, Distance 20.59, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.54, Angle accuracy 0.0, Num episodes 1251
Warning: trajectory cut off by epoch at 157 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 231 |
| AverageEpRet | 389 |
| StdEpRet | 32.7 |
| MaxEpRet | 414 |
| MinEpRet | 318 |
| EpLen | 640 |
| AverageVVals | 48.8 |
| StdVVals | 7.65e-06 |
| MaxVVals | 48.8 |
| MinVVals | 48.8 |
| TotalEnvInteracts | 9.28e+05 |
| LossPi | -4.71e-09 |
| LossV | 445 |
| DeltaLossPi | 0.000954 |
| DeltaLossV | -3.5 |
| Entropy | -1.84 |
| KL | 0.00229 |
| ClipFrac | 0.00025 |
| StopIter | 6 |
| Time | 876 |
---------------------------------------
2019-12-06 17:39:20.329 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:39:20.330 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.14, Steps: 618, Distance 19.73, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.4, Angle accuracy 0.0, Num episodes 1252
2019-12-06 17:39:21.063 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 771
2019-12-06 17:39:21.063 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.64, Steps: 772, Distance 28.83, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.8, Angle accuracy 0.0, Num episodes 1253
2019-12-06 17:39:21.580 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 575
2019-12-06 17:39:21.580 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.67, Steps: 576, Distance 17.24, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.73, Angle accuracy 0.0, Num episodes 1254
2019-12-06 17:39:22.031 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 505
2019-12-06 17:39:22.031 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.21, Steps: 506, Distance 13.35, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.29, Angle accuracy 0.0, Num episodes 1255
2019-12-06 17:39:22.379 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 393
2019-12-06 17:39:22.380 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 278.09, Steps: 394, Distance 8.32, Angular velocity 0.0, Speed: 2.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.55, Angle accuracy 0.0, Num episodes 1256
2019-12-06 17:39:22.954 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:39:22.954 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.25, Steps: 651, Distance 21.26, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1257
Warning: trajectory cut off by epoch at 483 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 232 |
| AverageEpRet | 376 |
| StdEpRet | 50.1 |
| MaxEpRet | 436 |
| MinEpRet | 278 |
| EpLen | 586 |
| AverageVVals | 50.7 |
| StdVVals | 7.45e-06 |
| MaxVVals | 50.7 |
| MinVVals | 50.7 |
| TotalEnvInteracts | 9.32e+05 |
| LossPi | -3.03e-08 |
| LossV | 448 |
| DeltaLossPi | 8.71e-05 |
| DeltaLossV | -11 |
| Entropy | -1.86 |
| KL | -0.000158 |
| ClipFrac | 0.00025 |
| StopIter | 1 |
| Time | 880 |
---------------------------------------
2019-12-06 17:39:24.009 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 603
2019-12-06 17:39:24.009 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.79, Steps: 604, Distance 18.56, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.11, Angle accuracy 0.0, Num episodes 1258
2019-12-06 17:39:24.636 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:39:24.637 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.82, Steps: 705, Distance 24.93, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 1259
2019-12-06 17:39:25.018 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 428
2019-12-06 17:39:25.018 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 303.83, Steps: 429, Distance 9.98, Angular velocity 0.0, Speed: 2.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.14, Angle accuracy 0.0, Num episodes 1260
2019-12-06 17:39:25.484 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:39:25.484 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.0, Steps: 528, Distance 14.83, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.86, Angle accuracy 0.0, Num episodes 1261
2019-12-06 17:39:25.809 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 366
2019-12-06 17:39:25.809 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 256.57, Steps: 367, Distance 7.22, Angular velocity 0.0, Speed: 2.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.17, Angle accuracy 0.0, Num episodes 1262
2019-12-06 17:39:26.220 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 454
2019-12-06 17:39:26.220 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.29, Steps: 455, Distance 10.71, Angular velocity 0.0, Speed: 2.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.81, Angle accuracy 0.0, Num episodes 1263
2019-12-06 17:39:26.959 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 759
2019-12-06 17:39:26.960 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.86, Steps: 760, Distance 28.48, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.8, Angle accuracy 0.0, Num episodes 1264
Warning: trajectory cut off by epoch at 152 steps.
---------------------------------------
| Epoch | 233 |
| AverageEpRet | 352 |
| StdEpRet | 54.9 |
| MaxEpRet | 421 |
| MinEpRet | 257 |
| EpLen | 550 |
| AverageVVals | 54 |
| StdVVals | 1.14e-05 |
| MaxVVals | 54 |
| MinVVals | 54 |
| TotalEnvInteracts | 9.36e+05 |
| LossPi | 3.06e-08 |
| LossV | 427 |
| DeltaLossPi | -0.00107 |
| DeltaLossV | -3.57 |
| Entropy | -1.84 |
| KL | 0.000509 |
| ClipFrac | 0.00825 |
| StopIter | 79 |
| Time | 883 |
---------------------------------------
2019-12-06 17:39:27.806 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:39:27.806 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.49, Steps: 639, Distance 20.53, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.57, Angle accuracy 0.0, Num episodes 1265
2019-12-06 17:39:28.276 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 528
2019-12-06 17:39:28.277 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.03, Steps: 529, Distance 14.57, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.85, Angle accuracy 0.0, Num episodes 1266
2019-12-06 17:39:28.733 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 484
2019-12-06 17:39:28.733 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.72, Steps: 485, Distance 12.36, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.7, Angle accuracy 0.0, Num episodes 1267
2019-12-06 17:39:29.423 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 698
2019-12-06 17:39:29.424 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.43, Steps: 699, Distance 24.35, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.1, Angle accuracy 0.0, Num episodes 1268
2019-12-06 17:39:30.019 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 664
2019-12-06 17:39:30.019 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.39, Steps: 665, Distance 22.23, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1269
2019-12-06 17:39:30.604 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 657
2019-12-06 17:39:30.604 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.61, Steps: 658, Distance 22.05, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.83, Angle accuracy 0.0, Num episodes 1270
Warning: trajectory cut off by epoch at 325 steps.
---------------------------------------
| Epoch | 234 |
| AverageEpRet | 386 |
| StdEpRet | 30.5 |
| MaxEpRet | 420 |
| MinEpRet | 335 |
| EpLen | 612 |
| AverageVVals | 52.1 |
| StdVVals | 7.61e-06 |
| MaxVVals | 52.1 |
| MinVVals | 52.1 |
| TotalEnvInteracts | 9.4e+05 |
| LossPi | 3.62e-08 |
| LossV | 421 |
| DeltaLossPi | -0.00134 |
| DeltaLossV | -0.762 |
| Entropy | -1.85 |
| KL | 0.00311 |
| ClipFrac | 0.0255 |
| StopIter | 79 |
| Time | 887 |
---------------------------------------
2019-12-06 17:39:31.336 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 337
2019-12-06 17:39:31.336 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 238.11, Steps: 338, Distance 6.05, Angular velocity 0.0, Speed: 2.15, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 85.91, Angle accuracy 0.0, Num episodes 1271
2019-12-06 17:39:31.857 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 584
2019-12-06 17:39:31.857 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.76, Steps: 585, Distance 17.87, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.73, Angle accuracy 0.0, Num episodes 1272
2019-12-06 17:39:32.495 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 706
2019-12-06 17:39:32.495 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.32, Steps: 707, Distance 24.75, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1273
2019-12-06 17:39:32.805 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 351
2019-12-06 17:39:32.805 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 246.39, Steps: 352, Distance 6.73, Angular velocity 0.0, Speed: 2.28, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 87.17, Angle accuracy 0.0, Num episodes 1274
2019-12-06 17:39:33.383 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:39:33.383 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.58, Steps: 641, Distance 21.03, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.66, Angle accuracy 0.0, Num episodes 1275
2019-12-06 17:39:34.046 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 720
2019-12-06 17:39:34.047 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.77, Steps: 721, Distance 25.83, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1276
Warning: trajectory cut off by epoch at 656 steps.
---------------------------------------
| Epoch | 235 |
| AverageEpRet | 349 |
| StdEpRet | 77.4 |
| MaxEpRet | 419 |
| MinEpRet | 238 |
| EpLen | 557 |
| AverageVVals | 53 |
| StdVVals | 3.76e-06 |
| MaxVVals | 53 |
| MinVVals | 53 |
| TotalEnvInteracts | 9.44e+05 |
| LossPi | 4.27e-08 |
| LossV | 389 |
| DeltaLossPi | -0.0026 |
| DeltaLossV | -0.505 |
| Entropy | -1.82 |
| KL | 0.00264 |
| ClipFrac | 0.04 |
| StopIter | 79 |
| Time | 891 |
---------------------------------------
2019-12-06 17:39:35.373 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:39:35.374 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.82, Steps: 655, Distance 22.16, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1277
2019-12-06 17:39:35.742 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 415
2019-12-06 17:39:35.743 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 295.42, Steps: 416, Distance 9.2, Angular velocity 0.0, Speed: 2.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.29, Angle accuracy 0.0, Num episodes 1278
2019-12-06 17:39:36.373 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 700
2019-12-06 17:39:36.373 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.37, Steps: 701, Distance 24.91, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.36, Angle accuracy 0.0, Num episodes 1279
2019-12-06 17:39:37.031 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 731
2019-12-06 17:39:37.032 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.04, Steps: 732, Distance 26.57, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 1280
2019-12-06 17:39:37.706 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:39:37.707 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.2, Steps: 762, Distance 28.71, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 1281
2019-12-06 17:39:38.317 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:39:38.317 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.88, Steps: 689, Distance 24.28, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.06, Angle accuracy 0.0, Num episodes 1282
Warning: trajectory cut off by epoch at 45 steps.
Early stopping at step 21 due to reaching max kl.
---------------------------------------
| Epoch | 236 |
| AverageEpRet | 396 |
| StdEpRet | 45.7 |
| MaxEpRet | 426 |
| MinEpRet | 295 |
| EpLen | 659 |
| AverageVVals | 52.3 |
| StdVVals | 1.13e-05 |
| MaxVVals | 52.3 |
| MinVVals | 52.3 |
| TotalEnvInteracts | 9.48e+05 |
| LossPi | 8.86e-08 |
| LossV | 503 |
| DeltaLossPi | -0.000615 |
| DeltaLossV | -5.76 |
| Entropy | -1.86 |
| KL | 0.00034 |
| ClipFrac | 0.0005 |
| StopIter | 21 |
| Time | 895 |
---------------------------------------
2019-12-06 17:39:39.042 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 669
2019-12-06 17:39:39.042 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.3, Steps: 670, Distance 22.92, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.05, Angle accuracy 0.0, Num episodes 1283
2019-12-06 17:39:39.520 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:39:39.520 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 368.98, Steps: 545, Distance 15.72, Angular velocity 0.0, Speed: 3.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.29, Angle accuracy 0.0, Num episodes 1284
2019-12-06 17:39:40.159 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:39:40.159 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.75, Steps: 689, Distance 24.19, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 1285
2019-12-06 17:39:40.708 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 613
2019-12-06 17:39:40.709 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.31, Steps: 614, Distance 19.63, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.29, Angle accuracy 0.0, Num episodes 1286
2019-12-06 17:39:41.225 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 577
2019-12-06 17:39:41.226 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.84, Steps: 578, Distance 17.5, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.86, Angle accuracy 0.0, Num episodes 1287
2019-12-06 17:39:41.931 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 789
2019-12-06 17:39:41.931 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.4, Steps: 790, Distance 30.13, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.97, Angle accuracy 0.0, Num episodes 1288
Warning: trajectory cut off by epoch at 114 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 237 |
| AverageEpRet | 397 |
| StdEpRet | 22.5 |
| MaxEpRet | 430 |
| MinEpRet | 369 |
| EpLen | 648 |
| AverageVVals | 49.9 |
| StdVVals | 7.61e-06 |
| MaxVVals | 49.9 |
| MinVVals | 49.9 |
| TotalEnvInteracts | 9.52e+05 |
| LossPi | 8.13e-08 |
| LossV | 449 |
| DeltaLossPi | -0.00087 |
| DeltaLossV | -1.21 |
| Entropy | -1.85 |
| KL | 0.00153 |
| ClipFrac | 0.00225 |
| StopIter | 1 |
| Time | 898 |
---------------------------------------
2019-12-06 17:39:42.651 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:39:42.651 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.6, Steps: 601, Distance 18.9, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1289
2019-12-06 17:39:43.184 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 590
2019-12-06 17:39:43.184 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.05, Steps: 591, Distance 18.39, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.12, Angle accuracy 0.0, Num episodes 1290
2019-12-06 17:39:43.490 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 343
2019-12-06 17:39:43.490 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 245.72, Steps: 344, Distance 6.22, Angular velocity 0.0, Speed: 2.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.42, Angle accuracy 0.0, Num episodes 1291
2019-12-06 17:39:44.110 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 695
2019-12-06 17:39:44.110 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.61, Steps: 696, Distance 24.84, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.35, Angle accuracy 0.0, Num episodes 1292
2019-12-06 17:39:44.773 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 740
2019-12-06 17:39:44.773 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.96, Steps: 741, Distance 27.32, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.5, Angle accuracy 0.0, Num episodes 1293
2019-12-06 17:39:45.080 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 333
2019-12-06 17:39:45.081 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 239.46, Steps: 334, Distance 5.91, Angular velocity 0.0, Speed: 2.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 85.91, Angle accuracy 0.0, Num episodes 1294
2019-12-06 17:39:45.657 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 644
2019-12-06 17:39:45.658 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.62, Steps: 645, Distance 21.39, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.74, Angle accuracy 0.0, Num episodes 1295
Warning: trajectory cut off by epoch at 48 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 238 |
| AverageEpRet | 357 |
| StdEpRet | 73.6 |
| MaxEpRet | 428 |
| MinEpRet | 239 |
| EpLen | 565 |
| AverageVVals | 51 |
| StdVVals | 3.81e-06 |
| MaxVVals | 51 |
| MinVVals | 51 |
| TotalEnvInteracts | 9.56e+05 |
| LossPi | -4.59e-08 |
| LossV | 440 |
| DeltaLossPi | -7.18e-05 |
| DeltaLossV | -0.0153 |
| Entropy | -1.84 |
| KL | 0.00521 |
| ClipFrac | 0.0763 |
| StopIter | 1 |
| Time | 902 |
---------------------------------------
2019-12-06 17:39:46.283 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 550
2019-12-06 17:39:46.283 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 371.2, Steps: 551, Distance 16.13, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.36, Angle accuracy 0.0, Num episodes 1296
2019-12-06 17:39:46.646 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:39:46.646 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.42, Steps: 413, Distance 9.08, Angular velocity 0.0, Speed: 2.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.33, Angle accuracy 0.0, Num episodes 1297
2019-12-06 17:39:47.277 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 709
2019-12-06 17:39:47.277 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.92, Steps: 710, Distance 25.64, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 1298
2019-12-06 17:39:47.726 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 499
2019-12-06 17:39:47.727 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.59, Steps: 500, Distance 13.32, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.26, Angle accuracy 0.0, Num episodes 1299
2019-12-06 17:39:48.378 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 724
2019-12-06 17:39:48.379 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.41, Steps: 725, Distance 25.95, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 1300
2019-12-06 17:39:49.095 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 793
2019-12-06 17:39:49.095 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.84, Steps: 794, Distance 30.99, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.95, Angle accuracy 0.0, Num episodes 1301
Warning: trajectory cut off by epoch at 307 steps.
---------------------------------------
| Epoch | 239 |
| AverageEpRet | 382 |
| StdEpRet | 52.1 |
| MaxEpRet | 434 |
| MinEpRet | 288 |
| EpLen | 616 |
| AverageVVals | 51.1 |
| StdVVals | 4.63e-07 |
| MaxVVals | 51.1 |
| MinVVals | 51.1 |
| TotalEnvInteracts | 9.6e+05 |
| LossPi | -2.33e-08 |
| LossV | 447 |
| DeltaLossPi | -0.00244 |
| DeltaLossV | -0.806 |
| Entropy | -1.85 |
| KL | 0.00211 |
| ClipFrac | 0.0095 |
| StopIter | 79 |
| Time | 906 |
---------------------------------------
2019-12-06 17:39:50.014 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 537
2019-12-06 17:39:50.014 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.22, Steps: 538, Distance 15.38, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.13, Angle accuracy 0.0, Num episodes 1302
2019-12-06 17:39:50.761 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 803
2019-12-06 17:39:50.762 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.12, Steps: 804, Distance 31.06, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.9, Angle accuracy 0.0, Num episodes 1303
2019-12-06 17:39:51.291 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:39:51.291 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.77, Steps: 593, Distance 18.75, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.94, Angle accuracy 0.0, Num episodes 1304
2019-12-06 17:39:51.909 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 687
2019-12-06 17:39:51.909 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.92, Steps: 688, Distance 23.85, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.03, Angle accuracy 0.0, Num episodes 1305
2019-12-06 17:39:52.468 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 569
2019-12-06 17:39:52.468 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 371.89, Steps: 570, Distance 17.01, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.68, Angle accuracy 0.0, Num episodes 1306
2019-12-06 17:39:52.887 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 466
2019-12-06 17:39:52.887 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.84, Steps: 467, Distance 11.78, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.32, Angle accuracy 0.0, Num episodes 1307
Warning: trajectory cut off by epoch at 340 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 240 |
| AverageEpRet | 385 |
| StdEpRet | 37 |
| MaxEpRet | 443 |
| MinEpRet | 327 |
| EpLen | 610 |
| AverageVVals | 52 |
| StdVVals | 7.63e-06 |
| MaxVVals | 52 |
| MinVVals | 52 |
| TotalEnvInteracts | 9.64e+05 |
| LossPi | -8.69e-08 |
| LossV | 409 |
| DeltaLossPi | -0.00308 |
| DeltaLossV | -0.801 |
| Entropy | -1.83 |
| KL | 0.00317 |
| ClipFrac | 0.025 |
| StopIter | 79 |
| Time | 910 |
---------------------------------------
2019-12-06 17:39:54.136 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 550
2019-12-06 17:39:54.136 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 371.71, Steps: 551, Distance 15.99, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.12, Angle accuracy 0.0, Num episodes 1308
2019-12-06 17:39:54.807 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 748
2019-12-06 17:39:54.808 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.0, Steps: 749, Distance 27.55, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.54, Angle accuracy 0.0, Num episodes 1309
2019-12-06 17:39:55.430 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:39:55.431 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.66, Steps: 697, Distance 24.54, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 1310
2019-12-06 17:39:55.991 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 611
2019-12-06 17:39:55.992 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.25, Steps: 612, Distance 19.51, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1311
2019-12-06 17:39:56.356 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 411
2019-12-06 17:39:56.357 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.46, Steps: 412, Distance 9.07, Angular velocity 0.0, Speed: 2.66, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 90.11, Angle accuracy 0.0, Num episodes 1312
2019-12-06 17:39:57.051 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 767
2019-12-06 17:39:57.051 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.97, Steps: 768, Distance 29.03, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.83, Angle accuracy 0.0, Num episodes 1313
Warning: trajectory cut off by epoch at 211 steps.
Early stopping at step 17 due to reaching max kl.
---------------------------------------
| Epoch | 241 |
| AverageEpRet | 393 |
| StdEpRet | 52.6 |
| MaxEpRet | 441 |
| MinEpRet | 287 |
| EpLen | 632 |
| AverageVVals | 52.9 |
| StdVVals | 1.14e-05 |
| MaxVVals | 52.9 |
| MinVVals | 52.9 |
| TotalEnvInteracts | 9.68e+05 |
| LossPi | 4.29e-08 |
| LossV | 432 |
| DeltaLossPi | -0.000377 |
| DeltaLossV | -0.542 |
| Entropy | -1.84 |
| KL | 0.000619 |
| ClipFrac | 0 |
| StopIter | 17 |
| Time | 913 |
---------------------------------------
2019-12-06 17:39:57.934 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 685
2019-12-06 17:39:57.934 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.82, Steps: 686, Distance 23.78, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.97, Angle accuracy 0.0, Num episodes 1314
2019-12-06 17:39:58.539 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:39:58.540 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.4, Steps: 666, Distance 22.7, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.94, Angle accuracy 0.0, Num episodes 1315
2019-12-06 17:39:59.110 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:39:59.110 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.67, Steps: 635, Distance 20.66, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.45, Angle accuracy 0.0, Num episodes 1316
2019-12-06 17:39:59.603 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 534
2019-12-06 17:39:59.604 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 366.35, Steps: 535, Distance 14.99, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.91, Angle accuracy 0.0, Num episodes 1317
2019-12-06 17:40:00.167 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:40:00.167 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.55, Steps: 587, Distance 17.78, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.87, Angle accuracy 0.0, Num episodes 1318
2019-12-06 17:40:00.591 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 475
2019-12-06 17:40:00.591 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.79, Steps: 476, Distance 11.94, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.57, Angle accuracy 0.0, Num episodes 1319
Warning: trajectory cut off by epoch at 415 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 242 |
| AverageEpRet | 388 |
| StdEpRet | 32.1 |
| MaxEpRet | 421 |
| MinEpRet | 329 |
| EpLen | 598 |
| AverageVVals | 52.2 |
| StdVVals | 7.36e-07 |
| MaxVVals | 52.2 |
| MinVVals | 52.2 |
| TotalEnvInteracts | 9.72e+05 |
| LossPi | 2.89e-08 |
| LossV | 395 |
| DeltaLossPi | -0.00158 |
| DeltaLossV | -7.82 |
| Entropy | -1.82 |
| KL | 0.00144 |
| ClipFrac | 0.0015 |
| StopIter | 3 |
| Time | 917 |
---------------------------------------
2019-12-06 17:40:01.595 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:40:01.596 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.08, Steps: 629, Distance 20.46, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.38, Angle accuracy 0.0, Num episodes 1320
2019-12-06 17:40:01.911 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 347
2019-12-06 17:40:01.911 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 252.97, Steps: 348, Distance 6.39, Angular velocity 0.0, Speed: 2.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.78, Angle accuracy 0.0, Num episodes 1321
2019-12-06 17:40:02.512 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 657
2019-12-06 17:40:02.512 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.59, Steps: 658, Distance 22.13, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.87, Angle accuracy 0.0, Num episodes 1322
2019-12-06 17:40:03.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 560
2019-12-06 17:40:03.012 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.3, Steps: 561, Distance 16.48, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.48, Angle accuracy 0.0, Num episodes 1323
2019-12-06 17:40:03.665 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 722
2019-12-06 17:40:03.666 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.1, Steps: 723, Distance 25.92, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 1324
2019-12-06 17:40:04.291 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 681
2019-12-06 17:40:04.291 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.5, Steps: 682, Distance 23.51, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.03, Angle accuracy 0.0, Num episodes 1325
Warning: trajectory cut off by epoch at 399 steps.
---------------------------------------
| Epoch | 243 |
| AverageEpRet | 386 |
| StdEpRet | 62.7 |
| MaxEpRet | 439 |
| MinEpRet | 253 |
| EpLen | 600 |
| AverageVVals | 55 |
| StdVVals | 7.84e-06 |
| MaxVVals | 55 |
| MinVVals | 55 |
| TotalEnvInteracts | 9.76e+05 |
| LossPi | 4.33e-08 |
| LossV | 416 |
| DeltaLossPi | -0.00114 |
| DeltaLossV | -0.29 |
| Entropy | -1.84 |
| KL | 0.00208 |
| ClipFrac | 0.0055 |
| StopIter | 79 |
| Time | 921 |
---------------------------------------
2019-12-06 17:40:05.314 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 578
2019-12-06 17:40:05.315 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.09, Steps: 579, Distance 17.51, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.65, Angle accuracy 0.0, Num episodes 1326
2019-12-06 17:40:05.925 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:40:05.925 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.59, Steps: 689, Distance 24.11, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 1327
2019-12-06 17:40:06.534 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 667
2019-12-06 17:40:06.534 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.67, Steps: 668, Distance 22.96, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.86, Angle accuracy 0.0, Num episodes 1328
2019-12-06 17:40:07.161 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:40:07.162 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.15, Steps: 690, Distance 24.22, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.07, Angle accuracy 0.0, Num episodes 1329
2019-12-06 17:40:07.589 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 477
2019-12-06 17:40:07.590 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 331.5, Steps: 478, Distance 12.22, Angular velocity 0.0, Speed: 3.0, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.71, Angle accuracy 0.0, Num episodes 1330
2019-12-06 17:40:08.147 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 616
2019-12-06 17:40:08.148 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.56, Steps: 617, Distance 19.76, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.37, Angle accuracy 0.0, Num episodes 1331
Warning: trajectory cut off by epoch at 279 steps.
---------------------------------------
| Epoch | 244 |
| AverageEpRet | 396 |
| StdEpRet | 30.6 |
| MaxEpRet | 424 |
| MinEpRet | 332 |
| EpLen | 620 |
| AverageVVals | 54.5 |
| StdVVals | 7.63e-06 |
| MaxVVals | 54.5 |
| MinVVals | 54.5 |
| TotalEnvInteracts | 9.8e+05 |
| LossPi | 5.34e-08 |
| LossV | 393 |
| DeltaLossPi | -0.00112 |
| DeltaLossV | -0.492 |
| Entropy | -1.85 |
| KL | 0.00108 |
| ClipFrac | 0.02 |
| StopIter | 79 |
| Time | 925 |
---------------------------------------
2019-12-06 17:40:08.872 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 365
2019-12-06 17:40:08.873 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 260.01, Steps: 366, Distance 7.15, Angular velocity 0.0, Speed: 2.38, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 87.74, Angle accuracy 0.0, Num episodes 1332
2019-12-06 17:40:09.340 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 500
2019-12-06 17:40:09.340 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.33, Steps: 501, Distance 13.33, Angular velocity 0.0, Speed: 3.11, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.06, Angle accuracy 0.0, Num episodes 1333
2019-12-06 17:40:09.845 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 558
2019-12-06 17:40:09.845 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.86, Steps: 559, Distance 16.69, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.37, Angle accuracy 0.0, Num episodes 1334
2019-12-06 17:40:10.557 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 757
2019-12-06 17:40:10.558 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.73, Steps: 758, Distance 28.82, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.75, Angle accuracy 0.0, Num episodes 1335
2019-12-06 17:40:10.849 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 321
2019-12-06 17:40:10.849 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 219.27, Steps: 322, Distance 5.57, Angular velocity 0.0, Speed: 2.08, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 85.04, Angle accuracy 0.0, Num episodes 1336
2019-12-06 17:40:11.494 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 720
2019-12-06 17:40:11.495 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.57, Steps: 721, Distance 26.23, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1337
2019-12-06 17:40:12.055 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:40:12.055 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.13, Steps: 625, Distance 20.48, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.35, Angle accuracy 0.0, Num episodes 1338
Warning: trajectory cut off by epoch at 148 steps.
---------------------------------------
| Epoch | 245 |
| AverageEpRet | 353 |
| StdEpRet | 76.9 |
| MaxEpRet | 431 |
| MinEpRet | 219 |
| EpLen | 550 |
| AverageVVals | 53.7 |
| StdVVals | 7.66e-06 |
| MaxVVals | 53.7 |
| MinVVals | 53.7 |
| TotalEnvInteracts | 9.84e+05 |
| LossPi | -5.03e-08 |
| LossV | 401 |
| DeltaLossPi | -0.00266 |
| DeltaLossV | -2.65 |
| Entropy | -1.83 |
| KL | 0.000368 |
| ClipFrac | 0.0117 |
| StopIter | 79 |
| Time | 928 |
---------------------------------------
2019-12-06 17:40:12.932 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 670
2019-12-06 17:40:12.932 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.66, Steps: 671, Distance 23.05, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1339
2019-12-06 17:40:13.325 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 431
2019-12-06 17:40:13.326 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 309.93, Steps: 432, Distance 9.99, Angular velocity 0.0, Speed: 2.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.21, Angle accuracy 0.0, Num episodes 1340
2019-12-06 17:40:13.997 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 752
2019-12-06 17:40:13.997 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.54, Steps: 753, Distance 28.61, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.78, Angle accuracy 0.0, Num episodes 1341
2019-12-06 17:40:14.483 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 539
2019-12-06 17:40:14.484 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 373.71, Steps: 540, Distance 15.32, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.0, Angle accuracy 0.0, Num episodes 1342
2019-12-06 17:40:15.120 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 712
2019-12-06 17:40:15.121 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.75, Steps: 713, Distance 26.01, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 1343
2019-12-06 17:40:15.698 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:40:15.698 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.91, Steps: 646, Distance 21.57, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.79, Angle accuracy 0.0, Num episodes 1344
Warning: trajectory cut off by epoch at 245 steps.
Early stopping at step 9 due to reaching max kl.
---------------------------------------
| Epoch | 246 |
| AverageEpRet | 396 |
| StdEpRet | 43.3 |
| MaxEpRet | 433 |
| MinEpRet | 310 |
| EpLen | 626 |
| AverageVVals | 52.1 |
| StdVVals | 7.66e-06 |
| MaxVVals | 52.1 |
| MinVVals | 52.1 |
| TotalEnvInteracts | 9.88e+05 |
| LossPi | -1.23e-08 |
| LossV | 410 |
| DeltaLossPi | -5.22e-05 |
| DeltaLossV | -1.34 |
| Entropy | -1.86 |
| KL | 1.87e-05 |
| ClipFrac | 0 |
| StopIter | 9 |
| Time | 932 |
---------------------------------------
2019-12-06 17:40:16.704 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 776
2019-12-06 17:40:16.705 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.72, Steps: 777, Distance 29.87, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.92, Angle accuracy 0.0, Num episodes 1345
2019-12-06 17:40:17.341 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 716
2019-12-06 17:40:17.342 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.68, Steps: 717, Distance 26.0, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1346
2019-12-06 17:40:17.956 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 686
2019-12-06 17:40:17.956 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.93, Steps: 687, Distance 24.47, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.2, Angle accuracy 0.0, Num episodes 1347
2019-12-06 17:40:18.743 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 826
2019-12-06 17:40:18.743 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 457.84, Steps: 827, Distance 33.54, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.24, Angle accuracy 0.0, Num episodes 1348
2019-12-06 17:40:19.454 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 786
2019-12-06 17:40:19.455 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.43, Steps: 787, Distance 30.62, Angular velocity 0.0, Speed: 3.96, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.0, Angle accuracy 0.0, Num episodes 1349
Warning: trajectory cut off by epoch at 205 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 247 |
| AverageEpRet | 447 |
| StdEpRet | 7.67 |
| MaxEpRet | 458 |
| MinEpRet | 435 |
| EpLen | 759 |
| AverageVVals | 53.3 |
| StdVVals | 7.59e-06 |
| MaxVVals | 53.3 |
| MinVVals | 53.3 |
| TotalEnvInteracts | 9.92e+05 |
| LossPi | 3.04e-08 |
| LossV | 510 |
| DeltaLossPi | -3.48e-05 |
| DeltaLossV | -7.28 |
| Entropy | -1.87 |
| KL | 0.00247 |
| ClipFrac | 0.042 |
| StopIter | 3 |
| Time | 936 |
---------------------------------------
2019-12-06 17:40:20.357 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 722
2019-12-06 17:40:20.358 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.72, Steps: 723, Distance 26.73, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.56, Angle accuracy 0.0, Num episodes 1350
2019-12-06 17:40:20.798 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 494
2019-12-06 17:40:20.799 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 353.03, Steps: 495, Distance 13.18, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.14, Angle accuracy 0.0, Num episodes 1351
2019-12-06 17:40:21.405 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:40:21.405 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.5, Steps: 684, Distance 24.51, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.19, Angle accuracy 0.0, Num episodes 1352
2019-12-06 17:40:22.007 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 673
2019-12-06 17:40:22.007 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.03, Steps: 674, Distance 23.84, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.0, Angle accuracy 0.0, Num episodes 1353
2019-12-06 17:40:22.754 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 837
2019-12-06 17:40:22.754 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 466.34, Steps: 838, Distance 34.06, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.23, Angle accuracy 0.0, Num episodes 1354
Warning: trajectory cut off by epoch at 586 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 248 |
| AverageEpRet | 422 |
| StdEpRet | 38 |
| MaxEpRet | 466 |
| MinEpRet | 353 |
| EpLen | 683 |
| AverageVVals | 50.5 |
| StdVVals | 3.77e-06 |
| MaxVVals | 50.5 |
| MinVVals | 50.5 |
| TotalEnvInteracts | 9.96e+05 |
| LossPi | 4.43e-08 |
| LossV | 451 |
| DeltaLossPi | -0.000158 |
| DeltaLossV | -7.35 |
| Entropy | -1.87 |
| KL | 1.24e-05 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 939 |
---------------------------------------
2019-12-06 17:40:23.903 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 636
2019-12-06 17:40:23.904 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.71, Steps: 637, Distance 21.46, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.56, Angle accuracy 0.0, Num episodes 1355
2019-12-06 17:40:24.648 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 812
2019-12-06 17:40:24.648 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.87, Steps: 813, Distance 32.89, Angular velocity 0.0, Speed: 4.02, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.18, Angle accuracy 0.0, Num episodes 1356
2019-12-06 17:40:24.973 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 369
2019-12-06 17:40:24.974 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 261.72, Steps: 370, Distance 7.44, Angular velocity 0.0, Speed: 2.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.41, Angle accuracy 0.0, Num episodes 1357
2019-12-06 17:40:25.576 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 644
2019-12-06 17:40:25.577 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.77, Steps: 645, Distance 22.04, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.74, Angle accuracy 0.0, Num episodes 1358
2019-12-06 17:40:26.147 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:40:26.148 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.46, Steps: 643, Distance 21.86, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.66, Angle accuracy 0.0, Num episodes 1359
2019-12-06 17:40:26.634 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:40:26.634 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.38, Steps: 548, Distance 16.22, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.4, Angle accuracy 0.0, Num episodes 1360
Warning: trajectory cut off by epoch at 344 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 249 |
| AverageEpRet | 389 |
| StdEpRet | 60.6 |
| MaxEpRet | 452 |
| MinEpRet | 262 |
| EpLen | 609 |
| AverageVVals | 53.3 |
| StdVVals | 7.62e-06 |
| MaxVVals | 53.3 |
| MinVVals | 53.3 |
| TotalEnvInteracts | 1e+06 |
| LossPi | 2.93e-08 |
| LossV | 430 |
| DeltaLossPi | -0.000452 |
| DeltaLossV | -0.13 |
| Entropy | -1.88 |
| KL | 0.00341 |
| ClipFrac | 0.0115 |
| StopIter | 1 |
| Time | 943 |
---------------------------------------
2019-12-06 17:40:27.539 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 581
2019-12-06 17:40:27.540 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 391.06, Steps: 582, Distance 18.01, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.84, Angle accuracy 0.0, Num episodes 1361
2019-12-06 17:40:28.135 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 660
2019-12-06 17:40:28.135 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.5, Steps: 661, Distance 23.06, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.09, Angle accuracy 0.0, Num episodes 1362
2019-12-06 17:40:28.588 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 496
2019-12-06 17:40:28.588 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 346.97, Steps: 497, Distance 13.35, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.09, Angle accuracy 0.0, Num episodes 1363
2019-12-06 17:40:29.199 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:40:29.200 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.24, Steps: 695, Distance 25.02, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.38, Angle accuracy 0.0, Num episodes 1364
2019-12-06 17:40:29.835 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 720
2019-12-06 17:40:29.835 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.44, Steps: 721, Distance 26.43, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.36, Angle accuracy 0.0, Num episodes 1365
2019-12-06 17:40:30.476 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 716
2019-12-06 17:40:30.476 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.78, Steps: 717, Distance 26.33, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.56, Angle accuracy 0.0, Num episodes 1366
Warning: trajectory cut off by epoch at 127 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 250 |
| AverageEpRet | 409 |
| StdEpRet | 31.6 |
| MaxEpRet | 437 |
| MinEpRet | 347 |
| EpLen | 646 |
| AverageVVals | 53.6 |
| StdVVals | 7.62e-06 |
| MaxVVals | 53.6 |
| MinVVals | 53.6 |
| TotalEnvInteracts | 1e+06 |
| LossPi | 5.99e-08 |
| LossV | 441 |
| DeltaLossPi | -0.00112 |
| DeltaLossV | -0.38 |
| Entropy | -1.86 |
| KL | 0.00213 |
| ClipFrac | 0.023 |
| StopIter | 79 |
| Time | 947 |
---------------------------------------
2019-12-06 17:40:31.693 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 695
2019-12-06 17:40:31.694 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.33, Steps: 696, Distance 25.29, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.32, Angle accuracy 0.0, Num episodes 1367
2019-12-06 17:40:32.274 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 636
2019-12-06 17:40:32.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.97, Steps: 637, Distance 21.65, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.8, Angle accuracy 0.0, Num episodes 1368
2019-12-06 17:40:32.714 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 496
2019-12-06 17:40:32.714 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.28, Steps: 497, Distance 13.53, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.38, Angle accuracy 0.0, Num episodes 1369
2019-12-06 17:40:33.264 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 618
2019-12-06 17:40:33.264 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.3, Steps: 619, Distance 20.56, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.41, Angle accuracy 0.0, Num episodes 1370
2019-12-06 17:40:33.864 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 680
2019-12-06 17:40:33.865 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.76, Steps: 681, Distance 24.34, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 1371
2019-12-06 17:40:34.436 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 644
2019-12-06 17:40:34.437 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.63, Steps: 645, Distance 22.15, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.84, Angle accuracy 0.0, Num episodes 1372
Warning: trajectory cut off by epoch at 225 steps.
---------------------------------------
| Epoch | 251 |
| AverageEpRet | 404 |
| StdEpRet | 26.9 |
| MaxEpRet | 428 |
| MinEpRet | 345 |
| EpLen | 629 |
| AverageVVals | 53 |
| StdVVals | 7.65e-06 |
| MaxVVals | 53 |
| MinVVals | 53 |
| TotalEnvInteracts | 1.01e+06 |
| LossPi | 1.49e-11 |
| LossV | 416 |
| DeltaLossPi | -0.00188 |
| DeltaLossV | -1.16 |
| Entropy | -1.88 |
| KL | 0.00268 |
| ClipFrac | 0.006 |
| StopIter | 79 |
| Time | 951 |
---------------------------------------
2019-12-06 17:40:35.199 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 450
2019-12-06 17:40:35.200 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.04, Steps: 451, Distance 11.31, Angular velocity 0.0, Speed: 2.99, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.07, Angle accuracy 0.0, Num episodes 1373
2019-12-06 17:40:35.807 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 684
2019-12-06 17:40:35.807 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.55, Steps: 685, Distance 24.63, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.17, Angle accuracy 0.0, Num episodes 1374
2019-12-06 17:40:36.437 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:40:36.437 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.24, Steps: 708, Distance 25.9, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.38, Angle accuracy 0.0, Num episodes 1375
2019-12-06 17:40:37.142 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 760
2019-12-06 17:40:37.143 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.62, Steps: 761, Distance 29.69, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.8, Angle accuracy 0.0, Num episodes 1376
2019-12-06 17:40:37.701 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 626
2019-12-06 17:40:37.701 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.29, Steps: 627, Distance 21.05, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.72, Angle accuracy 0.0, Num episodes 1377
2019-12-06 17:40:38.117 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 468
2019-12-06 17:40:38.118 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.12, Steps: 469, Distance 12.01, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.41, Angle accuracy 0.0, Num episodes 1378
Warning: trajectory cut off by epoch at 299 steps.
---------------------------------------
| Epoch | 252 |
| AverageEpRet | 390 |
| StdEpRet | 49 |
| MaxEpRet | 438 |
| MinEpRet | 323 |
| EpLen | 617 |
| AverageVVals | 54.1 |
| StdVVals | 1.15e-05 |
| MaxVVals | 54.1 |
| MinVVals | 54.1 |
| TotalEnvInteracts | 1.01e+06 |
| LossPi | -1.84e-08 |
| LossV | 430 |
| DeltaLossPi | -0.00381 |
| DeltaLossV | -0.644 |
| Entropy | -1.88 |
| KL | 0.00425 |
| ClipFrac | 0.0333 |
| StopIter | 79 |
| Time | 955 |
---------------------------------------
2019-12-06 17:40:39.143 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 690
2019-12-06 17:40:39.144 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.45, Steps: 691, Distance 24.8, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.27, Angle accuracy 0.0, Num episodes 1379
2019-12-06 17:40:39.770 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:40:39.770 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.18, Steps: 705, Distance 25.81, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.37, Angle accuracy 0.0, Num episodes 1380
2019-12-06 17:40:40.316 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 601
2019-12-06 17:40:40.317 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 388.04, Steps: 602, Distance 19.48, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.34, Angle accuracy 0.0, Num episodes 1381
2019-12-06 17:40:40.873 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:40:40.874 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.72, Steps: 607, Distance 19.54, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.28, Angle accuracy 0.0, Num episodes 1382
2019-12-06 17:40:41.555 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 764
2019-12-06 17:40:41.555 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.92, Steps: 765, Distance 29.87, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.82, Angle accuracy 0.0, Num episodes 1383
2019-12-06 17:40:41.976 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 474
2019-12-06 17:40:41.977 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 335.03, Steps: 475, Distance 12.37, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.59, Angle accuracy 0.0, Num episodes 1384
Warning: trajectory cut off by epoch at 155 steps.
---------------------------------------
| Epoch | 253 |
| AverageEpRet | 395 |
| StdEpRet | 30.5 |
| MaxEpRet | 426 |
| MinEpRet | 335 |
| EpLen | 641 |
| AverageVVals | 53.3 |
| StdVVals | 1.91e-07 |
| MaxVVals | 53.3 |
| MinVVals | 53.3 |
| TotalEnvInteracts | 1.02e+06 |
| LossPi | 3.73e-08 |
| LossV | 443 |
| DeltaLossPi | -0.00231 |
| DeltaLossV | -3.08 |
| Entropy | -1.84 |
| KL | 0.00371 |
| ClipFrac | 0.0245 |
| StopIter | 79 |
| Time | 958 |
---------------------------------------
2019-12-06 17:40:42.969 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 776
2019-12-06 17:40:42.969 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.69, Steps: 777, Distance 30.48, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.02, Angle accuracy 0.0, Num episodes 1385
2019-12-06 17:40:43.543 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:40:43.543 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.65, Steps: 641, Distance 21.76, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.75, Angle accuracy 0.0, Num episodes 1386
2019-12-06 17:40:44.205 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 711
2019-12-06 17:40:44.205 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.12, Steps: 712, Distance 26.35, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 1387
2019-12-06 17:40:44.652 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 488
2019-12-06 17:40:44.652 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.53, Steps: 489, Distance 13.19, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.18, Angle accuracy 0.0, Num episodes 1388
2019-12-06 17:40:45.274 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 695
2019-12-06 17:40:45.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.78, Steps: 696, Distance 25.35, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 1389
Warning: trajectory cut off by epoch at 685 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 254 |
| AverageEpRet | 405 |
| StdEpRet | 35.9 |
| MaxEpRet | 439 |
| MinEpRet | 340 |
| EpLen | 663 |
| AverageVVals | 51.5 |
| StdVVals | 3.8e-06 |
| MaxVVals | 51.5 |
| MinVVals | 51.5 |
| TotalEnvInteracts | 1.02e+06 |
| LossPi | 5.73e-08 |
| LossV | 412 |
| DeltaLossPi | -0.0014 |
| DeltaLossV | -0.4 |
| Entropy | -1.81 |
| KL | 0.00217 |
| ClipFrac | 0.0268 |
| StopIter | 6 |
| Time | 962 |
---------------------------------------
2019-12-06 17:40:46.367 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 464
2019-12-06 17:40:46.367 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.3, Steps: 465, Distance 11.71, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.21, Angle accuracy 0.0, Num episodes 1390
2019-12-06 17:40:46.830 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 518
2019-12-06 17:40:46.831 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.01, Steps: 519, Distance 14.74, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.8, Angle accuracy 0.0, Num episodes 1391
2019-12-06 17:40:47.579 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 812
2019-12-06 17:40:47.580 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.88, Steps: 813, Distance 32.99, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 97.19, Angle accuracy 0.0, Num episodes 1392
2019-12-06 17:40:47.897 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 355
2019-12-06 17:40:47.897 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 250.1, Steps: 356, Distance 6.83, Angular velocity 0.0, Speed: 2.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.26, Angle accuracy 0.0, Num episodes 1393
2019-12-06 17:40:48.490 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 657
2019-12-06 17:40:48.491 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.1, Steps: 658, Distance 22.94, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1394
2019-12-06 17:40:48.946 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 504
2019-12-06 17:40:48.947 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.19, Steps: 505, Distance 13.73, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.51, Angle accuracy 0.0, Num episodes 1395
Warning: trajectory cut off by epoch at 684 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 255 |
| AverageEpRet | 353 |
| StdEpRet | 60 |
| MaxEpRet | 444 |
| MinEpRet | 250 |
| EpLen | 553 |
| AverageVVals | 52.1 |
| StdVVals | 3.87e-06 |
| MaxVVals | 52.1 |
| MinVVals | 52.1 |
| TotalEnvInteracts | 1.02e+06 |
| LossPi | 4.89e-09 |
| LossV | 361 |
| DeltaLossPi | -0.00119 |
| DeltaLossV | -0.766 |
| Entropy | -1.83 |
| KL | 0.00166 |
| ClipFrac | 0.0335 |
| StopIter | 1 |
| Time | 966 |
---------------------------------------
2019-12-06 17:40:50.284 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 737
2019-12-06 17:40:50.284 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.25, Steps: 738, Distance 27.97, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 1396
2019-12-06 17:40:50.870 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 643
2019-12-06 17:40:50.871 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.82, Steps: 644, Distance 21.67, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1397
2019-12-06 17:40:51.552 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 763
2019-12-06 17:40:51.552 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.18, Steps: 764, Distance 29.5, Angular velocity 0.0, Speed: 3.92, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 1398
2019-12-06 17:40:52.041 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 534
2019-12-06 17:40:52.042 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.68, Steps: 535, Distance 15.35, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.15, Angle accuracy 0.0, Num episodes 1399
2019-12-06 17:40:52.573 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:40:52.574 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.73, Steps: 586, Distance 18.27, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.85, Angle accuracy 0.0, Num episodes 1400
2019-12-06 17:40:52.924 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 387
2019-12-06 17:40:52.924 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.32, Steps: 388, Distance 8.0, Angular velocity 0.0, Speed: 2.52, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.11, Angle accuracy 0.0, Num episodes 1401
Warning: trajectory cut off by epoch at 345 steps.
---------------------------------------
| Epoch | 256 |
| AverageEpRet | 383 |
| StdEpRet | 50.8 |
| MaxEpRet | 434 |
| MinEpRet | 284 |
| EpLen | 609 |
| AverageVVals | 53 |
| StdVVals | 1.14e-05 |
| MaxVVals | 53 |
| MinVVals | 53 |
| TotalEnvInteracts | 1.03e+06 |
| LossPi | -1.73e-08 |
| LossV | 404 |
| DeltaLossPi | -0.00159 |
| DeltaLossV | -0.159 |
| Entropy | -1.82 |
| KL | 0.000644 |
| ClipFrac | 0.0085 |
| StopIter | 79 |
| Time | 970 |
---------------------------------------
2019-12-06 17:40:53.921 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:40:53.922 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.57, Steps: 593, Distance 18.72, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.04, Angle accuracy 0.0, Num episodes 1402
2019-12-06 17:40:54.483 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 633
2019-12-06 17:40:54.483 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.35, Steps: 634, Distance 21.17, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.61, Angle accuracy 0.0, Num episodes 1403
2019-12-06 17:40:55.081 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:40:55.082 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.54, Steps: 638, Distance 21.4, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.63, Angle accuracy 0.0, Num episodes 1404
2019-12-06 17:40:55.702 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 687
2019-12-06 17:40:55.703 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.02, Steps: 688, Distance 24.29, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.18, Angle accuracy 0.0, Num episodes 1405
2019-12-06 17:40:56.216 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 579
2019-12-06 17:40:56.216 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.04, Steps: 580, Distance 17.84, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.69, Angle accuracy 0.0, Num episodes 1406
2019-12-06 17:40:56.506 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 327
2019-12-06 17:40:56.507 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 231.91, Steps: 328, Distance 5.74, Angular velocity 0.0, Speed: 2.14, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 85.35, Angle accuracy 0.0, Num episodes 1407
Warning: trajectory cut off by epoch at 539 steps.
---------------------------------------
| Epoch | 257 |
| AverageEpRet | 374 |
| StdEpRet | 65.3 |
| MaxEpRet | 427 |
| MinEpRet | 232 |
| EpLen | 577 |
| AverageVVals | 52.6 |
| StdVVals | 7.63e-06 |
| MaxVVals | 52.6 |
| MinVVals | 52.6 |
| TotalEnvInteracts | 1.03e+06 |
| LossPi | -3.1e-09 |
| LossV | 370 |
| DeltaLossPi | -0.00121 |
| DeltaLossV | -4.32 |
| Entropy | -1.83 |
| KL | 0.000481 |
| ClipFrac | 0.019 |
| StopIter | 79 |
| Time | 973 |
---------------------------------------
2019-12-06 17:40:57.788 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 737
2019-12-06 17:40:57.788 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.48, Steps: 738, Distance 27.46, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.5, Angle accuracy 0.0, Num episodes 1408
2019-12-06 17:40:58.135 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 389
2019-12-06 17:40:58.135 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 283.8, Steps: 390, Distance 8.01, Angular velocity 0.0, Speed: 2.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.31, Angle accuracy 0.0, Num episodes 1409
2019-12-06 17:40:58.574 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:40:58.575 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.37, Steps: 503, Distance 13.61, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.16, Angle accuracy 0.0, Num episodes 1410
2019-12-06 17:40:58.951 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 425
2019-12-06 17:40:58.951 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 303.61, Steps: 426, Distance 9.69, Angular velocity 0.0, Speed: 2.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.9, Angle accuracy 0.0, Num episodes 1411
2019-12-06 17:40:59.589 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 712
2019-12-06 17:40:59.589 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.86, Steps: 713, Distance 25.78, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.27, Angle accuracy 0.0, Num episodes 1412
2019-12-06 17:41:00.225 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 717
2019-12-06 17:41:00.225 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.31, Steps: 718, Distance 26.16, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.45, Angle accuracy 0.0, Num episodes 1413
Warning: trajectory cut off by epoch at 512 steps.
---------------------------------------
| Epoch | 258 |
| AverageEpRet | 371 |
| StdEpRet | 61.7 |
| MaxEpRet | 433 |
| MinEpRet | 284 |
| EpLen | 581 |
| AverageVVals | 54.8 |
| StdVVals | 3.81e-06 |
| MaxVVals | 54.8 |
| MinVVals | 54.8 |
| TotalEnvInteracts | 1.04e+06 |
| LossPi | 4.23e-09 |
| LossV | 401 |
| DeltaLossPi | -0.00183 |
| DeltaLossV | -0.515 |
| Entropy | -1.85 |
| KL | 0.00455 |
| ClipFrac | 0.0225 |
| StopIter | 79 |
| Time | 977 |
---------------------------------------
2019-12-06 17:41:01.306 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:41:01.307 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 363.38, Steps: 532, Distance 15.13, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.98, Angle accuracy 0.0, Num episodes 1414
2019-12-06 17:41:01.758 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 512
2019-12-06 17:41:01.758 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.97, Steps: 513, Distance 14.16, Angular velocity 0.0, Speed: 3.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.61, Angle accuracy 0.0, Num episodes 1415
2019-12-06 17:41:02.128 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 414
2019-12-06 17:41:02.129 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 292.23, Steps: 415, Distance 9.3, Angular velocity 0.0, Speed: 2.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.35, Angle accuracy 0.0, Num episodes 1416
2019-12-06 17:41:02.781 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 733
2019-12-06 17:41:02.782 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.52, Steps: 734, Distance 27.15, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 1417
2019-12-06 17:41:03.480 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 776
2019-12-06 17:41:03.480 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.66, Steps: 777, Distance 29.94, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.86, Angle accuracy 0.0, Num episodes 1418
2019-12-06 17:41:03.853 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 413
2019-12-06 17:41:03.853 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.4, Steps: 414, Distance 9.14, Angular velocity 0.0, Speed: 2.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.22, Angle accuracy 0.0, Num episodes 1419
Warning: trajectory cut off by epoch at 615 steps.
---------------------------------------
| Epoch | 259 |
| AverageEpRet | 359 |
| StdEpRet | 58.1 |
| MaxEpRet | 434 |
| MinEpRet | 282 |
| EpLen | 564 |
| AverageVVals | 54 |
| StdVVals | 7.62e-06 |
| MaxVVals | 54 |
| MinVVals | 54 |
| TotalEnvInteracts | 1.04e+06 |
| LossPi | 1.59e-08 |
| LossV | 378 |
| DeltaLossPi | -0.00259 |
| DeltaLossV | -0.363 |
| Entropy | -1.84 |
| KL | 0.00292 |
| ClipFrac | 0.038 |
| StopIter | 79 |
| Time | 981 |
---------------------------------------
2019-12-06 17:41:05.028 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:41:05.028 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.6, Steps: 545, Distance 15.63, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.17, Angle accuracy 0.0, Num episodes 1420
2019-12-06 17:41:05.647 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 693
2019-12-06 17:41:05.648 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.87, Steps: 694, Distance 25.1, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1421
2019-12-06 17:41:06.299 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 716
2019-12-06 17:41:06.299 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.53, Steps: 717, Distance 26.19, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 1422
2019-12-06 17:41:06.829 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:41:06.830 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.59, Steps: 586, Distance 18.38, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.06, Angle accuracy 0.0, Num episodes 1423
2019-12-06 17:41:07.368 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 584
2019-12-06 17:41:07.369 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.21, Steps: 585, Distance 18.4, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.94, Angle accuracy 0.0, Num episodes 1424
2019-12-06 17:41:08.003 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:41:08.003 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.71, Steps: 714, Distance 26.28, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 1425
Warning: trajectory cut off by epoch at 159 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 260 |
| AverageEpRet | 400 |
| StdEpRet | 21.6 |
| MaxEpRet | 423 |
| MinEpRet | 373 |
| EpLen | 640 |
| AverageVVals | 53.4 |
| StdVVals | 7.64e-06 |
| MaxVVals | 53.4 |
| MinVVals | 53.4 |
| TotalEnvInteracts | 1.04e+06 |
| LossPi | -2.36e-08 |
| LossV | 423 |
| DeltaLossPi | -0.00234 |
| DeltaLossV | -0.996 |
| Entropy | -1.82 |
| KL | 0.00359 |
| ClipFrac | 0.0275 |
| StopIter | 79 |
| Time | 985 |
---------------------------------------
2019-12-06 17:41:09.157 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:41:09.158 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.55, Steps: 608, Distance 19.59, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.15, Angle accuracy 0.0, Num episodes 1426
2019-12-06 17:41:09.730 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:41:09.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.08, Steps: 629, Distance 20.99, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1427
2019-12-06 17:41:10.385 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:41:10.386 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.42, Steps: 739, Distance 27.48, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.55, Angle accuracy 0.0, Num episodes 1428
2019-12-06 17:41:10.874 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 553
2019-12-06 17:41:10.874 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 374.52, Steps: 554, Distance 16.33, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.37, Angle accuracy 0.0, Num episodes 1429
2019-12-06 17:41:11.322 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 501
2019-12-06 17:41:11.323 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.84, Steps: 502, Distance 13.58, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.34, Angle accuracy 0.0, Num episodes 1430
2019-12-06 17:41:11.834 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 573
2019-12-06 17:41:11.834 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.26, Steps: 574, Distance 17.28, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.67, Angle accuracy 0.0, Num episodes 1431
Warning: trajectory cut off by epoch at 394 steps.
---------------------------------------
| Epoch | 261 |
| AverageEpRet | 393 |
| StdEpRet | 25.8 |
| MaxEpRet | 437 |
| MinEpRet | 355 |
| EpLen | 601 |
| AverageVVals | 52.4 |
| StdVVals | 3.8e-06 |
| MaxVVals | 52.4 |
| MinVVals | 52.4 |
| TotalEnvInteracts | 1.05e+06 |
| LossPi | -3.41e-08 |
| LossV | 395 |
| DeltaLossPi | -0.00109 |
| DeltaLossV | -8.6 |
| Entropy | -1.84 |
| KL | 0.00186 |
| ClipFrac | 0.027 |
| StopIter | 79 |
| Time | 988 |
---------------------------------------
2019-12-06 17:41:12.859 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:41:12.860 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.53, Steps: 596, Distance 18.82, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.21, Angle accuracy 0.0, Num episodes 1432
2019-12-06 17:41:13.483 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 693
2019-12-06 17:41:13.483 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.44, Steps: 694, Distance 24.86, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 1433
2019-12-06 17:41:14.116 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:41:14.117 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.7, Steps: 692, Distance 24.38, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.15, Angle accuracy 0.0, Num episodes 1434
2019-12-06 17:41:14.775 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 739
2019-12-06 17:41:14.776 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.76, Steps: 740, Distance 27.6, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.71, Angle accuracy 0.0, Num episodes 1435
2019-12-06 17:41:15.433 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 726
2019-12-06 17:41:15.433 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.81, Steps: 727, Distance 26.83, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1436
2019-12-06 17:41:15.804 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 419
2019-12-06 17:41:15.805 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 298.24, Steps: 420, Distance 9.33, Angular velocity 0.0, Speed: 2.7, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 90.72, Angle accuracy 0.0, Num episodes 1437
Warning: trajectory cut off by epoch at 131 steps.
---------------------------------------
| Epoch | 262 |
| AverageEpRet | 404 |
| StdEpRet | 48.8 |
| MaxEpRet | 436 |
| MinEpRet | 298 |
| EpLen | 645 |
| AverageVVals | 55.4 |
| StdVVals | 7.64e-06 |
| MaxVVals | 55.4 |
| MinVVals | 55.4 |
| TotalEnvInteracts | 1.05e+06 |
| LossPi | 3.25e-08 |
| LossV | 446 |
| DeltaLossPi | -0.00241 |
| DeltaLossV | -7.96 |
| Entropy | -1.86 |
| KL | 0.00248 |
| ClipFrac | 0.0487 |
| StopIter | 79 |
| Time | 992 |
---------------------------------------
2019-12-06 17:41:16.555 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:41:16.555 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 366.67, Steps: 548, Distance 15.75, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.07, Angle accuracy 0.0, Num episodes 1438
2019-12-06 17:41:17.137 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 651
2019-12-06 17:41:17.137 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.01, Steps: 652, Distance 21.72, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.6, Angle accuracy 0.0, Num episodes 1439
2019-12-06 17:41:17.767 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:41:17.767 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.41, Steps: 697, Distance 24.8, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1440
2019-12-06 17:41:18.342 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:41:18.342 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.71, Steps: 646, Distance 21.44, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.63, Angle accuracy 0.0, Num episodes 1441
2019-12-06 17:41:18.806 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:41:18.806 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.23, Steps: 521, Distance 14.25, Angular velocity 0.0, Speed: 3.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.53, Angle accuracy 0.0, Num episodes 1442
2019-12-06 17:41:19.357 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:41:19.357 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.9, Steps: 603, Distance 19.04, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.06, Angle accuracy 0.0, Num episodes 1443
Warning: trajectory cut off by epoch at 333 steps.
---------------------------------------
| Epoch | 263 |
| AverageEpRet | 399 |
| StdEpRet | 25.7 |
| MaxEpRet | 432 |
| MinEpRet | 364 |
| EpLen | 611 |
| AverageVVals | 52.5 |
| StdVVals | 7.69e-06 |
| MaxVVals | 52.5 |
| MinVVals | 52.5 |
| TotalEnvInteracts | 1.06e+06 |
| LossPi | 7.39e-09 |
| LossV | 387 |
| DeltaLossPi | -0.00154 |
| DeltaLossV | -5.96 |
| Entropy | -1.86 |
| KL | 0.00383 |
| ClipFrac | 0.03 |
| StopIter | 79 |
| Time | 996 |
---------------------------------------
2019-12-06 17:41:20.248 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 510
2019-12-06 17:41:20.248 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.85, Steps: 511, Distance 13.97, Angular velocity 0.0, Speed: 3.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.53, Angle accuracy 0.0, Num episodes 1444
2019-12-06 17:41:20.879 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:41:20.879 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.69, Steps: 708, Distance 25.47, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.24, Angle accuracy 0.0, Num episodes 1445
2019-12-06 17:41:21.516 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:41:21.516 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.99, Steps: 714, Distance 25.66, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.38, Angle accuracy 0.0, Num episodes 1446
2019-12-06 17:41:22.218 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 792
2019-12-06 17:41:22.219 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.31, Steps: 793, Distance 30.92, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.92, Angle accuracy 0.0, Num episodes 1447
2019-12-06 17:41:22.856 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 723
2019-12-06 17:41:22.856 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.53, Steps: 724, Distance 26.48, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1448
Warning: trajectory cut off by epoch at 550 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 264 |
| AverageEpRet | 421 |
| StdEpRet | 38.6 |
| MaxEpRet | 455 |
| MinEpRet | 346 |
| EpLen | 690 |
| AverageVVals | 55 |
| StdVVals | 7.64e-06 |
| MaxVVals | 55 |
| MinVVals | 55 |
| TotalEnvInteracts | 1.06e+06 |
| LossPi | 6.09e-08 |
| LossV | 435 |
| DeltaLossPi | 0.000731 |
| DeltaLossV | -2.79 |
| Entropy | -1.87 |
| KL | 0.00187 |
| ClipFrac | 0.0122 |
| StopIter | 6 |
| Time | 1e+03 |
---------------------------------------
2019-12-06 17:41:23.913 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 559
2019-12-06 17:41:23.913 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.86, Steps: 560, Distance 16.37, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.27, Angle accuracy 0.0, Num episodes 1449
2019-12-06 17:41:24.439 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 589
2019-12-06 17:41:24.440 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.13, Steps: 590, Distance 18.1, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.95, Angle accuracy 0.0, Num episodes 1450
2019-12-06 17:41:25.059 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 701
2019-12-06 17:41:25.060 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.94, Steps: 702, Distance 24.95, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.16, Angle accuracy 0.0, Num episodes 1451
2019-12-06 17:41:25.658 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 675
2019-12-06 17:41:25.658 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.43, Steps: 676, Distance 23.28, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.03, Angle accuracy 0.0, Num episodes 1452
2019-12-06 17:41:25.953 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 331
2019-12-06 17:41:25.953 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 236.71, Steps: 332, Distance 5.61, Angular velocity 0.0, Speed: 2.07, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.97, Angle accuracy 0.0, Num episodes 1453
2019-12-06 17:41:26.511 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:41:26.512 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.35, Steps: 618, Distance 19.59, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.22, Angle accuracy 0.0, Num episodes 1454
2019-12-06 17:41:26.946 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 483
2019-12-06 17:41:26.946 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.33, Steps: 484, Distance 12.22, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.5, Angle accuracy 0.0, Num episodes 1455
Warning: trajectory cut off by epoch at 38 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 265 |
| AverageEpRet | 375 |
| StdEpRet | 62.7 |
| MaxEpRet | 432 |
| MinEpRet | 237 |
| EpLen | 566 |
| AverageVVals | 53.3 |
| StdVVals | 0 |
| MaxVVals | 53.3 |
| MinVVals | 53.3 |
| TotalEnvInteracts | 1.06e+06 |
| LossPi | 8.56e-08 |
| LossV | 390 |
| DeltaLossPi | 0.00037 |
| DeltaLossV | -0.844 |
| Entropy | -1.87 |
| KL | 0.000411 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1e+03 |
---------------------------------------
2019-12-06 17:41:27.788 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 826
2019-12-06 17:41:27.789 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.26, Steps: 827, Distance 33.13, Angular velocity 0.0, Speed: 4.01, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.18, Angle accuracy 0.0, Num episodes 1456
2019-12-06 17:41:28.427 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 726
2019-12-06 17:41:28.428 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.4, Steps: 727, Distance 26.35, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.54, Angle accuracy 0.0, Num episodes 1457
2019-12-06 17:41:28.948 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:41:28.948 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.11, Steps: 548, Distance 15.59, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.13, Angle accuracy 0.0, Num episodes 1458
2019-12-06 17:41:29.557 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:41:29.557 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.64, Steps: 643, Distance 21.16, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.53, Angle accuracy 0.0, Num episodes 1459
2019-12-06 17:41:30.201 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 728
2019-12-06 17:41:30.202 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.75, Steps: 729, Distance 26.79, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.58, Angle accuracy 0.0, Num episodes 1460
Warning: trajectory cut off by epoch at 526 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 266 |
| AverageEpRet | 425 |
| StdEpRet | 28.5 |
| MaxEpRet | 459 |
| MinEpRet | 375 |
| EpLen | 695 |
| AverageVVals | 54.2 |
| StdVVals | 4.09e-07 |
| MaxVVals | 54.2 |
| MinVVals | 54.2 |
| TotalEnvInteracts | 1.07e+06 |
| LossPi | -2.41e-08 |
| LossV | 435 |
| DeltaLossPi | -0.00029 |
| DeltaLossV | -1.03 |
| Entropy | -1.85 |
| KL | 0.00112 |
| ClipFrac | 0.0005 |
| StopIter | 1 |
| Time | 1.01e+03 |
---------------------------------------
2019-12-06 17:41:31.147 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 455
2019-12-06 17:41:31.147 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.61, Steps: 456, Distance 10.81, Angular velocity 0.0, Speed: 2.88, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.82, Angle accuracy 0.0, Num episodes 1461
2019-12-06 17:41:31.702 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 623
2019-12-06 17:41:31.702 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.5, Steps: 624, Distance 20.0, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.31, Angle accuracy 0.0, Num episodes 1462
2019-12-06 17:41:32.209 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 561
2019-12-06 17:41:32.209 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.54, Steps: 562, Distance 16.52, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.55, Angle accuracy 0.0, Num episodes 1463
2019-12-06 17:41:32.830 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:41:32.830 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.48, Steps: 689, Distance 23.89, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.2, Angle accuracy 0.0, Num episodes 1464
2019-12-06 17:41:33.426 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 657
2019-12-06 17:41:33.427 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.94, Steps: 658, Distance 22.2, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.86, Angle accuracy 0.0, Num episodes 1465
2019-12-06 17:41:33.746 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 359
2019-12-06 17:41:33.747 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 250.67, Steps: 360, Distance 6.82, Angular velocity 0.0, Speed: 2.32, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.39, Angle accuracy 0.0, Num episodes 1466
2019-12-06 17:41:34.162 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 466
2019-12-06 17:41:34.162 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.54, Steps: 467, Distance 11.5, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.23, Angle accuracy 0.0, Num episodes 1467
Warning: trajectory cut off by epoch at 184 steps.
---------------------------------------
| Epoch | 267 |
| AverageEpRet | 364 |
| StdEpRet | 61.6 |
| MaxEpRet | 435 |
| MinEpRet | 251 |
| EpLen | 545 |
| AverageVVals | 53.2 |
| StdVVals | 3.8e-06 |
| MaxVVals | 53.2 |
| MinVVals | 53.2 |
| TotalEnvInteracts | 1.07e+06 |
| LossPi | -2.94e-08 |
| LossV | 374 |
| DeltaLossPi | -0.0015 |
| DeltaLossV | -2.39 |
| Entropy | -1.87 |
| KL | 0.00146 |
| ClipFrac | 0.0165 |
| StopIter | 79 |
| Time | 1.01e+03 |
---------------------------------------
2019-12-06 17:41:35.024 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 623
2019-12-06 17:41:35.025 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.29, Steps: 624, Distance 19.73, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.24, Angle accuracy 0.0, Num episodes 1468
2019-12-06 17:41:35.545 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 584
2019-12-06 17:41:35.546 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.58, Steps: 585, Distance 17.58, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.74, Angle accuracy 0.0, Num episodes 1469
2019-12-06 17:41:35.819 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 312
2019-12-06 17:41:35.820 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 226.15, Steps: 313, Distance 5.06, Angular velocity 0.0, Speed: 2.0, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 83.65, Angle accuracy 0.0, Num episodes 1470
2019-12-06 17:41:36.513 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 749
2019-12-06 17:41:36.514 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.99, Steps: 750, Distance 28.52, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 1471
2019-12-06 17:41:36.971 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 506
2019-12-06 17:41:36.971 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 343.45, Steps: 507, Distance 13.37, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.06, Angle accuracy 0.0, Num episodes 1472
2019-12-06 17:41:37.509 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:41:37.509 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.81, Steps: 605, Distance 18.76, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.16, Angle accuracy 0.0, Num episodes 1473
2019-12-06 17:41:37.988 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 536
2019-12-06 17:41:37.988 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.62, Steps: 537, Distance 15.05, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.92, Angle accuracy 0.0, Num episodes 1474
Warning: trajectory cut off by epoch at 79 steps.
---------------------------------------
| Epoch | 268 |
| AverageEpRet | 369 |
| StdEpRet | 65.4 |
| MaxEpRet | 440 |
| MinEpRet | 226 |
| EpLen | 560 |
| AverageVVals | 54.8 |
| StdVVals | 1.14e-05 |
| MaxVVals | 54.8 |
| MinVVals | 54.8 |
| TotalEnvInteracts | 1.08e+06 |
| LossPi | -7.32e-08 |
| LossV | 396 |
| DeltaLossPi | -0.00318 |
| DeltaLossV | -0.668 |
| Entropy | -1.88 |
| KL | 0.00251 |
| ClipFrac | 0.0243 |
| StopIter | 79 |
| Time | 1.01e+03 |
---------------------------------------
2019-12-06 17:41:38.818 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 671
2019-12-06 17:41:38.818 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.27, Steps: 672, Distance 22.69, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.86, Angle accuracy 0.0, Num episodes 1475
2019-12-06 17:41:39.292 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 528
2019-12-06 17:41:39.293 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.92, Steps: 529, Distance 14.59, Angular velocity 0.0, Speed: 3.26, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.61, Angle accuracy 0.0, Num episodes 1476
2019-12-06 17:41:39.732 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 499
2019-12-06 17:41:39.733 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.77, Steps: 500, Distance 13.16, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.12, Angle accuracy 0.0, Num episodes 1477
2019-12-06 17:41:40.328 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 668
2019-12-06 17:41:40.329 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.27, Steps: 669, Distance 22.86, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.93, Angle accuracy 0.0, Num episodes 1478
2019-12-06 17:41:40.827 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:41:40.828 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.88, Steps: 564, Distance 16.58, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.54, Angle accuracy 0.0, Num episodes 1479
2019-12-06 17:41:41.466 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 701
2019-12-06 17:41:41.467 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.31, Steps: 702, Distance 25.15, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 1480
2019-12-06 17:41:41.785 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 351
2019-12-06 17:41:41.786 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 246.61, Steps: 352, Distance 6.29, Angular velocity 0.0, Speed: 2.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.44, Angle accuracy 0.0, Num episodes 1481
Warning: trajectory cut off by epoch at 12 steps.
---------------------------------------
| Epoch | 269 |
| AverageEpRet | 380 |
| StdEpRet | 64.6 |
| MaxEpRet | 442 |
| MinEpRet | 247 |
| EpLen | 570 |
| AverageVVals | 53.9 |
| StdVVals | 7.63e-06 |
| MaxVVals | 53.9 |
| MinVVals | 53.9 |
| TotalEnvInteracts | 1.08e+06 |
| LossPi | 1.57e-08 |
| LossV | 412 |
| DeltaLossPi | -0.00215 |
| DeltaLossV | -0.589 |
| Entropy | -1.88 |
| KL | 0.0022 |
| ClipFrac | 0.0333 |
| StopIter | 79 |
| Time | 1.02e+03 |
---------------------------------------
2019-12-06 17:41:42.594 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 714
2019-12-06 17:41:42.595 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.06, Steps: 715, Distance 26.04, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.52, Angle accuracy 0.0, Num episodes 1482
2019-12-06 17:41:43.198 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:41:43.199 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.7, Steps: 675, Distance 23.2, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.92, Angle accuracy 0.0, Num episodes 1483
2019-12-06 17:41:43.842 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 719
2019-12-06 17:41:43.843 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.69, Steps: 720, Distance 26.57, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 1484
2019-12-06 17:41:44.443 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:41:44.443 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.11, Steps: 660, Distance 22.57, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.0, Angle accuracy 0.0, Num episodes 1485
2019-12-06 17:41:45.051 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 673
2019-12-06 17:41:45.051 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.27, Steps: 674, Distance 23.18, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.92, Angle accuracy 0.0, Num episodes 1486
Warning: trajectory cut off by epoch at 556 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 270 |
| AverageEpRet | 434 |
| StdEpRet | 5.37 |
| MaxEpRet | 438 |
| MinEpRet | 423 |
| EpLen | 689 |
| AverageVVals | 54.7 |
| StdVVals | 7.65e-06 |
| MaxVVals | 54.7 |
| MinVVals | 54.7 |
| TotalEnvInteracts | 1.08e+06 |
| LossPi | 8.13e-08 |
| LossV | 437 |
| DeltaLossPi | -0.00061 |
| DeltaLossV | -0.0115 |
| Entropy | -1.91 |
| KL | 0.000806 |
| ClipFrac | 0.0122 |
| StopIter | 79 |
| Time | 1.02e+03 |
---------------------------------------
2019-12-06 17:41:46.527 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:41:46.527 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.52, Steps: 539, Distance 15.46, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.09, Angle accuracy 0.0, Num episodes 1487
2019-12-06 17:41:47.071 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:41:47.072 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.89, Steps: 613, Distance 19.63, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.31, Angle accuracy 0.0, Num episodes 1488
2019-12-06 17:41:47.442 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 405
2019-12-06 17:41:47.442 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.92, Steps: 406, Distance 8.71, Angular velocity 0.0, Speed: 2.61, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 89.96, Angle accuracy 0.0, Num episodes 1489
2019-12-06 17:41:48.117 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:41:48.117 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.06, Steps: 746, Distance 28.25, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 1490
2019-12-06 17:41:48.584 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:41:48.584 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.0, Steps: 520, Distance 14.33, Angular velocity 0.0, Speed: 3.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.57, Angle accuracy 0.0, Num episodes 1491
2019-12-06 17:41:49.072 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 541
2019-12-06 17:41:49.072 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.9, Steps: 542, Distance 15.69, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.15, Angle accuracy 0.0, Num episodes 1492
Warning: trajectory cut off by epoch at 634 steps.
---------------------------------------
| Epoch | 271 |
| AverageEpRet | 375 |
| StdEpRet | 47.4 |
| MaxEpRet | 447 |
| MinEpRet | 289 |
| EpLen | 561 |
| AverageVVals | 54.8 |
| StdVVals | 0 |
| MaxVVals | 54.8 |
| MinVVals | 54.8 |
| TotalEnvInteracts | 1.09e+06 |
| LossPi | -1.91e-08 |
| LossV | 368 |
| DeltaLossPi | -0.00142 |
| DeltaLossV | -1.35 |
| Entropy | -1.88 |
| KL | 0.0015 |
| ClipFrac | 0.019 |
| StopIter | 79 |
| Time | 1.03e+03 |
---------------------------------------
2019-12-06 17:41:50.092 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 301
2019-12-06 17:41:50.092 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 214.19, Steps: 302, Distance 4.89, Angular velocity 0.0, Speed: 1.96, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 83.32, Angle accuracy 0.0, Num episodes 1493
2019-12-06 17:41:50.701 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:41:50.702 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.61, Steps: 690, Distance 24.81, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 1494
2019-12-06 17:41:51.262 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 630
2019-12-06 17:41:51.262 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.29, Steps: 631, Distance 21.17, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.6, Angle accuracy 0.0, Num episodes 1495
2019-12-06 17:41:51.683 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 473
2019-12-06 17:41:51.683 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.15, Steps: 474, Distance 12.05, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.42, Angle accuracy 0.0, Num episodes 1496
2019-12-06 17:41:52.252 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:41:52.252 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.48, Steps: 641, Distance 21.53, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.61, Angle accuracy 0.0, Num episodes 1497
2019-12-06 17:41:52.893 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:41:52.894 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.03, Steps: 716, Distance 26.13, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1498
Warning: trajectory cut off by epoch at 546 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 272 |
| AverageEpRet | 380 |
| StdEpRet | 81.9 |
| MaxEpRet | 441 |
| MinEpRet | 214 |
| EpLen | 576 |
| AverageVVals | 56 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56 |
| MinVVals | 56 |
| TotalEnvInteracts | 1.09e+06 |
| LossPi | 6.54e-08 |
| LossV | 393 |
| DeltaLossPi | -0.0028 |
| DeltaLossV | -0.0172 |
| Entropy | -1.92 |
| KL | 0.00303 |
| ClipFrac | 0.0322 |
| StopIter | 2 |
| Time | 1.03e+03 |
---------------------------------------
2019-12-06 17:41:54.066 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:41:54.067 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.87, Steps: 684, Distance 24.65, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.3, Angle accuracy 0.0, Num episodes 1499
2019-12-06 17:41:54.531 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 522
2019-12-06 17:41:54.531 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.37, Steps: 523, Distance 14.82, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.96, Angle accuracy 0.0, Num episodes 1500
2019-12-06 17:41:55.095 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:41:55.096 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.75, Steps: 636, Distance 21.55, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.58, Angle accuracy 0.0, Num episodes 1501
2019-12-06 17:41:55.627 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:41:55.627 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.63, Steps: 593, Distance 19.06, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.15, Angle accuracy 0.0, Num episodes 1502
2019-12-06 17:41:56.297 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:41:56.298 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.49, Steps: 726, Distance 27.15, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.63, Angle accuracy 0.0, Num episodes 1503
2019-12-06 17:41:56.832 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:41:56.833 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.15, Steps: 601, Distance 19.3, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1504
Warning: trajectory cut off by epoch at 237 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 273 |
| AverageEpRet | 407 |
| StdEpRet | 19.4 |
| MaxEpRet | 438 |
| MinEpRet | 377 |
| EpLen | 627 |
| AverageVVals | 55.9 |
| StdVVals | 1.04e-07 |
| MaxVVals | 55.9 |
| MinVVals | 55.9 |
| TotalEnvInteracts | 1.1e+06 |
| LossPi | 6.79e-08 |
| LossV | 429 |
| DeltaLossPi | -0.000633 |
| DeltaLossV | -1.34 |
| Entropy | -1.91 |
| KL | 0.00396 |
| ClipFrac | 0.0803 |
| StopIter | 3 |
| Time | 1.03e+03 |
---------------------------------------
2019-12-06 17:41:57.775 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 708
2019-12-06 17:41:57.775 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.01, Steps: 709, Distance 26.46, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.5, Angle accuracy 0.0, Num episodes 1505
2019-12-06 17:41:58.400 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:41:58.400 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.56, Steps: 700, Distance 25.81, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1506
2019-12-06 17:41:58.778 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 408
2019-12-06 17:41:58.778 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 285.02, Steps: 409, Distance 9.2, Angular velocity 0.0, Speed: 2.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.23, Angle accuracy 0.0, Num episodes 1507
2019-12-06 17:41:59.329 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:41:59.329 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.9, Steps: 608, Distance 20.11, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.49, Angle accuracy 0.0, Num episodes 1508
2019-12-06 17:41:59.960 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 714
2019-12-06 17:41:59.960 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.11, Steps: 715, Distance 26.54, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.6, Angle accuracy 0.0, Num episodes 1509
2019-12-06 17:42:00.502 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:42:00.502 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.21, Steps: 615, Distance 20.57, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.41, Angle accuracy 0.0, Num episodes 1510
Warning: trajectory cut off by epoch at 244 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 274 |
| AverageEpRet | 399 |
| StdEpRet | 53.3 |
| MaxEpRet | 443 |
| MinEpRet | 285 |
| EpLen | 626 |
| AverageVVals | 54.7 |
| StdVVals | 7.62e-06 |
| MaxVVals | 54.7 |
| MinVVals | 54.7 |
| TotalEnvInteracts | 1.1e+06 |
| LossPi | -4.85e-08 |
| LossV | 442 |
| DeltaLossPi | -0.00129 |
| DeltaLossV | -1.14 |
| Entropy | -1.9 |
| KL | 0.00168 |
| ClipFrac | 0.013 |
| StopIter | 1 |
| Time | 1.04e+03 |
---------------------------------------
2019-12-06 17:42:01.226 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 479
2019-12-06 17:42:01.227 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 352.7, Steps: 480, Distance 12.72, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.99, Angle accuracy 0.0, Num episodes 1511
2019-12-06 17:42:01.852 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:42:01.853 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.47, Steps: 695, Distance 25.29, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.3, Angle accuracy 0.0, Num episodes 1512
2019-12-06 17:42:02.417 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 626
2019-12-06 17:42:02.417 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.26, Steps: 627, Distance 21.23, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.58, Angle accuracy 0.0, Num episodes 1513
2019-12-06 17:42:02.977 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 630
2019-12-06 17:42:02.978 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.45, Steps: 631, Distance 21.61, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.81, Angle accuracy 0.0, Num episodes 1514
2019-12-06 17:42:03.418 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 491
2019-12-06 17:42:03.418 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 347.18, Steps: 492, Distance 13.41, Angular velocity 0.0, Speed: 3.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.19, Angle accuracy 0.0, Num episodes 1515
2019-12-06 17:42:03.992 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 646
2019-12-06 17:42:03.992 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.91, Steps: 647, Distance 22.74, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 96.01, Angle accuracy 0.0, Num episodes 1516
Warning: trajectory cut off by epoch at 428 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 275 |
| AverageEpRet | 392 |
| StdEpRet | 30.5 |
| MaxEpRet | 419 |
| MinEpRet | 347 |
| EpLen | 595 |
| AverageVVals | 53.6 |
| StdVVals | 7.63e-06 |
| MaxVVals | 53.6 |
| MinVVals | 53.6 |
| TotalEnvInteracts | 1.1e+06 |
| LossPi | 3.25e-08 |
| LossV | 394 |
| DeltaLossPi | -0.00141 |
| DeltaLossV | -4.44 |
| Entropy | -1.9 |
| KL | 0.00251 |
| ClipFrac | 0.0245 |
| StopIter | 1 |
| Time | 1.04e+03 |
---------------------------------------
2019-12-06 17:42:05.144 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 765
2019-12-06 17:42:05.144 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 460.41, Steps: 766, Distance 30.37, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.98, Angle accuracy 0.0, Num episodes 1517
2019-12-06 17:42:05.536 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 423
2019-12-06 17:42:05.537 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 297.88, Steps: 424, Distance 9.99, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.22, Angle accuracy 0.0, Num episodes 1518
2019-12-06 17:42:06.124 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:42:06.125 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.03, Steps: 655, Distance 22.86, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.81, Angle accuracy 0.0, Num episodes 1519
2019-12-06 17:42:06.730 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 684
2019-12-06 17:42:06.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.29, Steps: 685, Distance 24.87, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.24, Angle accuracy 0.0, Num episodes 1520
2019-12-06 17:42:07.104 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 398
2019-12-06 17:42:07.105 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 289.39, Steps: 399, Distance 8.59, Angular velocity 0.0, Speed: 2.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.79, Angle accuracy 0.0, Num episodes 1521
2019-12-06 17:42:07.729 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 680
2019-12-06 17:42:07.729 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.93, Steps: 681, Distance 24.78, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.19, Angle accuracy 0.0, Num episodes 1522
Warning: trajectory cut off by epoch at 390 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 276 |
| AverageEpRet | 390 |
| StdEpRet | 69 |
| MaxEpRet | 460 |
| MinEpRet | 289 |
| EpLen | 602 |
| AverageVVals | 55.8 |
| StdVVals | 7.65e-06 |
| MaxVVals | 55.8 |
| MinVVals | 55.8 |
| TotalEnvInteracts | 1.11e+06 |
| LossPi | 7.3e-08 |
| LossV | 432 |
| DeltaLossPi | -0.00135 |
| DeltaLossV | -1.15 |
| Entropy | -1.91 |
| KL | 7.98e-05 |
| ClipFrac | 0.012 |
| StopIter | 1 |
| Time | 1.04e+03 |
---------------------------------------
2019-12-06 17:42:08.466 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 359
2019-12-06 17:42:08.466 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 266.02, Steps: 360, Distance 7.1, Angular velocity 0.0, Speed: 2.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.67, Angle accuracy 0.0, Num episodes 1523
2019-12-06 17:42:09.064 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:42:09.065 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.37, Steps: 678, Distance 24.2, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.2, Angle accuracy 0.0, Num episodes 1524
2019-12-06 17:42:09.501 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 492
2019-12-06 17:42:09.501 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 352.26, Steps: 493, Distance 13.43, Angular velocity 0.0, Speed: 3.21, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.33, Angle accuracy 0.0, Num episodes 1525
2019-12-06 17:42:10.007 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 575
2019-12-06 17:42:10.007 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 387.68, Steps: 576, Distance 18.04, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.81, Angle accuracy 0.0, Num episodes 1526
2019-12-06 17:42:10.509 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 570
2019-12-06 17:42:10.510 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 391.4, Steps: 571, Distance 17.76, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.92, Angle accuracy 0.0, Num episodes 1527
2019-12-06 17:42:11.055 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:42:11.056 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.22, Steps: 603, Distance 19.46, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.31, Angle accuracy 0.0, Num episodes 1528
Warning: trajectory cut off by epoch at 719 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 277 |
| AverageEpRet | 371 |
| StdEpRet | 51.9 |
| MaxEpRet | 428 |
| MinEpRet | 266 |
| EpLen | 547 |
| AverageVVals | 54.7 |
| StdVVals | 1.15e-05 |
| MaxVVals | 54.7 |
| MinVVals | 54.7 |
| TotalEnvInteracts | 1.11e+06 |
| LossPi | 2.48e-08 |
| LossV | 343 |
| DeltaLossPi | -0.000144 |
| DeltaLossV | -1.54 |
| Entropy | -1.91 |
| KL | 0.000334 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.05e+03 |
---------------------------------------
2019-12-06 17:42:12.213 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 498
2019-12-06 17:42:12.214 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 360.16, Steps: 499, Distance 13.32, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.14, Angle accuracy 0.0, Num episodes 1529
2019-12-06 17:42:12.681 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 524
2019-12-06 17:42:12.682 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.16, Steps: 525, Distance 14.92, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.0, Angle accuracy 0.0, Num episodes 1530
2019-12-06 17:42:13.253 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:42:13.253 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.05, Steps: 646, Distance 22.1, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.68, Angle accuracy 0.0, Num episodes 1531
2019-12-06 17:42:13.853 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 671
2019-12-06 17:42:13.853 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.85, Steps: 672, Distance 23.75, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.01, Angle accuracy 0.0, Num episodes 1532
2019-12-06 17:42:14.361 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:42:14.362 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.02, Steps: 567, Distance 17.5, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.76, Angle accuracy 0.0, Num episodes 1533
2019-12-06 17:42:14.945 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 649
2019-12-06 17:42:14.945 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.39, Steps: 650, Distance 22.29, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.93, Angle accuracy 0.0, Num episodes 1534
2019-12-06 17:42:15.275 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 341
2019-12-06 17:42:15.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 245.73, Steps: 342, Distance 6.31, Angular velocity 0.0, Speed: 2.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.41, Angle accuracy 0.0, Num episodes 1535
Warning: trajectory cut off by epoch at 99 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 278 |
| AverageEpRet | 376 |
| StdEpRet | 60 |
| MaxEpRet | 439 |
| MinEpRet | 246 |
| EpLen | 557 |
| AverageVVals | 55.9 |
| StdVVals | 3.86e-06 |
| MaxVVals | 55.9 |
| MinVVals | 55.9 |
| TotalEnvInteracts | 1.12e+06 |
| LossPi | -5.24e-08 |
| LossV | 384 |
| DeltaLossPi | -7.66e-05 |
| DeltaLossV | -0.861 |
| Entropy | -1.88 |
| KL | 0.00919 |
| ClipFrac | 0.156 |
| StopIter | 1 |
| Time | 1.05e+03 |
---------------------------------------
2019-12-06 17:42:16.100 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:42:16.100 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.38, Steps: 746, Distance 28.98, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.74, Angle accuracy 0.0, Num episodes 1536
2019-12-06 17:42:16.645 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 616
2019-12-06 17:42:16.646 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.55, Steps: 617, Distance 20.54, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 1537
2019-12-06 17:42:17.393 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 817
2019-12-06 17:42:17.394 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 462.3, Steps: 818, Distance 33.94, Angular velocity 0.0, Speed: 4.17, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.26, Angle accuracy 0.0, Num episodes 1538
2019-12-06 17:42:17.818 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 476
2019-12-06 17:42:17.818 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 340.56, Steps: 477, Distance 12.39, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.86, Angle accuracy 0.0, Num episodes 1539
2019-12-06 17:42:18.221 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 455
2019-12-06 17:42:18.221 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.37, Steps: 456, Distance 11.54, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.16, Angle accuracy 0.0, Num episodes 1540
2019-12-06 17:42:18.743 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 593
2019-12-06 17:42:18.744 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.41, Steps: 594, Distance 18.98, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.03, Angle accuracy 0.0, Num episodes 1541
Warning: trajectory cut off by epoch at 292 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 279 |
| AverageEpRet | 396 |
| StdEpRet | 50.7 |
| MaxEpRet | 462 |
| MinEpRet | 321 |
| EpLen | 618 |
| AverageVVals | 55 |
| StdVVals | 6.03e-08 |
| MaxVVals | 55 |
| MinVVals | 55 |
| TotalEnvInteracts | 1.12e+06 |
| LossPi | 2.22e-08 |
| LossV | 399 |
| DeltaLossPi | 8.26e-05 |
| DeltaLossV | -1.54 |
| Entropy | -1.91 |
| KL | 0.000656 |
| ClipFrac | 0.001 |
| StopIter | 1 |
| Time | 1.06e+03 |
---------------------------------------
2019-12-06 17:42:19.588 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 573
2019-12-06 17:42:19.588 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.39, Steps: 574, Distance 17.82, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.83, Angle accuracy 0.0, Num episodes 1542
2019-12-06 17:42:20.139 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:42:20.140 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.37, Steps: 618, Distance 20.34, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.37, Angle accuracy 0.0, Num episodes 1543
2019-12-06 17:42:20.687 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:42:20.687 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.1, Steps: 607, Distance 19.65, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.16, Angle accuracy 0.0, Num episodes 1544
2019-12-06 17:42:21.259 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:42:21.260 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.58, Steps: 599, Distance 19.14, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.1, Angle accuracy 0.0, Num episodes 1545
2019-12-06 17:42:21.810 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:42:21.810 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.02, Steps: 605, Distance 19.63, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1546
2019-12-06 17:42:22.230 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 472
2019-12-06 17:42:22.231 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.62, Steps: 473, Distance 12.2, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.78, Angle accuracy 0.0, Num episodes 1547
Warning: trajectory cut off by epoch at 524 steps.
Warning: could not pickle state_dict.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 280 |
| AverageEpRet | 398 |
| StdEpRet | 29.9 |
| MaxEpRet | 427 |
| MinEpRet | 335 |
| EpLen | 579 |
| AverageVVals | 53.7 |
| StdVVals | 1.53e-05 |
| MaxVVals | 53.7 |
| MinVVals | 53.7 |
| TotalEnvInteracts | 1.12e+06 |
| LossPi | -1.65e-08 |
| LossV | 353 |
| DeltaLossPi | -0.000769 |
| DeltaLossV | -18.7 |
| Entropy | -1.91 |
| KL | 6.2e-05 |
| ClipFrac | 0 |
| StopIter | 4 |
| Time | 1.06e+03 |
---------------------------------------
2019-12-06 17:42:23.712 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 654
2019-12-06 17:42:23.712 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.67, Steps: 655, Distance 22.74, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.81, Angle accuracy 0.0, Num episodes 1548
2019-12-06 17:42:24.146 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 477
2019-12-06 17:42:24.147 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.75, Steps: 478, Distance 12.13, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.64, Angle accuracy 0.0, Num episodes 1549
2019-12-06 17:42:24.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 502
2019-12-06 17:42:24.601 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.53, Steps: 503, Distance 13.55, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.26, Angle accuracy 0.0, Num episodes 1550
2019-12-06 17:42:25.081 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 535
2019-12-06 17:42:25.082 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.65, Steps: 536, Distance 15.27, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.96, Angle accuracy 0.0, Num episodes 1551
2019-12-06 17:42:25.639 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:42:25.639 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.81, Steps: 605, Distance 19.69, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.27, Angle accuracy 0.0, Num episodes 1552
2019-12-06 17:42:26.203 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:42:26.203 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.61, Steps: 635, Distance 21.68, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1553
2019-12-06 17:42:26.546 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 383
2019-12-06 17:42:26.546 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 265.22, Steps: 384, Distance 7.58, Angular velocity 0.0, Speed: 2.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.44, Angle accuracy 0.0, Num episodes 1554
Warning: trajectory cut off by epoch at 204 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 281 |
| AverageEpRet | 372 |
| StdEpRet | 53.8 |
| MaxEpRet | 439 |
| MinEpRet | 265 |
| EpLen | 542 |
| AverageVVals | 58.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 58.1 |
| MinVVals | 58.1 |
| TotalEnvInteracts | 1.13e+06 |
| LossPi | -6.71e-08 |
| LossV | 359 |
| DeltaLossPi | -0.000248 |
| DeltaLossV | -3.74 |
| Entropy | -1.9 |
| KL | 3.07e-05 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.06e+03 |
---------------------------------------
2019-12-06 17:42:27.150 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 388
2019-12-06 17:42:27.150 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 275.93, Steps: 389, Distance 8.16, Angular velocity 0.0, Speed: 2.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.37, Angle accuracy 0.0, Num episodes 1555
2019-12-06 17:42:27.711 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 625
2019-12-06 17:42:27.712 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.53, Steps: 626, Distance 20.6, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.55, Angle accuracy 0.0, Num episodes 1556
2019-12-06 17:42:28.163 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 491
2019-12-06 17:42:28.164 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.27, Steps: 492, Distance 13.3, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.05, Angle accuracy 0.0, Num episodes 1557
2019-12-06 17:42:28.639 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 504
2019-12-06 17:42:28.639 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 347.37, Steps: 505, Distance 13.85, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.29, Angle accuracy 0.0, Num episodes 1558
2019-12-06 17:42:28.943 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 343
2019-12-06 17:42:28.943 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 247.51, Steps: 344, Distance 6.28, Angular velocity 0.0, Speed: 2.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.67, Angle accuracy 0.0, Num episodes 1559
2019-12-06 17:42:29.401 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 513
2019-12-06 17:42:29.401 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.39, Steps: 514, Distance 14.44, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.71, Angle accuracy 0.0, Num episodes 1560
2019-12-06 17:42:29.812 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 453
2019-12-06 17:42:29.813 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 330.9, Steps: 454, Distance 11.01, Angular velocity 0.0, Speed: 2.94, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.83, Angle accuracy 0.0, Num episodes 1561
2019-12-06 17:42:30.352 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:42:30.353 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.01, Steps: 600, Distance 19.09, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.2, Angle accuracy 0.0, Num episodes 1562
Warning: trajectory cut off by epoch at 76 steps.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 282 |
| AverageEpRet | 342 |
| StdEpRet | 54.6 |
| MaxEpRet | 414 |
| MinEpRet | 248 |
| EpLen | 490 |
| AverageVVals | 56.2 |
| StdVVals | 3.85e-06 |
| MaxVVals | 56.2 |
| MinVVals | 56.2 |
| TotalEnvInteracts | 1.13e+06 |
| LossPi | -2.81e-08 |
| LossV | 332 |
| DeltaLossPi | -0.000768 |
| DeltaLossV | -0.16 |
| Entropy | -1.9 |
| KL | 0.000744 |
| ClipFrac | 0.00025 |
| StopIter | 4 |
| Time | 1.07e+03 |
---------------------------------------
2019-12-06 17:42:31.133 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:42:31.133 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.24, Steps: 695, Distance 25.65, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1563
2019-12-06 17:42:31.916 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 769
2019-12-06 17:42:31.916 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 470.46, Steps: 770, Distance 30.25, Angular velocity 0.0, Speed: 4.1, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.89, Angle accuracy 0.0, Num episodes 1564
2019-12-06 17:42:32.540 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 646
2019-12-06 17:42:32.541 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.6, Steps: 647, Distance 22.15, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1565
2019-12-06 17:42:32.997 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 505
2019-12-06 17:42:32.998 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.63, Steps: 506, Distance 13.77, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.51, Angle accuracy 0.0, Num episodes 1566
2019-12-06 17:42:33.730 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 813
2019-12-06 17:42:33.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 463.93, Steps: 814, Distance 33.5, Angular velocity 0.0, Speed: 4.18, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.11, Angle accuracy 0.0, Num episodes 1567
Warning: trajectory cut off by epoch at 568 steps.
---------------------------------------
| Epoch | 283 |
| AverageEpRet | 430 |
| StdEpRet | 41.5 |
| MaxEpRet | 470 |
| MinEpRet | 355 |
| EpLen | 686 |
| AverageVVals | 55.7 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.7 |
| MinVVals | 55.7 |
| TotalEnvInteracts | 1.14e+06 |
| LossPi | 1.02e-07 |
| LossV | 409 |
| DeltaLossPi | -0.00132 |
| DeltaLossV | -1.97 |
| Entropy | -1.89 |
| KL | 0.00232 |
| ClipFrac | 0.0472 |
| StopIter | 79 |
| Time | 1.07e+03 |
---------------------------------------
2019-12-06 17:42:35.086 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 686
2019-12-06 17:42:35.086 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.38, Steps: 687, Distance 24.36, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.16, Angle accuracy 0.0, Num episodes 1568
2019-12-06 17:42:35.782 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:42:35.783 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.94, Steps: 762, Distance 29.55, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.87, Angle accuracy 0.0, Num episodes 1569
2019-12-06 17:42:36.319 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 601
2019-12-06 17:42:36.319 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.06, Steps: 602, Distance 19.19, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.16, Angle accuracy 0.0, Num episodes 1570
2019-12-06 17:42:36.668 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 393
2019-12-06 17:42:36.669 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 282.97, Steps: 394, Distance 8.24, Angular velocity 0.0, Speed: 2.59, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 89.26, Angle accuracy 0.0, Num episodes 1571
2019-12-06 17:42:37.253 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 644
2019-12-06 17:42:37.253 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.12, Steps: 645, Distance 21.99, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1572
2019-12-06 17:42:37.587 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 378
2019-12-06 17:42:37.587 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 279.34, Steps: 379, Distance 7.68, Angular velocity 0.0, Speed: 2.48, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.49, Angle accuracy 0.0, Num episodes 1573
Warning: trajectory cut off by epoch at 531 steps.
---------------------------------------
| Epoch | 284 |
| AverageEpRet | 382 |
| StdEpRet | 73.3 |
| MaxEpRet | 462 |
| MinEpRet | 279 |
| EpLen | 578 |
| AverageVVals | 54.3 |
| StdVVals | 8.53e-08 |
| MaxVVals | 54.3 |
| MinVVals | 54.3 |
| TotalEnvInteracts | 1.14e+06 |
| LossPi | -4.77e-08 |
| LossV | 380 |
| DeltaLossPi | -0.00129 |
| DeltaLossV | -1.82 |
| Entropy | -1.91 |
| KL | 0.0013 |
| ClipFrac | 0.02 |
| StopIter | 79 |
| Time | 1.07e+03 |
---------------------------------------
2019-12-06 17:42:38.784 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:42:38.785 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.28, Steps: 608, Distance 19.2, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1574
2019-12-06 17:42:39.351 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 625
2019-12-06 17:42:39.352 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.86, Steps: 626, Distance 20.83, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.44, Angle accuracy 0.0, Num episodes 1575
2019-12-06 17:42:39.997 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 702
2019-12-06 17:42:39.997 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.36, Steps: 703, Distance 25.41, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 1576
2019-12-06 17:42:40.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 681
2019-12-06 17:42:40.600 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.99, Steps: 682, Distance 24.51, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.13, Angle accuracy 0.0, Num episodes 1577
2019-12-06 17:42:41.165 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 630
2019-12-06 17:42:41.165 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.39, Steps: 631, Distance 20.79, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.45, Angle accuracy 0.0, Num episodes 1578
2019-12-06 17:42:41.792 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:42:41.792 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.39, Steps: 708, Distance 26.1, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1579
Warning: trajectory cut off by epoch at 42 steps.
Early stopping at step 5 due to reaching max kl.
---------------------------------------
| Epoch | 285 |
| AverageEpRet | 433 |
| StdEpRet | 15.6 |
| MaxEpRet | 451 |
| MinEpRet | 408 |
| EpLen | 660 |
| AverageVVals | 55.7 |
| StdVVals | 0 |
| MaxVVals | 55.7 |
| MinVVals | 55.7 |
| TotalEnvInteracts | 1.14e+06 |
| LossPi | -2.93e-08 |
| LossV | 410 |
| DeltaLossPi | -0.000976 |
| DeltaLossV | -0.349 |
| Entropy | -1.9 |
| KL | 0.00699 |
| ClipFrac | 0.046 |
| StopIter | 5 |
| Time | 1.08e+03 |
---------------------------------------
2019-12-06 17:42:42.558 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 726
2019-12-06 17:42:42.558 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.24, Steps: 727, Distance 27.19, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 1580
2019-12-06 17:42:43.173 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:42:43.174 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.04, Steps: 630, Distance 20.57, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.6, Angle accuracy 0.0, Num episodes 1581
2019-12-06 17:42:43.603 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 471
2019-12-06 17:42:43.603 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.57, Steps: 472, Distance 11.87, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.23, Angle accuracy 0.0, Num episodes 1582
2019-12-06 17:42:44.179 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:42:44.180 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.46, Steps: 629, Distance 20.66, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.58, Angle accuracy 0.0, Num episodes 1583
2019-12-06 17:42:44.793 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 685
2019-12-06 17:42:44.793 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.52, Steps: 686, Distance 24.2, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.13, Angle accuracy 0.0, Num episodes 1584
2019-12-06 17:42:45.397 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:42:45.398 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.0, Steps: 680, Distance 23.82, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.15, Angle accuracy 0.0, Num episodes 1585
Warning: trajectory cut off by epoch at 176 steps.
Early stopping at step 16 due to reaching max kl.
---------------------------------------
| Epoch | 286 |
| AverageEpRet | 421 |
| StdEpRet | 37.6 |
| MaxEpRet | 449 |
| MinEpRet | 340 |
| EpLen | 637 |
| AverageVVals | 55.1 |
| StdVVals | 1.14e-05 |
| MaxVVals | 55.1 |
| MinVVals | 55.1 |
| TotalEnvInteracts | 1.15e+06 |
| LossPi | 6.07e-08 |
| LossV | 410 |
| DeltaLossPi | -0.00186 |
| DeltaLossV | -0.0974 |
| Entropy | -1.92 |
| KL | 0.000922 |
| ClipFrac | 0.002 |
| StopIter | 16 |
| Time | 1.08e+03 |
---------------------------------------
2019-12-06 17:42:46.330 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 779
2019-12-06 17:42:46.330 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 473.33, Steps: 780, Distance 30.21, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.82, Angle accuracy 0.0, Num episodes 1586
2019-12-06 17:42:46.739 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 439
2019-12-06 17:42:46.740 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 317.64, Steps: 440, Distance 10.19, Angular velocity 0.0, Speed: 2.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.35, Angle accuracy 0.0, Num episodes 1587
2019-12-06 17:42:47.348 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:42:47.349 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.8, Steps: 663, Distance 22.53, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 95.84, Angle accuracy 0.0, Num episodes 1588
2019-12-06 17:42:47.894 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:42:47.895 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.22, Steps: 613, Distance 19.53, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.15, Angle accuracy 0.0, Num episodes 1589
2019-12-06 17:42:48.508 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 670
2019-12-06 17:42:48.509 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.63, Steps: 671, Distance 23.36, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.11, Angle accuracy 0.0, Num episodes 1590
2019-12-06 17:42:48.971 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:42:48.971 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.49, Steps: 520, Distance 14.5, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.57, Angle accuracy 0.0, Num episodes 1591
Warning: trajectory cut off by epoch at 313 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 287 |
| AverageEpRet | 408 |
| StdEpRet | 51.9 |
| MaxEpRet | 473 |
| MinEpRet | 318 |
| EpLen | 614 |
| AverageVVals | 55.4 |
| StdVVals | 7.62e-06 |
| MaxVVals | 55.4 |
| MinVVals | 55.4 |
| TotalEnvInteracts | 1.15e+06 |
| LossPi | 7.99e-09 |
| LossV | 389 |
| DeltaLossPi | -5.94e-05 |
| DeltaLossV | -0.714 |
| Entropy | -1.92 |
| KL | 0.00011 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.09e+03 |
---------------------------------------
2019-12-06 17:42:49.809 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 534
2019-12-06 17:42:49.810 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.99, Steps: 535, Distance 14.77, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.97, Angle accuracy 0.0, Num episodes 1592
2019-12-06 17:42:50.243 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 441
2019-12-06 17:42:50.243 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.91, Steps: 442, Distance 10.08, Angular velocity 0.0, Speed: 2.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.16, Angle accuracy 0.0, Num episodes 1593
2019-12-06 17:42:50.778 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 583
2019-12-06 17:42:50.778 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.31, Steps: 584, Distance 17.87, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.78, Angle accuracy 0.0, Num episodes 1594
2019-12-06 17:42:51.191 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 456
2019-12-06 17:42:51.192 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.09, Steps: 457, Distance 10.82, Angular velocity 0.0, Speed: 2.87, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.62, Angle accuracy 0.0, Num episodes 1595
2019-12-06 17:42:51.569 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 409
2019-12-06 17:42:51.570 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 286.71, Steps: 410, Distance 8.76, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.76, Angle accuracy 0.0, Num episodes 1596
2019-12-06 17:42:52.230 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 733
2019-12-06 17:42:52.230 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.15, Steps: 734, Distance 27.36, Angular velocity 0.0, Speed: 4.0, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.48, Angle accuracy 0.0, Num episodes 1597
2019-12-06 17:42:52.813 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:42:52.813 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.46, Steps: 603, Distance 18.93, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.11, Angle accuracy 0.0, Num episodes 1598
Warning: trajectory cut off by epoch at 235 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 288 |
| AverageEpRet | 368 |
| StdEpRet | 57.2 |
| MaxEpRet | 459 |
| MinEpRet | 287 |
| EpLen | 538 |
| AverageVVals | 56.3 |
| StdVVals | 7.62e-06 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.16e+06 |
| LossPi | -8.64e-10 |
| LossV | 354 |
| DeltaLossPi | -0.00151 |
| DeltaLossV | 0 |
| Entropy | -1.92 |
| KL | 0.00631 |
| ClipFrac | 0.069 |
| StopIter | 1 |
| Time | 1.09e+03 |
---------------------------------------
2019-12-06 17:42:53.707 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:42:53.708 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.2, Steps: 636, Distance 21.24, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.54, Angle accuracy 0.0, Num episodes 1599
2019-12-06 17:42:54.286 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 619
2019-12-06 17:42:54.286 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.53, Steps: 620, Distance 19.93, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.45, Angle accuracy 0.0, Num episodes 1600
2019-12-06 17:42:54.943 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 723
2019-12-06 17:42:54.944 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 457.08, Steps: 724, Distance 27.04, Angular velocity 0.0, Speed: 4.0, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.61, Angle accuracy 0.0, Num episodes 1601
2019-12-06 17:42:55.491 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:42:55.491 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.36, Steps: 605, Distance 19.05, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.06, Angle accuracy 0.0, Num episodes 1602
2019-12-06 17:42:56.156 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:42:56.156 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.56, Steps: 743, Distance 27.97, Angular velocity 0.0, Speed: 4.02, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.67, Angle accuracy 0.0, Num episodes 1603
Warning: trajectory cut off by epoch at 672 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 289 |
| AverageEpRet | 436 |
| StdEpRet | 19.5 |
| MaxEpRet | 462 |
| MinEpRet | 415 |
| EpLen | 666 |
| AverageVVals | 56.3 |
| StdVVals | 0 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.16e+06 |
| LossPi | 3.56e-08 |
| LossV | 373 |
| DeltaLossPi | -0.00314 |
| DeltaLossV | -0.0251 |
| Entropy | -1.91 |
| KL | 0.00739 |
| ClipFrac | 0.087 |
| StopIter | 2 |
| Time | 1.09e+03 |
---------------------------------------
2019-12-06 17:42:57.400 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:42:57.400 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.1, Steps: 625, Distance 20.3, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.52, Angle accuracy 0.0, Num episodes 1604
2019-12-06 17:42:57.865 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:42:57.865 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.17, Steps: 521, Distance 13.95, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.63, Angle accuracy 0.0, Num episodes 1605
2019-12-06 17:42:58.243 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 410
2019-12-06 17:42:58.244 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 287.33, Steps: 411, Distance 8.48, Angular velocity 0.0, Speed: 2.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.52, Angle accuracy 0.0, Num episodes 1606
2019-12-06 17:42:58.817 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:42:58.818 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.84, Steps: 625, Distance 20.33, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.5, Angle accuracy 0.0, Num episodes 1607
2019-12-06 17:42:59.461 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 703
2019-12-06 17:42:59.461 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.82, Steps: 704, Distance 25.02, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.16, Angle accuracy 0.0, Num episodes 1608
2019-12-06 17:42:59.979 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 576
2019-12-06 17:42:59.980 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.26, Steps: 577, Distance 17.13, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.65, Angle accuracy 0.0, Num episodes 1609
Warning: trajectory cut off by epoch at 537 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 290 |
| AverageEpRet | 392 |
| StdEpRet | 53.3 |
| MaxEpRet | 448 |
| MinEpRet | 287 |
| EpLen | 577 |
| AverageVVals | 56.4 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56.4 |
| MinVVals | 56.4 |
| TotalEnvInteracts | 1.16e+06 |
| LossPi | -2.21e-08 |
| LossV | 322 |
| DeltaLossPi | -0.00156 |
| DeltaLossV | -1.62 |
| Entropy | -1.9 |
| KL | 0.00512 |
| ClipFrac | 0.0227 |
| StopIter | 79 |
| Time | 1.1e+03 |
---------------------------------------
2019-12-06 17:43:01.476 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:43:01.477 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.94, Steps: 545, Distance 15.35, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.99, Angle accuracy 0.0, Num episodes 1610
2019-12-06 17:43:02.076 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:43:02.076 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.34, Steps: 639, Distance 21.43, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.8, Angle accuracy 0.0, Num episodes 1611
2019-12-06 17:43:02.532 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 475
2019-12-06 17:43:02.533 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.73, Steps: 476, Distance 11.79, Angular velocity 0.0, Speed: 3.04, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.5, Angle accuracy 0.0, Num episodes 1612
2019-12-06 17:43:03.111 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:43:03.111 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.35, Steps: 643, Distance 21.26, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.66, Angle accuracy 0.0, Num episodes 1613
2019-12-06 17:43:03.749 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:43:03.750 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 463.39, Steps: 719, Distance 26.1, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 1614
2019-12-06 17:43:04.367 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:43:04.368 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.86, Steps: 692, Distance 24.23, Angular velocity 0.0, Speed: 3.92, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.17, Angle accuracy 0.0, Num episodes 1615
Warning: trajectory cut off by epoch at 286 steps.
---------------------------------------
| Epoch | 291 |
| AverageEpRet | 421 |
| StdEpRet | 40.1 |
| MaxEpRet | 463 |
| MinEpRet | 352 |
| EpLen | 619 |
| AverageVVals | 57.7 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.7 |
| MinVVals | 57.7 |
| TotalEnvInteracts | 1.17e+06 |
| LossPi | -3.68e-08 |
| LossV | 364 |
| DeltaLossPi | -0.00196 |
| DeltaLossV | -0.0903 |
| Entropy | -1.93 |
| KL | 0.00421 |
| ClipFrac | 0.015 |
| StopIter | 79 |
| Time | 1.1e+03 |
---------------------------------------
2019-12-06 17:43:05.396 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:43:05.396 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 462.23, Steps: 705, Distance 25.18, Angular velocity 0.0, Speed: 3.96, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 1616
2019-12-06 17:43:05.828 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 483
2019-12-06 17:43:05.828 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.66, Steps: 484, Distance 11.94, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 92.62, Angle accuracy 0.0, Num episodes 1617
2019-12-06 17:43:06.369 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:43:06.369 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.4, Steps: 601, Distance 18.71, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.97, Angle accuracy 0.0, Num episodes 1618
2019-12-06 17:43:06.880 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 582
2019-12-06 17:43:06.880 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.6, Steps: 583, Distance 17.96, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.73, Angle accuracy 0.0, Num episodes 1619
2019-12-06 17:43:07.516 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 717
2019-12-06 17:43:07.517 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 467.18, Steps: 718, Distance 26.51, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 1620
2019-12-06 17:43:08.130 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 687
2019-12-06 17:43:08.131 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.18, Steps: 688, Distance 24.06, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.22, Angle accuracy 0.0, Num episodes 1621
Warning: trajectory cut off by epoch at 221 steps.
Early stopping at step 64 due to reaching max kl.
---------------------------------------
| Epoch | 292 |
| AverageEpRet | 426 |
| StdEpRet | 40 |
| MaxEpRet | 467 |
| MinEpRet | 349 |
| EpLen | 630 |
| AverageVVals | 57.4 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57.4 |
| MinVVals | 57.4 |
| TotalEnvInteracts | 1.17e+06 |
| LossPi | 1.25e-08 |
| LossV | 371 |
| DeltaLossPi | 0.000708 |
| DeltaLossV | -0.0794 |
| Entropy | -1.93 |
| KL | 0.00179 |
| ClipFrac | 0.0145 |
| StopIter | 64 |
| Time | 1.1e+03 |
---------------------------------------
2019-12-06 17:43:08.834 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 428
2019-12-06 17:43:08.834 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 313.79, Steps: 429, Distance 9.64, Angular velocity 0.0, Speed: 2.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.79, Angle accuracy 0.0, Num episodes 1622
2019-12-06 17:43:09.130 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 329
2019-12-06 17:43:09.130 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 248.81, Steps: 330, Distance 5.74, Angular velocity 0.0, Speed: 2.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 85.51, Angle accuracy 0.0, Num episodes 1623
2019-12-06 17:43:09.741 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 680
2019-12-06 17:43:09.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.54, Steps: 681, Distance 23.56, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.97, Angle accuracy 0.0, Num episodes 1624
2019-12-06 17:43:10.361 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:43:10.361 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.18, Steps: 678, Distance 23.8, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.2, Angle accuracy 0.0, Num episodes 1625
2019-12-06 17:43:10.885 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:43:10.885 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.57, Steps: 587, Distance 17.82, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.84, Angle accuracy 0.0, Num episodes 1626
2019-12-06 17:43:11.502 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:43:11.502 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 454.46, Steps: 700, Distance 25.05, Angular velocity 0.0, Speed: 3.94, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.24, Angle accuracy 0.0, Num episodes 1627
Warning: trajectory cut off by epoch at 595 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 293 |
| AverageEpRet | 389 |
| StdEpRet | 79.6 |
| MaxEpRet | 454 |
| MinEpRet | 249 |
| EpLen | 568 |
| AverageVVals | 57.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.1 |
| MinVVals | 57.1 |
| TotalEnvInteracts | 1.18e+06 |
| LossPi | -2.86e-08 |
| LossV | 350 |
| DeltaLossPi | -0.0017 |
| DeltaLossV | -0.57 |
| Entropy | -1.97 |
| KL | 0.0065 |
| ClipFrac | 0.0742 |
| StopIter | 1 |
| Time | 1.11e+03 |
---------------------------------------
2019-12-06 17:43:12.484 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 421
2019-12-06 17:43:12.484 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 306.16, Steps: 422, Distance 9.27, Angular velocity 0.0, Speed: 2.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.58, Angle accuracy 0.0, Num episodes 1628
2019-12-06 17:43:12.942 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 510
2019-12-06 17:43:12.942 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 373.03, Steps: 511, Distance 13.56, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 93.35, Angle accuracy 0.0, Num episodes 1629
2019-12-06 17:43:13.521 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:43:13.521 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.28, Steps: 615, Distance 19.3, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1630
2019-12-06 17:43:14.185 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 749
2019-12-06 17:43:14.185 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 471.32, Steps: 750, Distance 28.23, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.75, Angle accuracy 0.0, Num episodes 1631
2019-12-06 17:43:14.642 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 509
2019-12-06 17:43:14.642 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.05, Steps: 510, Distance 13.37, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.07, Angle accuracy 0.0, Num episodes 1632
2019-12-06 17:43:15.276 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 695
2019-12-06 17:43:15.276 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 452.69, Steps: 696, Distance 24.47, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.13, Angle accuracy 0.0, Num episodes 1633
Warning: trajectory cut off by epoch at 496 steps.
---------------------------------------
| Epoch | 294 |
| AverageEpRet | 400 |
| StdEpRet | 56.6 |
| MaxEpRet | 471 |
| MinEpRet | 306 |
| EpLen | 584 |
| AverageVVals | 57.9 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.9 |
| MinVVals | 57.9 |
| TotalEnvInteracts | 1.18e+06 |
| LossPi | 3.71e-08 |
| LossV | 352 |
| DeltaLossPi | -0.00258 |
| DeltaLossV | -0.0474 |
| Entropy | -1.96 |
| KL | 0.00681 |
| ClipFrac | 0.056 |
| StopIter | 79 |
| Time | 1.11e+03 |
---------------------------------------
2019-12-06 17:43:16.482 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 698
2019-12-06 17:43:16.482 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.35, Steps: 699, Distance 24.66, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.27, Angle accuracy 0.0, Num episodes 1634
2019-12-06 17:43:17.022 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:43:17.022 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.29, Steps: 609, Distance 19.15, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.27, Angle accuracy 0.0, Num episodes 1635
2019-12-06 17:43:17.499 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 533
2019-12-06 17:43:17.500 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 371.23, Steps: 534, Distance 14.78, Angular velocity 0.0, Speed: 3.26, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.67, Angle accuracy 0.0, Num episodes 1636
2019-12-06 17:43:18.027 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 582
2019-12-06 17:43:18.027 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.2, Steps: 583, Distance 17.37, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.81, Angle accuracy 0.0, Num episodes 1637
2019-12-06 17:43:18.528 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:43:18.529 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.0, Steps: 564, Distance 16.39, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.5, Angle accuracy 0.0, Num episodes 1638
2019-12-06 17:43:19.029 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 535
2019-12-06 17:43:19.029 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 373.62, Steps: 536, Distance 14.99, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.0, Angle accuracy 0.0, Num episodes 1639
Warning: trajectory cut off by epoch at 475 steps.
---------------------------------------
| Epoch | 295 |
| AverageEpRet | 400 |
| StdEpRet | 25.5 |
| MaxEpRet | 445 |
| MinEpRet | 371 |
| EpLen | 588 |
| AverageVVals | 58.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 58.1 |
| MinVVals | 58.1 |
| TotalEnvInteracts | 1.18e+06 |
| LossPi | -2.15e-09 |
| LossV | 329 |
| DeltaLossPi | -0.00335 |
| DeltaLossV | -0.00476 |
| Entropy | -1.93 |
| KL | 0.0027 |
| ClipFrac | 0.0175 |
| StopIter | 79 |
| Time | 1.12e+03 |
---------------------------------------
2019-12-06 17:43:20.016 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 467
2019-12-06 17:43:20.017 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.49, Steps: 468, Distance 11.32, Angular velocity 0.0, Speed: 2.9, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.98, Angle accuracy 0.0, Num episodes 1640
2019-12-06 17:43:20.565 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 616
2019-12-06 17:43:20.565 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.84, Steps: 617, Distance 19.73, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1641
2019-12-06 17:43:21.177 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 681
2019-12-06 17:43:21.178 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.59, Steps: 682, Distance 23.44, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.09, Angle accuracy 0.0, Num episodes 1642
2019-12-06 17:43:21.462 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 317
2019-12-06 17:43:21.462 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 233.39, Steps: 318, Distance 5.27, Angular velocity 0.0, Speed: 2.0, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.26, Angle accuracy 0.0, Num episodes 1643
2019-12-06 17:43:21.844 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 430
2019-12-06 17:43:21.844 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.31, Steps: 431, Distance 9.53, Angular velocity 0.0, Speed: 2.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.87, Angle accuracy 0.0, Num episodes 1644
2019-12-06 17:43:22.556 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 797
2019-12-06 17:43:22.557 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 484.17, Steps: 798, Distance 30.89, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.01, Angle accuracy 0.0, Num episodes 1645
2019-12-06 17:43:22.965 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 448
2019-12-06 17:43:22.966 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 332.94, Steps: 449, Distance 10.56, Angular velocity 0.0, Speed: 2.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.45, Angle accuracy 0.0, Num episodes 1646
Warning: trajectory cut off by epoch at 237 steps.
---------------------------------------
| Epoch | 296 |
| AverageEpRet | 365 |
| StdEpRet | 79.8 |
| MaxEpRet | 484 |
| MinEpRet | 233 |
| EpLen | 538 |
| AverageVVals | 58.2 |
| StdVVals | 1.14e-05 |
| MaxVVals | 58.2 |
| MinVVals | 58.2 |
| TotalEnvInteracts | 1.19e+06 |
| LossPi | -2.04e-08 |
| LossV | 389 |
| DeltaLossPi | -0.00144 |
| DeltaLossV | -5.87 |
| Entropy | -1.92 |
| KL | 0.00212 |
| ClipFrac | 0.0233 |
| StopIter | 79 |
| Time | 1.12e+03 |
---------------------------------------
2019-12-06 17:43:23.892 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:43:23.892 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.39, Steps: 643, Distance 20.95, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1647
2019-12-06 17:43:24.259 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 402
2019-12-06 17:43:24.260 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 294.02, Steps: 403, Distance 8.43, Angular velocity 0.0, Speed: 2.53, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 89.78, Angle accuracy 0.0, Num episodes 1648
2019-12-06 17:43:24.825 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:43:24.825 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.72, Steps: 638, Distance 20.45, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 95.6, Angle accuracy 0.0, Num episodes 1649
2019-12-06 17:43:25.223 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 445
2019-12-06 17:43:25.223 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.34, Steps: 446, Distance 10.18, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.34, Angle accuracy 0.0, Num episodes 1650
2019-12-06 17:43:25.785 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:43:25.785 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.39, Steps: 625, Distance 19.98, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.32, Angle accuracy 0.0, Num episodes 1651
2019-12-06 17:43:26.336 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 610
2019-12-06 17:43:26.337 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.41, Steps: 611, Distance 18.98, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.26, Angle accuracy 0.0, Num episodes 1652
Warning: trajectory cut off by epoch at 634 steps.
---------------------------------------
| Epoch | 297 |
| AverageEpRet | 387 |
| StdEpRet | 56.6 |
| MaxEpRet | 432 |
| MinEpRet | 294 |
| EpLen | 561 |
| AverageVVals | 55.7 |
| StdVVals | 1.14e-05 |
| MaxVVals | 55.7 |
| MinVVals | 55.7 |
| TotalEnvInteracts | 1.19e+06 |
| LossPi | -7.34e-08 |
| LossV | 334 |
| DeltaLossPi | -0.000408 |
| DeltaLossV | -4.03 |
| Entropy | -1.96 |
| KL | 0.00165 |
| ClipFrac | 0.0025 |
| StopIter | 79 |
| Time | 1.12e+03 |
---------------------------------------
2019-12-06 17:43:27.694 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:43:27.694 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 457.69, Steps: 708, Distance 25.33, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 1653
2019-12-06 17:43:28.136 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 485
2019-12-06 17:43:28.136 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 348.36, Steps: 486, Distance 12.34, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.63, Angle accuracy 0.0, Num episodes 1654
2019-12-06 17:43:28.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 507
2019-12-06 17:43:28.600 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.79, Steps: 508, Distance 13.33, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.07, Angle accuracy 0.0, Num episodes 1655
2019-12-06 17:43:29.177 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:43:29.177 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.87, Steps: 651, Distance 21.7, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.66, Angle accuracy 0.0, Num episodes 1656
2019-12-06 17:43:29.783 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 660
2019-12-06 17:43:29.784 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.92, Steps: 661, Distance 22.38, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.84, Angle accuracy 0.0, Num episodes 1657
2019-12-06 17:43:30.384 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:43:30.384 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.02, Steps: 666, Distance 22.53, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1658
Warning: trajectory cut off by epoch at 320 steps.
---------------------------------------
| Epoch | 298 |
| AverageEpRet | 415 |
| StdEpRet | 41.4 |
| MaxEpRet | 458 |
| MinEpRet | 348 |
| EpLen | 613 |
| AverageVVals | 57.8 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57.8 |
| MinVVals | 57.8 |
| TotalEnvInteracts | 1.2e+06 |
| LossPi | 9.23e-08 |
| LossV | 383 |
| DeltaLossPi | -0.00317 |
| DeltaLossV | -0.261 |
| Entropy | -1.97 |
| KL | 0.000407 |
| ClipFrac | 0.029 |
| StopIter | 79 |
| Time | 1.13e+03 |
---------------------------------------
2019-12-06 17:43:31.376 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 634
2019-12-06 17:43:31.377 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.36, Steps: 635, Distance 20.84, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.64, Angle accuracy 0.0, Num episodes 1659
2019-12-06 17:43:31.936 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 627
2019-12-06 17:43:31.937 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.35, Steps: 628, Distance 20.53, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.58, Angle accuracy 0.0, Num episodes 1660
2019-12-06 17:43:32.428 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 546
2019-12-06 17:43:32.429 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 387.58, Steps: 547, Distance 15.69, Angular velocity 0.0, Speed: 3.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.3, Angle accuracy 0.0, Num episodes 1661
2019-12-06 17:43:32.930 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:43:32.930 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.57, Steps: 528, Distance 14.91, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.96, Angle accuracy 0.0, Num episodes 1662
2019-12-06 17:43:33.578 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 703
2019-12-06 17:43:33.579 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.57, Steps: 704, Distance 25.2, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.35, Angle accuracy 0.0, Num episodes 1663
2019-12-06 17:43:33.845 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 297
2019-12-06 17:43:33.845 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 219.64, Steps: 298, Distance 4.57, Angular velocity 0.0, Speed: 1.85, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 82.25, Angle accuracy 0.0, Num episodes 1664
2019-12-06 17:43:34.412 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 621
2019-12-06 17:43:34.413 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.88, Steps: 622, Distance 19.94, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1665
Warning: trajectory cut off by epoch at 38 steps.
---------------------------------------
| Epoch | 299 |
| AverageEpRet | 389 |
| StdEpRet | 73.6 |
| MaxEpRet | 460 |
| MinEpRet | 220 |
| EpLen | 566 |
| AverageVVals | 57.3 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57.3 |
| MinVVals | 57.3 |
| TotalEnvInteracts | 1.2e+06 |
| LossPi | -2.22e-08 |
| LossV | 407 |
| DeltaLossPi | -0.00216 |
| DeltaLossV | -0.961 |
| Entropy | -1.98 |
| KL | 0.00244 |
| ClipFrac | 0.026 |
| StopIter | 79 |
| Time | 1.13e+03 |
---------------------------------------
2019-12-06 17:43:35.098 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 567
2019-12-06 17:43:35.098 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.23, Steps: 568, Distance 16.97, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.45, Angle accuracy 0.0, Num episodes 1666
2019-12-06 17:43:35.464 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:43:35.464 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.35, Steps: 413, Distance 8.95, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.01, Angle accuracy 0.0, Num episodes 1667
2019-12-06 17:43:35.833 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:43:35.833 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 307.12, Steps: 413, Distance 9.11, Angular velocity 0.0, Speed: 2.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.15, Angle accuracy 0.0, Num episodes 1668
2019-12-06 17:43:36.407 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:43:36.408 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.68, Steps: 623, Distance 20.11, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.43, Angle accuracy 0.0, Num episodes 1669
2019-12-06 17:43:37.052 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 725
2019-12-06 17:43:37.053 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.67, Steps: 726, Distance 26.57, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 1670
2019-12-06 17:43:37.450 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 451
2019-12-06 17:43:37.451 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 330.07, Steps: 452, Distance 10.78, Angular velocity 0.0, Speed: 2.87, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.86, Angle accuracy 0.0, Num episodes 1671
2019-12-06 17:43:37.826 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 421
2019-12-06 17:43:37.827 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 307.76, Steps: 422, Distance 9.42, Angular velocity 0.0, Speed: 2.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.62, Angle accuracy 0.0, Num episodes 1672
2019-12-06 17:43:38.157 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 364
2019-12-06 17:43:38.157 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 269.21, Steps: 365, Distance 7.09, Angular velocity 0.0, Speed: 2.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.04, Angle accuracy 0.0, Num episodes 1673
Warning: trajectory cut off by epoch at 18 steps.
Warning: could not pickle state_dict.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 300 |
| AverageEpRet | 349 |
| StdEpRet | 62.8 |
| MaxEpRet | 450 |
| MinEpRet | 269 |
| EpLen | 498 |
| AverageVVals | 56.3 |
| StdVVals | 1.53e-05 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.2e+06 |
| LossPi | 4.68e-08 |
| LossV | 385 |
| DeltaLossPi | -0.000426 |
| DeltaLossV | -0.0376 |
| Entropy | -1.98 |
| KL | 0.00062 |
| ClipFrac | 0.00025 |
| StopIter | 2 |
| Time | 1.13e+03 |
---------------------------------------
2019-12-06 17:43:39.264 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 749
2019-12-06 17:43:39.265 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 463.17, Steps: 750, Distance 28.65, Angular velocity 0.0, Speed: 4.0, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.73, Angle accuracy 0.0, Num episodes 1674
2019-12-06 17:43:39.746 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:43:39.747 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.67, Steps: 539, Distance 15.26, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.89, Angle accuracy 0.0, Num episodes 1675
2019-12-06 17:43:40.441 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 777
2019-12-06 17:43:40.441 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 468.45, Steps: 778, Distance 30.3, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.87, Angle accuracy 0.0, Num episodes 1676
2019-12-06 17:43:41.055 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:43:41.055 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.43, Steps: 680, Distance 23.53, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 1677
2019-12-06 17:43:41.592 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:43:41.593 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.41, Steps: 603, Distance 18.66, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.08, Angle accuracy 0.0, Num episodes 1678
Warning: trajectory cut off by epoch at 650 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 301 |
| AverageEpRet | 432 |
| StdEpRet | 32.8 |
| MaxEpRet | 468 |
| MinEpRet | 382 |
| EpLen | 670 |
| AverageVVals | 56.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.1 |
| MinVVals | 56.1 |
| TotalEnvInteracts | 1.21e+06 |
| LossPi | 6.79e-08 |
| LossV | 407 |
| DeltaLossPi | -1.18e-05 |
| DeltaLossV | -0.267 |
| Entropy | -1.95 |
| KL | -0.000277 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.14e+03 |
---------------------------------------
2019-12-06 17:43:42.930 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:43:42.930 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.37, Steps: 695, Distance 24.65, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.19, Angle accuracy 0.0, Num episodes 1679
2019-12-06 17:43:43.537 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:43:43.537 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.74, Steps: 630, Distance 20.58, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.56, Angle accuracy 0.0, Num episodes 1680
2019-12-06 17:43:44.089 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 609
2019-12-06 17:43:44.090 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.26, Steps: 610, Distance 19.49, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.26, Angle accuracy 0.0, Num episodes 1681
2019-12-06 17:43:44.730 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:43:44.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.06, Steps: 719, Distance 26.25, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 1682
2019-12-06 17:43:45.203 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 530
2019-12-06 17:43:45.203 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.01, Steps: 531, Distance 14.82, Angular velocity 0.0, Speed: 3.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.92, Angle accuracy 0.0, Num episodes 1683
2019-12-06 17:43:45.740 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:43:45.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.98, Steps: 605, Distance 19.0, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 95.24, Angle accuracy 0.0, Num episodes 1684
Warning: trajectory cut off by epoch at 210 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 302 |
| AverageEpRet | 423 |
| StdEpRet | 25 |
| MaxEpRet | 458 |
| MinEpRet | 381 |
| EpLen | 632 |
| AverageVVals | 55.6 |
| StdVVals | 7.63e-06 |
| MaxVVals | 55.6 |
| MinVVals | 55.6 |
| TotalEnvInteracts | 1.21e+06 |
| LossPi | -6.91e-09 |
| LossV | 412 |
| DeltaLossPi | -1.96e-05 |
| DeltaLossV | -0.469 |
| Entropy | -1.96 |
| KL | -4.5e-05 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.14e+03 |
---------------------------------------
2019-12-06 17:43:46.374 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 378
2019-12-06 17:43:46.374 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 276.51, Steps: 379, Distance 7.66, Angular velocity 0.0, Speed: 2.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.74, Angle accuracy 0.0, Num episodes 1685
2019-12-06 17:43:46.911 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:43:46.911 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.49, Steps: 607, Distance 19.31, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.08, Angle accuracy 0.0, Num episodes 1686
2019-12-06 17:43:47.495 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 649
2019-12-06 17:43:47.495 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.51, Steps: 650, Distance 21.91, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1687
2019-12-06 17:43:48.133 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 698
2019-12-06 17:43:48.134 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.65, Steps: 699, Distance 24.97, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 1688
2019-12-06 17:43:48.744 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:43:48.745 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.5, Steps: 684, Distance 23.82, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.04, Angle accuracy 0.0, Num episodes 1689
2019-12-06 17:43:49.270 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:43:49.270 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.12, Steps: 586, Distance 18.03, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.78, Angle accuracy 0.0, Num episodes 1690
Warning: trajectory cut off by epoch at 395 steps.
Early stopping at step 8 due to reaching max kl.
---------------------------------------
| Epoch | 303 |
| AverageEpRet | 405 |
| StdEpRet | 59.4 |
| MaxEpRet | 450 |
| MinEpRet | 277 |
| EpLen | 601 |
| AverageVVals | 56.2 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.2 |
| MinVVals | 56.2 |
| TotalEnvInteracts | 1.22e+06 |
| LossPi | -5.47e-08 |
| LossV | 413 |
| DeltaLossPi | -0.00236 |
| DeltaLossV | -0.196 |
| Entropy | -1.97 |
| KL | 0.0118 |
| ClipFrac | 0.098 |
| StopIter | 8 |
| Time | 1.15e+03 |
---------------------------------------
2019-12-06 17:43:50.154 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 498
2019-12-06 17:43:50.154 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 356.15, Steps: 499, Distance 13.13, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.05, Angle accuracy 0.0, Num episodes 1691
2019-12-06 17:43:50.755 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 675
2019-12-06 17:43:50.755 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.93, Steps: 676, Distance 23.8, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.97, Angle accuracy 0.0, Num episodes 1692
2019-12-06 17:43:51.198 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 493
2019-12-06 17:43:51.198 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 356.01, Steps: 494, Distance 12.96, Angular velocity 0.0, Speed: 3.15, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 92.94, Angle accuracy 0.0, Num episodes 1693
2019-12-06 17:43:51.714 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 583
2019-12-06 17:43:51.715 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.27, Steps: 584, Distance 17.92, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.92, Angle accuracy 0.0, Num episodes 1694
2019-12-06 17:43:52.398 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 769
2019-12-06 17:43:52.399 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 469.54, Steps: 770, Distance 29.63, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.78, Angle accuracy 0.0, Num episodes 1695
2019-12-06 17:43:53.098 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 778
2019-12-06 17:43:53.099 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 471.67, Steps: 779, Distance 30.31, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.92, Angle accuracy 0.0, Num episodes 1696
Warning: trajectory cut off by epoch at 198 steps.
---------------------------------------
| Epoch | 304 |
| AverageEpRet | 418 |
| StdEpRet | 49 |
| MaxEpRet | 472 |
| MinEpRet | 356 |
| EpLen | 634 |
| AverageVVals | 56.7 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.7 |
| MinVVals | 56.7 |
| TotalEnvInteracts | 1.22e+06 |
| LossPi | 1.48e-07 |
| LossV | 424 |
| DeltaLossPi | -0.0021 |
| DeltaLossV | -1.38 |
| Entropy | -1.95 |
| KL | 0.00396 |
| ClipFrac | 0.0463 |
| StopIter | 79 |
| Time | 1.15e+03 |
---------------------------------------
2019-12-06 17:43:54.020 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 643
2019-12-06 17:43:54.020 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.65, Steps: 644, Distance 21.93, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.7, Angle accuracy 0.0, Num episodes 1697
2019-12-06 17:43:54.557 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:43:54.557 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.48, Steps: 593, Distance 18.63, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.15, Angle accuracy 0.0, Num episodes 1698
2019-12-06 17:43:55.138 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 652
2019-12-06 17:43:55.139 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.71, Steps: 653, Distance 22.24, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1699
2019-12-06 17:43:55.817 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 756
2019-12-06 17:43:55.818 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.23, Steps: 757, Distance 29.46, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 1700
2019-12-06 17:43:56.509 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 781
2019-12-06 17:43:56.509 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 474.83, Steps: 782, Distance 30.85, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.9, Angle accuracy 0.0, Num episodes 1701
Warning: trajectory cut off by epoch at 571 steps.
Early stopping at step 22 due to reaching max kl.
---------------------------------------
| Epoch | 305 |
| AverageEpRet | 444 |
| StdEpRet | 21.5 |
| MaxEpRet | 475 |
| MinEpRet | 413 |
| EpLen | 686 |
| AverageVVals | 55.5 |
| StdVVals | 7.63e-06 |
| MaxVVals | 55.5 |
| MinVVals | 55.5 |
| TotalEnvInteracts | 1.22e+06 |
| LossPi | 1.13e-08 |
| LossV | 442 |
| DeltaLossPi | -0.000161 |
| DeltaLossV | -0.487 |
| Entropy | -1.98 |
| KL | 0.00369 |
| ClipFrac | 0.0233 |
| StopIter | 22 |
| Time | 1.15e+03 |
---------------------------------------
2019-12-06 17:43:57.684 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:43:57.684 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.09, Steps: 639, Distance 21.52, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1702
2019-12-06 17:43:58.290 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:43:58.290 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.65, Steps: 684, Distance 24.63, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.1, Angle accuracy 0.0, Num episodes 1703
2019-12-06 17:43:58.602 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 343
2019-12-06 17:43:58.602 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 256.62, Steps: 344, Distance 6.34, Angular velocity 0.0, Speed: 2.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.71, Angle accuracy 0.0, Num episodes 1704
2019-12-06 17:43:59.173 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:43:59.173 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.82, Steps: 636, Distance 21.67, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.66, Angle accuracy 0.0, Num episodes 1705
2019-12-06 17:43:59.618 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 507
2019-12-06 17:43:59.619 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.8, Steps: 508, Distance 14.01, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.62, Angle accuracy 0.0, Num episodes 1706
2019-12-06 17:44:00.102 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:44:00.102 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.78, Steps: 545, Distance 16.18, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.32, Angle accuracy 0.0, Num episodes 1707
Warning: trajectory cut off by epoch at 644 steps.
---------------------------------------
| Epoch | 306 |
| AverageEpRet | 388 |
| StdEpRet | 65.1 |
| MaxEpRet | 450 |
| MinEpRet | 257 |
| EpLen | 559 |
| AverageVVals | 56.2 |
| StdVVals | 0 |
| MaxVVals | 56.2 |
| MinVVals | 56.2 |
| TotalEnvInteracts | 1.23e+06 |
| LossPi | 2.52e-08 |
| LossV | 368 |
| DeltaLossPi | -0.00407 |
| DeltaLossV | -3.28 |
| Entropy | -1.98 |
| KL | 0.00441 |
| ClipFrac | 0.0278 |
| StopIter | 79 |
| Time | 1.16e+03 |
---------------------------------------
2019-12-06 17:44:01.438 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 692
2019-12-06 17:44:01.439 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.71, Steps: 693, Distance 25.27, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 1708
2019-12-06 17:44:02.016 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 655
2019-12-06 17:44:02.017 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.33, Steps: 656, Distance 22.77, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.02, Angle accuracy 0.0, Num episodes 1709
2019-12-06 17:44:02.346 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 358
2019-12-06 17:44:02.346 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 266.89, Steps: 359, Distance 6.99, Angular velocity 0.0, Speed: 2.39, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.64, Angle accuracy 0.0, Num episodes 1710
2019-12-06 17:44:02.736 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 422
2019-12-06 17:44:02.737 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 301.99, Steps: 423, Distance 9.6, Angular velocity 0.0, Speed: 2.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.82, Angle accuracy 0.0, Num episodes 1711
2019-12-06 17:44:03.175 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 481
2019-12-06 17:44:03.175 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.61, Steps: 482, Distance 12.65, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.91, Angle accuracy 0.0, Num episodes 1712
2019-12-06 17:44:03.754 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 647
2019-12-06 17:44:03.755 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.18, Steps: 648, Distance 22.31, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.77, Angle accuracy 0.0, Num episodes 1713
2019-12-06 17:44:04.113 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 399
2019-12-06 17:44:04.113 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 297.21, Steps: 400, Distance 8.59, Angular velocity 0.0, Speed: 2.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.79, Angle accuracy 0.0, Num episodes 1714
Warning: trajectory cut off by epoch at 339 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 307 |
| AverageEpRet | 362 |
| StdEpRet | 69 |
| MaxEpRet | 441 |
| MinEpRet | 267 |
| EpLen | 523 |
| AverageVVals | 58 |
| StdVVals | 7.63e-06 |
| MaxVVals | 58 |
| MinVVals | 58 |
| TotalEnvInteracts | 1.23e+06 |
| LossPi | 1.93e-08 |
| LossV | 401 |
| DeltaLossPi | -0.00104 |
| DeltaLossV | -1.68 |
| Entropy | -1.99 |
| KL | 0.000585 |
| ClipFrac | 0.0005 |
| StopIter | 6 |
| Time | 1.16e+03 |
---------------------------------------
2019-12-06 17:44:05.137 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 686
2019-12-06 17:44:05.137 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.29, Steps: 687, Distance 24.73, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 1715
2019-12-06 17:44:05.755 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:44:05.756 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.38, Steps: 666, Distance 23.19, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.09, Angle accuracy 0.0, Num episodes 1716
2019-12-06 17:44:06.126 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 407
2019-12-06 17:44:06.126 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.64, Steps: 408, Distance 8.89, Angular velocity 0.0, Speed: 2.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.19, Angle accuracy 0.0, Num episodes 1717
2019-12-06 17:44:06.753 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 701
2019-12-06 17:44:06.753 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.86, Steps: 702, Distance 25.93, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.29, Angle accuracy 0.0, Num episodes 1718
2019-12-06 17:44:07.296 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:44:07.296 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.26, Steps: 601, Distance 19.36, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1719
2019-12-06 17:44:07.889 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 653
2019-12-06 17:44:07.889 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.46, Steps: 654, Distance 22.33, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1720
Warning: trajectory cut off by epoch at 282 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 308 |
| AverageEpRet | 414 |
| StdEpRet | 52 |
| MaxEpRet | 446 |
| MinEpRet | 300 |
| EpLen | 620 |
| AverageVVals | 56.7 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.7 |
| MinVVals | 56.7 |
| TotalEnvInteracts | 1.24e+06 |
| LossPi | -4.17e-09 |
| LossV | 418 |
| DeltaLossPi | -0.000875 |
| DeltaLossV | -0.224 |
| Entropy | -1.99 |
| KL | -0.000271 |
| ClipFrac | 0.002 |
| StopIter | 1 |
| Time | 1.16e+03 |
---------------------------------------
2019-12-06 17:44:08.676 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 529
2019-12-06 17:44:08.677 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.64, Steps: 530, Distance 15.06, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.86, Angle accuracy 0.0, Num episodes 1721
2019-12-06 17:44:09.252 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:44:09.252 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.0, Steps: 625, Distance 20.72, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.54, Angle accuracy 0.0, Num episodes 1722
2019-12-06 17:44:09.765 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:44:09.766 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 391.0, Steps: 564, Distance 17.09, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.48, Angle accuracy 0.0, Num episodes 1723
2019-12-06 17:44:10.499 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 814
2019-12-06 17:44:10.499 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 470.29, Steps: 815, Distance 33.05, Angular velocity 0.0, Speed: 4.13, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.25, Angle accuracy 0.0, Num episodes 1724
2019-12-06 17:44:11.163 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 741
2019-12-06 17:44:11.164 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.47, Steps: 742, Distance 28.29, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.66, Angle accuracy 0.0, Num episodes 1725
2019-12-06 17:44:11.578 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 466
2019-12-06 17:44:11.578 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.1, Steps: 467, Distance 11.76, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.43, Angle accuracy 0.0, Num episodes 1726
Warning: trajectory cut off by epoch at 257 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 309 |
| AverageEpRet | 410 |
| StdEpRet | 46.3 |
| MaxEpRet | 470 |
| MinEpRet | 334 |
| EpLen | 624 |
| AverageVVals | 56.3 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.24e+06 |
| LossPi | -1.86e-08 |
| LossV | 434 |
| DeltaLossPi | -0.000528 |
| DeltaLossV | -1.02 |
| Entropy | -1.97 |
| KL | 5.74e-05 |
| ClipFrac | 0.0103 |
| StopIter | 3 |
| Time | 1.17e+03 |
---------------------------------------
2019-12-06 17:44:12.567 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:44:12.568 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.76, Steps: 763, Distance 29.71, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.83, Angle accuracy 0.0, Num episodes 1727
2019-12-06 17:44:13.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 486
2019-12-06 17:44:13.012 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.69, Steps: 487, Distance 13.02, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.06, Angle accuracy 0.0, Num episodes 1728
2019-12-06 17:44:13.504 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 526
2019-12-06 17:44:13.504 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 378.45, Steps: 527, Distance 14.91, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.84, Angle accuracy 0.0, Num episodes 1729
2019-12-06 17:44:14.134 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:44:14.135 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.08, Steps: 695, Distance 25.24, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.2, Angle accuracy 0.0, Num episodes 1730
2019-12-06 17:44:14.761 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:44:14.761 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.84, Steps: 697, Distance 25.2, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.27, Angle accuracy 0.0, Num episodes 1731
2019-12-06 17:44:15.249 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 542
2019-12-06 17:44:15.249 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.26, Steps: 543, Distance 16.11, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.21, Angle accuracy 0.0, Num episodes 1732
Warning: trajectory cut off by epoch at 288 steps.
Warning: could not pickle state_dict.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 310 |
| AverageEpRet | 415 |
| StdEpRet | 41.4 |
| MaxEpRet | 462 |
| MinEpRet | 358 |
| EpLen | 619 |
| AverageVVals | 55.3 |
| StdVVals | 7.63e-06 |
| MaxVVals | 55.3 |
| MinVVals | 55.3 |
| TotalEnvInteracts | 1.24e+06 |
| LossPi | 2.56e-08 |
| LossV | 436 |
| DeltaLossPi | 1.33e-05 |
| DeltaLossV | -1.11 |
| Entropy | -2 |
| KL | 0.000294 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.17e+03 |
---------------------------------------
2019-12-06 17:44:16.511 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 630
2019-12-06 17:44:16.511 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.12, Steps: 631, Distance 21.34, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.56, Angle accuracy 0.0, Num episodes 1733
2019-12-06 17:44:17.092 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:44:17.093 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.95, Steps: 615, Distance 20.25, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.47, Angle accuracy 0.0, Num episodes 1734
2019-12-06 17:44:17.697 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:44:17.697 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.46, Steps: 660, Distance 23.26, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.96, Angle accuracy 0.0, Num episodes 1735
2019-12-06 17:44:18.247 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:44:18.248 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.17, Steps: 615, Distance 20.14, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 1736
2019-12-06 17:44:18.816 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 632
2019-12-06 17:44:18.816 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.57, Steps: 633, Distance 21.3, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.7, Angle accuracy 0.0, Num episodes 1737
2019-12-06 17:44:19.364 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:44:19.364 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.18, Steps: 609, Distance 19.82, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.39, Angle accuracy 0.0, Num episodes 1738
Warning: trajectory cut off by epoch at 237 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 311 |
| AverageEpRet | 424 |
| StdEpRet | 7 |
| MaxEpRet | 436 |
| MinEpRet | 413 |
| EpLen | 627 |
| AverageVVals | 56.3 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.25e+06 |
| LossPi | 2.98e-10 |
| LossV | 409 |
| DeltaLossPi | -0.00087 |
| DeltaLossV | -0.292 |
| Entropy | -1.99 |
| KL | 0.00123 |
| ClipFrac | 0.001 |
| StopIter | 1 |
| Time | 1.18e+03 |
---------------------------------------
2019-12-06 17:44:20.046 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 426
2019-12-06 17:44:20.047 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 315.32, Steps: 427, Distance 9.88, Angular velocity 0.0, Speed: 2.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.82, Angle accuracy 0.0, Num episodes 1739
2019-12-06 17:44:20.456 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 456
2019-12-06 17:44:20.456 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.36, Steps: 457, Distance 11.27, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.99, Angle accuracy 0.0, Num episodes 1740
2019-12-06 17:44:20.949 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 545
2019-12-06 17:44:20.950 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.85, Steps: 546, Distance 16.07, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.24, Angle accuracy 0.0, Num episodes 1741
2019-12-06 17:44:21.510 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 627
2019-12-06 17:44:21.510 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.03, Steps: 628, Distance 21.17, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.69, Angle accuracy 0.0, Num episodes 1742
2019-12-06 17:44:22.049 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 583
2019-12-06 17:44:22.050 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.83, Steps: 584, Distance 18.32, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.1, Angle accuracy 0.0, Num episodes 1743
2019-12-06 17:44:22.631 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:44:22.632 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.96, Steps: 636, Distance 21.49, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.72, Angle accuracy 0.0, Num episodes 1744
2019-12-06 17:44:23.209 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 646
2019-12-06 17:44:23.209 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.01, Steps: 647, Distance 22.27, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.93, Angle accuracy 0.0, Num episodes 1745
Warning: trajectory cut off by epoch at 75 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 312 |
| AverageEpRet | 390 |
| StdEpRet | 45.1 |
| MaxEpRet | 429 |
| MinEpRet | 315 |
| EpLen | 561 |
| AverageVVals | 56.8 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.8 |
| MinVVals | 56.8 |
| TotalEnvInteracts | 1.25e+06 |
| LossPi | 7.75e-09 |
| LossV | 402 |
| DeltaLossPi | -0.000567 |
| DeltaLossV | -0.00604 |
| Entropy | -1.99 |
| KL | 0.00171 |
| ClipFrac | 0.00075 |
| StopIter | 1 |
| Time | 1.18e+03 |
---------------------------------------
2019-12-06 17:44:24.025 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 751
2019-12-06 17:44:24.025 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.26, Steps: 752, Distance 29.35, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.88, Angle accuracy 0.0, Num episodes 1746
2019-12-06 17:44:24.598 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:44:24.598 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.33, Steps: 638, Distance 21.8, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.65, Angle accuracy 0.0, Num episodes 1747
2019-12-06 17:44:25.142 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 613
2019-12-06 17:44:25.142 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.35, Steps: 614, Distance 20.28, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.39, Angle accuracy 0.0, Num episodes 1748
2019-12-06 17:44:25.755 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:44:25.755 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.61, Steps: 623, Distance 20.92, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.64, Angle accuracy 0.0, Num episodes 1749
2019-12-06 17:44:26.352 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 610
2019-12-06 17:44:26.353 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.18, Steps: 611, Distance 20.19, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.52, Angle accuracy 0.0, Num episodes 1750
2019-12-06 17:44:26.875 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:44:26.875 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.6, Steps: 589, Distance 18.94, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.26, Angle accuracy 0.0, Num episodes 1751
Warning: trajectory cut off by epoch at 173 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 313 |
| AverageEpRet | 423 |
| StdEpRet | 16 |
| MaxEpRet | 453 |
| MinEpRet | 402 |
| EpLen | 638 |
| AverageVVals | 56.9 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.9 |
| MinVVals | 56.9 |
| TotalEnvInteracts | 1.26e+06 |
| LossPi | 3.56e-08 |
| LossV | 438 |
| DeltaLossPi | -0.000503 |
| DeltaLossV | -1.42 |
| Entropy | -1.98 |
| KL | 0.000276 |
| ClipFrac | 0 |
| StopIter | 3 |
| Time | 1.18e+03 |
---------------------------------------
2019-12-06 17:44:27.761 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 709
2019-12-06 17:44:27.761 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 452.5, Steps: 710, Distance 26.31, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.47, Angle accuracy 0.0, Num episodes 1752
2019-12-06 17:44:28.106 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 385
2019-12-06 17:44:28.106 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 283.82, Steps: 386, Distance 8.07, Angular velocity 0.0, Speed: 2.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.36, Angle accuracy 0.0, Num episodes 1753
2019-12-06 17:44:28.648 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 608
2019-12-06 17:44:28.648 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.35, Steps: 609, Distance 20.08, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 1754
2019-12-06 17:44:28.950 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 336
2019-12-06 17:44:28.950 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 241.25, Steps: 337, Distance 6.25, Angular velocity 0.0, Speed: 2.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.57, Angle accuracy 0.0, Num episodes 1755
2019-12-06 17:44:29.438 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:44:29.438 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.96, Steps: 539, Distance 15.66, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.19, Angle accuracy 0.0, Num episodes 1756
2019-12-06 17:44:29.999 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:44:29.999 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.47, Steps: 589, Distance 18.77, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.14, Angle accuracy 0.0, Num episodes 1757
2019-12-06 17:44:30.451 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 499
2019-12-06 17:44:30.451 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.03, Steps: 500, Distance 13.81, Angular velocity 0.0, Speed: 3.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.49, Angle accuracy 0.0, Num episodes 1758
Warning: trajectory cut off by epoch at 330 steps.
---------------------------------------
| Epoch | 314 |
| AverageEpRet | 365 |
| StdEpRet | 71.2 |
| MaxEpRet | 453 |
| MinEpRet | 241 |
| EpLen | 524 |
| AverageVVals | 55.7 |
| StdVVals | 1.14e-05 |
| MaxVVals | 55.7 |
| MinVVals | 55.7 |
| TotalEnvInteracts | 1.26e+06 |
| LossPi | 5.45e-08 |
| LossV | 395 |
| DeltaLossPi | -0.00284 |
| DeltaLossV | -2.58 |
| Entropy | -2.01 |
| KL | 0.00498 |
| ClipFrac | 0.0653 |
| StopIter | 79 |
| Time | 1.19e+03 |
---------------------------------------
2019-12-06 17:44:31.551 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 702
2019-12-06 17:44:31.552 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.87, Steps: 703, Distance 26.3, Angular velocity 0.0, Speed: 3.94, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 1759
2019-12-06 17:44:32.191 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:44:32.191 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.44, Steps: 716, Distance 26.86, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 1760
2019-12-06 17:44:32.871 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:44:32.871 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 463.39, Steps: 762, Distance 30.3, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.83, Angle accuracy 0.0, Num episodes 1761
2019-12-06 17:44:33.390 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:44:33.391 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.6, Steps: 589, Distance 19.0, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1762
2019-12-06 17:44:33.934 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:44:33.935 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.3, Steps: 603, Distance 19.93, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.4, Angle accuracy 0.0, Num episodes 1763
2019-12-06 17:44:34.344 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 448
2019-12-06 17:44:34.345 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 331.63, Steps: 449, Distance 11.11, Angular velocity 0.0, Speed: 2.97, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.03, Angle accuracy 0.0, Num episodes 1764
Warning: trajectory cut off by epoch at 178 steps.
Early stopping at step 15 due to reaching max kl.
---------------------------------------
| Epoch | 315 |
| AverageEpRet | 415 |
| StdEpRet | 42.5 |
| MaxEpRet | 463 |
| MinEpRet | 332 |
| EpLen | 637 |
| AverageVVals | 57.3 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.3 |
| MinVVals | 57.3 |
| TotalEnvInteracts | 1.26e+06 |
| LossPi | -2.03e-09 |
| LossV | 472 |
| DeltaLossPi | -0.000895 |
| DeltaLossV | -7.93 |
| Entropy | -2.01 |
| KL | 0.00038 |
| ClipFrac | 0.0182 |
| StopIter | 15 |
| Time | 1.19e+03 |
---------------------------------------
2019-12-06 17:44:35.251 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 745
2019-12-06 17:44:35.251 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.86, Steps: 746, Distance 28.96, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.87, Angle accuracy 0.0, Num episodes 1765
2019-12-06 17:44:35.921 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 723
2019-12-06 17:44:35.922 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.55, Steps: 724, Distance 27.55, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 1766
2019-12-06 17:44:36.291 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 391
2019-12-06 17:44:36.292 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 297.71, Steps: 392, Distance 8.46, Angular velocity 0.0, Speed: 2.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.49, Angle accuracy 0.0, Num episodes 1767
2019-12-06 17:44:36.860 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 635
2019-12-06 17:44:36.861 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.33, Steps: 636, Distance 21.71, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.85, Angle accuracy 0.0, Num episodes 1768
2019-12-06 17:44:37.447 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 643
2019-12-06 17:44:37.448 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.43, Steps: 644, Distance 22.34, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1769
2019-12-06 17:44:38.133 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 746
2019-12-06 17:44:38.134 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.22, Steps: 747, Distance 29.16, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.83, Angle accuracy 0.0, Num episodes 1770
Warning: trajectory cut off by epoch at 111 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 316 |
| AverageEpRet | 418 |
| StdEpRet | 55.1 |
| MaxEpRet | 459 |
| MinEpRet | 298 |
| EpLen | 648 |
| AverageVVals | 54.5 |
| StdVVals | 1.14e-05 |
| MaxVVals | 54.5 |
| MinVVals | 54.5 |
| TotalEnvInteracts | 1.27e+06 |
| LossPi | -5.51e-08 |
| LossV | 476 |
| DeltaLossPi | 0.00229 |
| DeltaLossV | -0.586 |
| Entropy | -2.01 |
| KL | 0.00538 |
| ClipFrac | 0.0723 |
| StopIter | 3 |
| Time | 1.19e+03 |
---------------------------------------
2019-12-06 17:44:38.861 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 603
2019-12-06 17:44:38.862 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.79, Steps: 604, Distance 19.53, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 1771
2019-12-06 17:44:39.496 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:44:39.496 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.31, Steps: 684, Distance 24.6, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.15, Angle accuracy 0.0, Num episodes 1772
2019-12-06 17:44:39.970 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 530
2019-12-06 17:44:39.971 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.59, Steps: 531, Distance 15.23, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.88, Angle accuracy 0.0, Num episodes 1773
2019-12-06 17:44:40.617 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:44:40.618 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.28, Steps: 716, Distance 26.78, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 1774
2019-12-06 17:44:41.127 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 555
2019-12-06 17:44:41.127 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.56, Steps: 556, Distance 16.81, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.58, Angle accuracy 0.0, Num episodes 1775
2019-12-06 17:44:41.791 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 722
2019-12-06 17:44:41.791 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.78, Steps: 723, Distance 27.13, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.67, Angle accuracy 0.0, Num episodes 1776
Warning: trajectory cut off by epoch at 186 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 317 |
| AverageEpRet | 426 |
| StdEpRet | 29.5 |
| MaxEpRet | 459 |
| MinEpRet | 385 |
| EpLen | 636 |
| AverageVVals | 53.7 |
| StdVVals | 3.81e-06 |
| MaxVVals | 53.7 |
| MinVVals | 53.7 |
| TotalEnvInteracts | 1.27e+06 |
| LossPi | -7.25e-08 |
| LossV | 469 |
| DeltaLossPi | -0.000785 |
| DeltaLossV | -5.29 |
| Entropy | -2.02 |
| KL | 0.000654 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.2e+03 |
---------------------------------------
2019-12-06 17:44:42.323 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 310
2019-12-06 17:44:42.324 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 231.42, Steps: 311, Distance 5.23, Angular velocity 0.0, Speed: 2.06, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 84.12, Angle accuracy 0.0, Num episodes 1777
2019-12-06 17:44:42.577 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 280
2019-12-06 17:44:42.577 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 208.34, Steps: 281, Distance 4.26, Angular velocity 0.0, Speed: 1.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 81.2, Angle accuracy 0.0, Num episodes 1778
2019-12-06 17:44:43.101 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 582
2019-12-06 17:44:43.101 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.18, Steps: 583, Distance 18.42, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.89, Angle accuracy 0.0, Num episodes 1779
2019-12-06 17:44:43.738 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 712
2019-12-06 17:44:43.738 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.58, Steps: 713, Distance 26.57, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.4, Angle accuracy 0.0, Num episodes 1780
2019-12-06 17:44:44.349 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:44:44.350 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.26, Steps: 662, Distance 23.14, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.91, Angle accuracy 0.0, Num episodes 1781
2019-12-06 17:44:44.939 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:44:44.939 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.07, Steps: 666, Distance 23.48, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.99, Angle accuracy 0.0, Num episodes 1782
2019-12-06 17:44:45.546 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 678
2019-12-06 17:44:45.546 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.58, Steps: 679, Distance 24.3, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.28, Angle accuracy 0.0, Num episodes 1783
Warning: trajectory cut off by epoch at 105 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 318 |
| AverageEpRet | 372 |
| StdEpRet | 97.4 |
| MaxEpRet | 450 |
| MinEpRet | 208 |
| EpLen | 556 |
| AverageVVals | 56.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.1 |
| MinVVals | 56.1 |
| TotalEnvInteracts | 1.28e+06 |
| LossPi | -4.54e-08 |
| LossV | 444 |
| DeltaLossPi | -0.000655 |
| DeltaLossV | -3.28 |
| Entropy | -1.99 |
| KL | 0.00186 |
| ClipFrac | 0.026 |
| StopIter | 1 |
| Time | 1.2e+03 |
---------------------------------------
2019-12-06 17:44:46.401 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 773
2019-12-06 17:44:46.402 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 467.08, Steps: 774, Distance 30.63, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.0, Angle accuracy 0.0, Num episodes 1784
2019-12-06 17:44:47.018 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 669
2019-12-06 17:44:47.018 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.34, Steps: 670, Distance 23.9, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.06, Angle accuracy 0.0, Num episodes 1785
2019-12-06 17:44:47.338 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 357
2019-12-06 17:44:47.339 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.73, Steps: 358, Distance 7.02, Angular velocity 0.0, Speed: 2.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.9, Angle accuracy 0.0, Num episodes 1786
2019-12-06 17:44:47.898 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:44:47.898 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.38, Steps: 599, Distance 19.28, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.26, Angle accuracy 0.0, Num episodes 1787
2019-12-06 17:44:48.565 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 690
2019-12-06 17:44:48.566 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.35, Steps: 691, Distance 25.2, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.28, Angle accuracy 0.0, Num episodes 1788
2019-12-06 17:44:49.146 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 655
2019-12-06 17:44:49.146 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.26, Steps: 656, Distance 22.81, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1789
Warning: trajectory cut off by epoch at 252 steps.
---------------------------------------
| Epoch | 319 |
| AverageEpRet | 415 |
| StdEpRet | 67 |
| MaxEpRet | 467 |
| MinEpRet | 269 |
| EpLen | 625 |
| AverageVVals | 54.2 |
| StdVVals | 7.63e-06 |
| MaxVVals | 54.2 |
| MinVVals | 54.2 |
| TotalEnvInteracts | 1.28e+06 |
| LossPi | 4.79e-08 |
| LossV | 471 |
| DeltaLossPi | -0.00286 |
| DeltaLossV | -1.68 |
| Entropy | -2.02 |
| KL | 0.0034 |
| ClipFrac | 0.0395 |
| StopIter | 79 |
| Time | 1.21e+03 |
---------------------------------------
2019-12-06 17:44:50.062 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:44:50.063 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.09, Steps: 596, Distance 19.24, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.28, Angle accuracy 0.0, Num episodes 1790
2019-12-06 17:44:50.537 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 518
2019-12-06 17:44:50.538 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.62, Steps: 519, Distance 15.02, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.0, Angle accuracy 0.0, Num episodes 1791
2019-12-06 17:44:51.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 532
2019-12-06 17:44:51.012 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.3, Steps: 533, Distance 15.79, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.25, Angle accuracy 0.0, Num episodes 1792
2019-12-06 17:44:51.494 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 522
2019-12-06 17:44:51.494 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.18, Steps: 523, Distance 15.0, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.95, Angle accuracy 0.0, Num episodes 1793
2019-12-06 17:44:51.783 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 318
2019-12-06 17:44:51.784 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 224.54, Steps: 319, Distance 5.6, Angular velocity 0.0, Speed: 2.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.86, Angle accuracy 0.0, Num episodes 1794
2019-12-06 17:44:52.476 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 753
2019-12-06 17:44:52.476 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 454.48, Steps: 754, Distance 29.6, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.89, Angle accuracy 0.0, Num episodes 1795
2019-12-06 17:44:53.011 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:44:53.011 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.84, Steps: 589, Distance 19.1, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.03, Angle accuracy 0.0, Num episodes 1796
Warning: trajectory cut off by epoch at 167 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 320 |
| AverageEpRet | 377 |
| StdEpRet | 67.4 |
| MaxEpRet | 454 |
| MinEpRet | 225 |
| EpLen | 548 |
| AverageVVals | 55.5 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.5 |
| MinVVals | 55.5 |
| TotalEnvInteracts | 1.28e+06 |
| LossPi | -1.65e-08 |
| LossV | 409 |
| DeltaLossPi | -0.00414 |
| DeltaLossV | -0.891 |
| Entropy | -2.02 |
| KL | 0.00269 |
| ClipFrac | 0.0338 |
| StopIter | 79 |
| Time | 1.21e+03 |
---------------------------------------
2019-12-06 17:44:54.258 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:44:54.258 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.07, Steps: 607, Distance 20.14, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.47, Angle accuracy 0.0, Num episodes 1797
2019-12-06 17:44:54.805 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 611
2019-12-06 17:44:54.805 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.61, Steps: 612, Distance 20.25, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.3, Angle accuracy 0.0, Num episodes 1798
2019-12-06 17:44:55.495 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 768
2019-12-06 17:44:55.496 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 474.11, Steps: 769, Distance 30.75, Angular velocity 0.0, Speed: 4.13, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.05, Angle accuracy 0.0, Num episodes 1799
2019-12-06 17:44:56.088 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 649
2019-12-06 17:44:56.089 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.54, Steps: 650, Distance 22.85, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1800
2019-12-06 17:44:56.492 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 459
2019-12-06 17:44:56.492 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.95, Steps: 460, Distance 11.6, Angular velocity 0.0, Speed: 3.03, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.2, Angle accuracy 0.0, Num episodes 1801
2019-12-06 17:44:57.116 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:44:57.117 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.94, Steps: 708, Distance 26.58, Angular velocity 0.0, Speed: 4.01, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 1802
Warning: trajectory cut off by epoch at 194 steps.
Early stopping at step 20 due to reaching max kl.
---------------------------------------
| Epoch | 321 |
| AverageEpRet | 426 |
| StdEpRet | 42.8 |
| MaxEpRet | 474 |
| MinEpRet | 340 |
| EpLen | 634 |
| AverageVVals | 56.5 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56.5 |
| MinVVals | 56.5 |
| TotalEnvInteracts | 1.29e+06 |
| LossPi | -2.55e-08 |
| LossV | 450 |
| DeltaLossPi | -9.88e-05 |
| DeltaLossV | -0.0132 |
| Entropy | -2.03 |
| KL | 0.000319 |
| ClipFrac | 0 |
| StopIter | 20 |
| Time | 1.21e+03 |
---------------------------------------
2019-12-06 17:44:57.802 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 466
2019-12-06 17:44:57.803 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.74, Steps: 467, Distance 12.1, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.72, Angle accuracy 0.0, Num episodes 1803
2019-12-06 17:44:58.271 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:44:58.271 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 372.31, Steps: 528, Distance 15.49, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.16, Angle accuracy 0.0, Num episodes 1804
2019-12-06 17:44:58.895 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:44:58.896 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.42, Steps: 708, Distance 26.54, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.47, Angle accuracy 0.0, Num episodes 1805
2019-12-06 17:44:59.501 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 667
2019-12-06 17:44:59.501 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.36, Steps: 668, Distance 24.0, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.22, Angle accuracy 0.0, Num episodes 1806
2019-12-06 17:45:00.034 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:45:00.035 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.08, Steps: 603, Distance 19.86, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.23, Angle accuracy 0.0, Num episodes 1807
2019-12-06 17:45:00.578 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:45:00.579 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.31, Steps: 600, Distance 19.63, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.36, Angle accuracy 0.0, Num episodes 1808
Warning: trajectory cut off by epoch at 426 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 322 |
| AverageEpRet | 408 |
| StdEpRet | 37.7 |
| MaxEpRet | 453 |
| MinEpRet | 345 |
| EpLen | 596 |
| AverageVVals | 56.4 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.4 |
| MinVVals | 56.4 |
| TotalEnvInteracts | 1.29e+06 |
| LossPi | -6.2e-08 |
| LossV | 399 |
| DeltaLossPi | 0.00059 |
| DeltaLossV | -2.32 |
| Entropy | -2.02 |
| KL | 0.0109 |
| ClipFrac | 0.11 |
| StopIter | 1 |
| Time | 1.22e+03 |
---------------------------------------
2019-12-06 17:45:01.514 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 542
2019-12-06 17:45:01.515 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.83, Steps: 543, Distance 16.03, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.33, Angle accuracy 0.0, Num episodes 1809
2019-12-06 17:45:02.095 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 649
2019-12-06 17:45:02.095 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.33, Steps: 650, Distance 22.48, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.92, Angle accuracy 0.0, Num episodes 1810
2019-12-06 17:45:02.746 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 732
2019-12-06 17:45:02.746 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.47, Steps: 733, Distance 28.13, Angular velocity 0.0, Speed: 4.02, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 96.69, Angle accuracy 0.0, Num episodes 1811
2019-12-06 17:45:03.386 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:45:03.386 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.4, Steps: 692, Distance 25.38, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.28, Angle accuracy 0.0, Num episodes 1812
2019-12-06 17:45:03.692 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 341
2019-12-06 17:45:03.692 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 254.93, Steps: 342, Distance 6.38, Angular velocity 0.0, Speed: 2.27, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.55, Angle accuracy 0.0, Num episodes 1813
2019-12-06 17:45:04.150 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:45:04.151 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.06, Steps: 520, Distance 14.74, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.73, Angle accuracy 0.0, Num episodes 1814
Warning: trajectory cut off by epoch at 520 steps.
---------------------------------------
| Epoch | 323 |
| AverageEpRet | 394 |
| StdEpRet | 70.1 |
| MaxEpRet | 459 |
| MinEpRet | 255 |
| EpLen | 580 |
| AverageVVals | 57.9 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.9 |
| MinVVals | 57.9 |
| TotalEnvInteracts | 1.3e+06 |
| LossPi | 2.04e-08 |
| LossV | 411 |
| DeltaLossPi | -0.0022 |
| DeltaLossV | -0.101 |
| Entropy | -2.03 |
| KL | 0.00246 |
| ClipFrac | 0.0203 |
| StopIter | 79 |
| Time | 1.22e+03 |
---------------------------------------
2019-12-06 17:45:05.327 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:45:05.327 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.29, Steps: 639, Distance 21.83, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.82, Angle accuracy 0.0, Num episodes 1815
2019-12-06 17:45:05.831 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 560
2019-12-06 17:45:05.832 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.43, Steps: 561, Distance 16.97, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.67, Angle accuracy 0.0, Num episodes 1816
2019-12-06 17:45:06.330 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:45:06.330 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.52, Steps: 567, Distance 17.41, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.86, Angle accuracy 0.0, Num episodes 1817
2019-12-06 17:45:06.941 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 690
2019-12-06 17:45:06.941 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.81, Steps: 691, Distance 25.24, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 1818
2019-12-06 17:45:07.489 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 610
2019-12-06 17:45:07.489 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.05, Steps: 611, Distance 20.04, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.41, Angle accuracy 0.0, Num episodes 1819
2019-12-06 17:45:08.136 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 734
2019-12-06 17:45:08.136 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 454.57, Steps: 735, Distance 27.97, Angular velocity 0.0, Speed: 4.0, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.58, Angle accuracy 0.0, Num episodes 1820
Warning: trajectory cut off by epoch at 196 steps.
---------------------------------------
| Epoch | 324 |
| AverageEpRet | 424 |
| StdEpRet | 22.5 |
| MaxEpRet | 455 |
| MinEpRet | 397 |
| EpLen | 634 |
| AverageVVals | 57.6 |
| StdVVals | 0 |
| MaxVVals | 57.6 |
| MinVVals | 57.6 |
| TotalEnvInteracts | 1.3e+06 |
| LossPi | -5.08e-08 |
| LossV | 437 |
| DeltaLossPi | -0.000513 |
| DeltaLossV | -1.4 |
| Entropy | -2.02 |
| KL | 0.00264 |
| ClipFrac | 0.0065 |
| StopIter | 79 |
| Time | 1.22e+03 |
---------------------------------------
2019-12-06 17:45:08.760 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 316
2019-12-06 17:45:08.761 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 237.86, Steps: 317, Distance 5.39, Angular velocity 0.0, Speed: 2.08, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.36, Angle accuracy 0.0, Num episodes 1821
2019-12-06 17:45:09.323 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:45:09.324 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 407.27, Steps: 601, Distance 19.5, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.22, Angle accuracy 0.0, Num episodes 1822
2019-12-06 17:45:09.760 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 494
2019-12-06 17:45:09.761 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.56, Steps: 495, Distance 13.36, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.33, Angle accuracy 0.0, Num episodes 1823
2019-12-06 17:45:10.293 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 567
2019-12-06 17:45:10.293 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.0, Steps: 568, Distance 17.65, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.91, Angle accuracy 0.0, Num episodes 1824
2019-12-06 17:45:10.867 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:45:10.867 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.91, Steps: 601, Distance 19.34, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.35, Angle accuracy 0.0, Num episodes 1825
2019-12-06 17:45:11.362 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 559
2019-12-06 17:45:11.362 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.04, Steps: 560, Distance 17.05, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.47, Angle accuracy 0.0, Num episodes 1826
2019-12-06 17:45:11.859 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 564
2019-12-06 17:45:11.860 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.22, Steps: 565, Distance 17.58, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.8, Angle accuracy 0.0, Num episodes 1827
Warning: trajectory cut off by epoch at 293 steps.
---------------------------------------
| Epoch | 325 |
| AverageEpRet | 374 |
| StdEpRet | 57.5 |
| MaxEpRet | 416 |
| MinEpRet | 238 |
| EpLen | 530 |
| AverageVVals | 56.4 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.4 |
| MinVVals | 56.4 |
| TotalEnvInteracts | 1.3e+06 |
| LossPi | 2.51e-08 |
| LossV | 373 |
| DeltaLossPi | -0.00165 |
| DeltaLossV | -2.88 |
| Entropy | -2.04 |
| KL | 0.00155 |
| ClipFrac | 0.0253 |
| StopIter | 79 |
| Time | 1.23e+03 |
---------------------------------------
2019-12-06 17:45:12.680 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 471
2019-12-06 17:45:12.680 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 353.53, Steps: 472, Distance 12.33, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.52, Angle accuracy 0.0, Num episodes 1828
2019-12-06 17:45:13.301 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 682
2019-12-06 17:45:13.301 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.42, Steps: 683, Distance 24.5, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 1829
2019-12-06 17:45:13.837 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 590
2019-12-06 17:45:13.838 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.72, Steps: 591, Distance 18.79, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.0, Angle accuracy 0.0, Num episodes 1830
2019-12-06 17:45:14.091 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 274
2019-12-06 17:45:14.091 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 206.06, Steps: 275, Distance 4.09, Angular velocity 0.0, Speed: 1.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 80.46, Angle accuracy 0.0, Num episodes 1831
2019-12-06 17:45:14.440 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 381
2019-12-06 17:45:14.440 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 278.17, Steps: 382, Distance 7.95, Angular velocity 0.0, Speed: 2.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.04, Angle accuracy 0.0, Num episodes 1832
2019-12-06 17:45:14.915 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:45:14.915 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.76, Steps: 539, Distance 15.75, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.2, Angle accuracy 0.0, Num episodes 1833
2019-12-06 17:45:15.616 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 771
2019-12-06 17:45:15.616 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 478.72, Steps: 772, Distance 30.5, Angular velocity 0.0, Speed: 4.09, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.92, Angle accuracy 0.0, Num episodes 1834
Warning: trajectory cut off by epoch at 286 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 326 |
| AverageEpRet | 368 |
| StdEpRet | 89.7 |
| MaxEpRet | 479 |
| MinEpRet | 206 |
| EpLen | 531 |
| AverageVVals | 58.1 |
| StdVVals | 7.63e-06 |
| MaxVVals | 58.1 |
| MinVVals | 58.1 |
| TotalEnvInteracts | 1.31e+06 |
| LossPi | 1.17e-07 |
| LossV | 424 |
| DeltaLossPi | -0.00126 |
| DeltaLossV | -1.23 |
| Entropy | -2.03 |
| KL | 0.00169 |
| ClipFrac | 0.0025 |
| StopIter | 6 |
| Time | 1.23e+03 |
---------------------------------------
2019-12-06 17:45:16.556 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 671
2019-12-06 17:45:16.556 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.47, Steps: 672, Distance 23.92, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.01, Angle accuracy 0.0, Num episodes 1835
2019-12-06 17:45:16.938 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 429
2019-12-06 17:45:16.939 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 320.99, Steps: 430, Distance 10.07, Angular velocity 0.0, Speed: 2.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.05, Angle accuracy 0.0, Num episodes 1836
2019-12-06 17:45:17.299 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 400
2019-12-06 17:45:17.300 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 291.99, Steps: 401, Distance 8.72, Angular velocity 0.0, Speed: 2.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.07, Angle accuracy 0.0, Num episodes 1837
2019-12-06 17:45:17.800 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 551
2019-12-06 17:45:17.800 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.87, Steps: 552, Distance 16.71, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.65, Angle accuracy 0.0, Num episodes 1838
2019-12-06 17:45:18.411 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 678
2019-12-06 17:45:18.411 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.96, Steps: 679, Distance 24.42, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.29, Angle accuracy 0.0, Num episodes 1839
2019-12-06 17:45:18.959 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:45:18.959 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.32, Steps: 600, Distance 19.44, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.15, Angle accuracy 0.0, Num episodes 1840
2019-12-06 17:45:19.242 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 317
2019-12-06 17:45:19.242 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 232.48, Steps: 318, Distance 5.51, Angular velocity 0.0, Speed: 2.11, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.69, Angle accuracy 0.0, Num episodes 1841
Warning: trajectory cut off by epoch at 348 steps.
---------------------------------------
| Epoch | 327 |
| AverageEpRet | 364 |
| StdEpRet | 76.8 |
| MaxEpRet | 446 |
| MinEpRet | 232 |
| EpLen | 522 |
| AverageVVals | 57 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57 |
| MinVVals | 57 |
| TotalEnvInteracts | 1.31e+06 |
| LossPi | -1.61e-08 |
| LossV | 400 |
| DeltaLossPi | -0.00183 |
| DeltaLossV | -0.341 |
| Entropy | -2.04 |
| KL | 0.00249 |
| ClipFrac | 0.0198 |
| StopIter | 79 |
| Time | 1.24e+03 |
---------------------------------------
2019-12-06 17:45:20.022 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 371
2019-12-06 17:45:20.022 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.14, Steps: 372, Distance 7.47, Angular velocity 0.0, Speed: 2.44, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.5, Angle accuracy 0.0, Num episodes 1842
2019-12-06 17:45:20.600 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 648
2019-12-06 17:45:20.601 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.3, Steps: 649, Distance 22.49, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.94, Angle accuracy 0.0, Num episodes 1843
2019-12-06 17:45:21.218 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 678
2019-12-06 17:45:21.219 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.19, Steps: 679, Distance 24.28, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.26, Angle accuracy 0.0, Num episodes 1844
2019-12-06 17:45:21.831 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:45:21.832 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.93, Steps: 641, Distance 22.05, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.92, Angle accuracy 0.0, Num episodes 1845
2019-12-06 17:45:22.379 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 562
2019-12-06 17:45:22.379 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.14, Steps: 563, Distance 17.27, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.71, Angle accuracy 0.0, Num episodes 1846
2019-12-06 17:45:22.920 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 570
2019-12-06 17:45:22.920 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.17, Steps: 571, Distance 17.99, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.03, Angle accuracy 0.0, Num episodes 1847
Warning: trajectory cut off by epoch at 525 steps.
Early stopping at step 13 due to reaching max kl.
---------------------------------------
| Epoch | 328 |
| AverageEpRet | 399 |
| StdEpRet | 60.9 |
| MaxEpRet | 447 |
| MinEpRet | 268 |
| EpLen | 579 |
| AverageVVals | 57.6 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.6 |
| MinVVals | 57.6 |
| TotalEnvInteracts | 1.32e+06 |
| LossPi | 3.11e-08 |
| LossV | 399 |
| DeltaLossPi | 0.000208 |
| DeltaLossV | -0.88 |
| Entropy | -2.01 |
| KL | 0.000564 |
| ClipFrac | 0 |
| StopIter | 13 |
| Time | 1.24e+03 |
---------------------------------------
2019-12-06 17:45:24.057 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 549
2019-12-06 17:45:24.057 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.98, Steps: 550, Distance 16.54, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.49, Angle accuracy 0.0, Num episodes 1848
2019-12-06 17:45:24.611 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:45:24.612 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.4, Steps: 599, Distance 19.32, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.32, Angle accuracy 0.0, Num episodes 1849
2019-12-06 17:45:24.946 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 361
2019-12-06 17:45:24.946 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 259.91, Steps: 362, Distance 7.14, Angular velocity 0.0, Speed: 2.39, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.86, Angle accuracy 0.0, Num episodes 1850
2019-12-06 17:45:25.476 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 573
2019-12-06 17:45:25.476 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.51, Steps: 574, Distance 17.75, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.87, Angle accuracy 0.0, Num episodes 1851
2019-12-06 17:45:25.985 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:45:25.986 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.26, Steps: 567, Distance 17.39, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.63, Angle accuracy 0.0, Num episodes 1852
2019-12-06 17:45:26.644 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 735
2019-12-06 17:45:26.644 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.2, Steps: 736, Distance 28.03, Angular velocity 0.0, Speed: 4.02, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.77, Angle accuracy 0.0, Num episodes 1853
2019-12-06 17:45:26.984 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 370
2019-12-06 17:45:26.984 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 268.57, Steps: 371, Distance 7.42, Angular velocity 0.0, Speed: 2.43, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.48, Angle accuracy 0.0, Num episodes 1854
Warning: trajectory cut off by epoch at 241 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 329 |
| AverageEpRet | 373 |
| StdEpRet | 72.2 |
| MaxEpRet | 465 |
| MinEpRet | 260 |
| EpLen | 537 |
| AverageVVals | 58.5 |
| StdVVals | 0 |
| MaxVVals | 58.5 |
| MinVVals | 58.5 |
| TotalEnvInteracts | 1.32e+06 |
| LossPi | 8.54e-08 |
| LossV | 396 |
| DeltaLossPi | 0.00253 |
| DeltaLossV | -1.91 |
| Entropy | -2.01 |
| KL | 0.0104 |
| ClipFrac | 0.198 |
| StopIter | 1 |
| Time | 1.24e+03 |
---------------------------------------
2019-12-06 17:45:27.887 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 655
2019-12-06 17:45:27.887 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.44, Steps: 656, Distance 22.63, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.01, Angle accuracy 0.0, Num episodes 1855
2019-12-06 17:45:28.385 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 551
2019-12-06 17:45:28.386 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.34, Steps: 552, Distance 16.29, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.52, Angle accuracy 0.0, Num episodes 1856
2019-12-06 17:45:28.951 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 618
2019-12-06 17:45:28.951 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.98, Steps: 619, Distance 20.23, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.39, Angle accuracy 0.0, Num episodes 1857
2019-12-06 17:45:29.379 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 455
2019-12-06 17:45:29.380 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.47, Steps: 456, Distance 11.13, Angular velocity 0.0, Speed: 2.93, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.9, Angle accuracy 0.0, Num episodes 1858
2019-12-06 17:45:29.806 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 446
2019-12-06 17:45:29.807 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.85, Steps: 447, Distance 10.75, Angular velocity 0.0, Speed: 2.9, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.64, Angle accuracy 0.0, Num episodes 1859
2019-12-06 17:45:30.375 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 623
2019-12-06 17:45:30.375 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.46, Steps: 624, Distance 20.45, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.53, Angle accuracy 0.0, Num episodes 1860
2019-12-06 17:45:30.941 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:45:30.942 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.27, Steps: 632, Distance 21.19, Angular velocity 0.0, Speed: 3.71, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.51, Angle accuracy 0.0, Num episodes 1861
Warning: trajectory cut off by epoch at 14 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 330 |
| AverageEpRet | 398 |
| StdEpRet | 42.5 |
| MaxEpRet | 445 |
| MinEpRet | 334 |
| EpLen | 569 |
| AverageVVals | 57.1 |
| StdVVals | 1.91e-05 |
| MaxVVals | 57.1 |
| MinVVals | 57.1 |
| TotalEnvInteracts | 1.32e+06 |
| LossPi | -7.44e-08 |
| LossV | 409 |
| DeltaLossPi | -0.00139 |
| DeltaLossV | -0.0437 |
| Entropy | -2.01 |
| KL | 0.00257 |
| ClipFrac | 0.014 |
| StopIter | 79 |
| Time | 1.25e+03 |
---------------------------------------
2019-12-06 17:45:32.061 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 653
2019-12-06 17:45:32.061 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.26, Steps: 654, Distance 22.25, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.79, Angle accuracy 0.0, Num episodes 1862
2019-12-06 17:45:32.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 657
2019-12-06 17:45:32.656 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.84, Steps: 658, Distance 22.59, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.94, Angle accuracy 0.0, Num episodes 1863
2019-12-06 17:45:33.248 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 658
2019-12-06 17:45:33.248 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.18, Steps: 659, Distance 22.42, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.8, Angle accuracy 0.0, Num episodes 1864
2019-12-06 17:45:33.942 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 744
2019-12-06 17:45:33.943 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 460.73, Steps: 745, Distance 27.95, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.58, Angle accuracy 0.0, Num episodes 1865
2019-12-06 17:45:34.530 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:45:34.531 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.4, Steps: 630, Distance 20.68, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.56, Angle accuracy 0.0, Num episodes 1866
Warning: trajectory cut off by epoch at 654 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 331 |
| AverageEpRet | 443 |
| StdEpRet | 10 |
| MaxEpRet | 461 |
| MinEpRet | 431 |
| EpLen | 669 |
| AverageVVals | 57.3 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57.3 |
| MinVVals | 57.3 |
| TotalEnvInteracts | 1.33e+06 |
| LossPi | -1.45e-08 |
| LossV | 415 |
| DeltaLossPi | -0.00318 |
| DeltaLossV | -0.000244 |
| Entropy | -2.03 |
| KL | 0.00216 |
| ClipFrac | 0.00525 |
| StopIter | 2 |
| Time | 1.25e+03 |
---------------------------------------
2019-12-06 17:45:35.900 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 647
2019-12-06 17:45:35.900 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.3, Steps: 648, Distance 21.81, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.85, Angle accuracy 0.0, Num episodes 1867
2019-12-06 17:45:36.468 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 632
2019-12-06 17:45:36.468 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.43, Steps: 633, Distance 20.86, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.69, Angle accuracy 0.0, Num episodes 1868
2019-12-06 17:45:37.053 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:45:37.053 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.99, Steps: 662, Distance 22.87, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.9, Angle accuracy 0.0, Num episodes 1869
2019-12-06 17:45:37.670 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 698
2019-12-06 17:45:37.671 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 456.77, Steps: 699, Distance 25.09, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.37, Angle accuracy 0.0, Num episodes 1870
2019-12-06 17:45:38.162 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:45:38.163 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.22, Steps: 548, Distance 16.0, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.13, Angle accuracy 0.0, Num episodes 1871
2019-12-06 17:45:38.856 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:45:38.857 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.36, Steps: 695, Distance 24.63, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.19, Angle accuracy 0.0, Num episodes 1872
Warning: trajectory cut off by epoch at 115 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 332 |
| AverageEpRet | 435 |
| StdEpRet | 19.6 |
| MaxEpRet | 457 |
| MinEpRet | 395 |
| EpLen | 648 |
| AverageVVals | 57.4 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.4 |
| MinVVals | 57.4 |
| TotalEnvInteracts | 1.33e+06 |
| LossPi | -5.59e-08 |
| LossV | 420 |
| DeltaLossPi | 0.000126 |
| DeltaLossV | -0.64 |
| Entropy | -2.01 |
| KL | 0.000499 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.26e+03 |
---------------------------------------
2019-12-06 17:45:39.660 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 673
2019-12-06 17:45:39.661 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.33, Steps: 674, Distance 23.4, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.93, Angle accuracy 0.0, Num episodes 1873
2019-12-06 17:45:40.308 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 676
2019-12-06 17:45:40.308 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 456.02, Steps: 677, Distance 23.67, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.04, Angle accuracy 0.0, Num episodes 1874
2019-12-06 17:45:40.904 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:45:40.904 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.86, Steps: 660, Distance 22.47, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.89, Angle accuracy 0.0, Num episodes 1875
2019-12-06 17:45:41.283 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 412
2019-12-06 17:45:41.283 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 303.82, Steps: 413, Distance 8.96, Angular velocity 0.0, Speed: 2.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.28, Angle accuracy 0.0, Num episodes 1876
2019-12-06 17:45:42.017 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 716
2019-12-06 17:45:42.017 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.85, Steps: 717, Distance 25.93, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1877
2019-12-06 17:45:42.656 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 706
2019-12-06 17:45:42.657 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 462.0, Steps: 707, Distance 25.51, Angular velocity 0.0, Speed: 3.92, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 1878
Warning: trajectory cut off by epoch at 152 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 333 |
| AverageEpRet | 430 |
| StdEpRet | 56.9 |
| MaxEpRet | 466 |
| MinEpRet | 304 |
| EpLen | 641 |
| AverageVVals | 56.6 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.6 |
| MinVVals | 56.6 |
| TotalEnvInteracts | 1.34e+06 |
| LossPi | 2.97e-08 |
| LossV | 434 |
| DeltaLossPi | -1.39e-05 |
| DeltaLossV | -0.0757 |
| Entropy | -2.02 |
| KL | -2.02e-06 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.26e+03 |
---------------------------------------
2019-12-06 17:45:43.442 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 600
2019-12-06 17:45:43.442 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.83, Steps: 601, Distance 18.81, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 95.07, Angle accuracy 0.0, Num episodes 1879
2019-12-06 17:45:43.970 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:45:43.971 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.06, Steps: 599, Distance 18.79, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.16, Angle accuracy 0.0, Num episodes 1880
2019-12-06 17:45:44.585 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:45:44.586 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.37, Steps: 695, Distance 24.57, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.12, Angle accuracy 0.0, Num episodes 1881
2019-12-06 17:45:45.200 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:45:45.201 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.6, Steps: 629, Distance 20.52, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.45, Angle accuracy 0.0, Num episodes 1882
2019-12-06 17:45:45.759 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:45:45.760 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 422.12, Steps: 615, Distance 19.62, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.17, Angle accuracy 0.0, Num episodes 1883
2019-12-06 17:45:46.429 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:45:46.430 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 471.22, Steps: 743, Distance 27.95, Angular velocity 0.0, Speed: 4.0, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 1884
Warning: trajectory cut off by epoch at 118 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 334 |
| AverageEpRet | 436 |
| StdEpRet | 18.4 |
| MaxEpRet | 471 |
| MinEpRet | 418 |
| EpLen | 647 |
| AverageVVals | 56.3 |
| StdVVals | 0 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.34e+06 |
| LossPi | -5.65e-08 |
| LossV | 420 |
| DeltaLossPi | -0.00135 |
| DeltaLossV | -0.269 |
| Entropy | -1.99 |
| KL | 0.00105 |
| ClipFrac | 0.0005 |
| StopIter | 3 |
| Time | 1.26e+03 |
---------------------------------------
2019-12-06 17:45:47.009 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 433
2019-12-06 17:45:47.009 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 313.41, Steps: 434, Distance 9.63, Angular velocity 0.0, Speed: 2.69, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 90.92, Angle accuracy 0.0, Num episodes 1885
2019-12-06 17:45:47.548 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:45:47.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.28, Steps: 572, Distance 17.16, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.79, Angle accuracy 0.0, Num episodes 1886
2019-12-06 17:45:48.140 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:45:48.140 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.41, Steps: 589, Distance 17.72, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 94.86, Angle accuracy 0.0, Num episodes 1887
2019-12-06 17:45:48.754 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:45:48.754 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 450.31, Steps: 662, Distance 22.41, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.84, Angle accuracy 0.0, Num episodes 1888
2019-12-06 17:45:49.241 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 512
2019-12-06 17:45:49.241 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 374.95, Steps: 513, Distance 13.8, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.49, Angle accuracy 0.0, Num episodes 1889
2019-12-06 17:45:49.714 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 512
2019-12-06 17:45:49.715 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.27, Steps: 513, Distance 13.82, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.4, Angle accuracy 0.0, Num episodes 1890
Warning: trajectory cut off by epoch at 3 steps.
2019-12-06 17:45:50.365 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:45:50.365 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 469.97, Steps: 714, Distance 25.96, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 1891
Early stopping at step 8 due to reaching max kl.
---------------------------------------
| Epoch | 335 |
| AverageEpRet | 399 |
| StdEpRet | 48.9 |
| MaxEpRet | 470 |
| MinEpRet | 313 |
| EpLen | 571 |
| AverageVVals | 56.8 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.8 |
| MinVVals | 56.8 |
| TotalEnvInteracts | 1.34e+06 |
| LossPi | -3.68e-08 |
| LossV | 388 |
| DeltaLossPi | -0.00118 |
| DeltaLossV | -0.334 |
| Entropy | -2.04 |
| KL | 0.000507 |
| ClipFrac | 0 |
| StopIter | 8 |
| Time | 1.27e+03 |
---------------------------------------
2019-12-06 17:45:50.705 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 288
2019-12-06 17:45:50.706 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 209.38, Steps: 289, Distance 4.35, Angular velocity 0.0, Speed: 1.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 81.75, Angle accuracy 0.0, Num episodes 1892
2019-12-06 17:45:51.225 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 576
2019-12-06 17:45:51.225 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.98, Steps: 577, Distance 17.28, Angular velocity 0.0, Speed: 3.48, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.59, Angle accuracy 0.0, Num episodes 1893
2019-12-06 17:45:51.878 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 724
2019-12-06 17:45:51.878 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 460.98, Steps: 725, Distance 26.52, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.6, Angle accuracy 0.0, Num episodes 1894
2019-12-06 17:45:52.517 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 707
2019-12-06 17:45:52.517 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 467.82, Steps: 708, Distance 25.49, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 1895
2019-12-06 17:45:53.181 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 726
2019-12-06 17:45:53.181 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 466.92, Steps: 727, Distance 26.89, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.59, Angle accuracy 0.0, Num episodes 1896
2019-12-06 17:45:53.722 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:45:53.723 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.63, Steps: 613, Distance 19.57, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1897
Warning: trajectory cut off by epoch at 361 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 336 |
| AverageEpRet | 407 |
| StdEpRet | 91.1 |
| MaxEpRet | 468 |
| MinEpRet | 209 |
| EpLen | 606 |
| AverageVVals | 57.4 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.4 |
| MinVVals | 57.4 |
| TotalEnvInteracts | 1.35e+06 |
| LossPi | -1.7e-08 |
| LossV | 419 |
| DeltaLossPi | -0.000457 |
| DeltaLossV | -0.225 |
| Entropy | -2.01 |
| KL | 0.000542 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.27e+03 |
---------------------------------------
2019-12-06 17:45:54.569 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 485
2019-12-06 17:45:54.569 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.53, Steps: 486, Distance 12.42, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.83, Angle accuracy 0.0, Num episodes 1898
2019-12-06 17:45:54.942 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 401
2019-12-06 17:45:54.942 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 293.59, Steps: 402, Distance 8.47, Angular velocity 0.0, Speed: 2.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.66, Angle accuracy 0.0, Num episodes 1899
2019-12-06 17:45:55.544 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:45:55.545 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.65, Steps: 663, Distance 22.79, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.04, Angle accuracy 0.0, Num episodes 1900
2019-12-06 17:45:56.096 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:45:56.096 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.96, Steps: 605, Distance 19.25, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.12, Angle accuracy 0.0, Num episodes 1901
2019-12-06 17:45:56.671 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 646
2019-12-06 17:45:56.671 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.19, Steps: 647, Distance 21.56, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.63, Angle accuracy 0.0, Num episodes 1902
2019-12-06 17:45:57.203 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 587
2019-12-06 17:45:57.204 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.34, Steps: 588, Distance 17.99, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.96, Angle accuracy 0.0, Num episodes 1903
2019-12-06 17:45:57.708 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:45:57.709 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 397.35, Steps: 564, Distance 16.79, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.4, Angle accuracy 0.0, Num episodes 1904
Warning: trajectory cut off by epoch at 45 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 337 |
| AverageEpRet | 397 |
| StdEpRet | 51.9 |
| MaxEpRet | 449 |
| MinEpRet | 294 |
| EpLen | 565 |
| AverageVVals | 56.9 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.9 |
| MinVVals | 56.9 |
| TotalEnvInteracts | 1.35e+06 |
| LossPi | 5.34e-08 |
| LossV | 370 |
| DeltaLossPi | -0.000738 |
| DeltaLossV | -0.774 |
| Entropy | -2 |
| KL | 0.00147 |
| ClipFrac | 0.00675 |
| StopIter | 3 |
| Time | 1.27e+03 |
---------------------------------------
2019-12-06 17:45:58.455 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 683
2019-12-06 17:45:58.456 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 452.66, Steps: 684, Distance 24.24, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 1905
2019-12-06 17:45:58.945 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:45:58.945 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.15, Steps: 521, Distance 14.63, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.62, Angle accuracy 0.0, Num episodes 1906
2019-12-06 17:45:59.625 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 690
2019-12-06 17:45:59.626 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.45, Steps: 691, Distance 24.62, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1907
2019-12-06 17:46:00.002 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 422
2019-12-06 17:46:00.003 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 318.78, Steps: 423, Distance 9.47, Angular velocity 0.0, Speed: 2.71, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 90.8, Angle accuracy 0.0, Num episodes 1908
2019-12-06 17:46:00.502 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 528
2019-12-06 17:46:00.503 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.31, Steps: 529, Distance 14.81, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.78, Angle accuracy 0.0, Num episodes 1909
2019-12-06 17:46:00.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 446
2019-12-06 17:46:00.903 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 334.26, Steps: 447, Distance 10.56, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.45, Angle accuracy 0.0, Num episodes 1910
2019-12-06 17:46:01.489 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:46:01.490 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.8, Steps: 666, Distance 23.01, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.93, Angle accuracy 0.0, Num episodes 1911
Warning: trajectory cut off by epoch at 39 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 338 |
| AverageEpRet | 396 |
| StdEpRet | 53.4 |
| MaxEpRet | 455 |
| MinEpRet | 319 |
| EpLen | 566 |
| AverageVVals | 57.8 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.8 |
| MinVVals | 57.8 |
| TotalEnvInteracts | 1.36e+06 |
| LossPi | -5.13e-09 |
| LossV | 405 |
| DeltaLossPi | 0.00339 |
| DeltaLossV | -0.149 |
| Entropy | -2.03 |
| KL | 0.0161 |
| ClipFrac | 0.212 |
| StopIter | 1 |
| Time | 1.28e+03 |
---------------------------------------
2019-12-06 17:46:01.957 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 389
2019-12-06 17:46:01.957 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 286.39, Steps: 390, Distance 8.18, Angular velocity 0.0, Speed: 2.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.34, Angle accuracy 0.0, Num episodes 1912
2019-12-06 17:46:02.368 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 445
2019-12-06 17:46:02.368 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.27, Steps: 446, Distance 10.87, Angular velocity 0.0, Speed: 2.95, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.72, Angle accuracy 0.0, Num episodes 1913
2019-12-06 17:46:03.109 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 792
2019-12-06 17:46:03.110 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 489.58, Steps: 793, Distance 31.95, Angular velocity 0.0, Speed: 4.18, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.15, Angle accuracy 0.0, Num episodes 1914
2019-12-06 17:46:03.736 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 660
2019-12-06 17:46:03.736 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 452.79, Steps: 661, Distance 23.16, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.95, Angle accuracy 0.0, Num episodes 1915
2019-12-06 17:46:04.382 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:46:04.382 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.61, Steps: 714, Distance 26.78, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1916
2019-12-06 17:46:04.808 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 465
2019-12-06 17:46:04.809 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.08, Steps: 466, Distance 11.76, Angular velocity 0.0, Speed: 3.02, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.21, Angle accuracy 0.0, Num episodes 1917
2019-12-06 17:46:05.182 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 407
2019-12-06 17:46:05.182 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 293.67, Steps: 408, Distance 9.03, Angular velocity 0.0, Speed: 2.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.3, Angle accuracy 0.0, Num episodes 1918
Warning: trajectory cut off by epoch at 122 steps.
---------------------------------------
| Epoch | 339 |
| AverageEpRet | 381 |
| StdEpRet | 79.6 |
| MaxEpRet | 490 |
| MinEpRet | 286 |
| EpLen | 554 |
| AverageVVals | 57.4 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.4 |
| MinVVals | 57.4 |
| TotalEnvInteracts | 1.36e+06 |
| LossPi | 5.75e-08 |
| LossV | 424 |
| DeltaLossPi | -0.00235 |
| DeltaLossV | -1.83 |
| Entropy | -2.01 |
| KL | 0.00455 |
| ClipFrac | 0.0645 |
| StopIter | 79 |
| Time | 1.28e+03 |
---------------------------------------
2019-12-06 17:46:05.729 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 324
2019-12-06 17:46:05.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 236.51, Steps: 325, Distance 5.77, Angular velocity 0.0, Speed: 2.16, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 85.56, Angle accuracy 0.0, Num episodes 1919
2019-12-06 17:46:06.338 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:46:06.339 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.03, Steps: 680, Distance 24.94, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.22, Angle accuracy 0.0, Num episodes 1920
2019-12-06 17:46:07.000 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 737
2019-12-06 17:46:07.000 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 473.13, Steps: 738, Distance 28.47, Angular velocity 0.0, Speed: 4.09, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 1921
2019-12-06 17:46:07.476 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 517
2019-12-06 17:46:07.476 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.76, Steps: 518, Distance 14.66, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.83, Angle accuracy 0.0, Num episodes 1922
2019-12-06 17:46:07.996 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 576
2019-12-06 17:46:07.997 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.71, Steps: 577, Distance 18.13, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.06, Angle accuracy 0.0, Num episodes 1923
2019-12-06 17:46:08.580 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 648
2019-12-06 17:46:08.581 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.65, Steps: 649, Distance 22.6, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.92, Angle accuracy 0.0, Num episodes 1924
Warning: trajectory cut off by epoch at 513 steps.
Warning: could not pickle state_dict.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 340 |
| AverageEpRet | 398 |
| StdEpRet | 78.1 |
| MaxEpRet | 473 |
| MinEpRet | 237 |
| EpLen | 581 |
| AverageVVals | 56.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.1 |
| MinVVals | 56.1 |
| TotalEnvInteracts | 1.36e+06 |
| LossPi | -4.55e-08 |
| LossV | 415 |
| DeltaLossPi | -0.0018 |
| DeltaLossV | -4.26 |
| Entropy | -2.04 |
| KL | 0.00194 |
| ClipFrac | 0.0125 |
| StopIter | 6 |
| Time | 1.29e+03 |
---------------------------------------
2019-12-06 17:46:10.026 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:46:10.026 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.6, Steps: 593, Distance 19.15, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.09, Angle accuracy 0.0, Num episodes 1925
2019-12-06 17:46:10.663 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 685
2019-12-06 17:46:10.664 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 467.45, Steps: 686, Distance 24.95, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 96.18, Angle accuracy 0.0, Num episodes 1926
2019-12-06 17:46:11.265 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:46:11.266 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.4, Steps: 663, Distance 23.65, Angular velocity 0.0, Speed: 3.92, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.04, Angle accuracy 0.0, Num episodes 1927
2019-12-06 17:46:11.614 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 384
2019-12-06 17:46:11.614 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 286.24, Steps: 385, Distance 8.03, Angular velocity 0.0, Speed: 2.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.05, Angle accuracy 0.0, Num episodes 1928
2019-12-06 17:46:12.205 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 656
2019-12-06 17:46:12.206 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.78, Steps: 657, Distance 23.03, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.0, Angle accuracy 0.0, Num episodes 1929
2019-12-06 17:46:12.629 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 473
2019-12-06 17:46:12.630 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 356.71, Steps: 474, Distance 12.25, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.46, Angle accuracy 0.0, Num episodes 1930
2019-12-06 17:46:13.105 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 525
2019-12-06 17:46:13.105 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.22, Steps: 526, Distance 15.0, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.92, Angle accuracy 0.0, Num episodes 1931
Warning: trajectory cut off by epoch at 16 steps.
---------------------------------------
| Epoch | 341 |
| AverageEpRet | 402 |
| StdEpRet | 59.7 |
| MaxEpRet | 467 |
| MinEpRet | 286 |
| EpLen | 569 |
| AverageVVals | 58.1 |
| StdVVals | 0 |
| MaxVVals | 58.1 |
| MinVVals | 58.1 |
| TotalEnvInteracts | 1.37e+06 |
| LossPi | -9.77e-08 |
| LossV | 418 |
| DeltaLossPi | -0.00193 |
| DeltaLossV | -0.000885 |
| Entropy | -2.07 |
| KL | 0.00213 |
| ClipFrac | 0.037 |
| StopIter | 79 |
| Time | 1.29e+03 |
---------------------------------------
2019-12-06 17:46:13.973 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 793
2019-12-06 17:46:13.974 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 496.25, Steps: 794, Distance 32.42, Angular velocity 0.0, Speed: 4.22, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 97.04, Angle accuracy 0.0, Num episodes 1932
2019-12-06 17:46:14.387 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 462
2019-12-06 17:46:14.388 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.58, Steps: 463, Distance 11.85, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.39, Angle accuracy 0.0, Num episodes 1933
2019-12-06 17:46:14.915 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 596
2019-12-06 17:46:14.915 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.89, Steps: 597, Distance 19.69, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.41, Angle accuracy 0.0, Num episodes 1934
2019-12-06 17:46:15.306 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 440
2019-12-06 17:46:15.307 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 329.55, Steps: 441, Distance 10.73, Angular velocity 0.0, Speed: 2.93, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.56, Angle accuracy 0.0, Num episodes 1935
2019-12-06 17:46:15.875 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 618
2019-12-06 17:46:15.876 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.74, Steps: 619, Distance 20.78, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 1936
2019-12-06 17:46:16.145 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 280
2019-12-06 17:46:16.146 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 213.33, Steps: 281, Distance 4.3, Angular velocity 0.0, Speed: 1.84, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 81.2, Angle accuracy 0.0, Num episodes 1937
2019-12-06 17:46:16.800 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:46:16.800 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 470.16, Steps: 739, Distance 28.75, Angular velocity 0.0, Speed: 4.12, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.68, Angle accuracy 0.0, Num episodes 1938
Warning: trajectory cut off by epoch at 66 steps.
---------------------------------------
| Epoch | 342 |
| AverageEpRet | 387 |
| StdEpRet | 91.1 |
| MaxEpRet | 496 |
| MinEpRet | 213 |
| EpLen | 562 |
| AverageVVals | 58.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 58.1 |
| MinVVals | 58.1 |
| TotalEnvInteracts | 1.37e+06 |
| LossPi | 1.54e-08 |
| LossV | 458 |
| DeltaLossPi | -0.00153 |
| DeltaLossV | -2.69 |
| Entropy | -2.08 |
| KL | 0.00212 |
| ClipFrac | 0.0135 |
| StopIter | 79 |
| Time | 1.29e+03 |
---------------------------------------
2019-12-06 17:46:17.515 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 577
2019-12-06 17:46:17.516 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.58, Steps: 578, Distance 18.37, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.0, Angle accuracy 0.0, Num episodes 1939
2019-12-06 17:46:18.145 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 716
2019-12-06 17:46:18.145 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.98, Steps: 717, Distance 27.19, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.6, Angle accuracy 0.0, Num episodes 1940
2019-12-06 17:46:18.774 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 705
2019-12-06 17:46:18.774 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 463.99, Steps: 706, Distance 26.54, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.42, Angle accuracy 0.0, Num episodes 1941
2019-12-06 17:46:19.163 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 435
2019-12-06 17:46:19.164 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.04, Steps: 436, Distance 10.43, Angular velocity 0.0, Speed: 2.91, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.37, Angle accuracy 0.0, Num episodes 1942
2019-12-06 17:46:19.845 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 774
2019-12-06 17:46:19.846 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 492.78, Steps: 775, Distance 31.03, Angular velocity 0.0, Speed: 4.17, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 97.01, Angle accuracy 0.0, Num episodes 1943
2019-12-06 17:46:20.343 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:46:20.343 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.59, Steps: 557, Distance 17.01, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.52, Angle accuracy 0.0, Num episodes 1944
Warning: trajectory cut off by epoch at 231 steps.
Early stopping at step 5 due to reaching max kl.
---------------------------------------
| Epoch | 343 |
| AverageEpRet | 426 |
| StdEpRet | 56.5 |
| MaxEpRet | 493 |
| MinEpRet | 322 |
| EpLen | 628 |
| AverageVVals | 56.5 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.5 |
| MinVVals | 56.5 |
| TotalEnvInteracts | 1.38e+06 |
| LossPi | -5.36e-08 |
| LossV | 448 |
| DeltaLossPi | -0.000108 |
| DeltaLossV | -0.262 |
| Entropy | -2.05 |
| KL | 0.00699 |
| ClipFrac | 0.0805 |
| StopIter | 5 |
| Time | 1.3e+03 |
---------------------------------------
2019-12-06 17:46:21.222 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:46:21.222 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 454.55, Steps: 662, Distance 23.43, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.05, Angle accuracy 0.0, Num episodes 1945
2019-12-06 17:46:21.690 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:46:21.690 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.71, Steps: 528, Distance 15.31, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.87, Angle accuracy 0.0, Num episodes 1946
2019-12-06 17:46:22.249 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:46:22.249 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.28, Steps: 629, Distance 21.18, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.5, Angle accuracy 0.0, Num episodes 1947
2019-12-06 17:46:22.807 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:46:22.808 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.91, Steps: 630, Distance 21.35, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.68, Angle accuracy 0.0, Num episodes 1948
2019-12-06 17:46:23.225 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 459
2019-12-06 17:46:23.226 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 341.05, Steps: 460, Distance 11.44, Angular velocity 0.0, Speed: 3.02, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.15, Angle accuracy 0.0, Num episodes 1949
2019-12-06 17:46:23.690 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 523
2019-12-06 17:46:23.691 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.15, Steps: 524, Distance 15.03, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.02, Angle accuracy 0.0, Num episodes 1950
Warning: trajectory cut off by epoch at 567 steps.
---------------------------------------
| Epoch | 344 |
| AverageEpRet | 408 |
| StdEpRet | 39.7 |
| MaxEpRet | 455 |
| MinEpRet | 341 |
| EpLen | 572 |
| AverageVVals | 57 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57 |
| MinVVals | 57 |
| TotalEnvInteracts | 1.38e+06 |
| LossPi | -1.4e-08 |
| LossV | 385 |
| DeltaLossPi | -0.00498 |
| DeltaLossV | -11.4 |
| Entropy | -2.07 |
| KL | 0.00364 |
| ClipFrac | 0.0318 |
| StopIter | 79 |
| Time | 1.3e+03 |
---------------------------------------
2019-12-06 17:46:24.744 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 460
2019-12-06 17:46:24.745 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.81, Steps: 461, Distance 11.63, Angular velocity 0.0, Speed: 3.06, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.43, Angle accuracy 0.0, Num episodes 1951
2019-12-06 17:46:25.315 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 632
2019-12-06 17:46:25.315 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.72, Steps: 633, Distance 21.19, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.53, Angle accuracy 0.0, Num episodes 1952
2019-12-06 17:46:25.689 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 414
2019-12-06 17:46:25.689 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 302.71, Steps: 415, Distance 9.39, Angular velocity 0.0, Speed: 2.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.62, Angle accuracy 0.0, Num episodes 1953
2019-12-06 17:46:26.096 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 451
2019-12-06 17:46:26.097 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 330.72, Steps: 452, Distance 11.15, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.04, Angle accuracy 0.0, Num episodes 1954
2019-12-06 17:46:26.616 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 582
2019-12-06 17:46:26.616 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.83, Steps: 583, Distance 18.55, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.17, Angle accuracy 0.0, Num episodes 1955
2019-12-06 17:46:27.131 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 559
2019-12-06 17:46:27.132 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 399.83, Steps: 560, Distance 17.09, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.57, Angle accuracy 0.0, Num episodes 1956
2019-12-06 17:46:27.784 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 729
2019-12-06 17:46:27.784 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 464.02, Steps: 730, Distance 27.85, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.65, Angle accuracy 0.0, Num episodes 1957
Warning: trajectory cut off by epoch at 166 steps.
Early stopping at step 41 due to reaching max kl.
---------------------------------------
| Epoch | 345 |
| AverageEpRet | 383 |
| StdEpRet | 55.2 |
| MaxEpRet | 464 |
| MinEpRet | 303 |
| EpLen | 548 |
| AverageVVals | 60.4 |
| StdVVals | 3.81e-06 |
| MaxVVals | 60.4 |
| MinVVals | 60.4 |
| TotalEnvInteracts | 1.38e+06 |
| LossPi | -7.24e-08 |
| LossV | 396 |
| DeltaLossPi | -0.00101 |
| DeltaLossV | -9.33 |
| Entropy | -2.02 |
| KL | -0.000517 |
| ClipFrac | 0.00125 |
| StopIter | 41 |
| Time | 1.3e+03 |
---------------------------------------
2019-12-06 17:46:28.567 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:46:28.567 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.78, Steps: 587, Distance 18.76, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.22, Angle accuracy 0.0, Num episodes 1958
2019-12-06 17:46:29.063 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 519
2019-12-06 17:46:29.063 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.19, Steps: 520, Distance 14.77, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.94, Angle accuracy 0.0, Num episodes 1959
2019-12-06 17:46:29.638 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 633
2019-12-06 17:46:29.638 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.51, Steps: 634, Distance 21.54, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.63, Angle accuracy 0.0, Num episodes 1960
2019-12-06 17:46:30.133 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:46:30.133 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.42, Steps: 545, Distance 16.12, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.39, Angle accuracy 0.0, Num episodes 1961
2019-12-06 17:46:30.465 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 362
2019-12-06 17:46:30.466 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 262.62, Steps: 363, Distance 7.14, Angular velocity 0.0, Speed: 2.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.94, Angle accuracy 0.0, Num episodes 1962
2019-12-06 17:46:30.790 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 364
2019-12-06 17:46:30.790 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 263.06, Steps: 365, Distance 7.21, Angular velocity 0.0, Speed: 2.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.83, Angle accuracy 0.0, Num episodes 1963
2019-12-06 17:46:31.408 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:46:31.408 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.55, Steps: 690, Distance 25.09, Angular velocity 0.0, Speed: 3.94, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 1964
Warning: trajectory cut off by epoch at 296 steps.
---------------------------------------
| Epoch | 346 |
| AverageEpRet | 369 |
| StdEpRet | 71 |
| MaxEpRet | 447 |
| MinEpRet | 263 |
| EpLen | 529 |
| AverageVVals | 57.3 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57.3 |
| MinVVals | 57.3 |
| TotalEnvInteracts | 1.39e+06 |
| LossPi | -5.62e-08 |
| LossV | 394 |
| DeltaLossPi | -0.000664 |
| DeltaLossV | -0.0505 |
| Entropy | -2.03 |
| KL | 0.00225 |
| ClipFrac | 0.0117 |
| StopIter | 79 |
| Time | 1.31e+03 |
---------------------------------------
2019-12-06 17:46:32.424 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:46:32.424 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 457.8, Steps: 689, Distance 24.63, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.33, Angle accuracy 0.0, Num episodes 1965
2019-12-06 17:46:32.919 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 551
2019-12-06 17:46:32.920 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.04, Steps: 552, Distance 16.53, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.45, Angle accuracy 0.0, Num episodes 1966
2019-12-06 17:46:33.430 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 555
2019-12-06 17:46:33.430 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.09, Steps: 556, Distance 16.62, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.55, Angle accuracy 0.0, Num episodes 1967
2019-12-06 17:46:33.828 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 442
2019-12-06 17:46:33.828 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.9, Steps: 443, Distance 10.67, Angular velocity 0.0, Speed: 2.92, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.8, Angle accuracy 0.0, Num episodes 1968
2019-12-06 17:46:34.288 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 508
2019-12-06 17:46:34.288 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.89, Steps: 509, Distance 14.13, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.43, Angle accuracy 0.0, Num episodes 1969
2019-12-06 17:46:34.928 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 700
2019-12-06 17:46:34.928 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.38, Steps: 701, Distance 25.41, Angular velocity 0.0, Speed: 3.92, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.24, Angle accuracy 0.0, Num episodes 1970
Warning: trajectory cut off by epoch at 550 steps.
---------------------------------------
| Epoch | 347 |
| AverageEpRet | 402 |
| StdEpRet | 46.2 |
| MaxEpRet | 461 |
| MinEpRet | 334 |
| EpLen | 575 |
| AverageVVals | 57.5 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.5 |
| MinVVals | 57.5 |
| TotalEnvInteracts | 1.39e+06 |
| LossPi | 5.72e-08 |
| LossV | 381 |
| DeltaLossPi | -0.00195 |
| DeltaLossV | -2.03 |
| Entropy | -2.02 |
| KL | 0.00304 |
| ClipFrac | 0.0565 |
| StopIter | 79 |
| Time | 1.31e+03 |
---------------------------------------
2019-12-06 17:46:36.109 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 606
2019-12-06 17:46:36.109 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.32, Steps: 607, Distance 19.5, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.39, Angle accuracy 0.0, Num episodes 1971
2019-12-06 17:46:36.776 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 733
2019-12-06 17:46:36.776 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.65, Steps: 734, Distance 27.44, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.69, Angle accuracy 0.0, Num episodes 1972
2019-12-06 17:46:37.375 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 671
2019-12-06 17:46:37.375 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.19, Steps: 672, Distance 23.39, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.03, Angle accuracy 0.0, Num episodes 1973
2019-12-06 17:46:38.061 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 759
2019-12-06 17:46:38.061 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 462.99, Steps: 760, Distance 29.33, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.81, Angle accuracy 0.0, Num episodes 1974
2019-12-06 17:46:38.633 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:46:38.634 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.12, Steps: 630, Distance 21.23, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.54, Angle accuracy 0.0, Num episodes 1975
Warning: trajectory cut off by epoch at 597 steps.
Early stopping at step 13 due to reaching max kl.
---------------------------------------
| Epoch | 348 |
| AverageEpRet | 446 |
| StdEpRet | 17.2 |
| MaxEpRet | 466 |
| MinEpRet | 424 |
| EpLen | 681 |
| AverageVVals | 59 |
| StdVVals | 3.81e-06 |
| MaxVVals | 59 |
| MinVVals | 59 |
| TotalEnvInteracts | 1.4e+06 |
| LossPi | -1.65e-08 |
| LossV | 449 |
| DeltaLossPi | 0.000442 |
| DeltaLossV | -2.94 |
| Entropy | -2.03 |
| KL | 0.00236 |
| ClipFrac | 0.0182 |
| StopIter | 13 |
| Time | 1.32e+03 |
---------------------------------------
2019-12-06 17:46:39.856 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:46:39.856 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.46, Steps: 678, Distance 23.93, Angular velocity 0.0, Speed: 3.87, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.07, Angle accuracy 0.0, Num episodes 1976
2019-12-06 17:46:40.354 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 538
2019-12-06 17:46:40.354 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.83, Steps: 539, Distance 15.44, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.07, Angle accuracy 0.0, Num episodes 1977
2019-12-06 17:46:40.925 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:46:40.925 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.71, Steps: 639, Distance 21.51, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.67, Angle accuracy 0.0, Num episodes 1978
2019-12-06 17:46:41.558 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 705
2019-12-06 17:46:41.558 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.3, Steps: 706, Distance 25.58, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 96.32, Angle accuracy 0.0, Num episodes 1979
2019-12-06 17:46:41.996 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 487
2019-12-06 17:46:41.996 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.41, Steps: 488, Distance 12.63, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.72, Angle accuracy 0.0, Num episodes 1980
2019-12-06 17:46:42.264 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 302
2019-12-06 17:46:42.264 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 225.05, Steps: 303, Distance 4.87, Angular velocity 0.0, Speed: 1.93, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 83.4, Angle accuracy 0.0, Num episodes 1981
Warning: trajectory cut off by epoch at 647 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 349 |
| AverageEpRet | 387 |
| StdEpRet | 82.5 |
| MaxEpRet | 461 |
| MinEpRet | 225 |
| EpLen | 559 |
| AverageVVals | 57.3 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.3 |
| MinVVals | 57.3 |
| TotalEnvInteracts | 1.4e+06 |
| LossPi | -6.77e-08 |
| LossV | 382 |
| DeltaLossPi | -1.78e-05 |
| DeltaLossV | -0.378 |
| Entropy | -2.04 |
| KL | 0.00148 |
| ClipFrac | 0.0005 |
| StopIter | 1 |
| Time | 1.32e+03 |
---------------------------------------
2019-12-06 17:46:43.559 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 718
2019-12-06 17:46:43.559 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 464.86, Steps: 719, Distance 26.52, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.38, Angle accuracy 0.0, Num episodes 1982
2019-12-06 17:46:44.203 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 708
2019-12-06 17:46:44.203 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.8, Steps: 709, Distance 25.82, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.35, Angle accuracy 0.0, Num episodes 1983
2019-12-06 17:46:44.675 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 525
2019-12-06 17:46:44.675 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.91, Steps: 526, Distance 14.8, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.91, Angle accuracy 0.0, Num episodes 1984
2019-12-06 17:46:45.292 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 700
2019-12-06 17:46:45.292 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.68, Steps: 701, Distance 25.32, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 1985
2019-12-06 17:46:45.732 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 500
2019-12-06 17:46:45.733 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 360.73, Steps: 501, Distance 13.42, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.26, Angle accuracy 0.0, Num episodes 1986
2019-12-06 17:46:46.168 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 491
2019-12-06 17:46:46.168 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.0, Steps: 492, Distance 12.94, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.1, Angle accuracy 0.0, Num episodes 1987
Warning: trajectory cut off by epoch at 352 steps.
Warning: could not pickle state_dict.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 350 |
| AverageEpRet | 412 |
| StdEpRet | 47 |
| MaxEpRet | 465 |
| MinEpRet | 357 |
| EpLen | 608 |
| AverageVVals | 57.9 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.9 |
| MinVVals | 57.9 |
| TotalEnvInteracts | 1.4e+06 |
| LossPi | 9.58e-08 |
| LossV | 423 |
| DeltaLossPi | 0.000591 |
| DeltaLossV | -0.239 |
| Entropy | -2.05 |
| KL | 0.000378 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.32e+03 |
---------------------------------------
2019-12-06 17:46:47.549 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:46:47.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.46, Steps: 675, Distance 23.62, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.97, Angle accuracy 0.0, Num episodes 1988
2019-12-06 17:46:48.166 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 696
2019-12-06 17:46:48.167 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 456.57, Steps: 697, Distance 25.16, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.39, Angle accuracy 0.0, Num episodes 1989
2019-12-06 17:46:48.562 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 445
2019-12-06 17:46:48.563 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 333.67, Steps: 446, Distance 10.82, Angular velocity 0.0, Speed: 2.92, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.81, Angle accuracy 0.0, Num episodes 1990
2019-12-06 17:46:49.146 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 652
2019-12-06 17:46:49.147 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.27, Steps: 653, Distance 22.43, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.88, Angle accuracy 0.0, Num episodes 1991
2019-12-06 17:46:49.536 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 445
2019-12-06 17:46:49.536 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 327.28, Steps: 446, Distance 10.68, Angular velocity 0.0, Speed: 2.87, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.69, Angle accuracy 0.0, Num episodes 1992
2019-12-06 17:46:50.069 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:46:50.070 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.1, Steps: 605, Distance 19.39, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 1993
2019-12-06 17:46:50.429 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 406
2019-12-06 17:46:50.430 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 301.65, Steps: 407, Distance 8.86, Angular velocity 0.0, Speed: 2.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.08, Angle accuracy 0.0, Num episodes 1994
Warning: trajectory cut off by epoch at 71 steps.
---------------------------------------
| Epoch | 351 |
| AverageEpRet | 388 |
| StdEpRet | 60.4 |
| MaxEpRet | 457 |
| MinEpRet | 302 |
| EpLen | 561 |
| AverageVVals | 57.4 |
| StdVVals | 1.53e-05 |
| MaxVVals | 57.4 |
| MinVVals | 57.4 |
| TotalEnvInteracts | 1.41e+06 |
| LossPi | 7.1e-08 |
| LossV | 421 |
| DeltaLossPi | -0.00447 |
| DeltaLossV | -0.567 |
| Entropy | -2.04 |
| KL | 0.00275 |
| ClipFrac | 0.018 |
| StopIter | 79 |
| Time | 1.33e+03 |
---------------------------------------
2019-12-06 17:46:51.254 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 704
2019-12-06 17:46:51.255 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.92, Steps: 705, Distance 25.7, Angular velocity 0.0, Speed: 3.92, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.49, Angle accuracy 0.0, Num episodes 1995
2019-12-06 17:46:51.722 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 533
2019-12-06 17:46:51.722 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.84, Steps: 534, Distance 15.24, Angular velocity 0.0, Speed: 3.34, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.15, Angle accuracy 0.0, Num episodes 1996
2019-12-06 17:46:52.177 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 503
2019-12-06 17:46:52.178 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 374.78, Steps: 504, Distance 13.76, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.28, Angle accuracy 0.0, Num episodes 1997
2019-12-06 17:46:52.644 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:46:52.645 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 383.19, Steps: 532, Distance 15.05, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.03, Angle accuracy 0.0, Num episodes 1998
2019-12-06 17:46:52.952 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 346
2019-12-06 17:46:52.952 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 251.78, Steps: 347, Distance 6.49, Angular velocity 0.0, Speed: 2.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.69, Angle accuracy 0.0, Num episodes 1999
2019-12-06 17:46:53.460 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 581
2019-12-06 17:46:53.460 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.24, Steps: 582, Distance 17.95, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.99, Angle accuracy 0.0, Num episodes 2000
2019-12-06 17:46:54.103 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:46:54.104 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 470.27, Steps: 743, Distance 27.99, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.69, Angle accuracy 0.0, Num episodes 2001
Warning: trajectory cut off by epoch at 53 steps.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 352 |
| AverageEpRet | 391 |
| StdEpRet | 67 |
| MaxEpRet | 470 |
| MinEpRet | 252 |
| EpLen | 564 |
| AverageVVals | 56.6 |
| StdVVals | 0 |
| MaxVVals | 56.6 |
| MinVVals | 56.6 |
| TotalEnvInteracts | 1.41e+06 |
| LossPi | 5.07e-08 |
| LossV | 420 |
| DeltaLossPi | -0.000842 |
| DeltaLossV | -0.0317 |
| Entropy | -2.02 |
| KL | 0.00117 |
| ClipFrac | 0.0145 |
| StopIter | 4 |
| Time | 1.33e+03 |
---------------------------------------
2019-12-06 17:46:54.690 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 511
2019-12-06 17:46:54.690 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.39, Steps: 512, Distance 13.71, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.23, Angle accuracy 0.0, Num episodes 2002
2019-12-06 17:46:55.205 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 589
2019-12-06 17:46:55.206 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.18, Steps: 590, Distance 18.31, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.83, Angle accuracy 0.0, Num episodes 2003
2019-12-06 17:46:55.837 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 714
2019-12-06 17:46:55.837 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.35, Steps: 715, Distance 26.35, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.44, Angle accuracy 0.0, Num episodes 2004
2019-12-06 17:46:56.416 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 656
2019-12-06 17:46:56.416 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.42, Steps: 657, Distance 22.28, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.76, Angle accuracy 0.0, Num episodes 2005
2019-12-06 17:46:56.797 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 435
2019-12-06 17:46:56.797 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.47, Steps: 436, Distance 10.24, Angular velocity 0.0, Speed: 2.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.32, Angle accuracy 0.0, Num episodes 2006
2019-12-06 17:46:57.343 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:46:57.344 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.73, Steps: 613, Distance 19.79, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 2007
Warning: trajectory cut off by epoch at 477 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 353 |
| AverageEpRet | 405 |
| StdEpRet | 40.8 |
| MaxEpRet | 453 |
| MinEpRet | 328 |
| EpLen | 587 |
| AverageVVals | 56.8 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.8 |
| MinVVals | 56.8 |
| TotalEnvInteracts | 1.42e+06 |
| LossPi | 5.11e-08 |
| LossV | 389 |
| DeltaLossPi | -9.84e-05 |
| DeltaLossV | -2.71 |
| Entropy | -2.02 |
| KL | 0.00414 |
| ClipFrac | 0.0608 |
| StopIter | 1 |
| Time | 1.33e+03 |
---------------------------------------
2019-12-06 17:46:58.397 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 650
2019-12-06 17:46:58.397 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.33, Steps: 651, Distance 22.03, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.79, Angle accuracy 0.0, Num episodes 2008
2019-12-06 17:46:58.889 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:46:58.889 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.4, Steps: 557, Distance 16.17, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.31, Angle accuracy 0.0, Num episodes 2009
2019-12-06 17:46:59.467 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 655
2019-12-06 17:46:59.468 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.71, Steps: 656, Distance 22.11, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.88, Angle accuracy 0.0, Num episodes 2010
2019-12-06 17:47:00.090 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 701
2019-12-06 17:47:00.090 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.44, Steps: 702, Distance 24.98, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.22, Angle accuracy 0.0, Num episodes 2011
2019-12-06 17:47:00.672 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 663
2019-12-06 17:47:00.672 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.62, Steps: 664, Distance 22.58, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.9, Angle accuracy 0.0, Num episodes 2012
2019-12-06 17:47:01.140 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 535
2019-12-06 17:47:01.140 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.02, Steps: 536, Distance 15.09, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.06, Angle accuracy 0.0, Num episodes 2013
Warning: trajectory cut off by epoch at 234 steps.
---------------------------------------
| Epoch | 354 |
| AverageEpRet | 423 |
| StdEpRet | 25.4 |
| MaxEpRet | 458 |
| MinEpRet | 386 |
| EpLen | 628 |
| AverageVVals | 58.5 |
| StdVVals | 3.81e-06 |
| MaxVVals | 58.5 |
| MinVVals | 58.5 |
| TotalEnvInteracts | 1.42e+06 |
| LossPi | -1.08e-07 |
| LossV | 409 |
| DeltaLossPi | -0.00122 |
| DeltaLossV | -2.67 |
| Entropy | -2.04 |
| KL | 0.000634 |
| ClipFrac | 0.012 |
| StopIter | 79 |
| Time | 1.34e+03 |
---------------------------------------
2019-12-06 17:47:02.055 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:47:02.055 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.14, Steps: 643, Distance 21.06, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.7, Angle accuracy 0.0, Num episodes 2014
2019-12-06 17:47:02.421 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 417
2019-12-06 17:47:02.421 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 304.06, Steps: 418, Distance 9.17, Angular velocity 0.0, Speed: 2.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.22, Angle accuracy 0.0, Num episodes 2015
2019-12-06 17:47:03.037 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 693
2019-12-06 17:47:03.038 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.82, Steps: 694, Distance 24.55, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 2016
2019-12-06 17:47:03.531 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 561
2019-12-06 17:47:03.532 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.26, Steps: 562, Distance 16.64, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.53, Angle accuracy 0.0, Num episodes 2017
2019-12-06 17:47:04.226 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 797
2019-12-06 17:47:04.226 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 475.85, Steps: 798, Distance 31.49, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.01, Angle accuracy 0.0, Num episodes 2018
2019-12-06 17:47:04.643 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 476
2019-12-06 17:47:04.643 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.99, Steps: 477, Distance 11.96, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.36, Angle accuracy 0.0, Num episodes 2019
Warning: trajectory cut off by epoch at 408 steps.
---------------------------------------
| Epoch | 355 |
| AverageEpRet | 400 |
| StdEpRet | 59 |
| MaxEpRet | 476 |
| MinEpRet | 304 |
| EpLen | 599 |
| AverageVVals | 56.8 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.8 |
| MinVVals | 56.8 |
| TotalEnvInteracts | 1.42e+06 |
| LossPi | -9.31e-08 |
| LossV | 424 |
| DeltaLossPi | -0.00224 |
| DeltaLossV | -0.0125 |
| Entropy | -2.02 |
| KL | 0.00109 |
| ClipFrac | 0.0178 |
| StopIter | 79 |
| Time | 1.34e+03 |
---------------------------------------
2019-12-06 17:47:05.682 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:47:05.683 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.05, Steps: 615, Distance 19.71, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.21, Angle accuracy 0.0, Num episodes 2020
2019-12-06 17:47:05.961 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 310
2019-12-06 17:47:05.961 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 225.01, Steps: 311, Distance 5.06, Angular velocity 0.0, Speed: 1.95, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 83.71, Angle accuracy 0.0, Num episodes 2021
2019-12-06 17:47:06.524 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 630
2019-12-06 17:47:06.524 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.21, Steps: 631, Distance 20.54, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.62, Angle accuracy 0.0, Num episodes 2022
2019-12-06 17:47:06.943 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 473
2019-12-06 17:47:06.943 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 346.06, Steps: 474, Distance 11.82, Angular velocity 0.0, Speed: 2.98, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 92.5, Angle accuracy 0.0, Num episodes 2023
2019-12-06 17:47:07.447 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:47:07.447 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.19, Steps: 567, Distance 16.84, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.51, Angle accuracy 0.0, Num episodes 2024
2019-12-06 17:47:08.035 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 666
2019-12-06 17:47:08.036 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.96, Steps: 667, Distance 22.5, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.86, Angle accuracy 0.0, Num episodes 2025
2019-12-06 17:47:08.541 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 573
2019-12-06 17:47:08.541 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.35, Steps: 574, Distance 17.08, Angular velocity 0.0, Speed: 3.44, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.55, Angle accuracy 0.0, Num episodes 2026
Warning: trajectory cut off by epoch at 161 steps.
---------------------------------------
| Epoch | 356 |
| AverageEpRet | 378 |
| StdEpRet | 68.3 |
| MaxEpRet | 438 |
| MinEpRet | 225 |
| EpLen | 548 |
| AverageVVals | 56.7 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.7 |
| MinVVals | 56.7 |
| TotalEnvInteracts | 1.43e+06 |
| LossPi | 6.96e-08 |
| LossV | 377 |
| DeltaLossPi | -0.00278 |
| DeltaLossV | -0.00262 |
| Entropy | -2 |
| KL | 0.00158 |
| ClipFrac | 0.013 |
| StopIter | 79 |
| Time | 1.34e+03 |
---------------------------------------
2019-12-06 17:47:09.439 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 695
2019-12-06 17:47:09.439 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.32, Steps: 696, Distance 24.46, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.19, Angle accuracy 0.0, Num episodes 2027
2019-12-06 17:47:09.870 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 491
2019-12-06 17:47:09.870 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 353.79, Steps: 492, Distance 12.89, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.84, Angle accuracy 0.0, Num episodes 2028
2019-12-06 17:47:10.487 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 697
2019-12-06 17:47:10.488 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.38, Steps: 698, Distance 24.85, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.29, Angle accuracy 0.0, Num episodes 2029
2019-12-06 17:47:11.112 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 700
2019-12-06 17:47:11.112 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.51, Steps: 701, Distance 24.82, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 2030
2019-12-06 17:47:11.771 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 756
2019-12-06 17:47:11.771 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 462.18, Steps: 757, Distance 28.44, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.8, Angle accuracy 0.0, Num episodes 2031
2019-12-06 17:47:12.263 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:47:12.263 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.71, Steps: 564, Distance 16.43, Angular velocity 0.0, Speed: 3.38, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.38, Angle accuracy 0.0, Num episodes 2032
Warning: trajectory cut off by epoch at 92 steps.
---------------------------------------
| Epoch | 357 |
| AverageEpRet | 424 |
| StdEpRet | 37.7 |
| MaxEpRet | 462 |
| MinEpRet | 354 |
| EpLen | 651 |
| AverageVVals | 56.7 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.7 |
| MinVVals | 56.7 |
| TotalEnvInteracts | 1.43e+06 |
| LossPi | 5.72e-09 |
| LossV | 461 |
| DeltaLossPi | -0.00252 |
| DeltaLossV | -5.22 |
| Entropy | -1.98 |
| KL | 0.00499 |
| ClipFrac | 0.051 |
| StopIter | 79 |
| Time | 1.35e+03 |
---------------------------------------
2019-12-06 17:47:13.078 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:47:13.079 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.3, Steps: 663, Distance 22.34, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.81, Angle accuracy 0.0, Num episodes 2033
2019-12-06 17:47:13.574 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 564
2019-12-06 17:47:13.575 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.19, Steps: 565, Distance 16.85, Angular velocity 0.0, Speed: 3.39, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.67, Angle accuracy 0.0, Num episodes 2034
2019-12-06 17:47:13.904 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 374
2019-12-06 17:47:13.905 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 275.31, Steps: 375, Distance 7.38, Angular velocity 0.0, Speed: 2.38, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.31, Angle accuracy 0.0, Num episodes 2035
2019-12-06 17:47:14.390 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 547
2019-12-06 17:47:14.390 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 384.71, Steps: 548, Distance 15.55, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.25, Angle accuracy 0.0, Num episodes 2036
2019-12-06 17:47:15.015 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 714
2019-12-06 17:47:15.016 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.88, Steps: 715, Distance 25.19, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.21, Angle accuracy 0.0, Num episodes 2037
2019-12-06 17:47:15.405 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 442
2019-12-06 17:47:15.405 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.46, Steps: 443, Distance 10.31, Angular velocity 0.0, Speed: 2.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.28, Angle accuracy 0.0, Num episodes 2038
2019-12-06 17:47:15.744 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 372
2019-12-06 17:47:15.744 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 269.95, Steps: 373, Distance 7.24, Angular velocity 0.0, Speed: 2.35, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.05, Angle accuracy 0.0, Num episodes 2039
Warning: trajectory cut off by epoch at 318 steps.
---------------------------------------
| Epoch | 358 |
| AverageEpRet | 359 |
| StdEpRet | 65.9 |
| MaxEpRet | 446 |
| MinEpRet | 270 |
| EpLen | 526 |
| AverageVVals | 54.4 |
| StdVVals | 0 |
| MaxVVals | 54.4 |
| MinVVals | 54.4 |
| TotalEnvInteracts | 1.44e+06 |
| LossPi | -3.81e-08 |
| LossV | 380 |
| DeltaLossPi | -0.0013 |
| DeltaLossV | -3.51 |
| Entropy | -1.96 |
| KL | 0.00394 |
| ClipFrac | 0.0127 |
| StopIter | 79 |
| Time | 1.35e+03 |
---------------------------------------
2019-12-06 17:47:16.798 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 723
2019-12-06 17:47:16.799 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.72, Steps: 724, Distance 26.39, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.07, Avg gforce: 0.03, Trip pct 96.56, Angle accuracy 0.0, Num episodes 2040
2019-12-06 17:47:17.154 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 404
2019-12-06 17:47:17.155 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 300.17, Steps: 405, Distance 8.59, Angular velocity 0.0, Speed: 2.6, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 89.89, Angle accuracy 0.0, Num episodes 2041
2019-12-06 17:47:17.695 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 619
2019-12-06 17:47:17.695 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.5, Steps: 620, Distance 19.85, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.47, Angle accuracy 0.0, Num episodes 2042
2019-12-06 17:47:18.286 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:47:18.286 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.42, Steps: 675, Distance 23.01, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.9, Angle accuracy 0.0, Num episodes 2043
2019-12-06 17:47:18.746 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:47:18.746 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.64, Steps: 521, Distance 14.19, Angular velocity 0.0, Speed: 3.19, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.6, Angle accuracy 0.0, Num episodes 2044
2019-12-06 17:47:19.302 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:47:19.303 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.95, Steps: 632, Distance 20.48, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.41, Angle accuracy 0.0, Num episodes 2045
Warning: trajectory cut off by epoch at 423 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 359 |
| AverageEpRet | 397 |
| StdEpRet | 51.4 |
| MaxEpRet | 450 |
| MinEpRet | 300 |
| EpLen | 596 |
| AverageVVals | 56.3 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.44e+06 |
| LossPi | -9.29e-08 |
| LossV | 408 |
| DeltaLossPi | -0.00119 |
| DeltaLossV | -0.0122 |
| Entropy | -1.97 |
| KL | 0.00236 |
| ClipFrac | 0.001 |
| StopIter | 2 |
| Time | 1.36e+03 |
---------------------------------------
2019-12-06 17:47:20.245 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:47:20.246 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.86, Steps: 567, Distance 16.68, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.64, Angle accuracy 0.0, Num episodes 2046
2019-12-06 17:47:20.683 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 499
2019-12-06 17:47:20.684 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 355.18, Steps: 500, Distance 13.0, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.08, Angle accuracy 0.0, Num episodes 2047
2019-12-06 17:47:21.148 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 525
2019-12-06 17:47:21.149 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.47, Steps: 526, Distance 14.46, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.68, Angle accuracy 0.0, Num episodes 2048
2019-12-06 17:47:21.816 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 758
2019-12-06 17:47:21.817 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.35, Steps: 759, Distance 28.42, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.81, Angle accuracy 0.0, Num episodes 2049
2019-12-06 17:47:22.465 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 735
2019-12-06 17:47:22.465 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.86, Steps: 736, Distance 27.01, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 2050
2019-12-06 17:47:23.061 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 676
2019-12-06 17:47:23.062 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 434.29, Steps: 677, Distance 23.45, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.11, Angle accuracy 0.0, Num episodes 2051
Warning: trajectory cut off by epoch at 235 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 360 |
| AverageEpRet | 407 |
| StdEpRet | 33.8 |
| MaxEpRet | 446 |
| MinEpRet | 355 |
| EpLen | 628 |
| AverageVVals | 56.4 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.4 |
| MinVVals | 56.4 |
| TotalEnvInteracts | 1.44e+06 |
| LossPi | -1.19e-07 |
| LossV | 445 |
| DeltaLossPi | -0.00144 |
| DeltaLossV | -3.91 |
| Entropy | -1.95 |
| KL | 0.00102 |
| ClipFrac | 0.0158 |
| StopIter | 79 |
| Time | 1.36e+03 |
---------------------------------------
2019-12-06 17:47:24.432 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:47:24.433 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.19, Steps: 692, Distance 24.32, Angular velocity 0.0, Speed: 3.75, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.06, Angle accuracy 0.0, Num episodes 2052
2019-12-06 17:47:25.110 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 765
2019-12-06 17:47:25.110 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 454.9, Steps: 766, Distance 28.86, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.8, Angle accuracy 0.0, Num episodes 2053
2019-12-06 17:47:25.603 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:47:25.604 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.23, Steps: 557, Distance 16.2, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.32, Angle accuracy 0.0, Num episodes 2054
2019-12-06 17:47:26.187 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 656
2019-12-06 17:47:26.187 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.3, Steps: 657, Distance 22.07, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.71, Angle accuracy 0.0, Num episodes 2055
2019-12-06 17:47:26.857 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:47:26.857 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 457.41, Steps: 763, Distance 28.97, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.81, Angle accuracy 0.0, Num episodes 2056
2019-12-06 17:47:27.303 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 504
2019-12-06 17:47:27.304 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 358.26, Steps: 505, Distance 13.44, Angular velocity 0.0, Speed: 3.14, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.11, Angle accuracy 0.0, Num episodes 2057
Warning: trajectory cut off by epoch at 60 steps.
Early stopping at step 5 due to reaching max kl.
---------------------------------------
| Epoch | 361 |
| AverageEpRet | 420 |
| StdEpRet | 36.4 |
| MaxEpRet | 457 |
| MinEpRet | 358 |
| EpLen | 657 |
| AverageVVals | 54.4 |
| StdVVals | 1.14e-05 |
| MaxVVals | 54.4 |
| MinVVals | 54.4 |
| TotalEnvInteracts | 1.45e+06 |
| LossPi | -1.42e-07 |
| LossV | 501 |
| DeltaLossPi | -0.00211 |
| DeltaLossV | -0.539 |
| Entropy | -1.99 |
| KL | 0.00322 |
| ClipFrac | 0.0185 |
| StopIter | 5 |
| Time | 1.36e+03 |
---------------------------------------
2019-12-06 17:47:28.175 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 825
2019-12-06 17:47:28.175 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 472.88, Steps: 826, Distance 32.76, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.2, Angle accuracy 0.0, Num episodes 2058
2019-12-06 17:47:28.809 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 713
2019-12-06 17:47:28.810 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.28, Steps: 714, Distance 25.47, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.05, Avg gforce: 0.03, Trip pct 96.25, Angle accuracy 0.0, Num episodes 2059
2019-12-06 17:47:29.277 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 533
2019-12-06 17:47:29.277 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.79, Steps: 534, Distance 14.85, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.95, Angle accuracy 0.0, Num episodes 2060
2019-12-06 17:47:29.760 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 528
2019-12-06 17:47:29.760 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.06, Steps: 529, Distance 14.57, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.72, Angle accuracy 0.0, Num episodes 2061
2019-12-06 17:47:30.310 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:47:30.311 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.94, Steps: 629, Distance 20.05, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.44, Angle accuracy 0.0, Num episodes 2062
2019-12-06 17:47:30.874 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 633
2019-12-06 17:47:30.874 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.71, Steps: 634, Distance 20.51, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.44, Angle accuracy 0.0, Num episodes 2063
Warning: trajectory cut off by epoch at 134 steps.
---------------------------------------
| Epoch | 362 |
| AverageEpRet | 419 |
| StdEpRet | 34.9 |
| MaxEpRet | 473 |
| MinEpRet | 377 |
| EpLen | 644 |
| AverageVVals | 53.7 |
| StdVVals | 7.63e-06 |
| MaxVVals | 53.7 |
| MinVVals | 53.7 |
| TotalEnvInteracts | 1.45e+06 |
| LossPi | -5.52e-08 |
| LossV | 460 |
| DeltaLossPi | -0.00088 |
| DeltaLossV | -0.546 |
| Entropy | -1.99 |
| KL | 0.00197 |
| ClipFrac | 0.00925 |
| StopIter | 79 |
| Time | 1.37e+03 |
---------------------------------------
2019-12-06 17:47:31.686 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 619
2019-12-06 17:47:31.687 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.62, Steps: 620, Distance 19.53, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.17, Angle accuracy 0.0, Num episodes 2064
2019-12-06 17:47:32.206 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:47:32.207 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.44, Steps: 586, Distance 17.92, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.92, Angle accuracy 0.0, Num episodes 2065
2019-12-06 17:47:32.778 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 648
2019-12-06 17:47:32.779 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.22, Steps: 649, Distance 21.63, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.73, Angle accuracy 0.0, Num episodes 2066
2019-12-06 17:47:33.070 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 331
2019-12-06 17:47:33.070 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 241.28, Steps: 332, Distance 5.79, Angular velocity 0.0, Speed: 2.13, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 85.65, Angle accuracy 0.0, Num episodes 2067
2019-12-06 17:47:33.594 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 596
2019-12-06 17:47:33.595 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.97, Steps: 597, Distance 18.32, Angular velocity 0.0, Speed: 3.5, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 94.87, Angle accuracy 0.0, Num episodes 2068
2019-12-06 17:47:34.038 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 503
2019-12-06 17:47:34.039 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.57, Steps: 504, Distance 13.22, Angular velocity 0.0, Speed: 3.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.26, Angle accuracy 0.0, Num episodes 2069
2019-12-06 17:47:34.611 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:47:34.612 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 426.25, Steps: 641, Distance 20.88, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.59, Angle accuracy 0.0, Num episodes 2070
Warning: trajectory cut off by epoch at 71 steps.
---------------------------------------
| Epoch | 363 |
| AverageEpRet | 382 |
| StdEpRet | 61.3 |
| MaxEpRet | 426 |
| MinEpRet | 241 |
| EpLen | 561 |
| AverageVVals | 54.4 |
| StdVVals | 3.81e-06 |
| MaxVVals | 54.4 |
| MinVVals | 54.4 |
| TotalEnvInteracts | 1.46e+06 |
| LossPi | -4.12e-08 |
| LossV | 404 |
| DeltaLossPi | -0.000604 |
| DeltaLossV | -1.64 |
| Entropy | -1.97 |
| KL | 0.00393 |
| ClipFrac | 0.02 |
| StopIter | 79 |
| Time | 1.37e+03 |
---------------------------------------
2019-12-06 17:47:35.456 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 716
2019-12-06 17:47:35.457 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.25, Steps: 717, Distance 25.82, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.46, Angle accuracy 0.0, Num episodes 2071
2019-12-06 17:47:35.994 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:47:35.995 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.82, Steps: 613, Distance 19.58, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.33, Angle accuracy 0.0, Num episodes 2072
2019-12-06 17:47:36.552 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 627
2019-12-06 17:47:36.552 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.5, Steps: 628, Distance 20.65, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.39, Angle accuracy 0.0, Num episodes 2073
2019-12-06 17:47:37.009 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 513
2019-12-06 17:47:37.009 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.37, Steps: 514, Distance 14.09, Angular velocity 0.0, Speed: 3.23, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.49, Angle accuracy 0.0, Num episodes 2074
2019-12-06 17:47:37.367 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 405
2019-12-06 17:47:37.368 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 297.82, Steps: 406, Distance 8.68, Angular velocity 0.0, Speed: 2.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.77, Angle accuracy 0.0, Num episodes 2075
2019-12-06 17:47:37.756 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 441
2019-12-06 17:47:37.756 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 321.61, Steps: 442, Distance 10.27, Angular velocity 0.0, Speed: 2.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.32, Angle accuracy 0.0, Num episodes 2076
2019-12-06 17:47:38.330 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 641
2019-12-06 17:47:38.331 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.99, Steps: 642, Distance 21.3, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.67, Angle accuracy 0.0, Num episodes 2077
Warning: trajectory cut off by epoch at 38 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 364 |
| AverageEpRet | 384 |
| StdEpRet | 52 |
| MaxEpRet | 442 |
| MinEpRet | 298 |
| EpLen | 566 |
| AverageVVals | 55.7 |
| StdVVals | 7.63e-06 |
| MaxVVals | 55.7 |
| MinVVals | 55.7 |
| TotalEnvInteracts | 1.46e+06 |
| LossPi | -1.19e-07 |
| LossV | 418 |
| DeltaLossPi | 0.00117 |
| DeltaLossV | -0.124 |
| Entropy | -1.97 |
| KL | 0.000111 |
| ClipFrac | 0.001 |
| StopIter | 2 |
| Time | 1.37e+03 |
---------------------------------------
2019-12-06 17:47:38.712 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 307
2019-12-06 17:47:38.713 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 227.07, Steps: 308, Distance 5.03, Angular velocity 0.0, Speed: 1.97, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 83.64, Angle accuracy 0.0, Num episodes 2078
2019-12-06 17:47:39.179 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 533
2019-12-06 17:47:39.180 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.79, Steps: 534, Distance 15.04, Angular velocity 0.0, Speed: 3.29, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.89, Angle accuracy 0.0, Num episodes 2079
2019-12-06 17:47:39.839 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 734
2019-12-06 17:47:39.839 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.4, Steps: 735, Distance 27.41, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 2080
2019-12-06 17:47:40.209 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 419
2019-12-06 17:47:40.209 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 307.23, Steps: 420, Distance 9.5, Angular velocity 0.0, Speed: 2.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.57, Angle accuracy 0.0, Num episodes 2081
2019-12-06 17:47:40.627 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 476
2019-12-06 17:47:40.628 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.73, Steps: 477, Distance 12.18, Angular velocity 0.0, Speed: 3.05, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.49, Angle accuracy 0.0, Num episodes 2082
2019-12-06 17:47:41.158 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:47:41.158 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.46, Steps: 600, Distance 18.79, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.06, Angle accuracy 0.0, Num episodes 2083
2019-12-06 17:47:41.743 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 665
2019-12-06 17:47:41.743 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.33, Steps: 666, Distance 22.82, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.82, Angle accuracy 0.0, Num episodes 2084
Warning: trajectory cut off by epoch at 260 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 365 |
| AverageEpRet | 360 |
| StdEpRet | 69.9 |
| MaxEpRet | 442 |
| MinEpRet | 227 |
| EpLen | 534 |
| AverageVVals | 55.4 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.4 |
| MinVVals | 55.4 |
| TotalEnvInteracts | 1.46e+06 |
| LossPi | -2.63e-08 |
| LossV | 400 |
| DeltaLossPi | -0.00138 |
| DeltaLossV | -0.00284 |
| Entropy | -1.98 |
| KL | 0.00425 |
| ClipFrac | 0.0413 |
| StopIter | 1 |
| Time | 1.38e+03 |
---------------------------------------
2019-12-06 17:47:42.548 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 567
2019-12-06 17:47:42.548 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.29, Steps: 568, Distance 17.16, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.74, Angle accuracy 0.0, Num episodes 2085
2019-12-06 17:47:43.112 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 637
2019-12-06 17:47:43.112 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 425.22, Steps: 638, Distance 21.37, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.79, Angle accuracy 0.0, Num episodes 2086
2019-12-06 17:47:43.684 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 645
2019-12-06 17:47:43.684 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.14, Steps: 646, Distance 21.89, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.69, Angle accuracy 0.0, Num episodes 2087
2019-12-06 17:47:44.045 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 402
2019-12-06 17:47:44.045 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 296.08, Steps: 403, Distance 8.63, Angular velocity 0.0, Speed: 2.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.78, Angle accuracy 0.0, Num episodes 2088
2019-12-06 17:47:44.555 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 579
2019-12-06 17:47:44.555 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.63, Steps: 580, Distance 17.86, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.87, Angle accuracy 0.0, Num episodes 2089
2019-12-06 17:47:45.097 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 616
2019-12-06 17:47:45.098 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.9, Steps: 617, Distance 19.82, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.29, Angle accuracy 0.0, Num episodes 2090
Warning: trajectory cut off by epoch at 548 steps.
---------------------------------------
| Epoch | 366 |
| AverageEpRet | 394 |
| StdEpRet | 46 |
| MaxEpRet | 427 |
| MinEpRet | 296 |
| EpLen | 575 |
| AverageVVals | 55.3 |
| StdVVals | 0 |
| MaxVVals | 55.3 |
| MinVVals | 55.3 |
| TotalEnvInteracts | 1.47e+06 |
| LossPi | -1.34e-08 |
| LossV | 391 |
| DeltaLossPi | 0.00607 |
| DeltaLossV | -5.8 |
| Entropy | -1.98 |
| KL | 0.0188 |
| ClipFrac | 0.226 |
| StopIter | 79 |
| Time | 1.38e+03 |
---------------------------------------
2019-12-06 17:47:46.136 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 455
2019-12-06 17:47:46.136 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.99, Steps: 456, Distance 11.35, Angular velocity 0.0, Speed: 3.01, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.16, Angle accuracy 0.0, Num episodes 2091
2019-12-06 17:47:46.741 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 689
2019-12-06 17:47:46.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.15, Steps: 690, Distance 25.01, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 2092
2019-12-06 17:47:47.251 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 578
2019-12-06 17:47:47.252 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.95, Steps: 579, Distance 18.05, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.78, Angle accuracy 0.0, Num episodes 2093
2019-12-06 17:47:47.869 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 703
2019-12-06 17:47:47.869 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.18, Steps: 704, Distance 26.09, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.35, Angle accuracy 0.0, Num episodes 2094
2019-12-06 17:47:48.372 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:47:48.372 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 387.82, Steps: 557, Distance 16.74, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.48, Angle accuracy 0.0, Num episodes 2095
2019-12-06 17:47:48.851 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 542
2019-12-06 17:47:48.851 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.94, Steps: 543, Distance 15.97, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.29, Angle accuracy 0.0, Num episodes 2096
Warning: trajectory cut off by epoch at 471 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 367 |
| AverageEpRet | 395 |
| StdEpRet | 39.8 |
| MaxEpRet | 441 |
| MinEpRet | 324 |
| EpLen | 588 |
| AverageVVals | 57.8 |
| StdVVals | 1.14e-05 |
| MaxVVals | 57.8 |
| MinVVals | 57.8 |
| TotalEnvInteracts | 1.47e+06 |
| LossPi | 2.62e-08 |
| LossV | 404 |
| DeltaLossPi | -0.00249 |
| DeltaLossV | -0.643 |
| Entropy | -1.97 |
| KL | 0.0065 |
| ClipFrac | 0.053 |
| StopIter | 1 |
| Time | 1.39e+03 |
---------------------------------------
2019-12-06 17:47:49.833 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 540
2019-12-06 17:47:49.833 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 385.86, Steps: 541, Distance 16.0, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.14, Angle accuracy 0.0, Num episodes 2097
2019-12-06 17:47:50.296 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 518
2019-12-06 17:47:50.297 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 363.54, Steps: 519, Distance 14.76, Angular velocity 0.0, Speed: 3.35, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.89, Angle accuracy 0.0, Num episodes 2098
2019-12-06 17:47:50.808 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 575
2019-12-06 17:47:50.809 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.41, Steps: 576, Distance 17.86, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.72, Angle accuracy 0.0, Num episodes 2099
2019-12-06 17:47:51.408 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:47:51.409 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.93, Steps: 662, Distance 23.35, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.13, Angle accuracy 0.0, Num episodes 2100
2019-12-06 17:47:51.900 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 546
2019-12-06 17:47:51.901 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 380.14, Steps: 547, Distance 16.19, Angular velocity 0.0, Speed: 3.46, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.35, Angle accuracy 0.0, Num episodes 2101
2019-12-06 17:47:52.497 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 673
2019-12-06 17:47:52.498 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.26, Steps: 674, Distance 24.2, Angular velocity 0.0, Speed: 3.88, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.04, Angle accuracy 0.0, Num episodes 2102
Warning: trajectory cut off by epoch at 481 steps.
---------------------------------------
| Epoch | 368 |
| AverageEpRet | 396 |
| StdEpRet | 23.4 |
| MaxEpRet | 428 |
| MinEpRet | 364 |
| EpLen | 586 |
| AverageVVals | 57 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57 |
| MinVVals | 57 |
| TotalEnvInteracts | 1.48e+06 |
| LossPi | -4.37e-08 |
| LossV | 368 |
| DeltaLossPi | -0.00236 |
| DeltaLossV | -0.133 |
| Entropy | -1.96 |
| KL | 0.00251 |
| ClipFrac | 0.0385 |
| StopIter | 79 |
| Time | 1.39e+03 |
---------------------------------------
2019-12-06 17:47:53.439 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 390
2019-12-06 17:47:53.440 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 284.04, Steps: 391, Distance 8.2, Angular velocity 0.0, Speed: 2.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.38, Angle accuracy 0.0, Num episodes 2103
2019-12-06 17:47:53.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 517
2019-12-06 17:47:53.902 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.1, Steps: 518, Distance 14.67, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.68, Angle accuracy 0.0, Num episodes 2104
2019-12-06 17:47:54.400 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 558
2019-12-06 17:47:54.400 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.69, Steps: 559, Distance 16.95, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.73, Angle accuracy 0.0, Num episodes 2105
2019-12-06 17:47:54.842 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 499
2019-12-06 17:47:54.843 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.4, Steps: 500, Distance 13.75, Angular velocity 0.0, Speed: 3.28, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 93.51, Angle accuracy 0.0, Num episodes 2106
2019-12-06 17:47:55.467 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 712
2019-12-06 17:47:55.468 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.26, Steps: 713, Distance 26.57, Angular velocity 0.0, Speed: 3.94, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.42, Angle accuracy 0.0, Num episodes 2107
2019-12-06 17:47:56.003 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 599
2019-12-06 17:47:56.004 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.82, Steps: 600, Distance 19.41, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.21, Angle accuracy 0.0, Num episodes 2108
2019-12-06 17:47:56.418 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 465
2019-12-06 17:47:56.419 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.65, Steps: 466, Distance 11.68, Angular velocity 0.0, Speed: 3.08, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.2, Angle accuracy 0.0, Num episodes 2109
Warning: trajectory cut off by epoch at 253 steps.
---------------------------------------
| Epoch | 369 |
| AverageEpRet | 367 |
| StdEpRet | 49.4 |
| MaxEpRet | 443 |
| MinEpRet | 284 |
| EpLen | 535 |
| AverageVVals | 57.3 |
| StdVVals | 7.63e-06 |
| MaxVVals | 57.3 |
| MinVVals | 57.3 |
| TotalEnvInteracts | 1.48e+06 |
| LossPi | 3.64e-08 |
| LossV | 367 |
| DeltaLossPi | -0.00124 |
| DeltaLossV | -1.06 |
| Entropy | -1.98 |
| KL | 0.00183 |
| ClipFrac | 0.0217 |
| StopIter | 79 |
| Time | 1.39e+03 |
---------------------------------------
2019-12-06 17:47:57.375 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 657
2019-12-06 17:47:57.376 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.13, Steps: 658, Distance 23.23, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 96.02, Angle accuracy 0.0, Num episodes 2110
2019-12-06 17:47:57.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 585
2019-12-06 17:47:57.902 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.62, Steps: 586, Distance 18.64, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.03, Angle accuracy 0.0, Num episodes 2111
2019-12-06 17:47:58.367 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:47:58.367 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 368.69, Steps: 521, Distance 15.18, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.9, Angle accuracy 0.0, Num episodes 2112
2019-12-06 17:47:58.742 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 424
2019-12-06 17:47:58.742 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 302.38, Steps: 425, Distance 9.84, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.87, Angle accuracy 0.0, Num episodes 2113
2019-12-06 17:47:59.313 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 639
2019-12-06 17:47:59.314 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.47, Steps: 640, Distance 21.84, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.79, Angle accuracy 0.0, Num episodes 2114
2019-12-06 17:47:59.789 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 530
2019-12-06 17:47:59.789 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.5, Steps: 531, Distance 15.4, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.13, Angle accuracy 0.0, Num episodes 2115
Warning: trajectory cut off by epoch at 639 steps.
Warning: could not pickle state_dict.
---------------------------------------
| Epoch | 370 |
| AverageEpRet | 381 |
| StdEpRet | 43 |
| MaxEpRet | 427 |
| MinEpRet | 302 |
| EpLen | 560 |
| AverageVVals | 56.3 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.48e+06 |
| LossPi | -2.1e-08 |
| LossV | 355 |
| DeltaLossPi | -0.00124 |
| DeltaLossV | -0.107 |
| Entropy | -2.01 |
| KL | 0.00576 |
| ClipFrac | 0.0487 |
| StopIter | 79 |
| Time | 1.4e+03 |
---------------------------------------
2019-12-06 17:48:01.462 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 603
2019-12-06 17:48:01.463 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.16, Steps: 604, Distance 20.27, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.3, Angle accuracy 0.0, Num episodes 2116
2019-12-06 17:48:01.998 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:48:01.999 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 401.79, Steps: 599, Distance 19.77, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.45, Angle accuracy 0.0, Num episodes 2117
2019-12-06 17:48:02.500 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 565
2019-12-06 17:48:02.500 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 390.64, Steps: 566, Distance 17.8, Angular velocity 0.0, Speed: 3.6, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.86, Angle accuracy 0.0, Num episodes 2118
2019-12-06 17:48:02.813 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 359
2019-12-06 17:48:02.813 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 255.04, Steps: 360, Distance 7.07, Angular velocity 0.0, Speed: 2.44, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.02, Angle accuracy 0.0, Num episodes 2119
2019-12-06 17:48:03.120 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 337
2019-12-06 17:48:03.120 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 242.62, Steps: 338, Distance 6.22, Angular velocity 0.0, Speed: 2.28, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.58, Angle accuracy 0.0, Num episodes 2120
2019-12-06 17:48:03.641 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 579
2019-12-06 17:48:03.641 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.98, Steps: 580, Distance 18.44, Angular velocity 0.0, Speed: 3.63, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.15, Angle accuracy 0.0, Num episodes 2121
2019-12-06 17:48:04.158 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 590
2019-12-06 17:48:04.158 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.65, Steps: 591, Distance 19.27, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.2, Angle accuracy 0.0, Num episodes 2122
Warning: trajectory cut off by epoch at 362 steps.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 371 |
| AverageEpRet | 356 |
| StdEpRet | 68.1 |
| MaxEpRet | 407 |
| MinEpRet | 243 |
| EpLen | 520 |
| AverageVVals | 56.6 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.6 |
| MinVVals | 56.6 |
| TotalEnvInteracts | 1.49e+06 |
| LossPi | -6.45e-08 |
| LossV | 386 |
| DeltaLossPi | 0.00202 |
| DeltaLossV | -0.213 |
| Entropy | -2.04 |
| KL | 0.00182 |
| ClipFrac | 0.027 |
| StopIter | 6 |
| Time | 1.4e+03 |
---------------------------------------
2019-12-06 17:48:04.825 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 316
2019-12-06 17:48:04.825 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 237.18, Steps: 317, Distance 5.47, Angular velocity 0.0, Speed: 2.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.56, Angle accuracy 0.0, Num episodes 2123
2019-12-06 17:48:05.274 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 508
2019-12-06 17:48:05.275 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.28, Steps: 509, Distance 14.12, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.69, Angle accuracy 0.0, Num episodes 2124
2019-12-06 17:48:05.771 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 572
2019-12-06 17:48:05.772 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 394.63, Steps: 573, Distance 18.14, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.94, Angle accuracy 0.0, Num episodes 2125
2019-12-06 17:48:06.242 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 530
2019-12-06 17:48:06.242 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 376.03, Steps: 531, Distance 15.59, Angular velocity 0.0, Speed: 3.43, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.08, Angle accuracy 0.0, Num episodes 2126
2019-12-06 17:48:06.772 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:48:06.772 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.39, Steps: 599, Distance 19.57, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.26, Angle accuracy 0.0, Num episodes 2127
2019-12-06 17:48:07.363 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 663
2019-12-06 17:48:07.363 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.99, Steps: 664, Distance 23.38, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.97, Angle accuracy 0.0, Num episodes 2128
2019-12-06 17:48:07.883 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 586
2019-12-06 17:48:07.883 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 400.74, Steps: 587, Distance 18.98, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.08, Angle accuracy 0.0, Num episodes 2129
Warning: trajectory cut off by epoch at 220 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 372 |
| AverageEpRet | 372 |
| StdEpRet | 58.2 |
| MaxEpRet | 425 |
| MinEpRet | 237 |
| EpLen | 540 |
| AverageVVals | 56.2 |
| StdVVals | 7.63e-06 |
| MaxVVals | 56.2 |
| MinVVals | 56.2 |
| TotalEnvInteracts | 1.49e+06 |
| LossPi | 1.26e-08 |
| LossV | 388 |
| DeltaLossPi | -0.0011 |
| DeltaLossV | -0.225 |
| Entropy | -2.03 |
| KL | 0.000855 |
| ClipFrac | 0.00475 |
| StopIter | 1 |
| Time | 1.4e+03 |
---------------------------------------
2019-12-06 17:48:08.576 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 479
2019-12-06 17:48:08.577 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 354.14, Steps: 480, Distance 12.8, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.1, Angle accuracy 0.0, Num episodes 2130
2019-12-06 17:48:08.989 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 473
2019-12-06 17:48:08.989 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 343.66, Steps: 474, Distance 12.43, Angular velocity 0.0, Speed: 3.16, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.68, Angle accuracy 0.0, Num episodes 2131
2019-12-06 17:48:09.376 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 441
2019-12-06 17:48:09.376 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 328.07, Steps: 442, Distance 10.72, Angular velocity 0.0, Speed: 2.94, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.77, Angle accuracy 0.0, Num episodes 2132
2019-12-06 17:48:09.930 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 636
2019-12-06 17:48:09.931 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.81, Steps: 637, Distance 21.82, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.64, Angle accuracy 0.0, Num episodes 2133
2019-12-06 17:48:10.247 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 364
2019-12-06 17:48:10.247 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 265.27, Steps: 365, Distance 7.22, Angular velocity 0.0, Speed: 2.44, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.13, Angle accuracy 0.0, Num episodes 2134
2019-12-06 17:48:10.825 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 664
2019-12-06 17:48:10.826 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.07, Steps: 665, Distance 23.61, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.14, Angle accuracy 0.0, Num episodes 2135
2019-12-06 17:48:11.325 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 561
2019-12-06 17:48:11.325 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.74, Steps: 562, Distance 17.38, Angular velocity 0.0, Speed: 3.55, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.86, Angle accuracy 0.0, Num episodes 2136
Warning: trajectory cut off by epoch at 375 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 373 |
| AverageEpRet | 362 |
| StdEpRet | 53.1 |
| MaxEpRet | 428 |
| MinEpRet | 265 |
| EpLen | 518 |
| AverageVVals | 56.6 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56.6 |
| MinVVals | 56.6 |
| TotalEnvInteracts | 1.5e+06 |
| LossPi | -1.14e-07 |
| LossV | 381 |
| DeltaLossPi | -0.000342 |
| DeltaLossV | -0.257 |
| Entropy | -2.02 |
| KL | 0.000192 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.41e+03 |
---------------------------------------
2019-12-06 17:48:12.312 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:48:12.312 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.27, Steps: 663, Distance 23.55, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.96, Angle accuracy 0.0, Num episodes 2137
2019-12-06 17:48:12.840 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 598
2019-12-06 17:48:12.840 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.44, Steps: 599, Distance 19.46, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.32, Angle accuracy 0.0, Num episodes 2138
2019-12-06 17:48:13.535 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 782
2019-12-06 17:48:13.535 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.32, Steps: 783, Distance 31.39, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.02, Angle accuracy 0.0, Num episodes 2139
2019-12-06 17:48:14.005 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 525
2019-12-06 17:48:14.005 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.72, Steps: 526, Distance 15.17, Angular velocity 0.0, Speed: 3.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.99, Angle accuracy 0.0, Num episodes 2140
2019-12-06 17:48:14.475 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 528
2019-12-06 17:48:14.475 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 370.24, Steps: 529, Distance 15.44, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.18, Angle accuracy 0.0, Num episodes 2141
2019-12-06 17:48:15.152 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:48:15.152 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.22, Steps: 762, Distance 30.05, Angular velocity 0.0, Speed: 4.0, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.89, Angle accuracy 0.0, Num episodes 2142
Warning: trajectory cut off by epoch at 138 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 374 |
| AverageEpRet | 415 |
| StdEpRet | 34.7 |
| MaxEpRet | 459 |
| MinEpRet | 370 |
| EpLen | 644 |
| AverageVVals | 57.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.1 |
| MinVVals | 57.1 |
| TotalEnvInteracts | 1.5e+06 |
| LossPi | 3.05e-08 |
| LossV | 497 |
| DeltaLossPi | 0.000531 |
| DeltaLossV | -9.81 |
| Entropy | -2.04 |
| KL | -0.000163 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.41e+03 |
---------------------------------------
2019-12-06 17:48:15.899 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 624
2019-12-06 17:48:15.900 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.21, Steps: 625, Distance 21.07, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.65, Angle accuracy 0.0, Num episodes 2143
2019-12-06 17:48:16.471 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 647
2019-12-06 17:48:16.472 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.98, Steps: 648, Distance 22.63, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.97, Angle accuracy 0.0, Num episodes 2144
2019-12-06 17:48:16.949 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 544
2019-12-06 17:48:16.949 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 377.75, Steps: 545, Distance 16.32, Angular velocity 0.0, Speed: 3.49, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.49, Angle accuracy 0.0, Num episodes 2145
2019-12-06 17:48:17.514 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 638
2019-12-06 17:48:17.514 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 421.6, Steps: 639, Distance 22.02, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.76, Angle accuracy 0.0, Num episodes 2146
2019-12-06 17:48:18.116 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:48:18.116 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.15, Steps: 692, Distance 25.2, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.23, Angle accuracy 0.0, Num episodes 2147
2019-12-06 17:48:18.689 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 655
2019-12-06 17:48:18.690 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.01, Steps: 656, Distance 23.06, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.87, Angle accuracy 0.0, Num episodes 2148
Warning: trajectory cut off by epoch at 195 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 375 |
| AverageEpRet | 416 |
| StdEpRet | 18 |
| MaxEpRet | 435 |
| MinEpRet | 378 |
| EpLen | 634 |
| AverageVVals | 54 |
| StdVVals | 1.14e-05 |
| MaxVVals | 54 |
| MinVVals | 54 |
| TotalEnvInteracts | 1.5e+06 |
| LossPi | 3.95e-08 |
| LossV | 437 |
| DeltaLossPi | 0.00172 |
| DeltaLossV | -1.03 |
| Entropy | -2.04 |
| KL | 0.00514 |
| ClipFrac | 0.0943 |
| StopIter | 1 |
| Time | 1.42e+03 |
---------------------------------------
2019-12-06 17:48:19.561 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 705
2019-12-06 17:48:19.561 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.15, Steps: 706, Distance 26.08, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.34, Angle accuracy 0.0, Num episodes 2149
2019-12-06 17:48:20.085 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 594
2019-12-06 17:48:20.086 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.08, Steps: 595, Distance 19.34, Angular velocity 0.0, Speed: 3.62, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.25, Angle accuracy 0.0, Num episodes 2150
2019-12-06 17:48:20.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 649
2019-12-06 17:48:20.655 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 429.13, Steps: 650, Distance 22.43, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.98, Angle accuracy 0.0, Num episodes 2151
2019-12-06 17:48:21.246 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 669
2019-12-06 17:48:21.246 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.54, Steps: 670, Distance 23.73, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 95.98, Angle accuracy 0.0, Num episodes 2152
2019-12-06 17:48:21.740 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 560
2019-12-06 17:48:21.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.82, Steps: 561, Distance 17.2, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.66, Angle accuracy 0.0, Num episodes 2153
2019-12-06 17:48:22.110 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 418
2019-12-06 17:48:22.110 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 316.31, Steps: 419, Distance 9.62, Angular velocity 0.0, Speed: 2.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.66, Angle accuracy 0.0, Num episodes 2154
2019-12-06 17:48:22.388 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 320
2019-12-06 17:48:22.388 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 231.2, Steps: 321, Distance 5.52, Angular velocity 0.0, Speed: 2.11, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.78, Angle accuracy 0.0, Num episodes 2155
Warning: trajectory cut off by epoch at 78 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 376 |
| AverageEpRet | 378 |
| StdEpRet | 71.4 |
| MaxEpRet | 437 |
| MinEpRet | 231 |
| EpLen | 560 |
| AverageVVals | 55 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55 |
| MinVVals | 55 |
| TotalEnvInteracts | 1.51e+06 |
| LossPi | 1.53e-08 |
| LossV | 447 |
| DeltaLossPi | 0.000983 |
| DeltaLossV | 0.000153 |
| Entropy | -2.03 |
| KL | 0.0109 |
| ClipFrac | 0.152 |
| StopIter | 1 |
| Time | 1.42e+03 |
---------------------------------------
2019-12-06 17:48:23.065 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 612
2019-12-06 17:48:23.065 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 414.41, Steps: 613, Distance 20.57, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.46, Angle accuracy 0.0, Num episodes 2156
2019-12-06 17:48:23.740 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 768
2019-12-06 17:48:23.741 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 441.91, Steps: 769, Distance 30.36, Angular velocity 0.0, Speed: 4.01, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.93, Angle accuracy 0.0, Num episodes 2157
2019-12-06 17:48:24.387 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 737
2019-12-06 17:48:24.387 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.02, Steps: 738, Distance 28.49, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.64, Angle accuracy 0.0, Num episodes 2158
2019-12-06 17:48:24.698 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 347
2019-12-06 17:48:24.699 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 259.25, Steps: 348, Distance 6.59, Angular velocity 0.0, Speed: 2.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.87, Angle accuracy 0.0, Num episodes 2159
2019-12-06 17:48:25.217 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 595
2019-12-06 17:48:25.217 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.1, Steps: 596, Distance 19.36, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.19, Angle accuracy 0.0, Num episodes 2160
2019-12-06 17:48:25.757 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:48:25.757 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.44, Steps: 615, Distance 20.58, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.62, Angle accuracy 0.0, Num episodes 2161
2019-12-06 17:48:25.985 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 261
2019-12-06 17:48:25.986 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 195.22, Steps: 262, Distance 3.7, Angular velocity 0.0, Speed: 1.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 78.76, Angle accuracy 0.0, Num episodes 2162
Warning: trajectory cut off by epoch at 59 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 377 |
| AverageEpRet | 369 |
| StdEpRet | 92.1 |
| MaxEpRet | 442 |
| MinEpRet | 195 |
| EpLen | 563 |
| AverageVVals | 55 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55 |
| MinVVals | 55 |
| TotalEnvInteracts | 1.51e+06 |
| LossPi | 7.1e-08 |
| LossV | 474 |
| DeltaLossPi | 0.00363 |
| DeltaLossV | -3.37 |
| Entropy | -2.04 |
| KL | 0.0123 |
| ClipFrac | 0.166 |
| StopIter | 1 |
| Time | 1.42e+03 |
---------------------------------------
2019-12-06 17:48:26.599 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 557
2019-12-06 17:48:26.599 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.49, Steps: 558, Distance 17.25, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.77, Angle accuracy 0.0, Num episodes 2163
2019-12-06 17:48:27.099 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 576
2019-12-06 17:48:27.100 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.69, Steps: 577, Distance 18.54, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.01, Angle accuracy 0.0, Num episodes 2164
2019-12-06 17:48:27.712 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:48:27.713 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.2, Steps: 700, Distance 26.39, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 2165
2019-12-06 17:48:27.989 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 311
2019-12-06 17:48:27.989 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 227.26, Steps: 312, Distance 5.38, Angular velocity 0.0, Speed: 2.12, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 84.39, Angle accuracy 0.0, Num episodes 2166
2019-12-06 17:48:28.543 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:48:28.543 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 405.8, Steps: 632, Distance 21.97, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.66, Angle accuracy 0.0, Num episodes 2167
2019-12-06 17:48:29.083 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:48:29.083 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.19, Steps: 618, Distance 21.05, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.72, Angle accuracy 0.0, Num episodes 2168
2019-12-06 17:48:29.614 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 590
2019-12-06 17:48:29.615 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.19, Steps: 591, Distance 19.42, Angular velocity 0.0, Speed: 3.72, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.29, Angle accuracy 0.0, Num episodes 2169
Warning: trajectory cut off by epoch at 12 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 378 |
| AverageEpRet | 379 |
| StdEpRet | 63.2 |
| MaxEpRet | 427 |
| MinEpRet | 227 |
| EpLen | 570 |
| AverageVVals | 53.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 53.1 |
| MinVVals | 53.1 |
| TotalEnvInteracts | 1.52e+06 |
| LossPi | 4.32e-08 |
| LossV | 420 |
| DeltaLossPi | 0.000242 |
| DeltaLossV | -1.25 |
| Entropy | -2.03 |
| KL | 0.0024 |
| ClipFrac | 0.0292 |
| StopIter | 1 |
| Time | 1.43e+03 |
---------------------------------------
2019-12-06 17:48:30.269 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:48:30.270 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 410.84, Steps: 630, Distance 21.72, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.84, Angle accuracy 0.0, Num episodes 2170
2019-12-06 17:48:30.731 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 516
2019-12-06 17:48:30.731 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 365.3, Steps: 517, Distance 14.89, Angular velocity 0.0, Speed: 3.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.84, Angle accuracy 0.0, Num episodes 2171
2019-12-06 17:48:31.148 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 467
2019-12-06 17:48:31.148 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 338.83, Steps: 468, Distance 12.33, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.86, Angle accuracy 0.0, Num episodes 2172
2019-12-06 17:48:31.814 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 750
2019-12-06 17:48:31.814 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 450.85, Steps: 751, Distance 29.79, Angular velocity 0.0, Speed: 4.05, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.89, Angle accuracy 0.0, Num episodes 2173
2019-12-06 17:48:32.358 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:48:32.359 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.4, Steps: 623, Distance 21.27, Angular velocity 0.0, Speed: 3.78, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.56, Angle accuracy 0.0, Num episodes 2174
2019-12-06 17:48:33.034 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 768
2019-12-06 17:48:33.035 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.27, Steps: 769, Distance 30.78, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.95, Angle accuracy 0.0, Num episodes 2175
Warning: trajectory cut off by epoch at 242 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 379 |
| AverageEpRet | 405 |
| StdEpRet | 40.8 |
| MaxEpRet | 451 |
| MinEpRet | 339 |
| EpLen | 626 |
| AverageVVals | 54.3 |
| StdVVals | 0 |
| MaxVVals | 54.3 |
| MinVVals | 54.3 |
| TotalEnvInteracts | 1.52e+06 |
| LossPi | -1.43e-09 |
| LossV | 456 |
| DeltaLossPi | 0.00536 |
| DeltaLossV | -0.0465 |
| Entropy | -2.03 |
| KL | 0.022 |
| ClipFrac | 0.203 |
| StopIter | 1 |
| Time | 1.43e+03 |
---------------------------------------
2019-12-06 17:48:33.919 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 664
2019-12-06 17:48:33.919 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.95, Steps: 665, Distance 23.94, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.19, Angle accuracy 0.0, Num episodes 2176
2019-12-06 17:48:34.589 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:48:34.590 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.48, Steps: 743, Distance 29.67, Angular velocity 0.0, Speed: 4.11, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.74, Angle accuracy 0.0, Num episodes 2177
2019-12-06 17:48:35.284 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:48:35.285 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.03, Steps: 762, Distance 30.89, Angular velocity 0.0, Speed: 4.13, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.05, Angle accuracy 0.0, Num episodes 2178
2019-12-06 17:48:35.826 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 611
2019-12-06 17:48:35.826 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.48, Steps: 612, Distance 20.71, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.43, Angle accuracy 0.0, Num episodes 2179
2019-12-06 17:48:36.262 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 491
2019-12-06 17:48:36.262 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 350.63, Steps: 492, Distance 13.67, Angular velocity 0.0, Speed: 3.36, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.45, Angle accuracy 0.0, Num episodes 2180
2019-12-06 17:48:36.653 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 449
2019-12-06 17:48:36.654 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 313.74, Steps: 450, Distance 11.53, Angular velocity 0.0, Speed: 3.13, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.23, Angle accuracy 0.0, Num episodes 2181
Warning: trajectory cut off by epoch at 276 steps.
Warning: could not pickle state_dict.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 380 |
| AverageEpRet | 398 |
| StdEpRet | 49.9 |
| MaxEpRet | 447 |
| MinEpRet | 314 |
| EpLen | 621 |
| AverageVVals | 54 |
| StdVVals | 1.14e-05 |
| MaxVVals | 54 |
| MinVVals | 54 |
| TotalEnvInteracts | 1.52e+06 |
| LossPi | 3.42e-08 |
| LossV | 429 |
| DeltaLossPi | -0.0014 |
| DeltaLossV | -0.245 |
| Entropy | -2.04 |
| KL | 0.00255 |
| ClipFrac | 0.006 |
| StopIter | 1 |
| Time | 1.43e+03 |
---------------------------------------
2019-12-06 17:48:37.894 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 556
2019-12-06 17:48:37.894 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 386.58, Steps: 557, Distance 17.31, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.71, Angle accuracy 0.0, Num episodes 2182
2019-12-06 17:48:38.378 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 551
2019-12-06 17:48:38.379 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 392.44, Steps: 552, Distance 16.8, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.61, Angle accuracy 0.0, Num episodes 2183
2019-12-06 17:48:39.094 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 813
2019-12-06 17:48:39.095 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.32, Steps: 814, Distance 34.15, Angular velocity 0.0, Speed: 4.17, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.23, Angle accuracy 0.0, Num episodes 2184
2019-12-06 17:48:39.611 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 579
2019-12-06 17:48:39.612 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 398.16, Steps: 580, Distance 18.69, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.0, Angle accuracy 0.0, Num episodes 2185
2019-12-06 17:48:39.965 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 396
2019-12-06 17:48:39.966 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 266.41, Steps: 397, Distance 8.62, Angular velocity 0.0, Speed: 2.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.66, Angle accuracy 0.0, Num episodes 2186
2019-12-06 17:48:40.471 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 576
2019-12-06 17:48:40.472 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 389.16, Steps: 577, Distance 18.43, Angular velocity 0.0, Speed: 3.68, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.05, Angle accuracy 0.0, Num episodes 2187
Warning: trajectory cut off by epoch at 523 steps.
Early stopping at step 4 due to reaching max kl.
---------------------------------------
| Epoch | 381 |
| AverageEpRet | 380 |
| StdEpRet | 54.2 |
| MaxEpRet | 444 |
| MinEpRet | 266 |
| EpLen | 580 |
| AverageVVals | 53.6 |
| StdVVals | 3.81e-06 |
| MaxVVals | 53.6 |
| MinVVals | 53.6 |
| TotalEnvInteracts | 1.53e+06 |
| LossPi | 5.22e-08 |
| LossV | 397 |
| DeltaLossPi | -0.00217 |
| DeltaLossV | -2.35 |
| Entropy | -2.04 |
| KL | 0.00288 |
| ClipFrac | 0.0312 |
| StopIter | 4 |
| Time | 1.44e+03 |
---------------------------------------
2019-12-06 17:48:41.675 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 762
2019-12-06 17:48:41.675 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.32, Steps: 763, Distance 30.5, Angular velocity 0.0, Speed: 4.09, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.01, Angle accuracy 0.0, Num episodes 2188
2019-12-06 17:48:42.239 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 632
2019-12-06 17:48:42.239 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.96, Steps: 633, Distance 21.72, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.64, Angle accuracy 0.0, Num episodes 2189
2019-12-06 17:48:42.743 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 559
2019-12-06 17:48:42.743 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 381.77, Steps: 560, Distance 17.13, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.72, Angle accuracy 0.0, Num episodes 2190
2019-12-06 17:48:43.235 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 555
2019-12-06 17:48:43.235 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 382.82, Steps: 556, Distance 16.94, Angular velocity 0.0, Speed: 3.57, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 94.43, Angle accuracy 0.0, Num episodes 2191
2019-12-06 17:48:43.781 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:48:43.781 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.83, Steps: 623, Distance 20.9, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.56, Angle accuracy 0.0, Num episodes 2192
2019-12-06 17:48:44.248 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 527
2019-12-06 17:48:44.248 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 366.65, Steps: 528, Distance 15.36, Angular velocity 0.0, Speed: 3.47, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.07, Angle accuracy 0.0, Num episodes 2193
Warning: trajectory cut off by epoch at 337 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 382 |
| AverageEpRet | 401 |
| StdEpRet | 26.4 |
| MaxEpRet | 443 |
| MinEpRet | 367 |
| EpLen | 610 |
| AverageVVals | 55.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.1 |
| MinVVals | 55.1 |
| TotalEnvInteracts | 1.53e+06 |
| LossPi | 1.82e-08 |
| LossV | 386 |
| DeltaLossPi | -0.00406 |
| DeltaLossV | -0.0279 |
| Entropy | -2.02 |
| KL | 0.00431 |
| ClipFrac | 0.019 |
| StopIter | 1 |
| Time | 1.44e+03 |
---------------------------------------
2019-12-06 17:48:45.180 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 642
2019-12-06 17:48:45.181 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.42, Steps: 643, Distance 22.51, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.77, Angle accuracy 0.0, Num episodes 2194
2019-12-06 17:48:45.691 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:48:45.692 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 395.94, Steps: 589, Distance 18.79, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.2, Angle accuracy 0.0, Num episodes 2195
2019-12-06 17:48:46.250 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:48:46.251 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.56, Steps: 629, Distance 21.65, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.77, Angle accuracy 0.0, Num episodes 2196
2019-12-06 17:48:46.778 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 605
2019-12-06 17:48:46.778 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.9, Steps: 606, Distance 20.12, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.43, Angle accuracy 0.0, Num episodes 2197
2019-12-06 17:48:47.223 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 508
2019-12-06 17:48:47.223 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.1, Steps: 509, Distance 14.2, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.54, Angle accuracy 0.0, Num episodes 2198
2019-12-06 17:48:47.875 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 740
2019-12-06 17:48:47.875 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.14, Steps: 741, Distance 29.01, Angular velocity 0.0, Speed: 4.09, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.86, Angle accuracy 0.0, Num episodes 2199
Warning: trajectory cut off by epoch at 283 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 383 |
| AverageEpRet | 411 |
| StdEpRet | 24.3 |
| MaxEpRet | 449 |
| MinEpRet | 369 |
| EpLen | 620 |
| AverageVVals | 55.3 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.3 |
| MinVVals | 55.3 |
| TotalEnvInteracts | 1.54e+06 |
| LossPi | -8.64e-09 |
| LossV | 388 |
| DeltaLossPi | -0.00153 |
| DeltaLossV | -0.139 |
| Entropy | -2.02 |
| KL | 0.00329 |
| ClipFrac | 0.0103 |
| StopIter | 1 |
| Time | 1.44e+03 |
---------------------------------------
2019-12-06 17:48:48.645 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 505
2019-12-06 17:48:48.645 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 369.43, Steps: 506, Distance 13.8, Angular velocity 0.0, Speed: 3.3, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.53, Angle accuracy 0.0, Num episodes 2200
2019-12-06 17:48:49.202 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 630
2019-12-06 17:48:49.202 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.48, Steps: 631, Distance 21.25, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.7, Angle accuracy 0.0, Num episodes 2201
2019-12-06 17:48:49.742 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:48:49.742 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.83, Steps: 618, Distance 20.88, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.62, Angle accuracy 0.0, Num episodes 2202
2019-12-06 17:48:50.391 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 738
2019-12-06 17:48:50.392 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.72, Steps: 739, Distance 28.56, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.63, Angle accuracy 0.0, Num episodes 2203
2019-12-06 17:48:51.025 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 723
2019-12-06 17:48:51.026 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 439.49, Steps: 724, Distance 27.73, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.66, Angle accuracy 0.0, Num episodes 2204
2019-12-06 17:48:51.642 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 706
2019-12-06 17:48:51.643 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.04, Steps: 707, Distance 26.6, Angular velocity 0.0, Speed: 4.02, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.47, Angle accuracy 0.0, Num episodes 2205
Warning: trajectory cut off by epoch at 75 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 384 |
| AverageEpRet | 425 |
| StdEpRet | 27.7 |
| MaxEpRet | 454 |
| MinEpRet | 369 |
| EpLen | 654 |
| AverageVVals | 55.6 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.6 |
| MinVVals | 55.6 |
| TotalEnvInteracts | 1.54e+06 |
| LossPi | -3.57e-08 |
| LossV | 449 |
| DeltaLossPi | 0.00421 |
| DeltaLossV | -1.88 |
| Entropy | -2.04 |
| KL | 0.00765 |
| ClipFrac | 0.123 |
| StopIter | 3 |
| Time | 1.45e+03 |
---------------------------------------
2019-12-06 17:48:52.384 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:48:52.384 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.09, Steps: 678, Distance 24.86, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 96.22, Angle accuracy 0.0, Num episodes 2206
2019-12-06 17:48:52.975 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 674
2019-12-06 17:48:52.976 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.41, Steps: 675, Distance 24.5, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.26, Angle accuracy 0.0, Num episodes 2207
2019-12-06 17:48:53.509 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:48:53.509 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.39, Steps: 608, Distance 20.22, Angular velocity 0.0, Speed: 3.79, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.46, Angle accuracy 0.0, Num episodes 2208
2019-12-06 17:48:53.957 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 506
2019-12-06 17:48:53.957 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.18, Steps: 507, Distance 14.39, Angular velocity 0.0, Speed: 3.41, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.57, Angle accuracy 0.0, Num episodes 2209
2019-12-06 17:48:54.566 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 691
2019-12-06 17:48:54.566 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.71, Steps: 692, Distance 25.56, Angular velocity 0.0, Speed: 4.01, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.3, Angle accuracy 0.0, Num episodes 2210
2019-12-06 17:48:54.801 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 268
2019-12-06 17:48:54.802 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 193.61, Steps: 269, Distance 3.89, Angular velocity 0.0, Speed: 1.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 79.94, Angle accuracy 0.0, Num episodes 2211
2019-12-06 17:48:55.299 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 568
2019-12-06 17:48:55.300 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 396.8, Steps: 569, Distance 17.87, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.99, Angle accuracy 0.0, Num episodes 2212
Warning: trajectory cut off by epoch at 2 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 385 |
| AverageEpRet | 380 |
| StdEpRet | 80.2 |
| MaxEpRet | 438 |
| MinEpRet | 194 |
| EpLen | 571 |
| AverageVVals | 54.3 |
| StdVVals | 0 |
| MaxVVals | 54.3 |
| MinVVals | 54.3 |
| TotalEnvInteracts | 1.54e+06 |
| LossPi | 1.25e-07 |
| LossV | 409 |
| DeltaLossPi | 0.00346 |
| DeltaLossV | -0.00275 |
| Entropy | -2.03 |
| KL | 0.00542 |
| ClipFrac | 0.076 |
| StopIter | 1 |
| Time | 1.45e+03 |
---------------------------------------
2019-12-06 17:48:55.921 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 622
2019-12-06 17:48:55.921 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.9, Steps: 623, Distance 21.23, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.72, Angle accuracy 0.0, Num episodes 2213
2019-12-06 17:48:56.466 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 619
2019-12-06 17:48:56.466 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.68, Steps: 620, Distance 20.96, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.69, Angle accuracy 0.0, Num episodes 2214
2019-12-06 17:48:57.129 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 757
2019-12-06 17:48:57.130 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.03, Steps: 758, Distance 30.5, Angular velocity 0.0, Speed: 4.16, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.85, Angle accuracy 0.0, Num episodes 2215
2019-12-06 17:48:57.597 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 531
2019-12-06 17:48:57.597 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 375.16, Steps: 532, Distance 15.54, Angular velocity 0.0, Speed: 3.52, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.15, Angle accuracy 0.0, Num episodes 2216
2019-12-06 17:48:58.024 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 489
2019-12-06 17:48:58.025 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.37, Steps: 490, Distance 13.18, Angular velocity 0.0, Speed: 3.31, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.17, Angle accuracy 0.0, Num episodes 2217
2019-12-06 17:48:58.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 717
2019-12-06 17:48:58.656 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.05, Steps: 718, Distance 27.73, Angular velocity 0.0, Speed: 4.1, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.61, Angle accuracy 0.0, Num episodes 2218
Warning: trajectory cut off by epoch at 259 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 386 |
| AverageEpRet | 406 |
| StdEpRet | 36.5 |
| MaxEpRet | 453 |
| MinEpRet | 344 |
| EpLen | 624 |
| AverageVVals | 54.2 |
| StdVVals | 0 |
| MaxVVals | 54.2 |
| MinVVals | 54.2 |
| TotalEnvInteracts | 1.55e+06 |
| LossPi | 6.56e-08 |
| LossV | 397 |
| DeltaLossPi | -0.00111 |
| DeltaLossV | -0.132 |
| Entropy | -2.03 |
| KL | 0.000834 |
| ClipFrac | 0.0265 |
| StopIter | 1 |
| Time | 1.46e+03 |
---------------------------------------
2019-12-06 17:48:59.613 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 726
2019-12-06 17:48:59.614 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 444.77, Steps: 727, Distance 28.02, Angular velocity 0.0, Speed: 4.11, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.67, Angle accuracy 0.0, Num episodes 2219
2019-12-06 17:49:00.220 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 694
2019-12-06 17:49:00.220 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.44, Steps: 695, Distance 25.77, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.34, Angle accuracy 0.0, Num episodes 2220
2019-12-06 17:49:00.821 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 669
2019-12-06 17:49:00.821 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 428.63, Steps: 670, Distance 24.04, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.24, Angle accuracy 0.0, Num episodes 2221
2019-12-06 17:49:01.386 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 641
2019-12-06 17:49:01.387 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 419.96, Steps: 642, Distance 22.43, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.07, Avg gforce: 0.04, Trip pct 95.83, Angle accuracy 0.0, Num episodes 2222
2019-12-06 17:49:02.060 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 767
2019-12-06 17:49:02.061 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.44, Steps: 768, Distance 30.93, Angular velocity 0.0, Speed: 4.19, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.03, Angle accuracy 0.0, Num episodes 2223
Warning: trajectory cut off by epoch at 498 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 387 |
| AverageEpRet | 439 |
| StdEpRet | 13.6 |
| MaxEpRet | 458 |
| MinEpRet | 420 |
| EpLen | 700 |
| AverageVVals | 54.6 |
| StdVVals | 3.81e-06 |
| MaxVVals | 54.6 |
| MinVVals | 54.6 |
| TotalEnvInteracts | 1.55e+06 |
| LossPi | -3.77e-08 |
| LossV | 427 |
| DeltaLossPi | 3.4e-06 |
| DeltaLossV | -0.00513 |
| Entropy | -2.04 |
| KL | -2.96e-05 |
| ClipFrac | 0 |
| StopIter | 3 |
| Time | 1.46e+03 |
---------------------------------------
2019-12-06 17:49:03.225 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 740
2019-12-06 17:49:03.226 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.61, Steps: 741, Distance 29.1, Angular velocity 0.0, Speed: 4.14, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.73, Angle accuracy 0.0, Num episodes 2224
2019-12-06 17:49:03.729 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 569
2019-12-06 17:49:03.730 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 404.83, Steps: 570, Distance 17.62, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.9, Angle accuracy 0.0, Num episodes 2225
2019-12-06 17:49:04.277 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:49:04.278 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.78, Steps: 632, Distance 21.37, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.8, Angle accuracy 0.0, Num episodes 2226
2019-12-06 17:49:04.604 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 374
2019-12-06 17:49:04.605 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 261.31, Steps: 375, Distance 7.48, Angular velocity 0.0, Speed: 2.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.39, Angle accuracy 0.0, Num episodes 2227
2019-12-06 17:49:05.053 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 495
2019-12-06 17:49:05.053 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 344.94, Steps: 496, Distance 13.35, Angular velocity 0.0, Speed: 3.32, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.37, Angle accuracy 0.0, Num episodes 2228
2019-12-06 17:49:05.507 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 520
2019-12-06 17:49:05.508 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.09, Steps: 521, Distance 14.83, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.71, Angle accuracy 0.0, Num episodes 2229
Warning: trajectory cut off by epoch at 665 steps.
---------------------------------------
| Epoch | 388 |
| AverageEpRet | 376 |
| StdEpRet | 63.1 |
| MaxEpRet | 454 |
| MinEpRet | 261 |
| EpLen | 556 |
| AverageVVals | 54.5 |
| StdVVals | 7.63e-06 |
| MaxVVals | 54.5 |
| MinVVals | 54.5 |
| TotalEnvInteracts | 1.56e+06 |
| LossPi | 1.06e-08 |
| LossV | 348 |
| DeltaLossPi | -0.00222 |
| DeltaLossV | -3.35 |
| Entropy | -2.05 |
| KL | 0.00355 |
| ClipFrac | 0.0545 |
| StopIter | 79 |
| Time | 1.46e+03 |
---------------------------------------
2019-12-06 17:49:06.836 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 695
2019-12-06 17:49:06.836 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 451.99, Steps: 696, Distance 25.54, Angular velocity 0.0, Speed: 4.01, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.29, Angle accuracy 0.0, Num episodes 2230
2019-12-06 17:49:07.208 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 419
2019-12-06 17:49:07.208 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 288.39, Steps: 420, Distance 9.35, Angular velocity 0.0, Speed: 2.81, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 90.74, Angle accuracy 0.0, Num episodes 2231
2019-12-06 17:49:07.803 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 679
2019-12-06 17:49:07.803 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 437.54, Steps: 680, Distance 24.46, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.29, Angle accuracy 0.0, Num episodes 2232
2019-12-06 17:49:08.222 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 469
2019-12-06 17:49:08.222 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 323.67, Steps: 470, Distance 11.75, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.42, Angle accuracy 0.0, Num episodes 2233
2019-12-06 17:49:08.869 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 732
2019-12-06 17:49:08.869 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.27, Steps: 733, Distance 27.78, Angular velocity 0.0, Speed: 4.08, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.7, Angle accuracy 0.0, Num episodes 2234
2019-12-06 17:49:09.366 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 562
2019-12-06 17:49:09.366 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 393.44, Steps: 563, Distance 16.98, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.68, Angle accuracy 0.0, Num episodes 2235
Warning: trajectory cut off by epoch at 438 steps.
---------------------------------------
| Epoch | 389 |
| AverageEpRet | 392 |
| StdEpRet | 65.3 |
| MaxEpRet | 459 |
| MinEpRet | 288 |
| EpLen | 594 |
| AverageVVals | 56.3 |
| StdVVals | 0 |
| MaxVVals | 56.3 |
| MinVVals | 56.3 |
| TotalEnvInteracts | 1.56e+06 |
| LossPi | -7.26e-08 |
| LossV | 382 |
| DeltaLossPi | -0.00134 |
| DeltaLossV | -0.139 |
| Entropy | -2.04 |
| KL | 0.00184 |
| ClipFrac | 0.0185 |
| StopIter | 79 |
| Time | 1.47e+03 |
---------------------------------------
2019-12-06 17:49:10.497 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:49:10.498 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 443.38, Steps: 678, Distance 24.13, Angular velocity 0.0, Speed: 3.96, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.22, Angle accuracy 0.0, Num episodes 2236
2019-12-06 17:49:11.176 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 776
2019-12-06 17:49:11.176 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 464.62, Steps: 777, Distance 30.67, Angular velocity 0.0, Speed: 4.16, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.98, Angle accuracy 0.0, Num episodes 2237
2019-12-06 17:49:11.744 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 659
2019-12-06 17:49:11.744 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.3, Steps: 660, Distance 23.01, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.98, Angle accuracy 0.0, Num episodes 2238
2019-12-06 17:49:12.297 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:49:12.297 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.0, Steps: 630, Distance 20.92, Angular velocity 0.0, Speed: 3.82, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 2239
2019-12-06 17:49:12.932 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 727
2019-12-06 17:49:12.932 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 461.91, Steps: 728, Distance 27.54, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.5, Angle accuracy 0.0, Num episodes 2240
Warning: trajectory cut off by epoch at 527 steps.
Warning: could not pickle state_dict.
Early stopping at step 6 due to reaching max kl.
---------------------------------------
| Epoch | 390 |
| AverageEpRet | 448 |
| StdEpRet | 14.6 |
| MaxEpRet | 465 |
| MinEpRet | 424 |
| EpLen | 695 |
| AverageVVals | 55.9 |
| StdVVals | 7.63e-06 |
| MaxVVals | 55.9 |
| MinVVals | 55.9 |
| TotalEnvInteracts | 1.56e+06 |
| LossPi | -8.55e-08 |
| LossV | 425 |
| DeltaLossPi | 0.00328 |
| DeltaLossV | -0.0608 |
| Entropy | -2.07 |
| KL | 0.00402 |
| ClipFrac | 0.0882 |
| StopIter | 6 |
| Time | 1.47e+03 |
---------------------------------------
2019-12-06 17:49:14.515 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 702
2019-12-06 17:49:14.515 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.53, Steps: 703, Distance 25.59, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.47, Angle accuracy 0.0, Num episodes 2241
2019-12-06 17:49:14.900 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 436
2019-12-06 17:49:14.901 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 322.89, Steps: 437, Distance 9.99, Angular velocity 0.0, Speed: 2.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.18, Angle accuracy 0.0, Num episodes 2242
2019-12-06 17:49:15.551 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 741
2019-12-06 17:49:15.551 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.07, Steps: 742, Distance 28.21, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.76, Angle accuracy 0.0, Num episodes 2243
2019-12-06 17:49:16.222 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 760
2019-12-06 17:49:16.223 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 471.09, Steps: 761, Distance 29.4, Angular velocity 0.0, Speed: 4.11, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.83, Angle accuracy 0.0, Num episodes 2244
2019-12-06 17:49:16.817 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 677
2019-12-06 17:49:16.817 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.09, Steps: 678, Distance 24.06, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.22, Angle accuracy 0.0, Num episodes 2245
2019-12-06 17:49:17.255 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 498
2019-12-06 17:49:17.255 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 364.77, Steps: 499, Distance 13.15, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.11, Angle accuracy 0.0, Num episodes 2246
Warning: trajectory cut off by epoch at 180 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 391 |
| AverageEpRet | 418 |
| StdEpRet | 54.6 |
| MaxEpRet | 471 |
| MinEpRet | 323 |
| EpLen | 637 |
| AverageVVals | 56.2 |
| StdVVals | 0 |
| MaxVVals | 56.2 |
| MinVVals | 56.2 |
| TotalEnvInteracts | 1.57e+06 |
| LossPi | -5.46e-08 |
| LossV | 433 |
| DeltaLossPi | -3.56e-05 |
| DeltaLossV | -1.19 |
| Entropy | -2.06 |
| KL | 0.00097 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.47e+03 |
---------------------------------------
2019-12-06 17:49:18.134 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 727
2019-12-06 17:49:18.135 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.58, Steps: 728, Distance 27.35, Angular velocity 0.0, Speed: 4.06, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.57, Angle accuracy 0.0, Num episodes 2247
2019-12-06 17:49:18.808 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 774
2019-12-06 17:49:18.809 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 469.73, Steps: 775, Distance 30.86, Angular velocity 0.0, Speed: 4.16, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.9, Angle accuracy 0.0, Num episodes 2248
2019-12-06 17:49:19.242 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 489
2019-12-06 17:49:19.242 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 362.64, Steps: 490, Distance 12.8, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.96, Angle accuracy 0.0, Num episodes 2249
2019-12-06 17:49:19.759 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 594
2019-12-06 17:49:19.759 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.29, Steps: 595, Distance 18.81, Angular velocity 0.0, Speed: 3.69, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.23, Angle accuracy 0.0, Num episodes 2250
2019-12-06 17:49:20.278 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 590
2019-12-06 17:49:20.278 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.31, Steps: 591, Distance 18.47, Angular velocity 0.0, Speed: 3.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.04, Angle accuracy 0.0, Num episodes 2251
2019-12-06 17:49:20.765 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 563
2019-12-06 17:49:20.766 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 402.67, Steps: 564, Distance 17.04, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.5, Angle accuracy 0.0, Num episodes 2252
Warning: trajectory cut off by epoch at 257 steps.
Early stopping at step 3 due to reaching max kl.
---------------------------------------
| Epoch | 392 |
| AverageEpRet | 421 |
| StdEpRet | 35.9 |
| MaxEpRet | 470 |
| MinEpRet | 363 |
| EpLen | 624 |
| AverageVVals | 55.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.1 |
| MinVVals | 55.1 |
| TotalEnvInteracts | 1.57e+06 |
| LossPi | 1.66e-08 |
| LossV | 409 |
| DeltaLossPi | -0.00153 |
| DeltaLossV | -2.69 |
| Entropy | -2.06 |
| KL | 0.00605 |
| ClipFrac | 0.0487 |
| StopIter | 3 |
| Time | 1.48e+03 |
---------------------------------------
2019-12-06 17:49:21.664 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:49:21.664 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.68, Steps: 689, Distance 24.98, Angular velocity 0.0, Speed: 3.97, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.34, Angle accuracy 0.0, Num episodes 2253
2019-12-06 17:49:21.977 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 356
2019-12-06 17:49:21.978 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 262.14, Steps: 357, Distance 6.71, Angular velocity 0.0, Speed: 2.33, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.24, Angle accuracy 0.0, Num episodes 2254
2019-12-06 17:49:22.559 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:49:22.560 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 445.43, Steps: 663, Distance 23.25, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.02, Angle accuracy 0.0, Num episodes 2255
2019-12-06 17:49:22.996 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 487
2019-12-06 17:49:22.996 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 361.64, Steps: 488, Distance 12.66, Angular velocity 0.0, Speed: 3.18, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.69, Angle accuracy 0.0, Num episodes 2256
2019-12-06 17:49:23.594 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 688
2019-12-06 17:49:23.594 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.28, Steps: 689, Distance 25.08, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.22, Angle accuracy 0.0, Num episodes 2257
2019-12-06 17:49:24.174 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:49:24.175 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 442.03, Steps: 663, Distance 23.19, Angular velocity 0.0, Speed: 3.89, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.92, Angle accuracy 0.0, Num episodes 2258
2019-12-06 17:49:24.492 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 366
2019-12-06 17:49:24.493 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 267.4, Steps: 367, Distance 7.17, Angular velocity 0.0, Speed: 2.4, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 87.76, Angle accuracy 0.0, Num episodes 2259
Warning: trajectory cut off by epoch at 84 steps.
---------------------------------------
| Epoch | 393 |
| AverageEpRet | 383 |
| StdEpRet | 80.4 |
| MaxEpRet | 456 |
| MinEpRet | 262 |
| EpLen | 559 |
| AverageVVals | 56.7 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.7 |
| MinVVals | 56.7 |
| TotalEnvInteracts | 1.58e+06 |
| LossPi | -4.45e-08 |
| LossV | 423 |
| DeltaLossPi | -0.00109 |
| DeltaLossV | -0.828 |
| Entropy | -2.05 |
| KL | 0.0057 |
| ClipFrac | 0.108 |
| StopIter | 79 |
| Time | 1.48e+03 |
---------------------------------------
2019-12-06 17:49:25.088 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 434
2019-12-06 17:49:25.089 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 326.03, Steps: 435, Distance 10.08, Angular velocity 0.0, Speed: 2.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.17, Angle accuracy 0.0, Num episodes 2260
2019-12-06 17:49:25.587 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 569
2019-12-06 17:49:25.587 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.52, Steps: 570, Distance 17.19, Angular velocity 0.0, Speed: 3.54, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.67, Angle accuracy 0.0, Num episodes 2261
2019-12-06 17:49:26.122 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 607
2019-12-06 17:49:26.122 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.99, Steps: 608, Distance 19.49, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.21, Angle accuracy 0.0, Num episodes 2262
2019-12-06 17:49:26.784 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 755
2019-12-06 17:49:26.785 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 467.07, Steps: 756, Distance 29.37, Angular velocity 0.0, Speed: 4.05, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.82, Angle accuracy 0.0, Num episodes 2263
2019-12-06 17:49:27.288 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 576
2019-12-06 17:49:27.288 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 411.48, Steps: 577, Distance 17.67, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.83, Angle accuracy 0.0, Num episodes 2264
2019-12-06 17:49:27.804 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 590
2019-12-06 17:49:27.805 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 423.86, Steps: 591, Distance 18.63, Angular velocity 0.0, Speed: 3.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.11, Angle accuracy 0.0, Num episodes 2265
Warning: trajectory cut off by epoch at 463 steps.
---------------------------------------
| Epoch | 394 |
| AverageEpRet | 410 |
| StdEpRet | 42.1 |
| MaxEpRet | 467 |
| MinEpRet | 326 |
| EpLen | 590 |
| AverageVVals | 55.8 |
| StdVVals | 3.81e-06 |
| MaxVVals | 55.8 |
| MinVVals | 55.8 |
| TotalEnvInteracts | 1.58e+06 |
| LossPi | 8.05e-08 |
| LossV | 414 |
| DeltaLossPi | -0.00211 |
| DeltaLossV | -9.99 |
| Entropy | -2.05 |
| KL | 0.000268 |
| ClipFrac | 0.01 |
| StopIter | 79 |
| Time | 1.48e+03 |
---------------------------------------
2019-12-06 17:49:28.852 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 575
2019-12-06 17:49:28.852 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 420.55, Steps: 576, Distance 17.79, Angular velocity 0.0, Speed: 3.61, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.78, Angle accuracy 0.0, Num episodes 2266
2019-12-06 17:49:29.470 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:49:29.470 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 449.45, Steps: 700, Distance 25.61, Angular velocity 0.0, Speed: 3.96, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.32, Angle accuracy 0.0, Num episodes 2267
2019-12-06 17:49:30.117 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 735
2019-12-06 17:49:30.118 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 472.93, Steps: 736, Distance 27.74, Angular velocity 0.0, Speed: 4.02, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.58, Angle accuracy 0.0, Num episodes 2268
2019-12-06 17:49:30.717 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 684
2019-12-06 17:49:30.718 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.37, Steps: 685, Distance 24.42, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.26, Angle accuracy 0.0, Num episodes 2269
2019-12-06 17:49:31.069 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 403
2019-12-06 17:49:31.070 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 299.49, Steps: 404, Distance 8.6, Angular velocity 0.0, Speed: 2.64, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 89.74, Angle accuracy 0.0, Num episodes 2270
2019-12-06 17:49:31.690 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:49:31.690 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.78, Steps: 716, Distance 26.48, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.43, Angle accuracy 0.0, Num episodes 2271
Warning: trajectory cut off by epoch at 183 steps.
---------------------------------------
| Epoch | 395 |
| AverageEpRet | 425 |
| StdEpRet | 58.3 |
| MaxEpRet | 473 |
| MinEpRet | 299 |
| EpLen | 636 |
| AverageVVals | 59 |
| StdVVals | 1.14e-05 |
| MaxVVals | 59 |
| MinVVals | 59 |
| TotalEnvInteracts | 1.58e+06 |
| LossPi | 4.37e-08 |
| LossV | 464 |
| DeltaLossPi | -0.00132 |
| DeltaLossV | -8.76 |
| Entropy | -2.07 |
| KL | 0.00237 |
| ClipFrac | 0.038 |
| StopIter | 79 |
| Time | 1.49e+03 |
---------------------------------------
2019-12-06 17:49:32.489 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 567
2019-12-06 17:49:32.490 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 408.43, Steps: 568, Distance 17.36, Angular velocity 0.0, Speed: 3.58, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.72, Angle accuracy 0.0, Num episodes 2272
2019-12-06 17:49:33.042 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 621
2019-12-06 17:49:33.042 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.38, Steps: 622, Distance 20.64, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.63, Angle accuracy 0.0, Num episodes 2273
2019-12-06 17:49:33.348 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 341
2019-12-06 17:49:33.348 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 254.17, Steps: 342, Distance 6.23, Angular velocity 0.0, Speed: 2.25, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 86.61, Angle accuracy 0.0, Num episodes 2274
2019-12-06 17:49:34.028 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 769
2019-12-06 17:49:34.028 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 471.47, Steps: 770, Distance 30.32, Angular velocity 0.0, Speed: 4.1, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.86, Angle accuracy 0.0, Num episodes 2275
2019-12-06 17:49:34.531 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 561
2019-12-06 17:49:34.532 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.64, Steps: 562, Distance 16.99, Angular velocity 0.0, Speed: 3.56, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.74, Angle accuracy 0.0, Num episodes 2276
2019-12-06 17:49:35.092 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:49:35.092 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 433.46, Steps: 632, Distance 21.64, Angular velocity 0.0, Speed: 3.83, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.77, Angle accuracy 0.0, Num episodes 2277
Warning: trajectory cut off by epoch at 504 steps.
Early stopping at step 2 due to reaching max kl.
---------------------------------------
| Epoch | 396 |
| AverageEpRet | 402 |
| StdEpRet | 69.3 |
| MaxEpRet | 471 |
| MinEpRet | 254 |
| EpLen | 583 |
| AverageVVals | 56 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56 |
| MinVVals | 56 |
| TotalEnvInteracts | 1.59e+06 |
| LossPi | -2.41e-08 |
| LossV | 421 |
| DeltaLossPi | -0.000451 |
| DeltaLossV | -5.52 |
| Entropy | -2.1 |
| KL | 0.00333 |
| ClipFrac | 0.0693 |
| StopIter | 2 |
| Time | 1.49e+03 |
---------------------------------------
2019-12-06 17:49:36.254 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 736
2019-12-06 17:49:36.255 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 469.82, Steps: 737, Distance 28.38, Angular velocity 0.0, Speed: 4.05, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.67, Angle accuracy 0.0, Num episodes 2278
2019-12-06 17:49:36.786 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 604
2019-12-06 17:49:36.786 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.15, Steps: 605, Distance 19.66, Angular velocity 0.0, Speed: 3.7, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.23, Angle accuracy 0.0, Num episodes 2279
2019-12-06 17:49:37.390 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 684
2019-12-06 17:49:37.391 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 440.4, Steps: 685, Distance 25.09, Angular velocity 0.0, Speed: 3.95, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.21, Angle accuracy 0.0, Num episodes 2280
2019-12-06 17:49:37.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 581
2019-12-06 17:49:37.902 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 409.68, Steps: 582, Distance 18.35, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.99, Angle accuracy 0.0, Num episodes 2281
2019-12-06 17:49:38.334 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 487
2019-12-06 17:49:38.334 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 359.59, Steps: 488, Distance 12.94, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.91, Angle accuracy 0.0, Num episodes 2282
2019-12-06 17:49:38.852 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 592
2019-12-06 17:49:38.852 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 417.62, Steps: 593, Distance 19.05, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.1, Angle accuracy 0.0, Num episodes 2283
Warning: trajectory cut off by epoch at 310 steps.
Early stopping at step 13 due to reaching max kl.
---------------------------------------
| Epoch | 397 |
| AverageEpRet | 419 |
| StdEpRet | 33.3 |
| MaxEpRet | 470 |
| MinEpRet | 360 |
| EpLen | 615 |
| AverageVVals | 58.4 |
| StdVVals | 7.63e-06 |
| MaxVVals | 58.4 |
| MinVVals | 58.4 |
| TotalEnvInteracts | 1.59e+06 |
| LossPi | 1.79e-08 |
| LossV | 426 |
| DeltaLossPi | 0.00716 |
| DeltaLossV | -0.731 |
| Entropy | -2.09 |
| KL | 0.0104 |
| ClipFrac | 0.198 |
| StopIter | 13 |
| Time | 1.5e+03 |
---------------------------------------
2019-12-06 17:49:39.810 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 686
2019-12-06 17:49:39.810 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.19, Steps: 687, Distance 25.07, Angular velocity 0.0, Speed: 3.91, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.21, Angle accuracy 0.0, Num episodes 2284
2019-12-06 17:49:40.467 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 749
2019-12-06 17:49:40.467 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 475.53, Steps: 750, Distance 28.83, Angular velocity 0.0, Speed: 4.03, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.73, Angle accuracy 0.0, Num episodes 2285
2019-12-06 17:49:41.067 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 684
2019-12-06 17:49:41.067 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 446.1, Steps: 685, Distance 24.66, Angular velocity 0.0, Speed: 3.9, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.17, Angle accuracy 0.0, Num episodes 2286
2019-12-06 17:49:41.457 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 434
2019-12-06 17:49:41.457 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 324.34, Steps: 435, Distance 10.28, Angular velocity 0.0, Speed: 2.89, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.32, Angle accuracy 0.0, Num episodes 2287
2019-12-06 17:49:41.956 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 571
2019-12-06 17:49:41.956 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 412.5, Steps: 572, Distance 17.66, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.79, Angle accuracy 0.0, Num episodes 2288
2019-12-06 17:49:42.564 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 692
2019-12-06 17:49:42.564 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.88, Steps: 693, Distance 25.38, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.35, Angle accuracy 0.0, Num episodes 2289
Warning: trajectory cut off by epoch at 178 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 398 |
| AverageEpRet | 426 |
| StdEpRet | 48.9 |
| MaxEpRet | 476 |
| MinEpRet | 324 |
| EpLen | 637 |
| AverageVVals | 57.5 |
| StdVVals | 3.81e-06 |
| MaxVVals | 57.5 |
| MinVVals | 57.5 |
| TotalEnvInteracts | 1.6e+06 |
| LossPi | 7.2e-08 |
| LossV | 481 |
| DeltaLossPi | -0.00024 |
| DeltaLossV | -2.21 |
| Entropy | -2.1 |
| KL | 0.0012 |
| ClipFrac | 0.001 |
| StopIter | 1 |
| Time | 1.5e+03 |
---------------------------------------
2019-12-06 17:49:43.415 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 699
2019-12-06 17:49:43.415 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 455.19, Steps: 700, Distance 25.81, Angular velocity 0.0, Speed: 3.94, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.41, Angle accuracy 0.0, Num episodes 2290
2019-12-06 17:49:43.740 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 367
2019-12-06 17:49:43.740 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 270.84, Steps: 368, Distance 7.27, Angular velocity 0.0, Speed: 2.42, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 88.33, Angle accuracy 0.0, Num episodes 2291
2019-12-06 17:49:44.307 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 640
2019-12-06 17:49:44.308 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 435.79, Steps: 641, Distance 22.01, Angular velocity 0.0, Speed: 3.8, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.85, Angle accuracy 0.0, Num episodes 2292
2019-12-06 17:49:44.846 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 615
2019-12-06 17:49:44.846 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 432.46, Steps: 616, Distance 20.52, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.57, Angle accuracy 0.0, Num episodes 2293
2019-12-06 17:49:45.272 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 471
2019-12-06 17:49:45.273 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 351.45, Steps: 472, Distance 11.97, Angular velocity 0.0, Speed: 3.09, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.62, Angle accuracy 0.0, Num episodes 2294
2019-12-06 17:49:45.902 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 715
2019-12-06 17:49:45.903 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.66, Steps: 716, Distance 26.87, Angular velocity 0.0, Speed: 3.96, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.45, Angle accuracy 0.0, Num episodes 2295
Warning: trajectory cut off by epoch at 487 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 399 |
| AverageEpRet | 402 |
| StdEpRet | 69.2 |
| MaxEpRet | 466 |
| MinEpRet | 271 |
| EpLen | 586 |
| AverageVVals | 56 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56 |
| MinVVals | 56 |
| TotalEnvInteracts | 1.6e+06 |
| LossPi | -4.12e-08 |
| LossV | 453 |
| DeltaLossPi | -8.12e-05 |
| DeltaLossV | -4.27 |
| Entropy | -2.11 |
| KL | 0.000351 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.5e+03 |
---------------------------------------
2019-12-06 17:49:47.224 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 742
2019-12-06 17:49:47.225 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 465.28, Steps: 743, Distance 28.44, Angular velocity 0.0, Speed: 4.01, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.62, Angle accuracy 0.0, Num episodes 2296
2019-12-06 17:49:47.796 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 617
2019-12-06 17:49:47.797 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.71, Steps: 618, Distance 20.63, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.54, Angle accuracy 0.0, Num episodes 2297
2019-12-06 17:49:48.206 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 463
2019-12-06 17:49:48.206 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 345.4, Steps: 464, Distance 11.97, Angular velocity 0.0, Speed: 3.1, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.31, Angle accuracy 0.0, Num episodes 2298
2019-12-06 17:49:48.904 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 782
2019-12-06 17:49:48.905 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 468.59, Steps: 783, Distance 31.42, Angular velocity 0.0, Speed: 4.07, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.06, Angle accuracy 0.0, Num episodes 2299
2019-12-06 17:49:49.460 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:49:49.461 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 418.53, Steps: 615, Distance 20.6, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.6, Angle accuracy 0.0, Num episodes 2300
2019-12-06 17:49:50.047 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 661
2019-12-06 17:49:50.047 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.46, Steps: 662, Distance 23.25, Angular velocity 0.0, Speed: 3.85, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.03, Angle accuracy 0.0, Num episodes 2301
Warning: trajectory cut off by epoch at 115 steps.
Warning: could not pickle state_dict.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 400 |
| AverageEpRet | 429 |
| StdEpRet | 41.5 |
| MaxEpRet | 469 |
| MinEpRet | 345 |
| EpLen | 648 |
| AverageVVals | 58.1 |
| StdVVals | 3.81e-06 |
| MaxVVals | 58.1 |
| MinVVals | 58.1 |
| TotalEnvInteracts | 1.6e+06 |
| LossPi | 1.69e-08 |
| LossV | 504 |
| DeltaLossPi | 1.9e-05 |
| DeltaLossV | -7.06 |
| Entropy | -2.11 |
| KL | -3.3e-05 |
| ClipFrac | 0 |
| StopIter | 1 |
| Time | 1.51e+03 |
---------------------------------------
2019-12-06 17:49:51.222 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:49:51.223 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 427.25, Steps: 629, Distance 21.2, Angular velocity 0.0, Speed: 3.76, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.65, Angle accuracy 0.0, Num episodes 2302
2019-12-06 17:49:51.887 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 748
2019-12-06 17:49:51.888 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 453.38, Steps: 749, Distance 29.44, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.92, Angle accuracy 0.0, Num episodes 2303
2019-12-06 17:49:52.287 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 440
2019-12-06 17:49:52.287 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 325.84, Steps: 441, Distance 10.48, Angular velocity 0.0, Speed: 2.92, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 91.67, Angle accuracy 0.0, Num episodes 2304
2019-12-06 17:49:52.845 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 628
2019-12-06 17:49:52.845 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 430.84, Steps: 629, Distance 21.07, Angular velocity 0.0, Speed: 3.74, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.57, Angle accuracy 0.0, Num episodes 2305
2019-12-06 17:49:53.399 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 629
2019-12-06 17:49:53.399 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 431.7, Steps: 630, Distance 21.42, Angular velocity 0.0, Speed: 3.77, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.74, Angle accuracy 0.0, Num episodes 2306
2019-12-06 17:49:53.943 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 614
2019-12-06 17:49:53.943 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 424.68, Steps: 615, Distance 20.55, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.48, Angle accuracy 0.0, Num episodes 2307
Warning: trajectory cut off by epoch at 307 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 401 |
| AverageEpRet | 416 |
| StdEpRet | 41.2 |
| MaxEpRet | 453 |
| MinEpRet | 326 |
| EpLen | 616 |
| AverageVVals | 55.4 |
| StdVVals | 0 |
| MaxVVals | 55.4 |
| MinVVals | 55.4 |
| TotalEnvInteracts | 1.61e+06 |
| LossPi | 3.16e-09 |
| LossV | 443 |
| DeltaLossPi | -0.000686 |
| DeltaLossV | -1.96 |
| Entropy | -2.08 |
| KL | 0.000561 |
| ClipFrac | 0.0005 |
| StopIter | 1 |
| Time | 1.51e+03 |
---------------------------------------
2019-12-06 17:49:54.725 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 445
2019-12-06 17:49:54.726 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 339.75, Steps: 446, Distance 10.91, Angular velocity 0.0, Speed: 2.96, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 91.83, Angle accuracy 0.0, Num episodes 2308
2019-12-06 17:49:55.337 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 692
2019-12-06 17:49:55.337 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.97, Steps: 693, Distance 25.61, Angular velocity 0.0, Speed: 3.93, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.31, Angle accuracy 0.0, Num episodes 2309
2019-12-06 17:49:55.856 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 566
2019-12-06 17:49:55.856 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 413.82, Steps: 567, Distance 17.28, Angular velocity 0.0, Speed: 3.53, Max gforce: 0.05, Avg gforce: 0.04, Trip pct 94.63, Angle accuracy 0.0, Num episodes 2310
2019-12-06 17:49:56.382 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 589
2019-12-06 17:49:56.383 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.89, Steps: 590, Distance 19.09, Angular velocity 0.0, Speed: 3.67, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.3, Angle accuracy 0.0, Num episodes 2311
2019-12-06 17:49:56.965 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:49:56.966 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 447.06, Steps: 663, Distance 23.36, Angular velocity 0.0, Speed: 3.84, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.1, Angle accuracy 0.0, Num episodes 2312
2019-12-06 17:49:57.549 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 662
2019-12-06 17:49:57.549 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 438.41, Steps: 663, Distance 23.63, Angular velocity 0.0, Speed: 3.86, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 96.19, Angle accuracy 0.0, Num episodes 2313
Warning: trajectory cut off by epoch at 378 steps.
Early stopping at step 1 due to reaching max kl.
---------------------------------------
| Epoch | 402 |
| AverageEpRet | 415 |
| StdEpRet | 35.9 |
| MaxEpRet | 447 |
| MinEpRet | 340 |
| EpLen | 604 |
| AverageVVals | 56.8 |
| StdVVals | 3.81e-06 |
| MaxVVals | 56.8 |
| MinVVals | 56.8 |
| TotalEnvInteracts | 1.61e+06 |
| LossPi | 2.04e-08 |
| LossV | 441 |
| DeltaLossPi | 0.00244 |
| DeltaLossV | -2.22 |
| Entropy | -2.12 |
| KL | 0.0147 |
| ClipFrac | 0.157 |
| StopIter | 1 |
| Time | 1.51e+03 |
---------------------------------------
2019-12-06 17:49:58.408 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 501
2019-12-06 17:49:58.408 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 379.6, Steps: 502, Distance 13.74, Angular velocity 0.0, Speed: 3.24, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.44, Angle accuracy 0.0, Num episodes 2314
2019-12-06 17:49:59.083 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 761
2019-12-06 17:49:59.083 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 462.22, Steps: 762, Distance 29.63, Angular velocity 0.0, Speed: 3.99, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.74, Angle accuracy 0.0, Num episodes 2315
2019-12-06 17:49:59.592 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 564
2019-12-06 17:49:59.592 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 403.17, Steps: 565, Distance 17.29, Angular velocity 0.0, Speed: 3.51, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.64, Angle accuracy 0.0, Num episodes 2316
2019-12-06 17:50:00.189 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 666
2019-12-06 17:50:00.190 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 448.4, Steps: 667, Distance 23.43, Angular velocity 0.0, Speed: 3.81, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.04, Angle accuracy 0.0, Num episodes 2317
2019-12-06 17:50:00.655 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 500
2019-12-06 17:50:00.655 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 367.54, Steps: 501, Distance 13.6, Angular velocity 0.0, Speed: 3.22, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.32, Angle accuracy 0.0, Num episodes 2318
2019-12-06 17:50:01.415 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 766
2019-12-06 17:50:01.416 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 459.56, Steps: 767, Distance 30.01, Angular velocity 0.0, Speed: 3.98, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.96, Angle accuracy 0.0, Num episodes 2319
Warning: trajectory cut off by epoch at 236 steps.
---------------------------------------
| Epoch | 403 |
| AverageEpRet | 420 |
| StdEpRet | 38.3 |
| MaxEpRet | 462 |
| MinEpRet | 368 |
| EpLen | 627 |
| AverageVVals | 58.4 |
| StdVVals | 0 |
| MaxVVals | 58.4 |
| MinVVals | 58.4 |
| TotalEnvInteracts | 1.62e+06 |
| LossPi | -4.64e-08 |
| LossV | 500 |
| DeltaLossPi | -0.000524 |
| DeltaLossV | -4.36 |
| Entropy | -2.11 |
| KL | 0.00193 |
| ClipFrac | 0.0065 |
| StopIter | 79 |
| Time | 1.52e+03 |
---------------------------------------
2019-12-06 17:50:02.250 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 525
2019-12-06 17:50:02.250 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 388.64, Steps: 526, Distance 15.16, Angular velocity 0.0, Speed: 3.37, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.09, Angle accuracy 0.0, Num episodes 2320
2019-12-06 17:50:02.679 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 486
2019-12-06 17:50:02.679 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 357.19, Steps: 487, Distance 12.88, Angular velocity 0.0, Speed: 3.17, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 92.92, Angle accuracy 0.0, Num episodes 2321
2019-12-06 17:50:02.914 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 260
2019-12-06 17:50:02.914 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 193.22, Steps: 261, Distance 3.63, Angular velocity 0.0, Speed: 1.66, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 78.63, Angle accuracy 0.0, Num episodes 2322
2019-12-06 17:50:03.473 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 631
2019-12-06 17:50:03.473 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 436.98, Steps: 632, Distance 21.18, Angular velocity 0.0, Speed: 3.73, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.61, Angle accuracy 0.0, Num episodes 2323
2019-12-06 17:50:04.123 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 730
2019-12-06 17:50:04.123 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 458.47, Steps: 731, Distance 27.48, Angular velocity 0.0, Speed: 3.94, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 96.51, Angle accuracy 0.0, Num episodes 2324
2019-12-06 17:50:04.667 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 602
2019-12-06 17:50:04.667 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 416.62, Steps: 603, Distance 19.56, Angular velocity 0.0, Speed: 3.65, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 95.17, Angle accuracy 0.0, Num episodes 2325
2019-12-06 17:50:05.191 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 588
2019-12-06 17:50:05.191 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 415.54, Steps: 589, Distance 18.67, Angular velocity 0.0, Speed: 3.59, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.92, Angle accuracy 0.0, Num episodes 2326
Warning: trajectory cut off by epoch at 171 steps.
---------------------------------------
| Epoch | 404 |
| AverageEpRet | 381 |
| StdEpRet | 82.4 |
| MaxEpRet | 458 |
| MinEpRet | 193 |
| EpLen | 547 |
| AverageVVals | 56.2 |
| StdVVals | 1.14e-05 |
| MaxVVals | 56.2 |
| MinVVals | 56.2 |
| TotalEnvInteracts | 1.62e+06 |
| LossPi | -3.75e-08 |
| LossV | 440 |
| DeltaLossPi | -0.00228 |
| DeltaLossV | -1.21 |
| Entropy | -2.08 |
| KL | 0.00723 |
| ClipFrac | 0.0712 |
| StopIter | 79 |
| Time | 1.52e+03 |
---------------------------------------
2019-12-06 17:50:05.981 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 551
2019-12-06 17:50:05.981 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 406.33, Steps: 552, Distance 16.45, Angular velocity 0.0, Speed: 3.45, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 94.54, Angle accuracy 0.0, Num episodes 2327
2019-12-06 17:50:06.690 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 788
2019-12-06 17:50:06.691 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 474.95, Steps: 789, Distance 31.3, Angular velocity 0.0, Speed: 4.04, Max gforce: 0.06, Avg gforce: 0.03, Trip pct 97.09, Angle accuracy 0.0, Num episodes 2328
2019-12-06 17:50:07.139 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - Reached destination! Steps: 501
2019-12-06 17:50:07.140 | DEBUG | deepdrive_2d.envs.env:_step:477 - Episode score 368.53, Steps: 502, Distance 13.7, Angular velocity 0.0, Speed: 3.2, Max gforce: 0.06, Avg gforce: 0.04, Trip pct 93.53, Angle accuracy 0.0, Num episodes 2329
2019-12-06 17:50:07.616 | SUCCESS | deepdrive_2d.envs.env:get_done:560 - R
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment