(partial) EasyBuild log for failed build of /home/s3248973/git/easybuild-easyconfigs/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.5.0-fosscuda-2020b.eb (easyblock PR(s) #2583)

TensorFlow-2.5.0-fosscuda-2020b_partial.log

//tensorflow/python/kernel_tests:fractional_avg_pool_op_test             PASSED in 7.3s
  Stats over 5 runs: max = 7.3s, min = 4.0s, avg = 4.8s, dev = 1.3s
//tensorflow/python/kernel_tests:fractional_max_pool_op_test             PASSED in 7.3s
  Stats over 5 runs: max = 7.3s, min = 4.0s, avg = 4.9s, dev = 1.2s
//tensorflow/python/data/experimental/kernel_tests:csv_dataset_test      PASSED in 11.2s
  Stats over 8 runs: max = 11.2s, min = 3.4s, avg = 6.5s, dev = 2.6s
//tensorflow/python/data/experimental/kernel_tests:parallel_interleave_test PASSED in 12.4s
  Stats over 8 runs: max = 12.4s, min = 7.1s, avg = 8.3s, dev = 1.6s
//tensorflow/python/data/kernel_tests:flat_map_test                      PASSED in 12.3s
  Stats over 8 runs: max = 12.3s, min = 2.8s, avg = 5.8s, dev = 3.4s
//tensorflow/python/data/kernel_tests:tf_record_dataset_test             PASSED in 14.0s
  Stats over 8 runs: max = 14.0s, min = 2.7s, avg = 5.8s, dev = 3.8s
//tensorflow/python/data/experimental/kernel_tests:data_service_ops_ft_test PASSED in 22.9s
  Stats over 10 runs: max = 22.9s, min = 4.9s, avg = 10.5s, dev = 5.2s
//tensorflow/python/kernel_tests:inplace_ops_test                        PASSED in 5.3s
  Stats over 10 runs: max = 5.3s, min = 4.5s, avg = 4.9s, dev = 0.2s
//tensorflow/python/data/experimental/kernel_tests:data_service_ops_test PASSED in 25.6s
  Stats over 16 runs: max = 25.6s, min = 4.0s, avg = 10.3s, dev = 5.7s
//tensorflow/python/data/experimental/kernel_tests:snapshot_test         PASSED in 14.4s
  Stats over 16 runs: max = 14.4s, min = 3.4s, avg = 7.7s, dev = 3.0s
//tensorflow/python/data/kernel_tests:map_test                           PASSED in 19.6s
  Stats over 16 runs: max = 19.6s, min = 4.8s, avg = 8.9s, dev = 4.1s

Executed 905 out of 905 tests: 904 tests pass and 1 fails locally.
There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
INFO: Build completed, 1 test FAILED, 14124 total actions

== 2021-09-24 18:14:51,689 tensorflow.py:989 WARNING Test //tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test failed with output
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test
-----------------------------------------------------------------------------
2021-09-24 16:08:57.435619: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcudart.so.11.0
Running main() from test_main.cc
[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from Test/FusedBatchNormOpTest/0, where TypeParam = float
[ RUN      ] Test/FusedBatchNormOpTest/0.Training
2021-09-24 16:08:57.471295: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcuda.so.1
2021-09-24 16:08:57.667258: E tensorflow/stream_executor/cuda/cuda_driver.cc:328] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
2021-09-24 16:08:57.667335: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:169] retrieving CUDA diagnostic information for host: taurusi8029
2021-09-24 16:08:57.667345: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:176] hostname: taurusi8029
2021-09-24 16:08:57.667435: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:200] libcuda reported version is: 460.32.3
2021-09-24 16:08:57.667493: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:204] kernel reported version is: 460.32.3
2021-09-24 16:08:57.667501: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:310] kernel version seems to match DSO: 460.32.3
2021-09-24 16:08:57.677398: I tensorflow/core/platform/profile_utils/cpu_utils.cc:114] CPU Frequency: 2300040000 Hz
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.26879921555519104 not close to 0)
Expected: true
i = 0 Tx[i] = -0.26879921555519104 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.44938200712203979 not close to 0)
Expected: true
i = 1 Tx[i] = -0.44938200712203979 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.78158426284790039 not close to 0)
Expected: true
i = 2 Tx[i] = -0.78158426284790039 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.67501527070999146 not close to 0)
Expected: true
i = 3 Tx[i] = -0.67501527070999146 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.41874641180038452 not close to 0)
Expected: true
i = 4 Tx[i] = -0.41874641180038452 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.61498409509658813 not close to 0)
Expected: true
i = 5 Tx[i] = -0.61498409509658813 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.626478910446167 not close to 0)
Expected: true
i = 6 Tx[i] = 1.626478910446167 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.52200073003768921 not close to 0)
Expected: true
i = 7 Tx[i] = -0.52200073003768921 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.60727185010910034 not close to 0)
Expected: true
i = 8 Tx[i] = 0.60727185010910034 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.3281968832015991 not close to 0)
Expected: true
i = 9 Tx[i] = 1.3281968832015991 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:181: Failure
Expected: (num_failures) < (max_failures), actual: 10 vs 10
Too many mismatches (atol = 1.0000000000000001e-05 rtol = -1), giving up.
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.015027559362351894 not close to nan)
Expected: true
i = 0 Tx[i] = -0.015027559362351894 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.11818549782037735 not close to nan)
Expected: true
i = 1 Tx[i] = -0.11818549782037735 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.12787923216819763 not close to nan)
Expected: true
i = 2 Tx[i] = 0.12787923216819763 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:185: Failure
Expected equality of these values:
  num_failures
    Which is: 3
  0
Mismatches detected (atol = 1.0000000000000001e-05 rtol = -1).
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.8836284875869751 not close to nan)
Expected: true
i = 0 Tx[i] = 0.8836284875869751 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.92319661378860474 not close to nan)
Expected: true
i = 1 Tx[i] = 0.92319661378860474 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.89064711332321167 not close to nan)
Expected: true
i = 2 Tx[i] = 0.89064711332321167 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:185: Failure
Expected equality of these values:
  num_failures
    Which is: 3
  0
Mismatches detected (atol = 1.0000000000000001e-05 rtol = -1).
[  FAILED  ] Test/FusedBatchNormOpTest/0.Training, where TypeParam = float (234 ms)
[ RUN      ] Test/FusedBatchNormOpTest/0.TrainingRunningMean
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.32682904601097107 not close to 1.7864828849767833e+25)
Expected: true
i = 0 Tx[i] = 0.32682904601097107 Ty[i] = 1.7864828849767833e+25
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.65119826793670654 not close to 6.780480066304051e-10)
Expected: true
i = 1 Tx[i] = -0.65119826793670654 Ty[i] = 6.780480066304051e-10
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.6645539402961731 not close to 1.7862293646362274e+31)
Expected: true
i = 2 Tx[i] = 0.6645539402961731 Ty[i] = 1.7862293646362274e+31
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.4230023622512817 not close to 1.6027860982870124e-10)
Expected: true
i = 3 Tx[i] = 1.4230023622512817 Ty[i] = 1.6027860982870124e-10
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-1.5054200887680054 not close to 1.8617159707148499e+25)
Expected: true
i = 4 Tx[i] = -1.5054200887680054 Ty[i] = 1.8617159707148499e+25
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.63918495178222656 not close to 186.39604187011719)
Expected: true
i = 5 Tx[i] = 0.63918495178222656 Ty[i] = 186.39604187011719
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.89869266748428345 not close to 6.7787642166194928e-10)
Expected: true
i = 6 Tx[i] = 0.89869266748428345 Ty[i] = 6.7787642166194928e-10
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-1.769249439239502 not close to -0.7992706298828125)
Expected: true
i = 7 Tx[i] = -1.769249439239502 Ty[i] = -0.7992706298828125
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.75287562608718872 not close to 1.7936620343357659e-43)
Expected: true
i = 8 Tx[i] = 0.75287562608718872 Ty[i] = 1.7936620343357659e-43
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.94379341602325439 not close to 0)
Expected: true
i = 9 Tx[i] = 0.94379341602325439 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:181: Failure
Expected: (num_failures) < (max_failures), actual: 10 vs 10
Too many mismatches (atol = 1.0000000000000001e-05 rtol = -1), giving up.
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.59438002109527588 not close to nan)
Expected: true
i = 0 Tx[i] = -0.59438002109527588 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.18171288073062897 not close to nan)
Expected: true
i = 1 Tx[i] = 0.18171288073062897 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.47364544868469238 not close to nan)
Expected: true
i = 2 Tx[i] = -0.47364544868469238 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:185: Failure
Expected equality of these values:
  num_failures
    Which is: 3
  0
Mismatches detected (atol = 1.0000000000000001e-05 rtol = -1).
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.71399110555648804 not close to nan)
Expected: true
i = 0 Tx[i] = 0.71399110555648804 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.72196155786514282 not close to nan)
Expected: true
i = 1 Tx[i] = 0.72196155786514282 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.7783057689666748 not close to nan)
Expected: true
i = 2 Tx[i] = 0.7783057689666748 Ty[i] = nan
tensorflow/core/framework/tensor_testutil.cc:185: Failure
Expected equality of these values:
  num_failures
    Which is: 3
  0
Mismatches detected (atol = 1.0000000000000001e-05 rtol = -1).
[  FAILED  ] Test/FusedBatchNormOpTest/0.TrainingRunningMean, where TypeParam = float (3 ms)
[ RUN      ] Test/FusedBatchNormOpTest/0.Inference
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-3.8458380699157715 not close to -8.0760349957858682e+20)
Expected: true
i = 0 Tx[i] = -3.8458380699157715 Ty[i] = -8.0760349957858682e+20
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.48413115739822388 not close to 1.5649701249579557e-41)
Expected: true
i = 1 Tx[i] = 0.48413115739822388 Ty[i] = 1.5649701249579557e-41
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (2.4452359676361084 not close to 0)
Expected: true
i = 2 Tx[i] = 2.4452359676361084 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.26827806234359741 not close to 0)
Expected: true
i = 3 Tx[i] = 0.26827806234359741 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.54920846223831177 not close to 1.1210387714598537e-43)
Expected: true
i = 4 Tx[i] = 0.54920846223831177 Ty[i] = 1.1210387714598537e-43
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (2.8357117176055908 not close to 0)
Expected: true
i = 5 Tx[i] = 2.8357117176055908 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (4.6628727912902832 not close to 1.1210387714598537e-43)
Expected: true
i = 6 Tx[i] = 4.6628727912902832 Ty[i] = 1.1210387714598537e-43
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.46257162094116211 not close to 0)
Expected: true
i = 7 Tx[i] = 0.46257162094116211 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.8880641460418701 not close to 1.3174106526534443e+38)
Expected: true
i = 8 Tx[i] = 1.8880641460418701 Ty[i] = 1.3174106526534443e+38
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.59705108404159546 not close to 3.0967294763114132e-41)
Expected: true
i = 9 Tx[i] = 0.59705108404159546 Ty[i] = 3.0967294763114132e-41
tensorflow/core/framework/tensor_testutil.cc:181: Failure
Expected: (num_failures) < (max_failures), actual: 10 vs 10
Too many mismatches (atol = 1.0000000000000001e-05 rtol = -1), giving up.
[  FAILED  ] Test/FusedBatchNormOpTest/0.Inference, where TypeParam = float (4 ms)
[ RUN      ] Test/FusedBatchNormOpTest/0.InferenceIgnoreAvgFactor
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-2.1502783298492432 not close to 0)
Expected: true
i = 0 Tx[i] = -2.1502783298492432 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.021960465237498283 not close to 0)
Expected: true
i = 1 Tx[i] = 0.021960465237498283 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.1988043785095215 not close to 0)
Expected: true
i = 2 Tx[i] = 1.1988043785095215 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.625554084777832 not close to 0)
Expected: true
i = 3 Tx[i] = 1.625554084777832 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.9697669744491577 not close to 1.3138084967078357e+38)
Expected: true
i = 4 Tx[i] = 1.9697669744491577 Ty[i] = 1.3138084967078357e+38
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (2.9358034133911133 not close to 3.0967294763114132e-41)
Expected: true
i = 5 Tx[i] = 2.9358034133911133 Ty[i] = 3.0967294763114132e-41
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.8170662522315979 not close to 0)
Expected: true
i = 6 Tx[i] = 0.8170662522315979 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-3.1544866561889648 not close to 0)
Expected: true
i = 7 Tx[i] = -3.1544866561889648 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.50782668590545654 not close to 0)
Expected: true
i = 8 Tx[i] = 0.50782668590545654 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (2.454193115234375 not close to 0)
Expected: true
i = 9 Tx[i] = 2.454193115234375 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:181: Failure
Expected: (num_failures) < (max_failures), actual: 10 vs 10
Too many mismatches (atol = 1.0000000000000001e-05 rtol = -1), giving up.
[  FAILED  ] Test/FusedBatchNormOpTest/0.InferenceIgnoreAvgFactor, where TypeParam = float (4 ms)
[ RUN      ] Test/FusedBatchNormOpTest/0.FusedBatchNormGradV3
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (3.30379319190979 not close to 0)
Expected: true
i = 0 Tx[i] = 3.30379319190979 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.51638245582580566 not close to 0)
Expected: true
i = 1 Tx[i] = -0.51638245582580566 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.048945166170597076 not close to 4.7994472403124985e-42)
Expected: true
i = 2 Tx[i] = 0.048945166170597076 Ty[i] = 4.7994472403124985e-42
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.32340025901794434 not close to 0)
Expected: true
i = 3 Tx[i] = -0.32340025901794434 Ty[i] = 0
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (2.05000901222229 not close to -9.7223549883090933e+26)
Expected: true
i = 4 Tx[i] = 2.05000901222229 Ty[i] = -9.7223549883090933e+26
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.12816695868968964 not close to 1.5649701249579557e-41)
Expected: true
i = 5 Tx[i] = 0.12816695868968964 Ty[i] = 1.5649701249579557e-41
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.37350505590438843 not close to -9.7223549883090933e+26)
Expected: true
i = 6 Tx[i] = -0.37350505590438843 Ty[i] = -9.7223549883090933e+26
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-0.47942405939102173 not close to 1.5649701249579557e-41)
Expected: true
i = 7 Tx[i] = -0.47942405939102173 Ty[i] = 1.5649701249579557e-41
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.02247980423271656 not close to 1.166793478936727e+38)
Expected: true
i = 8 Tx[i] = 0.02247980423271656 Ty[i] = 1.166793478936727e+38
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (0.48951709270477295 not close to 3.0967294763114132e-41)
Expected: true
i = 9 Tx[i] = 0.48951709270477295 Ty[i] = 3.0967294763114132e-41
tensorflow/core/framework/tensor_testutil.cc:181: Failure
Expected: (num_failures) < (max_failures), actual: 10 vs 10
Too many mismatches (atol = 1.0000000000000001e-05 rtol = -1), giving up.
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (82.969367980957031 not close to inf)
Expected: true
i = 0 Tx[i] = 82.969367980957031 Ty[i] = inf
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-56.701950073242188 not close to -1.3148632336088219e+29)
Expected: true
i = 1 Tx[i] = -56.701950073242188 Ty[i] = -1.3148632336088219e+29
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (29.785825729370117 not close to inf)
Expected: true
i = 2 Tx[i] = 29.785825729370117 Ty[i] = inf
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-11.944074630737305 not close to -0.07775849848985672)
Expected: true
i = 3 Tx[i] = -11.944074630737305 Ty[i] = -0.07775849848985672
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-13.482235908508301 not close to inf)
Expected: true
i = 4 Tx[i] = -13.482235908508301 Ty[i] = inf
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-4.6373858451843262 not close to -nan)
Expected: true
i = 5 Tx[i] = -4.6373858451843262 Ty[i] = -nan
tensorflow/core/framework/tensor_testutil.cc:185: Failure
Expected equality of these values:
  num_failures
    Which is: 6
  0
Mismatches detected (atol = 1.0000000000000001e-05 rtol = -1).
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (7.5062808990478516 not close to inf)
Expected: true
i = 0 Tx[i] = 7.5062808990478516 Ty[i] = inf
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-15.827049255371094 not close to 1.8523600588218255e+28)
Expected: true
i = 1 Tx[i] = -15.827049255371094 Ty[i] = 1.8523600588218255e+28
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-12.275802612304688 not close to inf)
Expected: true
i = 2 Tx[i] = -12.275802612304688 Ty[i] = inf
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (1.0248597860336304 not close to 0.58792519569396973)
Expected: true
i = 3 Tx[i] = 1.0248597860336304 Ty[i] = 0.58792519569396973
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (-19.956357955932617 not close to inf)
Expected: true
i = 4 Tx[i] = -19.956357955932617 Ty[i] = inf
tensorflow/core/framework/tensor_testutil.cc:178: Failure
Value of: IsClose(Tx[i], Ty[i], typed_atol, typed_rtol)
  Actual: false (6.0104160308837891 not close to -nan)
Expected: true
i = 5 Tx[i] = 6.0104160308837891 Ty[i] = -nan
tensorflow/core/framework/tensor_testutil.cc:185: Failure
Expected equality of these values:
  num_failures
    Which is: 6
  0
Mismatches detected (atol = 1.0000000000000001e-05 rtol = -1).
[  FAILED  ] Test/FusedBatchNormOpTest/0.FusedBatchNormGradV3, where TypeParam = float (35 ms)
[----------] 5 tests from Test/FusedBatchNormOpTest/0 (280 ms total)

[----------] Global test environment tear-down
[==========] 5 tests from 1 test suite ran. (280 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 5 tests, listed below:
[  FAILED  ] Test/FusedBatchNormOpTest/0.Training, where TypeParam = float
[  FAILED  ] Test/FusedBatchNormOpTest/0.TrainingRunningMean, where TypeParam = float
[  FAILED  ] Test/FusedBatchNormOpTest/0.Inference, where TypeParam = float
[  FAILED  ] Test/FusedBatchNormOpTest/0.InferenceIgnoreAvgFactor, where TypeParam = float
[  FAILED  ] Test/FusedBatchNormOpTest/0.FusedBatchNormGradV3, where TypeParam = float

 5 FAILED TESTS

== 2021-09-24 18:14:52,497 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): At least 1 cpu tests failed:
//tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test (at easybuild/framework/easyblock.py:1861 in report_test_failure)
== 2021-09-24 18:14:52,497 build_log.py:265 INFO 	... (took 46 mins 30 secs)
== 2021-09-24 18:14:52,498 build_log.py:265 INFO ... (took 49 mins 53 secs)
== 2021-09-24 18:14:52,498 filetools.py:1884 INFO Removing lock /tmp/software/.locks/_tmp_software_TensorFlow_2.5.0-fosscuda-2020b.lock...
== 2021-09-24 18:14:52,498 filetools.py:359 INFO Path /tmp/software/.locks/_tmp_software_TensorFlow_2.5.0-fosscuda-2020b.lock successfully removed.
== 2021-09-24 18:14:52,498 filetools.py:1888 INFO Lock removed: /tmp/software/.locks/_tmp_software_TensorFlow_2.5.0-fosscuda-2020b.lock
== 2021-09-24 18:14:52,499 easyblock.py:3753 WARNING build failed (first 300 chars): At least 1 cpu tests failed:
//tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test
== 2021-09-24 18:14:52,499 easyblock.py:304 INFO Closing log for application name TensorFlow version 2.5.0