Skip to content

Instantly share code, notes, and snippets.

@tomoaki0705
Last active April 30, 2020 04:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tomoaki0705/e6837523928327f150ccbe6a987c083b to your computer and use it in GitHub Desktop.
Save tomoaki0705/e6837523928327f150ccbe6a987c083b to your computer and use it in GitHub Desktop.
opencv_test_cudabgsegm stucked
Started by upstream project "OpenCV-matrix-test-cuda" build number 65
originally caused by:
Started by upstream project "OpenCV-trigger" build number 709
originally caused by:
Started by an SCM change
Running as SYSTEM
Building remotely on arm-jetson-tx2 (arm) in workspace /home/nvidia/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is used...
[WS-CLEANUP] Done
[arm-jetson-tx2] $ /bin/bash /tmp/jenkins3516302711894150601.sh
declare -x OPENCV_MAJOR_VERSION="3"
declare -x AZURE_KINECT_SENSOR_SDK_DIR="/media/nvidia/ECC1-42B0/AzureKinectSDK"
declare -x BUILD_DIR="build"
declare -x BUILD_DISPLAY_NAME="#65"
declare -x BUILD_ID="65"
declare -x BUILD_NUMBER="65"
declare -x BUILD_TAG="jenkins-OpenCV-matrix-test-cuda-POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2-65"
declare -x BUILD_URL="http://localhost:8080/job/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2/65/"
declare -x CMAKE_BUILD_OPTION="-DWITH_CUDA=ON"
declare -x CONTRIB_BRANCH="b31e55b6b5268fdafe7e6d79a911ead6d86c647a"
declare -x EXECUTOR_NUMBER="0"
declare -x EXTRA_BRANCH="859c140e8b8c15ebdc5819c646b870e29df9fa5f"
declare -x GTEST_FILTER="-videoio_dynamic.basic_write:videoio/Videoio_Synthetic.write_read_position*:videoio/Videoio_Writer.write_nothing*:videoio/videoio_synthetic.write_read_position/8:videoio/videoio_synthetic.write_read_position/11:videoio/videoio_synthetic.write_read_position/22:videoio/videoio_synthetic.write_read_position/25:CUDA_OptFlow/NvidiaOpticalFlow_1_0*:Objdetect_QRCode_Close.regression/4:Tracking/DistanceAndOverlap*"
declare -x HOME="/home/nvidia"
declare -x HUDSON_COOKIE="032a2458-a0b7-4bf6-bec1-f07ea5272b00"
declare -x HUDSON_HOME="/var/jenkins_home"
declare -x HUDSON_SERVER_COOKIE="526db567cf4039fb"
declare -x HUDSON_URL="http://localhost:8080/"
declare -x JENKINS_HOME="/var/jenkins_home"
declare -x JENKINS_SERVER_COOKIE="526db567cf4039fb"
declare -x JENKINS_URL="http://localhost:8080/"
declare -x JOB_BASE_NAME="POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2"
declare -x JOB_DISPLAY_URL="http://localhost:8080/job/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2/display/redirect"
declare -x JOB_NAME="OpenCV-matrix-test-cuda/POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2"
declare -x JOB_URL="http://localhost:8080/job/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2/"
declare -x LANG="en_US.UTF-8"
declare -x LOGNAME="nvidia"
declare -x MAIL="/var/mail/nvidia"
declare -x NODE_LABELS="arm arm-jetson-tx2"
declare -x NODE_NAME="arm-jetson-tx2"
declare -x OLDPWD
declare -x OPENCV_CONTRIB_PATH="/media/nvidia/ECC1-42B0/opencv_contrib"
declare -x OPENCV_MAJOR_VERSION="3"
declare -x OPENCV_SOURCE_PATH="/home/nvidia/opencv-fork"
declare -x OPENCV_TEST_DATA_PATH="/media/nvidia/ECC1-42B0/opencv_extra/testdata"
declare -x PARALLEL_BUILD="-j 3"
declare -x PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
declare -x POSSIBLE_BRANCH="3"
declare -x PWD="/home/nvidia/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2"
declare -x RUN_CHANGES_DISPLAY_URL="http://localhost:8080/job/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2/65/display/redirect?page=changes"
declare -x RUN_DISPLAY_URL="http://localhost:8080/job/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH=3,TARGET_JOB=opencv_test_cudabgsegm,TARGET_NODE=arm-jetson-tx2/65/display/redirect"
declare -x SHELL="/bin/bash"
declare -x SHLVL="2"
declare -x SSH_CLIENT="18.221.138.127 33466 22"
declare -x SSH_CONNECTION="18.221.138.127 33466 192.168.1.104 22"
declare -x TARGET_BRANCH="0b439bcd085ea4f2bcc494ae74c9c53e8d2bbb75"
declare -x TARGET_JOB="opencv_test_cudabgsegm"
declare -x TARGET_NODE="arm-jetson-tx2"
declare -x USER="nvidia"
declare -x WORKSPACE="/home/nvidia/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2"
declare -x XDG_RUNTIME_DIR="/run/user/1001"
declare -x XDG_SESSION_ID="97"
========== fetch and checkout ==========
/media/nvidia/ECC1-42B0/opencv_extra/testdata ~/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2
HEAD is now at 859c140 Merge pull request #751 from dkurt:dnn_tf_prelu
Fetching origin
Fetching upstream
fatal: A branch named '65' already exists.
fatal: branch name required
HEAD is now at 859c140 Merge pull request #751 from dkurt:dnn_tf_prelu
~/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2
========== run test opencv_test_cudabgsegm ==========
~/opencv-fork/build ~/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2
time ./bin/opencv_test_cudabgsegm --gtest_output=xml:/home/nvidia/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2/arm-jetson-tx2-opencv_test_cudabgsegm.xml
Available options besides google test option:
Usage: opencv_test_cudabgsegm [params]
--cuda_device (value:-1)
CUDA device on which tests will be executed (-1 means all devices)
-h, --help (value:false)
Print help info
Run tests on all supported CUDA devices
[----------]
[ GPU INFO ] Run on OS Linux x64.
[----------]
*** CUDA Device Query (Runtime API) version (CUDART static linking) ***
Device count: 1
Device 0: "GP10B"
CUDA Driver Version / Runtime Version 8.50 / 8.0
CUDA Capability Major/Minor version number: 6.2
Total amount of global memory: 7854 MBytes (8235577344 bytes)
GPU Clock Speed: 1.30 GHz
Max Texture Dimension Size (x,y,z) 1D=(131072), 2D=(131072,65536), 3D=(16384,16384,16384)
Max Layered Texture Size (dim) x layers 1D=(32768) x 2048, 2D=(32768,32768) x 2048
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 49152 bytes
Total number of registers available per block: 32768
Warp size: 32
Maximum number of threads per block: 1024
Maximum sizes of each dimension of a block: 1024 x 1024 x 64
Maximum sizes of each dimension of a grid: 2147483647 x 65535 x 65535
Maximum memory pitch: 2147483647 bytes
Texture alignment: 512 bytes
Concurrent copy and execution: Yes with 1 copy engine(s)
Run time limit on kernels: No
Integrated GPU sharing Host Memory: Yes
Support host page-locked memory mapping: Yes
Concurrent kernel execution: Yes
Alignment requirement for Surfaces: Yes
Device has ECC support enabled: No
Device is using TCC driver mode: No
Device supports Unified Addressing (UVA): Yes
Device PCI Bus ID / PCI location ID: 0 / 0
Compute Mode:
Default (multiple host threads can use ::cudaSetDevice() with device simultaneously)
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 8.50, CUDA Runtime Version = 8.0, NumDevs = 1
CTEST_FULL_OUTPUT
OpenCV version: 3.4.10-dev
OpenCV VCS version: 3.4.10-140-g0b439bc
Build type: Release
Compiler: /usr/bin/c++ (ver 5.4.0)
Parallel framework: pthreads (nthreads=6)
CPU features: NEON? FP16?
OpenCL is disabled
TEST: Skip tests with tags: 'mem_6gb', 'verylong'
Note: Google Test filter = -videoio_dynamic.basic_write:videoio/Videoio_Synthetic.write_read_position*:videoio/Videoio_Writer.write_nothing*:videoio/videoio_synthetic.write_read_position/8:videoio/videoio_synthetic.write_read_position/11:videoio/videoio_synthetic.write_read_position/22:videoio/videoio_synthetic.write_read_position/25:CUDA_OptFlow/NvidiaOpticalFlow_1_0*:Objdetect_QRCode_Close.regression/4:Tracking/DistanceAndOverlap*
[==========] Running 16 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 16 tests from CUDA_BgSegm/MOG2
[ RUN ] CUDA_BgSegm/MOG2.Update/0, where GetParam() = (GP10B, "768x576.avi", UseGray(true), DetectShadow(true), whole matrix)
Inside NvxLiteH264DecoderLowLatencyInitNvxLiteH264DecoderLowLatencyInit set DPB and MjstreamingInside NvxLiteH265DecoderLowLatencyInitNvxLiteH265DecoderLowLatencyInit set DPB and MjstreamingNvMMLiteOpen : Block : BlockType = 261
TVMR: NvMMLiteTVMRDecBlockOpen: 7818: NvMMLiteBlockOpen
NvMMLiteBlockCreate : Block : BlockType = 261
/tmp/jenkins3516302711894150601.sh: line 19: 8350 Killed ./bin/${TARGET_JOB} ${GTEST_TEST_OPTION} --gtest_output=xml:${WORKSPACE}/${TARGET_NODE}-${TARGET_JOB}.xml
real 168m7.766s
user 0m0.156s
sys 0m0.108s
~/workspace/OpenCV-matrix-test-cuda/POSSIBLE_BRANCH/3/TARGET_JOB/opencv_test_cudabgsegm/TARGET_NODE/arm-jetson-tx2
Triggering projects: OpenCV-log-matrix
Archiving artifacts
Recording test results
Started calculate disk usage of build
Finished Calculation of disk usage of build in 0 seconds
Started calculate disk usage of workspace
Finished Calculation of disk usage of workspace in 0 seconds
Finished: SUCCESS

abstract situation

  • Test stops in the middle
$ time ./bin/opencv_test_cudabgsegm --gtest_repeat=1000 --gtest_output=xml:/home/nvidia/workspace/OpenCV-test/arm-jetson-tx2-opencv_test_cudabgsegm.xml
:
Repeating all tests (iteration 468) . . .

Note: Google Test filter = -videoio_dynamic.basic_write:videoio/Videoio_Synthetic.write_read_position*:videoio/Videoio_Writer.write_nothing*:videoio/videoio_synthetic.write_read_position/8:videoio/videoio_synthetic.write_read_position/11:videoio/videoio_synthetic.write_read_position/22:videoio/videoio_synthetic.write_read_position/25:CUDA_OptFlow/NvidiaOpticalFlow_1_0*:Objdetect_QRCode_Close.regression/4:Tracking/DistanceAndOverlap*
[==========] Running 16 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 16 tests from CUDA_BgSegm/MOG2
:
[       OK ] CUDA_BgSegm/MOG2.Update/4 (954 ms)
[ RUN      ] CUDA_BgSegm/MOG2.Update/5, where GetParam() = (GP10B, "768x576.avi", UseGray(false), DetectShadow(true), sub matrix)
Inside NvxLiteH264DecoderLowLatencyInitNvxLiteH264DecoderLowLatencyInit set DPB and MjstreamingInside NvxLiteH265DecoderLowLatencyInitNvxLiteH265DecoderLowLatencyInit set DPB and MjstreamingNvMMLiteOpen : Block : BlockType = 261 
TVMR: NvMMLiteTVMRDecBlockOpen: 7818: NvMMLiteBlockOpen 
NvMMLiteBlockCreate : Block : BlockType = 261 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment