-
-
Save sd12832/0b1cfd402af3406cdb55b47d6a94f23b to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2021-05-11 08:22:37.996095: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
/usr/local/lib/python3.8/dist-packages/tensorflow_addons/utils/ensure_tf_install.py:54: UserWarning: Tensorflow Addons supports using Python ops for all Tensorflow versions above or e | |
qual to 2.2.0 and strictly below 2.4.0 (nightly versions are not supported). | |
The versions of TensorFlow you are currently using is 2.4.0 and is not supported. | |
Some things might work, some things might not. | |
If you were to encounter a bug, do not file an issue. | |
If you want to make sure you're using a tested and supported configuration, either change the TensorFlow version or the TensorFlow Addons's version. | |
You can find the compatibility matrix in TensorFlow Addon's readme: | |
https://github.com/tensorflow/addons | |
warnings.warn( | |
I0511 08:22:39.491033 140615476569920 export_model.py:111] SAVED MODEL DIR IS ['xxxx', '/trainer/models', '/trainer/models/200713_105933_Inception_V | |
3_TF2_Test2_0k', '/trainer/models/xxxx/1', '/trainer/models/xxxx/1/model.savedmodel'] | |
2021-05-11 08:22:39.712186: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set | |
2021-05-11 08:22:39.712948: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1 | |
2021-05-11 08:22:40.110389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Found device 0 with properties: | |
pciBusID: 0000:17:00.0 name: GeForce GTX 1080 Ti computeCapability: 6.1 | |
coreClock: 1.607GHz coreCount: 28 deviceMemorySize: 10.92GiB deviceMemoryBandwidth: 451.17GiB/s | |
2021-05-11 08:22:40.110457: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
2021-05-11 08:22:40.115320: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 | |
2021-05-11 08:22:40.115402: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 | |
2021-05-11 08:22:40.116674: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 | |
2021-05-11 08:22:40.117048: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 | |
2021-05-11 08:22:40.118257: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.11 | |
2021-05-11 08:22:40.119287: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 | |
2021-05-11 08:22:40.119519: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 | |
2021-05-11 08:22:40.121498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1888] Adding visible gpu devices: 0 | |
2021-05-11 08:22:40.123598: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set | |
2021-05-11 08:22:40.125716: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Found device 0 with properties: | |
pciBusID: 0000:17:00.0 name: GeForce GTX 1080 Ti computeCapability: 6.1 | |
coreClock: 1.607GHz coreCount: 28 deviceMemorySize: 10.92GiB deviceMemoryBandwidth: 451.17GiB/s | |
2021-05-11 08:22:40.125785: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
2021-05-11 08:22:40.125849: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 | |
2021-05-11 08:22:40.125899: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 | |
2021-05-11 08:22:40.125946: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 | |
2021-05-11 08:22:40.125992: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 | |
2021-05-11 08:22:40.126038: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.11 | |
2021-05-11 08:22:40.126084: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 | |
2021-05-11 08:22:40.126133: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 | |
2021-05-11 08:22:40.129856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1888] Adding visible gpu devices: 0 | |
2021-05-11 08:22:40.129948: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
2021-05-11 08:22:40.537000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1287] Device interconnect StreamExecutor with strength 1 edge matrix: | |
2021-05-11 08:22:40.537059: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1293] 0 | |
2021-05-11 08:22:40.537070: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1306] 0: N | |
2021-05-11 08:22:40.538846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1432] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10408 MB memory) -> p | |
hysical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:17:00.0, compute capability: 6.1) | |
# Truncated description about the nodes from the model | |
WARNING:tensorflow:From /usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/signature_def_utils_impl.py:200: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info. | |
W0511 08:24:33.929990 140645538408256 deprecation.py:333] From /usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/signature_def_utils_impl.py:200: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version. | |
Instructions for updating: | |
This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info. | |
INFO:tensorflow:No assets to save. | |
I0511 08:24:33.930645 140645538408256 builder_impl.py:641] No assets to save. | |
INFO:tensorflow:No assets to write. | |
I0511 08:24:33.930732 140645538408256 builder_impl.py:461] No assets to write. | |
INFO:tensorflow:SavedModel written to: xxxx/saved/saved_model.pb | |
I0511 08:24:34.176557 140645538408256 builder_impl.py:426] SavedModel written to: xxxx/saved/saved_model.pb | |
2021-05-11 08:24:34.202463: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libnvinfer.so.7 | |
INFO:tensorflow:Linked TensorRT version: (7, 2, 2) | |
I0511 08:24:34.202570 140645538408256 trt_convert.py:265] Linked TensorRT version: (7, 2, 2) | |
INFO:tensorflow:Loaded TensorRT version: (7, 2, 2) | |
I0511 08:24:34.202723 140645538408256 trt_convert.py:266] Loaded TensorRT version: (7, 2, 2) | |
INFO:tensorflow:Saver not created because there are no variables in the graph to restore | |
I0511 08:24:34.855897 140645538408256 saver.py:1511] Saver not created because there are no variables in the graph to restore | |
2021-05-11 08:24:35.063373: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set | |
2021-05-11 08:24:35.064430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Found device 0 with properties: | |
pciBusID: 0000:17:00.0 name: GeForce GTX 1080 Ti computeCapability: 6.1 | |
coreClock: 1.607GHz coreCount: 28 deviceMemorySize: 10.92GiB deviceMemoryBandwidth: 451.17GiB/s | |
2021-05-11 08:24:35.064471: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
2021-05-11 08:24:35.064505: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 | |
2021-05-11 08:24:35.064518: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 | |
2021-05-11 08:24:35.064530: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 | |
2021-05-11 08:24:35.064543: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 | |
2021-05-11 08:24:35.064556: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.11 | |
2021-05-11 08:24:35.064570: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 | |
2021-05-11 08:24:35.064585: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 | |
2021-05-11 08:24:35.066023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1888] Adding visible gpu devices: 0 | |
2021-05-11 08:24:35.066058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1287] Device interconnect StreamExecutor with strength 1 edge matrix: | |
2021-05-11 08:24:35.066069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1293] 0 | |
2021-05-11 08:24:35.066079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1306] 0: N | |
2021-05-11 08:24:35.067556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1432] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10408 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:17:00.0, compute capability: 6.1) | |
2021-05-11 08:24:35.096517: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2) | |
2021-05-11 08:24:35.117112: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 3299990000 Hz | |
2021-05-11 08:24:36.177095: I tensorflow/core/grappler/devices.cc:69] Number of eligible GPUs (core count >= 8, compute capability >= 0.0): 1 | |
2021-05-11 08:24:36.177354: I tensorflow/core/grappler/clusters/single_machine.cc:356] Starting new session | |
2021-05-11 08:24:36.177750: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set | |
2021-05-11 08:24:36.178209: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Found device 0 with properties: | |
pciBusID: 0000:17:00.0 name: GeForce GTX 1080 Ti computeCapability: 6.1 | |
coreClock: 1.607GHz coreCount: 28 deviceMemorySize: 10.92GiB deviceMemoryBandwidth: 451.17GiB/s | |
2021-05-11 08:24:36.178236: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
2021-05-11 08:24:36.178269: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 | |
2021-05-11 08:24:36.178283: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 | |
2021-05-11 08:24:36.178295: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 | |
2021-05-11 08:24:36.178308: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 | |
2021-05-11 08:24:36.178320: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.11 | |
2021-05-11 08:24:36.178334: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 | |
2021-05-11 08:24:36.178349: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 | |
2021-05-11 08:24:36.179077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1888] Adding visible gpu devices: 0 | |
2021-05-11 08:24:36.179113: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1287] Device interconnect StreamExecutor with strength 1 edge matrix: | |
2021-05-11 08:24:36.179124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1293] 0 | |
2021-05-11 08:24:36.179134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1306] 0: N | |
2021-05-11 08:24:36.179892: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1432] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10408 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:17:00.0, compute capability: 6.1) | |
2021-05-11 08:24:36.340983: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:954] Optimization results for grappler item: graph_to_optimize | |
function_optimizer: function_optimizer did nothing. time = 0.003ms. | |
function_optimizer: function_optimizer did nothing. time = 0.001ms. | |
2021-05-11 08:24:37.914714: I tensorflow/core/grappler/devices.cc:69] Number of eligible GPUs (core count >= 8, compute capability >= 0.0): 1 | |
2021-05-11 08:24:37.914873: I tensorflow/core/grappler/clusters/single_machine.cc:356] Starting new session | |
2021-05-11 08:24:37.915222: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set | |
2021-05-11 08:24:37.915546: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Found device 0 with properties: | |
pciBusID: 0000:17:00.0 name: GeForce GTX 1080 Ti computeCapability: 6.1 | |
coreClock: 1.607GHz coreCount: 28 deviceMemorySize: 10.92GiB deviceMemoryBandwidth: 451.17GiB/s | |
2021-05-11 08:24:37.915575: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 | |
2021-05-11 08:24:37.915607: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 | |
2021-05-11 08:24:37.915620: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 | |
2021-05-11 08:24:37.915633: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 | |
2021-05-11 08:24:37.915647: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 | |
2021-05-11 08:24:37.915665: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.11 | |
2021-05-11 08:24:37.915678: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 | |
2021-05-11 08:24:37.915691: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 | |
2021-05-11 08:24:37.916119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1888] Adding visible gpu devices: 0 | |
2021-05-11 08:24:37.916153: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1287] Device interconnect StreamExecutor with strength 1 edge matrix: | |
2021-05-11 08:24:37.916164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1293] 0 | |
2021-05-11 08:24:37.916174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1306] 0: N | |
2021-05-11 08:24:37.916628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1432] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10408 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:17:00.0, compute capability: 6.1) | |
2021-05-11 08:24:38.939730: I tensorflow/compiler/tf2tensorrt/segment/segment.cc:790] There are 4 ops of 3 different types in the graph that are not converted to TensorRT: Softmax, Placeholder, NoOp, (For more information see https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html#supported-ops). | |
2021-05-11 08:24:39.004761: I tensorflow/compiler/tf2tensorrt/convert/convert_graph.cc:757] Number of TensorRT candidate segments: 1 | |
2021-05-11 08:24:39.158856: I tensorflow/compiler/tf2tensorrt/convert/convert_graph.cc:851] Replaced segment 0 consisting of 798 nodes by InceptionV3/TRTEngineOp_0_0. | |
2021-05-11 08:24:39.725633: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:954] Optimization results for grappler item: tf_graph | |
constant_folding: Graph size after: 796 nodes (-386), 830 edges (-386), time = 315.044ms. | |
layout: Graph size after: 811 nodes (15), 845 edges (15), time = 224.76ms. | |
constant_folding: Graph size after: 800 nodes (-11), 834 edges (-11), time = 110.555ms. | |
TensorRTOptimizer: Graph size after: 3 nodes (-797), 2 edges (-832), time = 449.306ms. | |
constant_folding: Graph size after: 3 nodes (0), 2 edges (0), time = 2.283ms. | |
Optimization results for grappler item: InceptionV3/TRTEngineOp_0_0_native_segment | |
constant_folding: Graph size after: 800 nodes (0), 834 edges (0), time = 71.141ms. | |
layout: Graph size after: 800 nodes (0), 834 edges (0), time = 129.31ms. | |
constant_folding: Graph size after: 800 nodes (0), 834 edges (0), time = 75.567ms. | |
TensorRTOptimizer: Graph size after: 800 nodes (0), 834 edges (0), time = 15.344ms. | |
constant_folding: Graph size after: 800 nodes (0), 834 edges (0), time = 76.547ms. | |
2021-05-11 08:24:40.334558: W tensorflow/core/framework/op_kernel.cc:1763] OP_REQUIRES failed at trt_engine_resource_ops.cc:193 : Not found: Container TF-TRT does not exist. (Could not find resource: TF-TRT/TRTEngineOp_0_0) | |
INFO:tensorflow:Could not find TRTEngineOp_0_0 in TF-TRT cache. This can happen if build() is not called, which means TensorRT engines will be built and cached at runtime. | |
I0511 08:24:40.334683 140645538408256 trt_convert.py:1237] Could not find TRTEngineOp_0_0 in TF-TRT cache. This can happen if build() is not called, which means TensorRT engines will be built and cached at runtime. | |
INFO:tensorflow:Assets written to: /trainer/models/xxxx/1/model.savedmodel/assets | |
I0511 08:24:41.480864 140645538408256 builder_impl.py:774] Assets written to: /trainer/models/xxxx/1/model.savedmodel/assets | |
I0511 08:24:41.687407 140645538408256 export_model.py:216] Writing /trainer/models/xxxx/config.pbtxt |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment