Skip to content

Instantly share code, notes, and snippets.

@fischermario
Created April 25, 2018 23:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save fischermario/f5139a0da37186c845104770545a3df7 to your computer and use it in GitHub Desktop.
Save fischermario/f5139a0da37186c845104770545a3df7 to your computer and use it in GitHub Desktop.
[TensorRT] INFO: Added linear block of size 12845056
[TensorRT] INFO: Added linear block of size 12845056
[TensorRT] INFO: Added linear block of size 1605632
[TensorRT] INFO: Verifying engine construction was successful
[TensorRT] INFO: Allocating GPU buffers
[TensorRT] INFO: Registering postprocessor function table
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
[TensorRT] INFO: Detecting input data format
[TensorRT] INFO: Dectected data format NCHW
[TensorRT] INFO: Verifying data format is uniform accross all input layers
[TensorRT] INFO: Verifying batches are the expected data type
[TensorRT] INFO: Executing inference
[TensorRT] INFO: Number of Batches: 1
[TensorRT] INFO: Execution batch size: 1
[TensorRT] INFO: Formating output data
[TensorRT] INFO: Postprocessing output data for output layer dense_2/Softmax
function [infer_all_images_trt] finished in 1221 ms
daisy_1.jpg
daisy: 99.97%
daisy_2.jpg
daisy: 99.99%
daisy_3.jpg
daisy: 99.99%
dandelion_1.jpg
dandelion: 100.00%
dandelion_2.jpg
dandelion: 98.02%
dandelion_3.jpg
dandelion: 86.64%
golden_retriever.jpg
daisy: 91.14%
gordon_setter.jpg
not-a-flower: 85.78%
lifeboat.jpg
not-a-flower: 97.49%
manhattan.jpg
not-a-flower: 99.31%
night_sky.jpg
dandelion: 45.41%
santa_01.jpg
not-a-flower: 99.57%
santa_02.jpg
not-a-flower: 99.92%
sunflower_1.jpg
daisy: 99.35%
sunflower_2.jpg
daisy: 99.56%
sunflower_3.jpg
daisy: 99.93%
[TensorRT] INFO: Tearing down engine
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment