Skip to content

Instantly share code, notes, and snippets.

@0312birdzhang

0312birdzhang/gist:810b1fd40427484f7167e9bd4bf4f1cf

Created December 13, 2023 07:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 0312birdzhang/810b1fd40427484f7167e9bd4bf4f1cf to your computer and use it in GitHub Desktop.
Save 0312birdzhang/810b1fd40427484f7167e9bd4bf4f1cf to your computer and use it in GitHub Desktop.
Download ZIP
rknn1.6 perf
Raw
gistfile1.txt
I NPUTransfer: Starting NPU Transfer Client, Transfer version 2.1.0 (b5861e7@2020-11-23T11:50:36)
D RKNNAPI: ==============================================
D RKNNAPI: RKNN VERSION:
D RKNNAPI: API: 1.6.0 (535b468 build@2023-12-11T09:05:46)
D RKNNAPI: DRV: rknn_server: 1.6.0 (535b468 build@2023-12-11T17:05:07)
D RKNNAPI: DRV: rknnrt: 1.6.0 (585b3edcf@2023-12-11T15:30:19)
D RKNNAPI: ==============================================
D RKNNAPI: Input tensors:
D RKNNAPI: index=0, name=input_imgs, n_dims=4, dims=[1, 128, 256, 12], n_elems=393216, size=786432, w_stride = 0, size_with_stride = 0, fmt=NHWC, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: index=1, name=big_input_imgs, n_dims=4, dims=[1, 128, 256, 12], n_elems=393216, size=786432, w_stride = 0, size_with_stride = 0, fmt=NHWC, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: index=2, name=desire, n_dims=3, dims=[1, 100, 8], n_elems=800, size=1600, w_stride = 0, size_with_stride = 0, fmt=UNDEFINED, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: index=3, name=traffic_convention, n_dims=2, dims=[1, 2], n_elems=2, size=4, w_stride = 0, size_with_stride = 0, fmt=UNDEFINED, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: index=4, name=nav_features, n_dims=2, dims=[1, 256], n_elems=256, size=512, w_stride = 0, size_with_stride = 0, fmt=UNDEFINED, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: index=5, name=nav_instructions, n_dims=2, dims=[1, 150], n_elems=150, size=300, w_stride = 0, size_with_stride = 0, fmt=UNDEFINED, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: index=6, name=features_buffer, n_dims=3, dims=[1, 99, 128], n_elems=12672, size=25344, w_stride = 0, size_with_stride = 0, fmt=UNDEFINED, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
D RKNNAPI: Output tensors:
D RKNNAPI: index=0, name=outputs, n_dims=2, dims=[1, 6120], n_elems=6120, size=12240, w_stride = 0, size_with_stride = 0, fmt=UNDEFINED, type=FP16, qnt_type=NONE, zp=0, scale=1.000000
Warning: The performance result is just for debugging, may worse than actual performance!
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Network Layer Information Table
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ID OpType DataType Target InputShape OutputShape DDRCycles NPUCycles MaxCycles Time(us) MacUsage(%) WorkLoad(0/1/2)--ImproveTherical TaskNumber RW(KB) FullName
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
1 InputOperator FLOAT16 CPU \ (1,12,128,256) 0 0 0 9 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:input_imgs
2 InputOperator FLOAT16 CPU \ (1,12,128,256) 0 0 0 2 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:big_input_imgs
3 InputOperator FLOAT16 CPU \ (1,100,8) 0 0 0 2 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:desire
4 InputOperator FLOAT16 CPU \ (1,2) 0 0 0 2 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:traffic_convention
5 InputOperator FLOAT16 CPU \ (1,256) 0 0 0 1 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:nav_features
6 InputOperator FLOAT16 CPU \ (1,150) 0 0 0 3 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:nav_instructions
7 InputOperator FLOAT16 CPU \ (1,99,128) 0 0 0 2 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 InputOperator:features_buffer
8 Reshape FLOAT16 CPU (1,256),(4) (1,256,1,1) 0 0 0 1260 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/nav_encoder/nav_encoder.0/block_a/block_a.0/Gemm_2conv_reshape1
9 Gather FLOAT16 CPU (1,99,128),(8) (1,8,128) 0 0 0 316 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 24 Gather:/Gather
10 Reshape FLOAT16 CPU (1,8,128),(4) (1,1024,1,1) 0 0 0 1469 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 2 Reshape:/Concat_1_swap_concat_reshape_i1_out
11 Reshape FLOAT16 CPU (1,100,8),(4) (1,800,1,1) 0 0 0 1163 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 1 Reshape:/Concat_swap_concat_reshape_i0_out
12 Reshape FLOAT16 CPU (1,2),(4) (1,2,1,1) 0 0 0 1170 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_swap_concat_reshape_i1_out
13 Conv FLOAT16 NPU (1,2,1,1),(16,2,1,1) (1,16,1,1) 13 32 32 1136 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/Concat_swap_concat_reshape_i1_out_conv_/Concat
14 Reshape FLOAT16 CPU (1,150),(4) (1,150,1,1) 0 0 0 2535 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_swap_concat_reshape_i3_out
15 ConvRelu FLOAT16 NPU (1,256,1,1),(512,256,1,1),(512) (1,512,1,1) 11234 4096 11234 271 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 258 Conv:/nav_encoder/nav_encoder.0/block_a/block_a.0/Gemm_2conv
16 ConvElu FLOAT16 NPU (1,12,128,256),(32,12,3,3),(32) (1,32,64,128) 66890 147456 147456 603 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 1033 Conv:/supercombo/vision/_en/_conv_stem/Conv
17 ConvElu FLOAT16 NPU (1,12,128,256),(32,12,3,3),(32) (1,32,64,128) 66890 147456 147456 619 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 1033 Conv:/supercombo/extra/_en/_conv_stem/Conv
18 ConvElu FLOAT16 NPU (1,32,64,128),(1,32,3,3),(32) (1,32,64,128) 44360 73728 73728 582 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 3/1 512 Conv:/supercombo/vision/_en/_blocks.0/_depthwise_conv/Conv
19 Conv FLOAT16 NPU (1,32,64,128),(16,32,1,1),(16) (1,16,64,128) 33294 16384 33294 334 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 513 Conv:/supercombo/vision/_en/_blocks.0/_project_conv/Conv
20 ConvElu FLOAT16 NPU (1,32,64,128),(1,32,3,3),(32) (1,32,64,128) 44360 73728 73728 594 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 3/1 512 Conv:/supercombo/extra/_en/_blocks.0/_depthwise_conv/Conv
21 Conv FLOAT16 NPU (1,32,64,128),(16,32,1,1),(16) (1,16,64,128) 33294 16384 33294 333 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 513 Conv:/supercombo/extra/_en/_blocks.0/_project_conv/Conv
22 ConvElu FLOAT16 NPU (1,16,64,128),(1,16,3,3),(16) (1,16,64,128) 22183 73728 73728 513 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 256 Conv:/supercombo/vision/_en/_blocks.1/_depthwise_conv/Conv
23 ConvElu FLOAT16 NPU (1,16,64,128),(96,16,1,1),(96) (1,96,64,128) 77724 98304 98304 1041 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 259 Conv:/supercombo/extra/_en/_blocks.1/_expand_conv/Conv
24 ConvElu FLOAT16 NPU (1,96,64,128),(1,96,3,3),(96) (1,96,32,64) 83208 36864 83208 612 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 7/1 1538 Conv:/supercombo/extra/_en/_blocks.1/_depthwise_conv/Conv
25 Conv FLOAT16 NPU (1,96,32,64),(24,96,1,1),(24) (1,24,32,64) 20980 12288 20980 309 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 388 Conv:/supercombo/extra/_en/_blocks.1/_project_conv/Conv
26 ConvElu FLOAT16 NPU (1,24,32,64),(144,24,1,1),(144) (1,144,32,64) 29506 36864 36864 652 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 105 Conv:/supercombo/extra/_en/_blocks.2/_expand_conv/Conv
27 ConvElu FLOAT16 NPU (1,144,32,64),(1,144,3,3),(144) (1,144,32,64) 50008 55296 55296 581 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 579 Conv:/supercombo/extra/_en/_blocks.2/_depthwise_conv/Conv
28 ConvAddRelu FLOAT16 NPU (1,512,1,1),(256,512,1,1),(256),... (1,256,1,1) 11213 4096 11213 275 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 258 Conv:/nav_encoder/nav_encoder.0/block_a/block_a.3/Gemm_2conv
29 ConvRelu FLOAT16 NPU (1,256,1,1),(512,256,1,1),(512) (1,512,1,1) 11234 4096 11234 281 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 258 Conv:/nav_encoder/nav_encoder.0/block_b/block_b.1/Gemm_2conv
30 ConvAdd FLOAT16 NPU (1,16,64,128),(16,16,1,1),(16),... (1,16,64,128) 33272 16384 33272 301 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 512 Conv:/supercombo/vision/_en/_blocks.1/_project_conv/Conv
31 ConvElu FLOAT16 NPU (1,16,64,128),(96,16,1,1),(96) (1,96,64,128) 77724 98304 98304 1104 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 259 Conv:/supercombo/vision/_en/_blocks.2/_expand_conv/Conv
32 ConvElu FLOAT16 NPU (1,96,64,128),(1,96,3,3),(96) (1,96,32,64) 83208 36864 83208 532 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 7/1 1538 Conv:/supercombo/vision/_en/_blocks.2/_depthwise_conv/Conv
33 Conv FLOAT16 NPU (1,96,32,64),(24,96,1,1),(24) (1,24,32,64) 20980 12288 20980 201 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 388 Conv:/supercombo/vision/_en/_blocks.2/_project_conv/Conv
34 ConvElu FLOAT16 NPU (1,24,32,64),(144,24,1,1),(144) (1,144,32,64) 29506 36864 36864 438 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 105 Conv:/supercombo/vision/_en/_blocks.3/_expand_conv/Conv
35 ConvElu FLOAT16 NPU (1,144,32,64),(1,144,3,3),(144) (1,144,32,64) 50008 55296 55296 559 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 579 Conv:/supercombo/vision/_en/_blocks.3/_depthwise_conv/Conv
36 ConvAdd FLOAT16 NPU (1,144,32,64),(24,144,1,1),(24),... (1,24,32,64) 33545 20480 33545 183 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 678 Conv:/supercombo/extra/_en/_blocks.2/_project_conv/Conv
37 ConvElu FLOAT16 NPU (1,24,32,64),(144,24,1,1),(144) (1,144,32,64) 29506 36864 36864 459 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 105 Conv:/supercombo/extra/_en/_blocks.3/_expand_conv/Conv
38 ConvElu FLOAT16 NPU (1,144,32,64),(1,144,5,5),(144) (1,144,16,32) 31501 38400 38400 299 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 583 Conv:/supercombo/extra/_en/_blocks.3/_depthwise_conv/Conv
39 Conv FLOAT16 NPU (1,144,16,32),(40,144,1,1),(40) (1,40,16,32) 8461 7680 8461 162 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 155 Conv:/supercombo/extra/_en/_blocks.3/_project_conv/Conv
40 ConvElu FLOAT16 NPU (1,40,16,32),(240,40,1,1),(240) (1,240,16,32) 12974 15360 15360 252 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 59 Conv:/supercombo/extra/_en/_blocks.4/_expand_conv/Conv
41 ConvElu FLOAT16 NPU (1,240,16,32),(1,240,5,5),(240) (1,240,16,32) 21331 51200 51200 328 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 252 Conv:/supercombo/extra/_en/_blocks.4/_depthwise_conv/Conv
42 ConvAddRelu FLOAT16 NPU (1,512,1,1),(256,512,1,1),(256),... (1,256,1,1) 11213 4096 11213 166 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 258 Conv:/nav_encoder/nav_encoder.0/block_b/block_b.4/Gemm_2conv
43 ConvRelu FLOAT16 NPU (1,256,1,1),(256,256,1,1),(256) (1,256,1,1) 5628 2048 5628 156 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 129 Conv:/nav_encoder/nav_encoder.1/Gemm_2conv
44 Concat FLOAT16 NPU (1,800,1,1),(1,16,1,1),(1,256,1,1),... (1,1222,1,1) 207 0 207 143 \ 300.0%/0.0%/0.0%--Up:-200.0% 4/0 2 Concat:/Concat
45 ConvRelu FLOAT16 NPU (1,1222,1,1),(512,1222,1,1),(512) (1,512,1,1) 53135 19968 53135 253 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1226 Conv:/_extra_in/_extra_in.0/Gemm_2conv
46 ConvAdd FLOAT16 NPU (1,144,32,64),(24,144,1,1),(24),... (1,24,32,64) 33545 20480 33545 220 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 678 Conv:/supercombo/vision/_en/_blocks.3/_project_conv/Conv
47 ConvElu FLOAT16 NPU (1,24,32,64),(144,24,1,1),(144) (1,144,32,64) 29506 36864 36864 338 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 105 Conv:/supercombo/vision/_en/_blocks.4/_expand_conv/Conv
48 ConvElu FLOAT16 NPU (1,144,32,64),(1,144,3,3),(144) (1,144,32,64) 50008 55296 55296 569 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 579 Conv:/supercombo/vision/_en/_blocks.4/_depthwise_conv/Conv
49 ConvAdd FLOAT16 NPU (1,240,16,32),(40,240,1,1),(40),... (1,40,16,32) 14673 12288 14673 123 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 298 Conv:/supercombo/extra/_en/_blocks.4/_project_conv/Conv
50 ConvElu FLOAT16 NPU (1,40,16,32),(240,40,1,1),(240) (1,240,16,32) 12974 15360 15360 210 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 59 Conv:/supercombo/extra/_en/_blocks.5/_expand_conv/Conv
51 ConvElu FLOAT16 NPU (1,240,16,32),(1,240,3,3),(240) (1,240,8,16) 13214 4608 13214 146 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 245 Conv:/supercombo/extra/_en/_blocks.5/_depthwise_conv/Conv
52 Conv FLOAT16 NPU (1,240,8,16),(80,240,1,1),(80) (1,80,8,16) 5101 5120 5120 98 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 97 Conv:/supercombo/extra/_en/_blocks.5/_project_conv/Conv
53 ConvElu FLOAT16 NPU (1,80,8,16),(480,80,1,1),(480) (1,480,8,16) 9389 11520 11520 151 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 96 Conv:/supercombo/extra/_en/_blocks.6/_expand_conv/Conv
54 ConvElu FLOAT16 NPU (1,480,8,16),(1,480,3,3),(480) (1,480,8,16) 10837 9216 10837 167 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 130 Conv:/supercombo/extra/_en/_blocks.6/_depthwise_conv/Conv
55 ConvAdd FLOAT16 NPU (1,144,32,64),(24,144,1,1),(24),... (1,24,32,64) 33545 20480 33545 108 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/0 678 Conv:/supercombo/vision/_en/_blocks.4/_project_conv/Conv
56 ConvElu FLOAT16 NPU (1,24,32,64),(144,24,1,1),(144) (1,144,32,64) 29506 36864 36864 325 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 105 Conv:/supercombo/vision/_en/_blocks.5/_expand_conv/Conv
57 ConvElu FLOAT16 NPU (1,144,32,64),(1,144,5,5),(144) (1,144,16,32) 31501 38400 38400 182 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 4/1 583 Conv:/supercombo/vision/_en/_blocks.5/_depthwise_conv/Conv
58 Conv FLOAT16 NPU (1,144,16,32),(48,144,1,1),(48) (1,48,16,32) 8905 7680 8905 54 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 157 Conv:/supercombo/vision/_en/_blocks.5/_project_conv/Conv
59 ConvElu FLOAT16 NPU (1,48,16,32),(288,48,1,1),(288) (1,288,16,32) 15764 18432 18432 179 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 76 Conv:/supercombo/vision/_en/_blocks.6/_expand_conv/Conv
60 ConvElu FLOAT16 NPU (1,288,16,32),(1,288,5,5),(288) (1,288,16,32) 25593 64000 64000 297 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 303 Conv:/supercombo/vision/_en/_blocks.6/_depthwise_conv/Conv
61 ConvAdd FLOAT16 NPU (1,480,8,16),(80,480,1,1),(80),... (1,80,8,16) 10187 9600 10187 110 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 215 Conv:/supercombo/extra/_en/_blocks.6/_project_conv/Conv
62 ConvElu FLOAT16 NPU (1,80,8,16),(480,80,1,1),(480) (1,480,8,16) 9389 11520 11520 154 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 96 Conv:/supercombo/extra/_en/_blocks.7/_expand_conv/Conv
63 ConvElu FLOAT16 NPU (1,480,8,16),(1,480,3,3),(480) (1,480,8,16) 10837 9216 10837 171 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 130 Conv:/supercombo/extra/_en/_blocks.7/_depthwise_conv/Conv
64 ConvAdd FLOAT16 NPU (1,288,16,32),(48,288,1,1),(48),... (1,48,16,32) 17801 13824 17801 178 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 363 Conv:/supercombo/vision/_en/_blocks.6/_project_conv/Conv
65 ConvElu FLOAT16 NPU (1,48,16,32),(288,48,1,1),(288) (1,288,16,32) 15764 18432 18432 238 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 76 Conv:/supercombo/vision/_en/_blocks.7/_expand_conv/Conv
66 ConvElu FLOAT16 NPU (1,288,16,32),(1,288,5,5),(288) (1,288,16,32) 25593 64000 64000 351 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 303 Conv:/supercombo/vision/_en/_blocks.7/_depthwise_conv/Conv
67 ConvAdd FLOAT16 NPU (1,480,8,16),(80,480,1,1),(80),... (1,80,8,16) 10187 9600 10187 161 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 215 Conv:/supercombo/extra/_en/_blocks.7/_project_conv/Conv
68 ConvElu FLOAT16 NPU (1,80,8,16),(480,80,1,1),(480) (1,480,8,16) 9389 11520 11520 154 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 96 Conv:/supercombo/extra/_en/_blocks.8/_expand_conv/Conv
69 ConvElu FLOAT16 NPU (1,480,8,16),(1,480,5,5),(480) (1,480,8,16) 11486 25600 25600 227 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 145 Conv:/supercombo/extra/_en/_blocks.8/_depthwise_conv/Conv
70 Conv FLOAT16 NPU (1,480,8,16),(112,480,1,1),(112) (1,112,8,16) 10972 13440 13440 164 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 225 Conv:/supercombo/extra/_en/_blocks.8/_project_conv/Conv
71 ConvElu FLOAT16 NPU (1,112,8,16),(672,112,1,1),(672) (1,672,8,16) 14963 21504 21504 177 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 177 Conv:/supercombo/extra/_en/_blocks.9/_expand_conv/Conv
72 ConvElu FLOAT16 NPU (1,672,8,16),(1,672,5,5),(672) (1,672,8,16) 16080 35200 35200 214 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 203 Conv:/supercombo/extra/_en/_blocks.9/_depthwise_conv/Conv
73 ConvAdd FLOAT16 NPU (1,288,16,32),(48,288,1,1),(48),... (1,48,16,32) 17801 13824 17801 126 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 363 Conv:/supercombo/vision/_en/_blocks.7/_project_conv/Conv
74 ConvElu FLOAT16 NPU (1,48,16,32),(288,48,1,1),(288) (1,288,16,32) 15764 18432 18432 242 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 76 Conv:/supercombo/vision/_en/_blocks.8/_expand_conv/Conv
75 ConvElu FLOAT16 NPU (1,288,16,32),(1,288,3,3),(288) (1,288,8,16) 15853 5760 15853 157 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 294 Conv:/supercombo/vision/_en/_blocks.8/_depthwise_conv/Conv
76 Conv FLOAT16 NPU (1,288,8,16),(88,288,1,1),(88) (1,88,8,16) 6229 6912 6912 101 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 121 Conv:/supercombo/vision/_en/_blocks.8/_project_conv/Conv
77 ConvElu FLOAT16 NPU (1,88,8,16),(528,88,1,1),(528) (1,528,8,16) 11042 12672 12672 144 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 123 Conv:/supercombo/vision/_en/_blocks.9/_expand_conv/Conv
78 ConvElu FLOAT16 NPU (1,528,8,16),(1,528,3,3),(528) (1,528,8,16) 11923 10368 11923 177 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.9/_depthwise_conv/Conv
79 ConvAdd FLOAT16 NPU (1,672,8,16),(112,672,1,1),(112),... (1,112,8,16) 16080 18816 18816 123 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 343 Conv:/supercombo/extra/_en/_blocks.9/_project_conv/Conv
80 ConvElu FLOAT16 NPU (1,112,8,16),(672,112,1,1),(672) (1,672,8,16) 14963 21504 21504 147 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 177 Conv:/supercombo/extra/_en/_blocks.10/_expand_conv/Conv
81 ConvElu FLOAT16 NPU (1,672,8,16),(1,672,5,5),(672) (1,672,8,16) 16080 35200 35200 211 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 203 Conv:/supercombo/extra/_en/_blocks.10/_depthwise_conv/Conv
82 ConvAdd FLOAT16 NPU (1,528,8,16),(88,528,1,1),(88),... (1,88,8,16) 11565 13056 13056 112 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 245 Conv:/supercombo/vision/_en/_blocks.9/_project_conv/Conv
83 ConvElu FLOAT16 NPU (1,88,8,16),(528,88,1,1),(528) (1,528,8,16) 11042 12672 12672 125 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 123 Conv:/supercombo/vision/_en/_blocks.10/_expand_conv/Conv
84 ConvElu FLOAT16 NPU (1,528,8,16),(1,528,3,3),(528) (1,528,8,16) 11923 10368 11923 175 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.10/_depthwise_conv/Conv
85 ConvAdd FLOAT16 NPU (1,672,8,16),(112,672,1,1),(112),... (1,112,8,16) 16080 18816 18816 122 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 343 Conv:/supercombo/extra/_en/_blocks.10/_project_conv/Conv
86 ConvElu FLOAT16 NPU (1,112,8,16),(672,112,1,1),(672) (1,672,8,16) 14963 21504 21504 126 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 177 Conv:/supercombo/extra/_en/_blocks.11/_expand_conv/Conv
87 ConvElu FLOAT16 NPU (1,672,8,16),(1,672,5,5),(672) (1,672,4,8) 10626 8800 10626 132 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 203 Conv:/supercombo/extra/_en/_blocks.11/_depthwise_conv/Conv
88 Conv FLOAT16 NPU (1,672,4,8),(192,672,1,1),(192) (1,192,4,8) 13280 8064 13280 110 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 294 Conv:/supercombo/extra/_en/_blocks.11/_project_conv/Conv
89 ConvElu FLOAT16 NPU (1,192,4,8),(1152,192,1,1),(1152) (1,1152,4,8) 22533 13824 22533 146 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 448 Conv:/supercombo/extra/_en/_blocks.12/_expand_conv/Conv
90 ConvElu FLOAT16 NPU (1,1152,4,8),(1,1152,5,5),(1152) (1,1152,4,8) 8864 14400 14400 141 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 132 Conv:/supercombo/extra/_en/_blocks.12/_depthwise_conv/Conv
91 ConvAdd FLOAT16 NPU (1,528,8,16),(88,528,1,1),(88),... (1,88,8,16) 11565 13056 13056 113 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 245 Conv:/supercombo/vision/_en/_blocks.10/_project_conv/Conv
92 ConvElu FLOAT16 NPU (1,88,8,16),(528,88,1,1),(528) (1,528,8,16) 11042 12672 12672 161 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 123 Conv:/supercombo/vision/_en/_blocks.11/_expand_conv/Conv
93 ConvElu FLOAT16 NPU (1,528,8,16),(1,528,3,3),(528) (1,528,8,16) 11923 10368 11923 176 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.11/_depthwise_conv/Conv
94 ConvAdd FLOAT16 NPU (1,1152,4,8),(192,1152,1,1),(192),... (1,192,4,8) 22890 13824 22890 128 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 516 Conv:/supercombo/extra/_en/_blocks.12/_project_conv/Conv
95 ConvElu FLOAT16 NPU (1,192,4,8),(1152,192,1,1),(1152) (1,1152,4,8) 22533 13824 22533 165 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 448 Conv:/supercombo/extra/_en/_blocks.13/_expand_conv/Conv
96 ConvElu FLOAT16 NPU (1,1152,4,8),(1,1152,5,5),(1152) (1,1152,4,8) 8864 14400 14400 195 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 132 Conv:/supercombo/extra/_en/_blocks.13/_depthwise_conv/Conv
97 ConvAdd FLOAT16 NPU (1,528,8,16),(88,528,1,1),(88),... (1,88,8,16) 11565 13056 13056 166 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 245 Conv:/supercombo/vision/_en/_blocks.11/_project_conv/Conv
98 ConvElu FLOAT16 NPU (1,88,8,16),(528,88,1,1),(528) (1,528,8,16) 11042 12672 12672 209 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 123 Conv:/supercombo/vision/_en/_blocks.12/_expand_conv/Conv
99 ConvElu FLOAT16 NPU (1,528,8,16),(1,528,5,5),(528) (1,528,8,16) 12637 28800 28800 238 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 159 Conv:/supercombo/vision/_en/_blocks.12/_depthwise_conv/Conv
100 Conv FLOAT16 NPU (1,528,8,16),(120,528,1,1),(120) (1,120,8,16) 12392 17408 17408 170 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 256 Conv:/supercombo/vision/_en/_blocks.12/_project_conv/Conv
101 ConvElu FLOAT16 NPU (1,120,8,16),(720,120,1,1),(720) (1,720,8,16) 17006 23040 23040 182 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 212 Conv:/supercombo/vision/_en/_blocks.13/_expand_conv/Conv
102 ConvElu FLOAT16 NPU (1,720,8,16),(1,720,5,5),(720) (1,720,8,16) 17232 38400 38400 221 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 218 Conv:/supercombo/vision/_en/_blocks.13/_depthwise_conv/Conv
103 ConvAdd FLOAT16 NPU (1,1152,4,8),(192,1152,1,1),(192),... (1,192,4,8) 22890 13824 22890 127 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 516 Conv:/supercombo/extra/_en/_blocks.13/_project_conv/Conv
104 ConvElu FLOAT16 NPU (1,192,4,8),(1152,192,1,1),(1152) (1,1152,4,8) 22533 13824 22533 99 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 448 Conv:/supercombo/extra/_en/_blocks.14/_expand_conv/Conv
105 ConvElu FLOAT16 NPU (1,1152,4,8),(1,1152,5,5),(1152) (1,1152,4,8) 8864 14400 14400 142 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 132 Conv:/supercombo/extra/_en/_blocks.14/_depthwise_conv/Conv
106 ConvAdd FLOAT16 NPU (1,720,8,16),(120,720,1,1),(120),... (1,120,8,16) 17717 23552 23552 129 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 379 Conv:/supercombo/vision/_en/_blocks.13/_project_conv/Conv
107 ConvElu FLOAT16 NPU (1,120,8,16),(720,120,1,1),(720) (1,720,8,16) 17006 23040 23040 152 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 212 Conv:/supercombo/vision/_en/_blocks.14/_expand_conv/Conv
108 ConvElu FLOAT16 NPU (1,720,8,16),(1,720,5,5),(720) (1,720,8,16) 17232 38400 38400 221 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 218 Conv:/supercombo/vision/_en/_blocks.14/_depthwise_conv/Conv
109 ConvAdd FLOAT16 NPU (1,1152,4,8),(192,1152,1,1),(192),... (1,192,4,8) 22890 13824 22890 100 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 516 Conv:/supercombo/extra/_en/_blocks.14/_project_conv/Conv
110 ConvElu FLOAT16 NPU (1,192,4,8),(1152,192,1,1),(1152) (1,1152,4,8) 22533 13824 22533 146 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 448 Conv:/supercombo/extra/_en/_blocks.15/_expand_conv/Conv
111 ConvElu FLOAT16 NPU (1,1152,4,8),(1,1152,3,3),(1152) (1,1152,4,8) 7306 5184 7306 132 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 96 Conv:/supercombo/extra/_en/_blocks.15/_depthwise_conv/Conv
112 Conv FLOAT16 NPU (1,1152,4,8),(320,1152,1,1),(320) (1,320,4,8) 35207 23040 35207 104 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 793 Conv:/supercombo/extra/_en/_blocks.15/_project_conv/Conv
113 ConvElu FLOAT16 NPU (1,320,4,8),(1,320,1,1),(320) (1,320,4,8) 1813 160 1813 47 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 21 Conv:/supercombo/extra/_en/_conv_head/_depthwise_conv/Conv
114 Conv FLOAT16 NPU (1,320,4,8),(32,320,1,1),(32) (1,32,4,8) 1824 640 1824 36 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 40 Conv:/supercombo/extra/_en/_conv_head/_project_conv/Conv
115 Reshape FLOAT16 CPU (1,32,4,8),(4) (1,1024,1,1) 0 0 0 1577 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 2 Reshape:/supercombo/Concat_swap_concat_reshape_i1_out
116 ConvAdd FLOAT16 NPU (1,720,8,16),(120,720,1,1),(120),... (1,120,8,16) 17717 23552 23552 80 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 379 Conv:/supercombo/vision/_en/_blocks.14/_project_conv/Conv
117 ConvElu FLOAT16 NPU (1,120,8,16),(720,120,1,1),(720) (1,720,8,16) 17006 23040 23040 126 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 212 Conv:/supercombo/vision/_en/_blocks.15/_expand_conv/Conv
118 ConvElu FLOAT16 NPU (1,720,8,16),(1,720,5,5),(720) (1,720,8,16) 17232 38400 38400 169 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 218 Conv:/supercombo/vision/_en/_blocks.15/_depthwise_conv/Conv
119 ConvAdd FLOAT16 NPU (1,720,8,16),(120,720,1,1),(120),... (1,120,8,16) 17717 23552 23552 76 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 379 Conv:/supercombo/vision/_en/_blocks.15/_project_conv/Conv
120 ConvElu FLOAT16 NPU (1,120,8,16),(720,120,1,1),(720) (1,720,8,16) 17006 23040 23040 127 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 212 Conv:/supercombo/vision/_en/_blocks.16/_expand_conv/Conv
121 ConvElu FLOAT16 NPU (1,720,8,16),(1,720,5,5),(720) (1,720,4,8) 11387 9600 11387 82 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 218 Conv:/supercombo/vision/_en/_blocks.16/_depthwise_conv/Conv
122 Conv FLOAT16 NPU (1,720,4,8),(208,720,1,1),(208) (1,208,4,8) 15209 9568 15209 61 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 338 Conv:/supercombo/vision/_en/_blocks.16/_project_conv/Conv
123 ConvElu FLOAT16 NPU (1,208,4,8),(1248,208,1,1),(1248) (1,1248,4,8) 26099 17472 26099 102 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 524 Conv:/supercombo/vision/_en/_blocks.17/_expand_conv/Conv
124 ConvElu FLOAT16 NPU (1,1248,4,8),(1,1248,5,5),(1248) (1,1248,4,8) 9603 16000 16000 93 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.17/_depthwise_conv/Conv
125 ConvAdd FLOAT16 NPU (1,1248,4,8),(208,1248,1,1),(208),... (1,208,4,8) 26486 16224 26486 82 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 598 Conv:/supercombo/vision/_en/_blocks.17/_project_conv/Conv
126 ConvElu FLOAT16 NPU (1,208,4,8),(1248,208,1,1),(1248) (1,1248,4,8) 26099 17472 26099 102 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 524 Conv:/supercombo/vision/_en/_blocks.18/_expand_conv/Conv
127 ConvElu FLOAT16 NPU (1,1248,4,8),(1,1248,5,5),(1248) (1,1248,4,8) 9603 16000 16000 93 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.18/_depthwise_conv/Conv
128 ConvAdd FLOAT16 NPU (1,1248,4,8),(208,1248,1,1),(208),... (1,208,4,8) 26486 16224 26486 81 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 598 Conv:/supercombo/vision/_en/_blocks.18/_project_conv/Conv
129 ConvElu FLOAT16 NPU (1,208,4,8),(1248,208,1,1),(1248) (1,1248,4,8) 26099 17472 26099 103 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 524 Conv:/supercombo/vision/_en/_blocks.19/_expand_conv/Conv
130 ConvElu FLOAT16 NPU (1,1248,4,8),(1,1248,5,5),(1248) (1,1248,4,8) 9603 16000 16000 94 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.19/_depthwise_conv/Conv
131 ConvAdd FLOAT16 NPU (1,1248,4,8),(208,1248,1,1),(208),... (1,208,4,8) 26486 16224 26486 81 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 598 Conv:/supercombo/vision/_en/_blocks.19/_project_conv/Conv
132 ConvElu FLOAT16 NPU (1,208,4,8),(1248,208,1,1),(1248) (1,1248,4,8) 26099 17472 26099 156 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 524 Conv:/supercombo/vision/_en/_blocks.20/_expand_conv/Conv
133 ConvElu FLOAT16 NPU (1,1248,4,8),(1,1248,5,5),(1248) (1,1248,4,8) 9603 16000 16000 94 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 143 Conv:/supercombo/vision/_en/_blocks.20/_depthwise_conv/Conv
134 ConvAdd FLOAT16 NPU (1,1248,4,8),(208,1248,1,1),(208),... (1,208,4,8) 26486 16224 26486 80 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 598 Conv:/supercombo/vision/_en/_blocks.20/_project_conv/Conv
135 ConvElu FLOAT16 NPU (1,208,4,8),(1248,208,1,1),(1248) (1,1248,4,8) 26099 17472 26099 103 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 524 Conv:/supercombo/vision/_en/_blocks.21/_expand_conv/Conv
136 ConvElu FLOAT16 NPU (1,1248,4,8),(1,1248,3,3),(1248) (1,1248,4,8) 7915 5760 7915 82 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 104 Conv:/supercombo/vision/_en/_blocks.21/_depthwise_conv/Conv
137 Conv FLOAT16 NPU (1,1248,4,8),(352,1248,1,1),(352) (1,352,4,8) 41533 27456 41533 114 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 937 Conv:/supercombo/vision/_en/_blocks.21/_project_conv/Conv
138 ConvElu FLOAT16 NPU (1,352,4,8),(2112,352,1,1),(2112) (1,2112,4,8) 69883 46464 69883 200 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 1482 Conv:/supercombo/vision/_en/_blocks.22/_expand_conv/Conv
139 ConvElu FLOAT16 NPU (1,2112,4,8),(1,2112,3,3),(2112) (1,2112,4,8) 13394 9504 13394 113 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 177 Conv:/supercombo/vision/_en/_blocks.22/_depthwise_conv/Conv
140 ConvAdd FLOAT16 NPU (1,2112,4,8),(352,2112,1,1),(352),... (1,352,4,8) 70537 46464 70537 170 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1607 Conv:/supercombo/vision/_en/_blocks.22/_project_conv/Conv
141 ConvElu FLOAT16 NPU (1,352,4,8),(1,352,1,1),(352) (1,352,4,8) 1995 192 1995 49 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 2/1 24 Conv:/supercombo/vision/_en/_conv_head/_depthwise_conv/Conv
142 Conv FLOAT16 NPU (1,352,4,8),(32,352,1,1),(32) (1,32,4,8) 1997 704 1997 35 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 44 Conv:/supercombo/vision/_en/_conv_head/_project_conv/Conv
143 Reshape FLOAT16 CPU (1,32,4,8),(4) (1,1024,1,1) 0 0 0 1503 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 2 Reshape:/supercombo/Concat_swap_concat_reshape_i0_out
144 Concat FLOAT16 NPU (1,1024,1,1),(1,1024,1,1) (1,2048,1,1) 347 0 347 92 \ 300.0%/0.0%/0.0%--Up:-200.0% 2/0 4 Concat:/supercombo/Concat
145 ConvRelu FLOAT16 NPU (1,2048,1,1),(512,2048,1,1),(512) (1,512,1,1) 88963 32768 88963 277 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2054 Conv:/summarizer/_infeats/_infeats.0/Gemm_2conv
146 ConvRelu FLOAT16 NPU (1,2048,1,1),(512,2048,1,1),(512) (1,512,1,1) 88963 32768 88963 276 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2054 Conv:/supercombo/no_bottleneck_policy/summarizer/_infeats/_infeats.0/Gemm_2conv
147 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 181 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/summarizer/resblock/block_a/block_a.0/Gemm_2conv
148 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 180 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/summarizer/resblock/block_a/block_a.0/Gemm_2conv
149 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 179 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/summarizer/resblock/block_a/block_a.3/Gemm_2conv
150 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 180 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/summarizer/resblock/block_b/block_b.1/Gemm_2conv
151 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 180 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/summarizer/resblock/block_a/block_a.3/Gemm_2conv
152 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 180 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/summarizer/resblock/block_b/block_b.1/Gemm_2conv
153 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 181 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/summarizer/resblock/block_b/block_b.4/Gemm_2conv
154 Conv FLOAT16 NPU (1,512,1,1),(512,512,1,1),(512) (1,512,1,1) 22339 8192 22339 134 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 515 Conv:/summarizer/_mu/Gemm_2conv
155 Mul FLOAT16 NPU (1,512,1,1),(1,512,1,1) (1,512,1,1) 130 0 130 88 \ 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Mul:/summarizer/Mul
156 Conv FLOAT16 NPU (1,512,1,1),(1,512,1,1) (1,1,1,1) 88 256 256 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/summarizer/ReduceSum_2conv
157 Sqrt FLOAT16 CPU (1,1,1,1) (1,1,1,1) 0 0 0 620 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Sqrt:/summarizer/Sqrt
158 Clip FLOAT16 NPU (1,1,1,1),(1),(1) (1,1,1,1) 2 0 2 88 \ 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Clip:/summarizer/Clip
159 Div FLOAT16 CPU (1,512,1,1),(1,1,1,1) (1,512,1,1) 0 0 0 925 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 1 Div:/summarizer/Div
160 ConvRelu FLOAT16 NPU (1,512,1,1),(128,512,1,1),(128) (1,128,1,1) 5617 2048 5617 101 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 129 Conv:/_encode/_encode.0/Gemm_2conv
161 Reshape FLOAT16 CPU (1,128,1,1),(4) (1,1,128,1) 0 0 0 1451 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i13_out
162 Concat FLOAT16 NPU (1,512,1,1),(1,1024,1,1),(1,512,1,1) (1,2048,1,1) 347 0 347 93 \ 300.0%/0.0%/0.0%--Up:-200.0% 3/0 4 Concat:/Concat_1
163 ConvRelu FLOAT16 NPU (1,2048,1,1),(512,2048,1,1),(512) (1,512,1,1) 88963 32768 88963 276 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2054 Conv:/_outfeats/_outfeats.0/Gemm_2conv
164 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 183 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/temporal_hydra/resblock/block_a/block_a.0/Gemm_2conv
165 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 182 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/summarizer/resblock/block_b/block_b.4/Gemm_2conv
166 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 232 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/hydra/resblock/block_a/block_a.0/Gemm_2conv
167 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 233 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/temporal_hydra/resblock/block_a/block_a.3/Gemm_2conv
168 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 234 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/temporal_hydra/resblock/block_b/block_b.1/Gemm_2conv
169 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 234 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/hydra/resblock/block_a/block_a.3/Gemm_2conv
170 ConvRelu FLOAT16 NPU (1,512,1,1),(1024,512,1,1),(1024) (1,1024,1,1) 44633 16384 44633 184 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/hydra/resblock/block_b/block_b.1/Gemm_2conv
171 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 180 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/temporal_hydra/resblock/block_b/block_b.4/Gemm_2conv
172 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/temporal_hydra/sim_pose/Gemm_2conv
173 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/temporal_hydra/desire_state/Gemm_2conv
174 ConvRelu FLOAT16 NPU (1,512,1,1),(64,512,1,1),(64) (1,64,1,1) 2831 1024 2831 93 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 65 Conv:/temporal_hydra/lane_lines/Gemm_2conv
175 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 89 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/temporal_hydra/road_edges/Gemm_2conv
176 ConvRelu FLOAT16 NPU (1,512,1,1),(16,512,1,1),(16) (1,16,1,1) 741 256 741 88 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 17 Conv:/temporal_hydra/lane_lines_prob/Gemm_2conv
177 ConvRelu FLOAT16 NPU (1,512,1,1),(16,512,1,1),(16) (1,16,1,1) 741 256 741 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 17 Conv:/temporal_hydra/lead_prob/Gemm_2conv
178 ConvRelu FLOAT16 NPU (1,512,1,1),(64,512,1,1),(64) (1,64,1,1) 2831 1024 2831 93 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 65 Conv:/temporal_hydra/lead/Gemm_2conv
179 ConvRelu FLOAT16 NPU (1,512,1,1),(256,512,1,1),(256) (1,256,1,1) 11191 4096 11191 110 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 258 Conv:/temporal_hydra/plan/Gemm_2conv
180 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/temporal_hydra/sim_pose/sim_pose.0/Gemm_2conv
181 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/temporal_hydra/desire_state/desire_state.0/Gemm_2conv
182 ConvRelu FLOAT16 NPU (1,64,1,1),(64,64,1,1),(64) (1,64,1,1) 368 128 368 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 8 Conv:/temporal_hydra/lane_lines/lane_lines.0/Gemm_2conv
183 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/temporal_hydra/road_edges/road_edges.0/Gemm_2conv
184 ConvRelu FLOAT16 NPU (1,16,1,1),(16,16,1,1),(16) (1,16,1,1) 28 32 32 85 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/lane_lines_prob/lane_lines_prob.0/Gemm_2conv
185 ConvRelu FLOAT16 NPU (1,16,1,1),(16,16,1,1),(16) (1,16,1,1) 28 32 32 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/lead_prob/lead_prob.0/Gemm_2conv
186 ConvRelu FLOAT16 NPU (1,64,1,1),(64,64,1,1),(64) (1,64,1,1) 368 128 368 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 8 Conv:/temporal_hydra/lead/lead.0/Gemm_2conv
187 ConvRelu FLOAT16 NPU (1,256,1,1),(256,256,1,1),(256) (1,256,1,1) 5628 2048 5628 99 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 129 Conv:/temporal_hydra/plan/plan.0/Gemm_2conv
188 ConvAddRelu FLOAT16 NPU (1,1024,1,1),(512,1024,1,1),(512),... (1,512,1,1) 44590 16384 44590 181 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 1029 Conv:/supercombo/no_bottleneck_policy/hydra/resblock/block_b/block_b.4/Gemm_2conv
189 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 141 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/supercombo/no_bottleneck_policy/hydra/wide_from_device_euler/Gemm_2conv
190 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 93 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/supercombo/no_bottleneck_policy/hydra/pose/Gemm_2conv
191 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/supercombo/no_bottleneck_policy/hydra/road_transform/Gemm_2conv
192 ConvRelu FLOAT16 NPU (1,512,1,1),(32,512,1,1),(32) (1,32,1,1) 1437 512 1437 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 33 Conv:/supercombo/no_bottleneck_policy/hydra/desire_pred/Gemm_2conv
193 ConvRelu FLOAT16 NPU (1,512,1,1),(64,512,1,1),(64) (1,64,1,1) 2831 1024 2831 93 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 65 Conv:/supercombo/no_bottleneck_policy/hydra/meta/Gemm_2conv
194 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/wide_from_device_euler/wide_from_device_euler.0/Gemm_2conv
195 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 85 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/pose/pose.0/Gemm_2conv
196 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/road_transform/road_transform.0/Gemm_2conv
197 ConvRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/desire_pred/desire_pred.0/Gemm_2conv
198 ConvRelu FLOAT16 NPU (1,64,1,1),(64,64,1,1),(64) (1,64,1,1) 368 128 368 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 8 Conv:/supercombo/no_bottleneck_policy/hydra/meta/meta.0/Gemm_2conv
199 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/temporal_hydra/sim_pose/sim_pose.2/Gemm_2conv
200 Conv FLOAT16 NPU (1,32,1,1),(12,32,1,1),(12) (1,12,1,1) 40 32 40 86 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/sim_pose_1/Gemm_2conv
201 Reshape FLOAT16 CPU (1,12,1,1),(4) (1,1,12,1) 0 0 0 1475 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i11_out
202 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/temporal_hydra/desire_state/desire_state.2/Gemm_2conv
203 Conv FLOAT16 NPU (1,32,1,1),(8,32,1,1),(8) (1,8,1,1) 28 32 32 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/desire_state_1/Gemm_2conv
204 Reshape FLOAT16 CPU (1,8,1,1),(4) (1,1,8,1) 0 0 0 1451 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i6_out
205 ConvAddRelu FLOAT16 NPU (1,64,1,1),(64,64,1,1),(64),... (1,64,1,1) 374 128 374 89 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 8 Conv:/temporal_hydra/lane_lines/lane_lines.2/Gemm_2conv
206 Conv FLOAT16 NPU (1,64,1,1),(528,64,1,1),(528) (1,528,1,1) 2997 1056 2997 94 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 68 Conv:/temporal_hydra/lane_lines_1/Gemm_2conv
207 Reshape FLOAT16 CPU (1,528,1,1),(4) (1,1,528,1) 0 0 0 1482 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 1 Reshape:/Concat_2_swap_concat_reshape_i1_out
208 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/temporal_hydra/road_edges/road_edges.2/Gemm_2conv
209 Conv FLOAT16 NPU (1,32,1,1),(264,32,1,1),(264) (1,264,1,1) 786 544 786 89 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 17 Conv:/temporal_hydra/road_edges_1/Gemm_2conv
210 Reshape FLOAT16 CPU (1,264,1,1),(4) (1,1,264,1) 0 0 0 1459 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i3_out
211 ConvAddRelu FLOAT16 NPU (1,16,1,1),(16,16,1,1),(16),... (1,16,1,1) 29 32 32 89 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/lane_lines_prob/lane_lines_prob.2/Gemm_2conv
212 Conv FLOAT16 NPU (1,16,1,1),(8,16,1,1),(8) (1,8,1,1) 16 32 32 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/lane_lines_prob_1/Gemm_2conv
213 Reshape FLOAT16 CPU (1,8,1,1),(4) (1,1,8,1) 0 0 0 1467 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i2_out
214 ConvAddRelu FLOAT16 NPU (1,16,1,1),(16,16,1,1),(16),... (1,16,1,1) 29 32 32 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/lead_prob/lead_prob.2/Gemm_2conv
215 Conv FLOAT16 NPU (1,16,1,1),(3,16,1,1),(3) (1,3,1,1) 9 32 32 88 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/temporal_hydra/lead_prob_1/Gemm_2conv
216 Reshape FLOAT16 CPU (1,3,1,1),(4) (1,1,3,1) 0 0 0 1452 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i5_out
217 ConvAddRelu FLOAT16 NPU (1,64,1,1),(64,64,1,1),(64),... (1,64,1,1) 374 128 374 91 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 8 Conv:/temporal_hydra/lead/lead.2/Gemm_2conv
218 Conv FLOAT16 NPU (1,64,1,1),(102,64,1,1),(102) (1,102,1,1) 586 224 586 88 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 13 Conv:/temporal_hydra/lead_1/Gemm_2conv
219 Reshape FLOAT16 CPU (1,102,1,1),(4) (1,1,102,1) 0 0 0 1520 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i4_out
220 ConvAddRelu FLOAT16 NPU (1,256,1,1),(256,256,1,1),(256),... (1,256,1,1) 5650 2048 5650 118 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 130 Conv:/temporal_hydra/plan/plan.2/Gemm_2conv
221 Conv FLOAT16 NPU (1,256,1,1),(4955,256,1,1),(4955) (1,4955,1,1) 108533 39680 108533 315 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2497 Conv:/temporal_hydra/plan_1/Gemm_2conv
222 Reshape FLOAT16 CPU (1,4955,1,1),(4) (1,1,4955,1) 0 0 0 1518 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 9 Reshape:/Concat_2_swap_concat_reshape_i0_out
223 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 92 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/wide_from_device_euler/wide_from_device_euler.2/Gemm_2conv
224 Conv FLOAT16 NPU (1,32,1,1),(6,32,1,1),(6) (1,6,1,1) 23 32 32 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/supercombo/no_bottleneck_policy/hydra/wide_from_device_euler_1/Gemm_2conv
225 Reshape FLOAT16 CPU (1,6,1,1),(4) (1,1,6,1) 0 0 0 1470 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i10_out
226 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/pose/pose.2/Gemm_2conv
227 Conv FLOAT16 NPU (1,32,1,1),(12,32,1,1),(12) (1,12,1,1) 40 32 40 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/supercombo/no_bottleneck_policy/hydra/pose_1/Gemm_2conv
228 Reshape FLOAT16 CPU (1,12,1,1),(4) (1,1,12,1) 0 0 0 1451 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i9_out
229 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 91 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/road_transform/road_transform.2/Gemm_2conv
230 Conv FLOAT16 NPU (1,32,1,1),(12,32,1,1),(12) (1,12,1,1) 40 32 40 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 0 Conv:/supercombo/no_bottleneck_policy/hydra/road_transform_1/Gemm_2conv
231 Reshape FLOAT16 CPU (1,12,1,1),(4) (1,1,12,1) 0 0 0 1469 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i12_out
232 ConvAddRelu FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32),... (1,32,1,1) 101 64 101 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/desire_pred/desire_pred.2/Gemm_2conv
233 Conv FLOAT16 NPU (1,32,1,1),(32,32,1,1),(32) (1,32,1,1) 98 64 98 87 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 2 Conv:/supercombo/no_bottleneck_policy/hydra/desire_pred_1/Gemm_2conv
234 Reshape FLOAT16 CPU (1,32,1,1),(4) (1,1,32,1) 0 0 0 1452 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i8_out
235 ConvAddRelu FLOAT16 NPU (1,64,1,1),(64,64,1,1),(64),... (1,64,1,1) 374 128 374 90 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 8 Conv:/supercombo/no_bottleneck_policy/hydra/meta/meta.2/Gemm_2conv
236 Conv FLOAT16 NPU (1,64,1,1),(48,64,1,1),(48) (1,48,1,1) 278 96 278 89 0.00/0.00/0.00 300.0%/0.0%/0.0%--Up:-200.0% 1/0 6 Conv:/supercombo/no_bottleneck_policy/hydra/meta_1/Gemm_2conv
237 Reshape FLOAT16 CPU (1,48,1,1),(4) (1,1,48,1) 0 0 0 1479 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 0 Reshape:/Concat_2_swap_concat_reshape_i7_out
238 Concat FLOAT16 NPU (1,1,4955,1),(1,1,528,1),(1,1,8,1),... (1,1,6120,1) 8280 0 8280 179 \ 300.0%/0.0%/0.0%--Up:-200.0% 15/0 95 Concat:/Concat_2
239 Reshape FLOAT16 CPU (1,1,6120,1),(2) (1,6120) 0 0 0 1200 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 95 Reshape:/Concat_2_0_unsqueeze1
240 OutputOperator FLOAT16 CPU (1,6120) \ 0 0 0 6 \ 0.0%/0.0%/0.0%--Up:0.0% 0/0 11 OutputOperator:outputs
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total Operator Elapsed Per Frame Time(us): 72766
Total Memory Read/Write Per Frame Size(KB): 71047.9
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------
Operator Time Consuming Ranking Table
---------------------------------------------------------------------------------------------------
OpType CallNumber CPUTime(us) GPUTime(us) NPUTime(us) TotalTime(us) TimeRatio(%)
---------------------------------------------------------------------------------------------------
Reshape 22 32473 0 0 32473 44.63%
ConvElu 79 0 0 20315 20315 27.92%
ConvRelu 42 0 0 5827 5827 8.01%
Conv 32 0 0 5113 5113 7.03%
ConvAdd 25 0 0 3280 3280 4.51%
ConvAddRelu 23 0 0 3187 3187 4.38%
Div 1 925 0 0 925 1.27%
Sqrt 1 620 0 0 620 0.85%
Concat 4 0 0 507 507 0.70%
Gather 1 316 0 0 316 0.43%
Clip 1 0 0 88 88 0.12%
Mul 1 0 0 88 88 0.12%
InputOperator 7 21 0 0 21 0.03%
OutputOperator 1 6 0 0 6 0.01%
---------------------------------------------------------------------------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment