SNPE Performance Comparison between 1.61 and 1.64

fast.svg

<svg width="1000" viewBox="0 0 2671 1029" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" xml:space="preserve" overflow="hidden"><defs><clipPath id="clip0"><rect x="1202" y="1233" width="2671" height="1029"/></clipPath><clipPath id="clip1"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip2"><rect x="1354" y="1404" width="2469" height="648"/></clipPath><clipPath id="clip3"><rect x="1354" y="1404" width="2469" height="648"/></clipPath><clipPath id="clip4"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip5"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip6"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip7"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip8"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip9"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip10"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip11"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip12"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip13"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip14"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip15"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip16"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip17"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip18"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip19"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip20"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip21"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip22"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip23"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip24"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip25"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip26"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip27"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip28"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip29"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip30"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip31"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip32"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip33"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip34"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip35"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip36"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip37"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip38"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip39"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip40"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip41"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip42"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip43"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip44"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip45"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip46"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip47"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip48"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip49"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip50"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip51"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip52"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip53"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip54"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip55"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip56"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip57"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip58"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip59"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath><clipPath id="clip60"><rect x="1203" y="1234" width="2667" height="1026"/></clipPath></defs><g clip-path="url(#clip0)" transform="translate(-1202 -1233)"><rect x="1203" y="1234" width="2668" height="1026" fill="#FFFFFF"/><g clip-path="url(#clip1)"><path d="M1354.5 1919.56 3820.5 1919.56M1354.5 1790.56 3820.5 1790.56M1354.5 1661.55 3820.5 1661.55M1354.5 1532.55 3820.5 1532.55M1354.5 1404.5 3820.5 1404.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g><g clip-path="url(#clip2)"><path d="M1368.04 1803.06 1380.05 1803.06 1380.05 2049 1368.04 2049ZM1423.05 1777.06 1435.05 1777.06 1435.05 2049 1423.05 2049ZM1478.05 1774.06 1490.05 1774.06 1490.05 2049 1478.05 2049ZM1533.05 1768.06 1545.05 1768.06 1545.05 2049 1533.05 2049ZM1587.05 1768.06 1600.05 1768.06 1600.05 2049 1587.05 2049ZM1642.05 1762.06 1654.05 1762.06 1654.05 2049 1642.05 2049ZM1697.06 1758.06 1709.06 1758.06 1709.06 2049 1697.06 2049ZM1752.06 1696.06 1764.06 1696.06 1764.06 2049 1752.06 2049ZM1806.06 1688.06 1819.06 1688.06 1819.06 2049 1806.06 2049ZM1861.06 1682.06 1874.06 1682.06 1874.06 2049 1861.06 2049ZM1916.06 1678.06 1928.06 1678.06 1928.06 2049 1916.06 2049ZM1971.06 1641.05 1983.07 1641.05 1983.07 2049 1971.06 2049ZM2026.07 1621.05 2038.07 1621.05 2038.07 2049 2026.07 2049ZM2080.07 1614.05 2093.07 1614.05 2093.07 2049 2080.07 2049ZM2135.07 1611.05 2147.07 1611.05 2147.07 2049 2135.07 2049ZM2190.07 1603.05 2202.07 1603.05 2202.07 2049 2190.07 2049ZM2245.07 1601.05 2257.07 1601.05 2257.07 2049 2245.07 2049ZM2300.08 1600.05 2312.08 1600.05 2312.08 2049 2300.08 2049ZM2354.08 1600.05 2367.08 1600.05 2367.08 2049 2354.08 2049ZM2409.08 1599.05 2421.08 1599.05 2421.08 2049 2409.08 2049ZM2464.08 1597.05 2476.08 1597.05 2476.08 2049 2464.08 2049ZM2519.08 1594.05 2531.08 1594.05 2531.08 2049 2519.08 2049ZM2573.08 1594.05 2586.08 1594.05 2586.08 2049 2573.08 2049ZM2628.09 1591.05 2641.09 1591.05 2641.09 2049 2628.09 2049ZM2683.09 1590.05 2695.09 1590.05 2695.09 2049 2683.09 2049ZM2738.09 1590.05 2750.09 1590.05 2750.09 2049 2738.09 2049ZM2793.09 1590.05 2805.09 1590.05 2805.09 2049 2793.09 2049ZM2847.09 1589.05 2860.09 1589.05 2860.09 2049 2847.09 2049ZM2902.1 1589.05 2914.1 1589.05 2914.1 2049 2902.1 2049ZM2957.1 1588.05 2969.1 1588.05 2969.1 2049 2957.1 2049ZM3012.1 1585.05 3024.1 1585.05 3024.1 2049 3012.1 2049ZM3067.1 1582.05 3079.1 1582.05 3079.1 2049 3067.1 2049ZM3121.1 1582.05 3134.1 1582.05 3134.1 2049 3121.1 2049ZM3176.1 1582.05 3188.1 1582.05 3188.1 2049 3176.1 2049ZM3231.11 1582.05 3243.11 1582.05 3243.11 2049 3231.11 2049ZM3286.11 1581.05 3298.11 1581.05 3298.11 2049 3286.11 2049ZM3340.11 1581.05 3353.11 1581.05 3353.11 2049 3340.11 2049ZM3395.11 1580.05 3408.11 1580.05 3408.11 2049 3395.11 2049ZM3450.11 1580.05 3462.11 1580.05 3462.11 2049 3450.11 2049ZM3505.12 1580.05 3517.12 1580.05 3517.12 2049 3505.12 2049ZM3560.12 1580.05 3572.12 1580.05 3572.12 2049 3560.12 2049ZM3614.12 1578.05 3627.12 1578.05 3627.12 2049 3614.12 2049ZM3669.12 1578.05 3681.12 1578.05 3681.12 2049 3669.12 2049ZM3724.12 1578.05 3736.12 1578.05 3736.12 2049 3724.12 2049ZM3779.12 1578.05 3791.12 1578.05 3791.12 2049 3779.12 2049Z" fill="#4472C4"/></g><g clip-path="url(#clip3)"><path d="M1384.05 1604.05 1396.05 1604.05 1396.05 2049 1384.05 2049ZM1439.05 1586.05 1451.05 1586.05 1451.05 2049 1439.05 2049ZM1493.05 1586.05 1506.05 1586.05 1506.05 2049 1493.05 2049ZM1548.05 1579.05 1560.05 1579.05 1560.05 2049 1548.05 2049ZM1603.05 1583.05 1615.05 1583.05 1615.05 2049 1603.05 2049ZM1658.05 1575.05 1670.05 1575.05 1670.05 2049 1658.05 2049ZM1713.06 1570.05 1725.06 1570.05 1725.06 2049 1713.06 2049ZM1767.06 1533.05 1780.06 1533.05 1780.06 2049 1767.06 2049ZM1822.06 1528.05 1834.06 1528.05 1834.06 2049 1822.06 2049ZM1877.06 1523.05 1889.06 1523.05 1889.06 2049 1877.06 2049ZM1932.06 1514.05 1944.06 1514.05 1944.06 2049 1932.06 2049ZM1986.07 1500.05 1999.07 1500.05 1999.07 2049 1986.07 2049ZM2041.07 1488.05 2053.07 1488.05 2053.07 2049 2041.07 2049ZM2096.07 1483.05 2108.07 1483.05 2108.07 2049 2096.07 2049ZM2151.07 1523.05 2163.07 1523.05 2163.07 2049 2151.07 2049ZM2206.07 1486.05 2218.07 1486.05 2218.07 2049 2206.07 2049ZM2260.07 1518.05 2273.07 1518.05 2273.07 2049 2260.07 2049ZM2315.08 1477.05 2327.08 1477.05 2327.08 2049 2315.08 2049ZM2370.08 1506.05 2382.08 1506.05 2382.08 2049 2370.08 2049ZM2425.08 1496.05 2437.08 1496.05 2437.08 2049 2425.08 2049ZM2479.08 1504.05 2492.08 1504.05 2492.08 2049 2479.08 2049ZM2534.08 1514.05 2547.08 1514.05 2547.08 2049 2534.08 2049ZM2589.08 1518.05 2601.09 1518.05 2601.09 2049 2589.08 2049ZM2644.09 1521.05 2656.09 1521.05 2656.09 2049 2644.09 2049ZM2699.09 1501.05 2711.09 1501.05 2711.09 2049 2699.09 2049ZM2753.09 1491.05 2766.09 1491.05 2766.09 2049 2753.09 2049ZM2808.09 1507.05 2820.09 1507.05 2820.09 2049 2808.09 2049ZM2863.09 1490.05 2875.09 1490.05 2875.09 2049 2863.09 2049ZM2918.1 1515.05 2930.1 1515.05 2930.1 2049 2918.1 2049ZM2973.1 1481.05 2985.1 1481.05 2985.1 2049 2973.1 2049ZM3027.1 1532.05 3040.1 1532.05 3040.1 2049 3027.1 2049ZM3082.1 1518.05 3094.1 1518.05 3094.1 2049 3082.1 2049ZM3137.1 1520.05 3149.1 1520.05 3149.1 2049 3137.1 2049ZM3192.1 1498.05 3204.11 1498.05 3204.11 2049 3192.1 2049ZM3246.11 1471.05 3259.11 1471.05 3259.11 2049 3246.11 2049ZM3301.11 1495.05 3314.11 1495.05 3314.11 2049 3301.11 2049ZM3356.11 1510.05 3368.11 1510.05 3368.11 2049 3356.11 2049ZM3411.11 1451.05 3423.11 1451.05 3423.11 2049 3411.11 2049ZM3466.11 1469.05 3478.11 1469.05 3478.11 2049 3466.11 2049ZM3520.12 1504.05 3533.12 1504.05 3533.12 2049 3520.12 2049ZM3575.12 1479.05 3587.12 1479.05 3587.12 2049 3575.12 2049ZM3630.12 1484.05 3642.12 1484.05 3642.12 2049 3630.12 2049ZM3685.12 1509.05 3697.12 1509.05 3697.12 2049 3685.12 2049ZM3740.12 1518.05 3752.12 1518.05 3752.12 2049 3740.12 2049ZM3794.12 1497.05 3807.12 1497.05 3807.12 2049 3794.12 2049Z" fill="#ED7D31"/></g><g clip-path="url(#clip4)"><path d="M1354.5 2048.5 3820.5 2048.5" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none" fill-rule="evenodd"/></g><g clip-path="url(#clip5)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1295.62 2061)">0</text></g><g clip-path="url(#clip6)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1253.82 1932)">500</text></g><g clip-path="url(#clip7)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1232.92 1803)">1000</text></g><g clip-path="url(#clip8)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1232.92 1674)">1500</text></g><g clip-path="url(#clip9)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1232.92 1545)">2000</text></g><g clip-path="url(#clip10)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1232.92 1416)">2500</text></g><g clip-path="url(#clip11)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1371.73 2114)">1</text></g><g clip-path="url(#clip12)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1426.51 2114)">2</text></g><g clip-path="url(#clip13)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1481.3 2114)">3</text></g><g clip-path="url(#clip14)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1536.09 2114)">4</text></g><g clip-path="url(#clip15)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1590.88 2114)">5</text></g><g clip-path="url(#clip16)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1645.66 2114)">6</text></g><g clip-path="url(#clip17)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1700.45 2114)">7</text></g><g clip-path="url(#clip18)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1755.24 2114)">8</text></g><g clip-path="url(#clip19)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1810.02 2114)">9</text></g><g clip-path="url(#clip20)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1854.36 2114)">10</text></g><g clip-path="url(#clip21)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1909.15 2114)">11</text></g><g clip-path="url(#clip22)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 1963.94 2114)">12</text></g><g clip-path="url(#clip23)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2018.72 2114)">13</text></g><g clip-path="url(#clip24)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2073.51 2114)">14</text></g><g clip-path="url(#clip25)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2128.3 2114)">15</text></g><g clip-path="url(#clip26)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2183.09 2114)">16</text></g><g clip-path="url(#clip27)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2237.87 2114)">17</text></g><g clip-path="url(#clip28)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2292.66 2114)">18</text></g><g clip-path="url(#clip29)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2347.45 2114)">19</text></g><g clip-path="url(#clip30)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2402.23 2114)">20</text></g><g clip-path="url(#clip31)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2457.02 2114)">21</text></g><g clip-path="url(#clip32)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2511.81 2114)">22</text></g><g clip-path="url(#clip33)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2566.6 2114)">23</text></g><g clip-path="url(#clip34)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2621.38 2114)">24</text></g><g clip-path="url(#clip35)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2676.17 2114)">25</text></g><g clip-path="url(#clip36)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2730.96 2114)">26</text></g><g clip-path="url(#clip37)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2785.74 2114)">27</text></g><g clip-path="url(#clip38)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2840.53 2114)">28</text></g><g clip-path="url(#clip39)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2895.32 2114)">29</text></g><g clip-path="url(#clip40)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2950.11 2114)">30</text></g><g clip-path="url(#clip41)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3004.89 2114)">31</text></g><g clip-path="url(#clip42)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3059.68 2114)">32</text></g><g clip-path="url(#clip43)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3114.47 2114)">33</text></g><g clip-path="url(#clip44)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3169.26 2114)">34</text></g><g clip-path="url(#clip45)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3224.04 2114)">35</text></g><g clip-path="url(#clip46)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3278.83 2114)">36</text></g><g clip-path="url(#clip47)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3333.62 2114)">37</text></g><g clip-path="url(#clip48)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3388.4 2114)">38</text></g><g clip-path="url(#clip49)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3443.19 2114)">39</text></g><g clip-path="url(#clip50)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3497.98 2114)">40</text></g><g clip-path="url(#clip51)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3552.77 2114)">41</text></g><g clip-path="url(#clip52)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3607.55 2114)">42</text></g><g clip-path="url(#clip53)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3662.34 2114)">43</text></g><g clip-path="url(#clip54)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3717.13 2114)">44</text></g><g clip-path="url(#clip55)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 3771.91 2114)">45</text></g><g clip-path="url(#clip56)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="64" transform="matrix(1 0 0 1 1715.39 1329)">snpe_bench inference time comparison between 1.61 and 1.64</text></g><g clip-path="url(#clip57)"><rect x="2314" y="2183" width="23" height="22" fill="#4472C4"/></g><g clip-path="url(#clip58)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2346.4 2206)">mean 1.61</text></g><g clip-path="url(#clip59)"><rect x="2566" y="2183" width="23" height="22" fill="#ED7D31"/></g><g clip-path="url(#clip60)"><text fill="#595959" font-family="Calibri,Calibri_MSFontService,sans-serif" font-weight="400" font-size="41" transform="matrix(1 0 0 1 2598.75 2206)">mean 1.64</text></g><rect x="1203.5" y="1234.5" width="2668" height="1026" stroke="#D9D9D9" stroke-width="3.4375" stroke-linejoin="round" stroke-miterlimit="10" fill="none"/></g></svg>

large.svg

medium.svg

perf.md

SNPE Performance Comparison between 1.61 and 1.64

I upgraded my Qualcomm 888 testing pipeline to a new version of the SNPE SDK moving from snpe-1.61.0 to snpe-1.64.0. Then re-ran all our 8000 models we have been testing. The results are mixed. On the one hand snpe-1.64.0 seems to have fixed some quantization bugs such that a lot more models are getting an interesting non-zero F1 accuracy score and all scores are the same or better than before, but on the other hand the mean inference times have slowed down some. The slow down is more evident in the smaller faster models. So my question is for smaller models the perf hit is pretty bad, is this a known issue and something that will likely improve in future versions of the SDK ?

Here's the results on the smaller faster models:

Here's the result on medium sized models:

Here's the results on larger models: