hardened.diff

--- results.md	2018-12-09 19:12:39.636689970 -0500
+++ hardened_results.md	2018-12-09 19:12:39.173350525 -0500
@@ -26,6 +26,7 @@
 * CtsAppComponentFactoryTestCases - pass
 * CtsAppSecurityHostTestCases - pass (flaky)
     - very flaky: android.appsecurity.cts.EphemeralTest#testNormalStartEphemeral
+    - flaky: android.appsecurity.cts.ExternalStorageHostTest#testExternalStorageNone
     - flaky: android.appsecurity.cts.InstantCookieHostTest#testCookieUpdateAndRetrieval
 * CtsAppTestCases - pass
     - flaky: android.app.cts.ExpandableListActivityTest#testSelect
@@ -42,16 +43,27 @@
 * CtsBackgroundRestrictionsTestCases - pass
 * CtsBackupHostTestCases - pass
 * CtsBackupTestCases - pass
-    - flaky: android.backup.cts.FullBackupQuotaTest#testQuotaExceeded
 * CtsBatterySavingTestCases - pass
 * CtsBionicTestCases - pass
+    - 2 intentional failures from returning EINVAL on invalid non power of 2 alignments:
+        - malloc#memalign_multiple
+        - malloc#memalign_non_power2
+    - 1 intentional failure from using safer standards compliant realloc(ptr, 0)
+        - malloc#realloc_0
 * CtsBluetoothTestCases - pass
 * CtsBootStatsTestCases - pass
 * CtsCalendarcommon2TestCases - pass
 * CtsCameraApi25TestCases - pass
-* CtsCameraTestCases - pass
-    - overall quite flaky due to not having a great setup for lighting, etc.
-    - flaky: android.hardware.camera2.cts.StillCaptureTest#testAfRegions
+* CtsCameraTestCases - seemingly random crashes in random tests [HARDENED_MALLOC]
+    - android.hardware.camera2.cts.NativeImageReaderTest#testImageReaderCloseAcquiredImages
+      - crash, likely use-after-free (null pointer dereference)
+    - android.hardware.camera2.cts.StillCaptureTest#testAfRegions
+        - didn't seem to fail without hardened malloc, need to verify that, no
+          apparent crash though just a time out on auto focus
+    - android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceRepeatingBurst
+    - android.hardware.camera2.cts.PerformanceTest#testMultipleCapture
+    - android.hardware.camera2.cts.ReprocessCaptureTest#testMixedBurstReprocessing
+    - etc. (not consistent)
 * CtsCarTestCases - pass
 * CtsCarrierApiTestCases - pass
     - 6 passed, 14 require SIM card with carrier privilege rule to run
@@ -63,9 +75,93 @@
 * CtsCurrentApiSignatureTestCases - pass
 * CtsDatabaseTestCases - pass
 * CtsDebugTestCases - pass
-* CtsDeqpTestCases - pass
+* CtsDeqpTestCases - fail
+    - memory corruption bug triggered repeatedly on armv8a only, SEGV_ACCERR
+      0x7200dfc074 (always ends in 0x074)
+
+12-08 22:42:37 I/ModuleListener: [29/3673] dEQP-EGL.functional.query_context.get_current_context#rgb565_window fail:
+12-08 22:42:50 I/ModuleListener: [32/3673] dEQP-EGL.functional.query_context.get_current_context#rgb888_window fail:
+12-08 22:43:03 I/ModuleListener: [35/3673] dEQP-EGL.functional.query_context.get_current_context#rgba4444_window fail:
+12-08 22:43:16 I/ModuleListener: [38/3673] dEQP-EGL.functional.query_context.get_current_context#rgba5551_window fail:
+12-08 22:43:29 I/ModuleListener: [41/3673] dEQP-EGL.functional.query_context.get_current_context#rgba8888_window fail:
+12-08 22:43:43 I/ModuleListener: [45/3673] dEQP-EGL.functional.query_context.get_current_surface#rgb565_window fail:
+12-08 22:43:56 I/ModuleListener: [48/3673] dEQP-EGL.functional.query_context.get_current_surface#rgb888_window fail:
+12-08 22:44:09 I/ModuleListener: [51/3673] dEQP-EGL.functional.query_context.get_current_surface#rgba4444_window fail:
+12-08 22:44:22 I/ModuleListener: [54/3673] dEQP-EGL.functional.query_context.get_current_surface#rgba5551_window fail:
+12-08 22:44:42 I/ModuleListener: [57/3673] dEQP-EGL.functional.query_context.get_current_surface#rgba8888_window fail:
+12-08 22:44:55 I/ModuleListener: [61/3673] dEQP-EGL.functional.query_context.get_current_display#rgb565_window fail:
+12-08 22:45:08 I/ModuleListener: [64/3673] dEQP-EGL.functional.query_context.get_current_display#rgb888_window fail:
+12-08 22:45:27 I/ModuleListener: [67/3673] dEQP-EGL.functional.query_context.get_current_display#rgba4444_window fail:
+12-08 22:45:41 I/ModuleListener: [70/3673] dEQP-EGL.functional.query_context.get_current_display#rgba5551_window fail:
+12-08 22:45:54 I/ModuleListener: [73/3673] dEQP-EGL.functional.query_context.get_current_display#rgba8888_window fail:
+12-08 22:46:07 I/ModuleListener: [77/3673] dEQP-EGL.functional.query_context.query_context#rgb565_window fail:
+12-08 22:46:20 I/ModuleListener: [80/3673] dEQP-EGL.functional.query_context.query_context#rgb888_window fail:
+12-08 22:46:40 I/ModuleListener: [83/3673] dEQP-EGL.functional.query_context.query_context#rgba4444_window fail:
+12-08 22:46:53 I/ModuleListener: [86/3673] dEQP-EGL.functional.query_context.query_context#rgba5551_window fail:
+12-08 22:47:12 I/ModuleListener: [89/3673] dEQP-EGL.functional.query_context.query_context#rgba8888_window fail:
+
+12-08 22:48:54 I/ModuleListener: [995/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgb8_texture fail:
+12-08 22:49:07 I/ModuleListener: [997/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgb565_texture fail:
+12-08 22:49:20 I/ModuleListener: [999/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgba8_texture fail:
+12-08 22:49:40 I/ModuleListener: [1001/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgb5_a1_texture fail:
+12-08 22:49:53 I/ModuleListener: [1003/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgba4_texture fail:
+12-08 22:50:07 I/ModuleListener: [1005/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_x_rgba8_texture fail:
+12-08 22:50:20 I/ModuleListener: [1007/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_y_rgba8_texture fail:
+12-08 22:50:33 I/ModuleListener: [1009/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_z_rgba8_texture fail:
+12-08 22:50:46 I/ModuleListener: [1011/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_x_rgba8_texture fail:
+12-08 22:51:00 I/ModuleListener: [1013/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_y_rgba8_texture fail:
+12-08 22:51:13 I/ModuleListener: [1015/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_z_rgba8_texture fail:
+12-08 22:51:26 I/ModuleListener: [1017/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_x_rgb8_texture fail:
+12-08 22:51:39 I/ModuleListener: [1019/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_y_rgb8_texture fail:
+12-08 22:51:58 I/ModuleListener: [1021/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_z_rgb8_texture fail:
+12-08 22:52:12 I/ModuleListener: [1023/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_x_rgb8_texture fail:
+12-08 22:52:25 I/ModuleListener: [1025/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_y_rgb8_texture fail:
+12-08 22:52:38 I/ModuleListener: [1027/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_z_rgb8_texture fail:
+12-08 22:52:58 I/ModuleListener: [1029/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_renderbuffer_rgba4_texture fail:
+12-08 22:53:17 I/ModuleListener: [1031/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_renderbuffer_rgb5_a1_texture fail:
+12-08 22:53:30 I/ModuleListener: [1033/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_renderbuffer_rgb565_texture fail:
+
+12-08 22:45:14.559 27696 27696 F DEBUG   :     #00 pc 0000000000236358  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::FreeAllocationOnTimestampCommon(EsxContext*, EsxMemAllocDescInstance)+552)
+12-08 22:45:14.559 27696 27696 F DEBUG   :     #01 pc 0000000000236534  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::Destroy(EsxContext*)+64)
+12-08 22:45:14.559 27696 27696 F DEBUG   :     #02 pc 0000000000335394  /vendor/lib64/egl/libGLESv2_adreno.so (A5xResource::HwFreeSubResource(EsxContext*, EsxSubResource*) const+56)
+12-08 22:45:14.559 27696 27696 F DEBUG   :     #03 pc 00000000001ae0dc  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::FreeSubResource(EsxContext*, EsxSubResource*)+52)
+12-08 22:45:14.559 27696 27696 F DEBUG   :     #04 pc 00000000001adf70  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::Destroy(EsxContext*)+100)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #05 pc 0000000000202cf4  /vendor/lib64/egl/libGLESv2_adreno.so (EglSurface::Destroy()+72)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #06 pc 00000000001eb580  /vendor/lib64/egl/libGLESv2_adreno.so (EglApi::DestroySurface(void*, void*)+176)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #07 pc 0000000000015f24  /system/lib64/libEGL.so (eglDestroySurface+100)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #08 pc 0000000001178608  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (eglu::UniqueSurface::~UniqueSurface()+32)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #09 pc 000000000138a340  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (deqp::egl::RenderCase::executeForConfig(void*, void*)+1004)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #10 pc 00000000013af5c4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (deqp::egl::SimpleConfigCase::iterate()+44)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #11 pc 0000000001124ef8  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::iterateTestCase(tcu::TestCase*)+52)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #12 pc 0000000001124744  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::iterate()+332)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #13 pc 00000000010e6bd4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::App::iterate()+60)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #14 pc 00000000012a20f4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::TestThread::render()+36)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #15 pc 00000000012a195c  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::RenderThread::run()+256)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #16 pc 0000000001fe99bc  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (startThread+12)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #17 pc 00000000000842c4  /system/lib64/libc.so (__pthread_start(void*)+36)
+12-08 22:45:14.560 27696 27696 F DEBUG   :     #18 pc 000000000002473c  /system/lib64/libc.so (__start_thread+68)
+
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #00 pc 0000000000236358  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::FreeAllocationOnTimestampCommon(EsxContext*, EsxMemAllocDescInstance)+552)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #01 pc 0000000000236534  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::Destroy(EsxContext*)+64)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #02 pc 0000000000335394  /vendor/lib64/egl/libGLESv2_adreno.so (A5xResource::HwFreeSubResource(EsxContext*, EsxSubResource*) const+56)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #03 pc 00000000001ae0dc  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::FreeSubResource(EsxContext*, EsxSubResource*)+52)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #04 pc 00000000001adf70  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::Destroy(EsxContext*)+100)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #05 pc 0000000000202cf4  /vendor/lib64/egl/libGLESv2_adreno.so (EglSurface::Destroy()+72)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #06 pc 00000000001eb580  /vendor/lib64/egl/libGLESv2_adreno.so (EglApi::DestroySurface(void*, void*)+176)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #07 pc 0000000000015f24  /system/lib64/libEGL.so (eglDestroySurface+100)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #08 pc 000000000134d358  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (deqp::egl::Image::ImageFormatCase::deinit()+144)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #09 pc 0000000001124a14  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::leaveTestCase(tcu::TestCase*)+60)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #10 pc 0000000001124690  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::iterate()+152)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #11 pc 00000000010e6bd4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::App::iterate()+60)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #12 pc 00000000012a20f4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::TestThread::render()+36)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #13 pc 00000000012a195c  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::RenderThread::run()+256)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #14 pc 0000000001fe99bc  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (startThread+12)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #15 pc 00000000000842c4  /system/lib64/libc.so (__pthread_start(void*)+36)
+12-08 22:53:24.145  2922  2922 F DEBUG   :     #16 pc 000000000002473c  /system/lib64/libc.so (__start_thread+68)
+
 * CtsDeviceIdleHostTestCases - pass
-* CtsDevicePolicyManagerTestCases - pass
+* CtsDevicePolicyManagerTestCases - fail
+    - random failures with 'Failed to parse result: cmd: Can't find service: package'
 * CtsDexMetadataHostTestCases - pass
 * CtsDisplayTestCases - pass
 * CtsDpiTestCases - pass
@@ -100,8 +196,11 @@
 * CtsHostsideWebViewTests - 1 failure
     - failure: com.android.cts.webkit.WebViewHostSideStartupTest#testStrictMode
 * CtsIcuTestCases - pass
-* CtsIncidentHostTestCases - pass
-    - flaky: com.android.server.cts.IncidentdTest#testIncidentReportDumpAuto
+* CtsIncidentHostTestCases - 4 failures
+    - failure: com.android.server.cts.ErrorsTest#testNativeCrashA
+    - failure: com.android.server.cts.IncidentdTest#testIncidentReportDumpAuto
+    - failure: com.android.server.cts.IncidentdTest#testIncidentReportDumpExplicit
+    - failure: com.android.server.cts.IncidentdTest#testIncidentReportDumpLocal
 * CtsInlineMockingTestCases - pass
 * CtsInputMethodServiceHostTestCases - pass
 * CtsInputMethodTestCases - pass
@@ -217,18 +316,22 @@
 * CtsLocation2TestCases - pass
 * CtsLocationTestCases - pass
     - flaky indoors
+    - need to look into this more with hardened malloc due to existing
+      flakiness making it hard to identify new issues
 * CtsLogdTestCases - pass
 * CtsMediaBitstreamsTestCases - pass
 * CtsMediaHostTestCases - pass
 * CtsMediaStressTestCases - pass
-* CtsMediaTestCases - 1 failure + flaky tests
+* CtsMediaTestCases - 2 failures
+    - 1 failure (crash): android.media.cts.DecoderConformanceTest#testVP9Other
     - the flaky network tests seem to be flaky themselves in general, so others may also occasionally fail
     - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S3P00001
     - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S4P00001
     - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S5P00001
     - flaky: android.media.cts.VideoDecoderPerfTest#testHevcGoog0Perf0640x0360 (maybe others too)
     - flaky: android.media.cts.StreamingMediaPlayerTest#testPlayHlsStream (maybe others too)
-    - failure: android.media.cts.MediaSessionManagerTest#testRemoteUserInfo
+    - framerate too high? android.media.cts.VideoDecoderPerfTest#testAvcGoog0Perf0720x0480
+    - failure (timeout): android.media.cts.VideoEncoderTest#testGoogVP9SurfArbitraryH
 * CtsMidiTestCases - pass
 * CtsMockingDebuggableTestCases - pass
 * CtsMockingTestCases - pass
@@ -274,7 +377,9 @@
 * CtsPrintTestCases - pass
     - flaky
 * CtsProtoTestCases - pass
-* CtsProviderTestCases - pass
+* CtsProviderTestCases - 2 failures
+    - android.provider.cts.contacts.ContactsContract_DumpFileProviderTest#testQuery_throwsErrorWithIllegalFileName
+    - android.provider.cts.contacts.ContactsContract_DumpFileProviderTest#testOpenFileDescriptor_throwsErrorWithIllegalFileName
 * CtsRenderscriptLegacyTestCases - pass
 * CtsRenderscriptTestCases - pass
 * CtsRsBlasTestCases - pass
@@ -300,7 +405,8 @@
 * CtsSkQPTestCases - pass
 * CtsSliceTestCases - pass
 * CtsSpeechTestCases - pass
-* CtsStatsdHostTestCases - pass
+* CtsStatsdHostTestCases - 1 failure
+    - failure: android.cts.statsd.atom.UidAtomTests#testCpuTimePerUid
 * CtsSustainedPerformanceHostTestCases - pass
 * CtsSyncAccountAccessOtherCertTestCases - pass
 * CtsSyncContentHostTestCases - pass
@@ -348,10 +454,10 @@
 * CtsVoiceSettingsTestCases - pass
 * CtsVrTestCases - pass
 * CtsWebkitTestCases - pass
-    - flaky: android.webkit.cts.WebChromeClientTest#testOnJsBeforeUnloadIsCalled
 * CtsWidgetTestCases - pass
 * CtsWindowManagerDeviceTestCases - pass
     - flaky: android.server.wm.DialogFrameTests#testExplicitSizeBottomRightGravity
+    - flaky: android.server.wm.DialogFrameTests#testExplicitSizeDefaultGravity
 * CtsWrapNoWrapTestCases - pass
 * CtsWrapWrapDebugMallocDebugTestCases - pass
 * CtsWrapWrapDebugTestCases - pass

hardened.txt

CTS results on Pixel 2 (walleye) running AOSP PQ1A.181105.017.A1 (android-9.0.0_r16) with Chromium 70.0.3538.110 monochrome_public_apk as the WebView and browser

* CtsAbiOverrideHostTestCases - pass
* CtsAccelerationTestCases - pass
* CtsAccessibilityServiceTestCases - pass
* CtsAccessibilityTestCases - pass
* CtsAccountManagerTestCases - pass
* CtsActivityManagerDeviceSdk25TestCases - pass
* CtsActivityManagerDeviceTestCases - pass (flaky)
    - test module is quite flaky seemingly due to race conditions in how the
      tests are implemented, so occasional failures don't necessarily indicate
      problems in the OS
    - very flaky: android.server.am.ActivityManagerDisplayLockedKeyguardTests#testDismissKeyguard_whileOccluded_secondaryDisplay
* CtsAdminPackageInstallerTestCases - pass
* CtsAdminTestCases - pass
* CtsAlarmClockTestCases - pass
* CtsAlarmManagerTestCases - pass
* CtsAndroidAppTestCases - pass
* CtsAndroidTestBase27ApiSignatureTestCases - pass
* CtsAndroidTestMockCurrentApiSignatureTestCases - pass
* CtsAndroidTestRunnerCurrentApiSignatureTestCases - pass
* CtsAnimationTestCases - pass
* CtsApacheHttpLegacy27ApiSignatureTestCases - pass
* CtsApacheHttpLegacyCurrentApiSignatureTestCases - pass
* CtsApacheHttpLegacyUsesLibraryApiSignatureTestCases - pass
* CtsAppComponentFactoryTestCases - pass
* CtsAppSecurityHostTestCases - pass (flaky)
    - very flaky: android.appsecurity.cts.EphemeralTest#testNormalStartEphemeral
    - flaky: android.appsecurity.cts.ExternalStorageHostTest#testExternalStorageNone
    - flaky: android.appsecurity.cts.InstantCookieHostTest#testCookieUpdateAndRetrieval
* CtsAppTestCases - pass
    - flaky: android.app.cts.ExpandableListActivityTest#testSelect
* CtsAppUsageHostTestCases - pass
* CtsAppWidgetTestCases - pass
* CtsAslrMallocTestCases - pass
* CtsAssistTestCases - pass
* CtsAtraceHostTestCases - pass
* CtsAutoFillServiceTestCases - 4 failures
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillAndSave
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillOneDataset
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillAndSave_withExternalViews_loadWebViewFirst
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillNoDatasets
* CtsBackgroundRestrictionsTestCases - pass
* CtsBackupHostTestCases - pass
* CtsBackupTestCases - pass
* CtsBatterySavingTestCases - pass
* CtsBionicTestCases - pass
    - 2 intentional failures from returning EINVAL on invalid non power of 2 alignments:
        - malloc#memalign_multiple
        - malloc#memalign_non_power2
    - 1 intentional failure from using safer standards compliant realloc(ptr, 0)
        - malloc#realloc_0
* CtsBluetoothTestCases - pass
* CtsBootStatsTestCases - pass
* CtsCalendarcommon2TestCases - pass
* CtsCameraApi25TestCases - pass
* CtsCameraTestCases - seemingly random crashes in random tests [HARDENED_MALLOC]
    - android.hardware.camera2.cts.NativeImageReaderTest#testImageReaderCloseAcquiredImages
      - crash, likely use-after-free (null pointer dereference)
    - android.hardware.camera2.cts.StillCaptureTest#testAfRegions
        - didn't seem to fail without hardened malloc, need to verify that, no
          apparent crash though just a time out on auto focus
    - android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceRepeatingBurst
    - android.hardware.camera2.cts.PerformanceTest#testMultipleCapture
    - android.hardware.camera2.cts.ReprocessCaptureTest#testMixedBurstReprocessing
    - etc. (not consistent)
* CtsCarTestCases - pass
* CtsCarrierApiTestCases - pass
    - 6 passed, 14 require SIM card with carrier privilege rule to run
* CtsColorModeTestCases - pass
* CtsCompilationTestCases - pass
* CtsContactsProviderWipe - pass
* CtsContentTestCases - pass
* CtsCppToolsTestCases - pass
* CtsCurrentApiSignatureTestCases - pass
* CtsDatabaseTestCases - pass
* CtsDebugTestCases - pass
* CtsDeqpTestCases - fail
    - memory corruption bug triggered repeatedly on armv8a only, SEGV_ACCERR
      0x7200dfc074 (always ends in 0x074)

12-08 22:42:37 I/ModuleListener: [29/3673] dEQP-EGL.functional.query_context.get_current_context#rgb565_window fail:
12-08 22:42:50 I/ModuleListener: [32/3673] dEQP-EGL.functional.query_context.get_current_context#rgb888_window fail:
12-08 22:43:03 I/ModuleListener: [35/3673] dEQP-EGL.functional.query_context.get_current_context#rgba4444_window fail:
12-08 22:43:16 I/ModuleListener: [38/3673] dEQP-EGL.functional.query_context.get_current_context#rgba5551_window fail:
12-08 22:43:29 I/ModuleListener: [41/3673] dEQP-EGL.functional.query_context.get_current_context#rgba8888_window fail:
12-08 22:43:43 I/ModuleListener: [45/3673] dEQP-EGL.functional.query_context.get_current_surface#rgb565_window fail:
12-08 22:43:56 I/ModuleListener: [48/3673] dEQP-EGL.functional.query_context.get_current_surface#rgb888_window fail:
12-08 22:44:09 I/ModuleListener: [51/3673] dEQP-EGL.functional.query_context.get_current_surface#rgba4444_window fail:
12-08 22:44:22 I/ModuleListener: [54/3673] dEQP-EGL.functional.query_context.get_current_surface#rgba5551_window fail:
12-08 22:44:42 I/ModuleListener: [57/3673] dEQP-EGL.functional.query_context.get_current_surface#rgba8888_window fail:
12-08 22:44:55 I/ModuleListener: [61/3673] dEQP-EGL.functional.query_context.get_current_display#rgb565_window fail:
12-08 22:45:08 I/ModuleListener: [64/3673] dEQP-EGL.functional.query_context.get_current_display#rgb888_window fail:
12-08 22:45:27 I/ModuleListener: [67/3673] dEQP-EGL.functional.query_context.get_current_display#rgba4444_window fail:
12-08 22:45:41 I/ModuleListener: [70/3673] dEQP-EGL.functional.query_context.get_current_display#rgba5551_window fail:
12-08 22:45:54 I/ModuleListener: [73/3673] dEQP-EGL.functional.query_context.get_current_display#rgba8888_window fail:
12-08 22:46:07 I/ModuleListener: [77/3673] dEQP-EGL.functional.query_context.query_context#rgb565_window fail:
12-08 22:46:20 I/ModuleListener: [80/3673] dEQP-EGL.functional.query_context.query_context#rgb888_window fail:
12-08 22:46:40 I/ModuleListener: [83/3673] dEQP-EGL.functional.query_context.query_context#rgba4444_window fail:
12-08 22:46:53 I/ModuleListener: [86/3673] dEQP-EGL.functional.query_context.query_context#rgba5551_window fail:
12-08 22:47:12 I/ModuleListener: [89/3673] dEQP-EGL.functional.query_context.query_context#rgba8888_window fail:

12-08 22:48:54 I/ModuleListener: [995/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgb8_texture fail:
12-08 22:49:07 I/ModuleListener: [997/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgb565_texture fail:
12-08 22:49:20 I/ModuleListener: [999/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgba8_texture fail:
12-08 22:49:40 I/ModuleListener: [1001/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgb5_a1_texture fail:
12-08 22:49:53 I/ModuleListener: [1003/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_texture_rgba4_texture fail:
12-08 22:50:07 I/ModuleListener: [1005/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_x_rgba8_texture fail:
12-08 22:50:20 I/ModuleListener: [1007/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_y_rgba8_texture fail:
12-08 22:50:33 I/ModuleListener: [1009/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_z_rgba8_texture fail:
12-08 22:50:46 I/ModuleListener: [1011/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_x_rgba8_texture fail:
12-08 22:51:00 I/ModuleListener: [1013/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_y_rgba8_texture fail:
12-08 22:51:13 I/ModuleListener: [1015/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_z_rgba8_texture fail:
12-08 22:51:26 I/ModuleListener: [1017/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_x_rgb8_texture fail:
12-08 22:51:39 I/ModuleListener: [1019/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_y_rgb8_texture fail:
12-08 22:51:58 I/ModuleListener: [1021/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_positive_z_rgb8_texture fail:
12-08 22:52:12 I/ModuleListener: [1023/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_x_rgb8_texture fail:
12-08 22:52:25 I/ModuleListener: [1025/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_y_rgb8_texture fail:
12-08 22:52:38 I/ModuleListener: [1027/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_cubemap_negative_z_rgb8_texture fail:
12-08 22:52:58 I/ModuleListener: [1029/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_renderbuffer_rgba4_texture fail:
12-08 22:53:17 I/ModuleListener: [1031/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_renderbuffer_rgb5_a1_texture fail:
12-08 22:53:30 I/ModuleListener: [1033/3673] dEQP-EGL.functional.image.render_multiple_contexts#gles2_renderbuffer_rgb565_texture fail:

12-08 22:45:14.559 27696 27696 F DEBUG   :     #00 pc 0000000000236358  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::FreeAllocationOnTimestampCommon(EsxContext*, EsxMemAllocDescInstance)+552)
12-08 22:45:14.559 27696 27696 F DEBUG   :     #01 pc 0000000000236534  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::Destroy(EsxContext*)+64)
12-08 22:45:14.559 27696 27696 F DEBUG   :     #02 pc 0000000000335394  /vendor/lib64/egl/libGLESv2_adreno.so (A5xResource::HwFreeSubResource(EsxContext*, EsxSubResource*) const+56)
12-08 22:45:14.559 27696 27696 F DEBUG   :     #03 pc 00000000001ae0dc  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::FreeSubResource(EsxContext*, EsxSubResource*)+52)
12-08 22:45:14.559 27696 27696 F DEBUG   :     #04 pc 00000000001adf70  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::Destroy(EsxContext*)+100)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #05 pc 0000000000202cf4  /vendor/lib64/egl/libGLESv2_adreno.so (EglSurface::Destroy()+72)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #06 pc 00000000001eb580  /vendor/lib64/egl/libGLESv2_adreno.so (EglApi::DestroySurface(void*, void*)+176)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #07 pc 0000000000015f24  /system/lib64/libEGL.so (eglDestroySurface+100)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #08 pc 0000000001178608  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (eglu::UniqueSurface::~UniqueSurface()+32)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #09 pc 000000000138a340  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (deqp::egl::RenderCase::executeForConfig(void*, void*)+1004)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #10 pc 00000000013af5c4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (deqp::egl::SimpleConfigCase::iterate()+44)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #11 pc 0000000001124ef8  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::iterateTestCase(tcu::TestCase*)+52)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #12 pc 0000000001124744  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::iterate()+332)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #13 pc 00000000010e6bd4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::App::iterate()+60)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #14 pc 00000000012a20f4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::TestThread::render()+36)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #15 pc 00000000012a195c  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::RenderThread::run()+256)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #16 pc 0000000001fe99bc  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (startThread+12)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #17 pc 00000000000842c4  /system/lib64/libc.so (__pthread_start(void*)+36)
12-08 22:45:14.560 27696 27696 F DEBUG   :     #18 pc 000000000002473c  /system/lib64/libc.so (__start_thread+68)

12-08 22:53:24.145  2922  2922 F DEBUG   :     #00 pc 0000000000236358  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::FreeAllocationOnTimestampCommon(EsxContext*, EsxMemAllocDescInstance)+552)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #01 pc 0000000000236534  /vendor/lib64/egl/libGLESv2_adreno.so (EsxGfxMem::Destroy(EsxContext*)+64)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #02 pc 0000000000335394  /vendor/lib64/egl/libGLESv2_adreno.so (A5xResource::HwFreeSubResource(EsxContext*, EsxSubResource*) const+56)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #03 pc 00000000001ae0dc  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::FreeSubResource(EsxContext*, EsxSubResource*)+52)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #04 pc 00000000001adf70  /vendor/lib64/egl/libGLESv2_adreno.so (EsxResource::Destroy(EsxContext*)+100)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #05 pc 0000000000202cf4  /vendor/lib64/egl/libGLESv2_adreno.so (EglSurface::Destroy()+72)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #06 pc 00000000001eb580  /vendor/lib64/egl/libGLESv2_adreno.so (EglApi::DestroySurface(void*, void*)+176)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #07 pc 0000000000015f24  /system/lib64/libEGL.so (eglDestroySurface+100)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #08 pc 000000000134d358  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (deqp::egl::Image::ImageFormatCase::deinit()+144)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #09 pc 0000000001124a14  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::leaveTestCase(tcu::TestCase*)+60)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #10 pc 0000000001124690  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::TestSessionExecutor::iterate()+152)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #11 pc 00000000010e6bd4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::App::iterate()+60)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #12 pc 00000000012a20f4  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::TestThread::render()+36)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #13 pc 00000000012a195c  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (tcu::Android::RenderThread::run()+256)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #14 pc 0000000001fe99bc  /data/app/com.drawelements.deqp-LuaHQDu6JmFONVIcUNsJww==/lib/arm64/libdeqp.so (startThread+12)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #15 pc 00000000000842c4  /system/lib64/libc.so (__pthread_start(void*)+36)
12-08 22:53:24.145  2922  2922 F DEBUG   :     #16 pc 000000000002473c  /system/lib64/libc.so (__start_thread+68)

* CtsDeviceIdleHostTestCases - pass
* CtsDevicePolicyManagerTestCases - fail
    - random failures with 'Failed to parse result: cmd: Can't find service: package'
* CtsDexMetadataHostTestCases - pass
* CtsDisplayTestCases - pass
* CtsDpiTestCases - pass
* CtsDpiTestCases2 - pass
* CtsDreamsTestCases - pass
* CtsDrmTestCases - pass
* CtsDumpsysHostTestCases - pass
* CtsDynamicLinkerTestCases - pass
* CtsEdiHostTestCases - pass
* CtsEffectTestCases - pass
* CtsExternalServiceTestCases - pass
* CtsExternalSourcesTestCases - pass
* CtsFileSystemTestCases - pass
* CtsFragmentTestCases - pass
* CtsFragmentTestCasesSdk26 - pass
* CtsGestureTestCases - pass
* CtsGpuToolsHostTestCases - pass
* CtsGraphicsTestCases - 1 failure
    - failure: android.graphics.drawable.cts.AnimatedImageDrawableTest#testStop
* CtsHardwareTestCases - pass
* CtsHarmfulAppWarningHostTestCases - pass
* CtsHiddenApiBlacklistApi27TestCases - pass
* CtsHiddenApiBlacklistCurrentApiTestCases - pass
* CtsHiddenApiBlacklistDebugClassTestCases - pass
* CtsHiddenApiKillswitchDebugClassTestCases - pass
* CtsHiddenApiKillswitchWhitelistTestCases - pass
* CtsHiddenApiKillswitchWildcardTestCases - pass
* CtsHostTzDataTests - pass
* CtsHostsideNetworkTests - pass
* CtsHostsideNumberBlockingTestCases - pass
* CtsHostsideTvTests - pass
* CtsHostsideWebViewTests - 1 failure
    - failure: com.android.cts.webkit.WebViewHostSideStartupTest#testStrictMode
* CtsIcuTestCases - pass
* CtsIncidentHostTestCases - 4 failures
    - failure: com.android.server.cts.ErrorsTest#testNativeCrashA
    - failure: com.android.server.cts.IncidentdTest#testIncidentReportDumpAuto
    - failure: com.android.server.cts.IncidentdTest#testIncidentReportDumpExplicit
    - failure: com.android.server.cts.IncidentdTest#testIncidentReportDumpLocal
* CtsInlineMockingTestCases - pass
* CtsInputMethodServiceHostTestCases - pass
* CtsInputMethodTestCases - pass
* CtsIntentSignatureTestCases - pass
* CtsJankDeviceTestCases - pass
* CtsJdwpSecurityHostTestCases - pass
* CtsJdwpTestCases - pass
* CtsJniTestCases - pass
* CtsJobSchedulerSharedUidTestCases - pass
* CtsJobSchedulerTestCases - pass
* CtsJvmtiAttachingHostTestCases - pass
* CtsJvmtiAttachingTestCases - pass
* CtsJvmtiRedefineClassesHostTestCases - pass
* CtsJvmtiRunTest1900HostTestCases - pass
* CtsJvmtiRunTest1901HostTestCases - pass
* CtsJvmtiRunTest1902HostTestCases - pass
* CtsJvmtiRunTest1903HostTestCases - pass
* CtsJvmtiRunTest1904HostTestCases - pass
* CtsJvmtiRunTest1906HostTestCases - pass
* CtsJvmtiRunTest1907HostTestCases - pass
* CtsJvmtiRunTest1908HostTestCases - pass
* CtsJvmtiRunTest1909HostTestCases - pass
* CtsJvmtiRunTest1910HostTestCases - pass
* CtsJvmtiRunTest1911HostTestCases - pass
* CtsJvmtiRunTest1912HostTestCases - pass
* CtsJvmtiRunTest1913HostTestCases - pass
* CtsJvmtiRunTest1914HostTestCases - pass
* CtsJvmtiRunTest1915HostTestCases - pass
* CtsJvmtiRunTest1916HostTestCases - pass
* CtsJvmtiRunTest1917HostTestCases - pass
* CtsJvmtiRunTest1920HostTestCases - pass
* CtsJvmtiRunTest1921HostTestCases - pass
* CtsJvmtiRunTest1922HostTestCases - pass
* CtsJvmtiRunTest1923HostTestCases - pass
* CtsJvmtiRunTest1924HostTestCases - pass
* CtsJvmtiRunTest1925HostTestCases - pass
* CtsJvmtiRunTest1926HostTestCases - pass
* CtsJvmtiRunTest1927HostTestCases - pass
* CtsJvmtiRunTest1928HostTestCases - pass
* CtsJvmtiRunTest1930HostTestCases - pass
* CtsJvmtiRunTest1931HostTestCases - pass
* CtsJvmtiRunTest1932HostTestCases - pass
* CtsJvmtiRunTest1933HostTestCases - pass
* CtsJvmtiRunTest1934HostTestCases - pass
* CtsJvmtiRunTest1936HostTestCases - pass
* CtsJvmtiRunTest1937HostTestCases - pass
* CtsJvmtiRunTest1939HostTestCases - pass
* CtsJvmtiRunTest1941HostTestCases - pass
* CtsJvmtiRunTest1942HostTestCases - pass
* CtsJvmtiRunTest1943HostTestCases - pass
* CtsJvmtiRunTest902HostTestCases - pass
* CtsJvmtiRunTest903HostTestCases - pass
* CtsJvmtiRunTest904HostTestCases - pass
* CtsJvmtiRunTest905HostTestCases - pass
* CtsJvmtiRunTest906HostTestCases - pass
* CtsJvmtiRunTest907HostTestCases - pass
* CtsJvmtiRunTest908HostTestCases - pass
* CtsJvmtiRunTest910HostTestCases - pass
* CtsJvmtiRunTest911HostTestCases - pass
* CtsJvmtiRunTest912HostTestCases - pass
* CtsJvmtiRunTest913HostTestCases - pass
* CtsJvmtiRunTest914HostTestCases - pass
* CtsJvmtiRunTest915HostTestCases - pass
* CtsJvmtiRunTest917HostTestCases - pass
* CtsJvmtiRunTest918HostTestCases - pass
* CtsJvmtiRunTest919HostTestCases - pass
* CtsJvmtiRunTest920HostTestCases - pass
* CtsJvmtiRunTest922HostTestCases - pass
* CtsJvmtiRunTest923HostTestCases - pass
* CtsJvmtiRunTest924HostTestCases - pass
* CtsJvmtiRunTest926HostTestCases - pass
* CtsJvmtiRunTest927HostTestCases - pass
* CtsJvmtiRunTest928HostTestCases - pass
* CtsJvmtiRunTest930HostTestCases - pass
* CtsJvmtiRunTest931HostTestCases - pass
* CtsJvmtiRunTest932HostTestCases - pass
* CtsJvmtiRunTest940HostTestCases - pass
* CtsJvmtiRunTest942HostTestCases - pass
* CtsJvmtiRunTest944HostTestCases - pass
* CtsJvmtiRunTest945HostTestCases - pass
* CtsJvmtiRunTest947HostTestCases - pass
* CtsJvmtiRunTest951HostTestCases - pass
* CtsJvmtiRunTest982HostTestCases - pass
* CtsJvmtiRunTest983HostTestCases - pass
* CtsJvmtiRunTest984HostTestCases - pass
* CtsJvmtiRunTest985HostTestCases - pass
* CtsJvmtiRunTest986HostTestCases - pass
* CtsJvmtiRunTest988HostTestCases - pass
* CtsJvmtiRunTest989HostTestCases - pass
* CtsJvmtiRunTest990HostTestCases - pass
* CtsJvmtiRunTest991HostTestCases - pass
* CtsJvmtiRunTest992HostTestCases - pass
* CtsJvmtiRunTest993HostTestCases - pass
* CtsJvmtiRunTest994HostTestCases - pass
* CtsJvmtiRunTest995HostTestCases - pass
* CtsJvmtiRunTest996HostTestCases - pass
* CtsJvmtiRunTest997HostTestCases - pass
* CtsJvmtiTaggingHostTestCases - pass
* CtsJvmtiTrackingHostTestCases - pass
* CtsKernelConfigTestCases - pass
* CtsKeystoreTestCases - pass
* CtsLeanbackJankTestCases - pass
* CtsLibcoreFileIOTestCases - pass
* CtsLibcoreJavaUtilCollectionsTestCases - pass
* CtsLibcoreJsr166TestCases - pass
* CtsLibcoreLegacy22TestCases - pass
* CtsLibcoreOjTestCases - pass
* CtsLibcoreOkHttpTestCases - pass
* CtsLibcoreTestCases - pass
* CtsLibcoreWycheproofBCTestCases - pass
* CtsLibcoreWycheproofConscryptTestCases - pass
* CtsLiblogTestCases - pass
* CtsLocation2TestCases - pass
* CtsLocationTestCases - pass
    - flaky indoors
    - need to look into this more with hardened malloc due to existing
      flakiness making it hard to identify new issues
* CtsLogdTestCases - pass
* CtsMediaBitstreamsTestCases - pass
* CtsMediaHostTestCases - pass
* CtsMediaStressTestCases - pass
* CtsMediaTestCases - 2 failures
    - 1 failure (crash): android.media.cts.DecoderConformanceTest#testVP9Other
    - the flaky network tests seem to be flaky themselves in general, so others may also occasionally fail
    - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S3P00001
    - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S4P00001
    - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S5P00001
    - flaky: android.media.cts.VideoDecoderPerfTest#testHevcGoog0Perf0640x0360 (maybe others too)
    - flaky: android.media.cts.StreamingMediaPlayerTest#testPlayHlsStream (maybe others too)
    - framerate too high? android.media.cts.VideoDecoderPerfTest#testAvcGoog0Perf0720x0480
    - failure (timeout): android.media.cts.VideoEncoderTest#testGoogVP9SurfArbitraryH
* CtsMidiTestCases - pass
* CtsMockingDebuggableTestCases - pass
* CtsMockingTestCases - pass
* CtsMonkeyTestCases - pass
* CtsMultiUserHostTestCases - pass
* CtsMultiUserTestCases - pass
* CtsNNAPITestCases - pass
* CtsNativeHardwareTestCases - pass
* CtsNativeMediaAAudioTestCases - pass
* CtsNativeMediaSlTestCases - pass
* CtsNativeMediaXaTestCases - pass
* CtsNativeNetTestCases - pass
* CtsNdefTestCases - pass
* CtsNetSecConfigAttributeTestCases - pass
* CtsNetSecConfigBasicDebugDisabledTestCases - pass
* CtsNetSecConfigBasicDebugEnabledTestCases - pass
* CtsNetSecConfigBasicDomainConfigTestCases - pass
* CtsNetSecConfigCleartextTrafficTestCases - pass
* CtsNetSecConfigDownloadManagerTestCases - pass
* CtsNetSecConfigInvalidPinTestCases - pass
* CtsNetSecConfigNestedDomainConfigTestCases - pass
* CtsNetSecConfigPrePCleartextTrafficTestCases - pass
* CtsNetSecConfigResourcesSrcTestCases - pass
* CtsNetSecPolicyUsesCleartextTrafficFalseTestCases - pass
* CtsNetSecPolicyUsesCleartextTrafficTrueTestCases - pass
* CtsNetSecPolicyUsesCleartextTrafficUnspecifiedTestCases - pass
* CtsNetTestCases - pass
    - failure due to missing test AP: android.net.wifi.rtt.cts.WifiRttTest#testRangingToTestAp
* CtsNetTestCasesLegacyApi22 - pass
* CtsNetTestCasesLegacyPermission22 - pass
* CtsOmapiTestCases - pass
* CtsOpenGLTestCases - pass
* CtsOpenGlPerf2TestCases - pass
* CtsOpenGlPerfTestCases - pass
* CtsOsHostTestCases - pass
* CtsOsTestCases - pass
* CtsPdfTestCases - pass
* CtsPerfettoTestCases - pass
* CtsPermission2TestCases - pass
* CtsPermissionTestCases - pass
* CtsPreference2TestCases - pass
* CtsPreferenceTestCases - pass
* CtsPrintTestCases - pass
    - flaky
* CtsProtoTestCases - pass
* CtsProviderTestCases - 2 failures
    - android.provider.cts.contacts.ContactsContract_DumpFileProviderTest#testQuery_throwsErrorWithIllegalFileName
    - android.provider.cts.contacts.ContactsContract_DumpFileProviderTest#testOpenFileDescriptor_throwsErrorWithIllegalFileName
* CtsRenderscriptLegacyTestCases - pass
* CtsRenderscriptTestCases - pass
* CtsRsBlasTestCases - pass
* CtsRsCppTestCases - pass
* CtsSampleDeviceTestCases - pass
* CtsSampleHostTestCases - pass
* CtsSaxTestCases - pass
* CtsSeccompHostTestCases - pass
* CtsSecureElementAccessControlTestCases1 - pass
* CtsSecureElementAccessControlTestCases2 - pass
* CtsSecureElementAccessControlTestCases3 - pass
* CtsSecurityBulletinHostTestCases - pass
* CtsSecurityHostTestCases - pass
* CtsSecurityTestCases - pass
* CtsSelinuxTargetSdk25TestCases - pass
* CtsSelinuxTargetSdk27TestCases - pass
* CtsSelinuxTargetSdkCurrentTestCases - pass
* CtsSensorTestCases - pass
* CtsShortcutHostTestCases - pass
* CtsShortcutManagerTestCases - pass
* CtsSimpleCpuTestCases - pass
* CtsSimpleperfTestCases - pass
* CtsSkQPTestCases - pass
* CtsSliceTestCases - pass
* CtsSpeechTestCases - pass
* CtsStatsdHostTestCases - 1 failure
    - failure: android.cts.statsd.atom.UidAtomTests#testCpuTimePerUid
* CtsSustainedPerformanceHostTestCases - pass
* CtsSyncAccountAccessOtherCertTestCases - pass
* CtsSyncContentHostTestCases - pass
* CtsSyncManagerTestsCases - pass
* CtsSystemApiAnnotationTestCases - pass
* CtsSystemApiSignatureTestCases - pass
* CtsSystemIntentTestCases - pass
* CtsSystemUiHostTestCases - pass
* CtsSystemUiTestCases - pass
* CtsTelecomTestCases - pass
* CtsTelecomTestCases2 - pass
* CtsTelecomTestCases3 - pass
* CtsTelephony2TestCases - pass
* CtsTelephonyTestCases - 8 failures
    - failures are likely tied to the cellular service (lack of visual voicemail support, etc.) not the build
    - failure: android.telephony.cts.SmsManagerTest#testSendAndReceiveMessages
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilter
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_InvalidKeyValuePair
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_InvalidMissingKey
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_MessageEndAfterClientPrefix
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_MissingSecondColon
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_PrefixMismatch
    - failure: android.telephony.gsm.cts.SmsManagerTest#testSendAndReceiveMessages
* CtsTextTestCases - pass
* CtsThemeDeviceTestCases - pass
* CtsThemeHostTestCases - pass
* CtsToastLegacyTestCases - pass
* CtsToastTestCases - pass
* CtsTransitionTestCases - pass
* CtsTrustedVoiceHostTestCases - pass
* CtsTvProviderTestCases - pass
* CtsTvTestCases - pass
* CtsUiAutomationTestCases - pass
* CtsUiDeviceTestCases - pass
* CtsUiRenderingTestCases - pass
* CtsUidIsolationTestCases - pass
* CtsUnofficialApisUsageTestCases - pass
* CtsUsageStatsTestCases - pass
* CtsUsbTests - pass
* CtsUtilTestCases - pass
* CtsVideoTestCases - pass
* CtsViewTestCases - pass
* CtsVmTestCases - pass
* CtsVoiceInteractionTestCases - pass
* CtsVoiceSettingsTestCases - pass
* CtsVrTestCases - pass
* CtsWebkitTestCases - pass
* CtsWidgetTestCases - pass
* CtsWindowManagerDeviceTestCases - pass
    - flaky: android.server.wm.DialogFrameTests#testExplicitSizeBottomRightGravity
    - flaky: android.server.wm.DialogFrameTests#testExplicitSizeDefaultGravity
* CtsWrapNoWrapTestCases - pass
* CtsWrapWrapDebugMallocDebugTestCases - pass
* CtsWrapWrapDebugTestCases - pass
* CtsWrapWrapNoDebugTestCases - pass
* cts-system-all.api - pass
* signed-CtsSecureElementAccessControlTestCases1 - pass
* signed-CtsSecureElementAccessControlTestCases2 - pass
* signed-CtsSecureElementAccessControlTestCases3 - pass
* vm-tests-tf - pass

normal.txt

CTS results on Pixel 2 (walleye) running AOSP PQ1A.181105.017.A1 (android-9.0.0_r16) with Chromium 70.0.3538.110 monochrome_public_apk as the WebView and browser

* CtsAbiOverrideHostTestCases - pass
* CtsAccelerationTestCases - pass
* CtsAccessibilityServiceTestCases - pass
* CtsAccessibilityTestCases - pass
* CtsAccountManagerTestCases - pass
* CtsActivityManagerDeviceSdk25TestCases - pass
* CtsActivityManagerDeviceTestCases - pass (flaky)
    - test module is quite flaky seemingly due to race conditions in how the
      tests are implemented, so occasional failures don't necessarily indicate
      problems in the OS
    - very flaky: android.server.am.ActivityManagerDisplayLockedKeyguardTests#testDismissKeyguard_whileOccluded_secondaryDisplay
* CtsAdminPackageInstallerTestCases - pass
* CtsAdminTestCases - pass
* CtsAlarmClockTestCases - pass
* CtsAlarmManagerTestCases - pass
* CtsAndroidAppTestCases - pass
* CtsAndroidTestBase27ApiSignatureTestCases - pass
* CtsAndroidTestMockCurrentApiSignatureTestCases - pass
* CtsAndroidTestRunnerCurrentApiSignatureTestCases - pass
* CtsAnimationTestCases - pass
* CtsApacheHttpLegacy27ApiSignatureTestCases - pass
* CtsApacheHttpLegacyCurrentApiSignatureTestCases - pass
* CtsApacheHttpLegacyUsesLibraryApiSignatureTestCases - pass
* CtsAppComponentFactoryTestCases - pass
* CtsAppSecurityHostTestCases - pass (flaky)
    - very flaky: android.appsecurity.cts.EphemeralTest#testNormalStartEphemeral
    - flaky: android.appsecurity.cts.InstantCookieHostTest#testCookieUpdateAndRetrieval
* CtsAppTestCases - pass
    - flaky: android.app.cts.ExpandableListActivityTest#testSelect
* CtsAppUsageHostTestCases - pass
* CtsAppWidgetTestCases - pass
* CtsAslrMallocTestCases - pass
* CtsAssistTestCases - pass
* CtsAtraceHostTestCases - pass
* CtsAutoFillServiceTestCases - 4 failures
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillAndSave
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillOneDataset
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillAndSave_withExternalViews_loadWebViewFirst
    - failure: android.autofillservice.cts.WebViewActivityTest#testAutofillNoDatasets
* CtsBackgroundRestrictionsTestCases - pass
* CtsBackupHostTestCases - pass
* CtsBackupTestCases - pass
    - flaky: android.backup.cts.FullBackupQuotaTest#testQuotaExceeded
* CtsBatterySavingTestCases - pass
* CtsBionicTestCases - pass
* CtsBluetoothTestCases - pass
* CtsBootStatsTestCases - pass
* CtsCalendarcommon2TestCases - pass
* CtsCameraApi25TestCases - pass
* CtsCameraTestCases - pass
    - overall quite flaky due to not having a great setup for lighting, etc.
    - flaky: android.hardware.camera2.cts.StillCaptureTest#testAfRegions
* CtsCarTestCases - pass
* CtsCarrierApiTestCases - pass
    - 6 passed, 14 require SIM card with carrier privilege rule to run
* CtsColorModeTestCases - pass
* CtsCompilationTestCases - pass
* CtsContactsProviderWipe - pass
* CtsContentTestCases - pass
* CtsCppToolsTestCases - pass
* CtsCurrentApiSignatureTestCases - pass
* CtsDatabaseTestCases - pass
* CtsDebugTestCases - pass
* CtsDeqpTestCases - pass
* CtsDeviceIdleHostTestCases - pass
* CtsDevicePolicyManagerTestCases - pass
* CtsDexMetadataHostTestCases - pass
* CtsDisplayTestCases - pass
* CtsDpiTestCases - pass
* CtsDpiTestCases2 - pass
* CtsDreamsTestCases - pass
* CtsDrmTestCases - pass
* CtsDumpsysHostTestCases - pass
* CtsDynamicLinkerTestCases - pass
* CtsEdiHostTestCases - pass
* CtsEffectTestCases - pass
* CtsExternalServiceTestCases - pass
* CtsExternalSourcesTestCases - pass
* CtsFileSystemTestCases - pass
* CtsFragmentTestCases - pass
* CtsFragmentTestCasesSdk26 - pass
* CtsGestureTestCases - pass
* CtsGpuToolsHostTestCases - pass
* CtsGraphicsTestCases - 1 failure
    - failure: android.graphics.drawable.cts.AnimatedImageDrawableTest#testStop
* CtsHardwareTestCases - pass
* CtsHarmfulAppWarningHostTestCases - pass
* CtsHiddenApiBlacklistApi27TestCases - pass
* CtsHiddenApiBlacklistCurrentApiTestCases - pass
* CtsHiddenApiBlacklistDebugClassTestCases - pass
* CtsHiddenApiKillswitchDebugClassTestCases - pass
* CtsHiddenApiKillswitchWhitelistTestCases - pass
* CtsHiddenApiKillswitchWildcardTestCases - pass
* CtsHostTzDataTests - pass
* CtsHostsideNetworkTests - pass
* CtsHostsideNumberBlockingTestCases - pass
* CtsHostsideTvTests - pass
* CtsHostsideWebViewTests - 1 failure
    - failure: com.android.cts.webkit.WebViewHostSideStartupTest#testStrictMode
* CtsIcuTestCases - pass
* CtsIncidentHostTestCases - pass
    - flaky: com.android.server.cts.IncidentdTest#testIncidentReportDumpAuto
* CtsInlineMockingTestCases - pass
* CtsInputMethodServiceHostTestCases - pass
* CtsInputMethodTestCases - pass
* CtsIntentSignatureTestCases - pass
* CtsJankDeviceTestCases - pass
* CtsJdwpSecurityHostTestCases - pass
* CtsJdwpTestCases - pass
* CtsJniTestCases - pass
* CtsJobSchedulerSharedUidTestCases - pass
* CtsJobSchedulerTestCases - pass
* CtsJvmtiAttachingHostTestCases - pass
* CtsJvmtiAttachingTestCases - pass
* CtsJvmtiRedefineClassesHostTestCases - pass
* CtsJvmtiRunTest1900HostTestCases - pass
* CtsJvmtiRunTest1901HostTestCases - pass
* CtsJvmtiRunTest1902HostTestCases - pass
* CtsJvmtiRunTest1903HostTestCases - pass
* CtsJvmtiRunTest1904HostTestCases - pass
* CtsJvmtiRunTest1906HostTestCases - pass
* CtsJvmtiRunTest1907HostTestCases - pass
* CtsJvmtiRunTest1908HostTestCases - pass
* CtsJvmtiRunTest1909HostTestCases - pass
* CtsJvmtiRunTest1910HostTestCases - pass
* CtsJvmtiRunTest1911HostTestCases - pass
* CtsJvmtiRunTest1912HostTestCases - pass
* CtsJvmtiRunTest1913HostTestCases - pass
* CtsJvmtiRunTest1914HostTestCases - pass
* CtsJvmtiRunTest1915HostTestCases - pass
* CtsJvmtiRunTest1916HostTestCases - pass
* CtsJvmtiRunTest1917HostTestCases - pass
* CtsJvmtiRunTest1920HostTestCases - pass
* CtsJvmtiRunTest1921HostTestCases - pass
* CtsJvmtiRunTest1922HostTestCases - pass
* CtsJvmtiRunTest1923HostTestCases - pass
* CtsJvmtiRunTest1924HostTestCases - pass
* CtsJvmtiRunTest1925HostTestCases - pass
* CtsJvmtiRunTest1926HostTestCases - pass
* CtsJvmtiRunTest1927HostTestCases - pass
* CtsJvmtiRunTest1928HostTestCases - pass
* CtsJvmtiRunTest1930HostTestCases - pass
* CtsJvmtiRunTest1931HostTestCases - pass
* CtsJvmtiRunTest1932HostTestCases - pass
* CtsJvmtiRunTest1933HostTestCases - pass
* CtsJvmtiRunTest1934HostTestCases - pass
* CtsJvmtiRunTest1936HostTestCases - pass
* CtsJvmtiRunTest1937HostTestCases - pass
* CtsJvmtiRunTest1939HostTestCases - pass
* CtsJvmtiRunTest1941HostTestCases - pass
* CtsJvmtiRunTest1942HostTestCases - pass
* CtsJvmtiRunTest1943HostTestCases - pass
* CtsJvmtiRunTest902HostTestCases - pass
* CtsJvmtiRunTest903HostTestCases - pass
* CtsJvmtiRunTest904HostTestCases - pass
* CtsJvmtiRunTest905HostTestCases - pass
* CtsJvmtiRunTest906HostTestCases - pass
* CtsJvmtiRunTest907HostTestCases - pass
* CtsJvmtiRunTest908HostTestCases - pass
* CtsJvmtiRunTest910HostTestCases - pass
* CtsJvmtiRunTest911HostTestCases - pass
* CtsJvmtiRunTest912HostTestCases - pass
* CtsJvmtiRunTest913HostTestCases - pass
* CtsJvmtiRunTest914HostTestCases - pass
* CtsJvmtiRunTest915HostTestCases - pass
* CtsJvmtiRunTest917HostTestCases - pass
* CtsJvmtiRunTest918HostTestCases - pass
* CtsJvmtiRunTest919HostTestCases - pass
* CtsJvmtiRunTest920HostTestCases - pass
* CtsJvmtiRunTest922HostTestCases - pass
* CtsJvmtiRunTest923HostTestCases - pass
* CtsJvmtiRunTest924HostTestCases - pass
* CtsJvmtiRunTest926HostTestCases - pass
* CtsJvmtiRunTest927HostTestCases - pass
* CtsJvmtiRunTest928HostTestCases - pass
* CtsJvmtiRunTest930HostTestCases - pass
* CtsJvmtiRunTest931HostTestCases - pass
* CtsJvmtiRunTest932HostTestCases - pass
* CtsJvmtiRunTest940HostTestCases - pass
* CtsJvmtiRunTest942HostTestCases - pass
* CtsJvmtiRunTest944HostTestCases - pass
* CtsJvmtiRunTest945HostTestCases - pass
* CtsJvmtiRunTest947HostTestCases - pass
* CtsJvmtiRunTest951HostTestCases - pass
* CtsJvmtiRunTest982HostTestCases - pass
* CtsJvmtiRunTest983HostTestCases - pass
* CtsJvmtiRunTest984HostTestCases - pass
* CtsJvmtiRunTest985HostTestCases - pass
* CtsJvmtiRunTest986HostTestCases - pass
* CtsJvmtiRunTest988HostTestCases - pass
* CtsJvmtiRunTest989HostTestCases - pass
* CtsJvmtiRunTest990HostTestCases - pass
* CtsJvmtiRunTest991HostTestCases - pass
* CtsJvmtiRunTest992HostTestCases - pass
* CtsJvmtiRunTest993HostTestCases - pass
* CtsJvmtiRunTest994HostTestCases - pass
* CtsJvmtiRunTest995HostTestCases - pass
* CtsJvmtiRunTest996HostTestCases - pass
* CtsJvmtiRunTest997HostTestCases - pass
* CtsJvmtiTaggingHostTestCases - pass
* CtsJvmtiTrackingHostTestCases - pass
* CtsKernelConfigTestCases - pass
* CtsKeystoreTestCases - pass
* CtsLeanbackJankTestCases - pass
* CtsLibcoreFileIOTestCases - pass
* CtsLibcoreJavaUtilCollectionsTestCases - pass
* CtsLibcoreJsr166TestCases - pass
* CtsLibcoreLegacy22TestCases - pass
* CtsLibcoreOjTestCases - pass
* CtsLibcoreOkHttpTestCases - pass
* CtsLibcoreTestCases - pass
* CtsLibcoreWycheproofBCTestCases - pass
* CtsLibcoreWycheproofConscryptTestCases - pass
* CtsLiblogTestCases - pass
* CtsLocation2TestCases - pass
* CtsLocationTestCases - pass
    - flaky indoors
* CtsLogdTestCases - pass
* CtsMediaBitstreamsTestCases - pass
* CtsMediaHostTestCases - pass
* CtsMediaStressTestCases - pass
* CtsMediaTestCases - 1 failure + flaky tests
    - the flaky network tests seem to be flaky themselves in general, so others may also occasionally fail
    - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S3P00001
    - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S4P00001
    - flaky: android.media.cts.MediaPlayerFlakyNetworkTest#test_S5P00001
    - flaky: android.media.cts.VideoDecoderPerfTest#testHevcGoog0Perf0640x0360 (maybe others too)
    - flaky: android.media.cts.StreamingMediaPlayerTest#testPlayHlsStream (maybe others too)
    - failure: android.media.cts.MediaSessionManagerTest#testRemoteUserInfo
* CtsMidiTestCases - pass
* CtsMockingDebuggableTestCases - pass
* CtsMockingTestCases - pass
* CtsMonkeyTestCases - pass
* CtsMultiUserHostTestCases - pass
* CtsMultiUserTestCases - pass
* CtsNNAPITestCases - pass
* CtsNativeHardwareTestCases - pass
* CtsNativeMediaAAudioTestCases - pass
* CtsNativeMediaSlTestCases - pass
* CtsNativeMediaXaTestCases - pass
* CtsNativeNetTestCases - pass
* CtsNdefTestCases - pass
* CtsNetSecConfigAttributeTestCases - pass
* CtsNetSecConfigBasicDebugDisabledTestCases - pass
* CtsNetSecConfigBasicDebugEnabledTestCases - pass
* CtsNetSecConfigBasicDomainConfigTestCases - pass
* CtsNetSecConfigCleartextTrafficTestCases - pass
* CtsNetSecConfigDownloadManagerTestCases - pass
* CtsNetSecConfigInvalidPinTestCases - pass
* CtsNetSecConfigNestedDomainConfigTestCases - pass
* CtsNetSecConfigPrePCleartextTrafficTestCases - pass
* CtsNetSecConfigResourcesSrcTestCases - pass
* CtsNetSecPolicyUsesCleartextTrafficFalseTestCases - pass
* CtsNetSecPolicyUsesCleartextTrafficTrueTestCases - pass
* CtsNetSecPolicyUsesCleartextTrafficUnspecifiedTestCases - pass
* CtsNetTestCases - pass
    - failure due to missing test AP: android.net.wifi.rtt.cts.WifiRttTest#testRangingToTestAp
* CtsNetTestCasesLegacyApi22 - pass
* CtsNetTestCasesLegacyPermission22 - pass
* CtsOmapiTestCases - pass
* CtsOpenGLTestCases - pass
* CtsOpenGlPerf2TestCases - pass
* CtsOpenGlPerfTestCases - pass
* CtsOsHostTestCases - pass
* CtsOsTestCases - pass
* CtsPdfTestCases - pass
* CtsPerfettoTestCases - pass
* CtsPermission2TestCases - pass
* CtsPermissionTestCases - pass
* CtsPreference2TestCases - pass
* CtsPreferenceTestCases - pass
* CtsPrintTestCases - pass
    - flaky
* CtsProtoTestCases - pass
* CtsProviderTestCases - pass
* CtsRenderscriptLegacyTestCases - pass
* CtsRenderscriptTestCases - pass
* CtsRsBlasTestCases - pass
* CtsRsCppTestCases - pass
* CtsSampleDeviceTestCases - pass
* CtsSampleHostTestCases - pass
* CtsSaxTestCases - pass
* CtsSeccompHostTestCases - pass
* CtsSecureElementAccessControlTestCases1 - pass
* CtsSecureElementAccessControlTestCases2 - pass
* CtsSecureElementAccessControlTestCases3 - pass
* CtsSecurityBulletinHostTestCases - pass
* CtsSecurityHostTestCases - pass
* CtsSecurityTestCases - pass
* CtsSelinuxTargetSdk25TestCases - pass
* CtsSelinuxTargetSdk27TestCases - pass
* CtsSelinuxTargetSdkCurrentTestCases - pass
* CtsSensorTestCases - pass
* CtsShortcutHostTestCases - pass
* CtsShortcutManagerTestCases - pass
* CtsSimpleCpuTestCases - pass
* CtsSimpleperfTestCases - pass
* CtsSkQPTestCases - pass
* CtsSliceTestCases - pass
* CtsSpeechTestCases - pass
* CtsStatsdHostTestCases - pass
* CtsSustainedPerformanceHostTestCases - pass
* CtsSyncAccountAccessOtherCertTestCases - pass
* CtsSyncContentHostTestCases - pass
* CtsSyncManagerTestsCases - pass
* CtsSystemApiAnnotationTestCases - pass
* CtsSystemApiSignatureTestCases - pass
* CtsSystemIntentTestCases - pass
* CtsSystemUiHostTestCases - pass
* CtsSystemUiTestCases - pass
* CtsTelecomTestCases - pass
* CtsTelecomTestCases2 - pass
* CtsTelecomTestCases3 - pass
* CtsTelephony2TestCases - pass
* CtsTelephonyTestCases - 8 failures
    - failures are likely tied to the cellular service (lack of visual voicemail support, etc.) not the build
    - failure: android.telephony.cts.SmsManagerTest#testSendAndReceiveMessages
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilter
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_InvalidKeyValuePair
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_InvalidMissingKey
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_MessageEndAfterClientPrefix
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_MissingSecondColon
    - failure: android.telephony.cts.VisualVoicemailServiceTest#testFilterFail_PrefixMismatch
    - failure: android.telephony.gsm.cts.SmsManagerTest#testSendAndReceiveMessages
* CtsTextTestCases - pass
* CtsThemeDeviceTestCases - pass
* CtsThemeHostTestCases - pass
* CtsToastLegacyTestCases - pass
* CtsToastTestCases - pass
* CtsTransitionTestCases - pass
* CtsTrustedVoiceHostTestCases - pass
* CtsTvProviderTestCases - pass
* CtsTvTestCases - pass
* CtsUiAutomationTestCases - pass
* CtsUiDeviceTestCases - pass
* CtsUiRenderingTestCases - pass
* CtsUidIsolationTestCases - pass
* CtsUnofficialApisUsageTestCases - pass
* CtsUsageStatsTestCases - pass
* CtsUsbTests - pass
* CtsUtilTestCases - pass
* CtsVideoTestCases - pass
* CtsViewTestCases - pass
* CtsVmTestCases - pass
* CtsVoiceInteractionTestCases - pass
* CtsVoiceSettingsTestCases - pass
* CtsVrTestCases - pass
* CtsWebkitTestCases - pass
    - flaky: android.webkit.cts.WebChromeClientTest#testOnJsBeforeUnloadIsCalled
* CtsWidgetTestCases - pass
* CtsWindowManagerDeviceTestCases - pass
    - flaky: android.server.wm.DialogFrameTests#testExplicitSizeBottomRightGravity
* CtsWrapNoWrapTestCases - pass
* CtsWrapWrapDebugMallocDebugTestCases - pass
* CtsWrapWrapDebugTestCases - pass
* CtsWrapWrapNoDebugTestCases - pass
* cts-system-all.api - pass
* signed-CtsSecureElementAccessControlTestCases1 - pass
* signed-CtsSecureElementAccessControlTestCases2 - pass
* signed-CtsSecureElementAccessControlTestCases3 - pass
* vm-tests-tf - pass