VTS doesn't run on VIM3 AOSP 12

Hi all,
I tried to run VTS WiFi testcases on VIM3 with android-12.0.0_r10, there is nothing run. While the same testcases are PASS on Pixel 5a.

Anyone has lucky in vts on VIM3?
Does it mean VIM3 doesn’t support VTS yet?

Thanks!

Logs on host:

vts-tf > run vts -m VtsHalWifiV1_3TargetTest
11-16 16:02:42 I/TestInvocation: Starting invocation for 'vts' with '[ DeviceBuildInfo{bid=eng.zzou.20211116.143839, serial=92F93E91E502} on device '92F93E91E502']
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm64/tests/apm_config_with_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm64/tests/apm_config_no_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm/tests/apm_config_with_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm/tests/apm_config_no_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm64/tests/apm_config_no_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm64/tests/apm_config_with_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm/tests/apm_config_no_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm/tests/apm_config_with_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:35 D/ITestSuite: [Total Unique Modules = 2]
11-16 16:03:35 D/ModuleDefinition: Running module arm64-v8a VtsHalWifiV1_3TargetTest
11-16 16:03:56 W/NativeDevice: Did not detect device 92F93E91E502 becoming unavailable after root
11-16 16:03:58 W/BatteryFetcher: AdbCommandRejectedException getting battery level for device 92F93E91E502: device '92F93E91E502' not found
11-16 16:03:58 W/NativeDevice: Failed to query battery level for 92F93E91E502: java.util.concurrent.ExecutionException: com.android.ddmlib.AdbCommandRejectedException: device '92F93E91E502' not found
11-16 16:03:58 W/PropertyFetcher: AdbCommandRejectedException getting properties for device 92F93E91E502
java.lang.Throwable: AdbCommandRejectedException getting properties for device 92F93E91E502
        at com.android.ddmlib.PropertyFetcher.handleException(PropertyFetcher.java:248)
        at com.android.ddmlib.PropertyFetcher.access$500(PropertyFetcher.java:30)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:211)
Caused by: com.android.ddmlib.AdbCommandRejectedException: device '92F93E91E502' not found
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1171)
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1190)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:599)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:467)
        at com.android.ddmlib.internal.DeviceImpl.executeShellCommand(DeviceImpl.java:708)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:207)

11-16 16:03:58 W/PropertyFetcher: AdbCommandRejectedException getting properties for device 92F93E91E502
java.lang.Throwable: AdbCommandRejectedException getting properties for device 92F93E91E502
        at com.android.ddmlib.PropertyFetcher.handleException(PropertyFetcher.java:248)
        at com.android.ddmlib.PropertyFetcher.access$500(PropertyFetcher.java:30)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:211)
Caused by: com.android.ddmlib.AdbCommandRejectedException: device '92F93E91E502' not found
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1171)
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1190)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:599)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:467)
        at com.android.ddmlib.internal.DeviceImpl.executeShellCommand(DeviceImpl.java:708)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:207)

11-16 16:03:58 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell ls "/data/local/tmp/VtsHalWifiV1_3TargetTest" on device 92F93E91E502
11-16 16:04:06 E/ClearcutClient: connect timed out
java.net.SocketTimeoutException: connect timed out
        at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399)
        at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242)
        at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224)
        at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
        at java.base/java.net.Socket.connect(Socket.java:591)
        at java.base/sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:285)
        at java.base/sun.net.NetworkClient.doConnect(NetworkClient.java:177)
        at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:474)
        at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:569)
        at java.base/sun.net.www.protocol.https.HttpsClient.<init>(HttpsClient.java:265)
        at java.base/sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:372)
        at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:191)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081)
        at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:177)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1362)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1337)
        at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:246)
        at com.android.tradefed.clearcut.ClearcutClient.sendToClearcut(ClearcutClient.java:284)
        at com.android.tradefed.clearcut.ClearcutClient.flushEvents(ClearcutClient.java:270)
        at com.android.tradefed.clearcut.ClearcutClient.access$000(ClearcutClient.java:52)
        at com.android.tradefed.clearcut.ClearcutClient$2.run(ClearcutClient.java:134)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)

11-16 16:05:03 E/ModuleDefinition: Unexpected Exception from preparer: com.android.tradefed.targetprep.PushFilePreparer
11-16 16:05:03 E/ModuleDefinition: Could not find device 92F93E91E502
com.android.tradefed.device.DeviceNotAvailableException[DEVICE_UNAVAILABLE|520750|LOST_SYSTEM_UNDER_TEST]: Could not find device 92F93E91E502
        at com.android.tradefed.device.WaitDeviceRecovery.handleDeviceNotAvailable(WaitDeviceRecovery.java:265)
        at com.android.tradefed.device.WaitDeviceRecovery.recoverDevice(WaitDeviceRecovery.java:152)
        at com.android.tradefed.device.NativeDevice.recoverDevice(NativeDevice.java:2320)
        at com.android.tradefed.device.NativeDevice.performDeviceAction(NativeDevice.java:2253)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:775)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:832)
        at com.android.tradefed.device.NativeDevice.doesFileExist(NativeDevice.java:1394)
        at com.android.tradefed.device.TestDevice.doesFileExist(TestDevice.java:1182)
        at com.android.tradefed.targetprep.PushFilePreparer.evaluatePushingPair(PushFilePreparer.java:429)
        at com.android.tradefed.targetprep.PushFilePreparer.setUp(PushFilePreparer.java:378)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparerSetup(ModuleDefinition.java:868)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runTargetPreparation(ModuleDefinition.java:1239)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparation(ModuleDefinition.java:828)
        at com.android.tradefed.testtype.suite.ModuleDefinition.run(ModuleDefinition.java:428)
        at com.android.tradefed.testtype.suite.ITestSuite.runSingleModule(ITestSuite.java:854)
        at com.android.tradefed.testtype.suite.ITestSuite.run(ITestSuite.java:736)
        at com.android.tradefed.invoker.InvocationExecution.runTest(InvocationExecution.java:880)
        at com.android.tradefed.invoker.InvocationExecution.runTests(InvocationExecution.java:705)
        at com.android.tradefed.invoker.TestInvocation.prepareAndRun(TestInvocation.java:483)
        at com.android.tradefed.invoker.TestInvocation.performInvocation(TestInvocation.java:252)
        at com.android.tradefed.invoker.TestInvocation.invoke(TestInvocation.java:1107)
        at com.android.tradefed.command.CommandScheduler$InvocationThread.run(CommandScheduler.java:631)

11-16 16:05:03 E/ModuleDefinition: Some preparation step failed. failing the module arm64-v8a VtsHalWifiV1_3TargetTest
11-16 16:05:03 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell start on device 92F93E91E502
11-16 16:05:04 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell start on device 92F93E91E502
11-16 16:05:05 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell start on device 92F93E91E502
11-16 16:05:06 E/ModuleDefinition: Module arm64-v8a VtsHalWifiV1_3TargetTest failed during tearDown with: com.android.tradefed.device.DeviceUnresponsiveException[DEVICE_UNRESPONSIVE|520751|LOST_SYSTEM_UNDER_TEST]: Attempted shell start multiple times on device 92F93E91E502 without communication success. Aborting.
        at com.android.tradefed.device.NativeDevice.performDeviceAction(NativeDevice.java:2262)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:775)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:832)
        at com.android.tradefed.targetprep.StopServicesSetup.tearDown(StopServicesSetup.java:54)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runTearDown(ModuleDefinition.java:974)
        at com.android.tradefed.testtype.suite.ModuleDefinition.run(ModuleDefinition.java:556)
        at com.android.tradefed.testtype.suite.ITestSuite.runSingleModule(ITestSuite.java:854)
        at com.android.tradefed.testtype.suite.ITestSuite.run(ITestSuite.java:736)
        at com.android.tradefed.invoker.InvocationExecution.runTest(InvocationExecution.java:880)
        at com.android.tradefed.invoker.InvocationExecution.runTests(InvocationExecution.java:705)
        at com.android.tradefed.invoker.TestInvocation.prepareAndRun(TestInvocation.java:483)
        at com.android.tradefed.invoker.TestInvocation.performInvocation(TestInvocation.java:252)
        at com.android.tradefed.invoker.TestInvocation.invoke(TestInvocation.java:1107)
        at com.android.tradefed.command.CommandScheduler$InvocationThread.run(CommandScheduler.java:631)

11-16 16:05:06 E/ITestSuite: A DeviceNotAvailableException occurred, following modules did not run: [armeabi-v7a VtsHalWifiV1_3TargetTest]
11-16 16:05:06 W/TestInvocation: Invocation did not complete due to device 92F93E91E502 becoming not available. Reason: com.android.tradefed.device.DeviceUnresponsiveException[DEVICE_UNRESPONSIVE|520751|LOST_SYSTEM_UNDER_TEST]: Attempted shell start multiple times on device 92F93E91E502 without communication success. Aborting.
11-16 16:05:06 E/NativeDevice: Skip Tradefed Content Provider teardown due to DeviceNotAvailableException.
11-16 16:05:06 E/TestInvocation: 'adb devices' output:
List of devices attached


11-16 16:05:06 I/SuiteResultReporter:
============================================
================= Results ==================
=============== Consumed Time ==============
    arm64-v8a VtsHalWifiV1_3TargetTest: 0 ms
    armeabi-v7a VtsHalWifiV1_3TargetTest: 0 ms
Total aggregated tests run time: 0 ms
=============== Summary ===============
Total Run time: 2m 24s
0/2 modules completed
Module(s) with run failure(s):
    armeabi-v7a VtsHalWifiV1_3TargetTest: Module did not run due to device not available.
    arm64-v8a VtsHalWifiV1_3TargetTest: com.android.tradefed.device.DeviceNotAvailableException[DEVICE_UNAVAILABLE|520750|LOST_SYSTEM_UNDER_TEST]: Could not find device 92F93E91E502
        at com.android.tradefed.device.WaitDeviceRecovery.handleDeviceNotAvailable(WaitDeviceRecovery.java:265)
        at com.android.tradefed.device.WaitDeviceRecovery.recoverDevice(WaitDeviceRecovery.java:152)
        at com.android.tradefed.device.NativeDevice.recoverDevice(NativeDevice.java:2320)
        at com.android.tradefed.device.NativeDevice.performDeviceAction(NativeDevice.java:2253)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:775)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:832)
        at com.android.tradefed.device.NativeDevice.doesFileExist(NativeDevice.java:1394)
        at com.android.tradefed.device.TestDevice.doesFileExist(TestDevice.java:1182)
        at com.android.tradefed.targetprep.PushFilePreparer.evaluatePushingPair(PushFilePreparer.java:429)
        at com.android.tradefed.targetprep.PushFilePreparer.setUp(PushFilePreparer.java:378)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparerSetup(ModuleDefinition.java:868)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runTargetPreparation(ModuleDefinition.java:1239)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparation(ModuleDefinition.java:828)
        at com.android.tradefed.testtype.suite.ModuleDefinition.run(ModuleDefinition.java:428)
        at com.android.tradefed.testtype.suite.ITestSuite.runSingleModule(ITestSuite.java:854)
        at com.android.tradefed.testtype.suite.ITestSuite.run(ITestSuite.java:736)
        at com.android.tradefed.invoker.InvocationExecution.runTest(InvocationExecution.java:880)
        at com.android.tradefed.invoker.InvocationExecution.runTests(InvocationExecution.java:705)
        at com.android.tradefed.invoker.TestInvocation.prepareAndRun(TestInvocation.java:483)
        at com.android.tradefed.invoker.TestInvocation.performInvocation(TestInvocation.java:252)
        at com.android.tradefed.invoker.TestInvocation.invoke(TestInvocation.java:1107)
        at com.android.tradefed.command.CommandScheduler$InvocationThread.run(CommandScheduler.java:631)

Total Tests       : 1
PASSED            : 0
FAILED            : 0
IMPORTANT: Some modules failed to run to completion, tests counts may be inaccurate.
============== End of Results ==============
============================================

vts-tf >

Anyone has lucky on VTS Wi-Fi on VIM3?

Thanks

Hi Khadas engineer,

Did Khadas run VTS on Wi-Fi? What’s the result? Any plan to support VTS on Khadas VIM3?

Following is Quoted from android.com.
“As of Android 8.0, VTS tests are required for all devices launched with Android 8.0 and higher.”

Thanks,

Hi @tenk.wang @jasonl @goenjoy

Would you please share your comments?

Thanks,

@David_Zou At present, AOSP android12 is still under development.