VTS doesn't run on VIM3 AOSP 12

VIM3
1

Hi all,
I tried to run VTS WiFi testcases on VIM3 with android-12.0.0_r10, there is nothing run. While the same testcases are PASS on Pixel 5a.

Anyone has lucky in vts on VIM3?
Does it mean VIM3 doesn’t support VTS yet?

Thanks!

Logs on host:

vts-tf > run vts -m VtsHalWifiV1_3TargetTest
11-16 16:02:42 I/TestInvocation: Starting invocation for 'vts' with '[ DeviceBuildInfo{bid=eng.zzou.20211116.143839, serial=92F93E91E502} on device '92F93E91E502']
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm64/tests/apm_config_with_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm64/tests/apm_config_no_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm/tests/apm_config_with_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV6_0GeneratorTest/arm/tests/apm_config_no_vx.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm64/tests/apm_config_no_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm64/tests/apm_config_with_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm/tests/apm_config_no_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:33 E/ConfigurationUtil: /nvme0/zzou/android12-r10-vim3/out/host/linux-x86/vts/android-vts/testcases/HalAudioV7_0GeneratorTest/arm/tests/apm_config_with_vx_7_0.xml doesn't look like a test configuration.
11-16 16:03:35 D/ITestSuite: [Total Unique Modules = 2]
11-16 16:03:35 D/ModuleDefinition: Running module arm64-v8a VtsHalWifiV1_3TargetTest
11-16 16:03:56 W/NativeDevice: Did not detect device 92F93E91E502 becoming unavailable after root
11-16 16:03:58 W/BatteryFetcher: AdbCommandRejectedException getting battery level for device 92F93E91E502: device '92F93E91E502' not found
11-16 16:03:58 W/NativeDevice: Failed to query battery level for 92F93E91E502: java.util.concurrent.ExecutionException: com.android.ddmlib.AdbCommandRejectedException: device '92F93E91E502' not found
11-16 16:03:58 W/PropertyFetcher: AdbCommandRejectedException getting properties for device 92F93E91E502
java.lang.Throwable: AdbCommandRejectedException getting properties for device 92F93E91E502
        at com.android.ddmlib.PropertyFetcher.handleException(PropertyFetcher.java:248)
        at com.android.ddmlib.PropertyFetcher.access$500(PropertyFetcher.java:30)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:211)
Caused by: com.android.ddmlib.AdbCommandRejectedException: device '92F93E91E502' not found
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1171)
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1190)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:599)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:467)
        at com.android.ddmlib.internal.DeviceImpl.executeShellCommand(DeviceImpl.java:708)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:207)

11-16 16:03:58 W/PropertyFetcher: AdbCommandRejectedException getting properties for device 92F93E91E502
java.lang.Throwable: AdbCommandRejectedException getting properties for device 92F93E91E502
        at com.android.ddmlib.PropertyFetcher.handleException(PropertyFetcher.java:248)
        at com.android.ddmlib.PropertyFetcher.access$500(PropertyFetcher.java:30)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:211)
Caused by: com.android.ddmlib.AdbCommandRejectedException: device '92F93E91E502' not found
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1171)
        at com.android.ddmlib.AdbHelper.setDevice(AdbHelper.java:1190)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:599)
        at com.android.ddmlib.AdbHelper.executeRemoteCommand(AdbHelper.java:467)
        at com.android.ddmlib.internal.DeviceImpl.executeShellCommand(DeviceImpl.java:708)
        at com.android.ddmlib.PropertyFetcher$1.run(PropertyFetcher.java:207)

11-16 16:03:58 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell ls "/data/local/tmp/VtsHalWifiV1_3TargetTest" on device 92F93E91E502
11-16 16:04:06 E/ClearcutClient: connect timed out
java.net.SocketTimeoutException: connect timed out
        at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399)
        at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242)
        at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224)
        at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
        at java.base/java.net.Socket.connect(Socket.java:591)
        at java.base/sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:285)
        at java.base/sun.net.NetworkClient.doConnect(NetworkClient.java:177)
        at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:474)
        at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:569)
        at java.base/sun.net.www.protocol.https.HttpsClient.<init>(HttpsClient.java:265)
        at java.base/sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:372)
        at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:191)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081)
        at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:177)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1362)
        at java.base/sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1337)
        at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:246)
        at com.android.tradefed.clearcut.ClearcutClient.sendToClearcut(ClearcutClient.java:284)
        at com.android.tradefed.clearcut.ClearcutClient.flushEvents(ClearcutClient.java:270)
        at com.android.tradefed.clearcut.ClearcutClient.access$000(ClearcutClient.java:52)
        at com.android.tradefed.clearcut.ClearcutClient$2.run(ClearcutClient.java:134)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)

11-16 16:05:03 E/ModuleDefinition: Unexpected Exception from preparer: com.android.tradefed.targetprep.PushFilePreparer
11-16 16:05:03 E/ModuleDefinition: Could not find device 92F93E91E502
com.android.tradefed.device.DeviceNotAvailableException[DEVICE_UNAVAILABLE|520750|LOST_SYSTEM_UNDER_TEST]: Could not find device 92F93E91E502
        at com.android.tradefed.device.WaitDeviceRecovery.handleDeviceNotAvailable(WaitDeviceRecovery.java:265)
        at com.android.tradefed.device.WaitDeviceRecovery.recoverDevice(WaitDeviceRecovery.java:152)
        at com.android.tradefed.device.NativeDevice.recoverDevice(NativeDevice.java:2320)
        at com.android.tradefed.device.NativeDevice.performDeviceAction(NativeDevice.java:2253)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:775)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:832)
        at com.android.tradefed.device.NativeDevice.doesFileExist(NativeDevice.java:1394)
        at com.android.tradefed.device.TestDevice.doesFileExist(TestDevice.java:1182)
        at com.android.tradefed.targetprep.PushFilePreparer.evaluatePushingPair(PushFilePreparer.java:429)
        at com.android.tradefed.targetprep.PushFilePreparer.setUp(PushFilePreparer.java:378)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparerSetup(ModuleDefinition.java:868)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runTargetPreparation(ModuleDefinition.java:1239)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparation(ModuleDefinition.java:828)
        at com.android.tradefed.testtype.suite.ModuleDefinition.run(ModuleDefinition.java:428)
        at com.android.tradefed.testtype.suite.ITestSuite.runSingleModule(ITestSuite.java:854)
        at com.android.tradefed.testtype.suite.ITestSuite.run(ITestSuite.java:736)
        at com.android.tradefed.invoker.InvocationExecution.runTest(InvocationExecution.java:880)
        at com.android.tradefed.invoker.InvocationExecution.runTests(InvocationExecution.java:705)
        at com.android.tradefed.invoker.TestInvocation.prepareAndRun(TestInvocation.java:483)
        at com.android.tradefed.invoker.TestInvocation.performInvocation(TestInvocation.java:252)
        at com.android.tradefed.invoker.TestInvocation.invoke(TestInvocation.java:1107)
        at com.android.tradefed.command.CommandScheduler$InvocationThread.run(CommandScheduler.java:631)

11-16 16:05:03 E/ModuleDefinition: Some preparation step failed. failing the module arm64-v8a VtsHalWifiV1_3TargetTest
11-16 16:05:03 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell start on device 92F93E91E502
11-16 16:05:04 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell start on device 92F93E91E502
11-16 16:05:05 W/NativeDevice: AdbCommandRejectedException (device '92F93E91E502' not found) when attempting shell start on device 92F93E91E502
11-16 16:05:06 E/ModuleDefinition: Module arm64-v8a VtsHalWifiV1_3TargetTest failed during tearDown with: com.android.tradefed.device.DeviceUnresponsiveException[DEVICE_UNRESPONSIVE|520751|LOST_SYSTEM_UNDER_TEST]: Attempted shell start multiple times on device 92F93E91E502 without communication success. Aborting.
        at com.android.tradefed.device.NativeDevice.performDeviceAction(NativeDevice.java:2262)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:775)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:832)
        at com.android.tradefed.targetprep.StopServicesSetup.tearDown(StopServicesSetup.java:54)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runTearDown(ModuleDefinition.java:974)
        at com.android.tradefed.testtype.suite.ModuleDefinition.run(ModuleDefinition.java:556)
        at com.android.tradefed.testtype.suite.ITestSuite.runSingleModule(ITestSuite.java:854)
        at com.android.tradefed.testtype.suite.ITestSuite.run(ITestSuite.java:736)
        at com.android.tradefed.invoker.InvocationExecution.runTest(InvocationExecution.java:880)
        at com.android.tradefed.invoker.InvocationExecution.runTests(InvocationExecution.java:705)
        at com.android.tradefed.invoker.TestInvocation.prepareAndRun(TestInvocation.java:483)
        at com.android.tradefed.invoker.TestInvocation.performInvocation(TestInvocation.java:252)
        at com.android.tradefed.invoker.TestInvocation.invoke(TestInvocation.java:1107)
        at com.android.tradefed.command.CommandScheduler$InvocationThread.run(CommandScheduler.java:631)

11-16 16:05:06 E/ITestSuite: A DeviceNotAvailableException occurred, following modules did not run: [armeabi-v7a VtsHalWifiV1_3TargetTest]
11-16 16:05:06 W/TestInvocation: Invocation did not complete due to device 92F93E91E502 becoming not available. Reason: com.android.tradefed.device.DeviceUnresponsiveException[DEVICE_UNRESPONSIVE|520751|LOST_SYSTEM_UNDER_TEST]: Attempted shell start multiple times on device 92F93E91E502 without communication success. Aborting.
11-16 16:05:06 E/NativeDevice: Skip Tradefed Content Provider teardown due to DeviceNotAvailableException.
11-16 16:05:06 E/TestInvocation: 'adb devices' output:
List of devices attached


11-16 16:05:06 I/SuiteResultReporter:
============================================
================= Results ==================
=============== Consumed Time ==============
    arm64-v8a VtsHalWifiV1_3TargetTest: 0 ms
    armeabi-v7a VtsHalWifiV1_3TargetTest: 0 ms
Total aggregated tests run time: 0 ms
=============== Summary ===============
Total Run time: 2m 24s
0/2 modules completed
Module(s) with run failure(s):
    armeabi-v7a VtsHalWifiV1_3TargetTest: Module did not run due to device not available.
    arm64-v8a VtsHalWifiV1_3TargetTest: com.android.tradefed.device.DeviceNotAvailableException[DEVICE_UNAVAILABLE|520750|LOST_SYSTEM_UNDER_TEST]: Could not find device 92F93E91E502
        at com.android.tradefed.device.WaitDeviceRecovery.handleDeviceNotAvailable(WaitDeviceRecovery.java:265)
        at com.android.tradefed.device.WaitDeviceRecovery.recoverDevice(WaitDeviceRecovery.java:152)
        at com.android.tradefed.device.NativeDevice.recoverDevice(NativeDevice.java:2320)
        at com.android.tradefed.device.NativeDevice.performDeviceAction(NativeDevice.java:2253)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:775)
        at com.android.tradefed.device.NativeDevice.executeShellCommand(NativeDevice.java:832)
        at com.android.tradefed.device.NativeDevice.doesFileExist(NativeDevice.java:1394)
        at com.android.tradefed.device.TestDevice.doesFileExist(TestDevice.java:1182)
        at com.android.tradefed.targetprep.PushFilePreparer.evaluatePushingPair(PushFilePreparer.java:429)
        at com.android.tradefed.targetprep.PushFilePreparer.setUp(PushFilePreparer.java:378)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparerSetup(ModuleDefinition.java:868)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runTargetPreparation(ModuleDefinition.java:1239)
        at com.android.tradefed.testtype.suite.ModuleDefinition.runPreparation(ModuleDefinition.java:828)
        at com.android.tradefed.testtype.suite.ModuleDefinition.run(ModuleDefinition.java:428)
        at com.android.tradefed.testtype.suite.ITestSuite.runSingleModule(ITestSuite.java:854)
        at com.android.tradefed.testtype.suite.ITestSuite.run(ITestSuite.java:736)
        at com.android.tradefed.invoker.InvocationExecution.runTest(InvocationExecution.java:880)
        at com.android.tradefed.invoker.InvocationExecution.runTests(InvocationExecution.java:705)
        at com.android.tradefed.invoker.TestInvocation.prepareAndRun(TestInvocation.java:483)
        at com.android.tradefed.invoker.TestInvocation.performInvocation(TestInvocation.java:252)
        at com.android.tradefed.invoker.TestInvocation.invoke(TestInvocation.java:1107)
        at com.android.tradefed.command.CommandScheduler$InvocationThread.run(CommandScheduler.java:631)

Total Tests       : 1
PASSED            : 0
FAILED            : 0
IMPORTANT: Some modules failed to run to completion, tests counts may be inaccurate.
============== End of Results ==============
============================================

vts-tf >
2

Anyone has lucky on VTS Wi-Fi on VIM3?

Thanks

3

Hi Khadas engineer,

Did Khadas run VTS on Wi-Fi? What’s the result? Any plan to support VTS on Khadas VIM3?

Following is Quoted from android.com.
“As of Android 8.0, VTS tests are required for all devices launched with Android 8.0 and higher.”

Thanks,

4

Hi @tenk.wang @jasonl @goenjoy

Would you please share your comments?

Thanks,

5

@David_Zou At present, AOSP android12 is still under development.

6

Dear Wang
Now, I’m facing the same problems, It seems that VTS/CTS can NOT run in VIM3L of AOSP12,Could you help me check check ?Thank you very much
I found that, the android.tradefed.contentprovider and com.android.compatibility.common.deviceinfo can NOT be run when VTS running,

Below is my part logs of that

08-16 11:54:40.211 1339 1353 I MediaProvider: Invalidating LocalCallingIdentity cache for package com.android.compatibility.common.deviceinfo. Reason: op android:read_external_storage
28 08-16 11:54:40.228 235 348 E vold : Failed to find mounted volume for /dev/null/Android/obb/com.android.compatibility.common.deviceinfo/
29 08-16 11:54:40.229 591 661 E StorageManagerService: Failed to fixup app dir for com.android.compatibility.common.deviceinfo

08-16 11:54:59.552 1339 1365 I MediaProvider: Invalidating LocalCallingIdentity cache for package android.tradefed.contentprovider. Reason: op android:read_external_storage
08-16 11:54:59.569 235 348 E vold : Failed to find mounted volume for /dev/null/Android/obb/android.tradefed.contentprovider/
08-16 11:54:59.570 591 661 E StorageManagerService: Failed to fixup app dir for android.tradefed.contentprovider

@tenk.wang

Dear @goenjoy could you help me to check this ? Thank you very much !