This page includes the key CTS changes introduced in Android 13.
CTS features
Android 13 includes new and updated documentation for the following CTS features.
| Features | Description | Added/Updated |
|---|---|---|
| Camera ITS updates | For a list of changes, see the Android T (AOSP experimental) Camera Image Test Suite Release Notes. | Updated |
| Fused Presence requirements compliance verification | Added CTS Verifier tests for the Presence Calibration requirements. For details, see CDD sections 2.2.1, 7.4.9, and 7.4.3. | Added |
| Multi-device testing in CTS | Android 13 supports multi-device testing. Tests
that require multiple devices are automatically executed during the CTS run.
CTS 13 includes some multi-device tests that trigger automatically when
sharding is used. While testing doesn’t require additional changes to
physical setup, virtualenv needs to be installed for tests to
run correctly. For details, see
Multi-devices suites. |
Added |
| Wifi AP requirement updates | Android 13 enhances the support for concurrent connection to two internet providing APs for STA+STA. For these optional features, an enhanced Wi-Fi test environment for CTS with two DBS APs (2.4GHz + 5GHz) is required. Any single physical DBS AP can be programmed to support these two logical APs, such as TPLink AC 1750 with OpenWRT. For details, refer to Wi-Fi STA/STA Concurrency. | Updated |
| API and CDD requirement annotations in CTS Verifier | Added annotations for tests enforcing API behaviors and CDD requirements in CTS Verifier. | Added |
| Developer contributed CTS | External developers can contribute new tests to CTS and CTS Verifier by following the guidelines in the Developer-Powered CTS (CTS-D) blog post. | Added |
| Automated foldable tests | The DeviceStateManager API enables tests with the Alternate
Modes option configured to be run on different device states of a foldable
device. Test execution is based on the display folding states defined in the
device. For details, see
Running CTS for
Alternate Modes. |
Added |
| Baseline settings | Added two baseline settings that are commonly assumed by default. Before
running each CTS test module, the system checker automatically sets the
following device baseline settings:
|
Added |
| CTS test quality improvement | Fixed test flakiness and reduced long execution time for certain tests. | Updated |
CTS modules
The number of test modules and test cases are as follows:
- ~1068 Modules depending on the devices
- ~2.69M test cases over 2 ABIs
In Android 13, a total of 119 new modules are added and a total of 19 modules are removed. See the following tables for more information.
New modules
| Added test module name | ABI | Instant App Test |
|---|---|---|
| CtsAdServicesDeviceTestCases | arm64-v8a | |
| CtsAdServicesDeviceTestCases[instant] | arm64-v8a | yes |
| CtsAmbientContextServiceTestCases | arm64-v8a | |
| CtsAndroidTestBase29ApiSignatureTestCases | arm64-v8a | |
| CtsAndroidTestBase29ApiSignatureTestCases[instant] | arm64-v8a | yes |
| CtsAndroidTestBaseUsesLibraryApiSignatureTestCases | arm64-v8a | |
| CtsAndroidTestBaseUsesLibraryApiSignatureTestCases[instant] | arm64-v8a | yes |
| CtsArtTestCases | arm64-v8a | |
| CtsArtTestCases | armeabi-v7a | |
| CtsArtTestCases[instant] | arm64-v8a | yes |
| CtsBootDisplayModeTestCases | arm64-v8a | |
| CtsBootDisplayModeTestCases[instant] | arm64-v8a | yes |
| CtsCarBuiltinApiHostTestCases | arm64-v8a | |
| CtsCarHostNonRecoverableTestCases | arm64-v8a | |
| CtsCloudSearchServiceTestCases | arm64-v8a | |
| CtsCompanionDeviceManagerCoreTestCases | arm64-v8a | |
| CtsCompanionDeviceManagerCoreTestCases[instant] | arm64-v8a | yes |
| CtsCompanionDeviceManagerNoCompanionServicesTestCases | arm64-v8a | |
| CtsCompanionDeviceManagerNoCompanionServicesTestCases[instant] | arm64-v8a | yes |
| CtsCompanionDeviceManagerUiAutomationTestCases | arm64-v8a | |
| CtsCompanionDeviceManagerUiAutomationTestCases[instant] | arm64-v8a | yes |
| CtsGameServiceTestCases | arm64-v8a | |
| CtsGameServiceTestCases | armeabi-v7a | |
| CtsGpuMetricsHostTestCases | arm64-v8a | |
| CtsInputMethodTestCases32 | arm64-v8a | |
| CtsInputMethodTestCases32[instant] | arm64-v8a | yes |
| CtsKeystorePerformanceTestCases | arm64-v8a | |
| CtsKeystorePerformanceTestCases | armeabi-v7a | |
| CtsKeystoreWycheproofTestCases | arm64-v8a | |
| CtsKeystoreWycheproofTestCases | armeabi-v7a | |
| CtsLocaleConfigTestCases | arm64-v8a | |
| CtsLocaleManagerHostTestCases | arm64-v8a | |
| CtsLocaleManagerTestCases | arm64-v8a | |
| CtsMediaAudioTestCases | arm64-v8a | |
| CtsMediaAudioTestCases | armeabi-v7a | |
| CtsMediaAudioTestCases[instant] | arm64-v8a | yes |
| CtsMediaCodecTestCases | arm64-v8a | |
| CtsMediaCodecTestCases | armeabi-v7a | |
| CtsMediaCodecTestCases[instant] | arm64-v8a | yes |
| CtsMediaDecoderTestCases | arm64-v8a | |
| CtsMediaDecoderTestCases | armeabi-v7a | |
| CtsMediaDecoderTestCases[instant] | arm64-v8a | yes |
| CtsMediaDrmFrameworkTestCases | arm64-v8a | |
| CtsMediaDrmFrameworkTestCases | armeabi-v7a | |
| CtsMediaDrmFrameworkTestCases[instant] | arm64-v8a | yes |
| CtsMediaEncoderTestCases | arm64-v8a | |
| CtsMediaEncoderTestCases | armeabi-v7a | |
| CtsMediaEncoderTestCases[instant] | arm64-v8a | yes |
| CtsMediaExtractorTestCases | arm64-v8a | |
| CtsMediaExtractorTestCases | armeabi-v7a | |
| CtsMediaExtractorTestCases[instant] | arm64-v8a | yes |
| CtsMediaMiscTestCases | arm64-v8a | |
| CtsMediaMiscTestCases | armeabi-v7a | |
| CtsMediaMiscTestCases[instant] | arm64-v8a | yes |
| CtsMediaMuxerTestCases | arm64-v8a | |
| CtsMediaMuxerTestCases | armeabi-v7a | |
| CtsMediaMuxerTestCases[instant] | arm64-v8a | yes |
| CtsMediaPlayerTestCases | arm64-v8a | |
| CtsMediaPlayerTestCases | armeabi-v7a | |
| CtsMediaPlayerTestCases[instant] | arm64-v8a | yes |
| CtsMediaRecorderTestCases | arm64-v8a | |
| CtsMediaRecorderTestCases | armeabi-v7a | |
| CtsMediaRecorderTestCases[instant] | arm64-v8a | yes |
| CtsMultiUserTestCases[run-on-secondary-user] | arm64-v8a | |
| CtsMultiUserTestCases[run-on-work-profile] | arm64-v8a | |
| CtsNNAPIStatsdAtomHostTestCases | arm64-v8a | |
| CtsNNAPIStatsdAtomHostTestCases | armeabi-v7a | |
| CtsNNAPIStatsdAtomHostTestCases[instant] | arm64-v8a | yes |
| CtsNativeNetPlatformTestCases | arm64-v8a | |
| CtsNativeNetPlatformTestCases | armeabi-v7a | |
| CtsNativeNetPlatformTestCases[instant] | arm64-v8a | yes |
| CtsNearbyFastPairTestCases | arm64-v8a | |
| CtsNetTestCasesMaxTargetSdk31 | arm64-v8a | |
| CtsNetTestCasesMaxTargetSdk31[instant] | arm64-v8a | yes |
| CtsOnDevicePersonalizationTestCases | arm64-v8a | |
| CtsOnDevicePersonalizationTestCases[instant] | arm64-v8a | yes |
| CtsOsTestCases[run-on-secondary-user] | arm64-v8a | |
| CtsOsTestCases[run-on-work-profile] | arm64-v8a | |
| CtsPackageSettingHostTestCases | arm64-v8a | |
| CtsPackageSettingHostTestCases | armeabi-v7a | |
| CtsPersistentDataBlockManagerTestCases | arm64-v8a | |
| CtsPersistentDataBlockManagerTestCases | armeabi-v7a | |
| CtsPhotoPickerTest | arm64-v8a | |
| CtsPhotoPickerTest[run-on-secondary-user] | arm64-v8a | |
| CtsPhotoPickerTest[run-on-work-profile] | arm64-v8a | |
| CtsProcessTest | arm64-v8a | |
| CtsSafetyCenterTestCases | arm64-v8a | |
| CtsSelinuxTargetSdk30TestCases | arm64-v8a | |
| CtsSettingsAPITestCases | arm64-v8a | |
| CtsSettingsAPITestCases[instant] | arm64-v8a | yes |
| CtsSharedUserMigrationTestCases | arm64-v8a | |
| CtsSkQPTestCases | arm64-v8a | |
| CtsSkQPTestCases | armeabi-v7a | |
| CtsSupplementalApiDeviceTestCases | arm64-v8a | |
| CtsSupplementalApiDeviceTestCases[instant] | arm64-v8a | yes |
| CtsTaskFpsCallbackTestCases | arm64-v8a | |
| CtsTaskFpsCallbackTestCases | armeabi-v7a | |
| CtsTaskFpsCallbackTestCases[instant] | arm64-v8a | yes |
| CtsTelephony5TestCases | arm64-v8a | |
| CtsTileServiceTestCases | arm64-v8a | |
| CtsVirtualDevicesTestCases | arm64-v8a | |
| CtsVirtualDevicesTestCases[instant] | arm64-v8a | yes |
| CtsWallpaperEffectsGenerationServiceTestCases | arm64-v8a | |
| CtsWifiAwareTestCases | arm64-v8a | |
| MicrodroidHostTestCases | arm64-v8a | |
| MicrodroidTestApp | arm64-v8a | |
| art-run-test-048-reflect-v8 | arm64-v8a | |
| art-run-test-048-reflect-v8 | armeabi-v7a | |
| art_libnativebridge_cts_tests | arm64-v8a | |
| art_libnativebridge_cts_tests | armeabi-v7a | |
| art_standalone_dex2oat_cts_tests | arm64-v8a | |
| art_standalone_dex2oat_cts_tests | armeabi-v7a | |
| art_standalone_libartpalette_tests | arm64-v8a | |
| art_standalone_libartpalette_tests | armeabi-v7a | |
| art_standalone_libdexfile_external_tests | arm64-v8a | |
| art_standalone_libdexfile_external_tests | armeabi-v7a | |
| libnativeloader_test | arm64-v8a | |
| libnativeloader_test | armeabi-v7a | |
| odsign_e2e_tests | arm64-v8a |
Removed modules
| Deleted test module name | ABI | Instant App Test |
|---|---|---|
| CtsActivityRecognitionTestCases[instant] | arm64-v8a | yes |
| CtsAndroidTestBase28ApiSignatureTestCases | arm64-v8a | |
| CtsAndroidTestBase28ApiSignatureTestCases[instant] | arm64-v8a | yes |
| CtsAppCloningHostTest[instant] | arm64-v8a | yes |
| CtsCodePathHostTestCases | arm64-v8a | |
| CtsCodePathHostTestCases | armeabi-v7a | |
| CtsCurrentApiSignatureTestCases[instant] | arm64-v8a | yes |
| CtsDreamsTestCases[instant] | arm64-v8a | yes |
| CtsMediaTestCases | arm64-v8a | |
| CtsMediaTestCases | armeabi-v7a | |
| CtsMediaTestCases[instant] | arm64-v8a | yes |
| CtsScopedStorageCoreHostTest[instant] | arm64-v8a | yes |
| CtsTelephonySdk28TestCases | arm64-v8a | |
| CtsTelephonyTestCasesPermissionReadPhoneState | arm64-v8a | |
| CtsTelephonyTestCasesPermissionReadPhoneState[instant] | arm64-v8a | yes |
| LegacyStorageTest | arm64-v8a | |
| LegacyStorageTest[instant] | arm64-v8a | yes |
| ScopedStorageTest | arm64-v8a | |
| ScopedStorageTest[instant] | arm64-v8a | yes |