Android 13 CTS release notes

This page includes the key CTS changes introduced in Android 13.

CTS features

Android 13 includes new and updated documentation for the following CTS features.

Features Description Added/Updated
Camera ITS updates For a list of changes, see the Android T (AOSP experimental) Camera Image Test Suite Release Notes. Updated
Fused Presence requirements compliance verification Added CTS Verifier tests for the Presence Calibration requirements. For details, see CDD sections 2.2.1, 7.4.9, and 7.4.3. Added
Multi-device testing in CTS Android 13 supports multi-device testing. Tests that require multiple devices are automatically executed during the CTS run. CTS 13 includes some multi-device tests that trigger automatically when sharding is used. While testing doesn’t require additional changes to physical setup, virtualenv needs to be installed for tests to run correctly. For details, see Multi-devices suites. Added
Wifi AP requirement updates Android 13 enhances the support for concurrent connection to two internet providing APs for STA+STA. For these optional features, an enhanced Wi-Fi test environment for CTS with two DBS APs (2.4GHz + 5GHz) is required. Any single physical DBS AP can be programmed to support these two logical APs, such as TPLink AC 1750 with OpenWRT. For details, refer to Wi-Fi STA/STA Concurrency. Updated
API and CDD requirement annotations in CTS Verifier Added annotations for tests enforcing API behaviors and CDD requirements in CTS Verifier. Added
Developer contributed CTS External developers can contribute new tests to CTS and CTS Verifier by following the guidelines in the Developer-Powered CTS (CTS-D) blog post. Added
Automated foldable tests The DeviceStateManager API enables tests with the Alternate Modes option configured to be run on different device states of a foldable device. Test execution is based on the display folding states defined in the device. For details, see Running CTS for Alternate Modes. Added
Baseline settings Added two baseline settings that are commonly assumed by default. Before running each CTS test module, the system checker automatically sets the following device baseline settings:
  • Keep screen on
  • Disable automatic OS updates
Added
CTS test quality improvement Fixed test flakiness and reduced long execution time for certain tests. Updated

CTS modules

The number of test modules and test cases are as follows:

  • ~1068 Modules depending on the devices
  • ~2.69M test cases over 2 ABIs

In Android 13, a total of 119 new modules are added and a total of 19 modules are removed. See the following tables for more information.

New modules

Added test module name ABI Instant App Test
CtsAdServicesDeviceTestCases arm64-v8a
CtsAdServicesDeviceTestCases[instant] arm64-v8a yes
CtsAmbientContextServiceTestCases arm64-v8a
CtsAndroidTestBase29ApiSignatureTestCases arm64-v8a
CtsAndroidTestBase29ApiSignatureTestCases[instant] arm64-v8a yes
CtsAndroidTestBaseUsesLibraryApiSignatureTestCases arm64-v8a
CtsAndroidTestBaseUsesLibraryApiSignatureTestCases[instant] arm64-v8a yes
CtsArtTestCases arm64-v8a
CtsArtTestCases armeabi-v7a
CtsArtTestCases[instant] arm64-v8a yes
CtsBootDisplayModeTestCases arm64-v8a
CtsBootDisplayModeTestCases[instant] arm64-v8a yes
CtsCarBuiltinApiHostTestCases arm64-v8a
CtsCarHostNonRecoverableTestCases arm64-v8a
CtsCloudSearchServiceTestCases arm64-v8a
CtsCompanionDeviceManagerCoreTestCases arm64-v8a
CtsCompanionDeviceManagerCoreTestCases[instant] arm64-v8a yes
CtsCompanionDeviceManagerNoCompanionServicesTestCases arm64-v8a
CtsCompanionDeviceManagerNoCompanionServicesTestCases[instant] arm64-v8a yes
CtsCompanionDeviceManagerUiAutomationTestCases arm64-v8a
CtsCompanionDeviceManagerUiAutomationTestCases[instant] arm64-v8a yes
CtsGameServiceTestCases arm64-v8a
CtsGameServiceTestCases armeabi-v7a
CtsGpuMetricsHostTestCases arm64-v8a
CtsInputMethodTestCases32 arm64-v8a
CtsInputMethodTestCases32[instant] arm64-v8a yes
CtsKeystorePerformanceTestCases arm64-v8a
CtsKeystorePerformanceTestCases armeabi-v7a
CtsKeystoreWycheproofTestCases arm64-v8a
CtsKeystoreWycheproofTestCases armeabi-v7a
CtsLocaleConfigTestCases arm64-v8a
CtsLocaleManagerHostTestCases arm64-v8a
CtsLocaleManagerTestCases arm64-v8a
CtsMediaAudioTestCases arm64-v8a
CtsMediaAudioTestCases armeabi-v7a
CtsMediaAudioTestCases[instant] arm64-v8a yes
CtsMediaCodecTestCases arm64-v8a
CtsMediaCodecTestCases armeabi-v7a
CtsMediaCodecTestCases[instant] arm64-v8a yes
CtsMediaDecoderTestCases arm64-v8a
CtsMediaDecoderTestCases armeabi-v7a
CtsMediaDecoderTestCases[instant] arm64-v8a yes
CtsMediaDrmFrameworkTestCases arm64-v8a
CtsMediaDrmFrameworkTestCases armeabi-v7a
CtsMediaDrmFrameworkTestCases[instant] arm64-v8a yes
CtsMediaEncoderTestCases arm64-v8a
CtsMediaEncoderTestCases armeabi-v7a
CtsMediaEncoderTestCases[instant] arm64-v8a yes
CtsMediaExtractorTestCases arm64-v8a
CtsMediaExtractorTestCases armeabi-v7a
CtsMediaExtractorTestCases[instant] arm64-v8a yes
CtsMediaMiscTestCases arm64-v8a
CtsMediaMiscTestCases armeabi-v7a
CtsMediaMiscTestCases[instant] arm64-v8a yes
CtsMediaMuxerTestCases arm64-v8a
CtsMediaMuxerTestCases armeabi-v7a
CtsMediaMuxerTestCases[instant] arm64-v8a yes
CtsMediaPlayerTestCases arm64-v8a
CtsMediaPlayerTestCases armeabi-v7a
CtsMediaPlayerTestCases[instant] arm64-v8a yes
CtsMediaRecorderTestCases arm64-v8a
CtsMediaRecorderTestCases armeabi-v7a
CtsMediaRecorderTestCases[instant] arm64-v8a yes
CtsMultiUserTestCases[run-on-secondary-user] arm64-v8a
CtsMultiUserTestCases[run-on-work-profile] arm64-v8a
CtsNNAPIStatsdAtomHostTestCases arm64-v8a
CtsNNAPIStatsdAtomHostTestCases armeabi-v7a
CtsNNAPIStatsdAtomHostTestCases[instant] arm64-v8a yes
CtsNativeNetPlatformTestCases arm64-v8a
CtsNativeNetPlatformTestCases armeabi-v7a
CtsNativeNetPlatformTestCases[instant] arm64-v8a yes
CtsNearbyFastPairTestCases arm64-v8a
CtsNetTestCasesMaxTargetSdk31 arm64-v8a
CtsNetTestCasesMaxTargetSdk31[instant] arm64-v8a yes
CtsOnDevicePersonalizationTestCases arm64-v8a
CtsOnDevicePersonalizationTestCases[instant] arm64-v8a yes
CtsOsTestCases[run-on-secondary-user] arm64-v8a
CtsOsTestCases[run-on-work-profile] arm64-v8a
CtsPackageSettingHostTestCases arm64-v8a
CtsPackageSettingHostTestCases armeabi-v7a
CtsPersistentDataBlockManagerTestCases arm64-v8a
CtsPersistentDataBlockManagerTestCases armeabi-v7a
CtsPhotoPickerTest arm64-v8a
CtsPhotoPickerTest[run-on-secondary-user] arm64-v8a
CtsPhotoPickerTest[run-on-work-profile] arm64-v8a
CtsProcessTest arm64-v8a
CtsSafetyCenterTestCases arm64-v8a
CtsSelinuxTargetSdk30TestCases arm64-v8a
CtsSettingsAPITestCases arm64-v8a
CtsSettingsAPITestCases[instant] arm64-v8a yes
CtsSharedUserMigrationTestCases arm64-v8a
CtsSkQPTestCases arm64-v8a
CtsSkQPTestCases armeabi-v7a
CtsSupplementalApiDeviceTestCases arm64-v8a
CtsSupplementalApiDeviceTestCases[instant] arm64-v8a yes
CtsTaskFpsCallbackTestCases arm64-v8a
CtsTaskFpsCallbackTestCases armeabi-v7a
CtsTaskFpsCallbackTestCases[instant] arm64-v8a yes
CtsTelephony5TestCases arm64-v8a
CtsTileServiceTestCases arm64-v8a
CtsVirtualDevicesTestCases arm64-v8a
CtsVirtualDevicesTestCases[instant] arm64-v8a yes
CtsWallpaperEffectsGenerationServiceTestCases arm64-v8a
CtsWifiAwareTestCases arm64-v8a
MicrodroidHostTestCases arm64-v8a
MicrodroidTestApp arm64-v8a
art-run-test-048-reflect-v8 arm64-v8a
art-run-test-048-reflect-v8 armeabi-v7a
art_libnativebridge_cts_tests arm64-v8a
art_libnativebridge_cts_tests armeabi-v7a
art_standalone_dex2oat_cts_tests arm64-v8a
art_standalone_dex2oat_cts_tests armeabi-v7a
art_standalone_libartpalette_tests arm64-v8a
art_standalone_libartpalette_tests armeabi-v7a
art_standalone_libdexfile_external_tests arm64-v8a
art_standalone_libdexfile_external_tests armeabi-v7a
libnativeloader_test arm64-v8a
libnativeloader_test armeabi-v7a
odsign_e2e_tests arm64-v8a

Removed modules

Deleted test module name ABI Instant App Test
CtsActivityRecognitionTestCases[instant] arm64-v8a yes
CtsAndroidTestBase28ApiSignatureTestCases arm64-v8a
CtsAndroidTestBase28ApiSignatureTestCases[instant] arm64-v8a yes
CtsAppCloningHostTest[instant] arm64-v8a yes
CtsCodePathHostTestCases arm64-v8a
CtsCodePathHostTestCases armeabi-v7a
CtsCurrentApiSignatureTestCases[instant] arm64-v8a yes
CtsDreamsTestCases[instant] arm64-v8a yes
CtsMediaTestCases arm64-v8a
CtsMediaTestCases armeabi-v7a
CtsMediaTestCases[instant] arm64-v8a yes
CtsScopedStorageCoreHostTest[instant] arm64-v8a yes
CtsTelephonySdk28TestCases arm64-v8a
CtsTelephonyTestCasesPermissionReadPhoneState arm64-v8a
CtsTelephonyTestCasesPermissionReadPhoneState[instant] arm64-v8a yes
LegacyStorageTest arm64-v8a
LegacyStorageTest[instant] arm64-v8a yes
ScopedStorageTest arm64-v8a
ScopedStorageTest[instant] arm64-v8a yes