CTS 17 release notes

This page includes the key CTS changes introduced in CTS 17 R1.

Infrastructure improvements

Test result aggregation and reporting

The CTS-V reporting structure (including CameraITS) has been refactored to support granular subtest results. This enhancement enables parallel execution of subtests to reduce total runtime, and focused reruns of failed subtests rather than the full module.

Token sharding

Fixed an issue with the enable-token-sharding feature, which sometimes fails to recognize samples with SIM cards, causing tests to run incorrectly.

Efficiency improvements

Biometrics test optimization

The biometric test suite in CTS-V combines multiple time-based key tests, reducing the number of authentication prompts from 120 to 72.

Connectivity and ranging modernization

The manual Presence test, which requires a standardized 1 m device setup for accurate validation, has been replaced by a fully automated Ranging module (Ranging test).

Wi-Fi test modernization

Updates to the Wi-Fi test suite include the introduction of new Unsynchronized Service Discovery (USD) tests, migration of existing Permission tests into a modernized framework, and the removal of legacy manual Connection tests.

Multimedia and telecom enhancements

The Secure Playback test is introduced to validate secure playback capabilities, ensuring correct video display and frame rate consistency secure playback test setup. This is a CTS Verifier test and requires a Peripheral Playback analysis tool.

Telecom test automation

Manual Telecom tests are replaced by the CtsTelecomTests automated module in CTS-V-HOST.

CTS modules

The number of test modules and test cases are as follows:

• Approximately 1,244 modules depending on the device type.
• Approximately 3.1 million test cases for single ABI.

185 new modules

• CtsAActivityManagerTest
• CtsAlarmAtomHostTestCases
• CtsAlarmAtomHostTestCases[instant]
• CtsAllowlistTestCases
• CtsAllowlistTestCases[instant]
• CtsAngleEnd2EndTestCases
• CtsAnomalyDetectorTests
• CtsAppcompatStateAtomHostTestCases
• CtsAppcompatStateAtomHostTestCases[instant]
• CtsAppExitAtomHostTestCases
• CtsAppExitAtomHostTestCases[instant]
• CtsAppFunctionNoQueryAllPackagesTestCases
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-clone-profile]
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-private-profile]
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-secondary-user]
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-work-profile]
• CtsAppFunctionsAtomHostTestCases
• CtsAppFunctionsAtomHostTestCases[instant]
• CtsAppHibernationAtomHostTestCases
• CtsAppHibernationAtomHostTestCases[instant]
• CtsAppInteractionTestCases
• CtsAppInteractionTestCases[run-on-clone-profile]
• CtsAppInteractionTestCases[run-on-private-profile]
• CtsAppInteractionTestCases[run-on-secondary-user]
• CtsAppInteractionTestCases[run-on-work-profile]
• CtsAppOpsAtomHostTestCases
• CtsAppOpsAtomHostTestCases[instant]
• CtsAppStartAtomHostTestCases
• CtsAppStartAtomHostTestCases[instant]
• CtsBackportedFixesAtomHostTestCases
• CtsBackportedFixesAtomHostTestCases[instant]
• CtsBatteryCycleAtomHostTestCases
• CtsBatteryCycleAtomHostTestCases[instant]
• CtsBatteryStatsAtomHostTestCases
• CtsBatteryStatsAtomHostTestCases[instant]
• CtsBinderStatsAtomHostTestCases
• CtsBinderStatsAtomHostTestCases[instant]
• CtsBluetoothAtomHostTestCases
• CtsBluetoothAtomHostTestCases[instant]
• CtsConscryptTestCases
• CtsContactsPickerCoreTestCases
• CtsContactsPickerCoreTestCases[run-on-clone-profile]
• CtsContactsPickerCoreTestCases[run-on-private-profile]
• CtsContactsPickerCoreTestCases[run-on-work-profile]
• CtsContactsPickerCoreTestCasesSdk36
• CtsContactsProviderHostTestCases
• CtsContactsProviderSessionTestCases
• CtsContactsProviderTestsStrictSqlCheckSdk37
• CtsContentPccTestCases
• CtsContentRestrictionTestCases
• CtsContentSafetyServiceTestCases
• CtsContextualModeManagerTestCases
• CtsContextualModeManagerTestCases[run-on-clone-profile]
• CtsContextualModeManagerTestCases[run-on-private-profile]
• CtsContextualModeManagerTestCases[run-on-secondary-user]
• CtsContextualModeManagerTestCases[run-on-work-profile]
• CtsCoreGraphicsAtomHostTestCases
• CtsCoreGraphicsAtomHostTestCases[instant]
• CtsCpuAtomHostTestCases
• CtsCpuAtomHostTestCases[instant]
• CtsCredentialsAtomHostTestCases
• CtsCredentialsAtomHostTestCases[instant]
• CtsDevicePowerAtomHostTestCases
• CtsDevicePowerAtomHostTestCases[instant]
• CtsDeviceStateAtomHostTestCases
• CtsDeviceStateAtomHostTestCases[instant]
• CtsDisplayAtomHostTestCases
• CtsDisplayAtomHostTestCases[instant]
• CtsDisplayStaticDeviceStateTestCases
• CtsDisplayStaticDeviceStateTestCases[instant]
• CtsGameManagerAtomHostTestCases
• CtsGameManagerAtomHostTestCases[instant]
• CtsGnssAtomHostTestCases
• CtsGnssAtomHostTestCases[instant]
• CtsGpuTestCases
• CtsGpuTestCases[instant]
• CtsHardwareHealthAtomHostTestCases
• CtsHardwareHealthAtomHostTestCases[instant]
• CtsJobSchedulerAtomHostTestCases
• CtsJobSchedulerAtomHostTestCases[instant]
• CtsLogcatHostTestCases
• CtsMediaAtomHostTestCases
• CtsMediaAtomHostTestCases[instant]
• CtsMediaRouterHostTestCases
• CtsMediaRouterHostTestCases[instant]
• CtsMemoryAtomHostTestCases
• CtsMemoryAtomHostTestCases[instant]
• CtsMemorySafetyAtomHostTestCases
• CtsMemorySafetyAtomHostTestCases[instant]
• CtsMotionCuesTestCases
• CtsMotionCuesTestCases[instant]
• CtsMultisensoryTestCases
• CtsMultisensoryTestCases[instant]
• CtsMultisensoryTestCases[run-on-clone-profile]
• CtsMultisensoryTestCases[run-on-private-profile]
• CtsMultisensoryTestCases[run-on-secondary-user]
• CtsMultisensoryTestCases[run-on-work-profile]
• CtsNativeNdkAllowlistTest
• CtsNativeServiceTest
• CtsNetAtomHostTestCases
• CtsNetAtomHostTestCases[instant]
• CtsNetSecConfigCustomTrustManagerTestCases
• CtsNetSecConfigCustomTrustManagerTestCases[instant]
• CtsNetSecConfigEncryptedClientHelloTestCases
• CtsNetSecConfigEncryptedClientHelloTestCases[instant]
• CtsNetSecEncryptedClientHelloTestCases
• CtsNetSecEncryptedClientHelloTestCases[instant]
• CtsNetTestCasesLocalNetNoPermissions
• CtsNetTestCasesLocalNetNoPermissions[instant]
• CtsNotificationAtomHostTestCases
• CtsNotificationAtomHostTestCases[instant]
• CtsNpuManagerMoblyTestCases
• CtsNpuManagerTestCases
• CtsPackageManagerIsolatedSplitHostTestCases
• CtsPackageManagerSplitHostTestCases
• CtsPccFeatureTests
• CtsPccFeatureTests[run-on-clone-profile]
• CtsPccFeatureTests[run-on-private-profile]
• CtsPccFeatureTests[run-on-secondary-user]
• CtsPccFeatureTests[run-on-work-profile]
• CtsPccProcessTests
• CtsPccSandboxManagerNativeTest
• CtsPccSecurityTestCases
• CtsPerfAtomHostTestCases
• CtsPerfAtomHostTestCases[instant]
• CtsPerfettoAtomHostTestCases
• CtsPerfettoAtomHostTestCases[instant]
• CtsPerformanceHintManagerAtomHostTestCases
• CtsPerformanceHintManagerAtomHostTestCases[instant]
• CtsPermissionStateAtomHostTestCases
• CtsPermissionStateAtomHostTestCases[instant]
• CtsPersonalContextTestCases
• CtsPersonalContextTestCases[run-on-clone-profile]
• CtsPersonalContextTestCases[run-on-private-profile]
• CtsPersonalContextTestCases[run-on-secondary-user]
• CtsPersonalContextTestCases[run-on-work-profile]
• CtsPowerAtomHostTestCases
• CtsPowerAtomHostTestCases[instant]
• CtsPowerManagerAtomHostTestCases
• CtsPowerManagerAtomHostTestCases[instant]
• CtsPowerManagerPccTestCases
• CtsPowerManagerPccTestCases[instant]
• CtsPowerManagerPccTestCases[run-on-work-profile]
• CtsSerialTestCases
• CtsSettingsStatsAtomHostTestCases
• CtsSettingsStatsAtomHostTestCases[instant]
• CtsSharesheetAppLockTestCases
• CtsSizeCompatRestartButtonAtomHostTestCases
• CtsSizeCompatRestartButtonAtomHostTestCases[instant]
• CtsSoundTriggerPccTestCases
• CtsStatsdAtomHostRebootTestCases
• CtsStatsdAtomHostRebootTestCases[instant]
• CtsStopAndKillHostTest
• CtsTelecomModuleTests
• CtsTelephonyAtomHostTestCases
• CtsTelephonyAtomHostTestCases[instant]
• CtsTelephonySatelliteTestCases
• CtsTextClassifierPccTestCases
• CtsTlsAtomHostTestCases
• CtsTlsAtomHostTestCases[instant]
• CtsTrustTokenServiceTestCases
• CtsTrustTokenServiceTestCases[instant]
• CtsUprobeStatsTest
• CtsUsageEventsPccTestCases
• CtsUsbAtomHostTestCases
• CtsUsbAtomHostTestCases[instant]
• CtsUsbManagerTestCases[run-on-clone-profile]
• CtsUsbManagerTestCases[run-on-private-profile]
• CtsUsbManagerTestCases[run-on-secondary-user]
• CtsUsbManagerTestCases[run-on-work-profile]
• CtsUsersAtomHostTestCases
• CtsUsersAtomHostTestCases[instant]
• CtsVibratorAtomHostTestCases
• CtsVibratorAtomHostTestCases[instant]
• CtsVirtualDevicesComputerControlTests
• CtsVoiceInteractionAtomHostTestCases
• CtsVoiceInteractionAtomHostTestCases[instant]
• CtsWifiAtomHostTestCases
• CtsWifiAtomHostTestCases[instant]
• CtsWindowManagerHostTestCases
• MctsVideoTestCases
• MtsWebAppTestCases
• PccServiceNonPccClientTest
• PccServicePccClientTest
• VmMultiTenancyTests.CTS

16 removed modules

• AdsPersonalizationStatusTest
• CtsAppFgsTestCases[instant]
• CtsCameraHeadlessSystemUserTestCases
• CtsCarBuiltinApiHostTestCases
• CtsFgsTimeoutTestCases[instant]
• CtsHealthConnectHostSideDeviceTestCases
• CtsHealthConnectHostTestCases
• CtsInstalledLoadingProgressHostTests
• CtsSandboxedAdIdManagerTests
• CtsSandboxedAppSetIdManagerTests
• CtsSandboxedFledgeManagerTests
• CtsSandboxedMeasurementManagerTests
• CtsSandboxedTopicsManagerTests
• CtsShortFgsTestCases[instant]
• CtsVideoEncodingQualityHostTestCases[instant]
• MctsTextClassifierTestCases

CTS Verifier 17 new tests

36 new CTS-V-HOST test cases have been added including interactive tests, host-based Verifier test cases.

36 tests added from 7 modules

Module name	Newly added test cases list
CtsNotificationSizeVerifierHostTest	android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapUnderLimit_ChangeDisabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapOverLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapUnderLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriOverLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriUnderLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapOverLimit_ChangeDisabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriOverLimit_ChangeDisabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriUnderLimit_ChangeDisabled
CtsPermissionInteractiveTestCases	android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonColorCustomization android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonSupportsRtlLayout android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonPaddingCustomization android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonIconOnly android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonShapeMorphsOnPress android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonShapeCustomization
CtsSysuiInteractiveTestCases	android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu_alreadyShowing android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu_multipleCallsInShortTime
CtsUsbTypecTestCases	com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Cdp com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Dcp com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Sdp com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testPowerProfileSourceFixed
CtsTelecomTest	CtsTelecomTest#test_call_audio_for_voice_and_voip_calls CtsTelecomTest#test_incall_ui_shows_when_screen_locked
CtsWifiConnectionTests	NetworkRequestTests#test_with_a_specific_ssid_and_bssid NetworkRequestTests#test_with_invalid_credential_in_network_specifier NetworkRequestTests#test_with_pattern_network_specifier NetworkRequestTests#test_with_unavailable_network_specifier NetworkSuggestionTests#test_that_suggestion_modification_in_place NetworkSuggestionTests#test_with_connection_failure NetworkSuggestionTests#test_with_ssid_and_bssid_specified NetworkSuggestionTests#test_with_ssid_and_post_connect_broadcast NetworkSuggestionTests#test_with_ssid_specified
CtsWifiUsdTests	WifiUsdTest#test_active_subscriber_exchange WifiUsdTest#test_bidirectional_large_message_exchange WifiUsdTest#test_bidirectional_message_exchange WifiUsdTest#test_passive_subscriber_exchange

Added 10 new tests for five other Verifier sections

Section	Newly added test cases list
AUDIO	Audio Communication Latency test Audio Datapaths USB Multichannel test Audio MMAP PCM Offload test Audio Playback Parameters test Audio Workload test
CAMERA	Camera ITS Feature Combination test
FEATURES	EyeDropper test
MEDIA	Secure Playback test
SYSUI	Pinned Windowing Layer test Self Movable Tasks test