CTS 17 版本说明

本页包含 CTS 17 R1 中引入的 CTS 重要变更。

基础架构改进

测试结果聚合和报告

CTS-V 报告结构(包括 CameraITS)已重构,以支持精细的子测试结果。此增强功能支持并行执行子测试以缩短总运行时,并支持重新运行失败的子测试,而不是重新运行整个模块。

令牌分片

修复了 enable-token-sharding 功能的问题,该功能有时无法识别带有 SIM 卡的样本,导致测试运行不正确。

效率提升

生物识别测试优化

CTS-V 中的生物识别测试套件结合了多个基于时间的关键测试,将身份验证提示的数量从 120 个减少到 72 个。

连接和测距现代化

手动 Presence test(需要标准化 1 米设备设置才能进行准确验证)已替换为完全自动化的测距模块(Ranging test)。

Wi-Fi 测试现代化

Wi-Fi 测试套件的更新包括引入新的 Unsynchronized Service Discovery (USD) 测试、将现有 Permission tests 迁移到现代化框架,以及移除旧版手动 Connection tests

多媒体和电信增强功能

引入了安全播放测试,用于验证安全播放功能, 确保正确的视频显示和帧速率一致性 安全播放测试设置。这是一项 CTS 验证程序测试,需要外围设备播放分析工具。

电信测试自动化

手动电信测试已替换为 CTS-V-HOST 中的 CtsTelecomTests 自动化模块。

CTS 模块

测试模块和测试用例的数量如下:

  • 约 1,244 个模块,具体取决于设备类型。
  • 约 310 万个测试用例(适用于单个 ABI)。

185 个新模块

  • CtsAActivityManagerTest
  • CtsAlarmAtomHostTestCases
  • CtsAlarmAtomHostTestCases[instant]
  • CtsAllowlistTestCases
  • CtsAllowlistTestCases[instant]
  • CtsAngleEnd2EndTestCases
  • CtsAnomalyDetectorTests
  • CtsAppcompatStateAtomHostTestCases
  • CtsAppcompatStateAtomHostTestCases[instant]
  • CtsAppExitAtomHostTestCases
  • CtsAppExitAtomHostTestCases[instant]
  • CtsAppFunctionNoQueryAllPackagesTestCases
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-clone-profile]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-private-profile]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-secondary-user]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-work-profile]
  • CtsAppFunctionsAtomHostTestCases
  • CtsAppFunctionsAtomHostTestCases[instant]
  • CtsAppHibernationAtomHostTestCases
  • CtsAppHibernationAtomHostTestCases[instant]
  • CtsAppInteractionTestCases
  • CtsAppInteractionTestCases[run-on-clone-profile]
  • CtsAppInteractionTestCases[run-on-private-profile]
  • CtsAppInteractionTestCases[run-on-secondary-user]
  • CtsAppInteractionTestCases[run-on-work-profile]
  • CtsAppOpsAtomHostTestCases
  • CtsAppOpsAtomHostTestCases[instant]
  • CtsAppStartAtomHostTestCases
  • CtsAppStartAtomHostTestCases[instant]
  • CtsBackportedFixesAtomHostTestCases
  • CtsBackportedFixesAtomHostTestCases[instant]
  • CtsBatteryCycleAtomHostTestCases
  • CtsBatteryCycleAtomHostTestCases[instant]
  • CtsBatteryStatsAtomHostTestCases
  • CtsBatteryStatsAtomHostTestCases[instant]
  • CtsBinderStatsAtomHostTestCases
  • CtsBinderStatsAtomHostTestCases[instant]
  • CtsBluetoothAtomHostTestCases
  • CtsBluetoothAtomHostTestCases[instant]
  • CtsConscryptTestCases
  • CtsContactsPickerCoreTestCases
  • CtsContactsPickerCoreTestCases[run-on-clone-profile]
  • CtsContactsPickerCoreTestCases[run-on-private-profile]
  • CtsContactsPickerCoreTestCases[run-on-work-profile]
  • CtsContactsPickerCoreTestCasesSdk36
  • CtsContactsProviderHostTestCases
  • CtsContactsProviderSessionTestCases
  • CtsContactsProviderTestsStrictSqlCheckSdk37
  • CtsContentPccTestCases
  • CtsContentRestrictionTestCases
  • CtsContentSafetyServiceTestCases
  • CtsContextualModeManagerTestCases
  • CtsContextualModeManagerTestCases[run-on-clone-profile]
  • CtsContextualModeManagerTestCases[run-on-private-profile]
  • CtsContextualModeManagerTestCases[run-on-secondary-user]
  • CtsContextualModeManagerTestCases[run-on-work-profile]
  • CtsCoreGraphicsAtomHostTestCases
  • CtsCoreGraphicsAtomHostTestCases[instant]
  • CtsCpuAtomHostTestCases
  • CtsCpuAtomHostTestCases[instant]
  • CtsCredentialsAtomHostTestCases
  • CtsCredentialsAtomHostTestCases[instant]
  • CtsDevicePowerAtomHostTestCases
  • CtsDevicePowerAtomHostTestCases[instant]
  • CtsDeviceStateAtomHostTestCases
  • CtsDeviceStateAtomHostTestCases[instant]
  • CtsDisplayAtomHostTestCases
  • CtsDisplayAtomHostTestCases[instant]
  • CtsDisplayStaticDeviceStateTestCases
  • CtsDisplayStaticDeviceStateTestCases[instant]
  • CtsGameManagerAtomHostTestCases
  • CtsGameManagerAtomHostTestCases[instant]
  • CtsGnssAtomHostTestCases
  • CtsGnssAtomHostTestCases[instant]
  • CtsGpuTestCases
  • CtsGpuTestCases[instant]
  • CtsHardwareHealthAtomHostTestCases
  • CtsHardwareHealthAtomHostTestCases[instant]
  • CtsJobSchedulerAtomHostTestCases
  • CtsJobSchedulerAtomHostTestCases[instant]
  • CtsLogcatHostTestCases
  • CtsMediaAtomHostTestCases
  • CtsMediaAtomHostTestCases[instant]
  • CtsMediaRouterHostTestCases
  • CtsMediaRouterHostTestCases[instant]
  • CtsMemoryAtomHostTestCases
  • CtsMemoryAtomHostTestCases[instant]
  • CtsMemorySafetyAtomHostTestCases
  • CtsMemorySafetyAtomHostTestCases[instant]
  • CtsMotionCuesTestCases
  • CtsMotionCuesTestCases[instant]
  • CtsMultisensoryTestCases
  • CtsMultisensoryTestCases[instant]
  • CtsMultisensoryTestCases[run-on-clone-profile]
  • CtsMultisensoryTestCases[run-on-private-profile]
  • CtsMultisensoryTestCases[run-on-secondary-user]
  • CtsMultisensoryTestCases[run-on-work-profile]
  • CtsNativeNdkAllowlistTest
  • CtsNativeServiceTest
  • CtsNetAtomHostTestCases
  • CtsNetAtomHostTestCases[instant]
  • CtsNetSecConfigCustomTrustManagerTestCases
  • CtsNetSecConfigCustomTrustManagerTestCases[instant]
  • CtsNetSecConfigEncryptedClientHelloTestCases
  • CtsNetSecConfigEncryptedClientHelloTestCases[instant]
  • CtsNetSecEncryptedClientHelloTestCases
  • CtsNetSecEncryptedClientHelloTestCases[instant]
  • CtsNetTestCasesLocalNetNoPermissions
  • CtsNetTestCasesLocalNetNoPermissions[instant]
  • CtsNotificationAtomHostTestCases
  • CtsNotificationAtomHostTestCases[instant]
  • CtsNpuManagerMoblyTestCases
  • CtsNpuManagerTestCases
  • CtsPackageManagerIsolatedSplitHostTestCases
  • CtsPackageManagerSplitHostTestCases
  • CtsPccFeatureTests
  • CtsPccFeatureTests[run-on-clone-profile]
  • CtsPccFeatureTests[run-on-private-profile]
  • CtsPccFeatureTests[run-on-secondary-user]
  • CtsPccFeatureTests[run-on-work-profile]
  • CtsPccProcessTests
  • CtsPccSandboxManagerNativeTest
  • CtsPccSecurityTestCases
  • CtsPerfAtomHostTestCases
  • CtsPerfAtomHostTestCases[instant]
  • CtsPerfettoAtomHostTestCases
  • CtsPerfettoAtomHostTestCases[instant]
  • CtsPerformanceHintManagerAtomHostTestCases
  • CtsPerformanceHintManagerAtomHostTestCases[instant]
  • CtsPermissionStateAtomHostTestCases
  • CtsPermissionStateAtomHostTestCases[instant]
  • CtsPersonalContextTestCases
  • CtsPersonalContextTestCases[run-on-clone-profile]
  • CtsPersonalContextTestCases[run-on-private-profile]
  • CtsPersonalContextTestCases[run-on-secondary-user]
  • CtsPersonalContextTestCases[run-on-work-profile]
  • CtsPowerAtomHostTestCases
  • CtsPowerAtomHostTestCases[instant]
  • CtsPowerManagerAtomHostTestCases
  • CtsPowerManagerAtomHostTestCases[instant]
  • CtsPowerManagerPccTestCases
  • CtsPowerManagerPccTestCases[instant]
  • CtsPowerManagerPccTestCases[run-on-work-profile]
  • CtsSerialTestCases
  • CtsSettingsStatsAtomHostTestCases
  • CtsSettingsStatsAtomHostTestCases[instant]
  • CtsSharesheetAppLockTestCases
  • CtsSizeCompatRestartButtonAtomHostTestCases
  • CtsSizeCompatRestartButtonAtomHostTestCases[instant]
  • CtsSoundTriggerPccTestCases
  • CtsStatsdAtomHostRebootTestCases
  • CtsStatsdAtomHostRebootTestCases[instant]
  • CtsStopAndKillHostTest
  • CtsTelecomModuleTests
  • CtsTelephonyAtomHostTestCases
  • CtsTelephonyAtomHostTestCases[instant]
  • CtsTelephonySatelliteTestCases
  • CtsTextClassifierPccTestCases
  • CtsTlsAtomHostTestCases
  • CtsTlsAtomHostTestCases[instant]
  • CtsTrustTokenServiceTestCases
  • CtsTrustTokenServiceTestCases[instant]
  • CtsUprobeStatsTest
  • CtsUsageEventsPccTestCases
  • CtsUsbAtomHostTestCases
  • CtsUsbAtomHostTestCases[instant]
  • CtsUsbManagerTestCases[run-on-clone-profile]
  • CtsUsbManagerTestCases[run-on-private-profile]
  • CtsUsbManagerTestCases[run-on-secondary-user]
  • CtsUsbManagerTestCases[run-on-work-profile]
  • CtsUsersAtomHostTestCases
  • CtsUsersAtomHostTestCases[instant]
  • CtsVibratorAtomHostTestCases
  • CtsVibratorAtomHostTestCases[instant]
  • CtsVirtualDevicesComputerControlTests
  • CtsVoiceInteractionAtomHostTestCases
  • CtsVoiceInteractionAtomHostTestCases[instant]
  • CtsWifiAtomHostTestCases
  • CtsWifiAtomHostTestCases[instant]
  • CtsWindowManagerHostTestCases
  • MctsVideoTestCases
  • MtsWebAppTestCases
  • PccServiceNonPccClientTest
  • PccServicePccClientTest
  • VmMultiTenancyTests.CTS

16 个已移除的模块

  • AdsPersonalizationStatusTest
  • CtsAppFgsTestCases[instant]
  • CtsCameraHeadlessSystemUserTestCases
  • CtsCarBuiltinApiHostTestCases
  • CtsFgsTimeoutTestCases[instant]
  • CtsHealthConnectHostSideDeviceTestCases
  • CtsHealthConnectHostTestCases
  • CtsInstalledLoadingProgressHostTests
  • CtsSandboxedAdIdManagerTests
  • CtsSandboxedAppSetIdManagerTests
  • CtsSandboxedFledgeManagerTests
  • CtsSandboxedMeasurementManagerTests
  • CtsSandboxedTopicsManagerTests
  • CtsShortFgsTestCases[instant]
  • CtsVideoEncodingQualityHostTestCases[instant]
  • MctsTextClassifierTestCases

CTS 验证程序 17 新测试

已添加 36 个新的 CTS-V-HOST 测试用例,包括互动测试, 基于主机的验证程序测试用例

从 7 个模块添加了 36 个测试

模块名称 新添加的测试用例列表 要求 ID 或 API
CtsNotificationSizeVerifierHostTest
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapUnderLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapOverLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapUnderLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriOverLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriUnderLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapOverLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriOverLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriUnderLimit_ChangeDisabled
API 行为测试
CtsPermissionInteractiveTestCases
  • android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonColorCustomization
  • android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonSupportsRtlLayout
  • android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonPaddingCustomization
  • android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonIconOnly
  • android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonShapeMorphsOnPress
  • android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonShapeCustomization
CDD 3.8.18[C-0-1]
CtsSysuiInteractiveTestCases
  • android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu
  • android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu_alreadyShowing
  • android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu_multipleCallsInShortTime
android.app.StatusBarManager#showPowerMenu
CtsUsbTypecTestCases
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Cdp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Dcp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Sdp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testPowerProfileSourceFixed
CDD 7.7.1-[C-SR-3]
CtsTelecomTest
  • CtsTelecomTest#test_call_audio_for_voice_and_voip_calls
  • CtsTelecomTest#test_incall_ui_shows_when_screen_locked
现有电信测试的迁移
CtsWifiConnectionTests
  • NetworkRequestTests#test_with_a_specific_ssid_and_bssid
  • NetworkRequestTests#test_with_invalid_credential_in_network_specifier
  • NetworkRequestTests#test_with_pattern_network_specifier
  • NetworkRequestTests#test_with_unavailable_network_specifier
  • NetworkSuggestionTests#test_that_suggestion_modification_in_place
  • NetworkSuggestionTests#test_with_connection_failure
  • NetworkSuggestionTests#test_with_ssid_and_bssid_specified
  • NetworkSuggestionTests#test_with_ssid_and_post_connect_broadcast
  • NetworkSuggestionTests#test_with_ssid_specified
  • java.lang.String
  • android.net.MacAddress
  • android.net.NetworkSpecifier
  • android.net.NetworkRequest,android.net.ConnectivityManager.NetworkCallback,int
  • android.os.PatternMatcher
  • java.util.concurrent.Executor,android.net.wifi.WifiManager.SuggestionUserApprovalStatusListener
  • android.net.wifi.WifiManager.SuggestionConnectionStatusListener
  • java.util.concurrent.Executor,android.net.wifi.WifiManager.SuggestionConnectionStatusListener
  • CtsWifiUsdTests
    • WifiUsdTest#test_active_subscriber_exchange
    • WifiUsdTest#test_bidirectional_large_message_exchange
    • WifiUsdTest#test_bidirectional_message_exchange
    • WifiUsdTest#test_passive_subscriber_exchange
  • android.net.wifi.usd.PublishSessionCallback
  • android.net.wifi.usd.SubscribeSessionCallback
  • android.net.wifi.usd.DiscoveryResult
  • 为其他五个验证程序部分添加了 10 个新测试

    部分 新添加的测试用例列表
    AUDIO
    • 音频通信延迟测试
    • 音频数据路径 USB 多声道测试
    • 音频 MMAP PCM 卸载测试
    • 音频播放参数测试
    • 音频工作负载测试
    CAMERA
    • 相机 ITS 功能组合测试
    FEATURES
    • 拾色器测试
    MEDIA
    • 安全播放测试
    SYSUI
    • 固定窗口层测试
    • 可自行移动的任务测试