Catatan rilis CTS 17

Halaman ini mencakup perubahan CTS utama yang diperkenalkan di CTS 17 R1.

Peningkatan infrastruktur

Penggabungan dan pelaporan hasil pengujian

Struktur pelaporan CTS-V (termasuk CameraITS) telah diubah untuk mendukung hasil subpengujian yang terperinci. Peningkatan ini memungkinkan eksekusi paralel subpengujian untuk mengurangi total waktu proses, dan menjalankan ulang subpengujian yang gagal secara terfokus, bukan modul lengkap.

Penyebaran token

Memperbaiki masalah pada fitur enable-token-sharding, yang terkadang gagal mengenali sampel dengan kartu SIM, sehingga menyebabkan pengujian berjalan dengan tidak benar.

Peningkatan efisiensi

Pengoptimalan pengujian biometrik

Rangkaian pengujian biometrik di CTS-V menggabungkan beberapa pengujian kunci berbasis waktu, sehingga mengurangi jumlah perintah autentikasi dari 120 menjadi 72.

Modernisasi konektivitas dan pengukuran jarak

Presence test manual, yang memerlukan penyiapan perangkat 1 m standar untuk validasi yang akurat, telah digantikan oleh modul Pengukuran Jarak yang sepenuhnya otomatis (Ranging test).

Modernisasi pengujian Wi-Fi

Pembaruan pada suite pengujian Wi-Fi mencakup pengenalan pengujian Unsynchronized Service Discovery (USD) baru, migrasi Permission tests yang ada ke framework modern, dan penghapusan Connection tests manual lama.

Peningkatan kualitas multimedia dan telekomunikasi

Pengujian Pemutaran Aman diperkenalkan untuk memvalidasi kemampuan pemutaran aman, memastikan tampilan video yang benar dan konsistensi kecepatan frame penyiapan pengujian pemutaran aman. Ini adalah pengujian CTS Verifier dan memerlukan alat analisis Pemutaran Periferal.

Otomatisasi pengujian telekomunikasi

Pengujian Telekomunikasi manual digantikan oleh modul otomatis CtsTelecomTests di CTS-V-HOST.

Modul CTS

Jumlah modul pengujian dan kasus pengujian adalah sebagai berikut:

• Sekitar 1.244 modul,bergantung pada jenis perangkat.
• Sekitar 3,1 juta kasus pengujian untuk satu ABI.

185 modul baru

• CtsAActivityManagerTest
• CtsAlarmAtomHostTestCases
• CtsAlarmAtomHostTestCases[instant]
• CtsAllowlistTestCases
• CtsAllowlistTestCases[instant]
• CtsAngleEnd2EndTestCases
• CtsAnomalyDetectorTests
• CtsAppcompatStateAtomHostTestCases
• CtsAppcompatStateAtomHostTestCases[instant]
• CtsAppExitAtomHostTestCases
• CtsAppExitAtomHostTestCases[instant]
• CtsAppFunctionNoQueryAllPackagesTestCases
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-clone-profile]
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-private-profile]
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-secondary-user]
• CtsAppFunctionNoQueryAllPackagesTestCases[run-on-work-profile]
• CtsAppFunctionsAtomHostTestCases
• CtsAppFunctionsAtomHostTestCases[instant]
• CtsAppHibernationAtomHostTestCases
• CtsAppHibernationAtomHostTestCases[instant]
• CtsAppInteractionTestCases
• CtsAppInteractionTestCases[run-on-clone-profile]
• CtsAppInteractionTestCases[run-on-private-profile]
• CtsAppInteractionTestCases[run-on-secondary-user]
• CtsAppInteractionTestCases[run-on-work-profile]
• CtsAppOpsAtomHostTestCases
• CtsAppOpsAtomHostTestCases[instant]
• CtsAppStartAtomHostTestCases
• CtsAppStartAtomHostTestCases[instant]
• CtsBackportedFixesAtomHostTestCases
• CtsBackportedFixesAtomHostTestCases[instant]
• CtsBatteryCycleAtomHostTestCases
• CtsBatteryCycleAtomHostTestCases[instant]
• CtsBatteryStatsAtomHostTestCases
• CtsBatteryStatsAtomHostTestCases[instant]
• CtsBinderStatsAtomHostTestCases
• CtsBinderStatsAtomHostTestCases[instant]
• CtsBluetoothAtomHostTestCases
• CtsBluetoothAtomHostTestCases[instant]
• CtsConscryptTestCases
• CtsContactsPickerCoreTestCases
• CtsContactsPickerCoreTestCases[run-on-clone-profile]
• CtsContactsPickerCoreTestCases[run-on-private-profile]
• CtsContactsPickerCoreTestCases[run-on-work-profile]
• CtsContactsPickerCoreTestCasesSdk36
• CtsContactsProviderHostTestCases
• CtsContactsProviderSessionTestCases
• CtsContactsProviderTestsStrictSqlCheckSdk37
• CtsContentPccTestCases
• CtsContentRestrictionTestCases
• CtsContentSafetyServiceTestCases
• CtsContextualModeManagerTestCases
• CtsContextualModeManagerTestCases[run-on-clone-profile]
• CtsContextualModeManagerTestCases[run-on-private-profile]
• CtsContextualModeManagerTestCases[run-on-secondary-user]
• CtsContextualModeManagerTestCases[run-on-work-profile]
• CtsCoreGraphicsAtomHostTestCases
• CtsCoreGraphicsAtomHostTestCases[instant]
• CtsCpuAtomHostTestCases
• CtsCpuAtomHostTestCases[instant]
• CtsCredentialsAtomHostTestCases
• CtsCredentialsAtomHostTestCases[instant]
• CtsDevicePowerAtomHostTestCases
• CtsDevicePowerAtomHostTestCases[instant]
• CtsDeviceStateAtomHostTestCases
• CtsDeviceStateAtomHostTestCases[instant]
• CtsDisplayAtomHostTestCases
• CtsDisplayAtomHostTestCases[instant]
• CtsDisplayStaticDeviceStateTestCases
• CtsDisplayStaticDeviceStateTestCases[instant]
• CtsGameManagerAtomHostTestCases
• CtsGameManagerAtomHostTestCases[instant]
• CtsGnssAtomHostTestCases
• CtsGnssAtomHostTestCases[instant]
• CtsGpuTestCases
• CtsGpuTestCases[instant]
• CtsHardwareHealthAtomHostTestCases
• CtsHardwareHealthAtomHostTestCases[instant]
• CtsJobSchedulerAtomHostTestCases
• CtsJobSchedulerAtomHostTestCases[instant]
• CtsLogcatHostTestCases
• CtsMediaAtomHostTestCases
• CtsMediaAtomHostTestCases[instant]
• CtsMediaRouterHostTestCases
• CtsMediaRouterHostTestCases[instant]
• CtsMemoryAtomHostTestCases
• CtsMemoryAtomHostTestCases[instant]
• CtsMemorySafetyAtomHostTestCases
• CtsMemorySafetyAtomHostTestCases[instant]
• CtsMotionCuesTestCases
• CtsMotionCuesTestCases[instant]
• CtsMultisensoryTestCases
• CtsMultisensoryTestCases[instant]
• CtsMultisensoryTestCases[run-on-clone-profile]
• CtsMultisensoryTestCases[run-on-private-profile]
• CtsMultisensoryTestCases[run-on-secondary-user]
• CtsMultisensoryTestCases[run-on-work-profile]
• CtsNativeNdkAllowlistTest
• CtsNativeServiceTest
• CtsNetAtomHostTestCases
• CtsNetAtomHostTestCases[instant]
• CtsNetSecConfigCustomTrustManagerTestCases
• CtsNetSecConfigCustomTrustManagerTestCases[instant]
• CtsNetSecConfigEncryptedClientHelloTestCases
• CtsNetSecConfigEncryptedClientHelloTestCases[instant]
• CtsNetSecEncryptedClientHelloTestCases
• CtsNetSecEncryptedClientHelloTestCases[instant]
• CtsNetTestCasesLocalNetNoPermissions
• CtsNetTestCasesLocalNetNoPermissions[instant]
• CtsNotificationAtomHostTestCases
• CtsNotificationAtomHostTestCases[instant]
• CtsNpuManagerMoblyTestCases
• CtsNpuManagerTestCases
• CtsPackageManagerIsolatedSplitHostTestCases
• CtsPackageManagerSplitHostTestCases
• CtsPccFeatureTests
• CtsPccFeatureTests[run-on-clone-profile]
• CtsPccFeatureTests[run-on-private-profile]
• CtsPccFeatureTests[run-on-secondary-user]
• CtsPccFeatureTests[run-on-work-profile]
• CtsPccProcessTests
• CtsPccSandboxManagerNativeTest
• CtsPccSecurityTestCases
• CtsPerfAtomHostTestCases
• CtsPerfAtomHostTestCases[instant]
• CtsPerfettoAtomHostTestCases
• CtsPerfettoAtomHostTestCases[instant]
• CtsPerformanceHintManagerAtomHostTestCases
• CtsPerformanceHintManagerAtomHostTestCases[instant]
• CtsPermissionStateAtomHostTestCases
• CtsPermissionStateAtomHostTestCases[instant]
• CtsPersonalContextTestCases
• CtsPersonalContextTestCases[run-on-clone-profile]
• CtsPersonalContextTestCases[run-on-private-profile]
• CtsPersonalContextTestCases[run-on-secondary-user]
• CtsPersonalContextTestCases[run-on-work-profile]
• CtsPowerAtomHostTestCases
• CtsPowerAtomHostTestCases[instant]
• CtsPowerManagerAtomHostTestCases
• CtsPowerManagerAtomHostTestCases[instant]
• CtsPowerManagerPccTestCases
• CtsPowerManagerPccTestCases[instant]
• CtsPowerManagerPccTestCases[run-on-work-profile]
• CtsSerialTestCases
• CtsSettingsStatsAtomHostTestCases
• CtsSettingsStatsAtomHostTestCases[instant]
• CtsSharesheetAppLockTestCases
• CtsSizeCompatRestartButtonAtomHostTestCases
• CtsSizeCompatRestartButtonAtomHostTestCases[instant]
• CtsSoundTriggerPccTestCases
• CtsStatsdAtomHostRebootTestCases
• CtsStatsdAtomHostRebootTestCases[instant]
• CtsStopAndKillHostTest
• CtsTelecomModuleTests
• CtsTelephonyAtomHostTestCases
• CtsTelephonyAtomHostTestCases[instant]
• CtsTelephonySatelliteTestCases
• CtsTextClassifierPccTestCases
• CtsTlsAtomHostTestCases
• CtsTlsAtomHostTestCases[instant]
• CtsTrustTokenServiceTestCases
• CtsTrustTokenServiceTestCases[instant]
• CtsUprobeStatsTest
• CtsUsageEventsPccTestCases
• CtsUsbAtomHostTestCases
• CtsUsbAtomHostTestCases[instant]
• CtsUsbManagerTestCases[run-on-clone-profile]
• CtsUsbManagerTestCases[run-on-private-profile]
• CtsUsbManagerTestCases[run-on-secondary-user]
• CtsUsbManagerTestCases[run-on-work-profile]
• CtsUsersAtomHostTestCases
• CtsUsersAtomHostTestCases[instant]
• CtsVibratorAtomHostTestCases
• CtsVibratorAtomHostTestCases[instant]
• CtsVirtualDevicesComputerControlTests
• CtsVoiceInteractionAtomHostTestCases
• CtsVoiceInteractionAtomHostTestCases[instant]
• CtsWifiAtomHostTestCases
• CtsWifiAtomHostTestCases[instant]
• CtsWindowManagerHostTestCases
• MctsVideoTestCases
• MtsWebAppTestCases
• PccServiceNonPccClientTest
• PccServicePccClientTest
• VmMultiTenancyTests.CTS

16 modul yang dihapus

• AdsPersonalizationStatusTest
• CtsAppFgsTestCases[instant]
• CtsCameraHeadlessSystemUserTestCases
• CtsCarBuiltinApiHostTestCases
• CtsFgsTimeoutTestCases[instant]
• CtsHealthConnectHostSideDeviceTestCases
• CtsHealthConnectHostTestCases
• CtsInstalledLoadingProgressHostTests
• CtsSandboxedAdIdManagerTests
• CtsSandboxedAppSetIdManagerTests
• CtsSandboxedFledgeManagerTests
• CtsSandboxedMeasurementManagerTests
• CtsSandboxedTopicsManagerTests
• CtsShortFgsTestCases[instant]
• CtsVideoEncodingQualityHostTestCases[instant]
• MctsTextClassifierTestCases

17 pengujian baru CTS Verifier

36 kasus pengujian CTS-V-HOST baru telah ditambahkan, termasuk pengujian interaktif, kasus pengujian Verifier berbasis host.

36 pengujian ditambahkan dari 7 modul

Nama modul	Daftar kasus pengujian yang baru ditambahkan	ID Persyaratan atau API
CtsNotificationSizeVerifierHostTest	android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapUnderLimit_ChangeDisabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapOverLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapUnderLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriOverLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriUnderLimit_ChangeEnabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testBitmapOverLimit_ChangeDisabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriOverLimit_ChangeDisabled android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest#testUriUnderLimit_ChangeDisabled	Pengujian perilaku API
CtsPermissionInteractiveTestCases	android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonColorCustomization android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonSupportsRtlLayout android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonPaddingCustomization android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonIconOnly android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonShapeMorphsOnPress android.permissioninteractive.cts.LocationButtonInteractiveTest#verifyButtonShapeCustomization	CDD 3.8.18[C-0-1]
CtsSysuiInteractiveTestCases	android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu_alreadyShowing android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu_multipleCallsInShortTime	android.app.StatusBarManager#showPowerMenu
CtsUsbTypecTestCases	com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Cdp com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Dcp com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Sdp com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testPowerProfileSourceFixed	CDD 7.7.1-[C-SR-3]
CtsTelecomTest	CtsTelecomTest#test_call_audio_for_voice_and_voip_calls CtsTelecomTest#test_incall_ui_shows_when_screen_locked	Migrasi pengujian Telekomunikasi yang ada
CtsWifiConnectionTests	NetworkRequestTests#test_with_a_specific_ssid_and_bssid NetworkRequestTests#test_with_invalid_credential_in_network_specifier NetworkRequestTests#test_with_pattern_network_specifier NetworkRequestTests#test_with_unavailable_network_specifier NetworkSuggestionTests#test_that_suggestion_modification_in_place NetworkSuggestionTests#test_with_connection_failure NetworkSuggestionTests#test_with_ssid_and_bssid_specified NetworkSuggestionTests#test_with_ssid_and_post_connect_broadcast NetworkSuggestionTests#test_with_ssid_specified	java.lang.String android.net.MacAddress android.net.NetworkSpecifier android.net.NetworkRequest,android.net.ConnectivityManager.NetworkCallback,int android.os.PatternMatcher java.util.concurrent.Executor,android.net.wifi.WifiManager.SuggestionUserApprovalStatusListener android.net.wifi.WifiManager.SuggestionConnectionStatusListener java.util.concurrent.Executor,android.net.wifi.WifiManager.SuggestionConnectionStatusListener
CtsWifiUsdTests	WifiUsdTest#test_active_subscriber_exchange WifiUsdTest#test_bidirectional_large_message_exchange WifiUsdTest#test_bidirectional_message_exchange WifiUsdTest#test_passive_subscriber_exchange	android.net.wifi.usd.PublishSessionCallback android.net.wifi.usd.SubscribeSessionCallback android.net.wifi.usd.DiscoveryResult

Menambahkan 10 pengujian baru untuk lima bagian Verifier lainnya

Bagian	Daftar kasus pengujian yang baru ditambahkan
AUDIO	Pengujian Latensi Komunikasi Audio Pengujian Multisaluran USB Jalur Data Audio Pengujian Offload PCM MMAP Audio Pengujian Parameter Pemutaran Audio Pengujian Beban Kerja Audio
CAMERA	Pengujian Kombinasi Fitur ITS Kamera
FEATURES	Pengujian EyeDropper
MEDIA	Pengujian Pemutaran Aman
SYSUI	Pengujian Lapisan Windowing yang Disematkan Pengujian Tugas yang Dapat Dipindahkan Sendiri