Catatan rilis CTS 17

Halaman ini mencakup perubahan CTS utama yang diperkenalkan di CTS 17 R1.

Peningkatan infrastruktur

Agregasi dan pelaporan hasil pengujian

Struktur pelaporan CTS-V, termasuk CameraITS, telah direfaktorisasi untuk mendukung hasil subpengujian yang terperinci. Peningkatan ini memungkinkan eksekusi subpengujian secara paralel untuk mengurangi total waktu proses, dan menjalankan ulang subpengujian yang gagal secara terfokus, bukan modul lengkap.

Sharding token

  • Memperbaiki masalah pada fitur enable-token-sharding, yang terkadang gagal mengenali sampel dengan kartu SIM, sehingga menyebabkan pengujian berjalan dengan tidak benar.

Peningkatan efisiensi

CTS 17 mencakup peningkatan efisiensi berikut.

Pengoptimalan pengujian biometrik

Suite pengujian biometrik di CTS-V telah direstrukturisasi untuk menggabungkan beberapa pengujian kunci berbasis waktu dan perintah autentikasi telah berkurang dari 120 menjadi 72.

Modernisasi konektivitas dan rentang

Pengujian Kehadiran manual, yang memerlukan penyiapan perangkat 1 m standar untuk validasi akurat, telah diganti dengan modul Rentang yang sepenuhnya otomatis.

Modernisasi pengujian Wi-Fi

Update pada suite pengujian Wi-Fi mencakup pengenalan pengujian Penemuan Layanan Tidak Tersinkronisasi (USD), migrasi pengujian Izin yang ada ke dalam framework yang dimodernisasi, dan penghapusan pengujian Koneksi manual lama.

Peningkatan multimedia dan telekomunikasi

Pengujian Pemutaran Aman diperkenalkan untuk memvalidasi kapabilitas pemutaran aman, memastikan tampilan video yang benar dan konsistensi kecepatan frame Penyiapan Pengujian Pemutaran Aman. Ini adalah pengujian CTS Verifier dan memerlukan alat analisis Pemutaran Periferal.

Otomatisasi pengujian telekomunikasi

Pengujian Telekomunikasi manual diganti dengan modul otomatis CtsTelecomTests di CTS-V-HOST.

Modul CTS

Jumlah modul pengujian dan kasus pengujian adalah sebagai berikut:

  • Sekitar 1.244 modul,bergantung pada jenis perangkat
  • Sekitar 3,1 juta kasus pengujian untuk ABI tunggal

185 modul baru

  • CtsAActivityManagerTest
  • CtsAlarmAtomHostTestCases
  • CtsAlarmAtomHostTestCases[instant]
  • CtsAllowlistTestCases
  • CtsAllowlistTestCases[instant]
  • CtsAngleEnd2EndTestCases
  • CtsAnomalyDetectorTests
  • CtsAppcompatStateAtomHostTestCases
  • CtsAppcompatStateAtomHostTestCases[instant]
  • CtsAppExitAtomHostTestCases
  • CtsAppExitAtomHostTestCases[instant]
  • CtsAppFunctionNoQueryAllPackagesTestCases
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-clone-profile]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-private-profile]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-secondary-user]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-work-profile]
  • CtsAppFunctionsAtomHostTestCases
  • CtsAppFunctionsAtomHostTestCases[instant]
  • CtsAppHibernationAtomHostTestCases
  • CtsAppHibernationAtomHostTestCases[instant]
  • CtsAppInteractionTestCases
  • CtsAppInteractionTestCases[run-on-clone-profile]
  • CtsAppInteractionTestCases[run-on-private-profile]
  • CtsAppInteractionTestCases[run-on-secondary-user]
  • CtsAppInteractionTestCases[run-on-work-profile]
  • CtsAppOpsAtomHostTestCases
  • CtsAppOpsAtomHostTestCases[instant]
  • CtsAppStartAtomHostTestCases
  • CtsAppStartAtomHostTestCases[instant]
  • CtsBackportedFixesAtomHostTestCases
  • CtsBackportedFixesAtomHostTestCases[instant]
  • CtsBatteryCycleAtomHostTestCases
  • CtsBatteryCycleAtomHostTestCases[instant]
  • CtsBatteryStatsAtomHostTestCases
  • CtsBatteryStatsAtomHostTestCases[instant]
  • CtsBinderStatsAtomHostTestCases
  • CtsBinderStatsAtomHostTestCases[instant]
  • CtsBluetoothAtomHostTestCases
  • CtsBluetoothAtomHostTestCases[instant]
  • CtsConscryptTestCases
  • CtsContactsPickerCoreTestCases
  • CtsContactsPickerCoreTestCases[run-on-clone-profile]
  • CtsContactsPickerCoreTestCases[run-on-private-profile]
  • CtsContactsPickerCoreTestCases[run-on-work-profile]
  • CtsContactsPickerCoreTestCasesSdk36
  • CtsContactsProviderHostTestCases
  • CtsContactsProviderSessionTestCases
  • CtsContactsProviderTestsStrictSqlCheckSdk37
  • CtsContentPccTestCases
  • CtsContentRestrictionTestCases
  • CtsContentSafetyServiceTestCases
  • CtsContextualModeManagerTestCases
  • CtsContextualModeManagerTestCases[run-on-clone-profile]
  • CtsContextualModeManagerTestCases[run-on-private-profile]
  • CtsContextualModeManagerTestCases[run-on-secondary-user]
  • CtsContextualModeManagerTestCases[run-on-work-profile]
  • CtsCoreGraphicsAtomHostTestCases
  • CtsCoreGraphicsAtomHostTestCases[instant]
  • CtsCpuAtomHostTestCases
  • CtsCpuAtomHostTestCases[instant]
  • CtsCredentialsAtomHostTestCases
  • CtsCredentialsAtomHostTestCases[instant]
  • CtsDevicePowerAtomHostTestCases
  • CtsDevicePowerAtomHostTestCases[instant]
  • CtsDeviceStateAtomHostTestCases
  • CtsDeviceStateAtomHostTestCases[instant]
  • CtsDisplayAtomHostTestCases
  • CtsDisplayAtomHostTestCases[instant]
  • CtsDisplayStaticDeviceStateTestCases
  • CtsDisplayStaticDeviceStateTestCases[instant]
  • CtsGameManagerAtomHostTestCases
  • CtsGameManagerAtomHostTestCases[instant]
  • CtsGnssAtomHostTestCases
  • CtsGnssAtomHostTestCases[instant]
  • CtsGpuTestCases
  • CtsGpuTestCases[instant]
  • CtsHardwareHealthAtomHostTestCases
  • CtsHardwareHealthAtomHostTestCases[instant]
  • CtsJobSchedulerAtomHostTestCases
  • CtsJobSchedulerAtomHostTestCases[instant]
  • CtsLogcatHostTestCases
  • CtsMediaAtomHostTestCases
  • CtsMediaAtomHostTestCases[instant]
  • CtsMediaRouterHostTestCases
  • CtsMediaRouterHostTestCases[instant]
  • CtsMemoryAtomHostTestCases
  • CtsMemoryAtomHostTestCases[instant]
  • CtsMemorySafetyAtomHostTestCases
  • CtsMemorySafetyAtomHostTestCases[instant]
  • CtsMotionCuesTestCases
  • CtsMotionCuesTestCases[instant]
  • CtsMultisensoryTestCases
  • CtsMultisensoryTestCases[instant]
  • CtsMultisensoryTestCases[run-on-clone-profile]
  • CtsMultisensoryTestCases[run-on-private-profile]
  • CtsMultisensoryTestCases[run-on-secondary-user]
  • CtsMultisensoryTestCases[run-on-work-profile]
  • CtsNativeNdkAllowlistTest
  • CtsNativeServiceTest
  • CtsNetAtomHostTestCases
  • CtsNetAtomHostTestCases[instant]
  • CtsNetSecConfigCustomTrustManagerTestCases
  • CtsNetSecConfigCustomTrustManagerTestCases[instant]
  • CtsNetSecConfigEncryptedClientHelloTestCases
  • CtsNetSecConfigEncryptedClientHelloTestCases[instant]
  • CtsNetSecEncryptedClientHelloTestCases
  • CtsNetSecEncryptedClientHelloTestCases[instant]
  • CtsNetTestCasesLocalNetNoPermissions
  • CtsNetTestCasesLocalNetNoPermissions[instant]
  • CtsNotificationAtomHostTestCases
  • CtsNotificationAtomHostTestCases[instant]
  • CtsNpuManagerMoblyTestCases
  • CtsNpuManagerTestCases
  • CtsPackageManagerIsolatedSplitHostTestCases
  • CtsPackageManagerSplitHostTestCases
  • CtsPccFeatureTests
  • CtsPccFeatureTests[run-on-clone-profile]
  • CtsPccFeatureTests[run-on-private-profile]
  • CtsPccFeatureTests[run-on-secondary-user]
  • CtsPccFeatureTests[run-on-work-profile]
  • CtsPccProcessTests
  • CtsPccSandboxManagerNativeTest
  • CtsPccSecurityTestCases
  • CtsPerfAtomHostTestCases
  • CtsPerfAtomHostTestCases[instant]
  • CtsPerfettoAtomHostTestCases
  • CtsPerfettoAtomHostTestCases[instant]
  • CtsPerformanceHintManagerAtomHostTestCases
  • CtsPerformanceHintManagerAtomHostTestCases[instant]
  • CtsPermissionStateAtomHostTestCases
  • CtsPermissionStateAtomHostTestCases[instant]
  • CtsPersonalContextTestCases
  • CtsPersonalContextTestCases[run-on-clone-profile]
  • CtsPersonalContextTestCases[run-on-private-profile]
  • CtsPersonalContextTestCases[run-on-secondary-user]
  • CtsPersonalContextTestCases[run-on-work-profile]
  • CtsPowerAtomHostTestCases
  • CtsPowerAtomHostTestCases[instant]
  • CtsPowerManagerAtomHostTestCases
  • CtsPowerManagerAtomHostTestCases[instant]
  • CtsPowerManagerPccTestCases
  • CtsPowerManagerPccTestCases[instant]
  • CtsPowerManagerPccTestCases[run-on-work-profile]
  • CtsSerialTestCases
  • CtsSettingsStatsAtomHostTestCases
  • CtsSettingsStatsAtomHostTestCases[instant]
  • CtsSharesheetAppLockTestCases
  • CtsSizeCompatRestartButtonAtomHostTestCases
  • CtsSizeCompatRestartButtonAtomHostTestCases[instant]
  • CtsSoundTriggerPccTestCases
  • CtsStatsdAtomHostRebootTestCases
  • CtsStatsdAtomHostRebootTestCases[instant]
  • CtsStopAndKillHostTest
  • CtsTelecomModuleTests
  • CtsTelephonyAtomHostTestCases
  • CtsTelephonyAtomHostTestCases[instant]
  • CtsTelephonySatelliteTestCases
  • CtsTextClassifierPccTestCases
  • CtsTlsAtomHostTestCases
  • CtsTlsAtomHostTestCases[instant]
  • CtsTrustTokenServiceTestCases
  • CtsTrustTokenServiceTestCases[instant]
  • CtsUprobeStatsTest
  • CtsUsageEventsPccTestCases
  • CtsUsbAtomHostTestCases
  • CtsUsbAtomHostTestCases[instant]
  • CtsUsbManagerTestCases[run-on-clone-profile]
  • CtsUsbManagerTestCases[run-on-private-profile]
  • CtsUsbManagerTestCases[run-on-secondary-user]
  • CtsUsbManagerTestCases[run-on-work-profile]
  • CtsUsersAtomHostTestCases
  • CtsUsersAtomHostTestCases[instant]
  • CtsVibratorAtomHostTestCases
  • CtsVibratorAtomHostTestCases[instant]
  • CtsVirtualDevicesComputerControlTests
  • CtsVoiceInteractionAtomHostTestCases
  • CtsVoiceInteractionAtomHostTestCases[instant]
  • CtsWifiAtomHostTestCases
  • CtsWifiAtomHostTestCases[instant]
  • CtsWindowManagerHostTestCases
  • MctsVideoTestCases
  • MtsWebAppTestCases
  • PccServiceNonPccClientTest
  • PccServicePccClientTest
  • VmMultiTenancyTests.CTS

16 modul yang dihapus

  • AdsPersonalizationStatusTest
  • CtsAppFgsTestCases[instant]
  • CtsCameraHeadlessSystemUserTestCases
  • CtsCarBuiltinApiHostTestCases
  • CtsFgsTimeoutTestCases[instant]
  • CtsHealthConnectHostSideDeviceTestCases
  • CtsHealthConnectHostTestCases
  • CtsInstalledLoadingProgressHostTests
  • CtsSandboxedAdIdManagerTests
  • CtsSandboxedAppSetIdManagerTests
  • CtsSandboxedFledgeManagerTests
  • CtsSandboxedMeasurementManagerTests
  • CtsSandboxedTopicsManagerTests
  • CtsShortFgsTestCases[instant]
  • CtsVideoEncodingQualityHostTestCases[instant]
  • MctsTextClassifierTestCases

Pengujian baru CTS Verifier 17

36 kasus pengujian CTS-V-HOST baru telah ditambahkan, termasuk pengujian interaktif, kasus pengujian verifier berbasis Host

36 pengujian ditambahkan dari 7 modul

Nama modul Daftar kasus pengujian yang ditambahkan
CtsNotificationSizeVerifierHostTest
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapUnderLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapOverLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapUnderLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriOverLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriUnderLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapOverLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriOverLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriUnderLimit_ChangeDisabled
    		•
    CtsPermissionInteractiveTestCases
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonColorCustomization
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonSupportsRtlLayout
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonPaddingCustomization
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonIconOnly
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonShapeMorphsOnPress
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonShapeCustomization
    		•
    CtsSysuiInteractiveTestCases
  • android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu
  • android.sysui.cts.ShowPowerMenuInteractiveTest# showPowerMenu_alreadyShowing
  • android.sysui.cts.ShowPowerMenuInteractiveTest# showPowerMenu_multipleCallsInShortTime
    		•
    CtsUsbTypecTestCases
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Cdp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Dcp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Sdp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases# testPowerProfileSourceFixed
    		•
    CtsTelecomTest
  • CtsTelecomTest#test_call_audio_for_voice_and_voip_calls
  • CtsTelecomTest#test_incall_ui_shows_when_screen_locked
    		•
    CtsWifiConnectionTests
  • NetworkRequestTests#test_with_a_specific_ssid_and_bssid
  • NetworkRequestTests#test_with_invalid_credential_in_network_specifier
  • NetworkRequestTests#test_with_pattern_network_specifier
  • NetworkRequestTests#test_with_unavailable_network_specifier
  • NetworkSuggestionTests#test_that_suggestion_modification_in_place
  • NetworkSuggestionTests#test_with_connection_failure
  • NetworkSuggestionTests#test_with_ssid_and_bssid_specified
  • NetworkSuggestionTests#test_with_ssid_and_post_connect_broadcast
  • NetworkSuggestionTests#test_with_ssid_specified
    		•
    CtsWifiUsdTests
  • WifiUsdTest#test_active_subscriber_exchange
  • WifiUsdTest#test_bidirectional_large_message_exchange
  • WifiUsdTest#test_bidirectional_message_exchange
  • WifiUsdTest#test_passive_subscriber_exchange
    		•

    Total 10 pengujian baru ditambahkan untuk 5 bagian verifier lainnya

    Bagian Daftar kasus pengujian yang ditambahkan
    AUDIO
  • Pengujian Latensi Komunikasi Audio
  • Pengujian Multisaluran USB Jalur Data Audio
  • Pengujian Offload PCM MMAP Audio
  • Pengujian Parameter Pemutaran Audio
  • Pengujian Workload Audio
    		•
    CAMERA
  • Pengujian Kombinasi Fitur ITS Kamera
    		•
    FEATURES
  • Pengujian EyeDropper
    		•
    MEDIA
  • Pengujian Pemutaran Aman
    		•
    SYSUI
  • Pengujian Lapisan Jendela yang Disematkan
  • Pengujian Tugas yang Dapat Dipindahkan Sendiri
    		•