Android 16 Camera Image Test Suite release notes

The Android 16 release includes a number of changes to Camera ITS. This page summarizes the Camera ITS changes for Android 16.

Python and package versions

We strongly encourage partners to use package management software to bundle the correct versions of packages to create a virtual environment for Android release development. For an example package management tool that handles most of the packages required, see the Python 3 documentation for venv.

Android 16 supports the following Python and package versions:

The following package is new for Android 16:

The following package has been deprecated for Android 16:

New or updated scenes

Android 16 introduces the following scenes:

Scene Description
scene1_3 Gray chart similar to scene1_1 with no white boundary.
scene6 Updates grid of circles with grid of ArUco markers to uniquely identify the located object in the scene.
scene_ip New scene for image parity comparisons between the default camera app and Jetpack Camera App captures.
scene_tele Reuses scene6 and scene7 but allows the wide to tele camera crossover to be tested separately as chart distance must be optimized for tele camera.

New tests

Android 16 introduces the following tests:

Scene Test name Description
scene1_3 test_exposure_time_priority Verifies the Android 16 exposure time priority mode feature.
scene1_3 test_sensitivity_priority Verifies the Android 16 ISO priority mode feature.
scene2_a test_exposure_keys_consistent Verifies exposure metadata values for auto and manual captures.
scene2_b test_preview_num_faces Verifies face detection for preview stream captures of scene2_b.
scene2_d test_preview_num_faces Verifies face detection for preview stream captures of scene2_d.
scene2_f test_preview_num_faces Verifies face detection for preview stream captures of scene2_f.
scene2_g test_preview_num_faces Verifies face detection for preview stream captures of scene2_g with faces in profile.
scene_flash test_night_mode_indicator Verifies the Android 16 Night Mode Indicator feature.
scene_ip test_default_jca_ip Verifies image parity between default camera app and Jetpack Camera App.
scene_tele test_zoom_tele Adds zoom check for wide to tele camera transition.
scene_tele test_preview_zoom_tele Adds preview zoom check for wide to tele camera transition.
scene_tele test_multi_camera_switch_tele Adds multi-camera switch check for wide to tele camera transition.
sensor_fusion test_video_stabilization_jca Similar to test_video_stabilization but uses Jetpack Camera App for video capture.

Refactored tests

In Android 16, the following tests are refactored to increase test coverage and group tests more logically:

Scene Test name Description
scene1_3 test_ev_compensation Merges test_ev_compensation_advanced & test_ev_compensation_basic.
scene3 test_imu_drift Runs test longer to uncover gyroscope drift issues at higher temperatures.
scene6 test_zoom Stops zooming at transition to telephoto lens. Adds offset check. Uses Jetpack Camera App for captures.
sensor_fusion test_preview_stabilization Refactored to test at both 0.9x and 1.1x zoom ratios for ultra-wide camera coverage.

Additionally, a number of tests in scene1_1 and scene1_2 are moved to scene1_3 to load balance the three sub-scenes. However, only tests not requiring autofocus are moved due to scene1_3 not having a white border.

Deprecated tests

In Android 16, the following tests are deprecated due to test function being covered by other tests:

Scene Test name Description
scene2_b test_num_faces Removed due to face detection in scene tested by test_preview_num_faces.
scene2_f test_num_faces Removed due to face detection in scene tested by test_preview_num_faces.