Audio Framework CTS Verifier

This new suite of tests requires human intervention and some external hardware including a Loopback Plug, a USB reference microphone and external speakers. For devices without 3.5 mm (⅛”) headset port, the user will be able to skip the test and mark it as successful. See the sections below for details.

Loopback plug latency test

Round trip latency in audio is defined as the time it takes an audio signal to be recorded, processed and output back.

To measure round-trip latency using CTS Verifier, connect a loopback plug to the 3.5 mm (⅛”) headset connector. (If you don’t have a loopback plug, you can easily make one following the Audio Loopback Dongle instructions.

Start CTS Verifier Loopback Test audio latency loopback
Summary of instructions is displayed summary of instructions
Report if the device has a headset port:
YES if the device under test has a physical headset port
NO if there is no headset port
audio loopback latency
If the answer was NO in the previous step, press Pass (green check) on the bottom of the test and finish audio pass button
If the answer was YES in the previous step, continue to connect loopback plug.
Connect a loopback plug to the headset port
Press the Loopback Plug Ready button
audio pass button
Move the slider until the signal level is greater than 60%
Press TEST
audio level 1 audio level 2
Wait several seconds while the latency test is performed test running
When the test is finished, results are shown
The minimum confidence level for a test to succeed is 0.6
Lower latency numbers are preferred, but no number is enforced
test finished
Press the Pass (green, only available if successful) or Failed (red) button to record the results. Pass button
Failed button

Audio frequency line test

Using a loopback plug, this test will characterize the left/right line audio output and use the mic feedback from the plug to capture audio and compute a frequency response for each channel.

A simple criterion for minimum energy expected in each band (out of four) is applied per channel.

Start CTS Audio Frequency Line Test start frequency line
Summary of instructions is displayed instructions
Report if the device has a headset port:
YES if the device under test has a physical headset port
NO if there is no headset port
audio frequency line
If the answer was NO in the previous step, press Pass (green check) on the bottom of the test and finish audio pass button
If the answer was YES in the previous step, continue to connect loopback plug
Connect a Loopback Plug to the headset connector (see Loopback plug latency test)
Press the Loopback Plug Ready button
loopback plug ready
Press TEST loopback plug test
Wait several seconds while the frequency tests are performed testing left capture
When the test is finished, results are shown testing complete
Press the Pass (only available if successful) or Failed button to record the results Pass button
Failed button

Audio frequency speaker test

This test uses the signal captured by an external USB reference microphone to assess the frequency response of left (and right, if it exists) loudspeakers.

A reference microphone is defined as that one that delivers flat, uncolored response. They are often used for analysis and measurement equipment.

There are some inexpensive USB Reference microphones (e.g., miniDSP USB Measurement calibrated microphone, Dayton Audio UMM-6 USB Measurement Microphone), mostly used for the home theater enthusiasts to calibrate their setups.

Minimum recommended reference microphone characteristics:
Flat Frequency response on range 100 Hz - 20 kHz: +/- 2 dB
S/N ration 70 dB (A-weighted)
THD Ratio @ 1000 Hz less than 1 % at 127 dB SPL

Start CTS Audio Frequency Speaker Test start speaker test
Summary of instructions is displayed instructions
Connect a USB reference microphone (see Audio frequency speaker test)
Press USB REFERENCE MICROPHONE READY
mic ready
Set up DUT (Device Under Test) in a quiet room and USB microphone 20cms perpendicular to center of screen device under test
Press TEST click test
Wait several seconds while the frequency tests are performed test underway
When the test is finished, results are shown test complete
Press the Pass (only available if successful) or Failed button to record the results Pass button
Failed button

Audio frequency microphone test

This test is more involved than the previous ones. It requires the use of both: External speakers for a white noise sound source, and a USB reference microphone to use as a reference for the sound. Although this process is more involved, it can be performed with affordable, easy to get, hardware

External speakers positioned 40cm from the device are used to deliver a white noise sound source. These speakers don’t need to have a “Flat” frequency response, but need good coverage from low frequencies (100 hz) to high frequencies (20khz) is expected which is usually met by portable or medium size self powered speakers (e.g. Sony SRS-X5 portable speakers)

The key element here is that a step for calibration (using the USB reference microphone) is performed, to estimate the actual response of the speakers, thus have a solid reference to compare the built in microphone against.

Start CTS Audio Frequency Microphone Test start mic test
Summary of instructions is displayed instructions
Set up DUT in a quiet room
Position the speakers 40cm perpendicular to the center of the screen of the DUT (see Audio frequency microphone test )
device under test
Report if the device has a headset port:
YES if the device under test has a physical headset port
NO if there is no headset port
audio microphone test
If the answer was NO in the previous step, press Pass (green check) on the bottom of the test and finish mic headset pass button
If the answer was YES in the previous step, continue to connect external speakers.
Connect external speakers using the headphone/line out connector (remember to unplug any USB microphone)
Press EXTERNAL SPEAKERS READY
external speakers ready
Press TEST 1 no USB device
Wait several seconds for test 1 to complete. testing underway
When test 1 is completed, results for the built in microphone are shown. test results
Connect a USB Reference microphone (see Audio frequency speaker test )
Press USB REFERENCE MICROPHONE READY
microphone ready
Position USB microphone right next to built-in microphone in DUT, pointing towards external speakers device position
mic position
Press TEST 2 USB detected
Wait several seconds while the test 2 runs test running
When test 2 is completed, results for the USB reference microphone are shown. testing completed
Press the Pass (only available if successful) or Failed button to record the results. Pass button
Failed button

Audio Frequency Unprocessed Test

For this test, in addition to the USB reference microphone and external speakers, it is necessary to have access to a Sound Pressure Level Meter (SPL Meter).

Also worth mentioning, in this test the Playback and Test parts of each test have been given their own button. This was done to help test certain devices which don't have easy playback capabilities, but still can test the recording source UNPROCESSED.

Start CTS Frequency Unprocessed Test. Start test
Summary of instructions is displayed. Summary of instructions
Set up DUT in a quiet room. Connect external speakers using the headphone/line out connector (make sure there is not any USB microphone connected). Photo of DUT setup
TEST TONE
Press [PLAY] and move the SPL meter on front of the speakers until the level read is 94 dB SPL.
Photo of test tone setup
Move the SPL meter in a straight line from the speakers back and forth, until the level read on the screen is 94 dB SPL. Make a note of this location. Photo of SPL meter placement
Move the DUT and place the microphone in about the same location found in the previous step. Press [TEST]. The DUT performs a short audio capture and automatically stops the playback. Playback can also be stopped by pressing [STOP] if needed. Screenshot of audio capture
TEST NOISE
Position the speakers 40cm perpendicular to the center of the screen of the DUT (see Audio frequency microphone test).
Photo of speaker placement
Press [PLAY]. Press [TEST]. Wait for the test to complete. It will automatically stop the plabyack.

Playback can also be stopped by pressing [STOP] if needed.

Screenshot of running test
TEST USB BACKGROUND
Connect a USB Reference microphone (see Audio frequency speaker test). Locate USB microphone close to DUT microphone

Press [TEST].

This runs a short test and displays results on screen.

Photo of USB refernce mike Screenshot of running test
TEST USB NOISE
Leave USB microphone in the same position as in the previous test.

Press [PLAY]. Broadband noise should play from external speakers. Press [TEST]. A short test will run and display results on screen.

. Screenshot of USB noise test
When the 4 parts of the test are completed, the global results are updated with PASSED/FAILED information for each test. If needed, repeat individual steps of the test. Test results
Press the Pass (only available if successful) or Failed button to record the results. If the DUT does not define the Audio Frequency Unprocessed feature, running the test is required, but success in all measurements is not mandatory. Test passed

Test not passed