ITestLifeCycleReceiver

public interface ITestLifeCycleReceiver

com.android.tradefed.result.ITestLifeCycleReceiver

Known indirect subclasses

AggregatePostProcessor, AtraceCollector, AtraceRunMetricCollector, AveragePostProcessor, BaseDeviceMetricCollector, BasePostProcessor, BluetoothConnectionLatencyCollector, BluetoothConnectionStateCollector, BluetoothConnectionSuccessRatePostProcessor, BluetoothHciSnoopLogCollector, BugreportCollector, BugreportzOnFailureCollector, BugreportzOnTestCaseFailureCollector, ClangCodeCoverageCollector, CollectingTestListener, and 77 others.

AggregatePostProcessor	A metric aggregator that gives the min, max, mean, variance, standard deviation, total, count and optionally percentiles for numeric metrics collected during multiple-iteration test runs, treating them as doubles.
AtraceCollector	A `IMetricCollector` that runs atrace during a test and collects the result and log them to the invocation.
AtraceRunMetricCollector	Collects the traces from all the test directory under the given directory from the test device, log the test directory and post process the trace files under the test directory and aggregate the metrics.
AveragePostProcessor	Implementation of post processor that calculate the average of the list of metrics.
BaseDeviceMetricCollector	Base implementation of `IMetricCollector` that allows to start and stop collection on `onTestRunStart(com.android.tradefed.device.metric.DeviceMetricData)` and `ERROR(/#onTestRunEnd(com.android.tradefed.device.metric.DeviceMetricData,Map))`.
BasePostProcessor	The base `IPostProcessor` that every implementation should extend.
BluetoothConnectionLatencyCollector	The collector will push a pre-defined statsd duration metric config to devices and collect Bluetooth connection duration for each profile.
BluetoothConnectionStateCollector	This collector will collect BluetoothConnectionStateChanged metrics and record connection state number for each profile.
BluetoothConnectionSuccessRatePostProcessor	Implementation of postprocessor which calculates success rate for a bluetooth profile Use "metric-key-match" to specify metrics which contain bluetooth connection states in numeric array Example [0, 1, 2, 3, 0, 1, 2, 3].
BluetoothHciSnoopLogCollector	Collector to enable Bluetooth HCI snoop logging on the DUT and to collect the log for each test.
BugreportCollector	A pass-through `ITestInvocationListener` that collects bugreports when configurable events occur and then calls `ITestInvocationListener#testLog` on its children after each bugreport is collected.
BugreportzOnFailureCollector	Collect a bugreportz when a test case fails.
BugreportzOnTestCaseFailureCollector	Collect a bugreportz when a test case in a run fails.
ClangCodeCoverageCollector	A `BaseDeviceMetricCollector` that will pull Clang coverage measurements off of the device and log them as test artifacts.
CollectingTestListener	A `ITestInvocationListener` that will collect all test results.
CommandStatusHandler	Handler helping to monitor and update the status of an invocation.
ConditionFailureMonitor	Monitor for any failures from the invocation.
ConsoleResultReporter	Result reporter to print the test results to the console.
CountTestCasesCollector	Count and report the number of test cases for a given `IRemoteTest`.
CountingTestResultListener	A `TestResultListener` that tracks the total number of tests by `TestStatus`
DebugHostLogOnFailureCollector	Collector that will gather and log the host-side logs when a test case failure occurs.
DeviceReleaseReporter	Device release reporter that handles communicating with the parent process the device(s) to be released.
DeviceTraceCollector	Collector that will start perfetto trace when a test run starts and log trace file at the end.
DeviceUnavailableMonitor	This listener attempts to capture a test case level DNAE only.
EventsLoggerListener	Listener that logs all the events it receives into a file
FileProtoResultReporter	Proto reporter that dumps the `TestRecord` into a file.
FilePullerDeviceMetricCollector	A `BaseDeviceMetricCollector` that listen for metrics key coming from the device and pull them as a file from the device.
FilePullerLogCollector	Logger of the file reported by the device-side.
FilteredResultForwarder	Variant of `ResultForwarder` that only allows an allowlist of `TestDescription` to be reported.
FormattedGeneratorReporter	Reporter that allows to generate reports in a particular format.
GcovCodeCoverageCollector	A `BaseDeviceMetricCollector` that will pull gcov coverage measurements off of the device and log them as test artifacts.
GcovKernelCodeCoverageCollector	A `BaseDeviceMetricCollector` that will pull gcov kernel coverage measurements out of debugfs and off of the device and then finally logs them as test artifacts.
GranularRetriableTestWrapper.StartEndCollector	Class helper to catch missing run start and end.
HostStatsdMetricCollector	A `IMetricCollector` that collects statsd metrics from host side using statsd utility commands.
ICommandScheduler.IScheduledInvocationListener	Listener for invocation events when invocation completes.
ILogSaverListener	Allows for `ITestInvocationListener`s to listen for when log files are saved.
IMetricCollector	This interface will be added as a decorator when reporting tests results in order to collect matching metrics.
IPostProcessor	Post processors is a Trade Federation object meant to allow the processing of metrics and logs AFTER the tests and BEFORE result reporting.
IShardableListener	A `ITestInvocationListener` that can be sharded.
ISupportGranularResults	Interface specifying whether a `ITestInvocationListener` supports receiving the granular results or not.
ITestInvocationListener	Listener for test results from the test invocation.
ITestSummaryListener	Interface that allows `ITestInvocationListener` to exchange some limited information via summaries.
InvocationToJUnitResultForwarder	A class that listens to `ITestInvocationListener` events and forwards them to a `TestListener`.
JarHostTest.HostTestListener	Wrapper listener that forwards all events except testRunStarted() and testRunEnded() to the embedded listener.
JavaCodeCoverageCollector	A `BaseDeviceMetricCollector` that will pull Java coverage measurements off of the device and log them as test artifacts.
JsonHttpTestResultReporter	A result reporter that encode test metrics results and branch, device info into JSON and POST into an HTTP service endpoint
LUCIResultReporter	A result reporter that saves test results needed by ResultDB and LUCI into JSON format (go/result-sink) and logs the file location in the console.
LastShardDetector	When running local sharding, sometimes we only want to execute some actions when the last shard reaches `invocationEnded(long)`.
LegacySubprocessResultsReporter	A frozen implementation of the subprocess results reporter which should remain compatible with earlier versions of TF/CTS (e.g. 8+), despite changes in its superclass.
LogSaverResultForwarder	A `ResultForwarder` for saving logs with the global file saver.
LogcatCrashResultForwarder	Special listener: on failures (instrumentation process crashing) it will attempt to extract from the logcat the crash and adds it to the failure message associated with the test.
LogcatOnFailureCollector	Collector that will capture and log a logcat when a test case fails.
LogcatTimingMetricCollector	A metric collector that collects timing information (e.g. user switch time) from logcat during one or multiple repeated tests by using given regex patterns to parse start and end signals of an event from logcat lines.
MetricFilePostProcessor	Used for uploading the metrics log file collected during the test and run level.
MetricsXMLResultReporter	MetricsXMLResultReporter writes test metrics and run metrics to an XML file in a folder specified by metrics-folder parameter at the invocationEnded phase of the test.
ModuleListener	Listener attached to each `IRemoteTest` of each module in order to collect the list of results.
ModuleLogcatCollector	Version of logcat collector but for module.
ModuleProtoResultReporter	A result reporter meant to report only the module level results.
NameMangleListener	A proxy listener to translate test method, class, and package names as results are reported.
PassingTestFileReporter	A `ITestInvocationListener` that saves the list of passing test cases to a test file
PerfettoGenericPostProcessor	A post processor that processes text/binary metric perfetto proto file into key-value pairs by recursively expanding the proto messages and fields with string values until the field with numeric value is encountered.
PerfettoPullerMetricCollector	Base implementation of `FilePullerDeviceMetricCollector` that allows pulling the perfetto files from the device and collect the metrics from it.
PrettyTestEventLogger	Logger matching the events and logging them in order to make it easier to debug.
ProtoResultReporter	Result reporter build a `TestRecord` protobuf with all the results inside.
PythonBinaryHostTest.PythonForwarder	Result forwarder to replace the run name by the binary name.
RebootReasonCollector	Collector that collects device reboot during the test run and report them by reason and counts.
RemoteTestTimeOutEnforcer	Listeners that allows to check the execution time of a given test config and fail it if it goes over a given timeout.
ReportPassedTests	Report in a file possible filters to exclude passed test.
ResultAggregator	Special forwarder that aggregates the results when needed, based on the retry strategy that was taken.
ResultAndLogForwarder	Forwarder for results and logs events.
ResultForwarder	A `ITestInvocationListener` that forwards invocation results to a list of other listeners.
RetryLogSaverResultForwarder	Forwarder that also handles passing the current attempt we are at.
RetryResultForwarder	An Extension of `ResultForwarder` that always push to a given attempt number.
RuntimeRestartCollector	Collector that collects timestamps of runtime restarts (system server crashes) during the test run, if any.
ScreenshotOnFailureCollector	Collector that will capture and log a screenshot when a test case fails.
ShardListener	A `ITestInvocationListener` that collects results from a invocation shard (aka an invocation split to run on multiple resources in parallel), and forwards them to another listener.
ShardMainResultForwarder	A `ResultForwarder` that combines the results of a sharded test invocations.
ShowmapPullerMetricCollector	Base implementation of `FilePullerDeviceMetricCollector` that allows pulling the showmap files from the device and collect the metrics from it.
StatsdBeforeAfterGaugeMetricPostProcessor	A post processor that processes gauge metrics collected in a "before/after" approach, i.e.
StatsdEventMetricPostProcessor	A post processor that processes event metrics in statsd reports into key-value pairs, using the formatters specified on the processor.
StatsdGenericPostProcessor	A post processor that processes binary proto statsd reports into key-value pairs by expanding the report as a tree structure.
StreamProtoResultReporter	An implementation of `ProtoResultReporter`
SubprocessResultsReporter	Implements `ITestInvocationListener` to be specified as a result_reporter and forward from the subprocess the results of tests, test runs, test invocations.
SuiteResultReporter	Collect test results for an entire suite invocation and output the final results.
TestResultListener	A simplification of ITestLifecycleListener for implementers that only care about individual test results.
TestRunResultListener	Listener that allows to read the final test run status.
TestTimeoutEnforcer	Listeners that allows to check the execution time of a given test case and fail it if it goes over a given timeout.
TextResultReporter	A test result reporter that forwards results to the JUnit text result printer.
TraceCmdCollector	A `IMetricCollector` that collects traces during the test using trace-cmd, and logs them to the invocation.
TradefedSandboxRunner.StubScheduledInvocationListener	A stub `IScheduledInvocationListener` that does nothing.
XmlFormattedGeneratorReporter	Implementation of the `FormattedGeneratorReporter` which format the suite results in an xml format.
XmlResultReporter	Writes JUnit results to an XML files in a format consistent with Ant's XMLJUnitResultFormatter.

Receives event notifications during instrumentation test runs.

Patterned after org.junit.runner.notification.RunListener

The sequence of calls will be:

testRunStarted
testStarted
[testFailed]
[testAssumptionFailure]
[testIgnored]
testEnded
....
[testRunFailed]
testRunEnded

Summary

Public methods
`default void`	`testAssumptionFailure(TestDescription test, String trace)` Called when an atomic test flags that it assumes a condition that is false
`default void`	`testAssumptionFailure(TestDescription test, FailureDescription failure)` Called when an atomic test flags that it assumes a condition that is false
`default void`	`testEnded(TestDescription test, long endTime, testMetrics)` Alternative to `ERROR(/#testEnded(com.android.tradefed.result.TestDescription,Map))` where we can specify the end time directly.
`default void`	`testEnded(TestDescription test, testMetrics)` Reports the execution end of an individual test case.
`default void`	`testFailed(TestDescription test, FailureDescription failure)` Reports the failure of a individual test case.
`default void`	`testFailed(TestDescription test, String trace)` Reports the failure of a individual test case.
`default void`	`testIgnored(TestDescription test)` Called when a test will not be run, generally because a test method is annotated with org.junit.Ignore.
`default void`	`testRunEnded(long elapsedTimeMillis, runMetrics)` Reports end of test run.
`default void`	`testRunFailed(FailureDescription failure)` Reports test run failed to complete due to a failure described by `FailureDescription`.
`default void`	`testRunFailed(String errorMessage)` Reports test run failed to complete due to a fatal error.
`default void`	`testRunStarted(String runName, int testCount, int attemptNumber)` Reports the start of a test run.
`default void`	`testRunStarted(String runName, int testCount)` Reports the start of a test run.
`default void`	`testRunStarted(String runName, int testCount, int attemptNumber, long startTime)` Reports the start of a test run.
`default void`	`testRunStopped(long elapsedTime)` Reports test run stopped before completion due to a user request.
`default void`	`testSkipped(TestDescription test, SkipReason reason)` Called when a test is skipped and did not execute for a reason that is not usually expected.
`default void`	`testStarted(TestDescription test, long startTime)` Alternative to `testStarted(com.android.tradefed.result.TestDescription)` where we also specify when the test was started, combined with `ERROR(/#testEnded(com.android.tradefed.result.TestDescription,long,Map))` for accurate measure.
`default void`	`testStarted(TestDescription test)` Reports the start of an individual test case.

Public methods

testAssumptionFailure

public void testAssumptionFailure (TestDescription test, 
                String trace)

Called when an atomic test flags that it assumes a condition that is false

Parameters
`test`	`TestDescription`: identifies the test
`trace`	`String`: stack trace of failure

testAssumptionFailure

public void testAssumptionFailure (TestDescription test, 
                FailureDescription failure)

Called when an atomic test flags that it assumes a condition that is false

Parameters
`test`	`TestDescription`: identifies the test
`failure`	`FailureDescription`: `FailureDescription` describing the failure and its context.

testEnded

public void testEnded (TestDescription test, 
                long endTime, 
                 testMetrics)

Alternative to ERROR(/#testEnded(com.android.tradefed.result.TestDescription,Map)) where we can specify the end time directly. Combine with testStarted(com.android.tradefed.result.TestDescription, long) for accurate measure.

Parameters
`test`	`TestDescription`: identifies the test
`endTime`	`long`: the time the test ended, measured via `System.currentTimeMillis()`
`testMetrics`	: a `ERROR(/Map)` of the metrics emitted

testEnded

public void testEnded (TestDescription test, 
                 testMetrics)

Reports the execution end of an individual test case.

If testFailed(TestDescription, FailureDescription) was not invoked, this test passed. Also returns any key/value metrics which may have been emitted during the test case's execution.

Parameters
`test`	`TestDescription`: identifies the test
`testMetrics`	: a `ERROR(/Map)` of the metrics emitted

testFailed

public void testFailed (TestDescription test, 
                FailureDescription failure)

Reports the failure of a individual test case.

Will be called between testStarted and testEnded.

Parameters
`test`	`TestDescription`: identifies the test
`failure`	`FailureDescription`: `FailureDescription` describing the failure and its context.

testFailed

public void testFailed (TestDescription test, 
                String trace)

Reports the failure of a individual test case.

Will be called between testStarted and testEnded.

Parameters
`test`	`TestDescription`: identifies the test
`trace`	`String`: stack trace of failure

testIgnored

public void testIgnored (TestDescription test)

Called when a test will not be run, generally because a test method is annotated with org.junit.Ignore.

Parameters
`test`	`TestDescription`: identifies the test

testRunEnded

public void testRunEnded (long elapsedTimeMillis, 
                 runMetrics)

Reports end of test run.

Parameters
`elapsedTimeMillis`	`long`: device reported elapsed time, in milliseconds
`runMetrics`	: key-value pairs reported at the end of a test run

testRunFailed

public void testRunFailed (FailureDescription failure)

Reports test run failed to complete due to a failure described by FailureDescription.

Parameters
`failure`	`FailureDescription`: `FailureDescription` describing the failure and its context.

testRunFailed

public void testRunFailed (String errorMessage)

Reports test run failed to complete due to a fatal error.

Parameters
`errorMessage`	`String`: `String` describing reason for run failure.

testRunStarted

public void testRunStarted (String runName, 
                int testCount, 
                int attemptNumber)

Reports the start of a test run.

Parameters
`runName`	`String`: the test run name
`testCount`	`int`: total number of tests in test run
`attemptNumber`	`int`: order number, identifying the different attempts of the same runName that run multiple times. The attemptNumber is 0-indexed and should increment everytime a new run happens. e.g. A test is granular retried 3 times, it should have 4 total runs under the same runName and the attemptNumber is from 0 to 3.

testRunStarted

public void testRunStarted (String runName, 
                int testCount)

Reports the start of a test run.

Parameters
`runName`	`String`: the test run name
`testCount`	`int`: total number of tests in test run

testRunStarted

public void testRunStarted (String runName, 
                int testCount, 
                int attemptNumber, 
                long startTime)

Reports the start of a test run.

Parameters
`runName`	`String`: the test run name
`testCount`	`int`: total number of tests in test run
`attemptNumber`	`int`: order number, identifying the different attempts of the same runName that run multiple times. The attemptNumber is 0-indexed and should increment everytime a new run happens. e.g. A test is granular retried 3 times, it should have 4 total runs under the same runName and the attemptNumber is from 0 to 3.
`startTime`	`long`: the time the run started, measured via `System.currentTimeMillis()`

testRunStopped

public void testRunStopped (long elapsedTime)

Reports test run stopped before completion due to a user request.

TODO: currently unused, consider removing

Parameters
`elapsedTime`	`long`: device reported elapsed time, in milliseconds

testSkipped

public void testSkipped (TestDescription test, 
                SkipReason reason)

Called when a test is skipped and did not execute for a reason that is not usually expected. These tests will be attempted to be retried to attempt to get a proper execution.

Parameters
`test`	`TestDescription`: identifies the test
`reason`	`SkipReason`: `SkipReason`

testStarted

public void testStarted (TestDescription test, 
                long startTime)

Alternative to testStarted(com.android.tradefed.result.TestDescription) where we also specify when the test was started, combined with ERROR(/#testEnded(com.android.tradefed.result.TestDescription,long,Map)) for accurate measure.

Parameters
`test`	`TestDescription`: identifies the test
`startTime`	`long`: the time the test started, measured via `System.currentTimeMillis()`

testStarted

public void testStarted (TestDescription test)

Reports the start of an individual test case. Older interface, should use testStarted(com.android.tradefed.result.TestDescription) whenever possible.

Parameters
`test`	`TestDescription`: identifies the test