BenchmarkResult

AI-generated Key Takeaways

• BenchmarkResult is a data class containing the results of a benchmark.

• It includes nested classes for BenchmarkMetric (accuracy metrics) and InferenceOutput (model output of one tensor).

• Public methods provide access to the actual model output, accuracy check status, inference and initialization times in microseconds, maximum memory usage in kilobytes, and a list of accuracy metrics.

public abstract class BenchmarkResult extends Object

Data class that contains BenchmarkResult.

Nested Class Summary

class	BenchmarkResult.BenchmarkMetric		Accuracy metrics.
class	BenchmarkResult.InferenceOutput		Model output of one tensor.

Public Method Summary

abstract List<BenchmarkResult.InferenceOutput>	actualOutput() Returns model output of running with this config.
abstract boolean	hasPassedAccuracyCheck() Returns whether accuracy validation check has passed.
abstract List<Long>	inferenceTimeMicros() Returns inference time of each sample input, in microseconds.
abstract List<Long>	initializationTimeMicros() Returns initialization time of each sample input, in microseconds.
abstract int	maxMemoryKb() Returns max memory used of all sample inputs, in kilobytes.
abstract List<BenchmarkResult.BenchmarkMetric>	metrics() Returns the list of accuracy metrics.

Inherited Method Summary

From class java.lang.Object

Object	clone()
boolean	equals(Object arg0)
void	finalize()
final Class<?>	getClass()
int	hashCode()
final void	notify()
final void	notifyAll()
String	toString()
final void	wait(long arg0, int arg1)
final void	wait(long arg0)
final void	wait()

Public Methods

public abstract List<BenchmarkResult.InferenceOutput> actualOutput ()

Returns model output of running with this config. Each BenchmarkResult.InferenceOutput maps to one output tensor.

public abstract boolean hasPassedAccuracyCheck ()

Returns whether accuracy validation check has passed.

public abstract List<Long> inferenceTimeMicros ()

Returns inference time of each sample input, in microseconds.

public abstract List<Long> initializationTimeMicros ()

Returns initialization time of each sample input, in microseconds.

public abstract int maxMemoryKb ()

Returns max memory used of all sample inputs, in kilobytes.

public abstract List<BenchmarkResult.BenchmarkMetric> metrics ()

Returns the list of accuracy metrics.