ObjectDetector class

Performs object detection on images.

Signature:

export declare class ObjectDetector extends VisionTaskRunner 

Extends: VisionTaskRunner

Methods

Method Modifiers Description
createFromModelBuffer(wasmFileset, modelAssetBuffer) static Initializes the Wasm runtime and creates a new object detector based on the provided model asset buffer.
createFromModelPath(wasmFileset, modelAssetPath) static Initializes the Wasm runtime and creates a new object detector based on the path to the model asset.
createFromOptions(wasmFileset, objectDetectorOptions) static Initializes the Wasm runtime and creates a new object detector from the provided options.
detect(image, imageProcessingOptions) Performs object detection on the provided single image and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode image.
detectForVideo(videoFrame, timestamp, imageProcessingOptions) Performs object detection on the provided video frame and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode video.
setOptions(options) Sets new options for the object detector.Calling setOptions() with a subset of options only affects those options. You can reset an option back to its default value by explicitly setting it to undefined.

ObjectDetector.createFromModelBuffer()

Initializes the Wasm runtime and creates a new object detector based on the provided model asset buffer.

Signature:

static createFromModelBuffer(wasmFileset: WasmFileset, modelAssetBuffer: Uint8Array): Promise<ObjectDetector>;

Parameters

Parameter Type Description
wasmFileset WasmFileset A configuration object that provides the location of the Wasm binary and its loader.
modelAssetBuffer Uint8Array A binary representation of the model.

Returns:

Promise<ObjectDetector>

ObjectDetector.createFromModelPath()

Initializes the Wasm runtime and creates a new object detector based on the path to the model asset.

Signature:

static createFromModelPath(wasmFileset: WasmFileset, modelAssetPath: string): Promise<ObjectDetector>;

Parameters

Parameter Type Description
wasmFileset WasmFileset A configuration object that provides the location of the Wasm binary and its loader.
modelAssetPath string The path to the model asset.

Returns:

Promise<ObjectDetector>

ObjectDetector.createFromOptions()

Initializes the Wasm runtime and creates a new object detector from the provided options.

Signature:

static createFromOptions(wasmFileset: WasmFileset, objectDetectorOptions: ObjectDetectorOptions): Promise<ObjectDetector>;

Parameters

Parameter Type Description
wasmFileset WasmFileset A configuration object that provides the location of the Wasm binary and its loader.
objectDetectorOptions ObjectDetectorOptions The options for the Object Detector. Note that either a path to the model asset or a model buffer needs to be provided (via baseOptions).

Returns:

Promise<ObjectDetector>

ObjectDetector.detect()

Performs object detection on the provided single image and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode image.

Signature:

detect(image: ImageSource, imageProcessingOptions?: ImageProcessingOptions): DetectionResult;

Parameters

Parameter Type Description
image ImageSource An image to process.
imageProcessingOptions ImageProcessingOptions the ImageProcessingOptions specifying how to process the input image before running inference. A result containing a list of detected objects.

Returns:

DetectionResult

ObjectDetector.detectForVideo()

Performs object detection on the provided video frame and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode video.

Signature:

detectForVideo(videoFrame: ImageSource, timestamp: number, imageProcessingOptions?: ImageProcessingOptions): DetectionResult;

Parameters

Parameter Type Description
videoFrame ImageSource A video frame to process.
timestamp number The timestamp of the current frame, in ms.
imageProcessingOptions ImageProcessingOptions the ImageProcessingOptions specifying how to process the input image before running inference. A result containing a list of detected objects.

Returns:

DetectionResult

ObjectDetector.setOptions()

Sets new options for the object detector.

Calling setOptions() with a subset of options only affects those options. You can reset an option back to its default value by explicitly setting it to undefined.

Signature:

setOptions(options: ObjectDetectorOptions): Promise<void>;

Parameters

Parameter Type Description
options ObjectDetectorOptions The options for the object detector.

Returns:

Promise<void>