The Google Assistant SDK lets you add voice control, natural language understanding and Google’s smarts to your ideas. Your project captures an utterance (a spoken audio request, such as What's on my calendar?), sends it to the Google Assistant, and receives a spoken audio response in addition to the raw text of the utterance.

Google Assistant Service

The Google Assistant Service exposes a low level API that lets you directly manipulate the audio bytes of an Assistant request and response. Bindings for this API can be generated for languages like Node.js, Go, C++, Java for all platforms that support gRPC.

Reference code is provided in Python for audio capture, audio playback, and conversation state management.

Compatibility and feature support

The following table summarizes the platform compatibility requirements of the Google Assistant Service:

Google Assistant service
Supported architectures All gRPC platforms
Supported languages All gRPC languages
Hands-free activation
(Ok Google)
Audio capture and playback Reference code is provided
Conversation state management Reference code is provided
Timers and alarmsNo
Playback of podcasts and newsNo
Broadcast voice messagesNo
Visual output (HTML5) of Assistant responsesYes

Steps to start building your projects

The SDK lets you build projects quickly by embedding the Google Assistant and then letting you add unique functionality with Actions on Google:

  1. Build your project using the gRPC APIs.
  2. Get ideas for next steps to customize it.
  3. Polish your project by reading best practices for privacy and security and audio configuration.