smart display icon

Help users get things done while they're on-the-go, using the full multimodal capabilities available on phones, including both voice and visuals.


For mobile devices which have screens, your Action needs to support two modalities:

  • Voice invocation
  • Keyboard invocation

Note that users are free to move between these modalities within an Action. Make sure to design your rich responses specifically for each of these modalities. For example, with keyboard invocation, no sounds are played if they are provided in SSML. If the response relies on the user hearing a sound and the device is using keyboard modality, your Action needs to describe what kind sound of sound is played.

To detect the availability of a screen and the input modality on a smartphone, you can use the following code:

  • Has screen: if (conv.screen)
  • Uses voice modality: if (conv.input.type === 'VOICE')
  • Uses keyboard modality: if (conv.input.type === 'KEYBOARD')

Tips & best practices

Try these Actions

Try this sample