CreateCachedContextRequest

class CreateCachedContextRequest


A request to create a cached context.

Summary

Public properties

String

the unique name for the cached context.

PromptPrefix

the prefix of the prompt.

Public properties

name

val name: String

the unique name for the cached context. Required.

promptPrefix

val promptPrefix: PromptPrefix

the prefix of the prompt. This can be used to provide a prefix shared across multiple generation requests.