| ▼NGoogle | |
| ▼NApis | |
| ▼NDataproc | |
| ▼Nv1 | |
| ▼NData | |
| CAcceleratorConfig | Specifies the type and number of accelerator cards attached to the instances of an instance. See GPUs on Compute Engine. |
| CAutoscalingConfig | Autoscaling Policy config associated with the cluster. |
| CAutoscalingPolicy | Describes an autoscaling policy for Dataproc cluster autoscaler. |
| CBasicAutoscalingAlgorithm | Basic algorithm for autoscaling. |
| CBasicYarnAutoscalingConfig | Basic autoscaling configurations for YARN. |
| CBinding | Associates members with a role. |
| CCancelJobRequest | A request to cancel a job. |
| CCluster | Describes the identifying information, config, and status of a cluster of Compute Engine instances. |
| CClusterConfig | The cluster config. |
| CClusterMetrics | Contains cluster daemon metrics, such as HDFS and YARN stats.Beta Feature: This report is available for testing purposes only. It may be changed before final release. |
| CClusterOperation | The cluster operation triggered by a workflow. |
| CClusterOperationMetadata | Metadata describing the operation. |
| CClusterOperationStatus | The status of the operation. |
| CClusterSelector | A selector that chooses target cluster for jobs based on metadata. |
| CClusterStatus | The status of a cluster and its instances. |
| CDiagnoseClusterRequest | A request to collect cluster diagnostic information. |
| CDiagnoseClusterResults | The location of diagnostic output. |
| CDiskConfig | Specifies the config of disk options for a group of VM instances. |
| CEmpty | A generic empty message that you can re-use to avoid defining duplicated empty messages in your APIs. A typical example is to use it as the request or the response type of an API method. For instance: service Foo { rpc Bar(google.protobuf.Empty) returns (google.protobuf.Empty); } The JSON representation for Empty is empty JSON object {}. |
| CEncryptionConfig | Encryption settings for the cluster. |
| CExpr | Represents a textual expression in the Common Expression Language (CEL) syntax. CEL is a C-like expression language. The syntax and semantics of CEL are documented at https://github.com/google/cel- spec.Example (Comparison): title: "Summary size limit" description: "Determines if a summary is less than 100
chars" expression: "document.summary.size() < 100" Example (Equality): title: "Requestor is owner" description: "Determines if requestor is the document owner" expression: "document.owner == request.auth.claims.email" Example (Logic): title: "Public documents" description: "Determine whether the document should be publicly
visible" expression: "document.type != 'private' && document.type != 'internal'" Example (Data Manipulation): title: "Notification string" description: "Create a notification string with a timestamp." expression: "'New
message received at ' + string(document.create_time)" The exact variables and functions that may be referenced within an expression are determined by the service that evaluates it. See the service documentation for additional information. |
| CGceClusterConfig | Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster. |
| CGetIamPolicyRequest | Request message for GetIamPolicy method. |
| CGetPolicyOptions | Encapsulates settings provided to GetIamPolicy. |
| CHadoopJob | A Dataproc job for running Apache Hadoop MapReduce (https://hadoop.apache.org/docs/current/hadoop- mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html) jobs on Apache Hadoop YARN (https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html). |
| CHiveJob | A Dataproc job for running Apache Hive (https://hive.apache.org/) queries on YARN. |
| CInstanceGroupAutoscalingPolicyConfig | Configuration for the size bounds of an instance group, including its proportional size to other groups. |
| CInstanceGroupConfig | The config settings for Compute Engine resources in an instance group, such as a master or worker group. |
| CInstantiateWorkflowTemplateRequest | A request to instantiate a workflow template. |
| CJob | A Dataproc job resource. |
| CJobPlacement | Dataproc job config. |
| CJobReference | Encapsulates the full scoping used to reference a job. |
| CJobScheduling | Job scheduling options. |
| CJobStatus | Dataproc job status. |
| CKerberosConfig | Specifies Kerberos related configuration. |
| CLifecycleConfig | Specifies the cluster auto-delete schedule configuration. |
| CListAutoscalingPoliciesResponse | A response to a request to list autoscaling policies in a project. |
| CListClustersResponse | The list of all clusters in a project. |
| CListJobsResponse | A list of jobs in a project. |
| CListOperationsResponse | The response message for Operations.ListOperations. |
| CListWorkflowTemplatesResponse | A response to a request to list workflow templates in a project. |
| CLoggingConfig | The runtime logging config of the job. |
| CManagedCluster | Cluster that is managed by the workflow. |
| CManagedGroupConfig | Specifies the resources used to actively manage an instance group. |
| CNodeInitializationAction | Specifies an executable to run on a fully configured node and a timeout period for executable completion. |
| COperation | This resource represents a long-running operation that is the result of a network API call. |
| COrderedJob | A job executed by the workflow. |
| CParameterValidation | Configuration for parameter validation. |
| CPigJob | A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN. |
| CPolicy | An Identity and Access Management (IAM) policy, which specifies access controls for Google Cloud resources.A Policy is a collection of bindings. A binding binds one or more members to a single role. Members can be user accounts, service accounts, Google groups, and domains (such as G Suite). A role is a named list of permissions; each role can be an IAM predefined role or a user-created custom role.Optionally, a binding can specify a condition, which is a logical expression that allows access to a resource only if the expression evaluates to true. A condition can add constraints based on attributes of the request, the resource, or both.JSON example: { "bindings": [ { "role": "roles/resourcemanager.organizationAdmin", "members": [ "user:mike@example.com", "group:admins@example.com", "domain:google.com", "serviceAccount:my-project-
id@appspot.gserviceaccount.com" ] }, { "role": "roles/resourcemanager.organizationViewer", "members": ["user:eve@example.com"], "condition": { "title": "expirable access", "description": "Does not grant access
after Sep 2020", "expression": "request.time < timestamp('2020-10-01T00:00:00.000Z')", } } ], "etag": "BwWWja0YfJA=", "version": 3 } YAML example: bindings: - members: - user:mike@.nosp@m.exam.nosp@m.ple.c.nosp@m.om - group:admin.nosp@m.s@ex.nosp@m.ample.nosp@m..com - domain:google.com - serviceAccount:my-pr.nosp@m.ojec.nosp@m.t-id@.nosp@m.apps.nosp@m.pot.g.nosp@m.serv.nosp@m.iceac.nosp@m.coun.nosp@m.t.com role: roles/resourcemanager.organizationAdmin - members: - user:eve@e.nosp@m.xamp.nosp@m.le.co.nosp@m.m role: roles/resourcemanager.organizationViewer condition: title: expirable access description: Does not grant access after Sep 2020 expression: request.time < timestamp('2020-10-01T00:00:00.000Z') - etag: BwWWja0YfJA= - version: 3 For a description of IAM and its features, see the IAM documentation (https://cloud.google.com/iam/docs/). |
| CPrestoJob | A Dataproc job for running Presto (https://prestosql.io/) queries |
| CPySparkJob | A Dataproc job for running Apache PySpark (https://spark.apache.org/docs/0.9.0/python-programming- guide.html) applications on YARN. |
| CQueryList | A list of queries to run on a cluster. |
| CRegexValidation | Validation based on regular expressions. |
| CReservationAffinity | Reservation Affinity for consuming Zonal reservation. |
| CSecurityConfig | Security related configuration, including Kerberos. |
| CSetIamPolicyRequest | Request message for SetIamPolicy method. |
| CSoftwareConfig | Specifies the selection and config of software inside the cluster. |
| CSparkJob | A Dataproc job for running Apache Spark (http://spark.apache.org/) applications on YARN. |
| CSparkRJob | A Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) applications on YARN. |
| CSparkSqlJob | A Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries. |
| CStatus | The Status type defines a logical error model that is suitable for different programming environments, including REST APIs and RPC APIs. It is used by gRPC (https://github.com/grpc). Each Status message contains three pieces of data: error code, error message, and error details.You can find out more about this error model and how to work with it in the API Design Guide (https://cloud.google.com/apis/design/errors). |
| CSubmitJobRequest | A request to submit a job. |
| CTemplateParameter | A configurable parameter that replaces one or more fields in the template. Parameterizable fields: - Labels - File uris - Job properties - Job arguments - Script variables - Main class (in HadoopJob and SparkJob) |
| CTestIamPermissionsRequest | Request message for TestIamPermissions method. |
| CTestIamPermissionsResponse | Response message for TestIamPermissions method. |
| CValueValidation | Validation based on a list of allowed values. |
| CWorkflowGraph | The workflow graph. |
| CWorkflowMetadata | A Dataproc workflow template resource. |
| CWorkflowNode | The workflow node. |
| CWorkflowTemplate | A Dataproc workflow template resource. |
| CWorkflowTemplatePlacement | Specifies workflow execution target.Either managed_cluster or cluster_selector is required. |
| CYarnApplication | A YARN application created by a job. Application information is a subset of org.apache.hadoop.yarn.proto.YarnProtos.ApplicationReportProto.Beta Feature: This report is available for testing purposes only. It may be changed before final release. |
| CDataprocBaseServiceRequest | A base abstract class for Dataproc requests. |
| CDataprocService | The Dataproc Service. |
| ▼CProjectsResource | The "projects" collection of methods. |
| ▼CLocationsResource | The "locations" collection of methods. |
| ►CAutoscalingPoliciesResource | The "autoscalingPolicies" collection of methods. |
| CCreateRequest | Creates new autoscaling policy. |
| CDeleteRequest | Deletes an autoscaling policy. It is an error to delete an autoscaling policy that is in use by one or more clusters. |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Retrieves autoscaling policy. |
| CListRequest | Lists autoscaling policies in the project. |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| CUpdateRequest | Updates (replaces) autoscaling policy.Disabled check for update_mask, because all updates will be full replacements. |
| ►CWorkflowTemplatesResource | The "workflowTemplates" collection of methods. |
| CCreateRequest | Creates new workflow template. |
| CDeleteRequest | Deletes a workflow template. It does not cancel in-progress workflows. |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Retrieves the latest workflow template.Can retrieve previously instantiated template by specifying optional version parameter. |
| CInstantiateInlineRequest | Instantiates a template and begins execution.This method is equivalent to executing the sequence CreateWorkflowTemplate, InstantiateWorkflowTemplate, DeleteWorkflowTemplate.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty. |
| CInstantiateRequest | Instantiates a template and begins execution.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty. |
| CListRequest | Lists workflows that match the specified filter in the request. |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| CUpdateRequest | Updates (replaces) workflow template. The updated template must contain version that matches the current server version. |
| ▼CRegionsResource | The "regions" collection of methods. |
| ►CAutoscalingPoliciesResource | The "autoscalingPolicies" collection of methods. |
| CCreateRequest | Creates new autoscaling policy. |
| CDeleteRequest | Deletes an autoscaling policy. It is an error to delete an autoscaling policy that is in use by one or more clusters. |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Retrieves autoscaling policy. |
| CListRequest | Lists autoscaling policies in the project. |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| CUpdateRequest | Updates (replaces) autoscaling policy.Disabled check for update_mask, because all updates will be full replacements. |
| ►CClustersResource | The "clusters" collection of methods. |
| CCreateRequest | Creates a cluster in a project. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc .v1::clusteroperationmetadata). |
| CDeleteRequest | Deletes a cluster in a project. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc .v1::clusteroperationmetadata). |
| CDiagnoseRequest | Gets cluster diagnostic information. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc .v1::clusteroperationmetadata). After the operation completes, Operation.response contains DiagnoseClusterResults (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v 1#diagnoseclusterresults). |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Gets the resource representation for a cluster in a project. |
| CListRequest | Lists all regions/{region}/clusters in a project alphabetically. |
| CPatchRequest | Updates a cluster in a project. The returned Operation.metadata will be ClusterOperationMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc .v1::clusteroperationmetadata). |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| ►CJobsResource | The "jobs" collection of methods. |
| CCancelRequest | Starts a job cancellation request. To access the job resource after cancellation, call regions/{region}/jobs.list (https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.jobs/list) or regions/{region}/jobs.get (https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.jobs/get). |
| CDeleteRequest | Deletes the job from the project. If the job is active, the delete fails, and the response returns FAILED_PRECONDITION. |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Gets the resource representation for a job in a project. |
| CListRequest | Lists regions/{region}/jobs in a project. |
| CPatchRequest | Updates a job in a project. |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CSubmitRequest | Submits a job to a cluster. |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| ►COperationsResource | The "operations" collection of methods. |
| CCancelRequest | Starts asynchronous cancellation on a long-running operation. The server makes a best effort to cancel the operation, but success is not guaranteed. If the server doesn't support this method, it returns google.rpc.Code.UNIMPLEMENTED. Clients can use Operations.GetOperation or other methods to check whether the cancellation succeeded or whether the operation completed despite cancellation. On successful cancellation, the operation is not deleted; instead, it becomes an operation with an Operation.error value with a google.rpc.Status.code of 1, corresponding to Code.CANCELLED. |
| CDeleteRequest | Deletes a long-running operation. This method indicates that the client is no longer interested in the operation result. It does not cancel the operation. If the server doesn't support this method, it returns google.rpc.Code.UNIMPLEMENTED. |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Gets the latest state of a long-running operation. Clients can use this method to poll the operation result at intervals as recommended by the API service. |
| CListRequest | Lists operations that match the specified filter in the request. If the server doesn't support this method, it returns UNIMPLEMENTED.NOTE: the name binding allows API services to override the binding to use different resource name schemes, such as users/operations. To override the binding, API services can add a binding such as "/v1/{name=users}/operations" to their service configuration. For backwards compatibility, the default name includes the operations collection id, however overriding users must ensure the name binding is the parent resource, without the operations collection id. |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| ►CWorkflowTemplatesResource | The "workflowTemplates" collection of methods. |
| CCreateRequest | Creates new workflow template. |
| CDeleteRequest | Deletes a workflow template. It does not cancel in-progress workflows. |
| CGetIamPolicyRequest | Gets the access control policy for a resource. Returns an empty policy if the resource exists and does not have a policy set. |
| CGetRequest | Retrieves the latest workflow template.Can retrieve previously instantiated template by specifying optional version parameter. |
| CInstantiateInlineRequest | Instantiates a template and begins execution.This method is equivalent to executing the sequence CreateWorkflowTemplate, InstantiateWorkflowTemplate, DeleteWorkflowTemplate.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty. |
| CInstantiateRequest | Instantiates a template and begins execution.The returned Operation can be used to track execution of workflow by polling operations.get. The Operation will complete when entire workflow is finished.The running workflow can be aborted via operations.cancel. This will cause any inflight jobs to be cancelled and workflow-owned clusters to be deleted.The Operation.metadata will be WorkflowMetadata (https://cloud.google.com/dataproc/docs/reference/rpc/google.cloud.dataproc.v1#workflowmetadata). Also see Using WorkflowMetadata (https://cloud.google.com/dataproc/docs/concepts/workflows/debugging#using_workflowmetadata).On successful completion, Operation.response will be Empty. |
| CListRequest | Lists workflows that match the specified filter in the request. |
| CSetIamPolicyRequest | Sets the access control policy on the specified resource. Replaces any existing policy.Can return Public Errors: NOT_FOUND, INVALID_ARGUMENT and PERMISSION_DENIED |
| CTestIamPermissionsRequest | Returns permissions that a caller has on the specified resource. If the resource does not exist, this will return an empty set of permissions, not a NOT_FOUND error.Note: This operation is designed to be used for building permission-aware UIs and command-line tools, not for authorization checking. This operation may "fail open" without warning. |
| CUpdateRequest | Updates (replaces) workflow template. The updated template must contain version that matches the current server version. |
