A Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) applications on YARN. More...

Inheritance diagram for Google.Apis.Dataproc.v1.Data.SparkRJob:

Properties
virtual System.Collections.Generic.IList< string >	ArchiveUris `[get, set]`
	Optional. HCFS URIs of archives to be extracted in the working directory of Spark drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip. More...

virtual System.Collections.Generic.IList< string >	Args `[get, set]`
	Optional. The arguments to pass to the driver. Do not include arguments, such as –conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission. More...

virtual System.Collections.Generic.IList< string >	FileUris `[get, set]`
	Optional. HCFS URIs of files to be copied to the working directory of R drivers and distributed tasks. Useful for naively parallel tasks. More...

virtual LoggingConfig	LoggingConfig `[get, set]`
	Optional. The runtime log config for job execution. More...

virtual string	MainRFileUri `[get, set]`
	Required. The HCFS URI of the main R file to use as the driver. Must be a .R file. More...

virtual System.Collections.Generic.IDictionary< string, string >	Properties `[get, set]`
	Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark- defaults.conf and classes in user code. More...

virtual string	ETag `[get, set]`
	The ETag of the item. More...

Properties inherited from Google::Apis::Requests::IDirectResponseSchema
string	ETag

Detailed Description

A Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) applications on YARN.

Property Documentation

◆ ArchiveUris

virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkRJob.ArchiveUris

getset

Optional. HCFS URIs of archives to be extracted in the working directory of Spark drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

◆ Args

virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkRJob.Args

getset

Optional. The arguments to pass to the driver. Do not include arguments, such as –conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.

◆ ETag

virtual string Google.Apis.Dataproc.v1.Data.SparkRJob.ETag

getset

The ETag of the item.

◆ FileUris

virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkRJob.FileUris

getset

Optional. HCFS URIs of files to be copied to the working directory of R drivers and distributed tasks. Useful for naively parallel tasks.

◆ LoggingConfig

virtual LoggingConfig Google.Apis.Dataproc.v1.Data.SparkRJob.LoggingConfig

getset

Optional. The runtime log config for job execution.

◆ MainRFileUri

virtual string Google.Apis.Dataproc.v1.Data.SparkRJob.MainRFileUri

getset

Required. The HCFS URI of the main R file to use as the driver. Must be a .R file.

◆ Properties

virtual System.Collections.Generic.IDictionary<string,string> Google.Apis.Dataproc.v1.Data.SparkRJob.Properties

getset

Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark- defaults.conf and classes in user code.

The documentation for this class was generated from the following file:

Google.Apis.Dataproc.v1.cs