A Dataproc job for running Apache Spark (http://spark.apache.org/) applications on YARN.
More...
|
virtual System.Collections.Generic.IList< string > | ArchiveUris [get, set] |
| Optional. HCFS URIs of archives to be extracted in the working directory of Spark drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip. More...
|
|
virtual System.Collections.Generic.IList< string > | Args [get, set] |
| Optional. The arguments to pass to the driver. Do not include arguments, such as –conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission. More...
|
|
virtual System.Collections.Generic.IList< string > | FileUris [get, set] |
| Optional. HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks. Useful for naively parallel tasks. More...
|
|
virtual System.Collections.Generic.IList< string > | JarFileUris [get, set] |
| Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks. More...
|
|
virtual LoggingConfig | LoggingConfig [get, set] |
| Optional. The runtime log config for job execution. More...
|
|
virtual string | MainClass [get, set] |
| The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. More...
|
|
virtual string | MainJarFileUri [get, set] |
| The HCFS URI of the jar file that contains the main class. More...
|
|
virtual System.Collections.Generic.IDictionary< string, string > | Properties [get, set] |
| Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark- defaults.conf and classes in user code. More...
|
|
virtual string | ETag [get, set] |
| The ETag of the item. More...
|
|
string | ETag |
|
A Dataproc job for running Apache Spark (http://spark.apache.org/) applications on YARN.
◆ ArchiveUris
virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkJob.ArchiveUris |
|
getset |
Optional. HCFS URIs of archives to be extracted in the working directory of Spark drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
◆ Args
virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkJob.Args |
|
getset |
Optional. The arguments to pass to the driver. Do not include arguments, such as –conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
◆ ETag
virtual string Google.Apis.Dataproc.v1.Data.SparkJob.ETag |
|
getset |
◆ FileUris
virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkJob.FileUris |
|
getset |
Optional. HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks. Useful for naively parallel tasks.
◆ JarFileUris
virtual System.Collections.Generic.IList<string> Google.Apis.Dataproc.v1.Data.SparkJob.JarFileUris |
|
getset |
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
◆ LoggingConfig
virtual LoggingConfig Google.Apis.Dataproc.v1.Data.SparkJob.LoggingConfig |
|
getset |
Optional. The runtime log config for job execution.
◆ MainClass
virtual string Google.Apis.Dataproc.v1.Data.SparkJob.MainClass |
|
getset |
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
◆ MainJarFileUri
virtual string Google.Apis.Dataproc.v1.Data.SparkJob.MainJarFileUri |
|
getset |
The HCFS URI of the jar file that contains the main class.
◆ Properties
virtual System.Collections.Generic.IDictionary<string,string> Google.Apis.Dataproc.v1.Data.SparkJob.Properties |
|
getset |
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark- defaults.conf and classes in user code.
The documentation for this class was generated from the following file:
- Google.Apis.Dataproc.v1.cs