com.google.api.services.dataproc.model

Class SparkSqlJob

java.lang.Object

java.util.AbstractMap<java.lang.String,java.lang.Object>

com.google.api.client.util.GenericData

com.google.api.client.json.GenericJson

com.google.api.services.dataproc.model.SparkSqlJob

All Implemented Interfaces:

java.lang.Cloneable, java.util.Map<java.lang.String,java.lang.Object>

public final class SparkSqlJob
extends com.google.api.client.json.GenericJson

A Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

This is the Java data model class that specifies how to parse/serialize into the JSON that is transmitted over HTTP when working with the Cloud Dataproc API. For a detailed explanation see: https://developers.google.com/api-client-library/java/google-http-java-client/json

Author:

Google, Inc.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.api.client.util.GenericData

com.google.api.client.util.GenericData.Flags

Nested classes/interfaces inherited from class java.util.AbstractMap

java.util.AbstractMap.SimpleEntry<K,V>, java.util.AbstractMap.SimpleImmutableEntry<K,V>

Nested classes/interfaces inherited from interface java.util.Map

java.util.Map.Entry<K,V>

Constructor Summary

Constructors

Constructor and Description
SparkSqlJob()

Method Summary

Modifier and Type	Method and Description
SparkSqlJob	clone()
java.util.List<java.lang.String>	getJarFileUris() Optional.
LoggingConfig	getLoggingConfig() Optional.
java.util.Map<java.lang.String,java.lang.String>	getProperties() Optional.
java.lang.String	getQueryFileUri() The HCFS URI of the script that contains SQL queries.
QueryList	getQueryList() A list of queries.
java.util.Map<java.lang.String,java.lang.String>	getScriptVariables() Optional.
SparkSqlJob	set(java.lang.String fieldName, java.lang.Object value)
SparkSqlJob	setJarFileUris(java.util.List<java.lang.String> jarFileUris) Optional.
SparkSqlJob	setLoggingConfig(LoggingConfig loggingConfig) Optional.
SparkSqlJob	setProperties(java.util.Map<java.lang.String,java.lang.String> properties) Optional.
SparkSqlJob	setQueryFileUri(java.lang.String queryFileUri) The HCFS URI of the script that contains SQL queries.
SparkSqlJob	setQueryList(QueryList queryList) A list of queries.
SparkSqlJob	setScriptVariables(java.util.Map<java.lang.String,java.lang.String> scriptVariables) Optional.

Methods inherited from class com.google.api.client.json.GenericJson

getFactory, setFactory, toPrettyString, toString

Methods inherited from class com.google.api.client.util.GenericData

entrySet, get, getClassInfo, getUnknownKeys, put, putAll, remove, setUnknownKeys

Methods inherited from class java.util.AbstractMap

clear, containsKey, containsValue, equals, hashCode, isEmpty, keySet, size, values

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Map

compute, computeIfAbsent, computeIfPresent, forEach, getOrDefault, merge, putIfAbsent, remove, replace, replace, replaceAll

Constructor Detail

SparkSqlJob

public SparkSqlJob()

Method Detail

getJarFileUris

public java.util.List<java.lang.String> getJarFileUris()

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Returns:

value or null for none

setJarFileUris

public SparkSqlJob setJarFileUris(java.util.List<java.lang.String> jarFileUris)

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Parameters:

jarFileUris - jarFileUris or null for none

getLoggingConfig

public LoggingConfig getLoggingConfig()

Optional. The runtime log config for job execution.

Returns:

value or null for none

setLoggingConfig

public SparkSqlJob setLoggingConfig(LoggingConfig loggingConfig)

Optional. The runtime log config for job execution.

Parameters:

loggingConfig - loggingConfig or null for none

getProperties

public java.util.Map<java.lang.String,java.lang.String> getProperties()

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Returns:

value or null for none

setProperties

public SparkSqlJob setProperties(java.util.Map<java.lang.String,java.lang.String> properties)

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Parameters:

properties - properties or null for none

getQueryFileUri

public java.lang.String getQueryFileUri()

The HCFS URI of the script that contains SQL queries.

Returns:

value or null for none

setQueryFileUri

public SparkSqlJob setQueryFileUri(java.lang.String queryFileUri)

The HCFS URI of the script that contains SQL queries.

Parameters:

queryFileUri - queryFileUri or null for none

getQueryList

public QueryList getQueryList()

A list of queries.

Returns:

value or null for none

setQueryList

public SparkSqlJob setQueryList(QueryList queryList)

A list of queries.

Parameters:

queryList - queryList or null for none

getScriptVariables

public java.util.Map<java.lang.String,java.lang.String> getScriptVariables()

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Returns:

value or null for none

setScriptVariables

public SparkSqlJob setScriptVariables(java.util.Map<java.lang.String,java.lang.String> scriptVariables)

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Parameters:

scriptVariables - scriptVariables or null for none

set

public SparkSqlJob set(java.lang.String fieldName,
                       java.lang.Object value)

Overrides:

set in class com.google.api.client.json.GenericJson

clone

public SparkSqlJob clone()

Overrides:

clone in class com.google.api.client.json.GenericJson