Class SparkJobProperties
java.lang.Object
com.azure.analytics.synapse.artifacts.models.SparkJobProperties
The properties of the Spark job.
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionGet the additionalProperties property: The properties of the Spark job.Get the archives property: Archives to be used in this job.getArgs()
Get the args property: Command line arguments for the application.Get the className property: Main class for Java/Scala application.getConf()
Get the conf property: Spark configuration properties.int
Get the driverCores property: Number of cores to use for the driver.Get the driverMemory property: Amount of memory to use for the driver process.int
Get the executorCores property: Number of cores to use for each executor.Get the executorMemory property: Amount of memory to use per executor process.getFile()
Get the file property: File containing the application to execute.getFiles()
Get the files property: files to be used in this job.getJars()
Get the jars property: Jars to be used in this job.getName()
Get the name property: The name of the job.int
Get the numExecutors property: Number of executors to launch for this job.setAdditionalProperties
(Map<String, Object> additionalProperties) Set the additionalProperties property: The properties of the Spark job.setArchives
(List<String> archives) Set the archives property: Archives to be used in this job.Set the args property: Command line arguments for the application.setClassName
(String className) Set the className property: Main class for Java/Scala application.Set the conf property: Spark configuration properties.setDriverCores
(int driverCores) Set the driverCores property: Number of cores to use for the driver.setDriverMemory
(String driverMemory) Set the driverMemory property: Amount of memory to use for the driver process.setExecutorCores
(int executorCores) Set the executorCores property: Number of cores to use for each executor.setExecutorMemory
(String executorMemory) Set the executorMemory property: Amount of memory to use per executor process.Set the file property: File containing the application to execute.Set the files property: files to be used in this job.Set the jars property: Jars to be used in this job.Set the name property: The name of the job.setNumExecutors
(int numExecutors) Set the numExecutors property: Number of executors to launch for this job.
-
Constructor Details
-
SparkJobProperties
public SparkJobProperties()
-
-
Method Details
-
getName
Get the name property: The name of the job.- Returns:
- the name value.
-
setName
Set the name property: The name of the job.- Parameters:
name
- the name value to set.- Returns:
- the SparkJobProperties object itself.
-
getFile
Get the file property: File containing the application to execute.- Returns:
- the file value.
-
setFile
Set the file property: File containing the application to execute.- Parameters:
file
- the file value to set.- Returns:
- the SparkJobProperties object itself.
-
getClassName
Get the className property: Main class for Java/Scala application.- Returns:
- the className value.
-
setClassName
Set the className property: Main class for Java/Scala application.- Parameters:
className
- the className value to set.- Returns:
- the SparkJobProperties object itself.
-
getConf
Get the conf property: Spark configuration properties.- Returns:
- the conf value.
-
setConf
Set the conf property: Spark configuration properties.- Parameters:
conf
- the conf value to set.- Returns:
- the SparkJobProperties object itself.
-
getArgs
Get the args property: Command line arguments for the application.- Returns:
- the args value.
-
setArgs
Set the args property: Command line arguments for the application.- Parameters:
args
- the args value to set.- Returns:
- the SparkJobProperties object itself.
-
getJars
Get the jars property: Jars to be used in this job.- Returns:
- the jars value.
-
setJars
Set the jars property: Jars to be used in this job.- Parameters:
jars
- the jars value to set.- Returns:
- the SparkJobProperties object itself.
-
getFiles
Get the files property: files to be used in this job.- Returns:
- the files value.
-
setFiles
Set the files property: files to be used in this job.- Parameters:
files
- the files value to set.- Returns:
- the SparkJobProperties object itself.
-
getArchives
Get the archives property: Archives to be used in this job.- Returns:
- the archives value.
-
setArchives
Set the archives property: Archives to be used in this job.- Parameters:
archives
- the archives value to set.- Returns:
- the SparkJobProperties object itself.
-
getDriverMemory
Get the driverMemory property: Amount of memory to use for the driver process.- Returns:
- the driverMemory value.
-
setDriverMemory
Set the driverMemory property: Amount of memory to use for the driver process.- Parameters:
driverMemory
- the driverMemory value to set.- Returns:
- the SparkJobProperties object itself.
-
getDriverCores
public int getDriverCores()Get the driverCores property: Number of cores to use for the driver.- Returns:
- the driverCores value.
-
setDriverCores
Set the driverCores property: Number of cores to use for the driver.- Parameters:
driverCores
- the driverCores value to set.- Returns:
- the SparkJobProperties object itself.
-
getExecutorMemory
Get the executorMemory property: Amount of memory to use per executor process.- Returns:
- the executorMemory value.
-
setExecutorMemory
Set the executorMemory property: Amount of memory to use per executor process.- Parameters:
executorMemory
- the executorMemory value to set.- Returns:
- the SparkJobProperties object itself.
-
getExecutorCores
public int getExecutorCores()Get the executorCores property: Number of cores to use for each executor.- Returns:
- the executorCores value.
-
setExecutorCores
Set the executorCores property: Number of cores to use for each executor.- Parameters:
executorCores
- the executorCores value to set.- Returns:
- the SparkJobProperties object itself.
-
getNumExecutors
public int getNumExecutors()Get the numExecutors property: Number of executors to launch for this job.- Returns:
- the numExecutors value.
-
setNumExecutors
Set the numExecutors property: Number of executors to launch for this job.- Parameters:
numExecutors
- the numExecutors value to set.- Returns:
- the SparkJobProperties object itself.
-
getAdditionalProperties
Get the additionalProperties property: The properties of the Spark job.- Returns:
- the additionalProperties value.
-
setAdditionalProperties
Set the additionalProperties property: The properties of the Spark job.- Parameters:
additionalProperties
- the additionalProperties value to set.- Returns:
- the SparkJobProperties object itself.
-