Class SynapseSparkJobActivityTypeProperties
java.lang.Object
com.azure.resourcemanager.datafactory.fluent.models.SynapseSparkJobActivityTypeProperties
Execute spark job activity properties.
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionGet the arguments property: User specified arguments to SynapseSparkJobDefinitionActivity.Get the className property: The fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide.conf()
Get the conf property: Spark configuration properties, which will override the 'conf' of the spark job definition you provide.Get the driverSize property: Number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide.Get the executorSize property: Number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide.file()
Get the file property: The main file used for the job, which will override the 'file' of the spark job definition you provide.files()
Get the files property: Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.Get the numExecutors property: Number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide.sparkJob()
Get the sparkJob property: Synapse spark job reference.Get the targetBigDataPool property: The name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.void
validate()
Validates the instance.withArguments
(List<Object> arguments) Set the arguments property: User specified arguments to SynapseSparkJobDefinitionActivity.withClassName
(Object className) Set the className property: The fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide.Set the conf property: Spark configuration properties, which will override the 'conf' of the spark job definition you provide.withDriverSize
(Object driverSize) Set the driverSize property: Number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide.withExecutorSize
(Object executorSize) Set the executorSize property: Number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide.Set the file property: The main file used for the job, which will override the 'file' of the spark job definition you provide.Set the files property: Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.withNumExecutors
(Integer numExecutors) Set the numExecutors property: Number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide.withSparkJob
(SynapseSparkJobReference sparkJob) Set the sparkJob property: Synapse spark job reference.withTargetBigDataPool
(BigDataPoolParametrizationReference targetBigDataPool) Set the targetBigDataPool property: The name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.
-
Constructor Details
-
SynapseSparkJobActivityTypeProperties
public SynapseSparkJobActivityTypeProperties()
-
-
Method Details
-
sparkJob
Get the sparkJob property: Synapse spark job reference.- Returns:
- the sparkJob value.
-
withSparkJob
Set the sparkJob property: Synapse spark job reference.- Parameters:
sparkJob
- the sparkJob value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
arguments
Get the arguments property: User specified arguments to SynapseSparkJobDefinitionActivity.- Returns:
- the arguments value.
-
withArguments
Set the arguments property: User specified arguments to SynapseSparkJobDefinitionActivity.- Parameters:
arguments
- the arguments value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
file
Get the file property: The main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string).- Returns:
- the file value.
-
withFile
Set the file property: The main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string).- Parameters:
file
- the file value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
className
Get the className property: The fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string).- Returns:
- the className value.
-
withClassName
Set the className property: The fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string).- Parameters:
className
- the className value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
files
Get the files property: Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.- Returns:
- the files value.
-
withFiles
Set the files property: Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.- Parameters:
files
- the files value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
targetBigDataPool
Get the targetBigDataPool property: The name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.- Returns:
- the targetBigDataPool value.
-
withTargetBigDataPool
public SynapseSparkJobActivityTypeProperties withTargetBigDataPool(BigDataPoolParametrizationReference targetBigDataPool) Set the targetBigDataPool property: The name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.- Parameters:
targetBigDataPool
- the targetBigDataPool value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
executorSize
Get the executorSize property: Number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).- Returns:
- the executorSize value.
-
withExecutorSize
Set the executorSize property: Number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).- Parameters:
executorSize
- the executorSize value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
conf
Get the conf property: Spark configuration properties, which will override the 'conf' of the spark job definition you provide.- Returns:
- the conf value.
-
withConf
Set the conf property: Spark configuration properties, which will override the 'conf' of the spark job definition you provide.- Parameters:
conf
- the conf value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
driverSize
Get the driverSize property: Number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).- Returns:
- the driverSize value.
-
withDriverSize
Set the driverSize property: Number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).- Parameters:
driverSize
- the driverSize value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
numExecutors
Get the numExecutors property: Number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide.- Returns:
- the numExecutors value.
-
withNumExecutors
Set the numExecutors property: Number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide.- Parameters:
numExecutors
- the numExecutors value to set.- Returns:
- the SynapseSparkJobActivityTypeProperties object itself.
-
validate
public void validate()Validates the instance.- Throws:
IllegalArgumentException
- thrown if the instance is not valid.
-