Package version:
Optional argumentsUser specified arguments to SynapseSparkJobDefinitionActivity.
Optional classThe fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string).
Optional confSpark configuration properties, which will override the 'conf' of the spark job definition you provide.
Optional configurationThe type of the spark config.
Optional dependsActivity depends on condition.
Optional descriptionActivity description.
Optional driverNumber of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).
Optional executorNumber of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).
Optional fileThe main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string).
Optional files(Deprecated. Please use pythonCodeReference and filesV2) Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.
Optional filesAdditional files used for reference in the main definition file, which will override the 'jars' and 'files' of the spark job definition you provide.
Optional linkedLinked service reference.
Activity name.
Optional numNumber of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide. Type: integer (or Expression with resultType integer).
Optional policyActivity policy.
Optional pythonAdditional python code files used for reference in the main definition file, which will override the 'pyFiles' of the spark job definition you provide.
Optional scanScanning subfolders from the root folder of the main definition file, these files will be added as reference files. The folders named 'jars', 'pyFiles', 'files' or 'archives' will be scanned, and the folders name are case sensitive. Type: boolean (or Expression with resultType boolean).
Optional sparkSpark configuration property.
Synapse spark job reference.
Optional targetThe name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.
Optional targetThe spark configuration of the spark job.
Polymorphic discriminator, which specifies the different types this object can be
Optional userActivity user properties.
Generated using TypeDoc
Execute spark job activity.