Package version:

Interface SparkJobProperties

The properties of the Spark job.

Hierarchy

  • SparkJobProperties

Indexable

[property: string]: any

Properties

archives? args? className? conf? driverCores driverMemory executorCores executorMemory file files? jars? name? numExecutors

Properties

Optional archives

archives?: string[]

Archives to be used in this job.

Optional args

args?: string[]

Command line arguments for the application.

Optional className

className?: string

Main class for Java/Scala application.

Optional conf

conf?: any

Spark configuration properties.

driverCores

driverCores: number

Number of cores to use for the driver.

driverMemory

driverMemory: string

Amount of memory to use for the driver process.

executorCores

executorCores: number

Number of cores to use for each executor.

executorMemory

executorMemory: string

Amount of memory to use per executor process.

file

file: string

File containing the application to execute.

Optional files

files?: string[]

files to be used in this job.

Optional jars

jars?: string[]

Jars to be used in this job.

Optional name

name?: string

The name of the job.

numExecutors

numExecutors: number

Number of executors to launch for this job.

Settings

Member Visibility

Theme

Generated using TypeDoc