Options
All
  • Public
  • Public/Protected
  • All
Menu

Interface SparkJobProperties

Package version

The properties of the Spark job.

Hierarchy

  • SparkJobProperties

Indexable

[property: string]: any

Describes unknown properties. The value of an unknown property can be of "any" type.

Index

Properties

Optional archives

archives: string[]

Archives to be used in this job.

Optional args

args: string[]

Command line arguments for the application.

Optional className

className: undefined | string

Main class for Java/Scala application.

Optional conf

conf: any

Spark configuration properties.

driverCores

driverCores: number

Number of cores to use for the driver.

driverMemory

driverMemory: string

Amount of memory to use for the driver process.

executorCores

executorCores: number

Number of cores to use for each executor.

executorMemory

executorMemory: string

Amount of memory to use per executor process.

file

file: string

File containing the application to execute.

Optional files

files: string[]

files to be used in this job.

Optional jars

jars: string[]

Jars to be used in this job.

Optional name

name: undefined | string

The name of the job.

numExecutors

numExecutors: number

Number of executors to launch for this job.

Generated using TypeDoc