Class SparkJobProperties


  • public final class SparkJobProperties
    extends Object
    The properties of the Spark job.
    • Constructor Detail

      • SparkJobProperties

        public SparkJobProperties()
    • Method Detail

      • getName

        public String getName()
        Get the name property: The name of the job.
        Returns:
        the name value.
      • setName

        public SparkJobProperties setName​(String name)
        Set the name property: The name of the job.
        Parameters:
        name - the name value to set.
        Returns:
        the SparkJobProperties object itself.
      • getFile

        public String getFile()
        Get the file property: File containing the application to execute.
        Returns:
        the file value.
      • setFile

        public SparkJobProperties setFile​(String file)
        Set the file property: File containing the application to execute.
        Parameters:
        file - the file value to set.
        Returns:
        the SparkJobProperties object itself.
      • getClassName

        public String getClassName()
        Get the className property: Main class for Java/Scala application.
        Returns:
        the className value.
      • setClassName

        public SparkJobProperties setClassName​(String className)
        Set the className property: Main class for Java/Scala application.
        Parameters:
        className - the className value to set.
        Returns:
        the SparkJobProperties object itself.
      • getConf

        public Object getConf()
        Get the conf property: Spark configuration properties.
        Returns:
        the conf value.
      • setConf

        public SparkJobProperties setConf​(Object conf)
        Set the conf property: Spark configuration properties.
        Parameters:
        conf - the conf value to set.
        Returns:
        the SparkJobProperties object itself.
      • getArgs

        public List<String> getArgs()
        Get the args property: Command line arguments for the application.
        Returns:
        the args value.
      • setArgs

        public SparkJobProperties setArgs​(List<String> args)
        Set the args property: Command line arguments for the application.
        Parameters:
        args - the args value to set.
        Returns:
        the SparkJobProperties object itself.
      • getJars

        public List<String> getJars()
        Get the jars property: Jars to be used in this job.
        Returns:
        the jars value.
      • setJars

        public SparkJobProperties setJars​(List<String> jars)
        Set the jars property: Jars to be used in this job.
        Parameters:
        jars - the jars value to set.
        Returns:
        the SparkJobProperties object itself.
      • getFiles

        public List<String> getFiles()
        Get the files property: files to be used in this job.
        Returns:
        the files value.
      • setFiles

        public SparkJobProperties setFiles​(List<String> files)
        Set the files property: files to be used in this job.
        Parameters:
        files - the files value to set.
        Returns:
        the SparkJobProperties object itself.
      • getArchives

        public List<String> getArchives()
        Get the archives property: Archives to be used in this job.
        Returns:
        the archives value.
      • setArchives

        public SparkJobProperties setArchives​(List<String> archives)
        Set the archives property: Archives to be used in this job.
        Parameters:
        archives - the archives value to set.
        Returns:
        the SparkJobProperties object itself.
      • getDriverMemory

        public String getDriverMemory()
        Get the driverMemory property: Amount of memory to use for the driver process.
        Returns:
        the driverMemory value.
      • setDriverMemory

        public SparkJobProperties setDriverMemory​(String driverMemory)
        Set the driverMemory property: Amount of memory to use for the driver process.
        Parameters:
        driverMemory - the driverMemory value to set.
        Returns:
        the SparkJobProperties object itself.
      • getDriverCores

        public int getDriverCores()
        Get the driverCores property: Number of cores to use for the driver.
        Returns:
        the driverCores value.
      • setDriverCores

        public SparkJobProperties setDriverCores​(int driverCores)
        Set the driverCores property: Number of cores to use for the driver.
        Parameters:
        driverCores - the driverCores value to set.
        Returns:
        the SparkJobProperties object itself.
      • getExecutorMemory

        public String getExecutorMemory()
        Get the executorMemory property: Amount of memory to use per executor process.
        Returns:
        the executorMemory value.
      • setExecutorMemory

        public SparkJobProperties setExecutorMemory​(String executorMemory)
        Set the executorMemory property: Amount of memory to use per executor process.
        Parameters:
        executorMemory - the executorMemory value to set.
        Returns:
        the SparkJobProperties object itself.
      • getExecutorCores

        public int getExecutorCores()
        Get the executorCores property: Number of cores to use for each executor.
        Returns:
        the executorCores value.
      • setExecutorCores

        public SparkJobProperties setExecutorCores​(int executorCores)
        Set the executorCores property: Number of cores to use for each executor.
        Parameters:
        executorCores - the executorCores value to set.
        Returns:
        the SparkJobProperties object itself.
      • getNumExecutors

        public int getNumExecutors()
        Get the numExecutors property: Number of executors to launch for this job.
        Returns:
        the numExecutors value.
      • setNumExecutors

        public SparkJobProperties setNumExecutors​(int numExecutors)
        Set the numExecutors property: Number of executors to launch for this job.
        Parameters:
        numExecutors - the numExecutors value to set.
        Returns:
        the SparkJobProperties object itself.
      • getAdditionalProperties

        public Map<String,​Object> getAdditionalProperties()
        Get the additionalProperties property: The properties of the Spark job.
        Returns:
        the additionalProperties value.
      • setAdditionalProperties

        public SparkJobProperties setAdditionalProperties​(Map<String,​Object> additionalProperties)
        Set the additionalProperties property: The properties of the Spark job.
        Parameters:
        additionalProperties - the additionalProperties value to set.
        Returns:
        the SparkJobProperties object itself.