Class HdfsSource


  • public final class HdfsSource
    extends CopySource
    A copy activity HDFS source.
    • Constructor Detail

      • HdfsSource

        public HdfsSource()
    • Method Detail

      • recursive

        public Object recursive()
        Get the recursive property: If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean).
        Returns:
        the recursive value.
      • withRecursive

        public HdfsSource withRecursive​(Object recursive)
        Set the recursive property: If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean).
        Parameters:
        recursive - the recursive value to set.
        Returns:
        the HdfsSource object itself.
      • distcpSettings

        public DistcpSettings distcpSettings()
        Get the distcpSettings property: Specifies Distcp-related settings.
        Returns:
        the distcpSettings value.
      • withDistcpSettings

        public HdfsSource withDistcpSettings​(DistcpSettings distcpSettings)
        Set the distcpSettings property: Specifies Distcp-related settings.
        Parameters:
        distcpSettings - the distcpSettings value to set.
        Returns:
        the HdfsSource object itself.
      • withSourceRetryCount

        public HdfsSource withSourceRetryCount​(Object sourceRetryCount)
        Set the sourceRetryCount property: Source retry count. Type: integer (or Expression with resultType integer).
        Overrides:
        withSourceRetryCount in class CopySource
        Parameters:
        sourceRetryCount - the sourceRetryCount value to set.
        Returns:
        the CopySource object itself.
      • withSourceRetryWait

        public HdfsSource withSourceRetryWait​(Object sourceRetryWait)
        Set the sourceRetryWait property: Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+)\.)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])).
        Overrides:
        withSourceRetryWait in class CopySource
        Parameters:
        sourceRetryWait - the sourceRetryWait value to set.
        Returns:
        the CopySource object itself.
      • withMaxConcurrentConnections

        public HdfsSource withMaxConcurrentConnections​(Object maxConcurrentConnections)
        Set the maxConcurrentConnections property: The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer).
        Overrides:
        withMaxConcurrentConnections in class CopySource
        Parameters:
        maxConcurrentConnections - the maxConcurrentConnections value to set.
        Returns:
        the CopySource object itself.
      • withDisableMetricsCollection

        public HdfsSource withDisableMetricsCollection​(Object disableMetricsCollection)
        Set the disableMetricsCollection property: If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean).
        Overrides:
        withDisableMetricsCollection in class CopySource
        Parameters:
        disableMetricsCollection - the disableMetricsCollection value to set.
        Returns:
        the CopySource object itself.