Class AzureBlobStorageReadSettings


  • public final class AzureBlobStorageReadSettings
    extends StoreReadSettings
    Azure blob read settings.
    • Constructor Detail

      • AzureBlobStorageReadSettings

        public AzureBlobStorageReadSettings()
    • Method Detail

      • recursive

        public Object recursive()
        Get the recursive property: If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean).
        Returns:
        the recursive value.
      • withRecursive

        public AzureBlobStorageReadSettings withRecursive​(Object recursive)
        Set the recursive property: If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean).
        Parameters:
        recursive - the recursive value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • wildcardFolderPath

        public Object wildcardFolderPath()
        Get the wildcardFolderPath property: Azure blob wildcardFolderPath. Type: string (or Expression with resultType string).
        Returns:
        the wildcardFolderPath value.
      • withWildcardFolderPath

        public AzureBlobStorageReadSettings withWildcardFolderPath​(Object wildcardFolderPath)
        Set the wildcardFolderPath property: Azure blob wildcardFolderPath. Type: string (or Expression with resultType string).
        Parameters:
        wildcardFolderPath - the wildcardFolderPath value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • wildcardFileName

        public Object wildcardFileName()
        Get the wildcardFileName property: Azure blob wildcardFileName. Type: string (or Expression with resultType string).
        Returns:
        the wildcardFileName value.
      • withWildcardFileName

        public AzureBlobStorageReadSettings withWildcardFileName​(Object wildcardFileName)
        Set the wildcardFileName property: Azure blob wildcardFileName. Type: string (or Expression with resultType string).
        Parameters:
        wildcardFileName - the wildcardFileName value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • prefix

        public Object prefix()
        Get the prefix property: The prefix filter for the Azure Blob name. Type: string (or Expression with resultType string).
        Returns:
        the prefix value.
      • withPrefix

        public AzureBlobStorageReadSettings withPrefix​(Object prefix)
        Set the prefix property: The prefix filter for the Azure Blob name. Type: string (or Expression with resultType string).
        Parameters:
        prefix - the prefix value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • fileListPath

        public Object fileListPath()
        Get the fileListPath property: Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string).
        Returns:
        the fileListPath value.
      • withFileListPath

        public AzureBlobStorageReadSettings withFileListPath​(Object fileListPath)
        Set the fileListPath property: Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string).
        Parameters:
        fileListPath - the fileListPath value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • enablePartitionDiscovery

        public Boolean enablePartitionDiscovery()
        Get the enablePartitionDiscovery property: Indicates whether to enable partition discovery.
        Returns:
        the enablePartitionDiscovery value.
      • withEnablePartitionDiscovery

        public AzureBlobStorageReadSettings withEnablePartitionDiscovery​(Boolean enablePartitionDiscovery)
        Set the enablePartitionDiscovery property: Indicates whether to enable partition discovery.
        Parameters:
        enablePartitionDiscovery - the enablePartitionDiscovery value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • partitionRootPath

        public Object partitionRootPath()
        Get the partitionRootPath property: Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string).
        Returns:
        the partitionRootPath value.
      • withPartitionRootPath

        public AzureBlobStorageReadSettings withPartitionRootPath​(Object partitionRootPath)
        Set the partitionRootPath property: Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string).
        Parameters:
        partitionRootPath - the partitionRootPath value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • deleteFilesAfterCompletion

        public Object deleteFilesAfterCompletion()
        Get the deleteFilesAfterCompletion property: Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean).
        Returns:
        the deleteFilesAfterCompletion value.
      • withDeleteFilesAfterCompletion

        public AzureBlobStorageReadSettings withDeleteFilesAfterCompletion​(Object deleteFilesAfterCompletion)
        Set the deleteFilesAfterCompletion property: Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean).
        Parameters:
        deleteFilesAfterCompletion - the deleteFilesAfterCompletion value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • modifiedDatetimeStart

        public Object modifiedDatetimeStart()
        Get the modifiedDatetimeStart property: The start of file's modified datetime. Type: string (or Expression with resultType string).
        Returns:
        the modifiedDatetimeStart value.
      • withModifiedDatetimeStart

        public AzureBlobStorageReadSettings withModifiedDatetimeStart​(Object modifiedDatetimeStart)
        Set the modifiedDatetimeStart property: The start of file's modified datetime. Type: string (or Expression with resultType string).
        Parameters:
        modifiedDatetimeStart - the modifiedDatetimeStart value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • modifiedDatetimeEnd

        public Object modifiedDatetimeEnd()
        Get the modifiedDatetimeEnd property: The end of file's modified datetime. Type: string (or Expression with resultType string).
        Returns:
        the modifiedDatetimeEnd value.
      • withModifiedDatetimeEnd

        public AzureBlobStorageReadSettings withModifiedDatetimeEnd​(Object modifiedDatetimeEnd)
        Set the modifiedDatetimeEnd property: The end of file's modified datetime. Type: string (or Expression with resultType string).
        Parameters:
        modifiedDatetimeEnd - the modifiedDatetimeEnd value to set.
        Returns:
        the AzureBlobStorageReadSettings object itself.
      • withMaxConcurrentConnections

        public AzureBlobStorageReadSettings withMaxConcurrentConnections​(Object maxConcurrentConnections)
        Set the maxConcurrentConnections property: The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer).
        Overrides:
        withMaxConcurrentConnections in class StoreReadSettings
        Parameters:
        maxConcurrentConnections - the maxConcurrentConnections value to set.
        Returns:
        the StoreReadSettings object itself.
      • withDisableMetricsCollection

        public AzureBlobStorageReadSettings withDisableMetricsCollection​(Object disableMetricsCollection)
        Set the disableMetricsCollection property: If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean).
        Overrides:
        withDisableMetricsCollection in class StoreReadSettings
        Parameters:
        disableMetricsCollection - the disableMetricsCollection value to set.
        Returns:
        the StoreReadSettings object itself.