MoveAzureDataLakeStorage

MoveAzureDataLakeStorage 2.5.0

Bundle: org.apache.nifi | nifi-azure-nar
Description: Moves content within an Azure Data Lake Storage Gen 2. After the move, files will be no longer available on source location.
Tags: adlsgen2, azure, cloud, datalake, microsoft, storage
Input Requirement: REQUIRED
Supports Sensitive Dynamic Properties: false

Properties

ADLS Credentials
Controller Service used to obtain Azure Credentials.

Display Name

ADLS Credentials

Description

Controller Service used to obtain Azure Credentials.

API Name

adls-credentials-service

Service Interface

org.apache.nifi.services.azure.storage.ADLSCredentialsService

Service Implementations

org.apache.nifi.services.azure.storage.ADLSCredentialsControllerService

org.apache.nifi.services.azure.storage.ADLSCredentialsControllerServiceLookup

Expression Language Scope

Not Supported

Sensitive

false

Required

true
Conflict Resolution Strategy
Indicates what should happen when a file with the same name already exists in the output directory
Display Name

Conflict Resolution Strategy

Description

Indicates what should happen when a file with the same name already exists in the output directory

API Name

conflict-resolution-strategy

Default Value

fail

Allowable Values
- fail
- replace
- ignore
Expression Language Scope

Not Supported

Sensitive

false

Required

true
Destination Directory
Name of the Azure Storage Directory where the files will be moved. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. Non-existing directories will be created. If the original directory structure should be kept, the full directory path needs to be provided after the destination directory. e.g.: destdir/${azure.directory}

Display Name

Destination Directory

Description

Name of the Azure Storage Directory where the files will be moved. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. Non-existing directories will be created. If the original directory structure should be kept, the full directory path needs to be provided after the destination directory. e.g.: destdir/${azure.directory}

API Name

directory-name

Expression Language Scope

Environment variables and FlowFile Attributes

Sensitive

false

Required

true
File Name
The filename

Display Name

File Name

Description

The filename

API Name

file-name

Default Value

${azure.filename}

Expression Language Scope

Environment variables and FlowFile Attributes

Sensitive

false

Required

true
Destination Filesystem
Name of the Azure Storage File System where the files will be moved.

Display Name

Destination Filesystem

Description

Name of the Azure Storage File System where the files will be moved.

API Name

filesystem-name

Expression Language Scope

Environment variables and FlowFile Attributes

Sensitive

false

Required

true
Proxy Configuration Service
Specifies the Proxy Configuration Controller Service to proxy network requests. In case of SOCKS, it is not guaranteed that the selected SOCKS Version will be used by the processor.

Display Name

Proxy Configuration Service

Description

Specifies the Proxy Configuration Controller Service to proxy network requests. In case of SOCKS, it is not guaranteed that the selected SOCKS Version will be used by the processor.

API Name

proxy-configuration-service

Service Interface

org.apache.nifi.proxy.ProxyConfigurationService

Service Implementations

org.apache.nifi.proxy.StandardProxyConfigurationService

Expression Language Scope

Not Supported

Sensitive

false

Required

false
Source Directory
Name of the Azure Storage Directory from where the move should happen. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value.

Display Name

Source Directory

Description

Name of the Azure Storage Directory from where the move should happen. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value.

API Name

source-directory-name

Default Value

${azure.directory}

Expression Language Scope

Environment variables and FlowFile Attributes

Sensitive

false

Required

true
Source Filesystem
Name of the Azure Storage File System from where the move should happen.

Display Name

Source Filesystem

Description

Name of the Azure Storage File System from where the move should happen.

API Name

source-filesystem-name

Default Value

${azure.filesystem}

Expression Language Scope

Environment variables and FlowFile Attributes

Sensitive

false

Required

true

Relationships

Name	Description
failure	Files that could not be written to Azure storage for some reason are transferred to this relationship
success	Files that have been successfully written to Azure storage are transferred to this relationship

Writes Attributes

Name	Description
azure.source.filesystem	The name of the source Azure File System
azure.source.directory	The name of the source Azure Directory
azure.filesystem	The name of the Azure File System
azure.directory	The name of the Azure Directory
azure.filename	The name of the Azure File
azure.primaryUri	Primary location for file content
azure.length	The length of the Azure File