-
Processors
- AttributeRollingWindow
- AttributesToCSV
- AttributesToJSON
- CalculateRecordStats
- CaptureChangeMySQL
- CompressContent
- ConnectWebSocket
- ConsumeAMQP
- ConsumeAzureEventHub
- ConsumeBoxEnterpriseEvents
- ConsumeBoxEvents
- ConsumeElasticsearch
- ConsumeGCPubSub
- ConsumeIMAP
- ConsumeJMS
- ConsumeKafka
- ConsumeKinesis
- ConsumeKinesisStream
- ConsumeMQTT
- ConsumePOP3
- ConsumeSlack
- ConsumeTwitter
- ConsumeWindowsEventLog
- ControlRate
- ConvertCharacterSet
- ConvertRecord
- CopyAzureBlobStorage_v12
- CopyS3Object
- CountText
- CreateBoxFileMetadataInstance
- CreateBoxMetadataTemplate
- CryptographicHashContent
- DebugFlow
- DecryptContentAge
- DecryptContentPGP
- DeduplicateRecord
- DeleteAzureBlobStorage_v12
- DeleteAzureDataLakeStorage
- DeleteBoxFileMetadataInstance
- DeleteByQueryElasticsearch
- DeleteDynamoDB
- DeleteFile
- DeleteGCSObject
- DeleteGridFS
- DeleteMongo
- DeleteS3Object
- DeleteSFTP
- DeleteSQS
- DetectDuplicate
- DistributeLoad
- DuplicateFlowFile
- EncodeContent
- EncryptContentAge
- EncryptContentPGP
- EnforceOrder
- EvaluateJsonPath
- EvaluateXPath
- EvaluateXQuery
- ExecuteGroovyScript
- ExecuteProcess
- ExecuteScript
- ExecuteSQL
- ExecuteSQLRecord
- ExecuteStreamCommand
- ExtractAvroMetadata
- ExtractEmailAttachments
- ExtractEmailHeaders
- ExtractGrok
- ExtractHL7Attributes
- ExtractRecordSchema
- ExtractStructuredBoxFileMetadata
- ExtractText
- FetchAzureBlobStorage_v12
- FetchAzureDataLakeStorage
- FetchBoxFile
- FetchBoxFileInfo
- FetchBoxFileMetadataInstance
- FetchBoxFileRepresentation
- FetchDistributedMapCache
- FetchDropbox
- FetchFile
- FetchFTP
- FetchGCSObject
- FetchGoogleDrive
- FetchGridFS
- FetchS3Object
- FetchSFTP
- FetchSmb
- FilterAttribute
- FlattenJson
- ForkEnrichment
- ForkRecord
- GenerateFlowFile
- GenerateRecord
- GenerateTableFetch
- GeoEnrichIP
- GeoEnrichIPRecord
- GeohashRecord
- GetAsanaObject
- GetAwsPollyJobStatus
- GetAwsTextractJobStatus
- GetAwsTranscribeJobStatus
- GetAwsTranslateJobStatus
- GetAzureEventHub
- GetAzureQueueStorage_v12
- GetBoxFileCollaborators
- GetBoxGroupMembers
- GetDynamoDB
- GetElasticsearch
- GetFile
- GetFileResource
- GetFTP
- GetGcpVisionAnnotateFilesOperationStatus
- GetGcpVisionAnnotateImagesOperationStatus
- GetHubSpot
- GetMongo
- GetMongoRecord
- GetS3ObjectMetadata
- GetS3ObjectTags
- GetSFTP
- GetShopify
- GetSmbFile
- GetSNMP
- GetSplunk
- GetSQS
- GetWorkdayReport
- GetZendesk
- HandleHttpRequest
- HandleHttpResponse
- IdentifyMimeType
- InvokeHTTP
- InvokeScriptedProcessor
- ISPEnrichIP
- JoinEnrichment
- JoltTransformJSON
- JoltTransformRecord
- JSLTTransformJSON
- JsonQueryElasticsearch
- ListAzureBlobStorage_v12
- ListAzureDataLakeStorage
- ListBoxFile
- ListBoxFileInfo
- ListBoxFileMetadataInstances
- ListBoxFileMetadataTemplates
- ListDatabaseTables
- ListDropbox
- ListenFTP
- ListenHTTP
- ListenOTLP
- ListenSlack
- ListenSyslog
- ListenTCP
- ListenTrapSNMP
- ListenUDP
- ListenUDPRecord
- ListenWebSocket
- ListFile
- ListFTP
- ListGCSBucket
- ListGoogleDrive
- ListS3
- ListSFTP
- ListSmb
- LogAttribute
- LogMessage
- LookupAttribute
- LookupRecord
- MergeContent
- MergeRecord
- ModifyBytes
- ModifyCompression
- MonitorActivity
- MoveAzureDataLakeStorage
- Notify
- PackageFlowFile
- PaginatedJsonQueryElasticsearch
- ParseEvtx
- ParseNetflowv5
- ParseSyslog
- ParseSyslog5424
- PartitionRecord
- PublishAMQP
- PublishGCPubSub
- PublishJMS
- PublishKafka
- PublishMQTT
- PublishSlack
- PutAzureBlobStorage_v12
- PutAzureCosmosDBRecord
- PutAzureDataExplorer
- PutAzureDataLakeStorage
- PutAzureEventHub
- PutAzureQueueStorage_v12
- PutBigQuery
- PutBoxFile
- PutCloudWatchMetric
- PutDatabaseRecord
- PutDistributedMapCache
- PutDropbox
- PutDynamoDB
- PutDynamoDBRecord
- PutElasticsearchJson
- PutElasticsearchRecord
- PutEmail
- PutFile
- PutFTP
- PutGCSObject
- PutGoogleDrive
- PutGridFS
- PutIcebergRecord
- PutKinesisFirehose
- PutKinesisStream
- PutLambda
- PutMongo
- PutMongoBulkOperations
- PutMongoRecord
- PutRecord
- PutRedisHashRecord
- PutS3Object
- PutSalesforceObject
- PutSFTP
- PutSmbFile
- PutSNS
- PutSplunk
- PutSplunkHTTP
- PutSQL
- PutSQS
- PutSyslog
- PutTCP
- PutUDP
- PutWebSocket
- PutZendeskTicket
- QueryAirtableTable
- QueryAzureDataExplorer
- QueryDatabaseTable
- QueryDatabaseTableRecord
- QueryRecord
- QuerySalesforceObject
- QuerySplunkIndexingStatus
- RemoveRecordField
- RenameRecordField
- ReplaceText
- ReplaceTextWithMapping
- RetryFlowFile
- RouteHL7
- RouteOnAttribute
- RouteOnContent
- RouteText
- RunMongoAggregation
- SampleRecord
- ScanAttribute
- ScanContent
- ScriptedFilterRecord
- ScriptedPartitionRecord
- ScriptedTransformRecord
- ScriptedValidateRecord
- SearchElasticsearch
- SegmentContent
- SendTrapSNMP
- SetSNMP
- SignContentPGP
- SplitAvro
- SplitContent
- SplitExcel
- SplitJson
- SplitPCAP
- SplitRecord
- SplitText
- SplitXml
- StartAwsPollyJob
- StartAwsTextractJob
- StartAwsTranscribeJob
- StartAwsTranslateJob
- StartGcpVisionAnnotateFilesOperation
- StartGcpVisionAnnotateImagesOperation
- TagS3Object
- TailFile
- TransformXml
- UnpackContent
- UpdateAttribute
- UpdateBoxFileMetadataInstance
- UpdateByQueryElasticsearch
- UpdateCounter
- UpdateDatabaseTable
- UpdateRecord
- ValidateCsv
- ValidateJson
- ValidateRecord
- ValidateXml
- VerifyContentMAC
- VerifyContentPGP
- Wait
-
Controller Services
- ADLSCredentialsControllerService
- ADLSCredentialsControllerServiceLookup
- ADLSIcebergFileIOProvider
- AmazonGlueEncodedSchemaReferenceReader
- AmazonGlueSchemaRegistry
- AmazonMSKConnectionService
- ApicurioSchemaRegistry
- AvroReader
- AvroRecordSetWriter
- AvroSchemaRegistry
- AWSCredentialsProviderControllerService
- AwsRdsIamDatabasePasswordProvider
- AzureBlobStorageFileResourceService
- AzureCosmosDBClientService
- AzureDataLakeStorageFileResourceService
- AzureEventHubRecordSink
- AzureStorageCredentialsControllerService_v12
- AzureStorageCredentialsControllerServiceLookup_v12
- CEFReader
- ConfluentEncodedSchemaReferenceReader
- ConfluentEncodedSchemaReferenceWriter
- ConfluentProtobufMessageNameResolver
- ConfluentSchemaRegistry
- CSVReader
- CSVRecordLookupService
- CSVRecordSetWriter
- DatabaseRecordLookupService
- DatabaseRecordSink
- DatabaseTableSchemaRegistry
- DBCPConnectionPool
- DBCPConnectionPoolLookup
- DeveloperBoxClientService
- DistributedMapCacheLookupService
- ElasticSearchClientServiceImpl
- ElasticSearchLookupService
- ElasticSearchStringLookupService
- EmailRecordSink
- EmbeddedHazelcastCacheManager
- ExcelReader
- ExternalHazelcastCacheManager
- FreeFormTextRecordSetWriter
- GCPCredentialsControllerService
- GCSFileResourceService
- GrokReader
- HazelcastMapCacheClient
- HikariCPConnectionPool
- HttpRecordSink
- IPLookupService
- JettyWebSocketClient
- JettyWebSocketServer
- JMSConnectionFactoryProvider
- JndiJmsConnectionFactoryProvider
- JsonConfigBasedBoxClientService
- JsonPathReader
- JsonRecordSetWriter
- JsonTreeReader
- JWTBearerOAuth2AccessTokenProvider
- Kafka3ConnectionService
- KerberosKeytabUserService
- KerberosPasswordUserService
- KerberosTicketCacheUserService
- LoggingRecordSink
- MapCacheClientService
- MapCacheServer
- MongoDBControllerService
- MongoDBLookupService
- ParquetIcebergWriter
- PEMEncodedSSLContextProvider
- PropertiesFileLookupService
- ProtobufReader
- ReaderLookup
- RecordSetWriterLookup
- RecordSinkServiceLookup
- RedisConnectionPoolService
- RedisDistributedMapCacheClientService
- RESTIcebergCatalog
- RestLookupService
- S3FileResourceService
- S3IcebergFileIOProvider
- ScriptedLookupService
- ScriptedReader
- ScriptedRecordSetWriter
- ScriptedRecordSink
- SetCacheClientService
- SetCacheServer
- SimpleCsvFileLookupService
- SimpleDatabaseLookupService
- SimpleKeyValueLookupService
- SimpleRedisDistributedMapCacheClientService
- SimpleScriptedLookupService
- SiteToSiteReportingRecordSink
- SlackRecordSink
- SmbjClientProviderService
- StandardAsanaClientProviderService
- StandardAzureCredentialsControllerService
- StandardDatabaseDialectService
- StandardDropboxCredentialService
- StandardFileResourceService
- StandardHashiCorpVaultClientService
- StandardHttpContextMap
- StandardJsonSchemaRegistry
- StandardKustoIngestService
- StandardKustoQueryService
- StandardOauth2AccessTokenProvider
- StandardPGPPrivateKeyService
- StandardPGPPublicKeyService
- StandardPrivateKeyService
- StandardProtobufReader
- StandardProxyConfigurationService
- StandardRestrictedSSLContextService
- StandardS3EncryptionService
- StandardSSLContextService
- StandardWebClientServiceProvider
- Syslog5424Reader
- SyslogReader
- UDPEventRecordSink
- VolatileSchemaCache
- WindowsEventLogReader
- XMLFileLookupService
- XMLReader
- XMLRecordSetWriter
- YamlTreeReader
- ZendeskRecordSink
AzureDevOpsFlowRegistryClient 2.7.0
- Bundle
- org.apache.nifi | nifi-azure-nar
- Description
- Flow Registry Client that uses the Azure DevOps Git REST API to version control flows in a repository.
- Tags
- azure, devops, flow, git, registry
- Input Requirement
- Supports Sensitive Dynamic Properties
- false
-
Additional Details for AzureDevOpsFlowRegistryClient 2.7.0
Azure DevOps Flow Registry Client – Service Principal Setup
This component stores NiFi versioned flows in Azure DevOps Git using the Azure DevOps Git REST API. It authenticates with Microsoft Entra service principals through OAuth 2.0 client credentials.
Entra ID (Microsoft Entra) – Service Principal
- App registrations → New registration → name (e.g.,
NiFi Git DevOps Registry Client); single-tenant is fine; no redirect URI. - Record
Directory (tenant) IDandApplication (client) ID. - Certificates & secrets → New client secret. Note the provided Value.
Azure DevOps
- Organization must use the same tenant.
- Organization Settings → Users → Add users → paste the Application (client) ID; Access Level = Basic; add to the right projects/groups (e.g., Contributors). Do not send email.
NiFi Management Controller Services
- StandardWebClientServiceProvider: default timeouts are usually fine; set proxy/SSL if needed. Enable.
- StandardOauth2AccessTokenProvider:
- Token Endpoint (replace with value “Directory (tenant) ID”):
https://login.microsoftonline.com/{tenant-id}/oauth2/v2.0/token - Grant Type:
Client Credentials - Client ID: Application (client) ID
- Client Secret: value from the created client secret
- Scope:
https://app.vssps.visualstudio.com/.default - Configure proxy/SSL if required.
- Optional: Verify to confirm a token can be obtained
- Enable
- Token Endpoint (replace with value “Directory (tenant) ID”):
NiFi Flow Registry Client
- Type:
AzureDevOpsFlowRegistryClient - Azure DevOps API URL:
https://dev.azure.com - Organization, Project, Repository Name
- Default Branch: must already exist (e.g.,
main). - Repository Path: optional subfolder; no leading or trailing
/. - Authentication Strategy:
Service Principal. - OAuth2 Access Token Provider: choose the configured
StandardOauth2AccessTokenProvider. - Web Client Service: choose the
StandardWebClientServiceProvider. - Optionally Verify to confirm read/write.
- App registrations → New registration → name (e.g.,
Properties
-
Authentication Strategy
Strategy for authenticating with Azure DevOps
- Display Name
- Authentication Strategy
- Description
- Strategy for authenticating with Azure DevOps
- API Name
- Authentication Strategy
- Default Value
- SERVICE_PRINCIPAL
- Allowable Values
-
- Service Principal
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Azure DevOps API URL
The base URL of the Azure DevOps instance
- Display Name
- Azure DevOps API URL
- Description
- The base URL of the Azure DevOps instance
- API Name
- Azure DevOps API URL
- Default Value
- https://dev.azure.com
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Default Branch
The default branch to use for this client
- Display Name
- Default Branch
- Description
- The default branch to use for this client
- API Name
- Default Branch
- Default Value
- main
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Directory Filter Exclusion
Directories whose names match the given regular expression will be ignored when listing buckets.
- Display Name
- Directory Filter Exclusion
- Description
- Directories whose names match the given regular expression will be ignored when listing buckets.
- API Name
- Directory Filter Exclusion
- Default Value
- [.].*
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
OAuth2 Access Token Provider
Controller service providing OAuth2 access tokens
- Display Name
- OAuth2 Access Token Provider
- Description
- Controller service providing OAuth2 access tokens
- API Name
- OAuth2 Access Token Provider
- Service Interface
- org.apache.nifi.oauth2.OAuth2AccessTokenProvider
- Service Implementations
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
- Dependencies
-
- Authentication Strategy is set to any of [SERVICE_PRINCIPAL]
-
Organization
The Azure DevOps organization
- Display Name
- Organization
- Description
- The Azure DevOps organization
- API Name
- Organization
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Parameter Context Values
Specifies what to do with parameter values when storing the versioned flow.
- Display Name
- Parameter Context Values
- Description
- Specifies what to do with parameter values when storing the versioned flow.
- API Name
- Parameter Context Values
- Default Value
- RETAIN
- Allowable Values
-
- Retain
- Remove
- Ignore Changes
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Project
The Azure DevOps project
- Display Name
- Project
- Description
- The Azure DevOps project
- API Name
- Project
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Repository Name
The name of the repository
- Display Name
- Repository Name
- Description
- The name of the repository
- API Name
- Repository Name
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Repository Path
The path in the repository that this client will use to store all data. If left blank, then the root of the repository will be used.
- Display Name
- Repository Path
- Description
- The path in the repository that this client will use to store all data. If left blank, then the root of the repository will be used.
- API Name
- Repository Path
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- false
-
Web Client Service
The Web Client Service to use for communicating with Bitbucket
- Display Name
- Web Client Service
- Description
- The Web Client Service to use for communicating with Bitbucket
- API Name
- Web Client Service
- Service Interface
- org.apache.nifi.web.client.provider.api.WebClientServiceProvider
- Service Implementations
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true