Get vs List+Fetch and using a Record Writer

The Get versus List/Fetch pattern is a very frequent topic in NiFi and it is key to understand what are the differences and how to properly use the List/Fetch pattern. Besides, it's now possible to configure a Record writer on the ListX processors which provides better performances and a better management of the memory when listing large number of files.

This video focuses on GetFile versus ListFile and FetchFile processors but would also apply to processors for AWS S3, Azure ADLS, Azure Blob Storage, Google Cloud Storage, SFTP, etc.

[oyeyemirafiuowolabi]

Thank you very much for this video. It shows more insight on how to fetch files correctly.

[perianka]

if i have to export a template, can i use my directory as the files for the list file?