FILE INDEXING

This Worker indexes a File store.

Process name Task
indexer To scan a single File store that has been configured for this Worker. As a result, all files will be registered to the CLOUDFLOW system, and changes on the file share will be monitored.
Note: Many commercial SMB servers which are not based on Microsoft Windows do not support file system events. Such servers include Linux servers and NAS systems (for example Synology and QNAP). For those systems, the standard behavior still works.
FILE INDEXING has some options:
  • Asset Filter: here you can define an asset filter that will be used as a sub-string match on the full file path of each file that the indexer visits. The indexer will only add files to CLOUDFLOW that match with this filter.
    Note: The asset filter is not a regular expression. It will check if the filter is a sub-string of the complete file path. If this is the case, the file will be added.
    Examples
    • If you specify .pdf as filter, only complete file paths that contain .pdf in their names will be added. These are typically all the files with extension pdf.
    • If you have a the following file structure:

      If you specify Final_Files as a filter, the indexer will only add the files in the Final_Files subfolders to CLOUDFLOW and skip the files in the Fonts and Resources directories.

  • Regex: if you select this checkbox, you can use a regular expression for defining the asset filter.
    Note: You can use https://regex101.com as an online regex tester.
  • Delay per File: here you can define the time that the scanning pauses after every 100 folders, before starting the scanning of the next folder.
  • Optimize for file system events: if you select this checkbox, the scanning is temporary interrupted in case an asset is added or edited. In this case, the asset is added or edited first, after which the scan continues.
    Note: This option only works for Windows.
  • Minimum pass time: here you can define the time interval between the start of the consecutive scans.