Am currently using flume 1.7.0 .
Configured spooling directory source and writing files in to HDFS sink. The source directory contains csv files which need to be written to HDFS, these csv files are also read by other applications.
Is there a way I can avoid adding a fileSuffix to these csv files once read by Flume?
Once completely ingested, these csv files are being renamed with .COMPLETED fileSuffix and making it unreadable for the other applications.
Any workarounds for this?