flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jyotsna G <jyotsn...@gmail.com>
Subject Query regarding flume spooling directory Source fileSuffix
Date Mon, 09 Apr 2018 09:45:04 GMT
Am currently using flume 1.7.0 .

Configured spooling directory source and writing files in to HDFS sink. The
source directory contains csv files which need to be written to HDFS, these
csv files are also read by other applications.

Is there a way I can avoid adding a fileSuffix to these csv files once read
by Flume?

Once completely ingested, these csv files are being renamed with .COMPLETED
fileSuffix and making it unreadable for the other applications.

Any workarounds for this?


View raw message