flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upender Nimbekar <nimbekar.upen...@gmail.com>
Subject Data Directory as Source and HDFS Sink
Date Thu, 17 Sep 2015 20:58:50 GMT
I have a use case where I have a directory mounted on my linux instance
where I am getting all twitter messages in the form oz zip file. I am
planning to use Flume to read these growing no, of files, use interceptor
to unizip / filter / enrich data before sending it over to kafka brokers.
Is there any flume source to read from a directory like in my case ?


View raw message