flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yosi Botzer <yosi.bot...@gmail.com>
Subject writing avro files to hdfs
Date Thu, 08 Oct 2015 21:59:13 GMT
Hi,

I have kafka service with different topics. The events sent to kafka are in
avro format.

I s there a way with flume to read events from kafka and writing them to
specific folder in HDFS according to timestamp field which exists in the
events?

According to this documentation:
https://flume.apache.org/FlumeUserGuide.html#hdfs-sink

It is only possible to create text or sequence files

Yosi

Mime
View raw message