flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Meyer, Dennis" <dennis.me...@adtech.com>
Subject Using Flume agent on binary Avro file
Date Wed, 19 Oct 2011 11:22:15 GMT
Hi,

We've got some use case I couldn't find good information about:

We use AVRO binary logging format and log the data out in binary compressed AVRO format as
we want to kep the data small. Those files we'd like a Flume agent to listen and stream the
data into hadoop. The current process needs the intermediate file – so no direct to Hadoop
streaming is possible.

Is there any way to do this, would wonder if it's not supported, but can't find infos?

Thanks,
Dennis

Mime
View raw message