flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: Flume and HDFS integration
Date Fri, 30 Nov 2012 01:26:37 GMT

On Thu, Nov 29, 2012 at 7:17 PM, Roman Shaposhnik <rvs@apache.org> wrote:
> On Thu, Nov 29, 2012 at 9:18 AM, Brock Noland <brock@cloudera.com> wrote:
>> 1) It's a sequence file, you can change it a text file if you want. See
>> FileType here http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
> Don't you also have to change a serialization format to get rid of the binary
> structure completely? IOW, you'd have to add something like:
>     agent.sinks.hdfsSink.hdfs.serializer =
> org.apache.flume.serialization.BodyTextEventSerializer

BodyTextEventSerializer is the default serializer. Serializers decide
how to turn Events into records while fileType decides what type of
file the event is written to.


View raw message