flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: Flume and HDFS integration
Date Fri, 30 Nov 2012 01:26:37 GMT
HI,

On Thu, Nov 29, 2012 at 7:17 PM, Roman Shaposhnik <rvs@apache.org> wrote:
> On Thu, Nov 29, 2012 at 9:18 AM, Brock Noland <brock@cloudera.com> wrote:
>> 1) It's a sequence file, you can change it a text file if you want. See
>> FileType here http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
>
> Don't you also have to change a serialization format to get rid of the binary
> structure completely? IOW, you'd have to add something like:
>     agent.sinks.hdfsSink.hdfs.serializer =
> org.apache.flume.serialization.BodyTextEventSerializer

BodyTextEventSerializer is the default serializer. Serializers decide
how to turn Events into records while fileType decides what type of
file the event is written to.

Brock

Mime
View raw message