flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Davis <mailinglists...@gmail.com>
Subject Writing AvroSequenceFiles to HDFS
Date Mon, 03 Mar 2014 07:57:47 GMT
Hi,

I'm wondering if there's an easy (or at least recommended) way to write
AvroSequenceFile's to HDFS using Flume.

By creating a new serializer I'm able to write Avro objects to a sequence
file, but they're not wrapped up in AvroKey or AvroValue and the schema
isn't in the sequence file header.

I can't explicitly output AvroKey/Values from my serializer as they're not
Writables.

Before I plunge into HDFS sink code, is there a better way?

Many thanks,

Tom

Mime
View raw message