flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robby <robby.verkuy...@gmail.com>
Subject Re: Flume avro file extension
Date Mon, 20 Feb 2012 18:41:33 GMT
That would become the dupe of 965: https://issues.apache.org/jira/browse/FLUME-965

On 20 feb. 2012, at 15:18, Brock Noland <brock@cloudera.com> wrote:

> https://issues.apache.org/jira/browse/FLUME-980
> 
> On Mon, Feb 20, 2012 at 12:49 AM, Eric Sammer <esammer@cloudera.com> wrote:
>> Makes sense to me. Can I convince one of you guys to file a JIRA so we don't
>> lose this one?
>> 
>> Thanks.
>> 
>> 
>> On Thu, Feb 9, 2012 at 2:10 PM, Tom White <tom@cloudera.com> wrote:
>>> 
>>> +1 to making Flume Avro data files have the .avro extension.
>>> 
>>> The Avro MapReduce classes expect the .avro extension too.
>>> 
>>> Cheers,
>>> Tom
>>> 
>>> On Thu, Feb 9, 2012 at 6:39 AM, Rob Verkuylen <rob@verkuylen.net> wrote:
>>>> I ran into problems with post processing Flume avrodata files with Pig's
>>>> AvroStorage loader. The loader will only read files with a .avro
>>>> extension.
>>>> 
>>>> There's no section in the official AVRO spec, but the general consensus
>>>> seems to be to use the ".avro" extension for writing avro data files.
>>>> See
>>>> AVRO-153 and Cloudera on AVRO Usage
>>>> 
>>>> Don't see it in Flume's Jira, but I can't be the first to raise this
>>>> issue
>>>> either. Any thoughts?
>>>> 
>> 
>> 
>> 
>> 
>> --
>> Eric Sammer
>> twitter: esammer
>> data: www.cloudera.com
> 
> 
> 
> -- 
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Mime
View raw message