flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: Flume avro file extension
Date Mon, 20 Feb 2012 18:56:09 GMT
Missed that during my search, 980 is marked as duplicate/resolved.

On Mon, Feb 20, 2012 at 12:41 PM, Robby <robby.verkuylen@gmail.com> wrote:
> That would become the dupe of 965: https://issues.apache.org/jira/browse/FLUME-965
>
> On 20 feb. 2012, at 15:18, Brock Noland <brock@cloudera.com> wrote:
>
>> https://issues.apache.org/jira/browse/FLUME-980
>>
>> On Mon, Feb 20, 2012 at 12:49 AM, Eric Sammer <esammer@cloudera.com> wrote:
>>> Makes sense to me. Can I convince one of you guys to file a JIRA so we don't
>>> lose this one?
>>>
>>> Thanks.
>>>
>>>
>>> On Thu, Feb 9, 2012 at 2:10 PM, Tom White <tom@cloudera.com> wrote:
>>>>
>>>> +1 to making Flume Avro data files have the .avro extension.
>>>>
>>>> The Avro MapReduce classes expect the .avro extension too.
>>>>
>>>> Cheers,
>>>> Tom
>>>>
>>>> On Thu, Feb 9, 2012 at 6:39 AM, Rob Verkuylen <rob@verkuylen.net> wrote:
>>>>> I ran into problems with post processing Flume avrodata files with Pig's
>>>>> AvroStorage loader. The loader will only read files with a .avro
>>>>> extension.
>>>>>
>>>>> There's no section in the official AVRO spec, but the general consensus
>>>>> seems to be to use the ".avro" extension for writing avro data files.
>>>>> See
>>>>> AVRO-153 and Cloudera on AVRO Usage
>>>>>
>>>>> Don't see it in Flume's Jira, but I can't be the first to raise this
>>>>> issue
>>>>> either. Any thoughts?
>>>>>
>>>
>>>
>>>
>>>
>>> --
>>> Eric Sammer
>>> twitter: esammer
>>> data: www.cloudera.com
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/



-- 
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Mime
View raw message