flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kathleen Ting <kathl...@apache.org>
Subject Re: HDFS sink leaves .tmp files
Date Mon, 10 Sep 2012 17:37:21 GMT
Chris, Eran, this appears to be FLUME-1238, which was fixed in
Flume-1.2.0. Can you let me know if you are using Flume-1.2.0?

Thanks, Kathleen

On Mon, Sep 10, 2012 at 8:21 AM, Chris Neal <cwneal@gmail.com> wrote:
> Glad to know it's not just me :)
>
>
> On Mon, Sep 10, 2012 at 10:16 AM, Eran Kutner <eran@gigya.com> wrote:
>>
>> I have the same problem. I roll every 1 minute so I have tons of those
>> .tmp files.
>>
>> -eran
>>
>>
>>
>> On Mon, Sep 10, 2012 at 6:02 PM, Chris Neal <cwneal@gmail.com> wrote:
>>>
>>> I'm still seeing this consistently every 24 hour period.  Does this sound
>>> like a configuration issue, an issue with the Exec source, or an issue with
>>> the HDFS sink?
>>>
>>> Thanks!
>>>
>>>
>>> On Wed, Aug 29, 2012 at 9:18 AM, Chris Neal <cwneal@gmail.com> wrote:
>>>>
>>>> Hi all,
>>>>
>>>> I have an Exec Source running a tail -F on a log4J-generated log file
>>>> that gets rolled once a day.  It seems that when log4J rolls the file to
the
>>>> new date, the hdfs sink ends up with a .tmp file.  I haven't figured out
if
>>>> there is any data loss yet, but was curious if this is expected behavior?
>>>>
>>>> Thanks for your time.
>>>> Chris
>>>
>>>
>>
>

Mime
View raw message