flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mingjie Lai <mjla...@gmail.com>
Subject Re: Flume agent repeatedly streaming the same content forever (Version: 0.9.3, r)
Date Tue, 27 Sep 2011 19:06:59 GMT
Vic.

There is patch already at flume-533. If you really want it right now, 
you can apply it and make a new patch. So a committers can commit it 
later on. (people seem busy recently)

-mingjie

On 09/26/2011 05:09 PM, Huang, Zijian(Victor) wrote:
> Thanks, Liam. This help me to move forward. do you aware of any
> difference than the Flume implementation of Tail?
> I really want to see this
> https://issues.cloudera.org/browse/FLUME-533?page=com.atlassian.streams.streams-jira-plugin%3Aactivity-stream-issue-tab
> fix to sovle the problem
> Vic
>
> ------------------------------------------------------------------------
> *From:* Liam Friel [mailto:liam.friel@gmail.com]
> *Sent:* Monday, September 26, 2011 3:04 PM
> *To:* flume-user@incubator.apache.org
> *Subject:* Re: Flume agent repeatedly streaming the same content forever
> (Version: 0.9.3, r)
>
>
>
> On Mon, Sep 26, 2011 at 10:50 PM, Huang, Zijian(Victor)
> <zijian.huang@etrade.com <mailto:zijian.huang@etrade.com>> wrote:
>
>     __
>     I think I found the cause. because one of the line is larger than
>     the set limit, I tried to set the flume.event.max.size.bytes in the
>     agent node and collector node but the system doesn't seem to take
>     the values
>     ====
>     <property>
>     <name>flume.event.max.size.bytes</name>
>     <value>2076150</value>
>     <description>The length of line content in byte.</description>
>     </property>
>     =====
>     am I doing anything wrong?
>     Thanks
>     Vic
>     ------------------------------------------------------------------------
>
>
> I had a similar issue before.
> I switched to using OS tail, rather than flume tail, and it made my
> problems go away.
>
> This thread:
> https://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/b2f9ba4609124311/f7a45e5a34f09f13
> has details.
>
> Liam
>

Mime
View raw message