flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Huang, Zijian(Victor)" <zijian.hu...@etrade.com>
Subject RE: Flume agent repeatedly streaming the same content forever (Version: 0.9.3, r)
Date Tue, 27 Sep 2011 00:09:07 GMT
Thanks, Liam. This help me to move forward. do you aware of any difference than the Flume implementation
of Tail?
I really want to see this https://issues.cloudera.org/browse/FLUME-533?page=com.atlassian.streams.streams-jira-plugin%3Aactivity-stream-issue-tab
fix to sovle the problem


Vic

________________________________
From: Liam Friel [mailto:liam.friel@gmail.com]
Sent: Monday, September 26, 2011 3:04 PM
To: flume-user@incubator.apache.org
Subject: Re: Flume agent repeatedly streaming the same content forever (Version: 0.9.3, r)



On Mon, Sep 26, 2011 at 10:50 PM, Huang, Zijian(Victor) <zijian.huang@etrade.com<mailto:zijian.huang@etrade.com>>
wrote:
I think I found the cause. because one of the line is larger than the set limit, I tried to
set the flume.event.max.size.bytes in the agent node and collector node but the system doesn't
seem to take the values
====
  <property>
    <name>flume.event.max.size.bytes</name>
    <value>2076150</value>
    <description>The length of line content in byte.</description>
  </property>
=====

am I doing anything wrong?

Thanks

Vic
________________________________

I had a similar issue before.
I switched to using OS tail, rather than flume tail, and it made my problems go away.

This thread: https://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/b2f9ba4609124311/f7a45e5a34f09f13
has details.

Liam


Mime
View raw message