flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Hsieh <...@cloudera.com>
Subject Re: DirectDriver: Driving src/sink failed! LazyOpenSource | LazyOpenDecorator because null
Date Thu, 21 Jul 2011 10:28:03 GMT
[please subscribe to new incubator list!  bcc: flume-user@cloudera.org, cc:
flume-user@incubator.apache.org,]

pk,

In this particular case, it looks like the body is larger than the max event
size which is by default 32k..  Can you boost the flume.event.max.size.bytes
 in your flume-site.xml file?

I'll file an issue to make a better warning when this happens.

Jon.

On Mon, Jul 11, 2011 at 7:36 PM, pk <pk1uuu@gmail.com> wrote:

>
> I regularly see the below error occur; it disrupts the agent, and I
> need to restart the flume-node service.
>
> I'm using package version 0.9.3+15.3-1~maverick-cdh3 .
>
> This error matches the fixed bug:
> https://issues.cloudera.org//browse/flume-435
> ; this bug is fixed in v0.9.3, so my installation should have it.
>
> It also matches the open bug: https://issues.cloudera.org/browse/FLUME-375
> ; this has a fix version of v0.9.5 . I assume this means that this bug
> will be fixed in v0.9.5; is that correct ?
>
>
That is the goal.  The comments of the issue state that a FLUME-620 has been
closed, bu tthe FLUME-375 issue hasn't been closed because we don' t know if
this solves the user's problem with the given information.


> Does anyone have suggestions regarding the below ? When will v0.9.5 be
> available as an APT package ?
>
>
There will be a new .deb package coming out "soon" -- within the next week
or so.


> Thanks,
>
> pk
>
>
>
> 2011-07-11 01:12:34,773 ERROR
> com.cloudera.flume.core.connector.DirectDriver: Driving src/sink
> failed! LazyOpenSource | LazyOpenDecorator because null
> java.lang.IllegalArgumentException
>        at
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:
> 75)
>        at com.cloudera.flume.core.EventImpl.<init>(EventImpl.java:
> 97)
>        at com.cloudera.flume.core.EventImpl.<init>(EventImpl.java:
> 87)
>        at com.cloudera.flume.core.EventImpl.<init>(EventImpl.java:
> 71)
>        at
>
> com.cloudera.flume.handlers.syslog.SyslogWireExtractor.buildEvent(SyslogWireExtractor.java:
> 120)
>        at
>
> com.cloudera.flume.handlers.syslog.SyslogWireExtractor.extract(SyslogWireExtractor.java:
> 192)
>        at
>
> com.cloudera.flume.handlers.syslog.SyslogWireExtractor.extractEvent(SyslogWireExtractor.java:
> 89)
>        at
>
> com.cloudera.flume.handlers.syslog.SyslogUdpSource.next(SyslogUdpSource.java:
> 88)
>        at
> com.cloudera.flume.handlers.debug.LazyOpenSource.next(LazyOpenSource.java:
> 57)
>        at com.cloudera.flume.core.connector.DirectDriver
> $PumperThread.run(DirectDriver.java:89)
>



-- 
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// jon@cloudera.com

Mime
View raw message