flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Alten-Lorenz <wget.n...@gmail.com>
Subject Re: Max Event Size
Date Fri, 23 Nov 2012 10:33:50 GMT

This depends on your memory configuration. When you start flume with DEBUG did you got some
errors / warning? 


P.S. http://flume.apache.org/FlumeUserGuide.html#exec-source

On Nov 23, 2012, at 10:29 AM, Lichen <kevinli.li@huawei.com> wrote:

> Hi all,
> I tried to use exec source to tail a file of which each line is few MB. The File-Roll/HDFS
sinks received nothing in this case, while work fine with other short lines. Is it because
of the maximum size of a single event? What parameter to set if it's configurable.
> Thanks
> Kevin

Alexander Alten-Lorenz
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

View raw message