flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Alten-Lorenz <wget.n...@gmail.com>
Subject Re: Max Event Size
Date Fri, 23 Nov 2012 10:33:50 GMT
Kevin,

This depends on your memory configuration. When you start flume with DEBUG did you got some
errors / warning? 

Cheers,
 Alex

P.S. http://flume.apache.org/FlumeUserGuide.html#exec-source


On Nov 23, 2012, at 10:29 AM, Lichen <kevinli.li@huawei.com> wrote:

> Hi all,
> 
> I tried to use exec source to tail a file of which each line is few MB. The File-Roll/HDFS
sinks received nothing in this case, while work fine with other short lines. Is it because
of the maximum size of a single event? What parameter to set if it's configurable.
> 
> Thanks
> 
> Kevin

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Mime
View raw message