flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Madhu Gmail <madhu.munag...@gmail.com>
Subject Re: Max events per RPC call from across sink to Avro source
Date Tue, 16 Apr 2013 21:45:16 GMT
May be it is taking the default batch size of 100 instead of 900 what I have for Avro sink.

Any  clue why it is not taking 900 as batch size ?

Thanks

Madhu 


On Apr 16, 2013, at 4:16 PM, Madhu Gmail <madhu.munagala@gmail.com> wrote:

> Hello,
> 
> I have flume agent configuration with sink batch size as 900.
> 
> Also I have another  flume agent working as collector.
> 
> Even though I have 900 as batch-size on agent sink,  I can only see 100 event batch when
the sink gets the data from file channel and sends it to collector.
> 
> I also see below comment in the code where it says max is 100 per RPC call
> 
> <td><tt>batch-size</tt></td>
> * <td>The maximum number of events to send per RPC.</td>
> * <td>events (int)</td>
> * <td>100</td>
> 
> Madhu  Munagala
> (214)679-2872

Mime
View raw message