flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sharninder <sharnin...@gmail.com>
Subject Re: Batchsize in kafka sink
Date Sat, 26 Sep 2015 04:19:57 GMT
Anyone ? 

> On 25-Sep-2015, at 3:51 PM, Sharninder <sharninder@gmail.com> wrote:
> 
> Hi,
> 
> We want to move to the built-in kafka sink from our own custom implementation and I have
a question about the batchsize config parameter.
> 
> Looking at the code of the sink, I can tell that the batchsize is used to construct the
list of keyed messages fed to the producer. 
> 
> My question is what is the difference between this variable and the kafka batch.num.messages
parameter?
> 
> Is the flume parameter necessary ?
> 
> --
> Sharninder
> 
> 

Mime
View raw message