flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guillermo Ortiz <konstt2...@gmail.com>
Subject Re: Flume, what happen if the batchsize is not enough
Date Wed, 10 Sep 2014 13:00:17 GMT
Ok, thank you.

2014-09-10 14:48 GMT+02:00 Joey Echeverria <joey@cloudera.com>:

> There isn't an explicit timeout on the HBaseSink, though there is on
> the AsyncHBaseSink. For the HBaseSink, it will grab events out of the
> channel until it reaches the batch size or the channel is empty. When
> the channel is empty, it will commit however many events it already
> pulled from the channel even if it's less than the batch size. So,
> there is no worry of events getting delayed due to an insufficient
> number, but it can mean sending much smaller batches to HBase.
>
> HTH,
>
> -Joey
>
> On Wed, Sep 10, 2014 at 5:20 AM, Guillermo Ortiz <konstt2000@gmail.com>
> wrote:
> > Hi,
> >
> > I have a question. I'm using an HBaseSink, If I define a batchSize = 1000
> > (for example), and it never get 1000, is there a timeout and send the
> events
> > I got?
> > Which is that time?
> >
> >
> >
>
>
>
> --
> Joey Echeverria
>

Mime
View raw message