flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Shreedharan <hshreedha...@cloudera.com>
Subject Re: dynamically change batch size in run time ?
Date Sat, 20 Sep 2014 18:49:11 GMT
File Channel size cannot be changed dynamically - since the the File
Channel stores a fixed size queue on disk. Changing it means that you'd
have to delete the checkpoint and that would mean a full replay which will
take quite a while.

On Sat, Sep 20, 2014 at 8:16 AM, terreyshih <terreyshih@gmail.com> wrote:

> Hi,
>
> I know that flume reads/reloads the config file periodically, but does it
> just check for changes in the data added (for example, new channel) or does
> it also reload the batch size ?
>
> I am doing some performance tuning and would like to know if I can just
> change the batch size in run time to get some data
>
> thx.

Mime
View raw message