flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shady Xu <shad...@gmail.com>
Subject Re: Replay log taking to much time
Date Mon, 01 Jun 2015 06:32:26 GMT
I noticed that Flume 1.6 has been released on Github but not the official
website. I have compiled some of the modules from source myself (for other
reasons), but I'm not sure compiling the whole project  is a good idea.

We have tons of data, every time we change the configurations, replaying
log takes us way too many hours...

2015-04-17 12:38 GMT+08:00 Hari Shreedharan <hshreedharan@cloudera.com>:

> Changes that went into Flume 1.6 should improve replay time. Flume 1.6
> will be out in a few days.
> Thanks,
> Hari
> On Thu, Apr 16, 2015 at 7:55 PM, Shady Xu <shadyxu@gmail.com> wrote:
>> Every time I restart Flume NG, it will try to replay the log and the
>> process usually takes hours. During this time, Flume does not take any data
>> from the source.
>> So how can I make the replay faster?

View raw message