flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From NerdyNick <nerdyn...@gmail.com>
Subject Re: agent restart resend tailed file data
Date Fri, 02 Sep 2011 14:30:22 GMT
right now the only way to do this is to set the startFromEnd = true.
This will trip tail to just pick back up at the end of the file vs the
start on restart. Do note you can loose events during the restart
because of this. I believe there is a bug in to extend this feature
and record the position in the file to disk, but do not recall the
status of it.

On Wed, Aug 31, 2011 at 4:59 AM, Lior Harel <harel.lior@gmail.com> wrote:
> Hi,
> we're using flume agent to tail a directory of log files, we noticed that
> when the node is restarted it resends the tailed files. is there any
> configuration that can overcome this problem?
> Thanks

Nick Verbeck - NerdyNick

View raw message