flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keane, Mike" <mke...@conversantmedia.com>
Subject RE: Determine the backlog in File channel
Date Tue, 03 Nov 2015 00:06:57 GMT
Enable monitoring and you can get the channelFillPercentage and channelSize from the metrics:

VM arguments for http monitoring:
-Dflume.monitoring.type=http -Dflume.monitoring.port=12345


or whatever port you choose.

From: Buntu Dev [buntudev@gmail.com]
Sent: Monday, November 02, 2015 4:33 PM
To: user@flume.apache.org
Subject: Determine the backlog in File channel

I got a File channel with HDFS sink. In the case when the sink slows down and event taken
from the channel falls behind while the event puts continue at the same pace, how would one
go about finding the amount of backlog or time it takes to clear the backlog?


This email and any files included with it may contain privileged,
proprietary and/or confidential information that is for the sole use
of the intended recipient(s).  Any disclosure, copying, distribution,
posting, or use of the information contained in or attached to this
email is prohibited unless permitted by the sender.  If you have
received this email in error, please immediately notify the sender
via return email, telephone, or fax and destroy this original transmission
and its included files without reading or saving it in any manner.
Thank you.

View raw message