flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From liuyongbo <liuyon...@baidu.com>
Subject 答复: how to print the channel capacity
Date Thu, 16 May 2013 08:06:20 GMT
Thank u very much. The monitor is useful.


发件人: Paul Chavez [mailto:pchavez@verticalsearchworks.com] 
发送时间: 2013年5月16日 0:36
收件人: user@flume.apache.org
主题: RE: how to print the channel capacity 


There are a few ways to monitor flume in operation. We use the JSON
reporting, which is available via 'http://<agent address>:<port>/metrics'.
You need to start the agent with the following parameters to get this

-Dflume.monitoring.type=http -Dflume.monitoring.port=34545

We use cacti to graph channel size both as a percentage of maximum and
absolute number of events in channel. This provides warning if the sinks
cannot keep up with the sources. 


We also graph ingress/egress event counts, much like a network bandwidth
graph, for some channels to get an idea of the throughput and to see if
sources/sinks are running at same speed.


From: liuyongbo [mailto:liuyongbo@baidu.com] 
Sent: Tuesday, May 14, 2013 10:38 PM
To: user@flume.apache.org
Subject: how to print the channel capacity 


         I’m using flume to pass log data to mongodb, but I find that some
data lose when the pressure is in high level, so I want to know the max
request that flume can hold and need to print the capacity.but I can not
find the proper way to do this instead of change the source code. Any ideas?


View raw message