flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish <paliwalash...@gmail.com>
Subject Re: Monitoring Flume
Date Thu, 21 Jan 2016 16:50:38 GMT
See the section http://flume.apache.org/FlumeUserGuide.html#monitoring

IMHO look for Counters values, if they don't change means things may
be off track. Outside this I would really look for JVM level stats
like GC's. In case of Full GC's nothing from within the application
would respond.

I did some work on https://issues.apache.org/jira/browse/FLUME-2550
(test cases are missing). If you have free cycles can try that out, it
shall open up things you can do with codahale Metrics package. Expect
a bumpy ride with the patch.

On Thu, Jan 21, 2016 at 2:54 AM, Guillermo Ortiz <konstt2000@gmail.com> wrote:
> Hello,
> I've looking for solutions to monitor a Flume Agent. Sometimes the process
> is running but it isn't available to process any message because some error
> happened. So, the process is running but Flume doesn't work.
> How are people monitoring Flume in general?
> We thought to create a JMX Source and send all data to some sink and do the
> monitoring based on the JMX logs though Solr or whatever.
> Any other solution or advise about monitoring Flume?


Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal

View raw message