flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: Flume Agent failure Handlling
Date Tue, 20 Oct 2015 17:13:29 GMT
I use CDH (e.g. restarting a process automatically when it dies is just a
checkbox), so I cannot tell you how it's done in HDP.
But it should be able do what you need.

Gonzalo

On 20 October 2015 at 14:24, Shashi Vishwakarma <shashi.vish123@gmail.com>
wrote:

> Hi
> Thanks for your reply. I am using HDP for our cluster. Are you referring
> to nagios as free version tools that comes with HDP or any other thing that
> you have in mind?
>
> It would great if you can point me to any document/link which describe
> configuration for flume agent alert.
>
> Thanks and Regards,
> Shashi
>
> On Tue, Oct 20, 2015 at 1:32 PM, Gonzalo Herreros <gherreros@gmail.com>
> wrote:
>
>> I would use a Hadoop distribution such as Cloudera or Hortonworks. Both
>> have free versions including monitoring and alert tools.
>> If you think that is too much, I believe Apache Ambari has that
>> capability.
>>
>> Finally, the most lightweight solution is a standard linux tool to
>> monitor/restart processes, there's plenty of them both free and commercial.
>>
>> Regards,
>> Gonzalo
>>
>> On 20 October 2015 at 08:40, Shashi Vishwakarma <shashi.vish123@gmail.com
>> > wrote:
>>
>>> Hi
>>>
>>> I have written flume agent which will be running 24/7 on production
>>> server. But some time I have observed that flume agent silently goes down.
>>>
>>> I need a mechanism which can atleast give an alert to client/user when
>>> such kind of scenario happens.
>>>
>>> Any suggestion to handle this case.
>>>
>>> Thanks and Regards,
>>>
>>> Shashi
>>>
>>>
>>>
>>>
>>
>

Mime
View raw message