flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish <paliwalash...@gmail.com>
Subject Re: Source Failover and Sink Failover
Date Wed, 29 Jan 2014 04:22:27 GMT
On Wed, Jan 29, 2014 at 12:46 AM, Mayur Gupta <mayur.gupta81@gmail.com>wrote:

> I have two questions related to failover in Flume.
> 1) If the source is not accepting events because of a failure condition,
> is there a failover mechanism in Flume other configuring 2 agents to listen
> to the events, in which I will get duplicates.

What is the source (not Flume Source) of Events? What happens to the Events
if the Flume Source fails?

> 2) I configured a sink processor for failover with 2 sinks, one logger and
> another HDFS. If the HDFS sink starts failing (say HDFS is no longer up),
> the events are not processed by logger sink. Is this excepted behavior. Is
> the failover only works with 2 avro sinks and not in the manner I have
> configured?

IMHO, this should not be the case. Anything in the logs?

> I will appreciate it if somebody can point me in the right direction.
> -Mayur


Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal

View raw message