flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Shreedharan <hshreedha...@cloudera.com>
Subject Re: Necessity of using failover sinks
Date Thu, 14 Aug 2014 16:25:31 GMT
You'd usually not need two pointing to the same HDFS cluster. I'd use it 
for Avro Sinks for agent to agent communication to make sure your 
pipeline does not get clogged due to a single agent failing. You could 
failover from one HDFS cluster to another if you want.

Gary Malouf wrote:
> I have a tough time seeing why one would need a failover sink where
> both write to the same HDFS cluster. Can one describe to me why this
> is a good idea?

View raw message