flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Balkrishna Sharma <balkrishna.sha...@gmail.com>
Subject Multiple HDFS HA sinks
Date Sun, 22 Mar 2015 20:22:47 GMT
Hi
My flume agent writes to couple of HDFS sinks, each of which is in HA mode.

How do I use the logical name for each of the cluster. i.e. how do I use
dfs.nameservices for specifying path for each sink ?
Flume seems to pick the first hdfs-site.xml it finds in its path and that
has only one dfs.nameservices in it. The other other hdfs-site.xml in the
other following config directory in the flumepath is ignored.
Anyway I can club both the nameservices in the same hdfs-site.xml ?

Thanks.

Mime
View raw message