flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hari Shreedharan" <hshreedha...@cloudera.com>
Subject Re: Multiple HDFS HA sinks
Date Sun, 22 Mar 2015 21:46:44 GMT
You’d specify the path as: hdfs://<nameservice>/path/to/write/to (Any substitutions
work in the path)




Thanks, Hari

On Sun, Mar 22, 2015 at 1:23 PM, Balkrishna Sharma
<balkrishna.sharma@gmail.com> wrote:

> Hi
> My flume agent writes to couple of HDFS sinks, each of which is in HA mode.
> How do I use the logical name for each of the cluster. i.e. how do I use
> dfs.nameservices for specifying path for each sink ?
> Flume seems to pick the first hdfs-site.xml it finds in its path and that
> has only one dfs.nameservices in it. The other other hdfs-site.xml in the
> other following config directory in the flumepath is ignored.
> Anyway I can club both the nameservices in the same hdfs-site.xml ?
> Thanks.
Mime
View raw message