flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 纪君祥 <zhongyan.f...@alipay.com>
Subject How to run multiple flow on single physical node
Date Fri, 16 Sep 2011 05:52:04 GMT
Hi all ,

I failed to do flow isolation as the steps in http://archive.cloudera.com/cdh/3/flume/UserGuide/index.html#_flow_isolation


I want to run multiple flow one physical node.
Right now, what I think is as following:

On node host1:

#flume node Cn host1-1
#flume node Cn host1-2
#flume node Cn host1-3

When I using map method, I found one bug, please refer to https://issues.apache.org/jira/browse/FLUME-763


Doing as http://archive.cloudera.com/cdh/3/flume/UserGuide/index.html#_flow_isolation, but
failed
Environment:
1 flume master, 3 flume nodes
OS: Redhat Enterprise Linux
Flume version: 0.9.4 release

Steps:

I want to do as follow
exec config hbase2 flow1 text("/home/hadoop/test.txt")       autoE2EChain
exec config hbase2 flow2 text("/home/hadoop/test_character") autoE2EChain
exec config hbase3 flow1 text("/home/hadoop/test.txt")       autoE2EChain
exec config hbase3 flow2 text("/home/hadoop/test_character") autoE2EChain
exec config hbase6 flow1 autoCollectorSource text("/home/hadoop/output_test.txt")
exec config hbase6 flow2 autoCollectorSource text("/home/hadoop/output_test_character")


when I input in flume shell

[flume hbase1:35873:45678] exec config hbase2 flow1 text("/home/hadoop/test.txt") autoE2EChain
Failed to run command 'exec config hbase2 flow1 text("/home/hadoop/test.txt") autoE2EChain'
due to null
11/09/14 21:22:38 ERROR util.FlumeShell: Failed to run command 'exec config hbase2 flow1 text("/home/hadoop/test.txt")
autoE2EChain'


Thanks
Longda

________________________________

This email (including any attachments) is confidential and may be legally privileged. If you
received this email in error, please delete it immediately and do not copy it or use it for
any purpose or disclose its contents to any other person. Thank you.

(κθ)ܺлϲܷɱȷռˣɾʼ벻ҪʽиƲκ;͸¶ʼ֮ݡлл
Mime
View raw message