flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Y. Sakamoto" <ks...@muc.biglobe.ne.jp>
Subject Configuring many agents makes heartbeats down
Date Wed, 16 Nov 2011 17:45:05 GMT
I tried to configure 53 agents (logical agents, on 1 physical server) by
"flume shell" all at one.
After this, heartbeats failed and following message was written in the
collector log :

2011-11-16 11:38:00.687 WARN com.cloudera.flume.agent.LivenessManager:
Heartbeats are backing up, currently behind by 189 heartbeats

I wonder that the interval of heartbeats is too short to process many
So I have questions,

(1) How many agents are assured ?

(2) If my assumption is correct, which approach is better ?
     a. Wait until one agent configuration is finished,
         then next configuration continue.
     b. Change the interval of heartbeats longer (about 1 minutes) .

  Y. Sakamoto.

View raw message