flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Quintana, Cesar (C)" <Cesar.Quint...@csaa.com>
Subject RE: Flume duplicating a set of events many (hundreds of) times!
Date Wed, 17 Jun 2015 23:48:29 GMT
Oh man! Thanks for spotting that. Whoever modified this config must have copied and pasted
because EVERY Memory Channel has the same typo.

I’ve corrected it. Now, I’m still not understanding how having the TransactionCapacity
= 100 and the BatchSize = 1000 would cause duplicates. Can someone walk me through that logic?

Thanks for all the help so far. And, FYI, I am RTFMing it, as well.

Cesar M. Quintana

From: Hari Shreedharan [mailto:hshreedharan@cloudera.com]
Sent: Wednesday, June 17, 2015 4:15 PM
To: user@flume.apache.org
Subject: Re: Flume duplicating a set of events many (hundreds of) times!

On Wed, Jun 17, 2015 at 3:54 PM, Quintana, Cesar (C) <Cesar.Quintana@csaa.com<mailto:Cesar.Quintana@csaa.com>>
agent1.channels.PASPAChannel.transactionCapactiy = 1000

This line has a typo - so the channel is starting up at default capacity. Change this to:
agent1.channels.PASPAChannel.transactionCapacity = 1000

View raw message