flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stern, Mark" <mst...@iskoot.com>
Subject flume non-duplication guarantees?
Date Thu, 26 Jul 2012 05:51:19 GMT
I was testing flume in an end-to-end configuration where A can send to D
via B or C. A, B, C and D are all flume agents with file channels. In
the course of the test, I killed and restarted B and C. At the end of
the test. I found that all the events reached D, but 100
events (that is my batch size on the avro sinks) were duplicated.

Is this expected (or at least accepted) behaviour?


Mark Stern
View raw message