Message view | « Date » · « Thread » |
---|---|
Top | « Date » · « Thread » |
From | "Stern, Mark" <mst...@iskoot.com> |
Subject | flume non-duplication guarantees? |
Date | Thu, 26 Jul 2012 05:51:19 GMT |
I was testing flume in an end-to-end configuration where A can send to D via B or C. A, B, C and D are all flume agents with file channels. In the course of the test, I killed and restarted B and C. At the end of the test. I found that all the events reached D, but 100 events (that is my batch size on the avro sinks) were duplicated. Is this expected (or at least accepted) behaviour? Thanks, Mark Stern | |
Mime |
|
View raw message |