flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guido Urdaneta <gui...@gmail.com>
Subject Reliable flows in flume
Date Thu, 05 Jul 2012 12:37:51 GMT

I have been trying to configure a reliable flow in Flume NG.
I installed the Flume NG distribution that comes with Cloudera cdh4.
Cloudera's documentation says that JDBC channel is "ideal for flows
where recoverability is important" and that FileChannel "is not yet
ready for use".
However, in some messages in this mailing list  FileChannel has been
recommended as the best option for reliable flows. Is this actually
the case?
Is Cloudera packing an old version of Flume NG with its CDH4 distribution?
Any recommendations?

I have found the performance of JDBC channel to be extremely slow
(about 10,000 times slower than memory channel), with the bottleneck
being CPU usage.

Can anybody give a recommendation?

Thanks in advance,

View raw message