flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GuoWei <wei....@wbkit.com>
Subject The size of data folder continue grow
Date Tue, 26 Nov 2013 13:41:58 GMT
Dear all,

I use flume and custom base sink to put data to HBase. In flume, I use file channel. 

the file channel data put in the following folder.

razor.channels.c_error.dataDirs = /var/lib/flume-ng/data/error

But I see the channel data folder size continue grow until to 2gb.

Does flume remove the data in channel data folder after flush to HBase? Or still store in
data folder after flush to HBase ?

Or the speed sink to HBase is too slower than source ?

And how to speed up the sink to HBase ?



View raw message