flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bean Edwards <edwardsb...@gmail.com>
Subject fileChannel always reached it's capacity
Date Fri, 21 Mar 2014 09:03:06 GMT
I use hdfsSink and fileChannel, it seems hdfsSink consume too slow.here is
my configuration:
...
agent1.channels.thrift_ch2.capacity = 200000000
agent1.channels.thrift_ch2.transactionCapacity = 100000
...
agent1.sinks.hdfsSink.hdfs.batchSize = 100000
agent1.sinks.hdfsSink.hdfs.threadsPoolSize = 40

very appreciate for guiding !!!

Mime
View raw message