How big are your events? 10000
capacity doesn't seem like it should run into any issues, but
since it is all on memory, it's possible your channel is eating up
all your memory.
Note: channel capacity is the number of events, not the physical
You can verify what is going on by setting up ganglia or using
something like jconsole to get counter data via jmx: you'll want
to pull the channelFillPercentage.
On 01/17/2013 07:15 AM, Mohit Anchlia wrote:
channel transaction is 500 and I've not set any
On Wed, Jan 16, 2013 at 1:49 PM, Bhaskar
V. Karambelkar <firstname.lastname@example.org>
What is the
channel transaction capacity and HDFS batch size ?
On Wed, Jan 16, 2013 at 1:52 PM,
Mohit Anchlia <email@example.com>
I often get out of memory even when there is no
load on the system. I am wondering what's the best
way to debug this. I have heap size set to 2G and
memory capacity is 10000
13/01/16 09:09:38 ERROR hdfs.HDFSEventSink: process failed
java.lang.OutOfMemoryError: Java heap space
... 11 lines omitted ...
Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: Java heap space