flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From iain wright <iainw...@gmail.com>
Subject Re: GC errors
Date Wed, 22 Mar 2017 17:56:54 GMT
Can you please drop your config in a reply or pastebin (omitting any
sensitive info)

-- 
Iain Wright

This email message is confidential, intended only for the recipient(s)
named above and may contain information that is privileged, exempt from
disclosure under applicable law. If you are not the intended recipient, do
not disclose or disseminate the message to anyone except the intended
recipient. If you have received this message in error, or are not the named
recipient(s), please immediately notify the sender by return email, and
delete all copies of this message.

On Wed, Mar 22, 2017 at 10:54 AM, Suresh V <verditer@gmail.com> wrote:

> Hello Flume users,
>
> I'm getting this error when starting the agent. The source is a rabbit mq
> that has millions of messages, channel is file and sink is HDFS..
>
> Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "RabbitMQ Consumer #0"
> Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor"
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> Exception in thread "pool-8-thread-1" java.lang.OutOfMemoryError: GC
> overhead limit exceeded
> ^CException in thread "Thread-0" java.lang.OutOfMemoryError: GC overhead
> limit exceeded
> Exception in thread "agent-shutdown-hook" java.lang.OutOfMemoryError: GC
> overhead limit exceeded
>
> I have tried increasing the JAVA_OPTS min and max in flume-env.sh but that
> has not helped.
>
> Any help appreciated.
>
> Thank you
> Suresh.
>
>

Mime
View raw message