flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Sammut <asam...@kixeye.com>
Subject Replay Flume File Channel Data
Date Wed, 30 Apr 2014 06:54:26 GMT
Hi there,

I've recently had an issue where a client repeatedly sent 1.6M sized events
to our load balanced avro sources and in doing so filled the heap (4GB) of
all of our instances.

Is there a way to replay log files and extract only the required data?
Also, is there a way to limit the size of message that an avro source can
accept?

Regards,
Andrew S

-- 
Andrew Sammut
Lead Reliability Engineer (AUS)

Mobile: +61 (0)435 072 784
Google Voice: +1 (415) 548 1927
Email: asammut@kixeye.com
Skype: kix.asammut

Mime
View raw message