flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Durgapal <durgapalmo...@gmail.com>
Subject Re: Flume to handle spam detection and rate limiting
Date Sat, 24 Jan 2015 09:25:18 GMT

I don't think that there is any spam detection features that are in-built
in flume. But don't you think spam-filtering and check against other
attacks should happen a layer before flume, maybe add a layer of  LBs
between the web-server(or any other source generating data stream) and

Did you consider using a load balancer like HAProxy?
Have a look at

Hope that helps.


On Sat, Jan 24, 2015 at 2:16 AM, Buntu Dev <buntudev@gmail.com> wrote:

> Hi -- I'm ingesting data to HDFS via Flume and wanted to know if there any
> built-in features to handle spam detection and rate limiting to avoid any
> possible flooding of data. Please let me know.
> Thanks!

View raw message