flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roshan Naik <ros...@hortonworks.com>
Subject Re: Memory channel implemented by CircularFifoQueue (purging oldest event if full)
Date Mon, 23 Mar 2015 23:27:36 GMT
I donĀ¹t think any such implementation exists.

On 3/23/15 12:22 PM, "Herman Schistad" <herman.schistad@gmail.com> wrote:

>Simple question: is there an implementation of a Flume
>memory/file-channel based on a Circular Fifo Queue
>That is instead of rejecting new events once the memory channel is
>full, I want to purge out the oldest one(s) until I can fit my new
>incoming event.
>I can see from the source code that the default MemoryChannel is
>implemented using a LinkedBlockingDeque, which doesn't suit my needs
>as I (for some channels/sinks) don't care about some events
>Appreciate thoughts, ideas and experiences with this.
>Herman Schistad

View raw message