flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Herman Schistad <herman.schis...@gmail.com>
Subject Memory channel implemented by CircularFifoQueue (purging oldest event if full)
Date Mon, 23 Mar 2015 19:22:43 GMT

Simple question: is there an implementation of a Flume
memory/file-channel based on a Circular Fifo Queue

That is instead of rejecting new events once the memory channel is
full, I want to purge out the oldest one(s) until I can fit my new
incoming event.

I can see from the source code that the default MemoryChannel is
implemented using a LinkedBlockingDeque, which doesn't suit my needs
as I (for some channels/sinks) don't care about some events

Appreciate thoughts, ideas and experiences with this.

Herman Schistad

View raw message