flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Hauser <ewhau...@gmail.com>
Subject Re: FlumeBase state, future, etc.
Date Tue, 20 Sep 2011 13:58:36 GMT

I don't have answers to your questions, but I can share some of our
experiences experimenting with FlumeBase:

1. Beyond just the issues in FlumeBase itself, there are a number of
issues with Flume 0.9.4 (FLUME-626, FLUME-706) that make it unusable
with FlumeBase.  (I'd argue that Flume 0.9.4 is unusable by itself due
to critical bugs, but that is another story)
2. We ran into a lot of issues trying to run Avro encoding events
through FlumeBase.  Aaron was responsive in helping our engineer
resolve the issues, but the error handling certainly did not give us a
lot of confidence that FlumeBase was ready for primetime yet
3. Personally, I'd rather see the FlumeBase's execution engine stand
on its own and not be coupled to Flume.  Since Kafka is a pub/sub
model, integration there is much easier if FlumeBase's execution
engine is embedded in any app.  You could probably do FlumeBase and
Scribe together right now since Flume has a Scribe facade.

Although GPL and thus maybe not appropriate depending on your use
case, Esper is much more mature and feature complete than FlumeBase.
In my limited use, I have had some good experiences with it.

On Tue, Sep 20, 2011 at 12:00 AM, Otis Gospodnetic
<otis_gospodnetic@yahoo.com> wrote:
> Hello,
> Sorry if this is not the ideal place to ask about FlumeBase, but I could not
> find a better place and I know Aaron is on the list here.
> I'm evaluating stream even processors and of course looking at FlumeBase,
> which is now at 0.2.0.
> Things I'm wondering about:
> * Is FlumeBase a 1-man-Aaron show?  Or maybe there is a plan to incubate at
> ASF in 2011/12?
> * Is there a new release coming up soon?  I think the last one was in June
> and it came with a big "not stable!" warning (see Documentation for 0.2.0)
> * Is the plan to stay tightly integrated with Flume or allow integration
> with things like Kafka or Scribe or ...?
> Thanks,
> Otis
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Hadoop - HBase
> Hadoop ecosystem search :: http://search-hadoop.com/

View raw message