flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mingjie Lai <mjla...@gmail.com>
Subject Re: Flume-HBase
Date Mon, 10 Oct 2011 17:34:45 GMT
Yes. You need to place the plugin jar to both master and nodes. Master 
does validate a plugin configure by loading the classes. That's my 
observation, and it really makes sense.

-mingjie

On 10/10/2011 01:03 AM, Alex Baranau wrote:
> I believe you need jar to be placed on node with
> * collector<- for sure!
> * master<- I think that master performs some validation when you use
> it to configure flume nodes, hence it should be aware of the new sink.
> Not that sure though.
>
> Alex Baranau
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop - HBase
>
> On Thu, Oct 6, 2011 at 11:23 PM, Saritha Ravi<Saritha.Ravi@chacha.com>  wrote:
>> Hi Otis,
>> Thanks for your reply,
>> I am following setup instructions from the below link, do I have to update
>> flume-site.xml and other configs in master,collector as well as agent
>> machines.
>> Thanks,
>> Saritha.
>> From: Otis Gospodnetic<otis_gospodnetic@yahoo.com>
>> Reply-To: "flume-user@incubator.apache.org"
>> <flume-user@incubator.apache.org>, Otis Gospodnetic
>> <otis_gospodnetic@yahoo.com>
>> Date: Thu, 6 Oct 2011 13:18:22 -0700
>> To: "flume-user@incubator.apache.org"<flume-user@incubator.apache.org>
>> Subject: Re: Flume-HBase
>>
>> Saritha,
>> Have a look
>> at http://blog.sematext.com/2011/07/28/flume-and-hbase-integration/
>> Otis
>> ----
>> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
>> Lucene ecosystem search :: http://search-lucene.com/
>>
>> ________________________________
>> From: Saritha Ravi<Saritha.Ravi@chacha.com>
>> To: "flume-user@incubator.apache.org"<flume-user@incubator.apache.org>
>> Cc: Flume Development<flume-dev@incubator.apache.org>
>> Sent: Wednesday, October 5, 2011 10:48 PM
>> Subject: Flume-HBase
>>
>> Hi All,
>> I need to configure Flume with hbase in cloud. Could anyone help me with
>> this. Is there a better documentation.
>> Does flume collector and and hbase master should be in the same cluster. I
>> was able to configure hbase(master ,Zookeeper,region server using WHIRR) and
>> flume(Master , collector) from CDH3. Can anyone suggest me the basic steps
>> how I can configure these two in ec2 cloud.
>> Thanks,
>> Saritha.
>>
>>
>>
>>
>

Mime
View raw message