Yes. You need to place the plugin jar to both master and nodes. Master
does validate a plugin configure by loading the classes. That's my
observation, and it really makes sense.
-mingjie
On 10/10/2011 01:03 AM, Alex Baranau wrote:
> I believe you need jar to be placed on node with
> * collector<- for sure!
> * master<- I think that master performs some validation when you use
> it to configure flume nodes, hence it should be aware of the new sink.
> Not that sure though.
>
> Alex Baranau
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop - HBase
>
> On Thu, Oct 6, 2011 at 11:23 PM, Saritha Ravi<Saritha.Ravi@chacha.com> wrote:
>> Hi Otis,
>> Thanks for your reply,
>> I am following setup instructions from the below link, do I have to update
>> flume-site.xml and other configs in master,collector as well as agent
>> machines.
>> Thanks,
>> Saritha.
>> From: Otis Gospodnetic<otis_gospodnetic@yahoo.com>
>> Reply-To: "flume-user@incubator.apache.org"
>> <flume-user@incubator.apache.org>, Otis Gospodnetic
>> <otis_gospodnetic@yahoo.com>
>> Date: Thu, 6 Oct 2011 13:18:22 -0700
>> To: "flume-user@incubator.apache.org"<flume-user@incubator.apache.org>
>> Subject: Re: Flume-HBase
>>
>> Saritha,
>> Have a look
>> at http://blog.sematext.com/2011/07/28/flume-and-hbase-integration/
>> Otis
>> ----
>> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
>> Lucene ecosystem search :: http://search-lucene.com/
>>
>> ________________________________
>> From: Saritha Ravi<Saritha.Ravi@chacha.com>
>> To: "flume-user@incubator.apache.org"<flume-user@incubator.apache.org>
>> Cc: Flume Development<flume-dev@incubator.apache.org>
>> Sent: Wednesday, October 5, 2011 10:48 PM
>> Subject: Flume-HBase
>>
>> Hi All,
>> I need to configure Flume with hbase in cloud. Could anyone help me with
>> this. Is there a better documentation.
>> Does flume collector and and hbase master should be in the same cluster. I
>> was able to configure hbase(master ,Zookeeper,region server using WHIRR) and
>> flume(Master , collector) from CDH3. Can anyone suggest me the basic steps
>> how I can configure these two in ec2 cloud.
>> Thanks,
>> Saritha.
>>
>>
>>
>>
>
|