flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nitin Pawar <nitinpawar...@gmail.com>
Subject RE: Configuring failover sync in Flume-ng
Date Wed, 19 Dec 2012 11:19:40 GMT
1.1.0 to 1.3.0 should be fairly easy job
On Dec 19, 2012 4:24 PM, "Abhijeet Pathak" <Abhijeet.Pathak@kpitcummins.com>
wrote:

> It's still not working.
>
> I read somewhere that failover support was implemented after Jan 2012.
> I've flume 1.1.0+121-1.cdh4.0.1.p0.1~precise-cdh4.0.1 installed.
>
> Can that be a reason for it not working?
>
> Thanks,
> Abhijeet
>
> -----Original Message-----
> From: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]
> Sent: Wednesday, December 19, 2012 2:52 PM
> To: user@flume.apache.org
> Subject: Re: Configuring failover sync in Flume-ng
>
> YOUR_NAME.sinks = HOSTSINK-1 HOSTSINK-2
>
> HOSTSINK-1.type=
> HOSTSINK-1.bind=HOSTNAME-1
> HOSTSINK-1.port=needed by JDBC?
> HOSTSINK-1.channels=YOUR_CHANNELS
>
> the same for the other HOSTSINK and deploy the config to the hosts and
> startup. Should work.
>
> Best,
>  Alex
>
> On Dec 19, 2012, at 10:01 AM, Abhijeet Pathak <
> Abhijeet.Pathak@kpitcummins.com> wrote:
>
> > Yes, I saw that.
> >
> > But I'm not sure how to tell flume that the failover sink is running on
> "another" machine.
> >
> > -----Original Message-----
> > From: Alexander Lorenz [mailto:wget.null@gmail.com]
> > Sent: Wednesday, December 19, 2012 1:59 PM
> > To: user@flume.apache.org
> > Subject: Re: Configuring failover sync in Flume-ng
> >
> > Hi,
> >
> > Failover:
> > http://flume.apache.org/FlumeUserGuide.html#failover-sink-processor
> >
> > Just define more as one JDBC channel and add them to the failover config
> (see the examples).
> >
> > Best
> > - Alex
> >
> > --
> > Alexander Alten-Lorenz
> > http://mapredit.blogspot.com
> > German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >
> > On Dec 19, 2012, at 9:23 AM, Abhijeet Pathak <
> Abhijeet.Pathak@kpitcummins.com> wrote:
> >
> >> Hi,
> >>
> >> I've working setup of flume-ng agent (1 source [tail], 1 channel[jdbc],
> 1 sink [AsyncHbase]) on one server.
> >>
> >> However, I am not able to find documentation on how to configure
> failover sinks for such scenario.
> >>
> >> I want to run same sink as backup/failover sink on different server.
> >> How can that be configured?
> >>
> >> Thanks,
> >> Abhijeet
> >>
> >
>
>

Mime
View raw message