flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anthony Biacco <abia...@handll.com>
Subject Re: flume with gnip
Date Fri, 17 Oct 2014 16:26:56 GMT
Ok, thanks. We're still learning using flume and appreciate the nudge in
the right direction.

-Tony


On Fri, Oct 17, 2014 at 12:50 AM, Ashish <paliwalashish@gmail.com> wrote:

> Hi Anthony,
>
> Had a quick look at gnip4j. You need to write a Source for that, and
> it would be inline with Twitter source. Code would be something like
> (pulled from example), rest would be similar to Twitter Source
>
> final StreamNotification observer = new StreamNotificationAdapter() {
>     @Override
>     public void notify(final Activity activity, final GnipStream stream) {
>         // Create Event out of Activity
>
>        // get Activity as byte array
>
>         Event event = EventBuilder.withBody(bytes);
>       getChannelProcessor().processEvent(event);
>
>     }
> };
>
> HTH !
> ashish
>
> On Fri, Oct 17, 2014 at 2:08 AM, Anthony Biacco <abiacco@handll.com>
> wrote:
> >
> > We were using flume with twitter's sample firehose but now would like to
> use
> > it with a GNIP hose we have.
> >
> > Does anybody know how we would configure a source for this? I would
> assume
> > we'd have to use the gnip4j jar, but I haven't figured out anything
> beyond
> > that.
> > A google search didn't produce any help or examples.
> >
> > Much appreciated,
> >
> > -Tony
> >
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>

Mime
View raw message