From flume-user-return-304-apmail-incubator-flume-user-archive=incubator.apache.org@incubator.apache.org Wed Oct 5 13:55:04 2011 Return-Path: X-Original-To: apmail-incubator-flume-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-flume-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6EC6192C0 for ; Wed, 5 Oct 2011 13:55:04 +0000 (UTC) Received: (qmail 5929 invoked by uid 500); 5 Oct 2011 13:55:04 -0000 Delivered-To: apmail-incubator-flume-user-archive@incubator.apache.org Received: (qmail 5905 invoked by uid 500); 5 Oct 2011 13:55:04 -0000 Mailing-List: contact flume-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: flume-user@incubator.apache.org Delivered-To: mailing list flume-user@incubator.apache.org Received: (qmail 5897 invoked by uid 99); 5 Oct 2011 13:55:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Oct 2011 13:55:04 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vaiju1981@gmail.com designates 209.85.210.175 as permitted sender) Received: from [209.85.210.175] (HELO mail-iy0-f175.google.com) (209.85.210.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Oct 2011 13:54:59 +0000 Received: by iadx2 with SMTP id x2so1966089iad.6 for ; Wed, 05 Oct 2011 06:54:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=wYFCCDVLFtUwBNdPuAyNjImE8Ha2lZVtuhnRtY/nWAo=; b=Y5oD1rAgHnryzHTJte6K5sgndif2KRGQrwSGwGSrCXeAgZGUnq1CX9drNyg74GCwy2 Ssjup3M7JafqCmd9C4DTADaW3G+ci448QuCaP+7nAgO2AVra2aJYMMkZBrGbYFSFnR9k 5rDmwfwIUZ8D942IflNmHHdfzse4wJaH8kAgk= MIME-Version: 1.0 Received: by 10.231.21.26 with SMTP id h26mr4284280ibb.40.1317822878271; Wed, 05 Oct 2011 06:54:38 -0700 (PDT) Received: by 10.231.144.135 with HTTP; Wed, 5 Oct 2011 06:54:38 -0700 (PDT) In-Reply-To: References: <20111005143222.32c5badf@toffel.linkoping.osa> <20111005154243.06032db0@toffel.linkoping.osa> <20111005154620.301961c6@toffel.linkoping.osa> Date: Wed, 5 Oct 2011 19:24:38 +0530 Message-ID: Subject: Re: Help From: Vaijanath Rao To: flume-user@incubator.apache.org Content-Type: multipart/alternative; boundary=00151773de9689480304ae8d8cf0 --00151773de9689480304ae8d8cf0 Content-Type: text/plain; charset=ISO-8859-1 Hi Ralph, Thanks for the reply, I will look into this as well. --Thanks and Regards Vaijanath N. Rao On Wed, Oct 5, 2011 at 7:22 PM, Ralph Goers wrote: > I've written a bit more robust example at > https://svn.apache.org/repos/asf/logging/log4j/branches/BRANCH_2_0_EXPERIMENTAL/rgoers/log4j2-core/src/main/java/org/apache/logging/log4j/core/appender/flume/. > The appender can be configured with a list of agents instead of just one. > The Manager handles the actual communication and FlumeEvent handles the > conversion from a Log4j2 event to a Flume event. > > Ralph > > > > > On Oct 5, 2011, at 6:46 AM, Erik Forsberg wrote: > > On Wed, 5 Oct 2011 15:42:43 +0200 > Erik Forsberg wrote: > > Have a look at the source catalog: > > > > http://archive.cloudera.com/cdh/3/flume/UserGuide/index.html#_flume_source_catalog > > > There's the rpcsource, which allows you to use Thrift or Avro to > > connect from your java program to the node and deliver messages. But I > > don't have any simple example on how to use it handy. > > > Actually, when I look at it a bit closer, the log4j appender source > code should serve as an example of how to communicate via Avro from > your Java program: > > > https://github.com/cloudera/flume/blob/master/flume-log4j-appender/src/main/java/com/cloudera/flume/log4j/appender/FlumeLog4jAvroAppender.java > > \EF > -- > Erik Forsberg > Developer, Opera Software - http://www.opera.com/ > > > -- I am feeling fine, healthier and Happier, what about you --00151773de9689480304ae8d8cf0 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Ralph,

Thanks for the reply, I will look into this as well.
--Thanks and Regards
Vaijanath N. Rao

On Wed, Oct 5, 2011 at 7:22 PM, Ralph Goers <ralph.goers@dslextreme.com> wrote:
I'v= e written a bit more robust example at=A0https://svn.apache.org/repos/asf/logging/log4j/branches/BRANCH_2_0_EXP= ERIMENTAL/rgoers/log4j2-core/src/main/java/org/apache/logging/log4j/core/ap= pender/flume/. The appender can be configured with a list of agents ins= tead of just one. The Manager handles the actual communication and FlumeEve= nt handles the conversion from a Log4j2 event to a Flume event.

Ralph




On Oct 5, 2= 011, at 6:46 AM, Erik Forsberg wrote:

On Wed, 5 Oct 2011 15:42:43 +0200
Erik Forsberg <forsberg@opera.com> wrote:
Have a look at the source catalog:

http://archive.cloudera.com/cdh/3/flume/Use= rGuide/index.html#_flume_source_catalog

There's the rpcsource, which allows you to use Thrift or Avro to=
connect from your java program t= o the node and deliver messages. But I
don't have any simple example on= how to use it handy.

Actually, when I look at it a bit= closer, the log4j appender source
code should serve as an example of ho= w to communicate via Avro from
your Java program:

https://github.com/clouder= a/flume/blob/master/flume-log4j-appender/src/main/java/com/cloudera/flume/l= og4j/appender/FlumeLog4jAvroAppender.java

\EF
--
Erik Forsberg <forsberg@opera.com>
Developer, Opera Software - = http://www.opera.com/




--
I am feeling fine, healthier and Happie= r, what about you
--00151773de9689480304ae8d8cf0--