flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alo alt <wget.n...@googlemail.com>
Subject Re: Python logs to Flume?
Date Tue, 20 Mar 2012 08:53:06 GMT
Hi Ari,

in the source code you'll find a thrift api (https://github.com/cloudera/flume/blob/master/src/thrift/flume.thrift),
you could use that like:

from thrift.transport import TSocket
from thrift.transport import THttpClient
from thrift.protocol import TBinaryProtocol
....

Or implement a own handler and use syslog as protocol. 

best,
 Alex 


--
Alexander Lorenz
http://mapredit.blogspot.com

On Mar 20, 2012, at 7:59 AM, Flinkster wrote:

> Alex,
> 
> Thanks for the advice. I'm not familiar with python, do I need to
> implement a new python LogHandler for avro?
> 
> -ari
> 
> On Mon, Mar 12, 2012 at 12:21 AM, alo alt <wget.null@googlemail.com> wrote:
>> Hi,
>> 
>> Avro is the best way. Or the thrift python interface generated from src/thrift/flume.thrift.
>> 
>> best,
>>  Alex
>> 
>> --
>> Alexander Lorenz
>> http://mapredit.blogspot.com
>> 
>> On Mar 12, 2012, at 5:53 AM, Flinkster wrote:
>> 
>>> Hi there,
>>> 
>>> What's the recommended way to log to Flume from python? Flume
>>> avroSource? I don't really use python SysLogHandler.
>>> 
>>> I'm sure there are many users logging from python to Flume. Could you
>>> please share your experiences & best practises?
>>> 
>>> Thanks,
>>> 
>>> -ari
>> 


Mime
View raw message