flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sharninder <sharnin...@gmail.com>
Subject Re: avro source vs syslog source in flume
Date Mon, 25 Aug 2014 05:02:46 GMT
Yes, you can compose avro messages in php. As to your question about which
is a better performances wise, I'm not really sure about that, but since
you already have a script generating syslog, why not just start using it.
To add header values to each event you can add an interceptor to the
topology, but it'd be easier to do this in avro since you can add headers
right at the source and won't need to write a lot of custom code.

On Mon, Aug 25, 2014 at 10:22 AM, Mohit Durgapal <durgapalmohit@gmail.com>

> I have to make a flume topology in which I can divide the events based on
> some header value to different sinks through selectors.
> My logging script is implemented in php, and this php script writes to
> syslog which then forwards the events to a pre-configured flume node.
> Could anyone tell me which is better between avro and syslog sources, in
> terms of performance,implementation and understanding?
> And is it even possible to write avro messages through php?
> Mohit

View raw message