flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: Kafka Sink avro event
Date Fri, 18 Dec 2015 14:53:09 GMT
Why don't you use a AvroSink and Source to link the tiers? I believe it
will preserve the headers.
You can still use Kafka as the channel if you want it's reliability

Regards,
Gonzalo

On 17 December 2015 at 20:02, Jean <lagarutte@yahoo.fr> wrote:

> Hello,
> I have this configuration :
> Source agent 1=> channel => kafka sink => kafka => source kafka agent 2 =>
> channel => custom sink.
>
> It works but the avro headers generated in agent 1 are lost on the second
> flume agent.
> Is there any way to sink full avro event (header and body) in kafka
> instead of body only ?
>
> Thx
> Jean
>
>

Mime
View raw message