flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gaspar Muñoz <gmu...@stratio.com>
Subject Re: Flume/Avro schema manipulation
Date Fri, 29 Aug 2014 12:25:47 GMT
Hi Ed,

maybe after read logs from your file, you can apply
org.apache.flume.sink.solr.morphline.MorphlineInterceptor$Builder
interceptor <http://kitesdk.org/docs/current/kite-morphlines/> and then
apply to Avro morphline
<http://org.apache.flume.sink.solr.morphline.MorphlineInterceptor$Builder>.

Is that what you are looking for?

Regards.


2014-08-29 13:43 GMT+02:00 Ed Judge <ejudgie@gmail.com>:

> I am looking for some good documentation that would explain how I can pull
> logs from a file and apply a certain schema to that log file format.  I
> have gone threw the exercise of sending a file using a Avro source/sink
> with the flume_ng avro_client to a flume_ng agent but my understanding is
> that this is just using a "default Avro schema”.  I want to be able build
> the schema a certain way.  Assuming it is doable, is there anything out
> that documents this process?
>
> Thanks,
> Ed
>

Mime
View raw message