flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: Multi-line Events
Date Sat, 13 Oct 2012 14:27:10 GMT
Hi,

I don't think there is anyway handle multi-line events with exec and
tail -F source. One could be written in python/perl/etc fairly easily
but would have to be written.

Brock

On Fri, Oct 12, 2012 at 9:44 PM, Cameron Gandevia <cgandevia@gmail.com> wrote:
> The plan is to eventually move to using the log4j appender but for now we
> don't want to introduce any dependencies in our application.
>
> On Oct 12, 2012 6:30 PM, "Brock Noland" <brock@cloudera.com> wrote:
>>
>> Hi,
>>
>> As opposed to using tail, why not use the API or log4j to send events
>> directly to a flume agent?
>>
>> Brock
>>
>> On Friday, October 12, 2012 at 8:21 PM, Cameron Gandevia wrote:
>>
>> Hi
>>
>> We are currently using the original flume and are considering switching to
>> flume ng using the exec "tail -F" source and eventually the spool directory
>> source
>> https://issues.apache.org/jira/browse/FLUME-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel.
>> My only question is I don't see how to handle multi-line log entries such
>> as stack traces using either of these methods. Is this possible?
>>
>> Thanks
>>
>>
>



-- 
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Mime
View raw message