flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandesh Hurli <sandip...@gmail.com>
Subject Re: Flume RegexHbaseEventSerializer
Date Fri, 07 Mar 2014 07:21:06 GMT
Got this working, had to change the regex pattern to
(.+)\\s(.+)\\s(\\d+)\\s(\\S+)\\s(\\S+)\\s(\\S+)\\s(.+). My bad.

Cheers!


On Fri, Mar 7, 2014 at 10:37 AM, Sandesh Hurli <sandip002@gmail.com> wrote:

> Hi
>
> I am using Flume's Hbase sink with RegexHbaseEventSerializer, but when I
> run the agent I get no entries in the Hbase table.
> It works perfectly with SimpleHbaseEventSerializer though.
>
> Here's my sink configuration:
>
> agent.sinks.loggerSink.type = org.apache.flume.sink.hbase.HBaseSink
> agent.sinks.loggerSink.table = demo
> agent.sinks.loggerSink.columnFamily = cf
> agent.sinks.loggerSink.serializer
> =org.apache.flume.sink.hbase.RegexHbaseEventSerializer
> agent.sinks.loggerSink.serializer.regex
> =(.+)\s(.+)\s(\d+)\s(\S+)\s(\S+)\s(\S+)\s(.+)
>
> agent.sinks.loggerSink.serializer.colNames=Date,Time,PID,Level,Module,ReqID,Message
>
> Entries in my source file look like this:
>
> 2014-02-27 15:17:54.409 1297 INFO nova.compute.resource_tracker [-]
> Compute_service record updated
> 2014-01-15 09:23:33.234 1288 DEBUG nova.wsgi [-] Loading app ec2 from
> /etc/nova/api-paste.ini
>
> I would appreciate any help.
>
> Sandesh.
>

Mime
View raw message