flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: Hbase Sink
Date Sat, 07 Nov 2015 10:45:47 GMT
I did a custom serializer that parses the event an json and the top level
properties become columns inside a configurable column family.
I also have a custom property to configure which fields make up the
composite key (which I salt based on the number of regions).

It shouldn't be too hard having a property that maps input fields into
hbase cf:column names (kinda like Hive does when you map an HBase table)


On 7 November 2015 at 09:17, Rani Yaroshinski <rani.yaroshinski@gmail.com>

> Hi,
> It seems a little weird, but it looks like the most simple sink you would
> like for hbase,
> which allows you to set key, and columns generally is missing.
> You need to write specific custom serializer for any implementation which
> would make
> a sense for any production system.
> Anyone with pointers to rellevant custom implementations which allows
> configuration for key
> type and value, and also for column family data.
> Regards,
> Rani

View raw message