flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul Chavez <pcha...@verticalsearchworks.com>
Subject RE: HDFS custom escape sequence
Date Mon, 10 Jun 2013 22:05:27 GMT
Yes, any header works using that same notation. I use it to allow us to bucket many event 'types'
with a single channel.

for example, a path with custom headers and Hive ready partition folders:
/flumelogs/%{someHeader}/%{someOtherHeader}/datekey=%Y%m%d/hour=%H

Hope that helps,
Paul Chavez

________________________________
From: Camp, Roy [mailto:rcamp@ebay.com]
Sent: Monday, June 10, 2013 2:51 PM
To: user@flume.apache.org
Subject: HDFS custom escape sequence

Is it possible to use other headers besides the host header, %{host} escape sequence, to name
the HDFS files?  We are interested in attaching a category header and want the events stored
separately.

If not possible, is there a best practice for achieving this?

Thanks,

Roy



Mime
View raw message