flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Sell <trs...@gmail.com>
Subject Re: escaped value decorator
Date Tue, 20 Sep 2011 16:37:20 GMT
This is immensly frustrating, the exact same decorator works on some
agents but on others, both agents are tailing files.

The decorator is:
value( "logsource", "%{host}", escape=true )

but for one the collector is creating files that look like this:
hdfs://<dfs>/user/flume/weblogs/2011/09/20/%{host}/file-20110920-173207097+0100.2535572882015521.00000023.tmp

and the other it's creating files that look like this:
hdfs://<dfs>/user/flume/rabbiteater/2011/09/20/of1-dev-tim/file-20110920-173238091+0100.2535603876046813.00000044.tmp


On 20 September 2011 17:23, Tim Sell <trsell@gmail.com> wrote:
> oh maybe I was just really tired...
>
> On 20 September 2011 17:18, Tim Sell <trsell@gmail.com> wrote:
>> turns out that was the correct format, and it does escape it correctly
>> if I'm using a collector, but not if I log to console(avrojson).
>>
>> On 20 September 2011 16:29, Tim Sell <trsell@gmail.com> wrote:
>>> What is the correct way to escape the value decorator? the
>>> documentation doesn't give any examples.\
>>>
>>> If for example I want to include the host in another attribute, is this correct?
>>>
>>> value("attr", "%{host}", escape=true)
>>>
>>> Because I am just getting the string "%{host}" as the attribute value.
>>>
>>
>

Mime
View raw message