flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pavel Zalunin <wr4b...@gmail.com>
Subject Re: Dynamic sink configuration
Date Tue, 28 Oct 2014 23:54:49 GMT
Hi,

We have embedded agent, zookeeper is huge overhead.

Pavel.

2014-10-28 20:11 GMT+03:00 Paweł Róg <prog88@gmail.com>:

> Hi,
> And as far as I know flume can be configured by zookeeper :D
>
> https://issues.apache.org/jira/browse/FLUME-1491
>
> --
> Pawel Rog
>
> 2014-10-28 17:02 GMT+01:00 Otis Gospodnetic <otis.gospodnetic@gmail.com>:
>
>> As far as I know, Flume is configured only through the config and I
>> *think* Flume automatically reloads the config when it detects the config
>> changed - at least that is what Ashish wrote here:
>> http://search-hadoop.com/m/DEeB4w0kHg1
>>
>> Otis
>> --
>> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>> Solr & Elasticsearch Support * http://sematext.com/
>>
>>
>> On Mon, Oct 27, 2014 at 7:42 PM, Pavel Zalunin <wr4bbit@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> We have embedded flume agent and we need to update some parameters
>>> dynamically after sink/source runners are started.
>>>
>>> For example, having sink which sends events to some url. At some point
>>> we need to change this url (add request parameter for example).
>>>
>>> Straightforward way is to add method which will accept changes and
>>> update internal state, but it looks like a 'hack', because all flume sinks,
>>> that I've seen configured just once.
>>>
>>> Maybe there are another, 'flume-way' to do such things?
>>>
>>> Is restarting sink (I think restart other related things also needed)
>>> only one option?
>>>
>>> Thanks,
>>> Pavel.
>>>
>>
>>
>

Mime
View raw message