flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Sammer <esam...@cloudera.com>
Subject Re: Flume flume.master.savefile
Date Tue, 26 Jul 2011 02:48:17 GMT
We require ZK now, we just embed it for those that don't want to set
it up themselves. :)

On Mon, Jul 25, 2011 at 7:30 PM, Mike <miketheman@gmail.com> wrote:
> Would this change the way a pseudo-cluster would work? As in, to get a
> starting environment, would you now require a ZK instance?
> if that's the case, then having some sort of persistence is still desirable.
>
> On Mon, Jul 25, 2011 at 10:19 PM, Eric Sammer <esammer@cloudera.com> wrote:
>> Jon:
>>
>> As a side note (and open to the community), do you think it makes
>> sense to deprecate this? I saw it today and was surprised it's still
>> around.
>>
>> On Mon, Jul 25, 2011 at 3:24 PM, Jonathan Hsieh <jon@cloudera.com> wrote:
>>> [Please subscribe to new flume-user@incubator.apache.org list,
>>> bcc flume-user@cloudera.org, cc flume-user@incubator.apache.org]
>>> Prashanth,
>>> Which mode is your master using?  If you are using any ZK mode the configs
>>> should be persistent, and survive master restarts.
>>> The flume.master.savefile is an old setting that doesn't support all the
>>> things that the master now keeps track of.  It was used before the ZK
>>> backend was added to the master.  It is still usable for basic
>>> configrutions, and I believe only "auto-loads" when using memory backed
>>> flume master (but I'd need to check -- its been a long time).
>>> You could take the file that is created and execute a "exec load <filename>"
>>> in the shell to read and load the configs from the file.
>>> Jon.
>>> On Tue, Jul 19, 2011 at 4:42 PM, Prashanth R <r.prashanth@gmail.com> wrote:
>>>>
>>>> A bit of a context:
>>>>
>>>> Right now, if the flume master is restarted, it loses all the
>>>> configurations  / mappings that are set. I would ideally like it to
>>>> pick these configurations from a file when it initializes. Is there a
>>>> good way of doing this?
>>>>
>>>> - Prashanth
>>>>
>>>> On Mon, Jul 18, 2011 at 5:59 PM, Prashanth R <r.prashanth@gmail.com>
>>>> wrote:
>>>> > Does anyone know if the property 'flume.master.savefile' in
>>>> > flume-site.xml is valid and can be safely used to initalize node
>>>> > configurations  after a startup ? if so, the format of the commands
>>>> > inside the file.
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > - Prash
>>>> >
>>>>
>>>>
>>>>
>>>> --
>>>> - Prash
>>>
>>>
>>>
>>> --
>>> // Jonathan Hsieh (shay)
>>> // Software Engineer, Cloudera
>>> // jon@cloudera.com
>>>
>>>
>>
>>
>>
>> --
>> Eric Sammer
>> twitter: esammer
>> data: www.cloudera.com
>>
>



-- 
Eric Sammer
twitter: esammer
data: www.cloudera.com

Mime
View raw message