flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike <mikethe...@gmail.com>
Subject Re: Flume flume.master.savefile
Date Tue, 26 Jul 2011 02:30:47 GMT
Would this change the way a pseudo-cluster would work? As in, to get a
starting environment, would you now require a ZK instance?
if that's the case, then having some sort of persistence is still desirable.

On Mon, Jul 25, 2011 at 10:19 PM, Eric Sammer <esammer@cloudera.com> wrote:
> Jon:
>
> As a side note (and open to the community), do you think it makes
> sense to deprecate this? I saw it today and was surprised it's still
> around.
>
> On Mon, Jul 25, 2011 at 3:24 PM, Jonathan Hsieh <jon@cloudera.com> wrote:
>> [Please subscribe to new flume-user@incubator.apache.org list,
>> bcc flume-user@cloudera.org, cc flume-user@incubator.apache.org]
>> Prashanth,
>> Which mode is your master using?  If you are using any ZK mode the configs
>> should be persistent, and survive master restarts.
>> The flume.master.savefile is an old setting that doesn't support all the
>> things that the master now keeps track of.  It was used before the ZK
>> backend was added to the master.  It is still usable for basic
>> configrutions, and I believe only "auto-loads" when using memory backed
>> flume master (but I'd need to check -- its been a long time).
>> You could take the file that is created and execute a "exec load <filename>"
>> in the shell to read and load the configs from the file.
>> Jon.
>> On Tue, Jul 19, 2011 at 4:42 PM, Prashanth R <r.prashanth@gmail.com> wrote:
>>>
>>> A bit of a context:
>>>
>>> Right now, if the flume master is restarted, it loses all the
>>> configurations  / mappings that are set. I would ideally like it to
>>> pick these configurations from a file when it initializes. Is there a
>>> good way of doing this?
>>>
>>> - Prashanth
>>>
>>> On Mon, Jul 18, 2011 at 5:59 PM, Prashanth R <r.prashanth@gmail.com>
>>> wrote:
>>> > Does anyone know if the property 'flume.master.savefile' in
>>> > flume-site.xml is valid and can be safely used to initalize node
>>> > configurations  after a startup ? if so, the format of the commands
>>> > inside the file.
>>> >
>>> >
>>> >
>>> > --
>>> > - Prash
>>> >
>>>
>>>
>>>
>>> --
>>> - Prash
>>
>>
>>
>> --
>> // Jonathan Hsieh (shay)
>> // Software Engineer, Cloudera
>> // jon@cloudera.com
>>
>>
>
>
>
> --
> Eric Sammer
> twitter: esammer
> data: www.cloudera.com
>

Mime
View raw message