flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher Shannon <cshannon...@gmail.com>
Subject Re: Multiple flume agent on single machine
Date Thu, 13 Mar 2014 22:16:06 GMT
This looks to be just what I need.

Thanx, Jeff

- Chris
On Mar 13, 2014 4:52 PM, "Jeff Lord" <jlord@cloudera.com> wrote:

> You can setup flume to use hdfs.proxyUser
>
>
> https://cwiki.apache.org/confluence/display/FLUME/Flume+1.x+Secure+HDFS+Setup
>
>
> On Thu, Mar 13, 2014 at 2:26 PM, Christopher Shannon <
> cshannon108@gmail.com> wrote:
>
>> What if your sinks have to write out to destinations that have different
>> users and different levels of authorization? How is security managed by
>> Flume?
>>  On Mar 6, 2014 8:56 AM, "Simeon Zaharici" <simeon_zaharici@yahoo.com>
>> wrote:
>>
>>> Hello
>>>
>>> You do not need to run multiple flume agents, although this is possible.
>>> You could just define multiple sources running on different ports in the
>>> same flume agent, each one writing to its own Hbase sink.
>>>
>>> Regards,
>>> Simeon
>>>
>>>
>>>
>>>   On Wednesday, March 5, 2014 11:30:56 PM, Chhaya Vishwakarma <
>>> Chhaya.Vishwakarma@lntinfotech.com> wrote:
>>>    Hi
>>>
>>> I have a problem statement where i need to collect data from multiple
>>> machines(each machine forwarding data for different format) to centralized
>>> storage(Hbase).
>>> I need to make a different table for each type of log collected.
>>> How can i do it using flume? Is it possible to run multiple flume agent
>>> on same machine ? I can assign each type to one agent which will write to
>>> hbase.
>>>
>>>
>>> Regards,
>>> Chhaya Vishwakarma
>>>
>>>
>>> ------------------------------
>>> The contents of this e-mail and any attachment(s) may contain
>>> confidential or privileged information for the intended recipient(s).
>>> Unintended recipients are prohibited from taking action on the basis of
>>> information in this e-mail and using or disseminating the information, and
>>> must notify the sender and delete it from their system. L&T Infotech will
>>> not accept responsibility or liability for the accuracy or completeness of,
>>> or the presence of any virus or disabling code in this e-mail"
>>>
>>>
>>>
>

Mime
View raw message