flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Lord <jl...@cloudera.com>
Subject Re: Multiple flume agent on single machine
Date Thu, 13 Mar 2014 21:52:25 GMT
You can setup flume to use hdfs.proxyUser

https://cwiki.apache.org/confluence/display/FLUME/Flume+1.x+Secure+HDFS+Setup


On Thu, Mar 13, 2014 at 2:26 PM, Christopher Shannon
<cshannon108@gmail.com>wrote:

> What if your sinks have to write out to destinations that have different
> users and different levels of authorization? How is security managed by
> Flume?
> On Mar 6, 2014 8:56 AM, "Simeon Zaharici" <simeon_zaharici@yahoo.com>
> wrote:
>
>> Hello
>>
>> You do not need to run multiple flume agents, although this is possible.
>> You could just define multiple sources running on different ports in the
>> same flume agent, each one writing to its own Hbase sink.
>>
>> Regards,
>> Simeon
>>
>>
>>
>>   On Wednesday, March 5, 2014 11:30:56 PM, Chhaya Vishwakarma <
>> Chhaya.Vishwakarma@lntinfotech.com> wrote:
>>    Hi
>>
>> I have a problem statement where i need to collect data from multiple
>> machines(each machine forwarding data for different format) to centralized
>> storage(Hbase).
>> I need to make a different table for each type of log collected.
>> How can i do it using flume? Is it possible to run multiple flume agent
>> on same machine ? I can assign each type to one agent which will write to
>> hbase.
>>
>>
>> Regards,
>> Chhaya Vishwakarma
>>
>>
>> ------------------------------
>> The contents of this e-mail and any attachment(s) may contain
>> confidential or privileged information for the intended recipient(s).
>> Unintended recipients are prohibited from taking action on the basis of
>> information in this e-mail and using or disseminating the information, and
>> must notify the sender and delete it from their system. L&T Infotech will
>> not accept responsibility or liability for the accuracy or completeness of,
>> or the presence of any virus or disabling code in this e-mail"
>>
>>
>>

Mime
View raw message