flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Percy <mpe...@apache.org>
Subject Re: How to load zip file into hdfs sink using flume-ng
Date Fri, 08 Feb 2013 22:13:57 GMT
Actually it might be tricky to use the directory spooling source to read a
compressed archive. It's possible, but you would definitely need to write
your own deserializer.

Flume is an event-oriented streaming system, it's not really optimized to
be a plain file transfer mechanism like FTP.

Regards,
Mike


On Fri, Feb 8, 2013 at 9:03 AM, Nitin Pawar <nitinpawar432@gmail.com> wrote:

> priyanka,
> you can do that flume-ng-1.3 using directory spooling
>
> just be aware what kind of channel you use
>
>
> On Fri, Feb 8, 2013 at 10:06 PM, Priyanka Jain <jainpriyanka1110@gmail.com
> > wrote:
>
>> Hi,,,
>> I want to know is it possible to load the zip file from remote location
>> to the hdfs sink in flume-ng-1.2
>>
>> Thanks in advance,
>> Priyanka
>>
>
>
>
> --
> Nitin Pawar
>

Mime
View raw message