flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Iván Fernández Perea <ivan.fernandez.pe...@gmail.com>
Subject Re: move file as they are with flume
Date Tue, 04 Mar 2014 10:06:01 GMT
Hi Jeff,

we are using spooling directory source. Finally we have coded our own
interceptor to add the basename to our events. In the next flume release,
we'll use the basename key as you suggested.

Many thanks,
Iván.


2014-03-03 18:15 GMT+01:00 Jeff Lord <jlord@cloudera.com>:

> Are you using the spooling directory source?
> We added the ability to just set the basename of a file (without
> absolute path) in FLUME-2056. Allow SpoolDir to pass just the filename
> that is the source of an event.
>
> On Fri, Feb 28, 2014 at 7:01 AM, Iván Fernández Perea
> <ivan.fernandez.perea@gmail.com> wrote:
> > Hi,
> >
> > I'm a newbie and I'm just wondering if it's possible to move a file from
> a
> > source to a sink as it is (exact file name and the same content).
> Basically
> > a cp or a put operation with hadoop.
> >
> > I was trying to use fileHeader property in the sink side, but it seems
> that
> > flume creates those files within the absolute folder path (not only the
> file
> > name).
> >
> >
>



-- 
Visit my blog:
http://java4developers.com/

Mime
View raw message