flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish <paliwalash...@gmail.com>
Subject Re: Need help on spooling directory source
Date Tue, 18 Nov 2014 06:01:46 GMT
AFAIK, it doesn't work recursively. It would pick files only from
specified directory.

Here is the patch you can try https://issues.apache.org/jira/browse/FLUME-1899

HTH !


On Tue, Nov 18, 2014 at 11:21 AM, mahendran m <mahendranec@hotmail.com> wrote:
> Hi All,
>
> I was working on moving the IIS logs into HDFS using flume spooling
> directory source
> i was running the 3 website in IIS server , so my logging directory will
> looks like below
>
> LogFiles
>
> |
> |-- W3SVC1
>
> |   |
>
> |        `--website1.log
>
> |
>
> |-- W3SVC1
>
> |   |
>
> |        `--website2.log
>
> |
>
> `-- W3SCV3
>     |
>     `-- website3.log
>
>
>
> Now my use case is that i want to move the log of website 3 that  is
> website3.log file to HDFS. So i have configured the  CONF file as below
>
>
>
> agent1.sources.spool.spoolDir =C:\\inetpub\\logs\\LogFiles\\W3SVC3
>
>
> and it is works perfectly . now My use case is changed that i want move all
> the log files under the folder LogFiles  , now  i changed the CONF as below
>
>
> agent1.sources.spool.spoolDir =C:\\inetpub\\logs\\LogFiles
>
>
> but it does not working . not moving any files from LogFiles directory. How
> can i achieve my use case ?
>
>
> Thanks,
>
> Mahendran
>
>



-- 
thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal

Mime
View raw message