flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: IIS Web server Logs
Date Thu, 19 Nov 2015 09:24:11 GMT
I see two options, either run a Flume agent on windows that spools the
local dir and either has access to hdfs or talks to other Flume agents
which do
Or you can have a small script scheduled on a regular basis to get logs and
post them to Flume.


On 19 November 2015 at 09:07, chandra sekar <thittaisekar@hotmail.com>

> Dear all,
> I am new to Apache Flume. I have 5 Cluster Hadoop (YARN) node running on
> Linux machine.  I would like to stream IIS webserver logs located at same
> subnet network to HDFS via Flume.
> Do I need to run Flume-ng on the Windows Server machines which is running
> web server. Can you please let me know detailed guideline  and
> configuration file.
> I have archived Linux Realtime syslogs streaming to HDFS in the same
> cluster environment. But no idea in remote server environment.
> Regards
> Shekar.

View raw message