flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: about flume-ng agent
Date Thu, 25 Oct 2012 16:21:49 GMT
If you cannot use RPCclient (project is not in java), then writing the
events to syslog and then sending those events to a "collector" agent
running syslog source is probably the best option. A worse option
would be to use exec source with tail -F. This is "worse" because it
can easily lose large amounts of data.


On Thu, Oct 25, 2012 at 11:00 AM, lancexxx <fervent.linux@gmail.com> wrote:
> oh, seemingly ,I see. sorry , I am new to flume.
> now I collect log from web server and want to use syslogudp source,
> which tool or  RPCclient  I should use to sent the data to the source of
> flume-ng agent
> on web server host ? maybe can you recommend to me a better source type like
> AVRO source,
> syslog source etc. because I do not realized the difference or advantage
> between them and
> I find no more information via the official guide。
> thanks very much!
> --
> lancexxx
> On 2012年10月25日Thursday at 下午10:37, Brock Noland wrote:
> Either the webserver must run a flume agent, the webserver must use
> the RPCClient (just a java object, not an agent) or the webserver can
> use the log4j appender.
> Brock
> On Wed, Oct 24, 2012 at 10:51 PM, lancexxx <fervent.linux@gmail.com> wrote:
> hi
> I do not understand that every host of webserser must run a flume-ng agent
> if I collect weblog?
> if no ,well then the client(web server host) how to sent the log to the
> flume-ng agent host in the internet?
> --
> thanks!
> lancexxx
> --
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

View raw message