flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Lorenz <wget.n...@gmail.com>
Subject Re: About data collection with flume problem
Date Tue, 23 Oct 2012 07:56:28 GMT

Do you use Flume 1.x? If so, attach please your running flume config. I assume you have successful
running a hdfs - cluster.

- Alex

On Oct 13, 2012, at 8:17 AM, Harsh J <harsh@cloudera.com> wrote:

> Am redirecting your question to the Apache Flume users list
> (user@flume.apache.org) which is a better place to send these type of
> questions to:
> =====
> Hi,
> I am interested in hadoop nowadays.I installed the hadoop also
> flume,zookeeper,hbase etc.I have read the tutorials of
> hadoop,flume,hbase,pig,hdfs.Also I have applied some examples
> according to the tutorials.
> I have some questions.I want to ask you so I want to learn these
> tech.I like it.
> I want to collect data from web server log or any data in documents.
> /var/log/apache2/access.log.1 --> log documentsI want to see these
> logs in hdfs file
> I run thisflume node_nowatch -n "collector"flume node_nowatch -n "agent"
> then
> See the flume_master_page.png
> I create the configuration in flume master in config page:
> agent: tail("/var/log/apache2/access.log.1") |
> agentSink("localhost",35853);collector: collectorSource(35853) |
> collectorSink("hdfs://localhost:9000/user/oracle/flume/",
> "access.log.1");
> After that ı didnt see the log files in the hadoop file
> See the hdfs.png
> Can you show me the truth way for data collections in flume architecture?
> Thank you for all thing
> -- 
> Harsh J

Alexander Alten-Lorenz
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

View raw message