flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Shreedharan <hshreedha...@cloudera.com>
Subject Re: Flume 1.6 Install question
Date Thu, 13 Aug 2015 22:49:36 GMT
Looks like you are missing Hadoop on the classpath. To write to HDFS you
need HDFS client lib (and its dependencies) in the classpath


Thanks,
Hari

On Thu, Aug 13, 2015 at 3:31 PM, Sutanu Das <sd2302@att.com> wrote:

> Johny/Community,
>
>
>
> Tried the binary version but getting this error when running an agent, I
> just want to run Flume server and I don’t have Hadoop or HDP
>
>
>
>
>
> Any thoughts ?
>
>
>
>
>
>
>
> 13 Aug 2015 22:28:15,749 ERROR [conf-file-poller-0]
> (org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run:145)
> *- Failed to start agent because dependencies were not found in classpath.
> Error follows.*
>
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/io/SequenceFile$CompressionType
>
>         at
> org.apache.flume.sink.hdfs.HDFSEventSink.configure(HDFSEventSink.java:239)
>
>         at
> org.apache.flume.conf.Configurables.configure(Configurables.java:41)
>
>         at
> org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:413)
>
>         at
> org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:98)
>
>         at
> org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
>
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
>
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
>
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
>         at java.lang.Thread.run(Thread.java:744)
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.io.SequenceFile$CompressionType
>
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
>         ... 12 more
>
>
>
> *From:* Johny Rufus [mailto:jrufus@cloudera.com]
> *Sent:* Wednesday, July 22, 2015 4:08 PM
> *To:* user@flume.apache.org
> *Subject:* Re: Flume 1.6 Install question
>
>
>
> Do you want to build Flume from source ? If not you can just download the
> binary version.
>
>
>
> https://cwiki.apache.org/confluence/display/FLUME/Getting+Started   this
> should give you a fairly good idea of how to proceed.
>
>
> Thanks,
>
> Rufus
>
>
>
> On Wed, Jul 22, 2015 at 12:47 PM, Sutanu Das <sd2302@att.com> wrote:
>
> Hello,
>
>
>
> How do I install Flume 1.6 for git clone?
>
>
>
> I already did this:
>
>
>
> git clone https://git-wip-us.apache.org/repos/asf/flume.git flume
>
>
>
>
>
> Question:
>
>
>
> Do I have to compile the code now with Maven before I can use Flume?
>
>
>
> Please help advise - thanks
>
>
>
>
>

Mime
View raw message