flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: Flume 1.6 and Java 1.8 with spooldir source bug?
Date Thu, 17 Sep 2015 21:05:37 GMT
Does it happen with Oracle JDK 8 or is only with OpenJDK?

Regards,
Gonzalo
On Sep 17, 2015 8:06 PM, "Doug McClure" <dmcclure@gmail.com> wrote:

> When trying to use Flume 1.6 and the spooldir source I'm getting this
> error.  Other sources work fine.  Are there known issues with Java 1.8.0_51?
>
> Tks - Doug
>
>
> *agent source*
>
> agent.sources.spooldir-source-1.type = spooldir
> agent.sources.spooldir-source-1.spoolDir = /opt/flumelogs/
> agent.sources.spooldir-source-1.fileHeader = true
> agent.sources.spooldir-source-1.basenameHeader = true
>
>
> *error*
>
> 17 Sep 2015 12:13:35,417 INFO  [conf-file-poller-0]
> (org.apache.flume.node.Application.startAllComponents:184)  - Starting
> Source spooldir-source-1
> 17 Sep 2015 12:13:35,418 INFO  [lifecycleSupervisor-1-7]
> (org.apache.flume.source.SpoolDirectorySource.start:78)  -
> SpoolDirectorySource source starting with directory: /opt/scala/flumelogs/
> 17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
> (org.apache.flume.instrumentation.MonitoredCounterGroup.register:120)  -
> Monitored counter group for type: SOURCE, name: spooldir-source-1:
> Successfully registered new MBean.
> 17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
> (org.apache.flume.instrumentation.MonitoredCounterGroup.start:96)  -
> Component type: SOURCE, name: spooldir-source-1 started
> 17 Sep 2015 12:13:35,764 ERROR [pool-3-thread-1]
> (org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run:256)
>  - FATAL: Spool Directory source spooldir-source-1: { spoolDir:
> /opt/flumelogs/ }: Uncaught exception in SpoolDirectorySource thread.
> Restart or reconfigure Flume to continue processing.
> java.lang.UnsupportedClassVersionError: org/apache/avro/io/DatumWriter :
> Unsupported major.minor version 51.0
>         at java.lang.ClassLoader.defineClass1(Native Method)
>         at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
>         at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>         at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
>         at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
>         at
> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.openFile(ReliableSpoolingFileEventReader.java:501)
>         at
> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getNextFile(ReliableSpoolingFileEventReader.java:482)
>         at
> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:243)
>         at
> org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:228)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at
> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:701)
> 17 Sep 2015 12:13:35,824 INFO  [lifecycleSupervisor-1-6]
> (org.apache.flume.source.SyslogTcpSource.start:119)  - Syslog TCP Source
> starting...
>
>
> *java-version*
>
> openjdk version "1.8.0_51"
> OpenJDK Runtime Environment (build 1.8.0_51-b16)
> OpenJDK 64-Bit Server VM (build 25.51-b03, mixed mode)
>
>
>
>

Mime
View raw message