flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug McClure <dmccl...@gmail.com>
Subject Flume 1.6 and Java 1.8 with spooldir source bug?
Date Thu, 17 Sep 2015 19:06:04 GMT
When trying to use Flume 1.6 and the spooldir source I'm getting this
error.  Other sources work fine.  Are there known issues with Java 1.8.0_51?

Tks - Doug


*agent source*

agent.sources.spooldir-source-1.type = spooldir
agent.sources.spooldir-source-1.spoolDir = /opt/flumelogs/
agent.sources.spooldir-source-1.fileHeader = true
agent.sources.spooldir-source-1.basenameHeader = true


*error*

17 Sep 2015 12:13:35,417 INFO  [conf-file-poller-0]
(org.apache.flume.node.Application.startAllComponents:184)  - Starting
Source spooldir-source-1
17 Sep 2015 12:13:35,418 INFO  [lifecycleSupervisor-1-7]
(org.apache.flume.source.SpoolDirectorySource.start:78)  -
SpoolDirectorySource source starting with directory: /opt/scala/flumelogs/
17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
(org.apache.flume.instrumentation.MonitoredCounterGroup.register:120)  -
Monitored counter group for type: SOURCE, name: spooldir-source-1:
Successfully registered new MBean.
17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
(org.apache.flume.instrumentation.MonitoredCounterGroup.start:96)  -
Component type: SOURCE, name: spooldir-source-1 started
17 Sep 2015 12:13:35,764 ERROR [pool-3-thread-1]
(org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run:256)
 - FATAL: Spool Directory source spooldir-source-1: { spoolDir:
/opt/flumelogs/ }: Uncaught exception in SpoolDirectorySource thread.
Restart or reconfigure Flume to continue processing.
java.lang.UnsupportedClassVersionError: org/apache/avro/io/DatumWriter :
Unsupported major.minor version 51.0
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
        at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
        at
org.apache.flume.client.avro.ReliableSpoolingFileEventReader.openFile(ReliableSpoolingFileEventReader.java:501)
        at
org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getNextFile(ReliableSpoolingFileEventReader.java:482)
        at
org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:243)
        at
org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:228)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:701)
17 Sep 2015 12:13:35,824 INFO  [lifecycleSupervisor-1-6]
(org.apache.flume.source.SyslogTcpSource.start:119)  - Syslog TCP Source
starting...


*java-version*

openjdk version "1.8.0_51"
OpenJDK Runtime Environment (build 1.8.0_51-b16)
OpenJDK 64-Bit Server VM (build 25.51-b03, mixed mode)

Mime
View raw message