flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Buntu Dev <buntu...@gmail.com>
Subject Kafka source with Avro throwing "Could not find schema for event" exception
Date Tue, 08 Sep 2015 20:30:17 GMT
I got Flume configured to read Avro events from Kafka source and I'm also
attaching the schema like this:

~~~
f1.sources.kafka-source.interceptors.attach-f1-schema.type = static
f1.sources.kafka-source.interceptors.attach-f1-schema.key =
flume.avro.schema.url
f1.sources.kafka-source.interceptors.attach-f1-schema.value =
file:/path/to/schema.avsc
~~~

But I keep running into this error:

~~~~~
org.apache.flume.FlumeException: Could not find schema for event
org.apache.flume.channel.file.FlumeEvent@774c6264
at
org.apache.flume.sink.hdfs.AvroEventSerializer.initialize(AvroEventSerializer.java:124)
at
org.apache.flume.sink.hdfs.AvroEventSerializer.write(AvroEventSerializer.java:106)
at org.apache.flume.sink.hdfs.HDFSDataStream.append(HDFSDataStream.java:124)
at org.apache.flume.sink.hdfs.BucketWriter$7.call(BucketWriter.java:550)
at org.apache.flume.sink.hdfs.BucketWriter$7.call(BucketWriter.java:547)
at org.apache.flume.sink.hdfs.BucketWriter$9$1.run(BucketWriter.java:679)
at
org.apache.flume.auth.SimpleAuthenticator.execute(SimpleAuthenticator.java:50)
at org.apache.flume.sink.hdfs.BucketWriter$9.call(BucketWriter.java:676)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
~~~~

Anything else I'm missing here?


Thanks!

Mime
View raw message