livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject unable to pass Jackson Avro Object to a Job
Date Mon, 26 Mar 2018 09:00:34 GMT
Hi All,

I wanted to pass

org.apache.avro.Schema

object to a Job via constructor however since the schema object is not
serializable I used jackson-dataformat-avro to pass

com.fasterxml.jackson.dataformat.avro.AvroSchema

but now I get the error below.  Any suggestions?


org.apache.livy.shaded.kryo.kryo.KryoException: Unable to find class: alues
18/03/26 01:26:05 INFO LineBufferedStream: stdout: Serialization trace:
18/03/26 01:26:05 INFO LineBufferedStream: stdout: fieldMap
(org.apache.avro.Schema$RecordSchema)
18/03/26 01:26:05 INFO LineBufferedStream: stdout: _writerSchema
(com.fasterxml.jackson.dataformat.avro.AvroSchema)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.util.DefaultClassResolver.readName(DefaultClassResolver.java:138)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:115)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.Kryo.readClass(Kryo.java:656)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.Kryo.readClassAndObject(Kryo.java:767)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.MapSerializer.read(MapSerializer.java:139)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.MapSerializer.read(MapSerializer.java:17)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.Kryo.readObject(Kryo.java:694)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.ObjectField.read(ObjectField.java:106)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.Kryo.readObject(Kryo.java:694)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.ObjectField.read(ObjectField.java:106)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.Kryo.readObject(Kryo.java:694)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.ObjectField.read(ObjectField.java:106)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.Kryo.readClassAndObject(Kryo.java:776)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.client.common.Serializer.deserialize(Serializer.java:63)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.rsc.driver.BypassJob.call(BypassJob.java:39)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.rsc.driver.BypassJob.call(BypassJob.java:27)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.rsc.driver.JobWrapper.call(JobWrapper.java:57)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.rsc.driver.BypassJobWrapper.call(BypassJobWrapper.java:42)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.rsc.driver.BypassJobWrapper.call(BypassJobWrapper.java:27)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.lang.Thread.run(Thread.java:745)
18/03/26 01:26:05 INFO LineBufferedStream: stdout: Caused by:
java.lang.ClassNotFoundException: alues
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.net.URLClassLoader.findClass(URLClassLoader.java:381)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.lang.ClassLoader.loadClass(ClassLoader.java:424)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.lang.ClassLoader.loadClass(ClassLoader.java:357)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.lang.Class.forName0(Native Method)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
java.lang.Class.forName(Class.java:348)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  at
org.apache.livy.shaded.kryo.kryo.util.DefaultClassResolver.readName(DefaultClassResolver.java:136)
18/03/26 01:26:05 INFO LineBufferedStream: stdout:  ... 25 more


Thanks!

Mime
View raw message