java - Hive: Kryo Exception -


i'm executing 1 of hql query has few joins, union , insert overwrite operation, working fine if run once.
if execute same job second time, i'm facing issue. can me identify in scenario exception?

error: java.lang.runtimeexception: org.apache.hive.com.esotericsoftware.kryo.kryoexception: encountered unregistered class id: 107 serialization trace: rowschema (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.filteroperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.unionoperator) childoperators (org.apache.hadoop.hive.ql.exec.tablescanoperator) aliastowork (org.apache.hadoop.hive.ql.plan.mapwork)     @ org.apache.hadoop.hive.ql.exec.utilities.getbasework(utilities.java:364)     @ org.apache.hadoop.hive.ql.exec.utilities.getmapwork(utilities.java:275)     @ org.apache.hadoop.hive.ql.io.hiveinputformat.init(hiveinputformat.java:254)     @ org.apache.hadoop.hive.ql.io.hiveinputformat.pushprojectionsandfilters(hiveinputformat.java:440)     @ org.apache.hadoop.hive.ql.io.hiveinputformat.pushprojectionsandfilters(hiveinputformat.java:433)     @ org.apache.hadoop.hive.ql.io.combinehiveinputformat.getrecordreader(combinehiveinputformat.java:587)     @ org.apache.hadoop.mapred.maptask$trackedrecordreader.<init>(maptask.java:169)     @ org.apache.hadoop.mapred.maptask.runoldmapper(maptask.java:429)     @ org.apache.hadoop.mapred.maptask.run(maptask.java:343)     @ org.apache.hadoop.mapred.yarnchild$2.run(yarnchild.java:168)     @ java.security.accesscontroller.doprivileged(native method)     @ javax.security.auth.subject.doas(subject.java:415)     @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1614)     @ org.apache.hadoop.mapred.yarnchild.main(yarnchild.java:163) caused by: org.apache.hive.com.esotericsoftware.kryo.kryoexception: encountered unregistered class id: 107 serialization trace: rowschema (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.filteroperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.unionoperator) childoperators (org.apache.hadoop.hive.ql.exec.tablescanoperator) aliastowork (org.apache.hadoop.hive.ql.plan.mapwork) 

avoid hive's parallel execution modifying below property false.

hive.exec.parallel

let me know if works you.


Comments

Popular posts from this blog

php - failed to open stream: HTTP request failed! HTTP/1.0 400 Bad Request -

java - How to filter a backspace keyboard input -

java - Show Soft Keyboard when EditText Appears -