java - Hive: Kryo Exception -
i'm executing 1 of hql query has few joins, union , insert overwrite operation, working fine if run once.
if execute same job second time, i'm facing issue. can me identify in scenario exception?
error: java.lang.runtimeexception: org.apache.hive.com.esotericsoftware.kryo.kryoexception: encountered unregistered class id: 107 serialization trace: rowschema (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.filteroperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.unionoperator) childoperators (org.apache.hadoop.hive.ql.exec.tablescanoperator) aliastowork (org.apache.hadoop.hive.ql.plan.mapwork) @ org.apache.hadoop.hive.ql.exec.utilities.getbasework(utilities.java:364) @ org.apache.hadoop.hive.ql.exec.utilities.getmapwork(utilities.java:275) @ org.apache.hadoop.hive.ql.io.hiveinputformat.init(hiveinputformat.java:254) @ org.apache.hadoop.hive.ql.io.hiveinputformat.pushprojectionsandfilters(hiveinputformat.java:440) @ org.apache.hadoop.hive.ql.io.hiveinputformat.pushprojectionsandfilters(hiveinputformat.java:433) @ org.apache.hadoop.hive.ql.io.combinehiveinputformat.getrecordreader(combinehiveinputformat.java:587) @ org.apache.hadoop.mapred.maptask$trackedrecordreader.<init>(maptask.java:169) @ org.apache.hadoop.mapred.maptask.runoldmapper(maptask.java:429) @ org.apache.hadoop.mapred.maptask.run(maptask.java:343) @ org.apache.hadoop.mapred.yarnchild$2.run(yarnchild.java:168) @ java.security.accesscontroller.doprivileged(native method) @ javax.security.auth.subject.doas(subject.java:415) @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1614) @ org.apache.hadoop.mapred.yarnchild.main(yarnchild.java:163) caused by: org.apache.hive.com.esotericsoftware.kryo.kryoexception: encountered unregistered class id: 107 serialization trace: rowschema (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.mapjoinoperator) parentoperators (org.apache.hadoop.hive.ql.exec.filteroperator) parentoperators (org.apache.hadoop.hive.ql.exec.selectoperator) parentoperators (org.apache.hadoop.hive.ql.exec.unionoperator) childoperators (org.apache.hadoop.hive.ql.exec.tablescanoperator) aliastowork (org.apache.hadoop.hive.ql.plan.mapwork)
avoid hive's parallel execution modifying below property false.
hive.exec.parallel
let me know if works you.
Comments
Post a Comment