java - Error Starting Apache Storm Supervisor -
i trying restart apache storm cluster , running issues. have 2 supervisors not restart. when @ supervisor logs, see following error:
java.lang.runtimeexception: java.io.streamcorruptedexception: invalid stream header: 00000000 @ backtype.storm.serialization.defaultserializationdelegate.deserialize(defaultserializationdelegate.java:56) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.utils.utils.deserialize(utils.java:89) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.utils.localstate.deserializelatestversion(localstate.java:65) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.utils.localstate.snapshot(localstate.java:47) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.utils.localstate.get(localstate.java:72) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.daemon.supervisor$read_worker_heartbeat.invoke.(supervisor.clj:96) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.daemon.supervisor$read_worker_heartbeats$iter__3992__3996$fn__3997.invoke(supervisor.clj:109) ~[storm-core-0.9.3.jar:0.9.3] @ clojure.lang.lazyseq.sval(lazyseq.java:42) ~[clojure-1.5.1.jar:na] @ clojure.lang.lazyseq.seq(lazyseq.java:60) ~[clojure-1.5.1.jar:na] @ clojure.lang.rt.seq(rt.java:484) ~[clojure-1.5.1.jar:na] @ clojure.core$seq.invoke(core.clj:133) ~[clojure-1.5.1.jar:na] @ clojure.core$dorun.invoke(core.clj:2780) ~[clojure-1.5.1.jar:na] @ clojure.core$doall.invoke(core.clj:2796) ~[clojure-1.5.1.jar:na] @ backtype.storm.daemon.supervisor$read_worker_heartbeats.invoke(supervisor.clj:108) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.daemon.supervisor$read_allocated_workers.invoke(supervisor.clj:125) ~[storm-core-0.9.3.jar:0.9.3] @ backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:230) ~[storm-core-0.9.3.jar:0.9.3] @ clojure.lang.afn.applytohelper(afn.java:161) ~[clojure-1.5.1.jar:na] @ clojure.lang.afn.applyto(afn.java:151) ~[clojure-1.5.1.jar:na] @ clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na] @ clojure.core$partial$fn__4190.doinvoke(core.clj:2396) ~[clojure-1.5.1.jar:na] @ clojure.lang.restfn.invoke(restfn.java:397) ~[clojure-1.5.1.jar:na] @ backtype.storm.event$event_manager$fn__2467.invoke(event.clj:40) ~[storm-core-0.9.3.jar:0.9.3] @ clojure.lang.afn.run(afn.java:24) ~[clojure-1.5.1.jar:na] @ java.lang.thread.run(thread.java:853) [na:1.7.0] caused java.io.streamcorruptedexceptionl invalid stream header: 00000000 @ java.io.objectinputstream.readstreamheader(objectinputstream.java:885) @ java.io.objectinputstream.<init>(objectinputstream.java:348) @ backtype.storm.serialization.defaultserializationdelegate.deserialized(defaultserializationdelegate.java:51) ... 23 common frames omitted 2015-04-29t10:36:34.096+0000 b.s.util [error] halting process: ("error when processing event") java.lang.runtimeexception: ("error when processing event") @ backtype.storm.util$exit_process_bang_.doinvoke(util.clj:325) @ clojure.lang.restfn.invoke(restfn.java:423) @ backtype.storm.event$event_manager$fn__2467.invoke(event.clj:48) @ clojure.lang.afn.run(afn.java:24) @ java.lang.thread.run(thread.java:853)
i guessing error has data assigned supervisor corrupt now. best way handle corrupt data? new storm , know basic info it.
storm 0.9.3 java - ibm j9 vm (build 2.7, jre 1.7.0 linux ppc64-64)
so there files under worker directory. these files corrupt , had delete under workers directory. restarted supervisor , started working again.
Comments
Post a Comment