- Get All Questions & Answer for CDP Generalist Exam (CDP-0011) and trainings.
- Get All Questions & Answer for CDP Administrator - Private Cloud Base Exam CDP-2001 and trainings.
- Get All Questions & Answer for CDP Data Developer Exam CDP-3001 and trainings.
This Question is from QuickTechie Cloudera CDP Certification Preparation Kit.
When I played with Kafka-Storm streaming analysis, I often met the problem
java.lang.RuntimeException: Could not find leader nimbus from seed hosts
And I even cannot kill the related topology through StormUI or command line.
I think it is because I got stale topology data in storm and zookeeper. My solution is to do directory clean up manually. This idea is borrowed from the bash files in our amazing "trucking demo".
Step 1: Clean up files in storm folder
#paths through Ambari install may start with /mnt if [ -d "/mnt/hadoop/storm" ]; then rm -rf /mnt/hadoop/storm/supervisor/isupervisor/* rm -rf /mnt/hadoop/storm/supervisor/localstate/* rm -rf /mnt/hadoop/storm/supervisor/stormdist/* rm -rf /mnt/hadoop/storm/supervisor/tmp/* rm -rf /mnt/hadoop/storm/workers/* rm -rf /mnt/hadoop/storm/workers-users/* fi #paths in sandbox may start with /hadoop if [ -d "/hadoop/storm" ]; then rm -rf /hadoop/storm/supervisor/isupervisor/* rm -rf /hadoop/storm/supervisor/localstate/* rm -rf /hadoop/storm/supervisor/stormdist/* rm -rf /hadoop/storm/supervisor/tmp/* rm -rf /hadoop/storm/workers/* rm -rf /hadoop/storm/workers-users/* rm -rf /hadoop/storm/nimbus/stormdist/* fi
Step 2: Clear your zookeeper state.
1) stop storm
2) do the following command lines:
/usr/hdp/current/zookeeper-client/bin/zkCli.sh rmr /storm quit
Step 3: restart storm
This solution works for me on most of the nimbus failure problem.
Thanks to Ali Bajwa for the kind help!
Is "/mnt/hadoop/storm" or "hadoop/storm" decided by the value of "storm.local.dir" parameter?
- Get All Questions & Answer for CDP Generalist Exam (CDP-0011) and trainings.
- Get All Questions & Answer for CDP Administrator - Private Cloud Base Exam CDP-2001 and trainings.
- Get All Questions & Answer for CDP Data Developer Exam CDP-3001 and trainings.
This Question is from QuickTechie Cloudera CDP Certification Preparation Kit.