- Get All Questions & Answer for CDP Generalist Exam (CDP-0011) and trainings.
- Get All Questions & Answer for CDP Administrator - Private Cloud Base Exam CDP-2001 and trainings.
- Get All Questions & Answer for CDP Data Developer Exam CDP-3001 and trainings.
This Question is from QuickTechie Cloudera CDP Certification Preparation Kit.
Caused by: java.lang.OutOfMemoryError: Java heap space
This particular case is related to "Reducer tasks of hive job fails with Out Of Memory error during shuffle fetcher stage"
Fix:
- Increase hive.tez.container.size if it is set too low.
- tez.runtime.shuffle.memory.limit.percent from default value 0.7
Changed to 0.4
- Decrease tez.runtime.shuffle.fetch.buffer.percent from default 0.25 to .15 if needed. (Different values were tested between the range of 0.25 to 0.10)
----------------------
Also, If we are using MR then we might need to revisit the mapper/reducer container's heap size accordingly.
- Get All Questions & Answer for CDP Generalist Exam (CDP-0011) and trainings.
- Get All Questions & Answer for CDP Administrator - Private Cloud Base Exam CDP-2001 and trainings.
- Get All Questions & Answer for CDP Data Developer Exam CDP-3001 and trainings.
This Question is from QuickTechie Cloudera CDP Certification Preparation Kit.