forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
19 lines
2.0 KiB
HTML
19 lines
2.0 KiB
HTML
<a name="mrs_01_2012"></a><a name="mrs_01_2012"></a>
|
|
|
|
<h1 class="topictitle1">What Can I Do If the Message "Password cannot be null if SASL is enabled" Is Displayed?</h1>
|
|
<div id="body1595920219637"><div class="section" id="mrs_01_2012__sad7363bd8ee145579ad394fdb6e4ea30"><h4 class="sectiontitle">Question</h4><p id="mrs_01_2012__a57ec1c9426144131ad1fcbe201c282c6">ExternalShuffle is enabled for the application that runs Spark. Task loss occurs in the application because the message "java.lang.NullPointerException: Password cannot be null if SASL is enabled" is displayed. The following shows some key logs:</p>
|
|
<p id="mrs_01_2012__a94ed986b82674e7e9387d591a6cbe5a2"><span><img id="mrs_01_2012__icc3922b7274948c58aece106f8742bed" src="en-us_image_0000001295930836.png"></span></p>
|
|
</div>
|
|
<div class="section" id="mrs_01_2012__s12cda0d260c048c1a0c4f49f58f3a087"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_2012__a04f8213376e34658bf0bc182187228d0">The cause is that NodeManager restarts. When ExternalShuffle is used, Spark uses NodeManager to transmit shuffle data. Therefore, the memory of NodeManager may be seriously insufficient.</p>
|
|
<p id="mrs_01_2012__abd0fe71072934421bd55fe4758896f9c">In the FusionInsight of the current version, the default memory of NodeManager is only 1 GB. When the data volume of Spark tasks is large (greater than 1 TB), the memory is severely insufficient and the message response is slow. As a result, the FusionInsight health check determines that the NodeManager process exits and forcibly restarts the NodeManager, causing the preceding problem.</p>
|
|
<p id="mrs_01_2012__a47a279354f894fcabd006b268a0f1a1e">Solution</p>
|
|
<p id="mrs_01_2012__a55022971022242d19e6548e331b19505">Adjust the memory of the NodeManager. If the data volume is large (greater than 1 TB), the memory of NodeManager must be greater than 4 GB. </p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2003.html">Spark Core</a></div>
|
|
</div>
|
|
</div>
|
|
|