forked from docs/doc-exports
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
19 lines
1.9 KiB
HTML
19 lines
1.9 KiB
HTML
<a name="mrs_01_24176"></a><a name="mrs_01_24176"></a>
|
|
|
|
<h1 class="topictitle1">Spark Shuffle Exception Handling</h1>
|
|
<div id="body32001227"><div class="section" id="mrs_01_24176__en-us_topic_0000001219230703_section19111959091"><h4 class="sectiontitle">Question</h4><p id="mrs_01_24176__en-us_topic_0000001219230703_p1580513101273">In some scenarios, the following exception occurs in the Spark shuffle phase:</p>
|
|
<p id="mrs_01_24176__en-us_topic_0000001219230703_p7656143610716"><span><img id="mrs_01_24176__en-us_topic_0000001219230703_image1734612262912" src="en-us_image_0000001348739993.png"></span></p>
|
|
</div>
|
|
<div class="section" id="mrs_01_24176__en-us_topic_0000001219230703_section1333439391"><h4 class="sectiontitle">Solution</h4><p id="mrs_01_24176__en-us_topic_0000001219230703_p2594125082417">For JDBC:</p>
|
|
<p id="mrs_01_24176__en-us_topic_0000001219230703_a7d7e82de84674777a59b76c72c046e99">Log in to FusionInsight Manager, change the value of the JDBCServer parameter <strong id="mrs_01_24176__en-us_topic_0000001219230703_b20714143911344">spark.authenticate.enableSaslEncryption</strong> to <strong id="mrs_01_24176__en-us_topic_0000001219230703_b6902174114341">false</strong>, and restart the corresponding instance.</p>
|
|
<p id="mrs_01_24176__en-us_topic_0000001219230703_p17430175522419">For client jobs:</p>
|
|
<p id="mrs_01_24176__en-us_topic_0000001219230703_p95702059142410">When the client submits the application, change the value of <strong id="mrs_01_24176__en-us_topic_0000001219230703_b15998456357">spark.authenticate.enableSaslEncryption</strong> in the <strong id="mrs_01_24176__en-us_topic_0000001219230703_b156235293519">spark-defaults.conf</strong> file to <strong id="mrs_01_24176__en-us_topic_0000001219230703_b11921456123514">false</strong>.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2002.html">Common Issues About Spark2x</a></div>
|
|
</div>
|
|
</div>
|
|
|