Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version

Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>

2022-12-09 14:55:21 +00:00

1.5 KiB

Raw Permalink Blame History

Spark Shuffle Exception Handling

Question

In some scenarios, the following exception occurs in the Spark shuffle phase:

Solution

For JDBC:

Log in to FusionInsight Manager, change the value of the JDBCServer parameter spark.authenticate.enableSaslEncryption to false, and restart the corresponding instance.

For client jobs:

When the client submits the application, change the value of spark.authenticate.enableSaslEncryption in the spark-defaults.conf file to false.

Parent topic: Common Issues About Spark2x

1.5 KiB Raw Permalink Blame History

Spark Shuffle Exception Handling

Question

Solution

1.5 KiB

Raw Permalink Blame History