Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

21 lines
2.4 KiB
HTML

<a name="mrs_01_1695"></a><a name="mrs_01_1695"></a>
<h1 class="topictitle1">Why Does the Distcp Command Fail in the Secure Cluster, Causing an Exception?</h1>
<div id="body1597735018973"><div class="section" id="mrs_01_1695__sc767d6311c15481d975d94fdbcc9cb95"><h4 class="sectiontitle">Question</h4><p id="mrs_01_1695__a87b06e299c9542a3b740711a20738a0f">Why distcp command fails in the secure cluster with the following error displayed?</p>
</div>
<p id="mrs_01_1695__a6fcce7bbdc694b4dabec8cd5196f761d">Client side exception</p>
<pre class="screen" id="mrs_01_1695__s1047b6776f9c4dd580a96c9d9a1d246d"><span id="mrs_01_1695__ph1689563515619">Invalid arguments: Unexpected end of file from server</span></pre>
<p id="mrs_01_1695__ade44ce019d344321a99999a97e68645b">Server side exception</p>
<pre class="screen" id="mrs_01_1695__sb943b639cab4413ab68ee4878ff1f0b6"><span id="mrs_01_1695__ph58966357615">javax.net.ssl.SSLException: Unrecognized SSL message, plaintext connection?</span></pre>
<div class="section" id="mrs_01_1695__sbae3285dda4b47eeb6bfacaf406734fe"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_1695__ae5b1083176bd44c3bba26220b260eda8">The preceding error may occur if <strong id="mrs_01_1695__a6c8f27b62b06496eb7edda7a1d7c5caa">webhdfs://</strong> is used in the distcp command. The reason is that the big data cluster uses the HTTPS mechanism, that is, <span class="parmname" id="mrs_01_1695__pc09e1effaf914822a2f65003844c9178"><b>dfs.http.policy</b></span> is set to <span class="parmvalue" id="mrs_01_1695__p9f45fba79c6f4d76869ee5d73e91ec9d"><b>HTTPS_ONLY</b></span> in <span class="filepath" id="mrs_01_1695__fecb99f1b05b34fb1bd31a1af292877b6"><b>core-site.xml</b></span> file. To avoid the error, replace <strong id="mrs_01_1695__a1b055bbfd26e4e1694a25d3bab8fb45b">webhdfs://</strong> with <strong id="mrs_01_1695__a402d6c2275bc48aa96ab123c3d401734">swebhdfs://</strong> in the file.</p>
</div>
<p id="mrs_01_1695__a2f2f0d8d75c94f1c8a6d4bc1ef8b884b">For example:</p>
<p id="mrs_01_1695__a7bc12b26e89a4208be9f8d8585352fa5"><strong id="mrs_01_1695__b107551721101612">./hadoop distcp</strong> <span class="parmname" id="mrs_01_1695__pea37d42af9cb4e26b36834bfab3e838f"><b>swebhdfs://IP:PORT/testfile hdfs://IP:PORT/testfile1</b></span></p>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1690.html">FAQ</a></div>
</div>
</div>