forked from docs/doc-exports
Yang, Tong
3b1f73dece
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
84 lines
8.1 KiB
HTML
84 lines
8.1 KiB
HTML
<a name="ALM-16048"></a><a name="ALM-16048"></a>
|
|
|
|
<h1 class="topictitle1">ALM-16048 Tez or Spark Library Path Does Not Exist</h1>
|
|
<div id="body0000001113812248"><div class="section" id="ALM-16048__section207241636155220"><h4 class="sectiontitle">Description</h4><p id="ALM-16048__p208233365522">The system checks the Tez and Spark library paths every 180 seconds. This alarm is generated when the Tez or Spark library path does not exist.</p>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section3725133635211"><h4 class="sectiontitle">Attribute</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-16048__table472614364523" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-16048__row198230368524"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.1"><p id="ALM-16048__p16823183614525">Alarm ID</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.2"><p id="ALM-16048__p9823123685212">Alarm Severity</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.3"><p id="ALM-16048__p178230363525">Auto Clear</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="ALM-16048__row8823103610529"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.1 "><p id="ALM-16048__p15823143614520">16048</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.2 "><p id="ALM-16048__p78235369526">Major</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.3 "><p id="ALM-16048__p88249367522">Yes</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section9734193614520"><h4 class="sectiontitle">Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-16048__table18735336145210" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-16048__row88243369529"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.1"><p id="ALM-16048__p168244367529">Name</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.2"><p id="ALM-16048__p1282414361527">Meaning</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="ALM-16048__row2082473635213"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-16048__p2824536175219">Source</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-16048__p982493695212">Specifies the cluster for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-16048__row1882410365520"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-16048__p168242362521">ServiceName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-16048__p16824173635219">Specifies the service for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-16048__row6824336105210"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-16048__p1882433613526">RoleName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-16048__p17824203675218">Specifies the role for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-16048__row782473615522"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-16048__p1782417362527">HostName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-16048__p4824153625211">Specifies the host for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section127391036155216"><h4 class="sectiontitle">Impact on the System</h4><p id="ALM-16048__p11824936135211">The Hive on Tez and Hive on Spark functions are affected.</p>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section17408362528"><h4 class="sectiontitle">Possible Causes</h4><p id="ALM-16048__p98248368524">The Tez or Spark library path is deleted from the HDFS.</p>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section1574010369527"><h4 class="sectiontitle">Procedure</h4><p id="ALM-16048__p12824136195210"><strong id="ALM-16048__b108242036205215">Check the default Hive data warehouse.</strong></p>
|
|
<ol id="ALM-16048__ol5824153675210"><li id="ALM-16048__li2824183610526"><span>Log in to the node where the client is located as user <strong id="ALM-16048__b108241536185213">root</strong>. <span id="ALM-16048__text15591755181513"></span></span></li><li id="ALM-16048__li482433675210"><span>Run the following command to check whether the <strong id="ALM-16048__b88241736205214">tezlib</strong> or <strong id="ALM-16048__b6824036115212">sparklib</strong> directory exists in the <strong id="ALM-16048__b128249368526">hdfs://hacluster/user/{User name}/.Trash/Current/</strong> director:</span><p><p id="ALM-16048__p48244363528"><strong id="ALM-16048__b13824103655211">hdfs dfs -ls hdfs://hacluster/user/</strong><em id="ALM-16048__i1824153655217"><username></em><strong id="ALM-16048__b20824133685213">/.Trash/Current/</strong></p>
|
|
<p id="ALM-16048__p108245364529">For example, the following information shows that <strong id="ALM-16048__b15824113611522">/user/hive/tezlib/<span id="ALM-16048__text7640548123913">8.1.0.1</span>/</strong> and <strong id="ALM-16048__b1282411361525">/user/hive/sparklib/<span id="ALM-16048__text1219215593917">8.1.0.1</span>/</strong> exist.</p>
|
|
<pre class="screen" id="ALM-16048__screen382410362528">host01:<span id="ALM-16048__ph381512063917">/opt/client</span> # hdfs dfs -ls hdfs://hacluster/user/test/.Trash/Current/
|
|
Found 1 items
|
|
drwx------ - test hadoop 0 2019-06-17 19:53 hdfs://hacluster/user/test/.Trash/Current/user</pre>
|
|
<ul id="ALM-16048__ul19824103615527"><li id="ALM-16048__li082493618529">If yes, go to <a href="#ALM-16048__li18824736175210">3</a>.</li><li id="ALM-16048__li1082463685211">If no, go to <a href="#ALM-16048__li1182513369521">5</a>.</li></ul>
|
|
</p></li><li id="ALM-16048__li18824736175210"><a name="ALM-16048__li18824736175210"></a><a name="li18824736175210"></a><span>Run the following command to restore <strong id="ALM-16048__b582423695212">tezlib</strong> and <strong id="ALM-16048__b10824136145216">sparklib</strong>.</span><p><p id="ALM-16048__p1279522194210"><strong id="ALM-16048__b13742111619394">hdfs dfs -mv hdfs://hacluster/user/</strong><em id="ALM-16048__i15503133074215"><username></em><strong id="ALM-16048__b9742216103916">/.Trash/Current/user/hive/tezlib/<span id="ALM-16048__text1729312582426">8.1.0.1</span>/tez.tar.gz /user/hive/tezlib/<span id="ALM-16048__text165015214438">8.1.0.1</span>/tez.tar.gz</strong></p>
|
|
</p></li><li id="ALM-16048__li68241136145217"><span>Check whether the alarm is cleared.</span><p><ul id="ALM-16048__ul1682411368522"><li id="ALM-16048__li168251536155213">If yes, no further action is required.</li><li id="ALM-16048__li6825163695220">If no, go to <a href="#ALM-16048__li1182513369521">5</a>.</li></ul>
|
|
<p id="ALM-16048__p168257364524"><strong id="ALM-16048__b4825113655212">Collect fault information</strong>.</p>
|
|
</p></li><li id="ALM-16048__li1182513369521"><a name="ALM-16048__li1182513369521"></a><a name="li1182513369521"></a><span>Collect related information in the <strong id="ALM-16048__b128251036105212">.Trash/Current/</strong> directory on the client background.</span></li><li id="ALM-16048__li10524105715137"><span>Contact the <span id="ALM-16048__text4614151421417">O&M personnel</span> and send the collected logs.</span></li></ol>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section107511736145210"><h4 class="sectiontitle">Alarm Clearing</h4><p id="ALM-16048__p482517369524">After the fault is rectified, the system automatically clears this alarm.</p>
|
|
</div>
|
|
<div class="section" id="ALM-16048__section1175110364525"><h4 class="sectiontitle">Related Information</h4><p id="ALM-16048__p20825163645218">None</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1298.html">Alarm Reference (Applicable to MRS 3.x)</a></div>
|
|
</div>
|
|
</div>
|
|
|