vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/umn/ALM-25006.html
Yang, Tong 3b1f73dece MRS UMN 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-13 12:03:34 +00:00

105 lines
18 KiB
HTML
Raw Permalink Blame History

<a name="ALM-25006"></a><a name="ALM-25006"></a>
<h1 class="topictitle1">ALM-25006 Sssd Service Exception</h1>
<div id="body43151833"><div class="section" id="ALM-25006__s53db4d813be34d9f903a678efc67f796"><h4 class="sectiontitle">Description</h4><p id="ALM-25006__p1245898010197">The system checks the status of the sssd service every 60 seconds. This alarm is generated when the sssd process fails to be queried for four consecutive times (three minutes) or users in LdapServer cannot be obtained.</p>
<p id="ALM-25006__p4502195710197">This alarm is cleared when the process is restored and users in LdapServer can be obtained.</p>
</div>
<div class="section" id="ALM-25006__s4aea33a290f749989a4e67d6348fbd6f"><h4 class="sectiontitle">Attribute</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-25006__en-us_topic_0070543547_table61883722" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-25006__en-us_topic_0070543547_row43410060"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.1"><p id="ALM-25006__en-us_topic_0070543547_p26553952">Alarm ID</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.2"><p id="ALM-25006__en-us_topic_0070543547_p3386497">Alarm Severity</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.3"><p id="ALM-25006__en-us_topic_0070543547_p5870806">Auto Clear</p>
</th>
</tr>
</thead>
<tbody><tr id="ALM-25006__en-us_topic_0070543547_row5773255"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.1 "><p id="ALM-25006__en-us_topic_0070543547_p64980542">25006</p>
</td>
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.2 "><p id="ALM-25006__en-us_topic_0070543547_p28932512">Major</p>
</td>
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.3 "><p id="ALM-25006__en-us_topic_0070543547_p61832151">Yes</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="ALM-25006__s6d36445f53214cfc9c069c3017450cec"><h4 class="sectiontitle">Parameters</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-25006__en-us_topic_0070543547_table42348363" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-25006__en-us_topic_0070543547_row18026058"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.1"><p id="ALM-25006__en-us_topic_0070543547_p50824621">Name</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.2"><p id="ALM-25006__en-us_topic_0070543547_p23153616">Meaning</p>
</th>
</tr>
</thead>
<tbody><tr id="ALM-25006__row1495271516413"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-25006__p192431315431">Source</p>
</td>
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-25006__p692551319435">Specifies the cluster for which the alarm is generated.</p>
</td>
</tr>
<tr id="ALM-25006__en-us_topic_0070543547_row63503579"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-25006__en-us_topic_0070543547_p43516279">ServiceName</p>
</td>
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-25006__en-us_topic_0070543547_p35157707">Specifies the service name for which the alarm is generated.</p>
</td>
</tr>
<tr id="ALM-25006__en-us_topic_0070543547_row47983914"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-25006__en-us_topic_0070543547_p61491846">HostName</p>
</td>
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-25006__en-us_topic_0070543547_p14783663">Specifies the object (host ID) for which the alarm is generated.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="ALM-25006__s984bbbe8cc59465fb697d87b27dcbf99"><h4 class="sectiontitle">Impact on the System</h4><p id="ALM-25006__en-us_topic_0070543547_p56626060">The alarmed node may not be able to synchronize data from LdapServer. The id command may fail to obtain the LDAP data, affecting upper-layer services.</p>
</div>
<div class="section" id="ALM-25006__s09f31ed2c39c48e981697c2be75827fb"><h4 class="sectiontitle">Possible Causes</h4><ul id="ALM-25006__en-us_topic_0070543547_ul23308166"><li id="ALM-25006__en-us_topic_0070543547_li8446905">The sssd service is not started or is incorrectly started.</li><li id="ALM-25006__en-us_topic_0070543547_li8913284">The network is faulty and cannot access the LDAP server.</li><li id="ALM-25006__en-us_topic_0070543547_li13110696">NameService is abnormal.</li></ul>
</div>
<ul id="ALM-25006__ul8708718101718"><li id="ALM-25006__li42103057183240">Users cannot be queried because the OS executes commands too slowly.</li></ul>
<div class="section" id="ALM-25006__s99c9d9b077524ccba9c6f986b202fd4e"><h4 class="sectiontitle">Procedure</h4><p class="tableheading" id="ALM-25006__en-us_topic_0070543547_p55333480"><strong id="ALM-25006__b4163169284640">Check whether the sssd service is correctly started.</strong></p>
<ol id="ALM-25006__ol2953554484659"><li id="ALM-25006__li5445518184636"><span>On the FusionInsight Manager portal, choose <strong id="ALM-25006__b36711547162914">O&amp;M &gt; Alarm<strong id="ALM-25006__b27872374104950"> &gt; Alarms</strong></strong>. Find the IP address of <strong id="ALM-25006__b2552742184636">HostName</strong> in <strong id="ALM-25006__b2842019784636">Location</strong> of the alarm and record it as IP1 (if multiple alarms exist, record the IP addresses as IP1, IP2, and IP3 respectively).</span></li><li id="ALM-25006__li872546684636"><a name="ALM-25006__li872546684636"></a><a name="li872546684636"></a><span>Contact the <span id="ALM-25006__text4614151421417">O&amp;M personnel</span> to access the node using IP1 as user root. <span id="ALM-25006__text2800174020566"></span>Run the <strong id="ALM-25006__b2033458284636">ps -ef | grep sssd</strong> command and check whether the <strong id="ALM-25006__b4879351384636">/usr/sbin/sssd</strong> process is started.</span><p><ul class="subitemlist" id="ALM-25006__ul2333911784636"><li id="ALM-25006__li5996050684636">If the process is started, go to <a href="#ALM-25006__li4389913484636">3</a>.</li><li id="ALM-25006__li2496285684636">If the process is not started, go to <a href="#ALM-25006__li1838613984636">4</a>.</li></ul>
</p></li><li id="ALM-25006__li4389913484636"><a name="ALM-25006__li4389913484636"></a><a name="li4389913484636"></a><span>Check whether the sssd process queried in <a href="#ALM-25006__li872546684636">2</a> has three subprocesses.</span><p><ul class="subitemlist" id="ALM-25006__ul4961692484636"><li id="ALM-25006__li5263206884636">If yes, go to <a href="#ALM-25006__li9130384636">5</a>.</li><li id="ALM-25006__li3533915384636">If no, go to <a href="#ALM-25006__li1838613984636">4</a>.</li></ul>
</p></li><li id="ALM-25006__li1838613984636"><a name="ALM-25006__li1838613984636"></a><a name="li1838613984636"></a><span>Run the <strong id="ALM-25006__b5954788884636">service sssd restart</strong> command as user <strong id="ALM-25006__b6616894784636">roo</strong>t to restart the sssd service. Then run the <strong id="ALM-25006__b5864961784636">ps -ef | grep sssd</strong> command to check whether the sssd process is normal.</span><p><p class="litext" id="ALM-25006__p4831131884636">In the normal state, the <strong id="ALM-25006__b5808450584636">/usr/sbin/sssd</strong> process has three subprocesses: <strong id="ALM-25006__b5299850284636">/usr/libexec/sssd/sssd_be</strong>, <strong id="ALM-25006__b722447184636">/usr/libexec/sssd/sssd_nss</strong>, and <strong id="ALM-25006__b6502024784636">/usr/libexec/sssd/sssd_pam</strong>.</p>
<ul class="subitemlist" id="ALM-25006__ul436951184636"><li id="ALM-25006__li2090271884636">If it exists, go to <a href="#ALM-25006__li4894866984636">9</a>.</li><li id="ALM-25006__li1539858284636">If it does not exist, go to <a href="#ALM-25006__li4877321484636">13</a>.</li></ul>
</p></li></ol>
<p class="tableheading" id="ALM-25006__p3932560684636"><strong id="ALM-25006__b3136546584646">Check whether the LDAP server can be accessed.</strong></p>
<ol start="5" id="ALM-25006__ol1090747484720"><li id="ALM-25006__li9130384636"><a name="ALM-25006__li9130384636"></a><a name="li9130384636"></a><span>Log in to the alarmed node as user <strong id="ALM-25006__b3125752784636">root</strong>. Run the <strong id="ALM-25006__b1288229184636">ping</strong> command to check the network connectivity between this node and the LdapServer node.</span><p><ul class="subitemlist" id="ALM-25006__ul3065579384636"><li id="ALM-25006__li3683266484636">If the network is normal, go to <a href="#ALM-25006__li4687622084636">6</a>.</li><li id="ALM-25006__li6305852284636">If the network is faulty, contact network administrators to troubleshoot the fault.</li></ul>
</p></li></ol>
<p class="tableheading" id="ALM-25006__p746668584636"><strong id="ALM-25006__b2395073184713">Check whether NameService is normal.</strong></p>
<ol start="6" id="ALM-25006__ol467504988489"><li id="ALM-25006__li4687622084636"><a name="ALM-25006__li4687622084636"></a><a name="li4687622084636"></a><span>Log in to the alarmed node as user <strong id="ALM-25006__b82172884636">root</strong>. Run the <strong id="ALM-25006__b739555384636">cat /etc/nsswitch.conf</strong> command and check the <strong id="ALM-25006__b6655997984636">passwd</strong> and <strong id="ALM-25006__b6216890384636">group</strong> configurations of NameService.</span><p><p class="litext" id="ALM-25006__p2264777184636">The correct parameter configurations are as follows: <strong id="ALM-25006__b2264922384636">passwd: compat ldap</strong> and <strong id="ALM-25006__b251641984636">group: compat ldap</strong>.</p>
<ul class="subitemlist" id="ALM-25006__ul4994771184636"><li id="ALM-25006__li2253019284636">If the configurations are correct, go to <a href="#ALM-25006__li4799532284636">7</a>.</li><li id="ALM-25006__li1300628684636">If the configurations are incorrect, go to <a href="#ALM-25006__li2317384684636">8</a>.</li></ul>
</p></li><li id="ALM-25006__li4799532284636"><a name="ALM-25006__li4799532284636"></a><a name="li4799532284636"></a><span>Run the <strong id="ALM-25006__b1923279684636">/usr/sbin/sss_cache -G</strong> and <strong id="ALM-25006__b3887744284636">/usr/sbin/sss_cache -U</strong> commands as user <strong id="ALM-25006__b1435266284636">root</strong>. Wait for 2 minutes and run the <strong id="ALM-25006__b6206509784636">id admin</strong> and <strong id="ALM-25006__b2171496484636">id backup/manager</strong> commands to check whether results can be queried.</span><p><ul class="subitemlist" id="ALM-25006__ul6498513784636"><li id="ALM-25006__li1408166384636">If results are queried, go to <a href="#ALM-25006__li4894866984636">9</a>.</li><li id="ALM-25006__li6687289484636">If no result is queried, go to <a href="#ALM-25006__li4877321484636">13</a>.</li></ul>
</p></li><li id="ALM-25006__li2317384684636"><a name="ALM-25006__li2317384684636"></a><a name="li2317384684636"></a><span>Run the <strong id="ALM-25006__b2930471484636">vi /etc/nsswitch.conf</strong> command as user <strong id="ALM-25006__b6241583484636">root</strong>. Correct the configurations in <a href="#ALM-25006__li4687622084636">6</a> and save the file. Run the <strong id="ALM-25006__b2251776684636">service sssd restart</strong> command to restart the sssd service. Wait for 2 minutes and run the <strong id="ALM-25006__b133330984636">id admin</strong> and <strong id="ALM-25006__b1199978384636">id backup/manager</strong> commands to check whether results can be queried.</span><p><ul class="subitemlist" id="ALM-25006__ul3985757484636"><li id="ALM-25006__li3245840584636">If results are queried, go to <a href="#ALM-25006__li4894866984636">9</a>.</li><li id="ALM-25006__li1188515984636">If no result is queried, go to <a href="#ALM-25006__li4877321484636">13</a>.</li></ul>
</p></li><li id="ALM-25006__li4894866984636"><a name="ALM-25006__li4894866984636"></a><a name="li4894866984636"></a><span>Log in to the FusionInsight Manager portal. Wait for 5 minutes and check whether the <strong id="ALM-25006__b530016576148">sssd Service Exception</strong> alarm is cleared.</span><p><ul class="subitemlist" id="ALM-25006__ul4202952984636"><li id="ALM-25006__li723802584636">If the alarm is cleared, no further action is required.</li><li id="ALM-25006__li4940919084636">If the alarm persists, go to <a href="#ALM-25006__li44241319183338">10</a>.</li></ul>
</p></li></ol>
<p id="ALM-25006__p56150708183338"><strong id="ALM-25006__b35594324183338">Check whether frame freezing occurs when running a command in the operating system.</strong></p>
<ol start="10" id="ALM-25006__ol1659849518344"><li id="ALM-25006__li44241319183338"><a name="ALM-25006__li44241319183338"></a><a name="li44241319183338"></a><span>Log in to the faulty node as user <strong id="ALM-25006__b62627559183338">root</strong>, run the<strong id="ALM-25006__b26777120183338"> id admin</strong> command, and check whether the command execution takes a long time. If the command execution takes more than 3 seconds, the command execution is deemed to be slow.</span><p><ul id="ALM-25006__ul106732273196"><li id="ALM-25006__li16673122719190">If yes, go to <a href="#ALM-25006__li10247506183338">11</a>.</li><li id="ALM-25006__li15240193121919">If no, go to <a href="#ALM-25006__li4877321484636">13</a>.</li></ul>
</p></li><li id="ALM-25006__li10247506183338"><a name="ALM-25006__li10247506183338"></a><a name="li10247506183338"></a><span>Run the <strong id="ALM-25006__b25118693183338">cat /var/log/messages</strong> command to check whether the sssd frequently restarts or the error information <strong id="ALM-25006__b24741649183338">Can't contact LDAP server</strong> exists.</span><p><p id="ALM-25006__p3543610991459">sssd restart example:</p>
<pre class="screen" id="ALM-25006__screen5048952991459">Feb 7 11:38:16 10-132-190-105 sssd[pam]: Shutting down
Feb 7 11:38:16 10-132-190-105 sssd[nss]: Shutting down
Feb 7 11:38:16 10-132-190-105 sssd[nss]: Shutting down
Feb 7 11:38:16 10-132-190-105 sssd[be[default]]: Shutting down
Feb 7 11:38:16 10-132-190-105 sssd: Starting up
Feb 7 11:38:16 10-132-190-105 sssd[be[default]]: Starting up
Feb 7 11:38:16 10-132-190-105 sssd[nss]: Starting up
Feb 7 11:38:16 10-132-190-105 sssd[pam]: Starting up</pre>
<ul id="ALM-25006__ul15811944181919"><li id="ALM-25006__li65814445191">If yes, go to <a href="#ALM-25006__li9709691183338">12</a>.</li><li id="ALM-25006__li79262479193">If no, go to <a href="#ALM-25006__li4877321484636">13</a>.</li></ul>
</p></li><li id="ALM-25006__li9709691183338"><a name="ALM-25006__li9709691183338"></a><a name="li9709691183338"></a><span>Run the <strong id="ALM-25006__b20278355183338">vi $BIGDATA_HOME/tmp/random_ldap_ip_order </strong>command to modify the number at the end. If the original number is an odd number, change it to an even number. If the number is an even number, change it to an odd number.</span><p><p id="ALM-25006__p48287467183338">Run the <strong id="ALM-25006__b36518822183338">vi /etc/sssd/sssd.conf</strong> command to reverse the first two IP addresses of the <strong id="ALM-25006__b60233944183338">ldap_uri</strong> configuration item, save the settings, and exit.</p>
<p id="ALM-25006__p5234592183338">Run the <strong id="ALM-25006__b47111334183338">ps -ef | grep sssd</strong> command to query the ID of the sssd process, kill it, and run the <strong id="ALM-25006__b21348827183338">/usr/sbin/sssd -D -f</strong> command to restart the sssd service. Wait 5 minutes and run the <strong id="ALM-25006__b57921720183338">id admin</strong> command again.</p>
<p id="ALM-25006__p51533439183338">Check whether the command execution is slow.</p>
<ul id="ALM-25006__ul518414582198"><li id="ALM-25006__li17184135819197">If yes, go to <a href="#ALM-25006__li4877321484636">13</a>.</li><li id="ALM-25006__li470212115206">If no, log in to other faulty nodes and run <a href="#ALM-25006__li44241319183338">10</a> to <a href="#ALM-25006__li9709691183338">12</a>. Collect logs and check whether the first ldapserver node in the ldap_uri before modifying<strong id="ALM-25006__b16436767183338"> /etc/sssd/sssd.conf</strong> is faulty. For example, check whether the service IP address is unreachable, the network latency is too long, or other abnormal software is deployed.</li></ul>
</p></li></ol>
<p class="tableheading" id="ALM-25006__p4272144384636"><strong id="ALM-25006__b576445428481">Collect fault information.</strong></p>
<ol start="13" id="ALM-25006__ol1086637884817"><li id="ALM-25006__li4877321484636"><a name="ALM-25006__li4877321484636"></a><a name="li4877321484636"></a><span>On the FusionInsight Manager portal, choose <strong id="ALM-25006__b528852383215">O&amp;M</strong> &gt; <strong id="ALM-25006__b541924684636">Log &gt; Download</strong>.</span></li><li id="ALM-25006__li2599730784636"><span>Select <strong id="ALM-25006__b15963141333317">LdapClient</strong> in the required cluster from the <strong id="ALM-25006__b13385188173318">Service</strong>.</span></li><li id="ALM-25006__li1145664103113"><span>Click <span><img id="ALM-25006__image1945644173117" src="en-us_image_0269417458.png"></span> in the upper right corner, and set <strong id="ALM-25006__b6456941173117">Start Date</strong> and <strong id="ALM-25006__b11456154113318">End Date</strong> for log collection to 1 hour ahead of and after the alarm generation time, respectively. Then, click <strong id="ALM-25006__b13456164113319">Download</strong>.</span></li><li id="ALM-25006__li6503660384636"><span>Contact the <span id="ALM-25006__text516532614242">O&amp;M personnel</span> and send the collected fault logs.</span></li></ol>
</div>
<div class="section" id="ALM-25006__section1529716184534"><h4 class="sectiontitle">Alarm Clearing</h4><p id="ALM-25006__p4677152685316">After the fault is rectified, the system automatically clears this alarm.</p>
</div>
<div class="section" id="ALM-25006__sc8726b522cb148559a3f19538bc271e3"><h4 class="sectiontitle">Related Information</h4><p id="ALM-25006__en-us_topic_0070543547_p66300913">None</p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1298.html">Alarm Reference (Applicable to MRS 3.x)</a></div>
</div>
</div>
View Git Blame Copy Permalink