forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
173 lines
17 KiB
HTML
173 lines
17 KiB
HTML
<a name="mrs_01_1165"></a><a name="mrs_01_1165"></a>
|
|
|
|
<h1 class="topictitle1">Loader Log Overview</h1>
|
|
<div id="body1590375614048"><div class="section" id="mrs_01_1165__s30704f356db045db9247c512443ec0bb"><h4 class="sectiontitle">Log Description</h4><p id="mrs_01_1165__en-us_topic_0046736740_p52455022"><strong id="mrs_01_1165__en-us_topic_0046736740_b2333158">Log path</strong>: The default storage path of Loader log files is <strong id="mrs_01_1165__b175731231947">/var/log/Bigdata/loader/Log category</strong>.</p>
|
|
<ul id="mrs_01_1165__en-us_topic_0046736740_ul20998422"><li id="mrs_01_1165__en-us_topic_0046736740_li54768072">runlog: /var/log/Bigdata/loader/runlog (run logs)</li><li id="mrs_01_1165__en-us_topic_0046736740_li23150606">scriptlog: /var/log/Bigdata/loader/scriptlog/ (script execution logs)</li><li id="mrs_01_1165__en-us_topic_0046736740_li7028863">catalina: /var/log/Bigdata/loader/catalina (Tomcat startup and stop logs)</li><li id="mrs_01_1165__en-us_topic_0046736740_li63259774">audit: /var/log/Bigdata/loader/audit (audit logs)</li></ul>
|
|
<p id="mrs_01_1165__en-us_topic_0046736740_p32467059"><strong id="mrs_01_1165__b078205515419">Log archive rule</strong>:</p>
|
|
<p id="mrs_01_1165__en-us_topic_0046736740_p12586123">The automatic compression and archiving function are enabled for Loader run logs and audit logs. By default, when the size of a log file exceeds 10 MB, the log file is automatically compressed into a log file named in the following rule: <em id="mrs_01_1165__i18536184231219"><Original log file name>-<yyyy-mm-dd_hh-mm-ss>.[ID]</em><strong id="mrs_01_1165__b1553617429121">.log.zip</strong>. A maximum of 20 latest compressed files are reserved. The number of compressed files can be configured on the Manager portal.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1165__en-us_topic_0046736740_table46166248" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Loader log list</caption><thead align="left"><tr id="mrs_01_1165__en-us_topic_0046736740_row19677689"><th align="left" class="cellrowborder" valign="top" width="27.2020202020202%" id="mcps1.3.1.6.2.4.1.1"><p id="mrs_01_1165__en-us_topic_0046736740_p50388959"><strong id="mrs_01_1165__b196218412122">Log Type</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="39.464646464646464%" id="mcps1.3.1.6.2.4.1.2"><p id="mrs_01_1165__en-us_topic_0046736740_p25003187"><strong id="mrs_01_1165__b22507151218">Log File Name</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.333333333333336%" id="mcps1.3.1.6.2.4.1.3"><p id="mrs_01_1165__en-us_topic_0046736740_p40821806"><strong id="mrs_01_1165__b1227915811120">Description</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1165__en-us_topic_0046736740_row29870484"><td class="cellrowborder" rowspan="3" valign="top" width="27.2020202020202%" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p3590106">Run log</p>
|
|
<p id="mrs_01_1165__p1616513414411"></p>
|
|
<p id="mrs_01_1165__p133331514164610"></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.464646464646464%" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p22363169">loader.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.1.6.2.4.1.3 "><p id="mrs_01_1165__en-us_topic_0046736740_p66586256">Loader system log file that records most of the logs generated when the TelcoFS system is running.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__row21659417410"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__p2165841420">loader-omm-***-pid***-gc.log.*.current</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__p71651449412">Loader process GC log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__row20333131484617"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__p11333191414617">sqoopInstanceCheck.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__p5333151418463">Loader instance health check log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row62405399"><td class="cellrowborder" valign="top" width="27.2020202020202%" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p21672534">Audit log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.464646464646464%" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p10644818">default.audit</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.1.6.2.4.1.3 "><p id="mrs_01_1165__en-us_topic_0046736740_p56923890">Loader operation audit log file that records operations such as adding, deleting, modifying, and querying jobs and user login</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row42552963"><td class="cellrowborder" rowspan="6" valign="top" width="27.2020202020202%" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p24237973">Tomcat log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.464646464646464%" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p17118783">catalina.out</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.1.6.2.4.1.3 "><p id="mrs_01_1165__en-us_topic_0046736740_p44444202">Tomcat run log file.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row64453503"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p53351278">catalina. <yyyy-mm-dd >.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p26486257">Tomcat run log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row37049726"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p48237819">host-manager. <yyyy-mm-dd >.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p14949248">Tomcat run log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row325510"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p26366315">localhost_access_log. <yyyy-mm-dd >.txt</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p55296748">Tomcat run log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row27908691"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p46011531">manager <yyyy-mm-dd >.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p35946515">Tomcat run log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row55083180"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p32552624">localhost. <yyyy-mm-dd >.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p19516888">Tomcat run log file</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row41434269"><td class="cellrowborder" rowspan="3" valign="top" width="27.2020202020202%" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p732663">Script log</p>
|
|
<p id="mrs_01_1165__p40778606101615"></p>
|
|
<p id="mrs_01_1165__p176781720989"></p>
|
|
<p id="mrs_01_1165__p430717395811"></p>
|
|
<p id="mrs_01_1165__p14299746194217"></p>
|
|
<p id="mrs_01_1165__p11299346144211"></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.464646464646464%" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p59345770">postInstall.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.1.6.2.4.1.3 "><p id="mrs_01_1165__en-us_topic_0046736740_p42278045">Loader installation script log file</p>
|
|
<p id="mrs_01_1165__en-us_topic_0046736740_p44958086">Log file generated during the execution of the Loader installation script (<strong id="mrs_01_1165__b1315495810494">postInstall.sh</strong>)</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row1969592"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p25319268">preStart.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p37594824">Pre-startup script log file of the Loader service During startup of the Loader service, a series of preparation operations are first performed (by executing <strong id="mrs_01_1165__b06551136165418">preStart.sh</strong>), such as generating the keytab file. This log file records information about these operations</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row2809103"><td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p26210811">loader_ctl.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.6.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p42700980">Log file generated when Loader executes the service start and stop script (<strong id="mrs_01_1165__b4217141975516">sqoop.sh</strong>)</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="mrs_01_1165__section93081430115120"><h4 class="sectiontitle">Log Level</h4><p id="mrs_01_1165__en-us_topic_0046736740_p27333381"><a href="#mrs_01_1165__t1e44247bfa6041108b3b65e12e97ae75">Table 2</a> describes the log levels provided by Loader. The priorities of log levels are ERROR, WARN, INFO, and DEBUG in descending order. Logs whose levels are higher than or equal to the specified level are printed. The number of printed logs decreases as the specified log level increases.</p>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_1165__t1e44247bfa6041108b3b65e12e97ae75"></a><a name="t1e44247bfa6041108b3b65e12e97ae75"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1165__t1e44247bfa6041108b3b65e12e97ae75" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Log levels</caption><thead align="left"><tr id="mrs_01_1165__en-us_topic_0046736740_row62634808"><th align="left" class="cellrowborder" valign="top" width="38.379999999999995%" id="mcps1.3.2.3.2.3.1.1"><p id="mrs_01_1165__en-us_topic_0046736740_p40254682"><strong id="mrs_01_1165__b142746832016">Level</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="61.62%" id="mcps1.3.2.3.2.3.1.2"><p id="mrs_01_1165__en-us_topic_0046736740_p19089850"><strong id="mrs_01_1165__b1277711313205">Description</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1165__en-us_topic_0046736740_row24966259"><td class="cellrowborder" valign="top" width="38.379999999999995%" headers="mcps1.3.2.3.2.3.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p9001062">ERROR</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.62%" headers="mcps1.3.2.3.2.3.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p57997459">Error information about the current event processing.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row52215086"><td class="cellrowborder" valign="top" width="38.379999999999995%" headers="mcps1.3.2.3.2.3.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p1563554">WARN</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.62%" headers="mcps1.3.2.3.2.3.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p59539043">Exception information about the current event processing.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row66089339"><td class="cellrowborder" valign="top" width="38.379999999999995%" headers="mcps1.3.2.3.2.3.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p51636249">INFO</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.62%" headers="mcps1.3.2.3.2.3.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p21786680">Normal running status information about the system and events.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row61862400"><td class="cellrowborder" valign="top" width="38.379999999999995%" headers="mcps1.3.2.3.2.3.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p44798466">DEBUG</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.62%" headers="mcps1.3.2.3.2.3.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p4797145">System information and system debugging information.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<p id="mrs_01_1165__en-us_topic_0046736733_p66684983">To modify log levels, perform the following operations:</p>
|
|
<ol id="mrs_01_1165__ol2049469418545"><li id="mrs_01_1165__li4027424618545"><span>Go to the <strong id="mrs_01_1165__b1312537121711">All Configurations</strong> page of Loader by referring to <a href="mrs_01_2125.html">Modifying Cluster Service Configuration Parameters</a>.</span></li><li id="mrs_01_1165__li2692390118545"><span>On the menu bar on the left, select the log menu of the target role.</span></li><li id="mrs_01_1165__li4098852518545"><span>Select a desired log level.</span></li><li id="mrs_01_1165__li1719026918545"><span>Save the configuration. In the displayed dialog box, click <strong id="mrs_01_1165__b27051579191817">OK</strong> to make the configurations take effect.</span><p><div class="note" id="mrs_01_1165__note1968793518196"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1165__p20687173520194">The configurations take effect immediately without the need to restart the service.</p>
|
|
</div></div>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="mrs_01_1165__s5910cd3ded994ea8aae61f487adcd77d"><h4 class="sectiontitle">Log Formats</h4><p id="mrs_01_1165__en-us_topic_0046736740_p54981395">The following table lists the Loader log formats.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1165__en-us_topic_0046736740_table25070509" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Log formats</caption><thead align="left"><tr id="mrs_01_1165__en-us_topic_0046736740_row9613768"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.3.3.2.4.1.1"><p id="mrs_01_1165__en-us_topic_0046736740_p40517777"><strong id="mrs_01_1165__b57541350144019">Log Type</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.3.3.2.4.1.2"><p id="mrs_01_1165__en-us_topic_0046736740_p9559684"><strong id="mrs_01_1165__b74711410416">Format</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.3.3.2.4.1.3"><p id="mrs_01_1165__en-us_topic_0046736740_p56796998"><strong id="mrs_01_1165__b63996215413">Example</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1165__en-us_topic_0046736740_row65951706"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.3.3.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p40487987">Run log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.3.3.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p58301484"><yyyy-MM-dd HH:mm:ss,SSS>|<Log Level>|<Thread that generates the log>|<Message in the log>|<Location of the log event></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.3.3.2.4.1.3 "><p id="mrs_01_1165__en-us_topic_0046736740_p24799725">2015-06-29 14:54:35,553 | INFO | [localhost-startStop-1] | ConnectionRequestHandler initialized | org.apache.sqoop.handler.ConnectionRequestHandler.<init>(ConnectionRequestHandler.java:100)</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1165__en-us_topic_0046736740_row21870936"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.3.3.2.4.1.1 "><p id="mrs_01_1165__en-us_topic_0046736740_p26715417">Audit log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.3.3.2.4.1.2 "><p id="mrs_01_1165__en-us_topic_0046736740_p16465207"><yyyy-MM-dd HH:mm:ss,SSS>|<Log Level>|default|<Message in the log>|<Location of the log event></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.3.3.2.4.1.3 "><p id="mrs_01_1165__en-us_topic_0046736740_p58613401">2015-06-29 15:35:40,969 INFO default: UserName=admin, UserIP=10.52.0.111, Time=2015-06-29 15:35:40,969, Operation=submit, Resource=submission@21, Result=Failure, Detail={[reason:GET_SFTP_SESSION_FAILED:Failed to get sftp session - 10.162.0.35 (caused by: Auth cancel) ];[config:null]}</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0400.html">Using Loader</a></div>
|
|
</div>
|
|
</div>
|
|
|