forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
26 lines
4.6 KiB
HTML
26 lines
4.6 KiB
HTML
<a name="mrs_01_1972"></a><a name="mrs_01_1972"></a>
|
|
|
|
<h1 class="topictitle1">Obtaining Container Logs of a Running Spark Application</h1>
|
|
<div id="body1595920217118"><p id="mrs_01_1972__a6e676d7951ba4e9e95db18a605c53664">Container logs of running Spark applications are distributed on multiple nodes. This section describes how to quickly obtain container logs.</p>
|
|
<div class="section" id="mrs_01_1972__s3f3243f155584adea798b1be45b9e386"><h4 class="sectiontitle">Scenario Description</h4><p id="mrs_01_1972__p76560596394">You can run the <strong id="mrs_01_1972__b201090620154">yarn logs</strong> command to obtain the logs of applications running on Yarn. In different scenarios, you can run the following commands to obtain required logs:</p>
|
|
<ol id="mrs_01_1972__ol6386173685516"><li id="mrs_01_1972__li1628719494554">Obtain complete logs of the application: <strong id="mrs_01_1972__b18933827145715">yarn logs --applicationId</strong><strong id="mrs_01_1972__b1686113144532"> </strong><em id="mrs_01_1972__i1257711511534"><appId></em><strong id="mrs_01_1972__b1286181405317"> </strong><strong id="mrs_01_1972__b19877331185710">-out</strong><strong id="mrs_01_1972__b143025211535"> </strong><em id="mrs_01_1972__i37762205315"><outputDir></em>.<p id="mrs_01_1972__p682544010571">Example: <strong id="mrs_01_1972__b1782584065718">yarn logs --applicationId application_1574856994802_0016 -out /opt/test</strong></p>
|
|
<p id="mrs_01_1972__p199032506571">The following figure shows the command output.</p>
|
|
<ol type="a" id="mrs_01_1972__ol1395875855714"><li id="mrs_01_1972__li9645115455718">If the application is running, container logs in the <strong id="mrs_01_1972__b155453562159">dead </strong>state cannot be obtained.</li><li id="mrs_01_1972__li18317717581">If the application is stopped, all archived container logs can be obtained.</li></ol>
|
|
</li><li id="mrs_01_1972__li15164536145812">Obtain logs of a specified container: <strong id="mrs_01_1972__b6164936155819">yarn logs -applicationId</strong><strong id="mrs_01_1972__b12935115712155"> </strong><em id="mrs_01_1972__i4419175815158"><appId></em><strong id="mrs_01_1972__b4935105712152"> </strong><strong id="mrs_01_1972__b516411364588">-containerId</strong><strong id="mrs_01_1972__b986418221619"> </strong><em id="mrs_01_1972__i726653191612"><containerId></em>.<p id="mrs_01_1972__p1788613453588">Example: <strong id="mrs_01_1972__b1288634565810">yarn logs -applicationId application_1574856994802_0018 -containerId container_e01_1574856994802_0018_01_000003</strong></p>
|
|
<p id="mrs_01_1972__p169231051135813">The following figure shows the command output.</p>
|
|
<ol type="a" id="mrs_01_1972__ol479165895820"><li id="mrs_01_1972__li46012516595">If the application is running, container logs in the <strong id="mrs_01_1972__b12723173941619">dead </strong>state cannot be obtained.</li><li id="mrs_01_1972__li142721565582">If the application is stopped, you can obtain logs of any container.</li></ol>
|
|
</li><li id="mrs_01_1972__li1689516375595">Obtain container logs in any state: <strong id="mrs_01_1972__b13897637175915">yarn logs -applicationId</strong><strong id="mrs_01_1972__b11122161310167"> </strong><em id="mrs_01_1972__i16820141317164"><appId></em><strong id="mrs_01_1972__b012220131166"> </strong><strong id="mrs_01_1972__b48971237135910">-containerId</strong><strong id="mrs_01_1972__b3712121801614"> </strong><em id="mrs_01_1972__i7955196168"><containerId></em><strong id="mrs_01_1972__b11712131831619"> </strong><strong id="mrs_01_1972__b189713714599">-nodeAddress</strong><strong id="mrs_01_1972__b83252441610"> </strong><em id="mrs_01_1972__i122751524141616"><nodeAddress></em><p id="mrs_01_1972__p17868157105912">Example: <strong id="mrs_01_1972__b17868957145912">yarn logs -applicationId application_1574856994802_0019 -containerId container_e01_1574856994802_0019_01_000003 -nodeAddress 192-168-1-1:</strong>8041</p>
|
|
<p id="mrs_01_1972__p520119391598">Execution result: Logs of any container can be obtained.</p>
|
|
<div class="note" id="mrs_01_1972__note810461611010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1972__p49539211504">You need to set <em id="mrs_01_1972__i17150429111718">nodeAddress </em>in the command. You can run the following command to obtain the value:</p>
|
|
<p id="mrs_01_1972__p195316211100"><strong id="mrs_01_1972__b441811251501">yarn node -list -all</strong></p>
|
|
</div></div>
|
|
</li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1926.html">Using Spark2x</a></div>
|
|
</div>
|
|
</div>
|
|
|