forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
26 lines
6.2 KiB
HTML
26 lines
6.2 KiB
HTML
<a name="mrs_01_1972"></a><a name="mrs_01_1972"></a>
|
|
|
|
<h1 class="topictitle1">Obtaining Container Logs of a Running Spark Application</h1>
|
|
<div id="body8662426"><p id="mrs_01_1972__en-us_topic_0000001173630952_a6e676d7951ba4e9e95db18a605c53664">Container logs of running Spark applications are distributed on multiple nodes. This section describes how to quickly obtain container logs.</p>
|
|
<div class="section" id="mrs_01_1972__en-us_topic_0000001173630952_s3f3243f155584adea798b1be45b9e386"><h4 class="sectiontitle">Scenario Description</h4><p id="mrs_01_1972__en-us_topic_0000001173630952_p76560596394">You can run the <strong id="mrs_01_1972__en-us_topic_0000001173630952_b201090620154">yarn logs</strong> command to obtain the logs of applications running on Yarn. In different scenarios, you can run the following commands to obtain required logs:</p>
|
|
<ol id="mrs_01_1972__en-us_topic_0000001173630952_ol6386173685516"><li id="mrs_01_1972__en-us_topic_0000001173630952_li1628719494554">Obtain complete logs of the application: <strong id="mrs_01_1972__en-us_topic_0000001173630952_b18933827145715">yarn logs --applicationId</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b1686113144532"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i1257711511534"><appId></em><strong id="mrs_01_1972__en-us_topic_0000001173630952_b1286181405317"> </strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b19877331185710">-out</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b143025211535"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i37762205315"><outputDir></em>.<p id="mrs_01_1972__en-us_topic_0000001173630952_p682544010571">Example: <strong id="mrs_01_1972__en-us_topic_0000001173630952_b1782584065718">yarn logs --applicationId application_1574856994802_0016 -out /opt/test</strong></p>
|
|
<p id="mrs_01_1972__en-us_topic_0000001173630952_p199032506571">The following figure shows the command output.</p>
|
|
<ol type="a" id="mrs_01_1972__en-us_topic_0000001173630952_ol1395875855714"><li id="mrs_01_1972__en-us_topic_0000001173630952_li9645115455718">If the application is running, container logs in the <strong id="mrs_01_1972__en-us_topic_0000001173630952_b155453562159">dead </strong>state cannot be obtained.</li><li id="mrs_01_1972__en-us_topic_0000001173630952_li18317717581">If the application is stopped, all archived container logs can be obtained.</li></ol>
|
|
</li><li id="mrs_01_1972__en-us_topic_0000001173630952_li15164536145812">Obtain logs of a specified container: <strong id="mrs_01_1972__en-us_topic_0000001173630952_b6164936155819">yarn logs -applicationId</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b12935115712155"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i4419175815158"><appId></em><strong id="mrs_01_1972__en-us_topic_0000001173630952_b4935105712152"> </strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b516411364588">-containerId</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b986418221619"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i726653191612"><containerId></em>.<p id="mrs_01_1972__en-us_topic_0000001173630952_p1788613453588">Example: <strong id="mrs_01_1972__en-us_topic_0000001173630952_b1288634565810">yarn logs -applicationId application_1574856994802_0018 -containerId container_e01_1574856994802_0018_01_000003</strong></p>
|
|
<p id="mrs_01_1972__en-us_topic_0000001173630952_p169231051135813">The following figure shows the command output.</p>
|
|
<ol type="a" id="mrs_01_1972__en-us_topic_0000001173630952_ol479165895820"><li id="mrs_01_1972__en-us_topic_0000001173630952_li46012516595">If the application is running, container logs in the <strong id="mrs_01_1972__en-us_topic_0000001173630952_b12723173941619">dead </strong>state cannot be obtained.</li><li id="mrs_01_1972__en-us_topic_0000001173630952_li142721565582">If the application is stopped, you can obtain logs of any container.</li></ol>
|
|
</li><li id="mrs_01_1972__en-us_topic_0000001173630952_li1689516375595">Obtain container logs in any state: <strong id="mrs_01_1972__en-us_topic_0000001173630952_b13897637175915">yarn logs -applicationId</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b11122161310167"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i16820141317164"><appId></em><strong id="mrs_01_1972__en-us_topic_0000001173630952_b012220131166"> </strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b48971237135910">-containerId</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b3712121801614"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i7955196168"><containerId></em><strong id="mrs_01_1972__en-us_topic_0000001173630952_b11712131831619"> </strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b189713714599">-nodeAddress</strong><strong id="mrs_01_1972__en-us_topic_0000001173630952_b83252441610"> </strong><em id="mrs_01_1972__en-us_topic_0000001173630952_i122751524141616"><nodeAddress></em><p id="mrs_01_1972__en-us_topic_0000001173630952_p17868157105912">Example: <strong id="mrs_01_1972__en-us_topic_0000001173630952_b17868957145912">yarn logs -applicationId application_1574856994802_0019 -containerId container_e01_1574856994802_0019_01_000003 -nodeAddress 192-168-1-1:</strong><strong id="mrs_01_1972__b5547159263">8041</strong></p>
|
|
<p id="mrs_01_1972__en-us_topic_0000001173630952_p520119391598">Execution result: Logs of any container can be obtained.</p>
|
|
<div class="note" id="mrs_01_1972__en-us_topic_0000001173630952_note810461611010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1972__en-us_topic_0000001173630952_p49539211504">You need to set <em id="mrs_01_1972__en-us_topic_0000001173630952_i17150429111718">nodeAddress </em>in the command. You can run the following command to obtain the value:</p>
|
|
<p id="mrs_01_1972__en-us_topic_0000001173630952_p195316211100"><strong id="mrs_01_1972__en-us_topic_0000001173630952_b441811251501">yarn node -list -all</strong></p>
|
|
</div></div>
|
|
</li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1926.html">Using Spark2x</a></div>
|
|
</div>
|
|
</div>
|
|
|