forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
35 lines
2.7 KiB
HTML
35 lines
2.7 KiB
HTML
<a name="mrs_01_1954"></a><a name="mrs_01_1954"></a>
|
|
|
|
<h1 class="topictitle1">Configuring the Number of Lost Executors Displayed in WebUI</h1>
|
|
<div id="body1595920207020"><p id="mrs_01_1954__aa37f8ab15d2f4d049388563539706757"></p>
|
|
<div class="section" id="mrs_01_1954__sea742cd1ef4147f396e0edef7da2656f"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1954__a9326f3296bab4a7191c994e9016522f4">In Spark WebUI, the <span class="wintitle" id="mrs_01_1954__w51984dcf1a874f9dbf557bca7b242601"><b>Executor</b></span> page can display information about Lost Executor. Executors are dynamically recycled. If the JDBCServer tasks are large, there may be too many lost executors displayed in WebUI. Therefore, the number of displayed lost executors can be configured.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1954__scdd6d98977ac4ad0b44b95b1a7605c31"><h4 class="sectiontitle">Procedure</h4><p id="mrs_01_1954__afd2e3f72f0e24580a7513b243cf55e9b">Configure the following parameter in the <span class="filepath" id="mrs_01_1954__f0a50b854fd6e44bfb591a386d2f00a46"><b>spark-defaults.conf</b></span> file on Spark client.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1954__t7c10913d306e4d468256c17990f3e25c" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="mrs_01_1954__ra438de715c7b4603bf5561cea85692af"><th align="left" class="cellrowborder" valign="top" width="20.18%" id="mcps1.3.3.3.2.4.1.1"><p id="mrs_01_1954__a0173f34d758e4375b6d6f213438fabe9">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="63.970000000000006%" id="mcps1.3.3.3.2.4.1.2"><p id="mrs_01_1954__abd31841751f74fe39968d40ff20a5fb7">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15.85%" id="mcps1.3.3.3.2.4.1.3"><p id="mrs_01_1954__a637abbebe6cd4026a90d04bb9dd886d7">Default Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1954__r9ad75cb842de4ef4bd537ddbc4b473f4"><td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.3.2.4.1.1 "><p id="mrs_01_1954__a5514373b8cf045b2bdf88be5f1b7742c">spark.ui.retainedDeadExecutors</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="63.970000000000006%" headers="mcps1.3.3.3.2.4.1.2 "><p id="mrs_01_1954__a7ede0b7fa9e34c8c9d5934a0697788bf">The maximum number of Lost Executors displayed in Spark WebUI.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.85%" headers="mcps1.3.3.3.2.4.1.3 "><p id="mrs_01_1954__a08cef678ea924bc3bc822e8743f6dff2">100</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1941.html">Scenario-Specific Configuration</a></div>
|
|
</div>
|
|
</div>
|
|
|