forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
55 lines
6.7 KiB
HTML
55 lines
6.7 KiB
HTML
<a name="mrs_01_1740"></a><a name="mrs_01_1740"></a>
|
|
|
|
<h1 class="topictitle1">Adjusting the Yarn Service Configuration</h1>
|
|
<div id="body32001227"><div class="section" id="mrs_01_1740__en-us_topic_0000001173949262_section18436165716222"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1740__en-us_topic_0000001173949262_p24801521184711"><span id="mrs_01_1740__en-us_topic_0000001173949262_text155083494718">HetuEngine</span> depends on the resource allocation and control capabilities provided by Yarn. You need to adjust the Yarn service configuration based on the actual service and cluster server configuration to achieve the optimal performance.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1740__en-us_topic_0000001173949262_section26631853134817"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1740__en-us_topic_0000001173949262_ol23864624910"><li id="mrs_01_1740__en-us_topic_0000001173949262_li15386161498"><span>Log in to FusionInsight Manager.</span></li><li id="mrs_01_1740__en-us_topic_0000001173949262_li18519131204918"><span>Choose <strong id="mrs_01_1740__en-us_topic_0000001173949262_b570913417119">Cluster</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b1351013681116">Services</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b104253811111">Yarn</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b2564101041119">Configurations</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b186717151112">All Configurations</strong> and set Yarn service parameters by referring to <a href="#mrs_01_1740__en-us_topic_0000001173949262_table49551729155011">Table 1</a>.</span><p>
|
|
<div class="tablenoborder"><a name="mrs_01_1740__en-us_topic_0000001173949262_table49551729155011"></a><a name="en-us_topic_0000001173949262_table49551729155011"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1740__en-us_topic_0000001173949262_table49551729155011" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Yarn configuration parameters</caption><thead align="left"><tr id="mrs_01_1740__en-us_topic_0000001173949262_row1695692916503"><th align="left" class="cellrowborder" valign="top" width="33.333333333333336%" id="mcps1.3.2.2.2.2.1.2.4.1.1"><p id="mrs_01_1740__en-us_topic_0000001173949262_p59561329185011">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="25.612561256125616%" id="mcps1.3.2.2.2.2.1.2.4.1.2"><p id="mrs_01_1740__en-us_topic_0000001173949262_p49561929105018">Default Value</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="41.054105410541055%" id="mcps1.3.2.2.2.2.1.2.4.1.3"><p id="mrs_01_1740__en-us_topic_0000001173949262_p49561029175010">Recommended Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1740__en-us_topic_0000001173949262_row695616293502"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.2.2.2.2.1.2.4.1.1 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p6956132995014">yarn.nodemanager.resource.memory-mb</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.612561256125616%" headers="mcps1.3.2.2.2.2.1.2.4.1.2 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p1995612919505">16384</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="41.054105410541055%" headers="mcps1.3.2.2.2.2.1.2.4.1.3 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p795652918509">To achieve the optimal performance, set this parameter to 90% of the minimum physical memory of the node in the cluster.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1740__en-us_topic_0000001173949262_row1995616294503"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.2.2.2.2.1.2.4.1.1 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p169568299504">yarn.nodemanager.resource.cpu-vcores</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.612561256125616%" headers="mcps1.3.2.2.2.2.1.2.4.1.2 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p199563294508">8</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="41.054105410541055%" headers="mcps1.3.2.2.2.2.1.2.4.1.3 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p3956122975011">To achieve the optimal performance, set this parameter to the minimum number of vCores of the node in the cluster.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1740__en-us_topic_0000001173949262_row395622915020"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.2.2.2.2.1.2.4.1.1 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p15956102914502">yarn.scheduler.maximum-allocation-mb</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.612561256125616%" headers="mcps1.3.2.2.2.2.1.2.4.1.2 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p1795622975018">65536</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="41.054105410541055%" headers="mcps1.3.2.2.2.2.1.2.4.1.3 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p13956132995016">To achieve the optimal performance, set this parameter to 90% of the minimum physical memory of the node in the cluster.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1740__en-us_topic_0000001173949262_row1995616296509"><td class="cellrowborder" valign="top" width="33.333333333333336%" headers="mcps1.3.2.2.2.2.1.2.4.1.1 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p19956192935013">yarn.scheduler.maximum-allocation-vcores</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.612561256125616%" headers="mcps1.3.2.2.2.2.1.2.4.1.2 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p6956129195016">32</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="41.054105410541055%" headers="mcps1.3.2.2.2.2.1.2.4.1.3 "><p id="mrs_01_1740__en-us_topic_0000001173949262_p39561229145019">To achieve the optimal performance, set this parameter to the minimum number of vCores of the node in the cluster.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</p></li><li id="mrs_01_1740__en-us_topic_0000001173949262_li32642052105313"><span>Click <span class="uicontrol" id="mrs_01_1740__en-us_topic_0000001173949262_en-us_topic_0254454631_uicontrol15312340979"><b>Save</b></span>.</span></li><li id="mrs_01_1740__en-us_topic_0000001173949262_li1915918238546"><span>Choose <strong id="mrs_01_1740__en-us_topic_0000001173949262_b122511353191218">Cluster</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b148148546121">Services</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b1812790181310">Yarn</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b996991181312">More</strong> > <strong id="mrs_01_1740__en-us_topic_0000001173949262_b16491041133">Restart Service</strong> to restart the Yarn service for the parameters to take effect.</span></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1745.html">HetuEngine Performance Tuning</a></div>
|
|
</div>
|
|
</div>
|
|
|