forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
42 lines
11 KiB
HTML
42 lines
11 KiB
HTML
<a name="mrs_01_24260"></a><a name="mrs_01_24260"></a>
|
|
|
|
<h1 class="topictitle1">Using Resource Labels to Specify on Which Node Coordinators Should Run</h1>
|
|
<div id="body8662426"><p id="mrs_01_24260__en-us_topic_0000001173630826_p349519179020">By default, coordinator and worker nodes randomly start on Yarn NodeManager nodes, and you have to open all ports on all NodeManager nodes. Using resource labels of Yarn, <span id="mrs_01_24260__en-us_topic_0000001173630826_text10765258107">HetuEngine</span> allows you to specify NodeManager nodes to run coordinators.</p>
|
|
<div class="section" id="mrs_01_24260__en-us_topic_0000001173630826_section39264474176"><h4 class="sectiontitle">Prerequisites</h4><p id="mrs_01_24260__en-us_topic_0000001173630826_p98597506178">You have created a user for accessing the <span id="mrs_01_24260__en-us_topic_0000001173630826_text1322216247106">HetuEngine</span> web UI. For details, see <a href="mrs_01_1714.html">Creating a HetuEngine User</a>.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_24260__en-us_topic_0000001173630826_section17522199307"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_24260__en-us_topic_0000001173630826_ol1555122612416"><li id="mrs_01_24260__en-us_topic_0000001173630826_li138119328184"><span>Log in to FusionInsight Manager as a user who can access the <span id="mrs_01_24260__en-us_topic_0000001173630826_text143439227865453">HetuEngine</span> web UI.</span></li><li id="mrs_01_24260__en-us_topic_0000001173630826_li192531321671"><span>Set Yarn parameters to specify the scheduler to handle PlacementConstraints.</span><p><ol type="a" id="mrs_01_24260__en-us_topic_0000001173630826_ol1340314158712"><li id="mrs_01_24260__en-us_topic_0000001173630826_li1830711123811">Choose <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1140513885314">Cluster</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1189711119533">Services</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1129015113544">Yarn</strong>. Click the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b4466154145418">Configurations</strong> tab and then <strong id="mrs_01_24260__en-us_topic_0000001173630826_b97461674546">All Configurations</strong>. On the displayed page, search for <strong id="mrs_01_24260__en-us_topic_0000001173630826_b022043619552">yarn.resourcemanager.placement-constraints.handler</strong>, set <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1638613716564">Value</strong> to <strong id="mrs_01_24260__en-us_topic_0000001173630826_b16378181111561">scheduler</strong>, and click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b749202155613">Save</strong>.</li><li id="mrs_01_24260__en-us_topic_0000001173630826_li6522192513188">Click the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b4111314577">Instance</strong> tab, select the active and standby ResourceManager instances, click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b181937406589">More</strong>, and select <strong id="mrs_01_24260__en-us_topic_0000001173630826_b9793951165818">Restart Instance</strong> to restart the ResourceManager instances of Yarn. Then wait until they are restarted successfully.</li></ol>
|
|
</p></li><li id="mrs_01_24260__en-us_topic_0000001173630826_li163657291812"><a name="mrs_01_24260__en-us_topic_0000001173630826_li163657291812"></a><a name="en-us_topic_0000001173630826_li163657291812"></a><span>Configure resource labels.</span><p><ol type="a" id="mrs_01_24260__en-us_topic_0000001173630826_ol3675546482"><li id="mrs_01_24260__en-us_topic_0000001173630826_li1341411818128">Choose <strong id="mrs_01_24260__en-us_topic_0000001173630826_b9313921619">Tenant Resources</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b186561351317">Resource Pool</strong>. On the displayed page, click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b53109182021">Add Resource Pool</strong>.</li><li id="mrs_01_24260__en-us_topic_0000001173630826_li14697331171711">Select a cluster, and enter a resource pool name and a resource label name, for example, <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1421815214814">pool1</strong>. Select the desired hosts, click <span><img id="mrs_01_24260__en-us_topic_0000001173630826_image81610816472" src="en-us_image_0000001295899908.png"></span> to add the selected hosts to the new resource pool, and click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b15400171414">OK</strong>.</li></ol>
|
|
</p></li><li id="mrs_01_24260__en-us_topic_0000001173630826_li18647413917"><span>Set <span id="mrs_01_24260__en-us_topic_0000001173630826_text77598121092">HetuEngine</span> parameters to enable the coordinator placement policy and enter the node resource label.</span><p><ol type="a" id="mrs_01_24260__en-us_topic_0000001173630826_ol154071921597"><li id="mrs_01_24260__en-us_topic_0000001173630826_li293522175120">Choose <strong id="mrs_01_24260__en-us_topic_0000001173630826_b520584318618">Cluster</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b08134461565">Service</strong> > <span id="mrs_01_24260__en-us_topic_0000001173630826_text0936122110512">HetuEngine</span>. Click the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1226518817716">Configurations</strong> tab and then <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1926528671">All Configurations</strong>. On the displayed page, set parameters and click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b338315405716">Save</strong>.
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_24260__en-us_topic_0000001173630826_table923712465119" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Setting <span id="mrs_01_24260__en-us_topic_0000001173630826_text2948649115219">HetuEngine</span> parameters</caption><thead align="left"><tr id="mrs_01_24260__en-us_topic_0000001173630826_row142384247517"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.4.2.1.1.7.2.3.1.1"><p id="mrs_01_24260__en-us_topic_0000001173630826_p623816243518">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.4.2.1.1.7.2.3.1.2"><p id="mrs_01_24260__en-us_topic_0000001173630826_p32381724145115">Setting</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_24260__en-us_topic_0000001173630826_row132385244513"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.4.2.1.1.7.2.3.1.1 "><p id="mrs_01_24260__en-us_topic_0000001173630826_p1123882495111">yarn.hetuserver.engine.coordinator.placement.enabled</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.4.2.1.1.7.2.3.1.2 "><p id="mrs_01_24260__en-us_topic_0000001173630826_p1123862416510">true</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24260__en-us_topic_0000001173630826_row1123817245514"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.4.2.1.1.7.2.3.1.1 "><p id="mrs_01_24260__en-us_topic_0000001173630826_p18238524165111">yarn.hetuserver.engine.coordinator.placement.label</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.4.2.1.1.7.2.3.1.2 "><p id="mrs_01_24260__en-us_topic_0000001173630826_p5238132410514">Node resource label created in <a href="#mrs_01_24260__en-us_topic_0000001173630826_li163657291812">3</a>, for example, <strong id="mrs_01_24260__en-us_topic_0000001173630826_b7645115661012">pool1</strong></p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li><li id="mrs_01_24260__en-us_topic_0000001173630826_li12790113992914">Click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b5421559291">Dashboard</strong>, click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b17332112614105">More</strong>, and select <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1459782941014">Service Rolling Restart</strong>. Wait until the <span id="mrs_01_24260__en-us_topic_0000001173630826_text19987815205215">HetuEngine</span> service is restarted successfully.</li></ol>
|
|
</p></li><li id="mrs_01_24260__en-us_topic_0000001173630826_li161124399"><span>Restart the <span id="mrs_01_24260__en-us_topic_0000001173630826_text1397110321390">HetuEngine</span> compute instance.</span><p><ol type="a" id="mrs_01_24260__en-us_topic_0000001173630826_ol1142623916915"><li id="mrs_01_24260__en-us_topic_0000001173630826_li0381173218183">In the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b44128399665453">Basic Information</strong> area on the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b171311196465453">Dashboard</strong> page, click the link next to <strong id="mrs_01_24260__en-us_topic_0000001173630826_b206815162765453">HSConsole WebUI</strong>. The HSConsole page is displayed.</li><li id="mrs_01_24260__en-us_topic_0000001173630826_li1857584545514">Locate the row that contains the target instance and click <strong id="mrs_01_24260__en-us_topic_0000001173630826_b1313995881213">Start</strong> in the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b7586711137">Operation</strong> column.</li></ol>
|
|
</p></li><li id="mrs_01_24260__en-us_topic_0000001173630826_li163967211263"><span>Check the node on which the coordinator is running.</span><p><ol type="a" id="mrs_01_24260__en-us_topic_0000001173630826_ol831792492613"><li id="mrs_01_24260__en-us_topic_0000001173630826_li1560913110398">Return to FusionInsight Manager.</li><li id="mrs_01_24260__en-us_topic_0000001173630826_li1044161114018">Choose <strong id="mrs_01_24260__en-us_topic_0000001173630826_b98844136157">Cluster</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b13346162020155">Services</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b188462229153">Yarn</strong>. In the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b4416342121515">Basic Information</strong> area on the <strong id="mrs_01_24260__en-us_topic_0000001173630826_b74161542181511">Dashboard</strong> page, click the link next to <strong id="mrs_01_24260__en-us_topic_0000001173630826_b154301661619">ResourceManager WebUI</strong>.</li><li id="mrs_01_24260__en-us_topic_0000001173630826_li0584155574118">In the navigation pane on the left, choose <strong id="mrs_01_24260__en-us_topic_0000001173630826_b18403130191713">Cluster</strong> > <strong id="mrs_01_24260__en-us_topic_0000001173630826_b194015313170">Nodes</strong>. You can view that the coordinator has been started on the node in the resource pool created in <a href="#mrs_01_24260__en-us_topic_0000001173630826_li163657291812">3</a>.<p id="mrs_01_24260__en-us_topic_0000001173630826_p16358205224411"><span><img id="mrs_01_24260__en-us_topic_0000001173630826_image1735895219443" src="en-us_image_0000001349139461.png"></span></p>
|
|
</li></ol>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1729.html">Managing Compute Instances</a></div>
|
|
</div>
|
|
</div>
|
|
|