lboka/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide-lts/mrs_01_24260.html
Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

11 KiB
Raw Permalink Blame History

Using Resource Labels to Specify on Which Node Coordinators Should Run

By default, coordinator and worker nodes randomly start on Yarn NodeManager nodes, and you have to open all ports on all NodeManager nodes. Using resource labels of Yarn, HetuEngine allows you to specify NodeManager nodes to run coordinators.

Prerequisites

You have created a user for accessing the HetuEngine web UI. For details, see Creating a HetuEngine User.

Procedure

  1. Log in to FusionInsight Manager as a user who can access the HetuEngine web UI.
  2. Set Yarn parameters to specify the scheduler to handle PlacementConstraints.

    1. Choose Cluster > Services > Yarn. Click the Configurations tab and then All Configurations. On the displayed page, search for yarn.resourcemanager.placement-constraints.handler, set Value to scheduler, and click Save.
    2. Click the Instance tab, select the active and standby ResourceManager instances, click More, and select Restart Instance to restart the ResourceManager instances of Yarn. Then wait until they are restarted successfully.

  3. Configure resource labels.

    1. Choose Tenant Resources > Resource Pool. On the displayed page, click Add Resource Pool.
    2. Select a cluster, and enter a resource pool name and a resource label name, for example, pool1. Select the desired hosts, click to add the selected hosts to the new resource pool, and click OK.

  4. Set HetuEngine parameters to enable the coordinator placement policy and enter the node resource label.

    1. Choose Cluster > Service > HetuEngine. Click the Configurations tab and then All Configurations. On the displayed page, set parameters and click Save.
      Table 1 Setting HetuEngine parameters

      Parameter

      Setting

      yarn.hetuserver.engine.coordinator.placement.enabled

      true

      yarn.hetuserver.engine.coordinator.placement.label

      Node resource label created in 3, for example, pool1
    2. Click Dashboard, click More, and select Service Rolling Restart. Wait until the HetuEngine service is restarted successfully.

  5. Restart the HetuEngine compute instance.

    1. In the Basic Information area on the Dashboard page, click the link next to HSConsole WebUI. The HSConsole page is displayed.
    2. Locate the row that contains the target instance and click Start in the Operation column.

  6. Check the node on which the coordinator is running.

    1. Return to FusionInsight Manager.
    2. Choose Cluster > Services > Yarn. In the Basic Information area on the Dashboard page, click the link next to ResourceManager WebUI.
    3. In the navigation pane on the left, choose Cluster > Nodes. You can view that the coordinator has been started on the node in the resource pool created in 3.