forked from docs/doc-exports
Yang, Tong
2195db241c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
24 lines
6.1 KiB
HTML
24 lines
6.1 KiB
HTML
<a name="admin_guide_000200"></a><a name="admin_guide_000200"></a>
|
|
|
|
<h1 class="topictitle1">Enabling Cross-Cluster Replication</h1>
|
|
<div id="body1530063325283"><div class="section" id="admin_guide_000200__s886896ffd96f408490bed9f30b917fe6"><h4 class="sectiontitle">Scenario</h4><p id="admin_guide_000200__en-us_topic_0046736761_p44154877">DistCp is used to replicate the data stored in HDFS from a cluster to another cluster. DistCp depends on the cross-cluster replication function, which is disabled by default. You need to enable it for both clusters.</p>
|
|
<p id="admin_guide_000200__en-us_topic_0046736761_p61849578">This section describes how to modify parameters on <span id="admin_guide_000200__text67509419010">MRS</span> Manager to enable the cross-cluster replication function. After this function is enabled, you can create a backup task for backing up data to the remote HDFS (RemoteHDFS).</p>
|
|
</div>
|
|
<div class="section" id="admin_guide_000200__s0a548359fed54946ab56cd2ca63e17f6"><h4 class="sectiontitle">Impact on the System</h4><p id="admin_guide_000200__en-us_topic_0046736761_p43759888">Yarn needs to be restarted to enable the cross-cluster replication function and cannot be accessed during restart.</p>
|
|
</div>
|
|
<div class="section" id="admin_guide_000200__sb084399274d24c149dac9a315a0f5e64"><h4 class="sectiontitle">Prerequisites</h4><ul id="admin_guide_000200__ul1039418548383"><li id="admin_guide_000200__li23941654193819">The <strong id="admin_guide_000200__b212721043563656">hadoop.rpc.protection</strong> parameter of HDFS in the two clusters for data replication must use the same data transmission mode. The default value is <strong id="admin_guide_000200__b13430242165210">privacy</strong>, indicating encrypted transmission. The value <strong id="admin_guide_000200__b443264295213">authentication</strong> indicates that transmission is not encrypted.</li><li id="admin_guide_000200__li1939435433812">For clusters in security mode, you need to configure mutual trust between clusters.</li></ul>
|
|
</div>
|
|
<div class="section" id="admin_guide_000200__se0e39f6f9c4348b0a615a7d8755b7422"><h4 class="sectiontitle">Procedure</h4><ol id="admin_guide_000200__en-us_topic_0046736761_ol16908166"><li id="admin_guide_000200__en-us_topic_0046736761_li17955773"><span>Log in to <span id="admin_guide_000200__text1276612231913">MRS</span> Manager of one of the two clusters.</span></li><li id="admin_guide_000200__en-us_topic_0046736761_li45131484"><a name="admin_guide_000200__en-us_topic_0046736761_li45131484"></a><a name="en-us_topic_0046736761_li45131484"></a><span>Choose <span class="menucascade" id="admin_guide_000200__menucascade58164510308"><b><span class="uicontrol" id="admin_guide_000200__uicontrol281645143013">Cluster</span></b> > <b><span class="uicontrol" id="admin_guide_000200__uicontrol18290115120303"><span id="admin_guide_000200__text179743347487"><strong id="admin_guide_000200__b11862161116411"><em id="admin_guide_000200__i189017551350">Name of the desired cluster</em></strong> ><em id="admin_guide_000200__i1978235534812"> </em></span>Services</span></b> > <b><span class="uicontrol" id="admin_guide_000200__uicontrol1363455411304">Yarn</span></b> > <b><span class="uicontrol" id="admin_guide_000200__uicontrol1432801016311">Configurations</span></b></span>, and click <strong id="admin_guide_000200__b9378104764011">All Configurations</strong>.</span></li><li id="admin_guide_000200__en-us_topic_0046736761_li3530175"><span>In the navigation pane, choose <strong id="admin_guide_000200__b110440079363656">Yarn</strong> > <strong id="admin_guide_000200__b75742036763656">Distcp</strong>.</span></li><li id="admin_guide_000200__en-us_topic_0046736761_li31771576"><span>Modify <strong id="admin_guide_000200__b13202155714512">dfs.namenode.rpc-address</strong>, set <strong id="admin_guide_000200__b19100154045317">haclusterX.remotenn1</strong> to the service IP address and RPC port of one NameNode instance of the peer cluster, and set <strong id="admin_guide_000200__b112031657184514">haclusterX.remotenn2</strong> to the service IP address and RPC port number of the other NameNode instance of the peer cluster.</span><p><p id="admin_guide_000200__en-us_topic_0046736761_p17508728"><strong id="admin_guide_000200__b1553255554817">haclusterX.remotenn1</strong> and <strong id="admin_guide_000200__b8767115754817">haclusterX.remotenn2</strong> do not distinguish active and standby NameNodes. The default NameNode RPC port is 8020 and cannot be modified on Manager.</p>
|
|
<p id="admin_guide_000200__en-us_topic_0046736761_p23360824">Examples of modified parameter values: <strong id="admin_guide_000200__b183832137763656">10.1.1.1:8020</strong> and <strong id="admin_guide_000200__b183277381063656">10.1.1.2:8020</strong>.</p>
|
|
<div class="note" id="admin_guide_000200__note173050222514"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="admin_guide_000200__ul1013610282511"><li id="admin_guide_000200__li20343131313534">If data of the current cluster needs to be backed up to the HDFS of multiple clusters, you can configure the corresponding NameNode RPC addresses to haclusterX1, haclusterX2, haclusterX3, and haclusterX4.</li></ul>
|
|
</div></div>
|
|
</p></li><li id="admin_guide_000200__li768814575217"><span>Click <strong id="admin_guide_000200__b141473048563656">Save</strong>. In the confirmation dialog box, click <strong id="admin_guide_000200__b166012662063656">OK</strong>.</span></li><li id="admin_guide_000200__en-us_topic_0046736761_li8920825"><a name="admin_guide_000200__en-us_topic_0046736761_li8920825"></a><a name="en-us_topic_0046736761_li8920825"></a><span>Restart the Yarn service.</span></li><li id="admin_guide_000200__en-us_topic_0046736761_li51498219"><span>Log in to <span id="admin_guide_000200__text9587102412197">MRS</span> Manager of the other cluster and repeat <a href="#admin_guide_000200__en-us_topic_0046736761_li45131484">2</a> to <a href="#admin_guide_000200__en-us_topic_0046736761_li8920825">6</a>.</span></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="admin_guide_000198.html">Backup and Recovery Management</a></div>
|
|
</div>
|
|
</div>
|
|
|