vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dws/umn/dws_01_0156.html
Lu, Huayi 95132e24fc DWS UMN 830.201_new version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com>
Co-authored-by: Lu, Huayi <luhuayi@huawei.com>
Co-committed-by: Lu, Huayi <luhuayi@huawei.com>
2024-05-27 11:54:34 +00:00

94 lines
14 KiB
HTML
Raw Blame History

<a name="EN-US_TOPIC_0000001707293973"></a><a name="EN-US_TOPIC_0000001707293973"></a>
<h1 class="topictitle1">Updating the MRS Data Source Configuration</h1>
<div id="body8662426"><div class="section" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_section31806539111657"><h4 class="sectiontitle">Scenario</h4><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p394673392220">For MRS, if the following parameter configurations of the HDFS cluster change, data may fail to be imported to the data warehouse cluster from the HDFS cluster. Before importing data using the HDFS cluster, you must update the MRS data source configuration.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_table4618184514293" frame="border" border="1" rules="all"><thead align="left"><tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row7619194592917"><th align="left" class="cellrowborder" valign="top" width="41%" id="mcps1.3.1.3.1.3.1.1"><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p12589614152910">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="59%" id="mcps1.3.1.3.1.3.1.2"><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p8398249152910">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row161974518294"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p43291566302">dfs.client.read.shortcircuit</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p832912693017">Specifies whether to enable the local read function.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row1261994522912"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p33296673017">dfs.client.read.shortcircuit.skip.checksum</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p183303633019">Specifies whether to skip data verification during the local read.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row4193515322"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p233015643013">dfs.client.block.write.replace-datanode-on-failure.enable</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p17330156163015">Specifies whether to replace the location storing copies with the new node when data blocks fail to be written to HDFS.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row519165173213"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p6330196133011">dfs.encrypt.data.transfer</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p719295193211">Specifies whether to enable data encryption. The value <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b4706216758221">true</strong> indicates that the channels are encrypted. The channels are not encrypted by default.</p>
<div class="note" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_note3531257017930"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_ul791614338487"><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li14928839134815">This parameter is available only for clusters with Kerberos authentication enabled.</li><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li1091613333489">This parameter is valid only when <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b6470297318221">hadoop.rpc.protection</strong> is set to <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b14067110118221">privacy</strong>.</li></ul>
</div></div>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row1461015818328"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p233015618306">dfs.encrypt.data.transfer.algorithm</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p1133136153015">Specifies the encryption and decryption algorithm for key transmission.</p>
<p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p8226855104613">This parameter is valid only when <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b2649970328221">dfs.encrypt.data.transfer</strong> is set to <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b17325017878221">true</strong>.</p>
<p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p034132503613">The default value is <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b12431012068221">3des</strong>, indicating that the 3DES algorithm is used for encryption.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row3912191116327"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p691241118326">dfs.encrypt.data.transfer.cipher.suites</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p13912191110326">Specifies the encryption and decryption algorithm for the transmission of actually stored data.</p>
<p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p42857219469">If this parameter is not specified, the cryptographic algorithm specified by <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b20753812278221">dfs.encrypt.data.transfer.algorithm</strong> is used for data encryption. The default value is <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b2406502218221">AES/CTR/NoPadding</strong>.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row46231942133316"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p12331067307">dfs.replication</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p14623144210337">Specifies the default number of data copies.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row8714346173314"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p83311663010">dfs.blocksiz</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p633114614307">Specifies the default size of a data block.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row15707450113318"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p1833110633013">hadoop.security.authentication</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p137081500335">Specifies the security authentication mode.</p>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row8284105503320"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p1033110623019">hadoop.rpc.protection</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p102848555333">Specifies the RPC communication protection mode.</p>
<p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p2515354367">Default value:</p>
<ul id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_ul1686155711358"><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li1068619574351">Security mode (Kerberos authentication enabled): <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b3644262928221">privacy</strong></li><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li1068665717355">Common mode (Kerberos authentication disabled): <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b15149875878221">authentication</strong></li></ul>
<div class="note" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_note7591819113611"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_ul7633926153616"><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li9633202617360"><strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b12925872208221">authentication</strong>: indicates that only authentication is required.</li><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li863362616365"><strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b1555939298221">integrity</strong>: indicates that authentication and consistency check need to be performed.</li><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li1763311261366"><strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b8993483848221">privacy</strong>: indicates that authentication, consistency check, and encryption need to be performed.</li></ul>
</div></div>
</td>
</tr>
<tr id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_row19749125963313"><td class="cellrowborder" valign="top" width="41%" headers="mcps1.3.1.3.1.3.1.1 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p6331265302">dfs.domain.socket.path</p>
</td>
<td class="cellrowborder" valign="top" width="59%" headers="mcps1.3.1.3.1.3.1.2 "><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p874995913313">Specifies the locally used <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b842352706104642">Domain socket</strong> path.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_section45940751111911"><h4 class="sectiontitle">Prerequisites</h4><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p1923474819376">You have created an MRS data source connection for the data warehouse cluster.</p>
</div>
<div class="section" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_section178972158583"><h4 class="sectiontitle">Impact on the System</h4><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p203014501376">When you are updating an MRS data source connection, the data warehouse cluster will automatically restart and cannot provide services.</p>
</div>
<div class="section" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_section4276196111818"><h4 class="sectiontitle">Procedure</h4><ol id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_ol39469418111823"><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li10022705112330"><span>On the GaussDB(DWS) management console, choose <span class="uicontrol" id="EN-US_TOPIC_0000001707293973__uicontrol1138015144249"><b>Clusters &gt; Dedicated Clusters</b></span>.</span></li><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li60457944112332"><span>In the cluster list, click the name of a cluster. On the page that is displayed, click <span class="uicontrol" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_uicontrol2927461612014"><b>MRS Data Sources</b></span>.</span></li><li id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_li1496585711256"><span>In the MRS data source list, select the MRS data source that you want to update. In the <strong id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_b842352706104722">Operation</strong> column, click <span class="uicontrol" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_uicontrol230942777104734"><b>Update Configurations</b></span>.</span><p><p id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_p71381812192813"><span class="parmname" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_parmname1384634290104815"><b>MRS Cluster Status</b></span> and <span class="parmname" id="EN-US_TOPIC_0000001707293973__en-us_topic_0000001423119189_parmname1233020519104815"><b>Configuration Status</b></span> of the current connection will be updated. During configuration update, you cannot create a connection. The system checks whether the security group rule is correct. If the rule is incorrect, the system rectifies the fault.</p>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_01_0057.html">MRS Data Sources</a></div>
</div>
</div>
View Git Blame Copy Permalink