forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
169 lines
16 KiB
HTML
169 lines
16 KiB
HTML
<a name="mrs_01_0402"></a><a name="mrs_01_0402"></a>
|
|
|
|
<h1 class="topictitle1">Loader Link Configuration</h1>
|
|
<div id="body1589421630544"><p id="mrs_01_0402__p184721821141115">This section applies to versions earlier than MRS 3.x.</p>
|
|
<div class="section" id="mrs_01_0402__s928381114aed4b4eb08f287c5d5c9ff0"><h4 class="sectiontitle">Overview</h4><p id="mrs_01_0402__ab5a40e6abe83416a9abbd160af2e1c84">Loader supports the following links. This section describes configurations of each link.</p>
|
|
<ul id="mrs_01_0402__u972fdc4f57654cb99baf8fe9c9f2fee9"><li id="mrs_01_0402__l88cd15feba154ba6909afd2caff91f2e">obs-connector</li><li id="mrs_01_0402__en-us_topic_0070859523_li99429165022">generic-jdbc-connector</li><li id="mrs_01_0402__lca80c526506c4523bd7fee177e803ea7">ftp-connector or sftp-connector</li><li id="mrs_01_0402__l93b43b9241054138a4de60d300a3eedf">hbase-connector, hdfs-connector, or hive-connector</li></ul>
|
|
</div>
|
|
<div class="section" id="mrs_01_0402__s5482eab8b69a44a48a2fcb069390d769"><h4 class="sectiontitle">OBS Link</h4><p id="mrs_01_0402__aed2558df2ab0497a91c347733da36ce6">An OBS link is a data exchange channel between Loader and OBS. <a href="#mrs_01_0402__t6fd2dae9f81e4309906aec5754a1bf77">Table 1</a> describes the configuration parameters.</p>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_0402__t6fd2dae9f81e4309906aec5754a1bf77"></a><a name="t6fd2dae9f81e4309906aec5754a1bf77"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0402__t6fd2dae9f81e4309906aec5754a1bf77" frame="border" border="1" rules="all"><caption><b>Table 1 </b><strong id="mrs_01_0402__b182829717015">obs-connector</strong> configuration</caption><thead align="left"><tr id="mrs_01_0402__r137dee3f5f374cc0aa2586646ee6e7f4"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.3.2.3.1.1"><p id="mrs_01_0402__a627d04c3bed542ca886bfc68a9b8e9f8">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="75%" id="mcps1.3.3.3.2.3.1.2"><p id="mrs_01_0402__ad3b306f3d0a64bafaa221cf2fe77da4c">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_0402__r75b3ea3932de44b088048608c4c28ce9"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.2.3.1.1 "><p id="mrs_01_0402__a88056ffebe56418a9581070f10620af3">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.3.3.2.3.1.2 "><p id="mrs_01_0402__adc68371588e644e2a905780696e5bd2c">Name of a Loader connection</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r83539d320ccf4f29a0f97e7c7dfbb1a7"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.2.3.1.1 "><p id="mrs_01_0402__a1dca11d6ea8c4978a1bae3fb0dff116f">OBS Server</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.3.3.2.3.1.2 "><p id="mrs_01_0402__adfe2884f2ceb4bc0b25206cfbb6bf641">Enter an OBS endpoint. The common format is <strong id="mrs_01_0402__b15726164212010">OBS.<em id="mrs_01_0402__i127208421302">Region</em>.<em id="mrs_01_0402__i13725154217016">DomainName</em></strong>.</p>
|
|
<p id="mrs_01_0402__ad44d6bb798c8427fa9fe799fe5e47b14">Run the following command to query the endpoints of OBS:</p>
|
|
<p id="mrs_01_0402__a3bdfda38c7d04f4caec64efc28de5005"><strong id="mrs_01_0402__b1487913260378">cat /opt/Bigdata/apache-tomcat-7.0.78/webapps/web/WEB-INF/classes/cloud-obs.properties</strong></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r3a39b60ab21a4a5aaf15f5c2ffc704f7"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.2.3.1.1 "><p id="mrs_01_0402__a8b4fc4fa805f42429edde9f47ad17eba">Port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.3.3.2.3.1.2 "><p id="mrs_01_0402__a40679334b4ed40c8a4b04e91e6d76f31">Specifies the port for accessing OBS data. The default value is <strong id="mrs_01_0402__b146941029110">443</strong>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__rc2e8e22efedb4d3d838f7974f7bcb6b4"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.2.3.1.1 "><p id="mrs_01_0402__a16fafb8f3a124bce92f19224ead7f9b6">Access Key</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.3.3.2.3.1.2 "><p id="mrs_01_0402__a431e5ad7b6994ed0ac2d29b45ade0209">AK for a user to access OBS</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__rd91ff600dac148dd8aacb26451ee7282"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.2.3.1.1 "><p id="mrs_01_0402__a2a090421a28641f79a56cb9bbc06c882">Security Key</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.3.3.2.3.1.2 "><p id="mrs_01_0402__aa5b12f69d23149da9fb23e2ebdffcd80">SK corresponding to AK</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="mrs_01_0402__s3adba992c44845858448dc54a3ac5cf9"><h4 class="sectiontitle">Relational Database Link</h4><p id="mrs_01_0402__adcc1ccd2b1514155820bea333053c75b">A relational database link is a data exchange channel between Loader and a relational database. <a href="#mrs_01_0402__t938c9f27e7004e4dbcca6c3c0ba5d8a2">Table 2</a> describes the configuration parameters.</p>
|
|
<div class="note" id="mrs_01_0402__n4d400d227dc145bba15b43a297f50033"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_0402__a2037d1fbb5b842248faeb21df22edb9c">Some parameters are hidden by default. They appear only after you click <span class="uicontrol" id="mrs_01_0402__u8ee04daa112f477b9be7148cf1eb0df4"><b>Show Senior Parameter</b></span>.</p>
|
|
</div></div>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_0402__t938c9f27e7004e4dbcca6c3c0ba5d8a2"></a><a name="t938c9f27e7004e4dbcca6c3c0ba5d8a2"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0402__t938c9f27e7004e4dbcca6c3c0ba5d8a2" frame="border" border="1" rules="all"><caption><b>Table 2 </b><strong id="mrs_01_0402__b051782011312">generic-jdbc-connector</strong> configuration</caption><thead align="left"><tr id="mrs_01_0402__r661eb1d54660464287aba708fc753996"><th align="left" class="cellrowborder" valign="top" width="24.98%" id="mcps1.3.4.4.2.3.1.1"><p id="mrs_01_0402__a20a6f27b9d31433f840a881b1206815c">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="75.02%" id="mcps1.3.4.4.2.3.1.2"><p id="mrs_01_0402__adfb44363195440f2a7280697a12a8c63">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_0402__ra5933fe0252d43f48c2fb0208e405579"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__a3275474d3c0b4d1991f36b2fa1a3b63a">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__a1a7573b8837c489996efba3fd736257d">Name of a Loader link</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r3fc53024658642fcb2c64af3f6b7e434"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__af635ba364828447ca4ef60ffbd43d2a4">Database Type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__ab7e9e57963be46cdb3e02e52a36f856b">Data types supported by Loader links: <span class="parmvalue" id="mrs_01_0402__parmvalue674244230"><b>ORACLE</b></span>, <span class="parmvalue" id="mrs_01_0402__parmvalue1279164415318"><b>MYSQL</b></span>, and <span class="parmvalue" id="mrs_01_0402__parmvalue57916441320"><b>MPPDB</b></span></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r4311edf3c2b047ccb5f76102f88b6884"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__a0ae257455c41460e927354b8c0ecb9e3">Host</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__a157eb7708b17412794a0763f577b497f">Database access address, which can be an IP address or domain name.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__rf73f722e1124452fb7110e1e0cf7ae63"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__ad059997a2cc54945b12ae54f74c9b37d">Port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__ad5356c0b42f745398b2eb3e07498ebd7">Port for accessing the database</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r772165140c1842b086c536808b2d78fe"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__a127a3254cdfc49569b6c977cca823cdc">Database</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__a46cf76cd1e27423eb62f37c50c1b8315">Name of the database saving data</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r4eab374a45ce4443a4c1ec51a21fee56"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__a7918e2a020ce42aabba551fe9f2184e3">Username</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__aa1156464e7da46348d07b7d3c6925998">Username for accessing the database</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r69bb7673014d4f9cbab32855f42f9082"><td class="cellrowborder" valign="top" width="24.98%" headers="mcps1.3.4.4.2.3.1.1 "><p id="mrs_01_0402__a352b7c1090c547ebb482d5c3361f879a">Password</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75.02%" headers="mcps1.3.4.4.2.3.1.2 "><p id="mrs_01_0402__en-us_topic_0070859523_p806192162119">Password of the user Use the actual password.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0402__t30f489226f7443c48d00aba34748e7e9" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Senior parameter configuration</caption><thead align="left"><tr id="mrs_01_0402__r9aad057702e3479eb8333fe4a7a59067"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.5.2.3.1.1"><p id="mrs_01_0402__a4ed3e9b266124dc39c6ab45df420592a">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="75%" id="mcps1.3.5.2.3.1.2"><p id="mrs_01_0402__a2b1d0c4851d0490682a3f27cb28290d2">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_0402__ra0ccb42f274647d789a595e748cb7610"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.5.2.3.1.1 "><p id="mrs_01_0402__a730ee559f70e46c8817bf06ed45fb1fb">Fetch Size</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.5.2.3.1.2 "><p id="mrs_01_0402__af443076bb81c4a4e96d6c769116ac0b4">A maximum volume of data obtained during each database access</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r307d76119ab8451f8c5b5d9e684a0a9f"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.5.2.3.1.1 "><p id="mrs_01_0402__a6289e89f766d4b8fb691e7b54c6d3096">Connection Properties</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.5.2.3.1.2 "><p id="mrs_01_0402__ab42f409947ce4f46a2797a9db0064fb4">Drive properties exclusive to the database link supported by databases of different types, for example, <span class="parmname" id="mrs_01_0402__p796e02d97991427bb1ce9ce1807f80fa"><b>autoReconnect</b></span> of MYSQL. If you want to define the drive properties, click <span class="uicontrol" id="mrs_01_0402__u0331134384b6442597038da80adfed57"><b>Add</b></span>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r081305e477a84585abca25cc1b22b7e6"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.5.2.3.1.1 "><p id="mrs_01_0402__a50787e91ce0d4a518125aea32823fcc3">Identifier Enclose</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.5.2.3.1.2 "><p id="mrs_01_0402__a2c428ddb0d454b1aad3e019fcb955a40">Delimiter for reserving keywords in the database SQL. Delimiters defined in different databases vary.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<div class="section" id="mrs_01_0402__s73ada4f9d7e94890a00a2c7a90856ba6"><a name="mrs_01_0402__s73ada4f9d7e94890a00a2c7a90856ba6"></a><a name="s73ada4f9d7e94890a00a2c7a90856ba6"></a><h4 class="sectiontitle">File Server Link</h4><p id="mrs_01_0402__a83b344ae422b4a64ae39091fdc245fd6">File server links include FTP and SFTP links and serve as a data exchange channel between Loader and a file server. <a href="#mrs_01_0402__t15d36a6a4bda4efe8b7dd5d4abb70019">Table 4</a> describes the configuration parameters.</p>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_0402__t15d36a6a4bda4efe8b7dd5d4abb70019"></a><a name="t15d36a6a4bda4efe8b7dd5d4abb70019"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0402__t15d36a6a4bda4efe8b7dd5d4abb70019" frame="border" border="1" rules="all"><caption><b>Table 4 </b><strong id="mrs_01_0402__b44091871879">ftp-connector</strong> or <strong id="mrs_01_0402__b20409107275">sftp-connector</strong> configuration</caption><thead align="left"><tr id="mrs_01_0402__r9c1a011a175249e49afb7265fc80fff5"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.6.3.2.3.1.1"><p id="mrs_01_0402__a9efe23ac1f544dee8e837d1db5979e43">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="75%" id="mcps1.3.6.3.2.3.1.2"><p id="mrs_01_0402__a271f379076824840a5c88fa8531af562">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_0402__r0961571163fc4d38b510ef27d85e0e6f"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.6.3.2.3.1.1 "><p id="mrs_01_0402__a2fbe412a8f3747fdb6632be895e386af">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.6.3.2.3.1.2 "><p id="mrs_01_0402__a08c97dd694c74c1cb6f40b7c8a983954">Name of a Loader link</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r778dca00da264f99a40091a8264fdca8"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.6.3.2.3.1.1 "><p id="mrs_01_0402__a7460771288324fcfae18a327d2db15d1">Hostname/IP</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.6.3.2.3.1.2 "><p id="mrs_01_0402__a3f3e13f5f72343068daf47c873bbe6bd">Enter the file server access address, which can be a host name or IP address.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r9d4370c88f1c443186d1bf066f12c7d2"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.6.3.2.3.1.1 "><p id="mrs_01_0402__a9b42b4e816fb4c679b324c2797c92a7f">Port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.6.3.2.3.1.2 "><p id="mrs_01_0402__afa2c0342b5b74c1999ef4de5f11c8e0c">Port for accessing the file server.</p>
|
|
<ul id="mrs_01_0402__ubacd452575c14d83baa3ceb00e53f1b4"><li id="mrs_01_0402__l836bac37d7134bc0ba49fe84a9f0339f">Use port <span class="parmvalue" id="mrs_01_0402__p438c53d55fc04ad19e0e46e9fbfbf3ec"><b>21</b></span> for FTP.</li><li id="mrs_01_0402__l5bc9042462ab4a238049ee6a22c1ced0">Use port <span class="parmvalue" id="mrs_01_0402__pa34e4048da8148ecb5690201042eea4e"><b>22</b></span> for SFTP.</li></ul>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r8205631f6d344155b338f71c9513bf5e"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.6.3.2.3.1.1 "><p id="mrs_01_0402__a2189dec77c094a5999e0939eb7c83d30">Username</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.6.3.2.3.1.2 "><p id="mrs_01_0402__a50155294694b48ca885323431e8c6cca">Username for logging in to the file server</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_0402__r2bb8b33d1b144d1fbff83cf4ee8eb969"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.6.3.2.3.1.1 "><p id="mrs_01_0402__afe76cd83f59c4b718b8c585feb4f2c42">Password</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="75%" headers="mcps1.3.6.3.2.3.1.2 "><p id="mrs_01_0402__a4c031e198a25489c8a36770bf6078b15">Password of the user</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="mrs_01_0402__s363f37eedcd7492bb75ef7b426b0000b"><h4 class="sectiontitle">MRS Cluster Link</h4><p id="mrs_01_0402__ab66927290c5a4046ac72de55f865137f">MRS cluster links include HBase, HDFS, and Hive links and serve as a data exchange channel between Loader and HBase, HDFS, or Hive.</p>
|
|
<p id="mrs_01_0402__ac21d5a03072143a2b0b7aa2f0e593932">When configuring an MRS cluster link, set the name, select a connector, for example, <span class="parmvalue" id="mrs_01_0402__parmvalue1658352611819"><b>hbase-connector</b></span>, <span class="parmvalue" id="mrs_01_0402__parmvalue1858813261183"><b>hdfs-connector</b></span>, or <span class="parmvalue" id="mrs_01_0402__parmvalue1258813260812"><b>hive-connector</b></span>, and save the settings.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0400.html">Using Loader</a></div>
|
|
</div>
|
|
</div>
|
|
|