vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide-lts/mrs_01_1102.html
Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

427 lines
75 KiB
HTML
Raw Blame History

<a name="mrs_01_1102"></a><a name="mrs_01_1102"></a>
<h1 class="topictitle1">Using Loader to Export Data</h1>
<div id="body8662426"><div class="section" id="mrs_01_1102__en-us_topic_0000001173949302_s255af35ec6414e3aa024e92034276ead"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1102__en-us_topic_0000001173949302_a1a1d8ae1bab648618c58573c613458f7">This task enables you to export data from MRS to external data sources.</p>
<p id="mrs_01_1102__en-us_topic_0000001173949302_a447749a04cbb4b419c0876e656135261">Generally, users can manually manage data import and export jobs on the Loader UI. To use shell scripts to update and run Loader jobs, you must configure the installed Loader client.</p>
</div>
<div class="section" id="mrs_01_1102__en-us_topic_0000001173949302_s583d8360f507406e89828dff1cb32f13"><h4 class="sectiontitle">Prerequisites</h4><ul id="mrs_01_1102__en-us_topic_0000001173949302_u1809b51ab42a4e81b91a32718d42ea6a"><li id="mrs_01_1102__en-us_topic_0000001173949302_l833f838474a444da85c8ce699163361b">You have obtained the service user name and password for creating a Loader job.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l766badf4675e488598dc6cb8679a6733">You have had the permission to access the HDFS directories, HBase tables, and data involved in job execution.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l5256705f9bca49dab0bd5e8ab384b024">You have obtained the user name and password used by an external data source (SFTP server or relational database).</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l2dddeda1bdf34bca80787bbd20fa9897">No disk space alarm is reported, and the available disk space is sufficient for importing and exporting data.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l6e856b50b5dd4caa8a0444691c4f8b4a">When using Loader to export data from HDFS/OBS, the input paths and input path subdirectories of HDFS/OBS data source and the name of the files in these directories do not contain any of the following special characters: <strong id="mrs_01_1102__en-us_topic_0000001173949302_a00ec897e53374a449a9ee89285084dd5">/\"':;,</strong>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l3a5924e6769545d8a0c39298b676def6">If the job requires the Yarn queue function, the user must be authorized with related Yarn queue permission.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l9bfac11373ed4f5789e01221d8668a31">The user who configures a task must obtain execution permission on the task and obtain usage permission on the related connection of the task.</li></ul>
</div>
<div class="section" id="mrs_01_1102__en-us_topic_0000001173949302_s1dc6371b614444fd9ecdf02a11d565f8"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1102__en-us_topic_0000001173949302_o374fa5336e4d4eb4995de256186182fb"><li id="mrs_01_1102__en-us_topic_0000001173949302_la20734520e4a4d46a75b44072d6758b4"><span>Check whether data is exported from Loader to a relational database for the first time.</span><p><ul id="mrs_01_1102__en-us_topic_0000001173949302_u79770ca114d04d25a09234723d2b6e72"><li id="mrs_01_1102__en-us_topic_0000001173949302_l85b62e22e75f463f9236dfc067478e25">If yes, go to <a href="#mrs_01_1102__en-us_topic_0000001173949302_li1629363225912">2</a>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lbccc1f0c04fc417e9c12ff045634ca99">If no, go to <a href="#mrs_01_1102__en-us_topic_0000001173949302_l80c533e39c5d445794c483104df54510">3</a>.</li></ul>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_li1629363225912"><a name="mrs_01_1102__en-us_topic_0000001173949302_li1629363225912"></a><a name="en-us_topic_0000001173949302_li1629363225912"></a><span>Modify the permission on the JAR package of the RDS driver.</span><p><ol type="a" id="mrs_01_1102__en-us_topic_0000001173949302_ol16374183718591"><li id="mrs_01_1102__en-us_topic_0000001173949302_li145002456571">Obtain the JAR package of the relational database driver and save it to the following directory on the active and standby Loader nodes: <strong id="mrs_01_1102__en-us_topic_0000001173949302_b920194451114">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1102__en-us_topic_0000001173949302_text9504615162611">8.1.2.2</span>/install/FusionInsight-Sqoop-1.99.3/FusionInsight-Sqoop-1.99.3/server/webapps/loader/WEB-INF/ext-lib</strong>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_li175111445145715">Run the following command on the active and standby nodes as user <strong id="mrs_01_1102__en-us_topic_0000001173949302_b443915254485">root </strong>to modify the permission:<p id="mrs_01_1102__en-us_topic_0000001173949302_p11910153515012"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b75232536535">cd </strong><strong id="mrs_01_1102__en-us_topic_0000001173949302_b8525153175310">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1102__en-us_topic_0000001173949302_text13308247261">8.1.2.2</span></strong><strong id="mrs_01_1102__en-us_topic_0000001173949302_b14526175315316">/install/FusionInsight-Sqoop-1.99.3/FusionInsight-Sqoop-1.99.3/server/webapps/loader/WEB-INF/ext-lib</strong></p>
<p id="mrs_01_1102__en-us_topic_0000001173949302_p20511134595715"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b4578294392110">chown omm:wheel</strong> <em id="mrs_01_1102__en-us_topic_0000001173949302_i52731860192110">JAR</em><em id="mrs_01_1102__en-us_topic_0000001173949302_i24824014492110"> package name</em></p>
<p id="mrs_01_1102__en-us_topic_0000001173949302_p55111345165713"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b117801690192110">chmod 600</strong> <em id="mrs_01_1102__en-us_topic_0000001173949302_i182735544692110">JAR</em><em id="mrs_01_1102__en-us_topic_0000001173949302_i111829684192110"> package name</em></p>
</li><li id="mrs_01_1102__en-us_topic_0000001173949302_li11236204835913">Log in to FusionInsight Manager. Choose <strong id="mrs_01_1102__en-us_topic_0000001173949302_b739417446482">Cluster</strong> &gt; <em id="mrs_01_1102__en-us_topic_0000001173949302_i174005449489">Name of the desired cluster</em> &gt; <strong id="mrs_01_1102__en-us_topic_0000001173949302_b134008443488">Service </strong>&gt; <strong id="mrs_01_1102__en-us_topic_0000001173949302_b14001544194810">Loader </strong>&gt; <strong id="mrs_01_1102__en-us_topic_0000001173949302_b14401144194811">More </strong>&gt; <strong id="mrs_01_1102__en-us_topic_0000001173949302_b12401124412481">Restart</strong>. Enter the password of the system administrator to restart the Loader service.</li></ol>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_l80c533e39c5d445794c483104df54510"><a name="mrs_01_1102__en-us_topic_0000001173949302_l80c533e39c5d445794c483104df54510"></a><a name="en-us_topic_0000001173949302_l80c533e39c5d445794c483104df54510"></a><span>Access the Loader web UI.</span><p><ol type="a" id="mrs_01_1102__en-us_topic_0000001219230551_obbc8c37dc53040efb21dc541b1dfc22c"><li id="mrs_01_1102__en-us_topic_0000001219230551_l6f0ffda40ca543d5a5660461b5e311dd">Log in to FusionInsight Manager. For details, see <a href="mrs_01_2124.html">Accessing FusionInsight Manager</a>.</li><li id="mrs_01_1102__en-us_topic_0000001219230551_la11b479a24ad4659a55365c2ede06015">Choose <strong id="mrs_01_1102__en-us_topic_0000001219230551_b39357591297">Cluster</strong> &gt; <em id="mrs_01_1102__en-us_topic_0000001219230551_i18941259112918">Name of the desired cluster</em> &gt; <strong id="mrs_01_1102__en-us_topic_0000001219230551_b19941115916297">Services</strong> &gt; <strong id="mrs_01_1102__en-us_topic_0000001219230551_b1894175916294">Loader</strong>.</li><li id="mrs_01_1102__en-us_topic_0000001219230551_l6601e8a2fd1b4780bf69238d6f5cc7f2">Click <strong id="mrs_01_1102__en-us_topic_0000001219230551_b13499742135213">LoaderServer(</strong><em id="mrs_01_1102__en-us_topic_0000001219230551_i187499244301">Node name</em><strong id="mrs_01_1102__en-us_topic_0000001219230551_b18777163515522">, Active)</strong>. The Loader web UI is displayed.<div class="fignone" id="mrs_01_1102__fig10607922203218"><span class="figcap"><b>Figure 1 </b>Loader web UI</span><br><span><img id="mrs_01_1102__mrs_01_1089_image155554364292" src="en-us_image_0000001438241209.png"></span></div>
</li></ol>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_l3eeeb3a9f5854d8fb889b44c6b2ce2c4"><span>Create a Loader data import job. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b16692190175810">New Job</strong>. Select the required job type in <strong id="mrs_01_1102__en-us_topic_0000001173949302_b16693150135816">1. Basic Information</strong> and click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b1693160125810">Next</strong>.</span><p><ol type="a" id="mrs_01_1102__en-us_topic_0000001173949302_o8b406484b59e41839798d600af1cbbfa"><li id="mrs_01_1102__en-us_topic_0000001173949302_ldd6b073945a845b9bfd7296da025efb8">Set <strong id="mrs_01_1102__en-us_topic_0000001173949302_b4180223552">Name</strong> to the job name and <strong id="mrs_01_1102__en-us_topic_0000001173949302_b191807285517">Type</strong> to <strong id="mrs_01_1102__en-us_topic_0000001173949302_b161815211555">Export</strong>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lb253fb1a84b44fb284842ddebfe58fa4">Select a connection for <strong id="mrs_01_1102__en-us_topic_0000001173949302_b2037875211555">Connection</strong>. By default, no connection is created. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b31645240992110">Add </strong>to create a connection, and then click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b94137468492110">Test </strong>to test whether the connection is available. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b117158699192110">OK </strong>when the system displays a message indicates that the test is successful.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1102__en-us_topic_0000001173949302_t3a56b57f2f754e02aab7da6ad4182a63" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Connection configuration parameters</caption><thead align="left"><tr id="mrs_01_1102__en-us_topic_0000001173949302_r90737609b45544ccbd9de59e5aa362dd"><th align="left" class="cellrowborder" valign="top" width="18.18%" id="mcps1.3.3.2.4.2.1.2.5.2.4.1.1"><p id="mrs_01_1102__en-us_topic_0000001173949302_a668a44515266433f8ad98f88f164ba15">Connector Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.220000000000002%" id="mcps1.3.3.2.4.2.1.2.5.2.4.1.2"><p id="mrs_01_1102__en-us_topic_0000001173949302_aece2ebfd53ee4ae694430d443c7b5842">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="59.599999999999994%" id="mcps1.3.3.2.4.2.1.2.5.2.4.1.3"><p id="mrs_01_1102__en-us_topic_0000001173949302_a054f57c5e85b4c038182e1d57fcbe842">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1102__en-us_topic_0000001173949302_ra733ac0fcf4545ec8ca36bb6eac57766"><td class="cellrowborder" rowspan="5" valign="top" width="18.18%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p761551716351">generic-jdbc-connector</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a92512d32fd6a49319c8f2bcd76019dde">JDBC Driver Class</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aba0a38b9ea01451ea7b356a128abd1c9">Specifies the name of a JDBC driver class.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r9a11aea739fe45f4bfa4c19ae6b6cc0a"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a7831a7191ab54fce8c91b4c17acae661">JDBC Connection String</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p959135616351">Specifies the JDBC connection string.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r2f872063e0154eb6ad065fdf9d110c2e"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_afe758f0f35c14a56912bd04300d8da4a">Username</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a123d3c70a2454a31a75a3011b95a16ed">Specifies the username for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rcbc28040f4c44c3bb75d682286db0d3a"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a123036b272a64a0dab07724a0881258f">Password</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p306935416351">Specifies the password for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_red90b135de92471a99ed79c3fcd97126"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a72147798b64446b08349afcf5c093bed">JDBC Connection Properties</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af015b7a8f4e84c1f9718fc0114c7552a">Specifies JDBC connection attributes. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b86648897992110">Add </strong>to manually add connection attributes.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_ue64922f511ce48dc850a50c4f4cb1c13"><li id="mrs_01_1102__en-us_topic_0000001173949302_l80567067df5446d8b79a8cd6d44fa128"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b987320407415">Name</strong>: connection attribute name</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l06bb975bf055434695e6705bbdbb4060"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b25958461146">Value</strong>: connection attribute value</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r670a7007150f4dc788f0f3e9a3ec1225"><td class="cellrowborder" valign="top" width="18.18%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a1437a2b8a9d24495b4bc0e9096b0d977">hdfs-connector</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p15871253115519">-</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p162921142135518">-</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rd19ade876d8b489cb750bc31d8006d4c"><td class="cellrowborder" rowspan="4" valign="top" width="18.18%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a69673998c4184a94bdf3c987b7059806">oracle-connector</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a3cf6f480aa6147db9d0de1e04a0bf7e3">JDBC Connection String</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_adbab738838094e5585e425272845bba2">Specifies connection string for a user to connect to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r3eba7fde966744e4b6d2bbc67302987b"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aebed6188f4f9411c87f1098693de154e">Username</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p395175116351">Specifies the username for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r9b203414fd6746e8aac539aab0162198"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af1d079ed316b483982fb9b81f1377dc7">Password</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p945246516351">Specifies the password for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rb4b6573ba0f5491f872a8c522130a3c3"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a475d340f120b4289aa5a3fdabe8658c4">Connection Properties</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a717f174eb435487a8f2e276b1f249a20">Specifies connection attributes. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b50813794992110">Add </strong>to manually add connection attributes.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u1b2826a7f04e44bea9e4e4d6c9b9d8a5"><li id="mrs_01_1102__en-us_topic_0000001173949302_l3a1a20c58d774df89260ee1087c87f34"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b112134541011">Name</strong>: connection attribute name</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l29f889a6ec2a4bc48a0ef3c929363c92"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b6381247181019">Value</strong>: connection attribute value</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rca397b54f02f421e9c365467de8cc4d4"><td class="cellrowborder" rowspan="4" valign="top" width="18.18%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a445328fbd819475a81a19384c9c684fe">mysql-fastpath-connector</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a722e135d9f6b486b916093bf1c3e93af">JDBC Connection String</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ab0a6e8bbec1b4665a07ce2ec247a4309">Specifies the JDBC connection string.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r10945e9be5ed4ae3b61b101e8c733926"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a79009a8d717848939fab3f7520899269">Username</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ad5238d5eb9864e1f897cc0b2d5a0ce61">Specifies the username for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r174e849a1fae4c6aa75bfb99547f3ce6"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a33ae37ee83c243b394f3f827c853967f">Password</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aa3124b53706649318c69d1066f0f950b">Specifies the password for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r6dc7bd0057bb433398b8f2bd9b208618"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p518436516351">Connection Properties</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a50e53deeab0041049336f3da4c97c051">Specifies connection attributes. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b7836210181110">Add </strong>to manually add connection attributes.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u2a87dcfe4a694bb588b4369690c2fc6a"><li id="mrs_01_1102__en-us_topic_0000001173949302_l46361cd0859849a7bcac88512ceb59b8"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b56041613131110">Name</strong>: connection attribute name</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l97172e875370403190b8a4dade3c11b8"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b16845415191114">Value</strong>: connection attribute value</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r7cae137092b4474680626296bdc3a970"><td class="cellrowborder" rowspan="5" valign="top" width="18.18%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a28ad48bdbe5c4d9ba9873fb6dd8f7105">sftp-connector</p>
<p id="mrs_01_1102__en-us_topic_0000001173949302_a21e80e7ac64e4cc18923879111b016db"></p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a61e522a67aa9473999fe96335ffc08b4">SFTP Server IP</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aacada1a760e4456ba26516d96777fc1b">Specifies the IP address of the SFTP server.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r1fd5224535f34f42a2c1297344ea03d8"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a931508cfebb845f1a562477a078ef3ba">SFTP Server Port</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a971357bde1bb4b0295835fc8636128d6">Specifies the port number of the SFTP server.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rc1db8ba89fa84a24883833a257f503ff"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aee03c329cbd24a8897755094c2ae2406">SFTP Username</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p217225716351">Specifies the username for accessing the SFTP server.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rf5624b75c60749e89208a063c3862a45"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a069a502598424a1981494aed15af2d26">SFTP Password</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a4e3eabaced414c1cb109e5386fd14f71">Specifies the password for accessing the SFTP server.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rc10b120006e14630b79b282d6ac7f47b"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a67309f6d1f2444acabf7e226969b276a">SFTP Public Key</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a28d099f94aea4e5183a9e10c4634945e">Specifies public key of the SFTP server.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r8f1e863989da486a9b7e53b1cf4c4ae4"><td class="cellrowborder" rowspan="5" valign="top" width="18.18%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a3e290c70b4c44e5f81a6a477e38bc2aa">oracle-partition-connector</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a8179908fe48147b187ecac7e05b57c26">JDBC Driver Class</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aa1717c49d3e44c8881575610ab29f642">Specifies the name of a Java database connectivity (JDBC) driver class.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r95ffc7f01cfc4e949be97324111ae8ff"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ae69dfc08dc01408aa447396f8f95f97d">JDBC Connection String</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a6c4329ff53c4444eaedd127682f0d8d3">Specifies the JDBC connection string.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r386bc96727804d2aae1427efc3fa0313"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a2990f58eb24a451fbf24c0bdbc172997">Username</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a4726916406e2415ead7d01ed236c5580">Specifies the username for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r34e0ef4bd97e4ff99e4123843b567a7c"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a272a34662cd948519a91a92c09eb1145">Password</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p287828116351">Specifies the password for connecting to the database.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r85d59100e8474b1fbf72b0469a33706c"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a742d0e0e46a74ba582cf613d0c667848">Connection Properties</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.2.1.2.5.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a80014e7ce01041229ae2b6150d3e8f1b">Specifies connection attributes. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b156132670092110">Add </strong>to manually add connection attributes.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u9ad620c740f841cd81a183c64c832499"><li id="mrs_01_1102__en-us_topic_0000001173949302_ld1844fbad9d448f295b96ea20059b348"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b5844781914">Name</strong>: connection attribute name</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l7948f8d6224e42919d8c745a00e31361"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b1479064831914">Value</strong>: connection attribute value</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l072d32e2916a477eb5ba493e94b346e1">Set <strong id="mrs_01_1102__en-us_topic_0000001173949302_b169061512196">Group </strong>to the group to which the job belongs. By default, there is no created group. Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b3907205115198">Add </strong>to create a group and click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b39071751201917">OK</strong>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l80e99b6d562a43c5984928fffe78c255"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b203988105692110">Queue </strong>indicates that Loader tasks are executed in a specified Yarn queue. The default value is <strong id="mrs_01_1102__en-us_topic_0000001173949302_b20956173619354">root.default</strong>, which indicates that the tasks are executed in the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b5956133619354">default</strong> queue.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l5101b14bc9c94826aed4c5202279ea57">Set <strong id="mrs_01_1102__en-us_topic_0000001173949302_b93509585092110">Priority </strong>to the priority of Loader tasks in the specified Yarn queue. The options can be <strong id="mrs_01_1102__en-us_topic_0000001173949302_b525611612208">VERY_LOW</strong>, <strong id="mrs_01_1102__en-us_topic_0000001173949302_b1479920174202">LOW</strong>, <strong id="mrs_01_1102__en-us_topic_0000001173949302_b315931992013">NORMAL</strong>, <strong id="mrs_01_1102__en-us_topic_0000001173949302_b10397152016205">HIGH</strong>, or <strong id="mrs_01_1102__en-us_topic_0000001173949302_b363152418202">VERY_HIGH</strong>. The default value is <strong id="mrs_01_1102__en-us_topic_0000001173949302_b185866459292110">NORMAL</strong>.</li></ol>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_la952b79f722e416e8b6e2d8d640600cc"><span>In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b102881854592110">2. Input Settings</strong> area, set the data source and click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b69975510092110">Next</strong>.</span><p><div class="note" id="mrs_01_1102__en-us_topic_0000001173949302_n6257601d42e741aab3edc1372eed59b0"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p class="text" id="mrs_01_1102__en-us_topic_0000001173949302_a32d4f41aef8b43de87bc861f37a1c392">When creating or editing a Loader job, you can use macro definitions when configuring parameters such as the SFTP path, HDFS/OBS path, and Where condition of SQL. For details, see <a href="mrs_01_1153.html">Using Macro Definitions in Configuration Items</a>.</p>
</div></div>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1102__en-us_topic_0000001173949302_t0aecfed1f63841f28432bb83c0c81768" frame="border" border="1" rules="all"><caption><b>Table 2 </b>List of input configuration parameters</caption><thead align="left"><tr id="mrs_01_1102__en-us_topic_0000001173949302_r5c496b39fe5d43fd843dc74742d9b27d"><th align="left" class="cellrowborder" valign="top" width="18.18%" id="mcps1.3.3.2.5.2.2.2.4.1.1"><p id="mrs_01_1102__en-us_topic_0000001173949302_a9cd74de6af56432ab09424a09b189003">Source File Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.220000000000002%" id="mcps1.3.3.2.5.2.2.2.4.1.2"><p id="mrs_01_1102__en-us_topic_0000001173949302_ab9d92e428ac34fa9a71c4797bc25ce78">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="59.599999999999994%" id="mcps1.3.3.2.5.2.2.2.4.1.3"><p id="mrs_01_1102__en-us_topic_0000001173949302_a17ffc066b7a04e2e921da159d8de8db0">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1102__en-us_topic_0000001173949302_ra8987bed36854dc49be3da1a68c8bf87"><td class="cellrowborder" rowspan="7" valign="top" width="18.18%" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a9dd9d1c8120f47c19883e5710e329d37">HDFS/OBS</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a7ce9b9603259411481fb73fbb00da1be">Input Directory</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.5.2.2.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a0f6e0e92af114d0496ab82d881d0b1be">Specifies the input path when data is exported from HDFS/OBS.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r5f1b709abb574f0882c77b6249ff8b72"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_afa965749801f48d5ba6f882aac6c954b">Path Filter</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a5ab2b88def834f69b79ffad4fa59a9b6">Specifies the wildcard for filtering the directories in the input paths of the source files. <strong id="mrs_01_1102__en-us_topic_0000001173949302_b161128714992110">Input Directory</strong> is not used in filtering. If there are multiple filter conditions, use commas (,) to separate them. If the value is empty, the directory is not filtered. The regular expression filtering is not supported.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r90de205a71994cf787b81ecb2aa0747b"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af16145c0b4134a299561f2a657e657e5">File Filter</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ac0a1e2996da544fe8a56c71a4bcf6411">Specifies the wildcard for filtering the file names of the source files. If there are multiple filter conditions, use commas (,) to separate them. The value cannot be left blank. The regular expression filtering is not supported.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r7abdc31965cc4597ac98328edcc98d91"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a991c655716bc41e086174c568fa4d459">File Type</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ac9f9d8b1159640b7ba07165068c2b6a4">Specifies the file import type.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u477067da51ca4a6bb6b4199c17ea52c0"><li id="mrs_01_1102__en-us_topic_0000001173949302_l9b40bfae3b0b437da8fcbcc8d344fa6d"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b18617936142714">TEXT_FILE</strong>: imports a text file and stores it as a text file.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_ld7e3901ba4b0409a9aba806d3116585f"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b19907155219292">SEQUENCE_FILE</strong>: imports a text file and stores it as a sequence file.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l3e2bbd37471b4fafbd78600d655f10bf"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b866014592295">BINARY_FILE</strong>: imports files of any format by using binary streams.</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r5056e4367daa4c2d8720a4b513160acd"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a1a75acd8706c48fdb0774ae8f89e1ac8">File Split Type</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ad64cf0ed03754f0a91dcea55deb5fd43">Specifies whether to split source files by file name or size. The files obtained after the splitting are used as the input files of each map in the MapReduce task for data export.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r142d8ff519f247c497768de7825e38c7"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aaefb530e45a84f60a16b6db480405905">Extractors</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a98c0ebc1ad7c455eb66dab5e89334316">Specifies the number of maps that are started at the same time in a MapReduce job of a data configuration operation. This parameter cannot be set when <strong id="mrs_01_1102__en-us_topic_0000001173949302_b16204105483019">Extractor Size</strong> is set. The value must be less than or equal to 3000.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_raed2477a35c54b8794e7e94567b8e6df"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ae4e47c65c16a434197d69afad38b786b">Extractor size</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a02cd62f58dc3409d870d6583998c669e">Specifies the size of data processed by maps that are started in a MapReduce job of a data configuration operation. The unit is MB. The value must be greater than or equal to 100. The recommended value is <strong id="mrs_01_1102__en-us_topic_0000001173949302_b854719246332">1000</strong>. This parameter cannot be set when <strong id="mrs_01_1102__en-us_topic_0000001173949302_b93427223492110">Extractors </strong>is set. When a relational database connector is used, <strong id="mrs_01_1102__en-us_topic_0000001173949302_b1275816577317">Extractor size</strong> is unavailable. You need to set <strong id="mrs_01_1102__en-us_topic_0000001173949302_b176355714314">Extractors</strong>.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r3c8d46a79218461ab4a8a00b4b3c4127"><td class="cellrowborder" rowspan="2" valign="top" width="18.18%" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a6f9869a8b1c54df0b2911467a64f534c">HBASE</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a34a97f6dcb234737805a9edb445563dd">HBase Instance</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.5.2.2.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a8354e748973a442982bb8a1b7e0b7ac5">Specifies the HBase service instance that Loader selects from all available HBase service instances in the cluster. If the selected HBase service instance is not added to the cluster, the HBase job cannot be run properly.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rcdf330a8c70e47999ab212a72b943730"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a74c5ac3d9ab94469a3aee6d99f8cb6cb">Quantity</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a2bfccc2765a34f0cb121f5b918e837e2">Specifies the number of maps that are started at the same time in a MapReduce job of a data configuration operation. The value must be less than or equal to 3000.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rd3427a8ea2474a03a2dae628c497ab46"><td class="cellrowborder" rowspan="2" valign="top" width="18.18%" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a487077cc721d48cc8f61c80a27f8f96b">HIVE</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p830118163645">Hive instance</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.5.2.2.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p130766163645">Specifies the Hive service instance that Loader selects from all available Hive service instances in the cluster. If the selected Hive service instance is not added to the cluster, the Hive job cannot run properly.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rb3b6b41bc5a241bba340a1a497197b2c"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af167265de59243cb9988c6c43fb37eb7">Quantity</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_abd8313f29e284429af12d086ba9c4b34">Specifies the number of maps that are started at the same time in a MapReduce job of a data configuration operation. The value must be less than or equal to 3000.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_row65507524144058"><td class="cellrowborder" rowspan="2" valign="top" width="18.18%" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p44239073144057">SPARK</p>
</td>
<td class="cellrowborder" valign="top" width="22.220000000000002%" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p26595156144057">Spark instance</p>
</td>
<td class="cellrowborder" valign="top" width="59.599999999999994%" headers="mcps1.3.3.2.5.2.2.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p6724036144057">Only SparkSQL can access Hive data. Specifies the SparkSQL service instance that Loader selects from all available SparkSQL service instances in the cluster. If the selected Spark service instance is not added to the cluster, the Spark job cannot be run properly.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_row22191694144058"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p2875355144057">Quantity</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.2.2.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_p31577217144057">Specifies the number of maps that are started at the same time in a MapReduce job of a data configuration operation. The value must be less than or equal to 3000.</p>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_ld22c39ddb54343b1afd9b1e5fe326f57"><span>In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b54263716392110">3. Convert </strong>area, set the conversion operations during data transmission.</span><p><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p91675496114">Check whether source data values in the data operation job created by the Loader can be directly used without conversion, including upper and lower case conversion, cutting, merging, and separation.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_uda20d58b3ec34454b431bf60e6208378"><li id="mrs_01_1102__en-us_topic_0000001173949302_lbbb40bc7111e43699e1798b1d7a03c65">If yes, click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b122055689492110">Next</strong>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lf22da1e1ffcf43dcb02635f364a68c20">If no, perform <a href="#mrs_01_1102__en-us_topic_0000001173949302_l8b00d9031c7b4b2f9ec209174cf49a4a">6.a</a> to <a href="#mrs_01_1102__en-us_topic_0000001173949302_l97f2108928f742be9efcb6c5cad6f50a">6.d</a>.</li></ul>
<ol type="a" id="mrs_01_1102__en-us_topic_0000001173949302_o8f7c613634814b2abbfd135fb77e0420"><li id="mrs_01_1102__en-us_topic_0000001173949302_l8b00d9031c7b4b2f9ec209174cf49a4a"><a name="mrs_01_1102__en-us_topic_0000001173949302_l8b00d9031c7b4b2f9ec209174cf49a4a"></a><a name="en-us_topic_0000001173949302_l8b00d9031c7b4b2f9ec209174cf49a4a"></a>No created conversion step exists by default. Drag an example conversion step on the left to the edit box to create a new conversion step.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l27cbaafa60b841f39eb5e499a9ed4504">Conversion step types must be selected based on service requirements. A complete conversion process includes the following types:<ol class="substepthirdol" id="mrs_01_1102__en-us_topic_0000001173949302_od4d9e625af6546b1bd5a53db2fa22978"><li id="mrs_01_1102__en-us_topic_0000001173949302_l339db177b1584200bfac7ae2737f2b8f">Input type. Only one conversion step can be added. This parameter is mandatory if the task involves HBase or relational databases.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lb3e3580009194017a49731a2bac3ccf8">Conversion type, which is an intermediate conversion step. You can add one or more conversion types or do not add any conversion type.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lb1f981202ca34a12a369897c146535fe">Output type. Only one output type can be added in the last conversion step. This parameter is mandatory if the task involves HBase or relational databases.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1102__en-us_topic_0000001173949302_tde4b9d8493414fa8889aa71273e8e74f" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Example list</caption><thead align="left"><tr id="mrs_01_1102__en-us_topic_0000001173949302_rd8753300433c49819531072f30d0f2ed"><th align="left" class="cellrowborder" valign="top" width="27%" id="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.1"><p id="mrs_01_1102__en-us_topic_0000001173949302_a6f372566a6d54b86872397545ca56389">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="73%" id="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.2"><p id="mrs_01_1102__en-us_topic_0000001173949302_a354df1fc23884ded89cdab0318759d4e">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1102__en-us_topic_0000001173949302_r960328898ccb42059615b2d2fc6d38ab"><td class="cellrowborder" valign="top" width="27%" headers="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p81671497116">Input Type</p>
</td>
<td class="cellrowborder" valign="top" width="73%" headers="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.2 "><ul id="mrs_01_1102__en-us_topic_0000001173949302_u56a6d154e5234e7c9e7ab9a6ce2de633"><li id="mrs_01_1102__en-us_topic_0000001173949302_l65817c6725824c05bbaeeab7b84643d2"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b181621307492110">CSV File Input</strong>: CSV file input step for configuring separators to generate multiple fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l1f719bdb54304ccd89d3a8707b4761bd"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b126032349692110">Fixed-Width File Input</strong>: Text file input step for configuring the length of characters or bytes to be truncated to generate multiple fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lf0395c7fecc7499fa71d33097779225b"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b70258088392110">Table Input</strong>: relational data input step for configuring specified columns in the database as input fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l155db69f11ca4eb78e3ddb06624415e2"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b41511743792110">HBase Input</strong>: HBase table input step for configuring the column definition of an HBase table to a specified field.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l0327e844aa4141359ef413f1d0187a40"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b100333609292110">HTML Input</strong>: HTML web page data input step for obtaining the target data of the HTML web page file to the specified field.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l6b69883c9a2747cd80cdb7184f3aedb2"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b51631936492110">Hive Input</strong>: Hive table input step for defining columns in a Hive table to specified fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_li59681020145237"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b199230160192110">Spark Input</strong>: Spark SQL table input step for defining columns in the SparkSQL table to specified fields. Only Hive data can be stored and accessed.</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rc9535d69def74c068112eddac5349f29"><td class="cellrowborder" valign="top" width="27%" headers="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a63f53f0e84f446299a5667161aa8467b">Conversion type</p>
</td>
<td class="cellrowborder" valign="top" width="73%" headers="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.2 "><ul id="mrs_01_1102__en-us_topic_0000001173949302_uf543f7a8728c4d0fad35aee23a3b2443"><li id="mrs_01_1102__en-us_topic_0000001173949302_le9344d008932476391e68aa93494930b"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b160591383192110">Long Integer Time Conversion</strong>: Configure the conversion between a long integer value and a date.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l33448e41d7c64b02991dc9bd5237ded4"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b18489389292110">Null Value Conversion</strong>: Configure a specified value to replace the null value.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l72aee78cb65045e1b6652571a2a87efd"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b139487736592110">Random Value Conversion</strong>: Configure new value-added fields as random data fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l53ed26c9b8394e07ba3e0741526d7635"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b77489415092110">Adding a Constant Field</strong>: Add a constant to directly generate a constant field.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l660cd48b7d694d679c9e772edf6d0f2e"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b213193340792110">Concatenation and Conversion</strong>: Concatenate fields, connect generated fields using connection characters, and convert new fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l416643e5c3bb4dc0b5966509e98ead11"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b7131577092110">Separator Conversion</strong>: Configure the generated fields to be separated by separators and convert new fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li61671491110"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b16832479392110">Modulo Conversion</strong>: Configure the generated fields to be converted into new fields through modulo operation.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lfef37bbf07af432792024144fa12e455"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b169320922792110">Cutting Character String</strong>: Truncate a generated field based on a specified position to generate a new field.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li41674494114"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b197695836492110">EL Operation Conversion</strong>: Calculate field values. Currently, the following operators are supported: md5sum, sha1sum, sha256sum, and sha512sum.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l68e2d71813324fb68dde4dc3ba1c7db2"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b208784055392110">Character String Case Conversion:</strong> Configure the generated fields to be converted to new fields through case conversion.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l5bff19a73f5c4e13aa69f63a4ed67a8a"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b188703628192110">Reverse String Conversion</strong>: Reverse the generated fields to generate new fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_lab12de34fe8d4951813caf6d719cff82"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b190125646692110">Character String Space Clearing Conversion</strong>: Configure the generated fields to clear spaces and convert them to new fields.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l96b263b5ff1646239940d4c806541864"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b151533228092110">Row Filtering Conversion</strong>: Configure logical conditions to filter out rows that contain triggering conditions.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l6d9fa4d0166b471b843e6574f58dd6a3"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b17435125417532">Update Fields</strong>: Update the value of a specified field when certain conditions are met.</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rbe1cffa748264d5bb98181ad98b96d42"><td class="cellrowborder" valign="top" width="27%" headers="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a49b943d837b9485080edbfb4d7cddfdc">Output type</p>
</td>
<td class="cellrowborder" valign="top" width="73%" headers="mcps1.3.3.2.6.2.3.2.1.3.1.2.3.1.2 "><ul id="mrs_01_1102__en-us_topic_0000001173949302_ud91912b605284b0cae91d030b1dc1f16"><li id="mrs_01_1102__en-us_topic_0000001173949302_le9528bf43496496fae9d9cbf09b78d0c"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b207965907392110">File Output</strong>: Configure generated fields to be connected by separators and exported to a file.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_ld03d46e602fe49399617ddaf9cec5974"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b103514372292110">Table Output</strong>: Configure the mapping between output fields and specified columns in the database.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l7d78fe9fa8eb49dcbbb03f4f25e64abc"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b98882395092110">HBase Output</strong>: Configure the generated fields to the columns of the HBase table.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_ldc8190d70cf74f50b0e83ffb1ee1d7e7"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b14728315192110">Hive Output</strong>: Configure generated fields to a column of a Hive table.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_li52766053145340"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b189526071492110">Spark Output</strong>: Configure generated fields to the columns of SparkSQL tables. Only SparkSQL can access Hive data.</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
<p id="mrs_01_1102__en-us_topic_0000001173949302_a480f0cf71a814388bc74a50f2b7bb8fd">The edit box allows you to perform the following tasks:</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u26313c2994644eb08bb0e2d7aaea1e72"><li id="mrs_01_1102__en-us_topic_0000001173949302_lf30aa89cc63c4b51a78476afe2166878">Re-command: Rename an example.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l8ba89fc0f90f4a7d803f3c0d90a631f6">Edit: Edit the step conversion by referring to <a href="#mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li1726113143">6.c</a>.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l2fa391de395b43129d91a41271dc942e">Delete: Delete an example.<div class="note" id="mrs_01_1102__en-us_topic_0000001173949302_note8692107341"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1102__en-us_topic_0000001173949302_p18693778419">You can also use the shortcut key Del to delete the file.</p>
</div></div>
</li></ul>
</li></ol>
</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li1726113143"><a name="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li1726113143"></a><a name="en-us_topic_0000001173949302_en-us_topic_0038499356_li1726113143"></a>Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b1643216392110">Edit </strong>to edit the step conversion information and configure fields and data.<p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p33196175151">For details about how to set parameters in the step conversion information, see <a href="mrs_01_1119.html">Operator Help</a>.</p>
<p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p19201729185">If the conversion step is incorrectly configured, the source data cannot be converted and become dirty data. The dirty data marking rules are as follows:</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_ul8203291818"><li id="mrs_01_1102__en-us_topic_0000001173949302_l8cfc1db186c24725bb51090de2f610d1">In any input type step, the number of fields contained in the original data is less than the number of configured fields or the field values in the original data do not match the configured field type.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li3201320189">In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b36962977692110">CSV File Input</strong> step, <strong id="mrs_01_1102__en-us_topic_0000001173949302_b25145354392110">Validate input field</strong> checks whether the input field matches the value type. If the input field and value type of a line do not match, the line is skipped and becomes dirty data.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li12201326181">In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b208869389692110">Fixed Width File Input</strong> step, <strong id="mrs_01_1102__en-us_topic_0000001173949302_b82813467792110">Fixed Length</strong> specifies the field splitting length. If the length is greater than the length of the original field value, data splitting fails and the current line becomes dirty data.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_la72c24df0cb14ba58168bca9dd0665de">In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b187687834992110">HBase Input</strong> step, if the HBase table name specified by <strong id="mrs_01_1102__en-us_topic_0000001173949302_b7270146592110">HBase Table Name </strong>is incorrect, or no primary key column is configured for Primary Key, all data becomes dirty data.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li820428186">In any conversion step, lines whose conversion fails becomes dirty data. For example, in the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b14376239992110">Split Conversion</strong> step, the number of generated fields is less than the number of configured fields, or the original data cannot be converted to the String type, and the current row becomes dirty data.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li17204211817">In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b131373543592110">Filter Row Conversion</strong> step, rows filtered by filter criteria become dirty data.</li><li id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_li98534114184">In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b163443996092110">Modulo Conversion</strong> step, if the original field value is NULL, the current row becomes dirty data.</li></ul>
</li><li id="mrs_01_1102__en-us_topic_0000001173949302_l97f2108928f742be9efcb6c5cad6f50a"><a name="mrs_01_1102__en-us_topic_0000001173949302_l97f2108928f742be9efcb6c5cad6f50a"></a><a name="en-us_topic_0000001173949302_l97f2108928f742be9efcb6c5cad6f50a"></a>Click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b88585352992110">Next</strong>.</li></ol>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_lb0fa778a9494435a8dc22a87c53e48b6"><span>In the <strong id="mrs_01_1102__en-us_topic_0000001173949302_b25079547392110">4. Output Settings</strong> area, set the destination location for saving data and click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b135678393392110">Save </strong>to save the job or click <strong id="mrs_01_1102__en-us_topic_0000001173949302_b24820874792110">Save and Run</strong> to save and run the job.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1102__en-us_topic_0000001173949302_ta59997e35acc4b599e3d6e9e7bc85111" frame="border" border="1" rules="all"><caption><b>Table 4 </b>List of Output Configuration Parameters</caption><thead align="left"><tr id="mrs_01_1102__en-us_topic_0000001173949302_r94bd074b96474fcab7d551df06b9f110"><th align="left" class="cellrowborder" valign="top" width="22.45%" id="mcps1.3.3.2.7.2.1.2.4.1.1"><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p813469518456">Data Connection Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.43%" id="mcps1.3.3.2.7.2.1.2.4.1.2"><p id="mrs_01_1102__en-us_topic_0000001173949302_a456c1cd73add476c9d172c129a5eb7df">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="56.120000000000005%" id="mcps1.3.3.2.7.2.1.2.4.1.3"><p id="mrs_01_1102__en-us_topic_0000001173949302_a0538a298b537473fb8d418f006598ecf">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1102__en-us_topic_0000001173949302_r69c925bb70f64fab960c8bdee460db33"><td class="cellrowborder" rowspan="4" valign="top" width="22.45%" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_acf74c50a3a5944d7a8f7909d2014f416">sftp-connector</p>
</td>
<td class="cellrowborder" valign="top" width="21.43%" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p652054118456">Output Path</p>
</td>
<td class="cellrowborder" valign="top" width="56.120000000000005%" headers="mcps1.3.3.2.7.2.1.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a539fbab443b74a559bc17345a81dc197">Path or name of the export file on an SFTP server. If multiple SFTP server IP addresses are configured for the connector, you can set this parameter to multiple paths or file names separated with semicolons (;). Ensure that the number of input paths or file names is the same as the number of SFTP servers configured for the connector.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r7a1ca7cb8e4541c99715e293ba043e39"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a8b4329e6dfe64823869492ca71c37cd5">Operation</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ac4d2ec3648f34807917f28cd008b2533">Specifies the action during data import. When all data is to be imported from the input path to the destination path, the data is stored in a temporary directory and then copied from the temporary directory to the destination path. After the data is imported successfully, the data is deleted from the temporary directory. One of the following actions can be taken when duplicate file names exist during data transfer:</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u5f94dded9a3b4405b7fa13e01e999882"><li id="mrs_01_1102__en-us_topic_0000001173949302_lc51816c666154fd68bfab76c3fe7c6f0"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b190854546792110">OVERRIDE</strong>: overrides the old file.</li></ul>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u396ed49ced46488aa6b40cae1b47ee6b"><li id="mrs_01_1102__en-us_topic_0000001173949302_lf71e2d1044f14372a13666c8e569becb"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b80297195392110">RENAME</strong>: renames as new file. For a file without an extension, a string is added to the file name as the extension; for a file with an extension, a string is added to the extension. The string is unique.</li></ul>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_ud8042a4949b94e119711b15bb3a5e616"><li id="mrs_01_1102__en-us_topic_0000001173949302_l4835475f960643a7b92908f4edd5e089"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b8147970692110">APPEND</strong>: adds the content of the new file to the end of the old file. This action only adds content regardless of whether the file can be used. For example, a text file can be used after this operation, while a compressed file cannot.</li></ul>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u26d9b5490dab4718bfda30a071e86cd9"><li id="mrs_01_1102__en-us_topic_0000001173949302_lc7204a76f3e34ad4b8cbc3bd3c291997"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b80615777992110">IGNORE</strong>: reserves the old file and does not copy the new file.</li></ul>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u5b4dda407e76413195c514124ac8577f"><li id="mrs_01_1102__en-us_topic_0000001173949302_lc4b292c7c5a64401acc1cd5d41b1a09e"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b146569969792110">ERROR</strong>: stops the task and reports an error if duplicate file names exist. Transferred files are imported successfully, while files that have duplicate names and files that are not transferred fail to be imported.</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r1ca3710302b1420198937dc1113afb74"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a379197af9e044960b294de8ef207d0d2">Encode type</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p416725318456">Specifies the exported file encoding format, for example, UTF-8. This parameter can be set only in text file export.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r01984e28b1244b9da70c88c1914f489b"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a199f6e7213ff41a1ab27afe8f807608f">Compression</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ae11b3e03562f4ad9a1af734b67376cfc">Indicates whether to enable the compressed transmission function when SFTP is used to export data. <strong id="mrs_01_1102__en-us_topic_0000001173949302_b80969762292110">true </strong>indicates that compression is enabled, and <strong id="mrs_01_1102__en-us_topic_0000001173949302_b49285192992110">false </strong>indicates that compression is disabled.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r1a38e43e85a24ab7988b3a37b2ac917f"><td class="cellrowborder" rowspan="4" valign="top" width="22.45%" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a320e73ed224f498d8354ae3a632e123b">hdfs-connector</p>
</td>
<td class="cellrowborder" valign="top" width="21.43%" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a9dc51a7a13364147b54b8a43ac56ebfa">Output Path</p>
</td>
<td class="cellrowborder" valign="top" width="56.120000000000005%" headers="mcps1.3.3.2.7.2.1.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ab76ec570ffed430aafc2f1b45a4e830c">Specifies the output directory or file name of the export file in the HDFS/OBS.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rce803adc4ed345ebab965ad918a340af"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a75f304b7447a47589784f0f75af9f6fd">File Format</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af4411c7822ba47f9adc46715bad5ded5">Specifies the file export type.</p>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_uc5bcc0cb71dc4716bddcd624d773de45"><li id="mrs_01_1102__en-us_topic_0000001173949302_l7623507278184b79bb0a40a303b3a11d"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b723265220464">TEXT_FILE</strong>: imports a text file and stores it as a text file.</li></ul>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u33edbd3f92c944e6ab059b23ba38b442"><li id="mrs_01_1102__en-us_topic_0000001173949302_la017e480e8154323bfa10f7a64e871a5"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b17201259134610">SEQUENCE_FILE</strong>: imports a text file and stores it as a sequence file.</li></ul>
<ul id="mrs_01_1102__en-us_topic_0000001173949302_u29ff31ab36a64f3ea70aa3ec53663b53"><li id="mrs_01_1102__en-us_topic_0000001173949302_l4c8a431e55e44c42aa10c948c0ccff7b"><strong id="mrs_01_1102__en-us_topic_0000001173949302_b1848116618470">BINARY_FILE</strong>: imports files of any format by using binary streams.</li></ul>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r34609504de8049389103e90961cb98bd"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p843707118456">Compression codec</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a9496ca2ed3c94d399d71754a68b027e8">Specifies the compression format of files exported to HDFS/OBS. Select a format from the drop-down list. If you select <strong id="mrs_01_1102__en-us_topic_0000001173949302_b138324525214">NONE </strong>or do not set this parameter, data is not compressed.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r51bf69b772ff4906847247a335a22384"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a4faca6e90b1240109e24cd391e057240">User-defined compression format</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a5c347893b41541efa75f36ca68f6bdab">Name of a user-defined compression format type.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rfa3877330747436c8ca77c6fb43e4adc"><td class="cellrowborder" rowspan="3" valign="top" width="22.45%" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a2b20fdee91084e28a5bb3aca071039c7">generic-jdbc-connector</p>
</td>
<td class="cellrowborder" valign="top" width="21.43%" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a252b604a3b034cea983f21af8555207f">Schema name</p>
</td>
<td class="cellrowborder" valign="top" width="56.120000000000005%" headers="mcps1.3.3.2.7.2.1.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a96579411ad7040bfa73bffc965d6ab43">Specifies the database schema name.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r4a26174c7e8749b198182f10bc1b33f2"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a901c736b6a3c4d5aad5636cb9ae0e0d1">Table name</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a0f099acd475d450690655795fcca1272">Specifies the name of a database table that is used to save the final data of the transmission.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r6bf1291df9cc45bc9465a2ce3153d0d3"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a717dd2cf471a4696ac5fd68a81c289c1">Temporary table</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aa6d86aaddfe64bab900069ca8c4fb1f0">Specifies the name of a temporary database table that is used to save temporary data during the transmission. The fields in the table must be the same as those in the database specified by <strong id="mrs_01_1102__en-us_topic_0000001173949302_b157940509592110">Table name</strong>.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r93f0337556b5488c895ea44c3bc59110"><td class="cellrowborder" rowspan="3" valign="top" width="22.45%" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a1f776430532b4536bacbe1d1eb4c1465">oracle-partition-connector</p>
</td>
<td class="cellrowborder" valign="top" width="21.43%" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a998ae3cc1b764f08b2b98645e250a35c">Schema Name</p>
</td>
<td class="cellrowborder" valign="top" width="56.120000000000005%" headers="mcps1.3.3.2.7.2.1.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a0893ce25f65e4ff0af2fb4b93d4f9760">Specifies the database schema name.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r39b5087959af469594ddbea21831c6ee"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_en-us_topic_0038499356_p701434918456">Table Name</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_afef17cfc7a034f638c10eb15e2b0c7fb">Specifies the name of a database table that is used to save the final data of the transmission.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r1f09e22ed62a479e92a7c1d2506b0d60"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af5784498db2b4b3c87e84dbbac6de69d">Temporary Table</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_aa5f41c03cfa24671b969760348de73ec">Specifies the name of a temporary database table that is used to save temporary data during the transmission. The fields in the table must be the same as those in the database specified by <strong id="mrs_01_1102__en-us_topic_0000001173949302_b171335383592110">Table name</strong>.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r5d32cdb6078e4671b4cd590deff40611"><td class="cellrowborder" rowspan="2" valign="top" width="22.45%" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ac33f735c9da140b1b984908689224a37">oracle-connector</p>
</td>
<td class="cellrowborder" valign="top" width="21.43%" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a7e67b9560fc14bc0b1a72b2091e5b2f6">Table Name</p>
</td>
<td class="cellrowborder" valign="top" width="56.120000000000005%" headers="mcps1.3.3.2.7.2.1.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a07b0f1a0221740ac8dcb90c9a7fba75d">Destination table name to store data.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r85202c0123974a2fa08399c361b30526"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_af883e9e09eb04770a3a3870500856968">Column Name</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a3d2aa6cf26fe40139b937268035ad9cd">Specifies the name of the column to be written. Columns that are not specified can be set to null or the default value.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r163d111c6d5c463399e134fe3f72861d"><td class="cellrowborder" rowspan="3" valign="top" width="22.45%" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ad64f52ebc440446892d08ab38c3c3802">mysql-fastpath-connector</p>
</td>
<td class="cellrowborder" valign="top" width="21.43%" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a963dc98a0a674406bc146e2d2e31c5c9">Schema Name</p>
</td>
<td class="cellrowborder" valign="top" width="56.120000000000005%" headers="mcps1.3.3.2.7.2.1.2.4.1.3 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a4088ca6f10124fc9a19ba2c789235a2d">Specifies the database schema name.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_rc4313f4644fe48f2a08c18ce48eacb65"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ab9156302681546bda8884b42fce4797c">Table Name</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a5479b32494e44a18a6e49ad092b50b57">Specifies the name of a database table that is used to save the final data of the transmission.</p>
</td>
</tr>
<tr id="mrs_01_1102__en-us_topic_0000001173949302_r25bf544dc99b47829de12e2f487a912b"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.1 "><p id="mrs_01_1102__en-us_topic_0000001173949302_ae4597b5bc8424519b071aee958befe9b">Temporary Table Name</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.7.2.1.2.4.1.2 "><p id="mrs_01_1102__en-us_topic_0000001173949302_a9c2de2c3bcac48bc8bc480e43165c9bc">Name of the temporary table, which is used to store data. After the job is successfully executed, data is transferred to the formal table.</p>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="mrs_01_1102__en-us_topic_0000001173949302_l33ff164cb9bc43938c70b59ff5b3f34f"><span>On the Loader WebUI page, you can view, start, stop, copy, delete, edit, and view historical information about created jobs.</span><p><div class="fignone" id="mrs_01_1102__en-us_topic_0000001173630728_f6c7d800e4d2a45da9f9672d8d2b33ad1"><span class="figcap"><b>Figure 2 </b>Viewing job</span><br><span><img id="mrs_01_1102__en-us_topic_0000001173630728_ia5e94abc31a3428aaaca819fd1f345ba" src="en-us_image_0000001389147810.png"></span></div>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1100.html">Exporting Data</a></div>
</div>
</div>
View Git Blame Copy Permalink