vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide-lts/mrs_01_1103.html
Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

225 lines
42 KiB
HTML
Raw Blame History

<a name="mrs_01_1103"></a><a name="mrs_01_1103"></a>
<h1 class="topictitle1">Typical Scenario: Exporting Data from HDFS/OBS to an SFTP Server</h1>
<div id="body8662426"><div class="section" id="mrs_01_1103__en-us_topic_0000001173471480_s227b48fe26ce41d79c79c2a0e275c6ef"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1103__en-us_topic_0000001173471480_a897006e5b8534fb79be9d36b06862be2">This section describes how to use Loader to export data from HDFS/OBS to an SFTP server.</p>
</div>
<div class="section" id="mrs_01_1103__en-us_topic_0000001173471480_sfb9474fe4e75473d879d084a6ad7d3a1"><h4 class="sectiontitle">Prerequisites</h4><ul id="mrs_01_1103__en-us_topic_0000001173471480_ue459086da2094a94ac2302f1027eae2f"><li id="mrs_01_1103__en-us_topic_0000001173471480_lf8d600aff2764b8fb364ba3cf8fbc999">You have obtained the service username and password for creating a Loader job.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_lc17e57c151ca4b31acf0a3d90fc5750a">You have had the permission to access the HDFS or OBS directories and data involved in job execution.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_la6f908d33de0416092096f04fffbf05e">You have obtained the username and password of the SFTP server and the user has the write permission of the data export directory on the SFTP server.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_la79f7c06143940e0a238b54c8c92c906">No disk space alarm is reported, and the available disk space is sufficient for importing and exporting data.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_la1e2cddac51442aaaebace7d32b2f937">When using Loader to export data from HDFS/OBS, the input paths and input path subdirectories of HDFS/OBS data source and the name of the files in these directories do not contain any of the following special characters: <strong id="mrs_01_1103__en-us_topic_0000001173471480_b1850612524015">/\"':;,</strong>.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l5a16aef0e09b4af5a5548df1cc80403a">If a configured task requires the Yarn queue function, the user must be authorized with related Yarn queue permission.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_ld288ee484da642018265e397696f6b1b">The user who configures a task must obtain execution permission on the task and obtain usage permission on the related connection of the task.</li></ul>
</div>
<div class="section" id="mrs_01_1103__en-us_topic_0000001173471480_s1b2883c699384ab4986a56f574e5a56b"><h4 class="sectiontitle">Procedure</h4><p class="tableheading" id="mrs_01_1103__en-us_topic_0000001173471480_a2bff5f5147ae4bdd8598352c483e0684"><strong id="mrs_01_1103__en-us_topic_0000001173471480_a04e7211dc55c4bb291d936202c5f80d0">Setting Basic Job Information</strong></p>
<ol id="mrs_01_1103__en-us_topic_0000001173471480_o753f9efd0e234f989d123596c305ed64"><li id="mrs_01_1103__en-us_topic_0000001173471480_l53b499a3d04a4bf7b22d60d4d101a86f"><span>Access the Loader web UI.</span><p><ol type="a" id="mrs_01_1103__en-us_topic_0000001219230551_obbc8c37dc53040efb21dc541b1dfc22c"><li id="mrs_01_1103__en-us_topic_0000001219230551_l6f0ffda40ca543d5a5660461b5e311dd">Log in to FusionInsight Manager. For details, see <a href="mrs_01_2124.html">Accessing FusionInsight Manager</a>.</li><li id="mrs_01_1103__en-us_topic_0000001219230551_la11b479a24ad4659a55365c2ede06015">Choose <strong id="mrs_01_1103__en-us_topic_0000001219230551_b39357591297">Cluster</strong> &gt; <em id="mrs_01_1103__en-us_topic_0000001219230551_i18941259112918">Name of the desired cluster</em> &gt; <strong id="mrs_01_1103__en-us_topic_0000001219230551_b19941115916297">Services</strong> &gt; <strong id="mrs_01_1103__en-us_topic_0000001219230551_b1894175916294">Loader</strong>.</li><li id="mrs_01_1103__en-us_topic_0000001219230551_l6601e8a2fd1b4780bf69238d6f5cc7f2">Click <strong id="mrs_01_1103__en-us_topic_0000001219230551_b13499742135213">LoaderServer(</strong><em id="mrs_01_1103__en-us_topic_0000001219230551_i187499244301">Node name</em><strong id="mrs_01_1103__en-us_topic_0000001219230551_b18777163515522">, Active)</strong>. The Loader web UI is displayed.<div class="fignone" id="mrs_01_1103__fig10607922203218"><span class="figcap"><b>Figure 1 </b>Loader web UI</span><br><span><img id="mrs_01_1103__mrs_01_1089_image155554364292" src="en-us_image_0000001438241209.png"></span></div>
</li></ol>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_le8d50848f99849579d14f9d65a172880"><span>Click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_u579669eb2ab14b019c81718a352b5153"><b>New Job</b></span> to go to the <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_p09283314036e46ab920cca2670a864d1"><b>Basic Information</b></span> page and set basic job information.</span><p><div class="fignone" id="mrs_01_1103__en-us_topic_0000001173471480_f12cb1e4a4fe548fcb2bba40ed142afa9"><span class="figcap"><b>Figure 2 </b>Basic Information</span><br><span><img id="mrs_01_1103__en-us_topic_0000001173471480_ia4dcada08b69487c9790f60273971a7d" src="en-us_image_0000001349059949.png"></span></div>
<ol class="subitemlist" type="a" id="mrs_01_1103__en-us_topic_0000001173471480_o733dbe17b7334fb38ae08eb008d6ad81"><li id="mrs_01_1103__en-us_topic_0000001173471480_lfc7f006b78ff4a9db39d32784b53d962">Set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_pd93222ea8bc34f6f9c0a7f813e747632"><b>Name</b></span> to the name of the job.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l625ba443454345f292e9f0c22dcfb10e">Set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_pb940d33201b647c18f457d6e4ab91720"><b>Type</b></span> to <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pf4b09284b2d14f84a448d04b0fa999e8"><b>Export</b></span>.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_lbb2fbf291e224d8399f9bcbc3fb16b0e">Set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname147179944491628"><b>Group</b></span> to the group to which the job belongs. No group is created by default. You need to click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol75982022991628"><b>Add</b></span> to create a group and click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol75101768991628"><b>OK</b></span> to save the created group.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l64a1ee870d7b4f96ba240be8f8a936fe">Set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_pe8e724107d1d429a8f86ba9c9952459f"><b>Queue</b></span> to the Yarn queue that executes the job. The default value is <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue126681149193814"><b>root.default</b></span>.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l7ebf364210ff42608b69672434756c7b">Set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_p02ee4bb9036b412c893b737feab650d9"><b>Priority</b></span> to the priority of the Yarn queue that executes the job. The default value is <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pb54832cbc99c47cdbd171128616b4010"><b>NORMAL</b></span>. The options are <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue96079032791628"><b>VERY_LOW</b></span>, <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue134822370091628"><b>LOW</b></span>, <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue47191557691628"><b>NORMAL</b></span>, <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue115276165491628"><b>HIGH</b></span>, and <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue157829051291628"><b>VERY_HIGH</b></span>.</li></ol>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_lc4e13c8b69324b7a829af9add740890a"><span>In the <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname83298326791628"><b>Connection</b></span> area, click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol144793807991628"><b>Add</b></span> to create a connection, set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname19351876991628"><b>Connector</b></span> to <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue79243539491628"><b>sftp-connector</b></span>, click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol73989902291628"><b>Add</b></span>, set connection parameters, and click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol34686928291628"><b>Test</b></span> to verify whether the connection is available. When "<span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue149401736291628"><b>Test Success</b></span>" is displayed, click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol70585785191628"><b>OK</b></span>. Loader allows multiple SFTP servers to be configured. Click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uc36d7eddb2754455bf4e04b09b47377e"><b>Add</b></span> to add the configuration information of multiple SFTP servers.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1103__en-us_topic_0000001173471480_tcc949ffd19f34f1ba9c38b596febd380" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Connection parameters</caption><thead align="left"><tr id="mrs_01_1103__en-us_topic_0000001173471480_rfd42135adb7d46e7938136267b1122d2"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.3.3.2.1.2.4.1.1"><p id="mrs_01_1103__en-us_topic_0000001173471480_a380acc55447541e0a97d7a647def177d">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="53.010000000000005%" id="mcps1.3.3.3.3.2.1.2.4.1.2"><p id="mrs_01_1103__en-us_topic_0000001173471480_aa5c6ebcb87064934bf0a47a4e163a403">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.990000000000002%" id="mcps1.3.3.3.3.2.1.2.4.1.3"><p id="mrs_01_1103__en-us_topic_0000001173471480_a1d2410d458f2436a9add279a8389bc12">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1103__en-us_topic_0000001173471480_r63ab1f3fc99a4d569cdb85b031c99c02"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.3.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ab0b5a760b2624d48a0da09dab9e7c5ff">Name</p>
</td>
<td class="cellrowborder" valign="top" width="53.010000000000005%" headers="mcps1.3.3.3.3.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a1cf7e258458240abb9d14c0db360e7ef">Specifies the name of the SFTP server connection.</p>
</td>
<td class="cellrowborder" valign="top" width="21.990000000000002%" headers="mcps1.3.3.3.3.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a74c1c844dcdc4c97a7c87aba63925547">sftpName</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r13ce7a843ca9403e894d44eaaab97892"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.3.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a34af973d75574505b38585281c19d3e4">SFTP Server IP</p>
</td>
<td class="cellrowborder" valign="top" width="53.010000000000005%" headers="mcps1.3.3.3.3.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_aabe9fe1740ef49cdae83449fe906ba59">Specifies the IP address of the SFTP server.</p>
</td>
<td class="cellrowborder" valign="top" width="21.990000000000002%" headers="mcps1.3.3.3.3.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a732180d4fe35488086c2aed065643535">10.16.0.1</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_rf8a57122eb1648079cedb67da901078d"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.3.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a3acd960379884b968aa8eb69760abd41">SFTP Server Port</p>
</td>
<td class="cellrowborder" valign="top" width="53.010000000000005%" headers="mcps1.3.3.3.3.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ab0cee814e8b640939ed8e24c767ed52e">Specifies the port number of the SFTP server.</p>
</td>
<td class="cellrowborder" valign="top" width="21.990000000000002%" headers="mcps1.3.3.3.3.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_aab984363ce7f45828619804899f1ca22">22</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r1c35a1ab3b1d45f5b602c29eff92c01a"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.3.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a2c2f2a7e72144f7eb498f653009026d1">SFTP Username</p>
</td>
<td class="cellrowborder" valign="top" width="53.010000000000005%" headers="mcps1.3.3.3.3.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a669112877e604b4591a6e6c34e48e88e">Specifies the user name for accessing the SFTP server.</p>
</td>
<td class="cellrowborder" valign="top" width="21.990000000000002%" headers="mcps1.3.3.3.3.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ac81a7b271f6a48c282f4dedf2c2fca73">root</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r47ed4cabb73f4522aee7686f1231020c"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.3.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ab10c2655c1e44c8dadaf116ce0e1a901">SFTP Password</p>
</td>
<td class="cellrowborder" valign="top" width="53.010000000000005%" headers="mcps1.3.3.3.3.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_afd7f6fb069e249e19166181ba433d1b8">Specifies the password for accessing the SFTP server.</p>
</td>
<td class="cellrowborder" valign="top" width="21.990000000000002%" headers="mcps1.3.3.3.3.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ad4353c0fdce7482789af61dc7e3cef83">xxxx</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_raf24b83cc759477c8b1d8d2d70db5537"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.3.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a6713fdd9a59c44dfacabb49d7b95076d">SFTP Public Key</p>
</td>
<td class="cellrowborder" valign="top" width="53.010000000000005%" headers="mcps1.3.3.3.3.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a1d9ccc2fe58c471fb74fed9b9a5a2fba">Specifies public key of the SFTP server.</p>
</td>
<td class="cellrowborder" valign="top" width="21.990000000000002%" headers="mcps1.3.3.3.3.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a78599705d09f49e09be3cfd07a362f67">OdDt/yn...etM</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="note" id="mrs_01_1103__en-us_topic_0000001173471480_n496200c385d04e24ac9f25c290376ae1"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p class="text" id="mrs_01_1103__en-us_topic_0000001173471480_a5c15dac27e5447e7ab3f49b82b4def45">When multiple SFTP servers are configured, the data of HDFS/OBS will be divided into multiple parts and exported to the SFTP servers randomly.</p>
</div></div>
<p class="tableheading" id="mrs_01_1103__en-us_topic_0000001173471480_a39315e8e20504402b61e0e26e2cf5aec"><strong id="mrs_01_1103__en-us_topic_0000001173471480_afc4945965bb54e349124c80f3aa5f422">Setting Data Source Information</strong></p>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_l5cd435a895424b01897eb69174b83e4c"><span>Click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uicontrol188449088091628"><b>Next</b></span>. On the displayed <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname150358725691628"><b>From</b></span> page, set <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname152959048991628"><b>Source type</b></span> to <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue34532622391628"><b>HDFS</b></span>.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1103__en-us_topic_0000001173471480_t9fb8fb13c77f429db206a5a3fa157f85" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Data source parameters</caption><thead align="left"><tr id="mrs_01_1103__en-us_topic_0000001173471480_r7f8ae21023fc4f15a418a64a7fd33b94"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.3.4.2.1.2.4.1.1"><p id="mrs_01_1103__en-us_topic_0000001173471480_a3c3c88c421ec4264a898609ca6a809e0">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="67.47999999999999%" id="mcps1.3.3.3.4.2.1.2.4.1.2"><p id="mrs_01_1103__en-us_topic_0000001173471480_a4f9ceaeab2c747739663356a68f0b55d">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="7.5200000000000005%" id="mcps1.3.3.3.4.2.1.2.4.1.3"><p id="mrs_01_1103__en-us_topic_0000001173471480_ac04575de0aa5484eaed71dc0c033a47f">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1103__en-us_topic_0000001173471480_r25d49c9451914e8aae71d02ddc4609b5"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a2aef04034e994be19f4ca824c26e75c0">Input directory</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a4e3c4a38aec947898ad1d63ef30da5de">Specifies the input path when data is exported from HDFS/OBS.</p>
<div class="note" id="mrs_01_1103__en-us_topic_0000001173471480_n0fef9153c27f4ab2be72263640f8725a"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="mrs_01_1103__en-us_topic_0000001173471480_abf4a232b074a44f0b3b12164c333d244">You can use macros to define path parameters. For details, see <a href="mrs_01_1153.html">Using Macro Definitions in Configuration Items</a>.</p>
</div></div>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a74ae499ddbb049729c56be3f8a42a4ca">/user/test</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r2d8843ac2b0640c6b5195127956dd88a"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a63fdfc3a3fd946b8977d0c363beb6f76">Path filter</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a65c75a3fef724cce8afa2f09a765412c">Specifies the wildcard for filtering the directories in the input paths of the source files. <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_p8536e735a8864881b3cbf38e66a67e2d"><b>Input directory</b></span> is not used in filtering. If there are multiple filter conditions, use commas (<span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p869f2a7d76054eb489f08b5ccd4fbf17"><b>,</b></span>) to separate them. If the parameter is empty, the directory is not filtered. The regular expression filtering is not supported.</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_u50f3e75130b8490ca89c52b025c880ae"><li id="mrs_01_1103__en-us_topic_0000001173471480_l9a85e3a78bb94e00853af6a290db7e82"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p514a49aaca374ae9aea9a8d94f149e75"><b>?</b></span> matches a single character.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l68df4727c3bc42f2b5052a7204852dda"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pc26272ccdf684101bcb286d8b9554a19"><b>*</b></span> indicates multiple characters.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_lb584e78470664e7aa1e584ebfa9dd27e">Adding <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p11a30421f36d495c8dd2bf67288216fa"><b>^</b></span> before the condition indicates negated filtering, that is, file filtering.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ab5b3f58033fe45eebfafc6f96ea8b790">*</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r715f790f4e01481b8615885b3069f33e"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_acb4cd550c15341b0823e778a0fcf3b0f">File filter</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a1d66fbe4e775428eb721f82f2daefb79">Specifies the wildcard for filtering the file names of the source files. If there are multiple filter conditions, use commas (<span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pab51ea2d8b0740fea3e8496f7913be63"><b>,</b></span>) to separate them. The value cannot be left blank. The regular expression filtering is not supported.</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_u43394f7b4cd04468aaa664757dfb74a8"><li id="mrs_01_1103__en-us_topic_0000001173471480_l335916274110416e914053e9d6912896"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pbc5dafbf9d1449229179280c28e0827d"><b>?</b></span> matches a single character.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l42357b7d7a6d490eba410b7502c528e0"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p53d0689e0d54436d8bff409f3d715976"><b>*</b></span> indicates multiple characters.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_lc0783db3df384a4a9e84ad6ceb7edae9">Adding <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pc141c62d741c4a14bac180f9848effa4"><b>^</b></span> before the condition indicates negated filtering, that is, file filtering.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a38d1055d3b2d4426a84b67d79d7d4490">*</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_rd1c32a8408c94397bcdae99c45efdb50"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a3fc325f96ca24ec992e666af05713270">File Type</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a1f657c660bce4f58acec2be82ff16eaa">Specifies the file import type.</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_ubf72451f9a2945729c795ffec7f940ee"><li id="mrs_01_1103__en-us_topic_0000001173471480_l6bb2799ec9154bbf8e59be9c1ea2e44a"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pe0b88a8b2f494131a5b7f71907d19d38"><b>TEXT_FILE</b></span>: imports a text file and stores it as a text file.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l48c68fa9fe1d4590a1c6a69a866ca43f"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p5f919c4b99d142b2b83ce4ab2ca8fd53"><b>SEQUENCE_FILE</b></span>: imports a text file and stores it as a <span class="filepath" id="mrs_01_1103__en-us_topic_0000001173471480_f438d96d0fe5a4747b4eab59e4bc4ee6f"><b>sequence file</b></span>.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l982e5a2e28564ec58032d18e003b7788"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pde1970dcf63f490ea1433dd07c890f45"><b>BINARY_FILE</b></span>: imports files of any format by using binary streams but not to process the files.</li></ul>
<div class="note" id="mrs_01_1103__en-us_topic_0000001173471480_n73ad0e36a2ae4716b7affe3498f0ab4f"><span class="notetitle"> NOTE: </span><div class="notebody"><p class="textintable" id="mrs_01_1103__en-us_topic_0000001173471480_ac580afe41ade4fcb9b9459b5c387ce59">When the file import type to <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue12410296991628"><b>TEXT_FILE</b></span> or <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue82203259191628"><b>SEQUENCE_FILE</b></span>, Loader automatically selects a decompression method based on the file name extension to decompress a file.</p>
</div></div>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a4a888ce5e7844d5bae859787f7f1bf11">TEXT_FILE</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r77a626b045ed4e758f58688b393c6422"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_aa201b3a547f14e26b28624e253f404f4">File Split Type</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a26905565ac4248f189e488c925e4364b">Indicates whether to split source files by file name or size. The files obtained after the splitting are used as the input files of each map in the MapReduce task for data export.</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_uf1a34a028e154b339a99fba63dd89e83"><li id="mrs_01_1103__en-us_topic_0000001173471480_lfae1b66d3b154832ac80154d59f5ee2b"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue48521211269"><b>FILE</b></span>: indicates that the source file is split by file. That is, each map processes one or multiple complete files, the same source file cannot be allocated to different maps, and the source file directory structure is retained after data import.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l9a67a71cc6d643cab1abad6905e25bb6"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue755064668"><b>SIZE</b></span>: indicates that the source file is split by size. That is, each map processes input files of a certain size, and a source file can be divided and processed by multiple maps. After data is stored in the output directory, the number of saved files is the same as the number of maps. The file name format is <span class="filepath" id="mrs_01_1103__en-us_topic_0000001173471480_filepath15501544620"><b>import_part_xxxx</b></span>, where <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue85501241962"><b>xxxx</b></span> is a unique random number generated by the system.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a77719f5c4ace4c6b9ec1064b57c34cf1">FILE</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r1353d0656fc24b5d97bb545fe6f8d47e"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ac33b99cc5d8a4dc3a2c306da25e1e88c">Extractors</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a325b48078ba64a83bbc618e45078b2f5">Specifies the number of maps that are started at the same time in a MapReduce job of a data configuration operation. This parameter cannot be set when <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_p35db33c2eb554302ae10ca8b8d13707c"><b>Extractor Size</b></span> is set. The value must be less than or equal to 3000. You are advised to set the parameter to the number of CPU cores on the SFTP server.</p>
<div class="note" id="mrs_01_1103__en-us_topic_0000001173471480_nd92625489f78475587831d184a1dab17"><span class="notetitle"> NOTE: </span><div class="notebody"><p class="textintable" id="mrs_01_1103__en-us_topic_0000001173471480_a874955c3d8a94e50aabe95e6a4d4ef92">To improve the data import speed, ensure that the following conditions are met:</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_ua22f426f2f064aa8953af267f7838d08"><li id="mrs_01_1103__en-us_topic_0000001173471480_l6bc13dc7e1404c46b50e418dfe25e544">Each map connection is equivalent to a client connection. Therefore, you must ensure that the maximum number of connections of the SFTP server is greater than the number of maps.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_lc67fa6cc75a9440bb56b758b24f5f9cb">Ensure that the disk I/O or network bandwidth on the SFTP server does not reach the upper limit.</li></ul>
</div></div>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a82da7fb4a12243368c66a14adb570a82">20</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r4b30369089ff4727b3d3cc9e79271776"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.4.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a397076d306d741619365079884889146">Extractor size</p>
</td>
<td class="cellrowborder" valign="top" width="67.47999999999999%" headers="mcps1.3.3.3.4.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ae1b6988d2bc24cd79786d390ed26a882">Specifies the size of data processed by maps that are started in a MapReduce job of a data configuration operation. The unit is MB. The value must be greater than or equal to 100. The recommended value is 1000. This parameter cannot be set when <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_pfe426cee5a9c40e8a2c630cc3ea37903"><b>Extractors</b></span> is set.</p>
</td>
<td class="cellrowborder" valign="top" width="7.5200000000000005%" headers="mcps1.3.3.3.4.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a02d89d20f53f4c08ae6336f55d411f32">-</p>
</td>
</tr>
</tbody>
</table>
</div>
<p class="tableheading" id="mrs_01_1103__en-us_topic_0000001173471480_a5761e19321b648d78606c1458085c404"><strong id="mrs_01_1103__en-us_topic_0000001173471480_a127521454f3b4a0897023670e99c9230">Setting Data Transformation</strong></p>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_le25238d909d7483d84863fdd82c7983d"><span>Click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_ua526073a1d9a4aceaab485f426a826d0"><b>Next</b></span>. On the displayed <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_pa5e6d9d7968548028cd96ee76d058b43"><b>Transform</b></span> page, set the transformation operations in the data transformation process. For details about how to select operators and set parameters, see <a href="mrs_01_1119.html">Operator Help</a> and <a href="#mrs_01_1103__en-us_topic_0000001173471480_table895989011525">Table 3</a>.</span><p>
<div class="tablenoborder"><a name="mrs_01_1103__en-us_topic_0000001173471480_table895989011525"></a><a name="en-us_topic_0000001173471480_table895989011525"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1103__en-us_topic_0000001173471480_table895989011525" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Setting the input and output parameters of the operator</caption><thead align="left"><tr id="mrs_01_1103__en-us_topic_0000001173471480_row1060779011525"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.3.5.2.1.2.3.1.1"><p id="mrs_01_1103__en-us_topic_0000001173471480_p1556013211525">Input Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.3.5.2.1.2.3.1.2"><p id="mrs_01_1103__en-us_topic_0000001173471480_p5241116811525">Export Type</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1103__en-us_topic_0000001173471480_row671911525"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.3.5.2.1.2.3.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_p54425911525">CSV file input</p>
</td>
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.3.5.2.1.2.3.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_p25487286115718">File output</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_row42347907115217"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.3.5.2.1.2.3.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_p7628470115217">HTML input</p>
</td>
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.3.5.2.1.2.3.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_p13926313115217">File output</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_row29417297115246"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.3.5.2.1.2.3.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_p33990823115246">Fixed-width file input</p>
</td>
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.3.5.2.1.2.3.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_p41907484115714">File output</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="fignone" id="mrs_01_1103__en-us_topic_0000001173471480_f5ca19118d43540ecb349e83b84bc566d"><span class="figcap"><b>Figure 3 </b>Operator operation procedure</span><br><span><img id="mrs_01_1103__en-us_topic_0000001173471480_i72156b23e5324abca814f31361fcda70" src="en-us_image_0000001349259401.png"></span></div>
<p class="tableheading" id="mrs_01_1103__en-us_topic_0000001173471480_a48d8fca6e021460b86f9483c67456ac9"><strong id="mrs_01_1103__en-us_topic_0000001173471480_aa713e291f4264398833af5c806f6bd13">Setting Data Storage Information and Executing the Job</strong></p>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_l1e7fd2ac905d4f9281bba98e2e8e8f3b"><span>Click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_uffa35360dbe0494687941910ec5debbd"><b>Next</b></span>. On the displayed <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_p0b5301d922d84cd98c2214b2e0376709"><b>To</b></span> page, set the data storage mode.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1103__en-us_topic_0000001173471480_t3c6799b9f8054cf1bb391cb06cb008e8" frame="border" border="1" rules="all"><caption><b>Table 4 </b>Parameter description</caption><thead align="left"><tr id="mrs_01_1103__en-us_topic_0000001173471480_rdcdb4043d456422faebb0101c3171cd3"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.3.6.2.1.2.4.1.1"><p id="mrs_01_1103__en-us_topic_0000001173471480_aec5edc24b60843ecafbb93fc40313635">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="65.14%" id="mcps1.3.3.3.6.2.1.2.4.1.2"><p id="mrs_01_1103__en-us_topic_0000001173471480_a83cde906b11f410f827f12d2c3255a59">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="9.86%" id="mcps1.3.3.3.6.2.1.2.4.1.3"><p id="mrs_01_1103__en-us_topic_0000001173471480_a0d1eef1a62084af6afce7626912bc378">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1103__en-us_topic_0000001173471480_rb897635307974452ab25e2d406fae585"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.6.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a823409e93c514aa0ad7af65988b0f65c">Output path</p>
</td>
<td class="cellrowborder" valign="top" width="65.14%" headers="mcps1.3.3.3.6.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a12d5d87845a047cf9d69d45d9f19d4a0">Specifies the path or file name of the exported file on an SFTP server. If multiple SFTP server IP addresses are configured for the connector, you can set this parameter to multiple paths or file names separated with semicolons (<span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p5a1127c29b0341598e247c149b403e82"><b>;</b></span>). Ensure that the number of paths or file names is the same as the number of SFTP servers configured for the connector.</p>
<div class="note" id="mrs_01_1103__en-us_topic_0000001173471480_ne94ab71339294b2db0fc68f799104057"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="mrs_01_1103__en-us_topic_0000001173471480_aa525f158d16c4fe19154be99a6413a34">You can use macros to define path parameters. For details, see <a href="mrs_01_1153.html">Using Macro Definitions in Configuration Items</a>.</p>
</div></div>
</td>
<td class="cellrowborder" valign="top" width="9.86%" headers="mcps1.3.3.3.6.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a4bca27fa78904e30b1a79a45d7d5fa47">/opt/tempfile</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r3a3dd8124e2f43a7bc592fdb312e6c1f"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.6.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ad5c420526f9846dc937c5cfb83484fa0">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="65.14%" headers="mcps1.3.3.3.6.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a85243595de2a438cbfd2212e4bd2ba65">Specifies the action during data import. When all data is to be imported from the input path to the destination path, the data is stored in a temporary directory and then copied from the temporary directory to the destination path. After the data is imported successfully, the data is deleted from the temporary directory. One of the following actions can be taken when duplicate file names exist during data transfer:</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_u740a0ae2eb424438a3a973d31ce69600"><li id="mrs_01_1103__en-us_topic_0000001173471480_le79546a81bbd48fabd867e9a0710d9f4"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pf47e2ed6da05480c8fb1d3f718524229"><b>OVERRIDE</b></span>: overrides the old file.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l17be387dc5e7480b9984a32b4313fbf2"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pbe29b58d895a400493a18b58a02b3c8a"><b>RENAME</b></span>: renames as new file. For a file without an extension, a string is added to the file name as the extension; for a file with an extension, a string is added to the extension. The string is unique.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_le175c9289af24976ab4c61f583c0dd03"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p0c8348ee2f8e47ed81724b5fd56b1a68"><b>APPEND</b></span>: adds the content of the new file to the end of the old file. This action only adds content regardless of whether the file can be used. For example, a text file can be used after this operation, while a compressed file cannot.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_lb3f8e693f74e4c7981ed6adec9165121"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_pf3b3695845e34c93997e7911118241e9"><b>IGNORE</b></span>: reserves the old file and does not copy the new file.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l4ccb2200243647cb85a8d5395e95572f"><span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p5c1af2357ff64ba884046a92b36510c8"><b>ERROR</b></span>: stops the task and reports an error if duplicate file names exist. Transferred files are imported successfully, while files that have duplicate names and files that are not transferred fail to be imported.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="9.86%" headers="mcps1.3.3.3.6.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a5a8aa5670dd345d18c1ddc648650cf4c">OVERRIDE</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r99cb4826654d4780a3a8361caa3279ed"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.6.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_aad437c1fa77542789711b922170e6472">Encode type</p>
</td>
<td class="cellrowborder" valign="top" width="65.14%" headers="mcps1.3.3.3.6.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a44e9cd0a72a340929417026b78ed7ae9">Specifies the exported file encoding format, for example, UTF-8. This parameter can be set only in text file export.</p>
</td>
<td class="cellrowborder" valign="top" width="9.86%" headers="mcps1.3.3.3.6.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a4990a76150fc4f5caf84120c5c2db4fc">UTF-8</p>
</td>
</tr>
<tr id="mrs_01_1103__en-us_topic_0000001173471480_r3c757ba44da64f0a80b1388139acd85f"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.3.6.2.1.2.4.1.1 "><p id="mrs_01_1103__en-us_topic_0000001173471480_a073e84859bb04dc880e47c73f0faf521">Compression</p>
</td>
<td class="cellrowborder" valign="top" width="65.14%" headers="mcps1.3.3.3.6.2.1.2.4.1.2 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ae7c7473274b54a118e1157f08b807c7d">Indicates whether to enable the compressed transmission function when SFTP is used to export data.</p>
<ul id="mrs_01_1103__en-us_topic_0000001173471480_uf68d6b59033e4b87bbdb6d71b23d7a7e"><li id="mrs_01_1103__en-us_topic_0000001173471480_l0288aaae4e5a428da7450cf803bceb6b">The value <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p95f66555010d4737aebac8007468f499"><b>true</b></span> indicates that compression is enabled.</li><li id="mrs_01_1103__en-us_topic_0000001173471480_l5337eea4285d492cb05362aa80a53d06">The value <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_p71195e03d7e34aefb5bef040e865f37f"><b>false</b></span> indicates that compression is disabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="9.86%" headers="mcps1.3.3.3.6.2.1.2.4.1.3 "><p id="mrs_01_1103__en-us_topic_0000001173471480_ae8f5a7c16889469f95c3a7dd2dbbe0cf">true</p>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_l37382f0e92294a44ab575d6d98f0b4f0"><span>Click <span class="uicontrol" id="mrs_01_1103__en-us_topic_0000001173471480_u68e91dbc7d13400c98e097ffd530c749"><b>Save and run</b></span> to save and run the job.</span><p><p id="mrs_01_1103__en-us_topic_0000001173471480_ab963dab0f25440b388d40dcaaa41d22f"><strong id="mrs_01_1103__en-us_topic_0000001173471480_ab06c1a61287c4165a721cb78db1716d5">Checking the Job Execution Result</strong></p>
</p></li><li id="mrs_01_1103__en-us_topic_0000001173471480_lbddfa3576813473f98436023b87be3e1"><span>Go to the <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname144193708491628"><b>Loader WebUI</b></span>. When <span class="parmname" id="mrs_01_1103__en-us_topic_0000001173471480_parmname119331633191628"><b>Status</b></span> is <span class="parmvalue" id="mrs_01_1103__en-us_topic_0000001173471480_parmvalue151552520591628"><b>Succeeded</b></span>, the job is complete.</span><p><div class="fignone" id="mrs_01_1103__en-us_topic_0000001173630728_f6c7d800e4d2a45da9f9672d8d2b33ad1"><span class="figcap"><b>Figure 4 </b>Viewing job </span><br><span><img id="mrs_01_1103__en-us_topic_0000001173630728_ia5e94abc31a3428aaaca819fd1f345ba" src="en-us_image_0000001439746633.png"></span></div>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1100.html">Exporting Data</a></div>
</div>
</div>
View Git Blame Copy Permalink