forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
178 lines
24 KiB
HTML
178 lines
24 KiB
HTML
<a name="mrs_01_1159"></a><a name="mrs_01_1159"></a>
|
|
|
|
<h1 class="topictitle1">schedule-tool Usage Guide</h1>
|
|
<div id="body8662426"><div class="section" id="mrs_01_1159__en-us_topic_0000001219350715_seb4a86aecbc248368d62c390af710d47"><h4 class="sectiontitle">Overview</h4><p id="mrs_01_1159__en-us_topic_0000001219350715_a74a635934b1e43a6bcf47676b31ea609">schedule-tool is used to submit jobs of SFTP data sources. You can modify the input path and file filtering criteria before submitting a job. You can modify the output path if the target source is HDFS.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1159__en-us_topic_0000001219350715_s0d08be9d8363432a862fddf4925330a6"><h4 class="sectiontitle">Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1159__en-us_topic_0000001219350715_t21b1b9a7312c40219b81392ec97a3029" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Configuration parameters of schedule.properties</caption><thead align="left"><tr id="mrs_01_1159__en-us_topic_0000001219350715_ra8bd69dcfc8f4a13a7d3f2a925bdea61"><th align="left" class="cellrowborder" valign="top" width="31.41%" id="mcps1.3.2.2.2.4.1.1"><p id="mrs_01_1159__en-us_topic_0000001219350715_a703be42e2beb43669084f1ec23f8cf63">Configuration parameters</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="44.529999999999994%" id="mcps1.3.2.2.2.4.1.2"><p id="mrs_01_1159__en-us_topic_0000001219350715_aa2b480542ab34f158dfca65497b80761">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="24.060000000000002%" id="mcps1.3.2.2.2.4.1.3"><p id="mrs_01_1159__en-us_topic_0000001219350715_ab84aaae2411a4457be670c2797d51d2c">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1159__en-us_topic_0000001219350715_rbe0304a838fb4933802b8f48f3e75310"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_add985136642d4f5ca8af25ba52f60ddb">server.url</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ae87e5db8ad5d48b4a63b507e9c5d1f38">Floating IP address and port for Loader. The default port is 21351.</p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_a2b2d80f6cbd94d7f9d00435d93c190e5">For compatibility, multiple IP addresses and ports can be configured and need to be separated by commas (<span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_p91308ebbbed0410199563579e13090f6"><b>,</b></span>). The first IP address and port must be those of Loader. The others can be configured based on service requirements.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a0c60a0ccb5864bb98dea94f3edf0a329">10.96.26.111:21351,127.0.0.2:21351</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r32a783e11c9d407f8cbec1f0d4f4e38d"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ad6fb86348930406987ae189e104ed0ef">authentication.type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a34651017b834422aac80bd709e6c1355">Login authentication mode.</p>
|
|
<ul id="mrs_01_1159__en-us_topic_0000001219350715_u68d992cfd8214d368cd4f960edc45360"><li id="mrs_01_1159__en-us_topic_0000001219350715_la5f1a60f0364480ea04e0287bea36b28"><span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_p0538dedf7b15492ca9fc49bba4d2b8a0"><b>kerberos</b></span> indicates that the security mode is used and Kerberos authentication is performed. Kerberos authentication provides two authentication modes: the password mode and the keytab file mode.</li><li id="mrs_01_1159__en-us_topic_0000001219350715_l89cf46df05f248daa7a76737e1b73c64"><span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_p5246eed09b83405ea0f1a435b01b3b74"><b>simple</b></span> indicates that the normal mode is used and Kerberos authentication is not performed.</li></ul>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_afc0de24a10514988ae59d568daf34064">kerberos</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r4cc2366306e8468b88cad6233c5cda63"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a056f1d4ace31494eab53b138aec4e9e3">authentication.user</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_p2090222720253">User for login when the normal mode or password authentication is used.</p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_a689fb835ecd241899677130221b7107e">In the keytab login mode, this parameter does not need to be set.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a6de042d9c2f7429d9a24d80738e9b69d">bar</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_rff1a73b4591741bbbf98df1f381b75a0"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a407f8c0e7b064a8ab005d9d07051dd9b">authentication.password</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a7beddafb92774323b97a04367ced7095">User password for login when the password authentication mode is used. In the normal mode or keytab login mode, this parameter does not need to be set.</p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_a7eda036bca904f498d502ee51a305c53">The password needs to be encrypted. The encryption method is described as follows:</p>
|
|
<ol id="mrs_01_1159__en-us_topic_0000001219350715_o3885ab04ca8c4837ba1ebd78354dc171"><li id="mrs_01_1159__en-us_topic_0000001219350715_l399361f03c8245a98441e59030ae938b">Go to the directory where <span class="parmname" id="mrs_01_1159__en-us_topic_0000001219350715_p85ca35a39f3b4f69826113f48f0caa64"><b>encrypt_tool</b></span> is located. For example, if the Loader client installation directory is <span class="filepath" id="mrs_01_1159__en-us_topic_0000001219350715_f5cca964c4bd04bdfb833a5c46a6d435b"><b>/opt/hadoopclient/Loader</b></span>, run the following command:<p id="mrs_01_1159__en-us_topic_0000001219350715_abd58e7635edf442db60538996419fcef"><strong id="mrs_01_1159__en-us_topic_0000001219350715_ac069f3fd64944678884f963da8563f91">cd /opt/hadoopclient/Loader/loader-tools-1.99.3</strong></p>
|
|
</li><li id="mrs_01_1159__en-us_topic_0000001219350715_lbbd0f96e433c4a6f848a3d6ecfd4ab83">Run the following command to encrypt the non-encrypted password:<p id="mrs_01_1159__en-us_topic_0000001219350715_ad8a75afef1a84a6e878ed97a7537a7c3"><a name="mrs_01_1159__en-us_topic_0000001219350715_lbbd0f96e433c4a6f848a3d6ecfd4ab83"></a><a name="en-us_topic_0000001219350715_lbbd0f96e433c4a6f848a3d6ecfd4ab83"></a><strong id="mrs_01_1159__en-us_topic_0000001219350715_b1788123581311">./encrypt_tool </strong><em id="mrs_01_1159__en-us_topic_0000001219350715_i588718356137">Unencrypted password</em></p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_abd67effcb2bb4707843b56e78234eb48">The obtained encrypted password is used as the value of <span class="parmname" id="mrs_01_1159__en-us_topic_0000001219350715_pdcaadf90b65448eda7665049ad061055"><b>authentication.password</b></span>.</p>
|
|
<div class="note" id="mrs_01_1159__en-us_topic_0000001219350715_note8349540161234"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="mrs_01_1159__en-us_topic_0000001219350715_p8036997161234">If a non-encrypted password contains special characters, the special characters must be escaped. For example, the dollar sign ($) is a special character and can be escaped using single quotation marks ('), for example, <strong id="mrs_01_1159__en-us_topic_0000001219350715_b20849171014134">'1q2w#e$r'</strong>. If a non-encrypted password contains single quotation marks, use double quotation marks to escape the single quotation marks. If a non-encrypted password contains double quotation marks, use backslashes (\) to escape the double quotation marks. For details, see the shell escape character rules.</p>
|
|
</div></div>
|
|
</li></ol>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a1d532988fd1846a8b92fa67be7eed64e">43B80E33A96DF3D203ABBDFD1050C041</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r0676eac6c1a244e6a31f387e0b4667d5"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ae0e4ef277f7947cda7139d21df3c0f5d">use.keytab</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a3719a6e2bbe142dca0a6191f89e048fc">Whether to use the keytab mode to log in.</p>
|
|
<ul id="mrs_01_1159__en-us_topic_0000001219350715_u8e5ec5e4166847238391ebe9ad70b201"><li id="mrs_01_1159__en-us_topic_0000001219350715_ladf71a9067c340e8a07d6a48733da340"><strong id="mrs_01_1159__en-us_topic_0000001219350715_b73955646291641">true</strong> indicates using the keytab file to log in.</li><li id="mrs_01_1159__en-us_topic_0000001219350715_la282380cae314900bda6d55a261e2cab"><strong id="mrs_01_1159__en-us_topic_0000001219350715_b101523529091641">false</strong> indicates using the password to log in.</li></ul>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a509f1e9bebf24dedb7ae8c417d0c713b">true</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r9805ea304b0d4ddb8f99ddf890174498"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a1740e884655440e9844fc5f0f3fa352d">client.principal</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a287164f69ff44de8bfb64bd54556e5e9">User principal for accessing the Loader service when the keytab authentication mode is used.</p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_a2955727cd3054f59a7ee68fd38f93da2">In the normal mode or password login mode, this parameter does not need to be set.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a315c4a161aa14691bbe0f7b71dcfed46">loader/hadoop.<em id="mrs_01_1159__en-us_topic_0000001219350715_i9783153914913">System domain name</em></p>
|
|
<div class="note" id="mrs_01_1159__en-us_topic_0000001219350715_note18431216101919"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="mrs_01_1159__en-us_topic_0000001219350715_p113661321101915">You can log in to FusionInsight Manager, choose <strong id="mrs_01_1159__en-us_topic_0000001219350715_b161019702991641">System</strong> > <strong id="mrs_01_1159__en-us_topic_0000001219350715_b95852445291641">Permission</strong> > <strong id="mrs_01_1159__en-us_topic_0000001219350715_b37215984791641">Domain and Mutual Trust</strong>, and view the value of <strong id="mrs_01_1159__en-us_topic_0000001219350715_b78334283491641">Local Domain</strong>, which is the current system domain name.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r6c4372cfaf4f418886b0ad5b21f04196"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a62fcdc2af5ef4a7a8d19f46d10fd3098">client.keytab</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ac04ac155d15143fa9e2a59289965ec08">Directory where the used keytab file is located when the keytab authentication mode is used.</p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_aac017c7b81464b7aabaa229928b9b348">In the normal mode or password login mode, this parameter does not need to be set.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a3a64b94e68fc4d7cada6808225617737">/opt/client/conf/loader.keytab</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r49c94bcbeafd43fabeb0b3e7f43d1154"><td class="cellrowborder" valign="top" width="31.41%" headers="mcps1.3.2.2.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a14de6cce620144d99efa12a679413ba5">krb5.conf.file</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.529999999999994%" headers="mcps1.3.2.2.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a8358c0ef80294b9b8b8c0ca894d80ab2">Directory where the <strong id="mrs_01_1159__en-us_topic_0000001219350715_b165780805491641">krb5.conf</strong> file is located when the keytab authentication mode is used.</p>
|
|
<p id="mrs_01_1159__en-us_topic_0000001219350715_a7c028e482a214f86a954fb36a0b78e8b">In the normal mode or password login mode, this parameter does not need to be set.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.2.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a99075f5ab9d944528fde9a9c967ee1ee">/opt/client/conf/krb5.conf</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_1159__en-us_topic_0000001219350715_tef5476bb3df74feaba8c792757ba1ab6"></a><a name="en-us_topic_0000001219350715_tef5476bb3df74feaba8c792757ba1ab6"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1159__en-us_topic_0000001219350715_tef5476bb3df74feaba8c792757ba1ab6" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Configuration parameters of job.properties</caption><thead align="left"><tr id="mrs_01_1159__en-us_topic_0000001219350715_r6802c50b876e4b9ba2580642a8299f54"><th align="left" class="cellrowborder" valign="top" width="31.39%" id="mcps1.3.2.3.2.4.1.1"><p id="mrs_01_1159__en-us_topic_0000001219350715_a1b83be3dd33247b7a6f71d5209a4de5b">Configuration parameters</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="44.55%" id="mcps1.3.2.3.2.4.1.2"><p id="mrs_01_1159__en-us_topic_0000001219350715_abfc05ddaa24642d8b41ef792700329bb">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="24.060000000000002%" id="mcps1.3.2.3.2.4.1.3"><p id="mrs_01_1159__en-us_topic_0000001219350715_a2ab16dd9a5184191863df0517943c875">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1159__en-us_topic_0000001219350715_rfa0e75562e334e9d8dba95cef0361970"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ab6bd09fe8c584aebba9e1c626fe36161">job.jobName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a03b72b0e8c144d2587a19ae6540c9511">Job name.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a4eca0c5ade0145f8b2cb0b618c4b09bc">job1</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_rd32cf9a11f444b86908aad874c8a0840"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a2032c83889194cc3a712754402b7c584">file.fileName.prefix</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a7f10ce3331d143c49fcb493361786f52">File name prefix.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ac99fda2cd92742cfa04fe7cef7c2f773">table1</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_ra031535efcf6433abfdb54a90a740a05"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a229f41266d534e2e95db1985fb87c5d8">file.fileName.posfix</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_aa2f34e027e8e46ea9fb5de61eb2408e6">File name suffix.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ae93abf2ba3be4220b7f4eb9f3adc78e3">.txt</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r15c67a4b83b341299639dbfc6db5f862"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a2de8b255135643e49e5d6e13e73aecc9">file.filter</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_af295156ec1ab41f4a63fe0cbd4f0753b">File filter, which filters files by matching file names.</p>
|
|
<ul id="mrs_01_1159__en-us_topic_0000001219350715_u9cbc000015b84a95aa68a62bccc2559a"><li id="mrs_01_1159__en-us_topic_0000001219350715_lf0ce979dcf184d9eaf6c49fe13cad4fe"><span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_p70030377091640508d6b3ae7a58db742"><b>true</b></span> indicates that the preceding prefix or suffix is used to match all files in the input path. For details, see the example.</li><li id="mrs_01_1159__en-us_topic_0000001219350715_l1d0ee60032844c159b987734c3d3a511"><span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_p51cb2d7bc1f74b00bd8dce77e10153cd"><b>false</b></span> indicates that the preceding prefix or suffix is used to match a file in the input path. For details, see the example.</li></ul>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a276ca8c6c0994324ad318ffa17bc13a3">true</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r9d47d52f78a9426287bf6549e283dd71"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a548b978a9ad3435aa18b98c6f350c414">date.day</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a4945a2dbb9114327be1dac0fc6dea7c8">Number of delayed days, which is matched with the date in the name of an imported file. For example, if the input date is 20160202 and the number of delayed days is 3, files that contain the 20160205 date field in the input path are matched. For details, see <a href="mrs_01_1160.html">schedule-tool Usage Example</a>.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a4cf7b55ffd6b46dfaca099b1c1a1b0d8">3</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r106fc1188ee94918971d4fb519b30607"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_abfa028436bcb4096a52145c13fdd15b3">file.date.format</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a6cf99c5dd3954868b50427ed6fe59b0c">Log format included in the name of the file to be imported.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_abf66696793c843df8785a2d9fd0f3051">yyyyMMdd</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r1f71062eb28743a7abf2d0d64b8e389e"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_acd7f0d359f184146bc68927e1087d439">parameter.date.format</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_ac9186ee88b2a403ba9b95bbb02ecfbd8">Entered date format when a script is invoked, which is usually consistent with <span class="parmname" id="mrs_01_1159__en-us_topic_0000001219350715_pf511f3aad633401490213e19d6b1763e"><b>file.date.format</b></span>.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a23807e257a8448fea87b24d9cc80d43f">yyyyMMdd</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_r153072b3889141dea89cdf2d2f408c66"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a848fa3a66eef41bca17ab2ab2261e455">file.format.iscompressed</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a5c09e8abfb2d4326915ff9f6402a2600">Whether the file to be imported is a compressed file.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a649f532393b54516ac39876b9c803272">false</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1159__en-us_topic_0000001219350715_ra108ccfd9a7a46ffb181d47ebfc8c0b0"><td class="cellrowborder" valign="top" width="31.39%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a3f12fde673db40dcb5f2925542908a0e">storage.type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.55%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a3fbb4400c2414d99b4f87a91bdd90dff">Storage type. The final type of the file to be imported include HDFS, HBase, and Hive.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.060000000000002%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1159__en-us_topic_0000001219350715_a79531c208b174e7ca3cfee1afce580e6">HDFS</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<div class="note" id="mrs_01_1159__en-us_topic_0000001219350715_n2ba235ee5b6240328b39af6bc29b56d0"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1159__en-us_topic_0000001219350715_ae72e53cfc6c741c181efa1b7e94f82df">schedule-tool supports the configuration of multiple jobs at the same time. When multiple jobs are configured at the same time, <span class="parmname" id="mrs_01_1159__en-us_topic_0000001219350715_parmname81839994291641"><b>job.jobName</b></span>, <span class="parmname" id="mrs_01_1159__en-us_topic_0000001219350715_parmname53010493391641"><b>file.fileName.prefix</b></span>, and <span class="parmname" id="mrs_01_1159__en-us_topic_0000001219350715_parmname12450756291641"><b>file.fileName.posfix</b></span> in <a href="#mrs_01_1159__en-us_topic_0000001219350715_tef5476bb3df74feaba8c792757ba1ab6">Table 2</a> need to be configured with multiple values, and the values need to be separated by <span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_parmvalue39168171891641"><b>commas (,)</b></span>.</p>
|
|
</div></div>
|
|
</div>
|
|
<div class="section" id="mrs_01_1159__en-us_topic_0000001219350715_s4f40a57c30484659adeaaea1a7fac5a2"><h4 class="sectiontitle">Precautions</h4><p id="mrs_01_1159__en-us_topic_0000001219350715_ad51dba0b84254387bbc54c3611389abf"><strong id="mrs_01_1159__en-us_topic_0000001219350715_b17929158191641">server.url</strong> must be set to a format string of two IP addresses and port numbers, and the IP addresses and ports need to be separated by <span class="parmvalue" id="mrs_01_1159__en-us_topic_0000001219350715_parmvalue46265325191641"><b>commas (,)</b></span>.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1155.html">Client Tool Description</a></div>
|
|
</div>
|
|
</div>
|
|
|