vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dli/api-ref/dli_02_0124.html
Su, Xiaomeng 57a0d535be dli_api_0910_version_api 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2023-10-16 22:01:57 +00:00

652 lines
58 KiB
HTML
Raw Blame History

<a name="dli_02_0124"></a><a name="dli_02_0124"></a>
<h1 class="topictitle1">Creating a Batch Processing Job</h1>
<div id="body8662426"><div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_s1f0e4fd3d502405199f36f78e68721aa"><h4 class="sectiontitle">Function</h4><p id="dli_02_0124__en-us_topic_0103343302_p28958103151626">This API is used to create a batch processing job in a queue.</p>
</div>
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_s9e1b8ec5b57c422a942b19835da7d66e"><h4 class="sectiontitle">URI</h4><ul id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_ul10082125"><li id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_li23630265">URI format<p id="dli_02_0124__en-us_topic_0103343302_p37583371151729"><a name="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_li23630265"></a><a name="en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_li23630265"></a>POST /v2.0/{project_id}/batches</p>
</li><li id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_li1725612218454">Parameter description
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_table60779388" frame="border" border="1" rules="all"><caption><b>Table 1 </b>URI parameter</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_row61411666"><th align="left" class="cellrowborder" valign="top" width="13.41%" id="mcps1.3.2.2.2.1.2.5.1.1"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_a420a62a594f9410eaea229ffc8037a61">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="11.73%" id="mcps1.3.2.2.2.1.2.5.1.2"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_p873025824211">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="12.76%" id="mcps1.3.2.2.2.1.2.5.1.3"><p id="dli_02_0124__p4661929163816">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="62.1%" id="mcps1.3.2.2.2.1.2.5.1.4"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_a692d3cd97b464aed90ba6d841900a4a5">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_row48589216"><td class="cellrowborder" valign="top" width="13.41%" headers="mcps1.3.2.2.2.1.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_p43412436">project_id</p>
</td>
<td class="cellrowborder" valign="top" width="11.73%" headers="mcps1.3.2.2.2.1.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_p26746391">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="12.76%" headers="mcps1.3.2.2.2.1.2.5.1.3 "><p id="dli_02_0124__p1266122917382">String</p>
</td>
<td class="cellrowborder" valign="top" width="62.1%" headers="mcps1.3.2.2.2.1.2.5.1.4 "><p id="dli_02_0124__p1310472724012">Project ID, which is used for resource isolation. For details about how to obtain its value, see <a href="dli_02_0183.html">Obtaining a Project ID</a>.</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ul>
</div>
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_section20458182103"><h4 class="sectiontitle">Request</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_table1944164663513" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Request parameters</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_row29441446113518"><th align="left" class="cellrowborder" valign="top" width="17.46%" id="mcps1.3.3.2.2.5.1.1"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p1935161415364">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="11.4%" id="mcps1.3.3.2.2.5.1.2"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p1036131419366">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="16.17%" id="mcps1.3.3.2.2.5.1.3"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p17381114123617">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="54.97%" id="mcps1.3.3.2.2.5.1.4"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p1340121413614">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_row42140185151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p56138383151841">file</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p50915163151841">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p30487499151841">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p53568327151841">Name of the package that is of the JAR or pyFile type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b877764075012">obs://</strong><em id="dli_02_0124__i31360494506">Bucket name</em><strong id="dli_02_0124__b771155535017">/</strong><em id="dli_02_0124__i1954825210508">Package name</em>.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row27860897151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p35630586151841">className</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p396334151841">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p32103087151841">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p50213220151841">Java/Spark main class of the batch processing job.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row25465276151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p171410613012">queue</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p717261002">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p191816209">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1417618602611">Queue name. Set this parameter to the name of the created DLI queue. The queue must be of the general-purpose type.</p>
<div class="note" id="dli_02_0124__note11247152122616"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_02_0124__ul4167717202719"><li id="dli_02_0124__li131675177275">This parameter is compatible with the <strong id="dli_02_0124__b14989190192315">cluster_name</strong> parameter. That is, if <strong id="dli_02_0124__b415513412313">cluster_name</strong> is used to specify a queue, the queue is still valid.</li><li id="dli_02_0124__li116811710273">You are advised to use the <strong id="dli_02_0124__b22191616412">queue</strong> parameter. The <strong id="dli_02_0124__b222441613113">queue</strong> and <strong id="dli_02_0124__b1322413168110">cluster_name</strong> parameters cannot coexist.</li></ul>
</div></div>
</td>
</tr>
<tr id="dli_02_0124__row153511293916"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p171410613012">cluster_name</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p717261002">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p191816209">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p41911613013">Queue name. Set this parameter to the created DLI queue name.</p>
<div class="note" id="dli_02_0124__note110524619365"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_02_0124__p9704122114376">You are advised to use the <strong id="dli_02_0124__b5449517714">queue</strong> parameter. The <strong id="dli_02_0124__b8450217712">queue</strong> and <strong id="dli_02_0124__b124501117712">cluster_name</strong> parameters cannot coexist.</p>
</div></div>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row5518185484813"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p5519175474817">args</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p951914544484">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p11519165417484">Array of Strings</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p2519754174819">Input parameters of the main class, that is, application parameters.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row47568717151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1620267012">sc_type</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p15211969014">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1222668011">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p14241762015">Compute resource type. Currently, resource types A, B, and C are available. If this parameter is not specified, the minimum configuration (type A) is used. For details about resource types, see <a href="#dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429">Table 3</a>.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row57481196151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1259614019">jars</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p6265617019">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p926765018">Array of Strings</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1729269015">Name of the package that is of the JAR type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b779035511509">obs://</strong><em id="dli_02_0124__i179116559501">Bucket name</em><strong id="dli_02_0124__b579111556504">/</strong><em id="dli_02_0124__i1179285505012">Package name</em>.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row58582582151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p2072111261753">pyFiles</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p172482381686">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p122491138782">Array of Strings</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p13251183811817">Name of the package that is of the PyFile type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b13679456175015">obs://</strong><em id="dli_02_0124__i186791256175013">Bucket name</em><strong id="dli_02_0124__b1367905625012">/</strong><em id="dli_02_0124__i268017568506">Package name</em>.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row1349812204465"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p4655202164617">files</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p265762113466">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p126581621164614">Array of Strings</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p265912124618">Name of the package that is of the file type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b20927135665020">obs://</strong><em id="dli_02_0124__i39271856155013">Bucket name</em><strong id="dli_02_0124__b092795617502">/</strong><em id="dli_02_0124__i149281560503">Package name</em>.</p>
</td>
</tr>
<tr id="dli_02_0124__row139937181292"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p0966333424">modules</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p149672331823">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p8967143313219">Array of Strings</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1596716338218">Name of the dependent system resource module. You can view the module name using the API related to <a href="dli_02_0172.html">Querying Resource Packages in a Group</a>.</p>
<div class="p" id="dli_02_0124__p231983472818">DLI provides dependencies for executing datasource jobs. The following table lists the dependency modules corresponding to different services.<ul id="dli_02_0124__ul863182613314"><li id="dli_02_0124__li1763926193110">CloudTable/MRS HBase: sys.datasource.hbase</li><li id="dli_02_0124__li1631426183116">CloudTable/MRS OpenTSDB: sys.datasource.opentsdb</li><li id="dli_02_0124__li206392643113">RDS MySQL: sys.datasource.rds</li><li id="dli_02_0124__li36362611311">RDS Postgre: preset</li><li id="dli_02_0124__li46319265318">DWS: preset</li><li id="dli_02_0124__li96372663114">CSS: sys.datasource.css</li></ul>
</div>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row13965716151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p20306616013">resources</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1130196707">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p831867011">Array of Objects</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p53236406">JSON object list, including the name and type of the JSON package that has been uploaded to the queue. For details, see <a href="#dli_02_0124__table31211426423">Table 4</a>.</p>
</td>
</tr>
<tr id="dli_02_0124__row11806152817332"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p14911912182916">groups</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p991111232912">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p9911712192920">Array of Objects</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1291161282919">JSON object list, including the package group resource. For details about the format, see the request example. If the type of the <span class="parmname" id="dli_02_0124__parmname6759125312019"><b>name</b></span> in <span class="parmname" id="dli_02_0124__parmname14290164720011"><b>resources</b></span> is not verified, the package with the name exists in the group. For details, see <a href="#dli_02_0124__table1212244016391">Table 5</a>.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row31377908151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p2679424131411">conf</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p9679152441416">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p480955018467">Object</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p106793241146"><strong id="dli_02_0124__b723815935913">Batch</strong> configuration item.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row1974423311228"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p19358384119">name</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p6921124161213">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p16351838111114">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p1351338101118">Batch processing task name. The value contains a maximum of 128 characters.</p>
</td>
</tr>
<tr id="dli_02_0124__row1856225185616"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p1872916192153">driverMemory</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p37291819191513">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p1072961910153">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p13731131971510">Driver memory of the Spark application, for example, <strong id="dli_02_0124__b913104616583">2 GB</strong> and <strong id="dli_02_0124__b10137164612587">2048 MB</strong>. This configuration item replaces the default parameter in <span class="parmname" id="dli_02_0124__parmname1920526137"><b>sc_type</b></span>. The unit must be provided. Otherwise, the startup fails.</p>
</td>
</tr>
<tr id="dli_02_0124__row556219518561"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p1873121915158">driverCores</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p473111199152">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p10731141910154">Integer</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p14731119101519">Number of CPU cores of the Spark application driver. This configuration item replaces the default parameter in <strong id="dli_02_0124__b842352706172957">sc_type</strong>.</p>
</td>
</tr>
<tr id="dli_02_0124__row25629514566"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p7731519131518">executorMemory</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p11731219141517">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p873151991511">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1073141910152">Executor memory of the Spark application, for example, <strong id="dli_02_0124__b1995145015581">2 GB</strong> and <strong id="dli_02_0124__b1610185017584">2048 MB</strong>. This configuration item replaces the default parameter in <span class="parmname" id="dli_02_0124__parmname2083683818515"><b>sc_type</b></span>. The unit must be provided. Otherwise, the startup fails.</p>
</td>
</tr>
<tr id="dli_02_0124__row10562175175616"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p19731819141510">executorCores</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p6731161911152">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p11731101919159">Integer</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p173111194155">Number of CPU cores of each Executor in the Spark application. This configuration item replaces the default parameter in <strong id="dli_02_0124__b216111168811">sc_type</strong>.</p>
</td>
</tr>
<tr id="dli_02_0124__row19563135114568"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p11657103111512">numExecutors</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p156571131161513">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p1657183112158">Integer</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p15657163113153">Number of Executors in a Spark application. This configuration item replaces the default parameter in <strong id="dli_02_0124__b487981306">sc_type</strong>.</p>
</td>
</tr>
<tr id="dli_02_0124__row93444526208"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p143445520209">obs_bucket</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p20344115212207">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p1434515215206">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p83451526207">OBS bucket for storing the Spark jobs. Set this parameter when you need to save jobs.</p>
</td>
</tr>
<tr id="dli_02_0124__row115382611461"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p145384664618">auto_recovery</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p1853917674613">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p14539106204614">Boolean</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p953906144618">Whether to enable the retry function. If enabled, Spark jobs will be automatically retried after an exception occurs. The default value is <strong id="dli_02_0124__b19261192713554">false</strong>.</p>
</td>
</tr>
<tr id="dli_02_0124__row13539146114617"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p1753918619465">max_retry_times</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p17539963467">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p145391863464">Integer</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p115394684613">Maximum retry times. The maximum value is <strong id="dli_02_0124__b10856173719552">100</strong>, and the default value is <strong id="dli_02_0124__b879794055516">20</strong>.</p>
</td>
</tr>
<tr id="dli_02_0124__row5290141873118"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p229041816318">catalog_name</p>
</td>
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p15291818143114">No</p>
</td>
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p82911318143115">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p142917188319">To access metadata, set this parameter to <strong id="dli_02_0124__b314882611411">dli</strong>.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429"></a><a name="en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Resource types</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row1656811816422"><th align="left" class="cellrowborder" valign="top" width="9.080000000000002%" id="mcps1.3.3.3.2.8.1.1"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p4558132410427">Resource Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="13.970000000000002%" id="mcps1.3.3.3.2.8.1.2"><p id="dli_02_0124__en-us_topic_0103343292_p6651820612">Physical Resource</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="13.660000000000002%" id="mcps1.3.3.3.2.8.1.3"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1656242494217">driverCores</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="16.300000000000004%" id="mcps1.3.3.3.2.8.1.4"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p9564192494215">executorCores</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="14.780000000000001%" id="mcps1.3.3.3.2.8.1.5"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p155668246423">driverMemory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="17.160000000000004%" id="mcps1.3.3.3.2.8.1.6"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p5570124184218">executorMemory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="15.050000000000002%" id="mcps1.3.3.3.2.8.1.7"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1357210241429">numExecutor</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row2056814184423"><td class="cellrowborder" valign="top" width="9.080000000000002%" headers="mcps1.3.3.3.2.8.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p35751124204210">A</p>
</td>
<td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.3.3.2.8.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_p106613203119">8 vCPUs, 32-GB memory</p>
</td>
<td class="cellrowborder" valign="top" width="13.660000000000002%" headers="mcps1.3.3.3.2.8.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1857717243428">2</p>
</td>
<td class="cellrowborder" valign="top" width="16.300000000000004%" headers="mcps1.3.3.3.2.8.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p105791243427">1</p>
</td>
<td class="cellrowborder" valign="top" width="14.780000000000001%" headers="mcps1.3.3.3.2.8.1.5 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1458242412426">7 GB</p>
</td>
<td class="cellrowborder" valign="top" width="17.160000000000004%" headers="mcps1.3.3.3.2.8.1.6 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p658562484219">4 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.050000000000002%" headers="mcps1.3.3.3.2.8.1.7 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p65871024164212">6</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row11568718144211"><td class="cellrowborder" valign="top" width="9.080000000000002%" headers="mcps1.3.3.3.2.8.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p65911024114213">B</p>
</td>
<td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.3.3.2.8.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_p633880217">16 vCPUs, 64-GB memory</p>
</td>
<td class="cellrowborder" valign="top" width="13.660000000000002%" headers="mcps1.3.3.3.2.8.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p20592624134213">2</p>
</td>
<td class="cellrowborder" valign="top" width="16.300000000000004%" headers="mcps1.3.3.3.2.8.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p13594202411428">2</p>
</td>
<td class="cellrowborder" valign="top" width="14.780000000000001%" headers="mcps1.3.3.3.2.8.1.5 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1859632413429">7 GB</p>
</td>
<td class="cellrowborder" valign="top" width="17.160000000000004%" headers="mcps1.3.3.3.2.8.1.6 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p19599324114218">8 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.050000000000002%" headers="mcps1.3.3.3.2.8.1.7 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p2602124164215">7</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row45681518114212"><td class="cellrowborder" valign="top" width="9.080000000000002%" headers="mcps1.3.3.3.2.8.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1760622434216">C</p>
</td>
<td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.3.3.2.8.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_p19794198826">32 vCPUs, 128-GB memory</p>
</td>
<td class="cellrowborder" valign="top" width="13.660000000000002%" headers="mcps1.3.3.3.2.8.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p18608524104211">4</p>
</td>
<td class="cellrowborder" valign="top" width="16.300000000000004%" headers="mcps1.3.3.3.2.8.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p6609152415425">2</p>
</td>
<td class="cellrowborder" valign="top" width="14.780000000000001%" headers="mcps1.3.3.3.2.8.1.5 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p8611224204210">15 GB</p>
</td>
<td class="cellrowborder" valign="top" width="17.160000000000004%" headers="mcps1.3.3.3.2.8.1.6 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p10614124134214">8 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.050000000000002%" headers="mcps1.3.3.3.2.8.1.7 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p161532410428">14</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dli_02_0124__table31211426423"></a><a name="table31211426423"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__table31211426423" frame="border" border="1" rules="all"><caption><b>Table 4 </b><strong id="dli_02_0124__b1998058286113723">resources</strong> parameters</caption><thead align="left"><tr id="dli_02_0124__row1413164210425"><th align="left" class="cellrowborder" valign="top" width="17.130000000000003%" id="mcps1.3.3.4.2.5.1.1"><p id="dli_02_0124__p10136427425">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="26.35%" id="mcps1.3.3.4.2.5.1.2"><p id="dli_02_0124__p0131142124214">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="25.77%" id="mcps1.3.3.4.2.5.1.3"><p id="dli_02_0124__p1313164213421">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="30.75%" id="mcps1.3.3.4.2.5.1.4"><p id="dli_02_0124__p161304213425">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__row1913042124211"><td class="cellrowborder" valign="top" width="17.130000000000003%" headers="mcps1.3.3.4.2.5.1.1 "><p id="dli_02_0124__p81314422426">name</p>
</td>
<td class="cellrowborder" valign="top" width="26.35%" headers="mcps1.3.3.4.2.5.1.2 "><p id="dli_02_0124__p1713144214218">No</p>
</td>
<td class="cellrowborder" valign="top" width="25.77%" headers="mcps1.3.3.4.2.5.1.3 "><p id="dli_02_0124__p113144214427">String</p>
</td>
<td class="cellrowborder" valign="top" width="30.75%" headers="mcps1.3.3.4.2.5.1.4 "><p id="dli_02_0124__p161314426427">Resource name You can also specify an OBS path, for example, <strong id="dli_02_0124__b3266641145116">obs://</strong><em id="dli_02_0124__i427115415519">Bucket name</em><strong id="dli_02_0124__b15271104116515">/</strong><em id="dli_02_0124__i4271941165116">Package name</em>.</p>
</td>
</tr>
<tr id="dli_02_0124__row71304214423"><td class="cellrowborder" valign="top" width="17.130000000000003%" headers="mcps1.3.3.4.2.5.1.1 "><p id="dli_02_0124__p1813194214429">type</p>
</td>
<td class="cellrowborder" valign="top" width="26.35%" headers="mcps1.3.3.4.2.5.1.2 "><p id="dli_02_0124__p1414042114216">No</p>
</td>
<td class="cellrowborder" valign="top" width="25.77%" headers="mcps1.3.3.4.2.5.1.3 "><p id="dli_02_0124__p161444224217">String</p>
</td>
<td class="cellrowborder" valign="top" width="30.75%" headers="mcps1.3.3.4.2.5.1.4 "><p id="dli_02_0124__p1214042144220">Resource type.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dli_02_0124__table1212244016391"></a><a name="table1212244016391"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__table1212244016391" frame="border" border="1" rules="all"><caption><b>Table 5 </b><strong id="dli_02_0124__b14685192920115">groups</strong> parameters</caption><thead align="left"><tr id="dli_02_0124__row7123164093915"><th align="left" class="cellrowborder" valign="top" width="13.969999999999999%" id="mcps1.3.3.5.2.5.1.1"><p id="dli_02_0124__p28418154407">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="15.27%" id="mcps1.3.3.5.2.5.1.2"><p id="dli_02_0124__p118410151401">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.740000000000002%" id="mcps1.3.3.5.2.5.1.3"><p id="dli_02_0124__p14841315124018">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="52.019999999999996%" id="mcps1.3.3.5.2.5.1.4"><p id="dli_02_0124__p118431511400">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__row1612415402393"><td class="cellrowborder" valign="top" width="13.969999999999999%" headers="mcps1.3.3.5.2.5.1.1 "><p id="dli_02_0124__p11311532134319">name</p>
</td>
<td class="cellrowborder" valign="top" width="15.27%" headers="mcps1.3.3.5.2.5.1.2 "><p id="dli_02_0124__p63111332104314">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.740000000000002%" headers="mcps1.3.3.5.2.5.1.3 "><p id="dli_02_0124__p1731219324431">String</p>
</td>
<td class="cellrowborder" valign="top" width="52.019999999999996%" headers="mcps1.3.3.5.2.5.1.4 "><p id="dli_02_0124__p6892534134419">User group name</p>
</td>
</tr>
<tr id="dli_02_0124__row111251404396"><td class="cellrowborder" valign="top" width="13.969999999999999%" headers="mcps1.3.3.5.2.5.1.1 "><p id="dli_02_0124__p031217328439">resources</p>
</td>
<td class="cellrowborder" valign="top" width="15.27%" headers="mcps1.3.3.5.2.5.1.2 "><p id="dli_02_0124__p531253224317">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.740000000000002%" headers="mcps1.3.3.5.2.5.1.3 "><p id="dli_02_0124__p16312113294318">Array of Objects</p>
</td>
<td class="cellrowborder" valign="top" width="52.019999999999996%" headers="mcps1.3.3.5.2.5.1.4 "><p id="dli_02_0124__p152845004411">User group resource For details, see <a href="#dli_02_0124__table31211426423">Table 4</a>.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_sd1ecb66580054b2ea403be8b2272a2c7"><h4 class="sectiontitle">Response</h4>
<div class="tablenoborder"><a name="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_table1391425172812"></a><a name="en-us_topic_0103343302_en-us_topic_0102902523_table1391425172812"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_table1391425172812" frame="border" border="1" rules="all"><caption><b>Table 6 </b>Response parameters</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_row239272520282"><th align="left" class="cellrowborder" valign="top" width="13.970000000000002%" id="mcps1.3.4.2.2.5.1.1"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p73934250283">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="11.870000000000001%" id="mcps1.3.4.2.2.5.1.2"><p id="dli_02_0124__p1874917140152">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.28%" id="mcps1.3.4.2.2.5.1.3"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p93931525182819">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="55.88000000000001%" id="mcps1.3.4.2.2.5.1.4"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p339412542814">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_row30137760152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p49479537152012">id</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p5749111412154">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p48419590152012">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p29672740152012">ID of a batch processing job.</p>
</td>
</tr>
<tr id="dli_02_0124__row1715520461916"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p53400622152012">appId</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p175091410153">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p30483143152012">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p53215488152012">Back-end application ID of a batch processing job.</p>
</td>
</tr>
<tr id="dli_02_0124__row12104169121916"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p1093121011518">name</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p1693111105515">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p1893119108518">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p11931510256">Batch processing task name. The value contains a maximum of 128 characters.</p>
</td>
</tr>
<tr id="dli_02_0124__row284815473574"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p9567203491719">owner</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p971613132910">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p856703421714">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1556713421713">Owner of a batch processing job.</p>
</td>
</tr>
<tr id="dli_02_0124__row10710796586"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p85671734141718">proxyUser</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p071791122914">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p13567183431711">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p6567133420178">Proxy user (resource tenant) to which a batch processing job belongs.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row40631342152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p22373378152012">state</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p1750314181515">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p304348152012">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p24652218152012">Status of a batch processing job. For details, see <a href="#dli_02_0124__en-us_topic_0103343302_table16701351161919">Table 7</a>.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row64166917152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p1667115691116">kind</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p471712117295">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p556793417178">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p65676340174">Type of a batch processing job. Only Spark parameters are supported.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row57958994152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p61787004152012">log</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p475051411159">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p38691391152012">Array of strings</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__en-us_topic_0103343302_p46995004152012">Last 10 records of the current batch processing job.</p>
</td>
</tr>
<tr id="dli_02_0124__row174513588123"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p41226725615">sc_type</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p14750101491511">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p412210718560">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p580458205614">Type of a computing resource. If the computing resource type is customized, value <strong id="dli_02_0124__b65481362615">CUSTOMIZED</strong> is returned.</p>
</td>
</tr>
<tr id="dli_02_0124__row2667120171313"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p8993199175614">cluster_name</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p5750161414153">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p4993999566">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p1099316912566">Queue where a batch processing job is located.</p>
</td>
</tr>
<tr id="dli_02_0124__row1393123914012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p129317396016">queue</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p69917153316">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p16996151310">String</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p29991517312">Queue name. Set this parameter to the name of the created DLI queue.</p>
<div class="note" id="dli_02_0124__note149981515312"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_02_0124__ul1999315636"><li id="dli_02_0124__li13997151537">This parameter is compatible with the <strong id="dli_02_0124__b1655438911">cluster_name</strong> parameter. That is, if <strong id="dli_02_0124__b1651639888">cluster_name</strong> is used to specify a queue, the queue is still valid.</li><li id="dli_02_0124__li59912151030">You are advised to use the <strong id="dli_02_0124__b38761467425">queue</strong> parameter. The <strong id="dli_02_0124__b38811267429">queue</strong> and <strong id="dli_02_0124__b7882146184213">cluster_name</strong> parameters cannot coexist.</li></ul>
</div></div>
</td>
</tr>
<tr id="dli_02_0124__row47742308113823"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p41921755113823">create_time</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p47501914151513">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p40219023113823">Long</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p36515431113823">Time when a batch processing job is created. The timestamp is expressed in milliseconds.</p>
</td>
</tr>
<tr id="dli_02_0124__row1542185572918"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p1954285562913">update_time</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p115431555122913">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p45437552294">Long</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p19543145512915">Time when a batch processing job is updated. The timestamp is expressed in milliseconds.</p>
</td>
</tr>
<tr id="dli_02_0124__row17132185716314"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p32369184237">duration</p>
</td>
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p323681852313">No</p>
</td>
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p12236918162310">Long</p>
</td>
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p923731815236">Job running duration (unit: millisecond)</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dli_02_0124__en-us_topic_0103343302_table16701351161919"></a><a name="en-us_topic_0103343302_table16701351161919"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_table16701351161919" frame="border" border="1" rules="all"><caption><b>Table 7 </b>Batch processing job statuses</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_row1670615114198"><th align="left" class="cellrowborder" valign="top" width="19.8%" id="mcps1.3.4.3.2.4.1.1"><p id="dli_02_0124__en-us_topic_0103343302_p97084513196">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="11.76%" id="mcps1.3.4.3.2.4.1.2"><p id="dli_02_0124__en-us_topic_0103343302_p1271095120195">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="68.44%" id="mcps1.3.4.3.2.4.1.3"><p id="dli_02_0124__en-us_topic_0103343302_p20711105141911">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_row11712165171920"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p75311359151918">starting</p>
</td>
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p2024084872012">String</p>
</td>
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p353325971910">The batch processing job is being started.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row471945112192"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p155363596193">running</p>
</td>
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p924064814204">String</p>
</td>
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p15386594193">The batch processing job is executing a task.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row1972725120192"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p1054119599194">dead</p>
</td>
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p1523811485203">String</p>
</td>
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p1754365915191">The batch processing job has exited.</p>
</td>
</tr>
<tr id="dli_02_0124__en-us_topic_0103343302_row1973445112193"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p115451559101920">success</p>
</td>
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p162373486205">String</p>
</td>
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p18547959161910">The batch processing job is successfully executed.</p>
</td>
</tr>
<tr id="dli_02_0124__row124898049219"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__p4871875792112">recovering</p>
</td>
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__p5390521192112">String</p>
</td>
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__p579570539219">The batch processing job is being restored.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_02_0124__section1217010661112"><h4 class="sectiontitle">Example Request</h4><p id="dli_02_0124__p8896124319415">Create a Spark job. Set the Spark main class of the job to <strong id="dli_02_0124__b1630091315559">org.apache.spark.examples.SparkPi</strong>, specify the program package to <strong id="dli_02_0124__b14449235135518">batchTest/spark-examples_2.11-2.1.0.luxor.jar</strong>, and load the program package whose type is <strong id="dli_02_0124__b1390522101016">jar</strong> and the resource package whose type is <strong id="dli_02_0124__b43014373103">files</strong>.</p>
<pre class="screen" id="dli_02_0124__en-us_topic_0103343302_screen706141715215">{
"file": "batchTest/spark-examples_2.11-2.1.0.luxor.jar",
"className": "org.apache.spark.examples.SparkPi",
"sc_type": "A",
"jars": ["demo-1.0.0.jar"],
"files": ["count.txt"],
"resources":[
{"name": "groupTest/testJar.jar", "type": "jar"},
{"name": "kafka-clients-0.10.0.0.jar", "type": "jar"}],
"groups": [
{"name": "groupTestJar", "resources": [{"name": "testJar.jar", "type": "jar"}, {"name": "testJar1.jar", "type": "jar"}]},
{"name": "batchTest", "resources": [{"name": "luxor.jar", "type": "jar"}]}],
"queue": " test",
"name": "TestDemo4"
}</pre>
<div class="note" id="dli_02_0124__en-us_topic_0103343302_note48113336152111"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_02_0124__en-us_topic_0103343302_p58663258152128">The <strong id="dli_02_0124__b19369555268">batchTest/spark-examples_2.11-2.1.0.luxor.jar</strong> file has been uploaded through API involved in <a href="dli_02_0130.html">Uploading a Package Group</a>.</p>
</div></div>
</div>
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_section17446171164041"><h4 class="sectiontitle">Example Response</h4><pre class="screen" id="dli_02_0124__en-us_topic_0103343302_screen63729817152224">{
"id": "07a3e4e6-9a28-4e92-8d3f-9c538621a166",
"appId": "",
"name": "",
"owner": "test1",
"proxyUser": "",
"state": "starting",
"kind": "",
"log": [],
"sc_type": "CUSTOMIZED",
"cluster_name": "aaa",
"queue": "aaa",
"create_time": 1607589874156,
"update_time": 1607589874156
}</pre>
</div>
<div class="section" id="dli_02_0124__sf39cfd445ad24e9e82754fcb0027179d"><h4 class="sectiontitle">Status Codes</h4><p id="dli_02_0124__a04144ca3a08e4576b386c6a98f43a2ae"><a href="#dli_02_0124__tb12870f1c5f24b27abd55ca24264af36">Table 8</a> describes the status code.</p>
<div class="tablenoborder"><a name="dli_02_0124__tb12870f1c5f24b27abd55ca24264af36"></a><a name="tb12870f1c5f24b27abd55ca24264af36"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__tb12870f1c5f24b27abd55ca24264af36" frame="border" border="1" rules="all"><caption><b>Table 8 </b>Status code</caption><thead align="left"><tr id="dli_02_0124__r8d54231f95b14c01a5e55e95f3b2e838"><th align="left" class="cellrowborder" valign="top" width="30%" id="mcps1.3.7.3.2.3.1.1"><p id="dli_02_0124__ab49d21f312644072a331f43e92baf853">Status Code</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="70%" id="mcps1.3.7.3.2.3.1.2"><p id="dli_02_0124__aea1d3bd107bb4c499da79a88832d256c">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_02_0124__r211ad4eb571d4d938e5579998723174e"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_02_0124__a3153e07b3a9749adba92599fe6628fbf">200</p>
</td>
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_02_0124__p104431642124811">The job is created successfully.</p>
</td>
</tr>
<tr id="dli_02_0124__row44937531727"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_02_0124__p184941532219">400</p>
</td>
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_02_0124__p2049413539219">Request error.</p>
</td>
</tr>
<tr id="dli_02_0124__row65331212142411"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_02_0124__p5537171216249">500</p>
</td>
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_02_0124__p953813124249">Internal service error.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_02_0124__section13596141025715"><h4 class="sectiontitle">Error Codes</h4><p id="dli_02_0124__p420584425712">If an error occurs when this API is invoked, the system does not return the result similar to the preceding example, but returns the error code and error information. For details, see <a href="dli_02_0056.html">Error Codes</a>.</p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_02_0162.html">Batch Processing-related APIs</a></div>
</div>
</div>
View Git Blame Copy Permalink