forked from docs/doc-exports
dli_umn_20240430
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com> Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
This commit is contained in:
parent
bc47653338
commit
12dd64efc7
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -8,7 +8,13 @@
|
|||||||
</th>
|
</th>
|
||||||
</tr>
|
</tr>
|
||||||
</thead>
|
</thead>
|
||||||
<tbody><tr id="dli_01_00006__row4248101042"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p14248407419">2024-02-27</p>
|
<tbody><tr id="dli_01_00006__row1340918386143"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p10168134117141">2024-04-28</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p181681241101413">Added the following section:</p>
|
||||||
|
<ul id="dli_01_00006__ul416812413143"><li id="dli_01_00006__li11168134151414"><a href="dli_01_0508.html">Elastic Resource Pool</a></li></ul>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_00006__row4248101042"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p14248407419">2024-02-27</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p752534712233">Added the following content:</p>
|
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p752534712233">Added the following content:</p>
|
||||||
<ul id="dli_01_00006__ul1052694717232"><li id="dli_01_00006__li45262474232">Added Spark 3.1.1 dependencies to <a href="dli_01_0397.html">Built-in Dependencies</a>.</li></ul>
|
<ul id="dli_01_00006__ul1052694717232"><li id="dli_01_00006__li45262474232">Added Spark 3.1.1 dependencies to <a href="dli_01_0397.html">Built-in Dependencies</a>.</li></ul>
|
||||||
|
@ -22,8 +22,8 @@
|
|||||||
</div></div>
|
</div></div>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0002__section10742144985011"><a name="dli_01_0002__section10742144985011"></a><a name="section10742144985011"></a><h4 class="sectiontitle">Step 2: Create a Queue</h4><p id="dli_01_0002__p313914434915">A queue is the basis for using DLI. Before executing an SQL job, you need to create a queue.</p>
|
<div class="section" id="dli_01_0002__section10742144985011"><a name="dli_01_0002__section10742144985011"></a><a name="section10742144985011"></a><h4 class="sectiontitle">Step 2: Create a Queue</h4><p id="dli_01_0002__p313914434915">A queue is the basis for using DLI. Before executing a SQL job, you need to create a queue.</p>
|
||||||
<ul id="dli_01_0002__ul17202247195010"><li id="dli_01_0002__li131931114812">An available queue <span class="parmvalue" id="dli_01_0002__parmvalue1369741014488"><b>default</b></span> is preset in DLI.</li><li id="dli_01_0002__li1131916110481">You can also create queues as needed.<ol id="dli_01_0002__ol15578144671515"><li id="dli_01_0002__li13332820164119">Log in to the DLI management console.</li><li id="dli_01_0002__li2578546131517">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b16611756192915">SQL Editor</strong>.</li><li id="dli_01_0002__li844914584169">On the left pane, select the <strong id="dli_01_0002__b8902351334">Queues</strong> tab, and click <span><img id="dli_01_0002__image17450135891614" src="en-us_image_0276441461.png"></span> next to <strong id="dli_01_0002__b1478271612">Queues</strong>.<p id="dli_01_0002__p17288510177">For details, see Creating a Queue.</p>
|
<ul id="dli_01_0002__ul17202247195010"><li id="dli_01_0002__li131931114812">DLI provides a preconfigured queue named <span class="parmvalue" id="dli_01_0002__parmvalue1369741014488"><b>default</b></span>.</li><li id="dli_01_0002__li1131916110481">You can also create queues as needed.<ol id="dli_01_0002__ol15578144671515"><li id="dli_01_0002__li13332820164119">Log in to the DLI management console.</li><li id="dli_01_0002__li2578546131517">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b16611756192915">SQL Editor</strong>.</li><li id="dli_01_0002__li844914584169">On the left pane, select the <strong id="dli_01_0002__b1816662911214">Queues</strong> tab, and click <span><img id="dli_01_0002__image9166122918218" src="en-us_image_0276441461.png"></span> next to <strong id="dli_01_0002__b101676291028">Queues</strong>.<p id="dli_01_0002__p17288510177">For details, see Creating a Queue.</p>
|
||||||
<p id="dli_01_0002__p8128252161516"></p>
|
<p id="dli_01_0002__p8128252161516"></p>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
@ -32,7 +32,7 @@
|
|||||||
<div class="note" id="dli_01_0002__note23711139194010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p143724399404">The <strong id="dli_01_0002__b842352706172053">default</strong> database is a built-in database. You cannot create the <strong id="dli_01_0002__b842352706172112">default</strong>. database.</p>
|
<div class="note" id="dli_01_0002__note23711139194010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p143724399404">The <strong id="dli_01_0002__b842352706172053">default</strong> database is a built-in database. You cannot create the <strong id="dli_01_0002__b842352706172112">default</strong>. database.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b124165381758">SQL Editor</strong>.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
|
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b124165381758">SQL Editor</strong>.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
|
||||||
<p id="dli_01_0002__p38732969153456">After the database is successfully created, click <span><img id="dli_01_0002__image147095116392" src="en-us_image_0000001597283981.png"></span> in the middle pane to refresh the database list. The new database <strong id="dli_01_0002__b58200197711">db1</strong> is displayed in the list.</p>
|
<p id="dli_01_0002__p38732969153456">After the database is successfully created, click <span><img id="dli_01_0002__image19325658315" src="en-us_image_0000001597283981.png"></span> in the middle pane to refresh the database list. The new database <strong id="dli_01_0002__b19326254319">db1</strong> is displayed in the list.</p>
|
||||||
<div class="note" id="dli_01_0002__note108505219593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p1862192165910">When you execute a query on the DLI management console for the first time, you need to read the privacy agreement. You can perform operations only after you agree to the agreement. For later queries, you will not need to read the privacy agreement again.</p>
|
<div class="note" id="dli_01_0002__note108505219593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p1862192165910">When you execute a query on the DLI management console for the first time, you need to read the privacy agreement. You can perform operations only after you agree to the agreement. For later queries, you will not need to read the privacy agreement again.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
|
@ -11,7 +11,7 @@
|
|||||||
<div class="section" id="dli_01_0005__section48771856376"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0005__ul01386356549"><li id="dli_01_0005__li20138635205415">If a folder and a file have the same name in the OBS directory, the file path is preferred as the path of the OBS table to be created.</li></ul>
|
<div class="section" id="dli_01_0005__section48771856376"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0005__ul01386356549"><li id="dli_01_0005__li20138635205415">If a folder and a file have the same name in the OBS directory, the file path is preferred as the path of the OBS table to be created.</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0005__section103093597569"><h4 class="sectiontitle">Creating a Database</h4><ol id="dli_01_0005__ol3050391101556"><li id="dli_01_0005__li2078303115103"><span>You can create a database on either the <span class="wintitle" id="dli_01_0005__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0005__wintitle1059923363164013"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0005__ul13952860151010"><li id="dli_01_0005__li20669721151337">To create a database on the <span class="wintitle" id="dli_01_0005__wintitle4564762181553"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0005__ol65658627151340"><li id="dli_01_0005__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0005__uicontrol1560222714517"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0005__uicontrol0608112713457"><b>Databases and Tables</b></span>.</li><li id="dli_01_0005__li29714355165922">In the upper right corner of the <strong id="dli_01_0005__b14592195513166">Databases and Tables</strong> page, click <strong id="dli_01_0005__b18598155518162">Create Database</strong> to create a database.</li></ol>
|
<div class="section" id="dli_01_0005__section103093597569"><h4 class="sectiontitle">Creating a Database</h4><ol id="dli_01_0005__ol3050391101556"><li id="dli_01_0005__li2078303115103"><span>You can create a database on either the <span class="wintitle" id="dli_01_0005__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0005__wintitle1059923363164013"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0005__ul13952860151010"><li id="dli_01_0005__li20669721151337">To create a database on the <span class="wintitle" id="dli_01_0005__wintitle4564762181553"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0005__ol65658627151340"><li id="dli_01_0005__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0005__uicontrol1560222714517"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0005__uicontrol0608112713457"><b>Databases and Tables</b></span>.</li><li id="dli_01_0005__li29714355165922">In the upper right corner of the <strong id="dli_01_0005__b14592195513166">Databases and Tables</strong> page, click <strong id="dli_01_0005__b18598155518162">Create Database</strong> to create a database.</li></ol>
|
||||||
</li><li id="dli_01_0005__li10384371151118">To create a database on the <span class="wintitle" id="dli_01_0005__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0005__ol39382464151459"><li id="dli_01_0005__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0005__uicontrol1481531519315"><b>SQL Editor</b></span>.</li><li id="dli_01_0005__li1773513617043">In the navigation pane on the left, click <span><img id="dli_01_0005__image654613242326" src="en-us_image_0237539077.png"></span> beside <strong id="dli_01_0005__b8303205915164">Databases</strong>.</li></ol>
|
</li><li id="dli_01_0005__li10384371151118">To create a database on the <span class="wintitle" id="dli_01_0005__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0005__ol39382464151459"><li id="dli_01_0005__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0005__uicontrol1481531519315"><b>SQL Editor</b></span>.</li><li id="dli_01_0005__li1773513617043">In the navigation pane on the left, click <span><img id="dli_01_0005__image95771733142112" src="en-us_image_0237539077.png"></span> next to <strong id="dli_01_0005__b5577733102116">Databases</strong>.</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</p></li><li id="dli_01_0005__li66896638102224"><span>In the displayed <span class="wintitle" id="dli_01_0005__wintitle129565131811"><b>Create Database</b></span> dialog box, specify <strong id="dli_01_0005__b1230118521815">Name</strong> and <strong id="dli_01_0005__b130145161811">Description</strong> by referring to <a href="#dli_01_0005__table055917491187">Table 1</a>.</span><p>
|
</p></li><li id="dli_01_0005__li66896638102224"><span>In the displayed <span class="wintitle" id="dli_01_0005__wintitle129565131811"><b>Create Database</b></span> dialog box, specify <strong id="dli_01_0005__b1230118521815">Name</strong> and <strong id="dli_01_0005__b130145161811">Description</strong> by referring to <a href="#dli_01_0005__table055917491187">Table 1</a>.</span><p>
|
||||||
<div class="tablenoborder"><a name="dli_01_0005__table055917491187"></a><a name="table055917491187"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0005__table055917491187" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Description</caption><thead align="left"><tr id="dli_01_0005__row12558124921818"><th align="left" class="cellrowborder" valign="top" width="15.290000000000001%" id="mcps1.3.3.2.2.2.1.2.3.1.1"><p id="dli_01_0005__p12558144931813">Parameter</p>
|
<div class="tablenoborder"><a name="dli_01_0005__table055917491187"></a><a name="table055917491187"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0005__table055917491187" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Description</caption><thead align="left"><tr id="dli_01_0005__row12558124921818"><th align="left" class="cellrowborder" valign="top" width="15.290000000000001%" id="mcps1.3.3.2.2.2.1.2.3.1.1"><p id="dli_01_0005__p12558144931813">Parameter</p>
|
||||||
@ -40,7 +40,7 @@
|
|||||||
<ul id="dli_01_0005__ul55819552289"><li id="dli_01_0005__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0005__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0005__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0005__ul55819552289"><li id="dli_01_0005__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0005__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0005__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0005__ul16911451899"><li id="dli_01_0005__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0005__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0005__ul16911451899"><li id="dli_01_0005__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0005__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
@ -52,10 +52,10 @@
|
|||||||
</p></li></ol>
|
</p></li></ol>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0005__section46221651175510"><h4 class="sectiontitle">Creating a Table</h4><p id="dli_01_0005__p56362480175534">Before creating a table, ensure that a database has been created.</p>
|
<div class="section" id="dli_01_0005__section46221651175510"><h4 class="sectiontitle">Creating a Table</h4><p id="dli_01_0005__p56362480175534">Before creating a table, ensure that a database has been created.</p>
|
||||||
<ol id="dli_01_0005__ol12637600103738"><li id="dli_01_0005__li59972234153426"><span>You can create a table on either the <span class="wintitle" id="dli_01_0005__wintitle280732842"><b>Databases and Tables</b></span> page or the <span class="wintitle" id="dli_01_0005__wintitle1052158451"><b>SQL Editor</b></span> page.</span><p><div class="note" id="dli_01_0005__note159813598457"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0005__p4599175984510">Datasource connection tables, such as View tables, HBase (MRS) tables, OpenTSDB (MRS) tables, DWS tables, RDS tables, and CSS tables, cannot be created. You can use SQL to create views and datasource connection tables. For details, see sections <strong id="dli_01_0005__b168941558103516">Creating a View</strong> and <strong id="dli_01_0005__b1989435873520">Creating a Datasource Connection Table</strong> in the <em id="dli_01_0005__i12894358133518">Data Lake Insight SQL Syntax Reference</em>.</p>
|
<ol id="dli_01_0005__ol12637600103738"><li id="dli_01_0005__li59972234153426"><span>You can create a table on either the <span class="wintitle" id="dli_01_0005__wintitle1376768905"><b>Databases and Tables</b></span> page or the <span class="wintitle" id="dli_01_0005__wintitle1088857340"><b>SQL Editor</b></span> page.</span><p><div class="note" id="dli_01_0005__note159813598457"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0005__p4599175984510">Datasource connection tables, such as View tables, HBase (MRS) tables, OpenTSDB (MRS) tables, GaussDB(DWS) tables, RDS tables, and CSS tables, cannot be created. You can use SQL to create views and datasource connection tables. For details, see sections <strong id="dli_01_0005__b168941558103516">Creating a View</strong> and <strong id="dli_01_0005__b1989435873520">Creating a Datasource Connection Table</strong> in the <em id="dli_01_0005__i12894358133518">Data Lake Insight SQL Syntax Reference</em>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
<ul id="dli_01_0005__ul22405571153537"><li id="dli_01_0005__li323555153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle412318792"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0005__ol2911995153537"><li id="dli_01_0005__li26207957153537">On the left of the management console, choose <span class="uicontrol" id="dli_01_0005__uicontrol1559686145"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0005__uicontrol8597462415"><b>Databases and Tables</b></span>.</li><li id="dli_01_0005__li17500832153537">On the <strong id="dli_01_0005__b1211154675314">Databases and Tables</strong> page, select the database for which you want to create a table. In the <strong id="dli_01_0005__b10345811102717">Operation</strong> column, click <strong id="dli_01_0005__b12918326165019">More</strong> > <strong id="dli_01_0005__b63873822719">Create Table</strong> to create a table in the current database.</li></ol>
|
<ul id="dli_01_0005__ul22405571153537"><li id="dli_01_0005__li323555153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle1461587218"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0005__ol2911995153537"><li id="dli_01_0005__li26207957153537">On the left of the management console, choose <span class="uicontrol" id="dli_01_0005__uicontrol1559686145"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0005__uicontrol8597462415"><b>Databases and Tables</b></span>.</li><li id="dli_01_0005__li17500832153537">On the <strong id="dli_01_0005__b1211154675314">Databases and Tables</strong> page, select the database for which you want to create a table. In the <strong id="dli_01_0005__b10345811102717">Operation</strong> column, click <strong id="dli_01_0005__b12918326165019">More</strong> > <strong id="dli_01_0005__b63873822719">Create Table</strong> to create a table in the current database.</li></ol>
|
||||||
</li><li id="dli_01_0005__li8281288153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle8700317181735"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0005__ol7422733153537"><li id="dli_01_0005__li66804605153537">On the left of the management console, click <span class="uicontrol" id="dli_01_0005__uicontrol11208161745"><b>SQL Editor</b></span>.</li><li id="dli_01_0005__li17512154252514">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0005__wintitle13614162313185"><b>SQL Editor</b></span> page, click <strong id="dli_01_0005__b4615162311183">Databases</strong>. You can create a table in either of the following ways:<ul id="dli_01_0005__ul782474512255"><li id="dli_01_0005__li1893119202619">Click a database name. In the <strong id="dli_01_0005__b11582159133716">Tables</strong> area, click <span><img id="dli_01_0005__image15644111617506" src="en-us_image_0237539075.png"></span> on the right to create a table in the current database.</li><li id="dli_01_0005__li16824154518252">Click <span><img id="dli_01_0005__image1322473935113" src="en-us_image_0237532018.png"></span> on the right of the database and choose <strong id="dli_01_0005__b135378142190">Create Table</strong> from the shortcut menu to create a table in the current database.</li></ul>
|
</li><li id="dli_01_0005__li8281288153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle8700317181735"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0005__ol7422733153537"><li id="dli_01_0005__li66804605153537">On the left of the management console, click <span class="uicontrol" id="dli_01_0005__uicontrol11208161745"><b>SQL Editor</b></span>.</li><li id="dli_01_0005__li17512154252514">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0005__wintitle13614162313185"><b>SQL Editor</b></span> page, click <strong id="dli_01_0005__b4615162311183">Databases</strong>. You can create a table in either of the following ways:<ul id="dli_01_0005__ul782474512255"><li id="dli_01_0005__li1893119202619">Click a database name. In the <strong id="dli_01_0005__b5326151882218">Tables</strong> area, click <span><img id="dli_01_0005__image8327018142210" src="en-us_image_0237539075.png"></span> on the right to create a table in the current database.</li><li id="dli_01_0005__li16824154518252">Click <span><img id="dli_01_0005__image33241729102220" src="en-us_image_0237532018.png"></span> on the right of the database and choose <strong id="dli_01_0005__b1325182917220">Create Table</strong> from the shortcut menu to create a table in the current database.</li></ul>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</p></li><li id="dli_01_0005__li2983192765420"><span>In the displayed <span class="wintitle" id="dli_01_0005__wintitle2984132785410"><b>Create Table</b></span> dialog box, set parameters as required.</span><p><ul id="dli_01_0005__ul6129151205515"><li id="dli_01_0005__li71297116557">If you set <strong id="dli_01_0005__b1708742961">Data Location</strong> to <strong id="dli_01_0005__b870916421367">DLI</strong>, set related parameters by referring to <a href="#dli_01_0005__table34159998103738">Table 2</a>.</li><li id="dli_01_0005__li8260111018554">If you set <strong id="dli_01_0005__b8655184917328">Data Location</strong> to <strong id="dli_01_0005__b4657849163216">OBS</strong>, set related parameters by referring to <a href="#dli_01_0005__table34159998103738">Table 2</a> and <a href="#dli_01_0005__table1913602718314">Table 3</a>.
|
</p></li><li id="dli_01_0005__li2983192765420"><span>In the displayed <span class="wintitle" id="dli_01_0005__wintitle2984132785410"><b>Create Table</b></span> dialog box, set parameters as required.</span><p><ul id="dli_01_0005__ul6129151205515"><li id="dli_01_0005__li71297116557">If you set <strong id="dli_01_0005__b1708742961">Data Location</strong> to <strong id="dli_01_0005__b870916421367">DLI</strong>, set related parameters by referring to <a href="#dli_01_0005__table34159998103738">Table 2</a>.</li><li id="dli_01_0005__li8260111018554">If you set <strong id="dli_01_0005__b8655184917328">Data Location</strong> to <strong id="dli_01_0005__b4657849163216">OBS</strong>, set related parameters by referring to <a href="#dli_01_0005__table34159998103738">Table 2</a> and <a href="#dli_01_0005__table1913602718314">Table 3</a>.
|
||||||
@ -108,7 +108,7 @@
|
|||||||
<tr id="dli_01_0005__row16943758105944"><td class="cellrowborder" valign="top" width="14.38%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.1 "><p id="dli_01_0005__p30267119105944">Type</p>
|
<tr id="dli_01_0005__row16943758105944"><td class="cellrowborder" valign="top" width="14.38%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.1 "><p id="dli_01_0005__p30267119105944">Type</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="71.45%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.2 "><p id="dli_01_0005__p35717569105944">Data type of a column. This parameter corresponds to <span class="parmname" id="dli_01_0005__parmname4155795592938"><b>Column Name</b></span>.</p>
|
<td class="cellrowborder" valign="top" width="71.45%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.2 "><p id="dli_01_0005__p35717569105944">Data type of a column. This parameter corresponds to <span class="parmname" id="dli_01_0005__parmname4155795592938"><b>Column Name</b></span>.</p>
|
||||||
<ul id="dli_01_0005__ul2957726293032"><li id="dli_01_0005__li159154616209"><strong id="dli_01_0005__b12861523131117">string</strong>: The data is of the string type.</li><li id="dli_01_0005__li5035776893042"><strong id="dli_01_0005__b84235270617190">int</strong>: Each integer is stored on four bytes.</li><li id="dli_01_0005__li197172662015"><strong id="dli_01_0005__b71123713114">date</strong>: The value ranges from 0000-01-01 to 9999-12-31.</li><li id="dli_01_0005__li15276123414204"><strong id="dli_01_0005__b2073283811110">double</strong>: Each number is stored on eight bytes.</li><li id="dli_01_0005__li122191918102110"><strong id="dli_01_0005__b87406418113">boolean</strong>: Each value is stored on one byte.</li><li id="dli_01_0005__li616884422117"><strong id="dli_01_0005__b842352706172140">decimal</strong>: The valid bits are positive integers between 1 to 38, including 1 and 38. The decimal digits are integers less than 10.</li><li id="dli_01_0005__li6039945193127"><strong id="dli_01_0005__b1597562473">smallint/short</strong>: The number is stored on two bytes.</li><li id="dli_01_0005__li157282298387"><strong id="dli_01_0005__b1496238909">bigint/long</strong>: The number is stored on eight bytes.</li><li id="dli_01_0005__li4930135112217"><strong id="dli_01_0005__b1251694319111">timestamp</strong>: The data indicates a date and time. The value can be accurate to six decimal points.</li><li id="dli_01_0005__li482517952312"><strong id="dli_01_0005__b161442457112">float</strong>: Each number is stored on four bytes.</li><li id="dli_01_0005__li246310417404"><strong id="dli_01_0005__b0368141417399">tinyint</strong>: Each number is stored on one byte. Only OBS tables support this data type.</li></ul>
|
<ul id="dli_01_0005__ul2957726293032"><li id="dli_01_0005__li159154616209"><strong id="dli_01_0005__b12861523131117">string</strong>: The data is of the string type.</li><li id="dli_01_0005__li5035776893042"><strong id="dli_01_0005__b84235270617190">int</strong>: Each integer is stored on four bytes.</li><li id="dli_01_0005__li197172662015"><strong id="dli_01_0005__b71123713114">date</strong>: The value ranges from 0000-01-01 to 9999-12-31.</li><li id="dli_01_0005__li15276123414204"><strong id="dli_01_0005__b2073283811110">double</strong>: Each number is stored on eight bytes.</li><li id="dli_01_0005__li122191918102110"><strong id="dli_01_0005__b87406418113">boolean</strong>: Each value is stored on one byte.</li><li id="dli_01_0005__li616884422117"><strong id="dli_01_0005__b842352706172140">decimal</strong>: The valid bits are positive integers between 1 to 38, including 1 and 38. The decimal digits are integers less than 10.</li><li id="dli_01_0005__li6039945193127"><strong id="dli_01_0005__b657553069">smallint/short</strong>: The number is stored on two bytes.</li><li id="dli_01_0005__li157282298387"><strong id="dli_01_0005__b1143915494">bigint/long</strong>: The number is stored on eight bytes.</li><li id="dli_01_0005__li4930135112217"><strong id="dli_01_0005__b1251694319111">timestamp</strong>: The data indicates a date and time. The value can be accurate to six decimal points.</li><li id="dli_01_0005__li482517952312"><strong id="dli_01_0005__b161442457112">float</strong>: Each number is stored on four bytes.</li><li id="dli_01_0005__li246310417404"><strong id="dli_01_0005__b0368141417399">tinyint</strong>: Each number is stored on one byte. Only OBS tables support this data type.</li></ul>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="14.17%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.3 "><p id="dli_01_0005__p7441963105944">string</p>
|
<td class="cellrowborder" valign="top" width="14.17%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.3 "><p id="dli_01_0005__p7441963105944">string</p>
|
||||||
</td>
|
</td>
|
||||||
@ -144,7 +144,7 @@
|
|||||||
<tbody><tr id="dli_01_0005__row3015013618314"><td class="cellrowborder" valign="top" width="16.6%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.1 "><p id="dli_01_0005__p3709008118455">Data Format</p>
|
<tbody><tr id="dli_01_0005__row3015013618314"><td class="cellrowborder" valign="top" width="16.6%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.1 "><p id="dli_01_0005__p3709008118455">Data Format</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p5150660918455">DLI supports the following data formats:</p>
|
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p5150660918455">DLI supports the following data formats:</p>
|
||||||
<ul id="dli_01_0005__ul4173603518455"><li id="dli_01_0005__li4007999518455"><strong id="dli_01_0005__b84235270614338">Parquet</strong>: DLI can read non-compressed data or data that is compressed using Snappy and gzip.</li><li id="dli_01_0005__li2517563618455"><strong id="dli_01_0005__b1449184344">CSV</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li2525413518455"><strong id="dli_01_0005__b68145053">ORC</strong>: DLI can read non-compressed data or data that is compressed using Snappy.</li><li id="dli_01_0005__li2596063018455"><strong id="dli_01_0005__b1694317934">JSON</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li20203144172320"><strong id="dli_01_0005__b14575133533814">Avro</strong>: DLI can read uncompressed Avro data.</li></ul>
|
<ul id="dli_01_0005__ul4173603518455"><li id="dli_01_0005__li4007999518455"><strong id="dli_01_0005__b84235270614338">Parquet</strong>: DLI can read non-compressed data or data that is compressed using Snappy and gzip.</li><li id="dli_01_0005__li2517563618455"><strong id="dli_01_0005__b1357964886">CSV</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li2525413518455"><strong id="dli_01_0005__b1998844488">ORC</strong>: DLI can read non-compressed data or data that is compressed using Snappy.</li><li id="dli_01_0005__li2596063018455"><strong id="dli_01_0005__b1305079628">JSON</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li20203144172320"><strong id="dli_01_0005__b14575133533814">Avro</strong>: DLI can read uncompressed Avro data.</li></ul>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="30.330000000000002%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.3 "><p id="dli_01_0005__p2243627218455">CSV</p>
|
<td class="cellrowborder" valign="top" width="30.330000000000002%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.3 "><p id="dli_01_0005__p2243627218455">CSV</p>
|
||||||
</td>
|
</td>
|
||||||
@ -177,7 +177,7 @@
|
|||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0005__row21739275111826"><td class="cellrowborder" valign="top" width="16.6%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.1 "><p id="dli_01_0005__p39917803111836">User-defined Quotation Character</p>
|
<tr id="dli_01_0005__row21739275111826"><td class="cellrowborder" valign="top" width="16.6%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.1 "><p id="dli_01_0005__p39917803111836">User-defined Quotation Character</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p056181715520">This parameter is valid only when <span class="parmname" id="dli_01_0005__parmname502358884"><b>Data Format</b></span> is set to <span class="parmvalue" id="dli_01_0005__parmvalue1064295601"><b>CSV</b></span> and you select <strong id="dli_01_0005__b885854190">User-defined Quotation Character</strong>.</p>
|
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p056181715520">This parameter is valid only when <span class="parmname" id="dli_01_0005__parmname570681823"><b>Data Format</b></span> is set to <span class="parmvalue" id="dli_01_0005__parmvalue141904967"><b>CSV</b></span> and you select <strong id="dli_01_0005__b255429859">User-defined Quotation Character</strong>.</p>
|
||||||
<p id="dli_01_0005__p57404199154711">The following quotation characters are supported:</p>
|
<p id="dli_01_0005__p57404199154711">The following quotation characters are supported:</p>
|
||||||
<ul id="dli_01_0005__ul41920423111836"><li id="dli_01_0005__li41739488111836">Single quotation mark (')</li><li id="dli_01_0005__li40111075111836">Double quotation marks (")</li><li id="dli_01_0005__li25455362111836">Others: Enter a user-defined quotation character.</li></ul>
|
<ul id="dli_01_0005__ul41920423111836"><li id="dli_01_0005__li41739488111836">Single quotation mark (')</li><li id="dli_01_0005__li40111075111836">Double quotation marks (")</li><li id="dli_01_0005__li25455362111836">Others: Enter a user-defined quotation character.</li></ul>
|
||||||
</td>
|
</td>
|
||||||
@ -213,7 +213,7 @@
|
|||||||
</table>
|
</table>
|
||||||
</div>
|
</div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</p></li><li id="dli_01_0005__li6436679692218"><span>Click <span class="uicontrol" id="dli_01_0005__uicontrol1346028235151847"><b>OK</b></span>.</span><p><p id="dli_01_0005__p2255887315231">After a table is created, you can view and select the table for use on the <span class="wintitle" id="dli_01_0005__wintitle1684585740"><b>Data Management</b></span> page or <strong id="dli_01_0005__b555872049">SQL Editor</strong> page.</p>
|
</p></li><li id="dli_01_0005__li6436679692218"><span>Click <span class="uicontrol" id="dli_01_0005__uicontrol1346028235151847"><b>OK</b></span>.</span><p><p id="dli_01_0005__p2255887315231">After a table is created, you can view and select the table for use on the <span class="wintitle" id="dli_01_0005__wintitle363616988"><b>Data Management</b></span> page or <strong id="dli_01_0005__b1856357937">SQL Editor</strong> page.</p>
|
||||||
</p></li><li id="dli_01_0005__li66082750104919"><span>(Optional) After a DLI table is created, you can decide whether to directly import data to the table.</span></li></ol>
|
</p></li><li id="dli_01_0005__li66082750104919"><span>(Optional) After a DLI table is created, you can decide whether to directly import data to the table.</span></li></ol>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -65,7 +65,7 @@
|
|||||||
<ul id="dli_01_0006__ul6617123554815"><li id="dli_01_0006__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0006__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0006__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0006__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0006__ul6617123554815"><li id="dli_01_0006__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0006__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0006__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0006__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0006__ul16911451899"><li id="dli_01_0006__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0006__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0006__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0006__ul16911451899"><li id="dli_01_0006__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0006__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0006__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
@ -112,7 +112,7 @@
|
|||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="36.42364236423642%" headers="mcps1.3.5.2.2.2.1.6.3.2.4.1.2 "><p id="dli_01_0006__p627695795618">Type of IP addresses.</p>
|
<td class="cellrowborder" valign="top" width="36.42364236423642%" headers="mcps1.3.5.2.2.2.1.6.3.2.4.1.2 "><p id="dli_01_0006__p627695795618">Type of IP addresses.</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="43.694369436943695%" headers="mcps1.3.5.2.2.2.1.6.3.2.4.1.3 "><p id="dli_01_0006__p1027675795620">IPV4</p>
|
<td class="cellrowborder" valign="top" width="43.694369436943695%" headers="mcps1.3.5.2.2.2.1.6.3.2.4.1.3 "><p id="dli_01_0006__p1027675795620">IPv4</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0006__row2276757105618"><td class="cellrowborder" valign="top" width="19.881988198819883%" headers="mcps1.3.5.2.2.2.1.6.3.2.4.1.1 "><p id="dli_01_0006__p4276957195613">Source</p>
|
<tr id="dli_01_0006__row2276757105618"><td class="cellrowborder" valign="top" width="19.881988198819883%" headers="mcps1.3.5.2.2.2.1.6.3.2.4.1.1 "><p id="dli_01_0006__p4276957195613">Source</p>
|
||||||
|
@ -3,7 +3,7 @@
|
|||||||
<h1 class="topictitle1">Previewing Data</h1>
|
<h1 class="topictitle1">Previewing Data</h1>
|
||||||
<div id="body1501038213757"><p id="dli_01_0007__p569436192936">The <span class="wintitle" id="dli_01_0007__wintitle159646911143"><b>Preview</b></span> page displays the first 10 records in the table.</p>
|
<div id="body1501038213757"><p id="dli_01_0007__p569436192936">The <span class="wintitle" id="dli_01_0007__wintitle159646911143"><b>Preview</b></span> page displays the first 10 records in the table.</p>
|
||||||
<div class="section" id="dli_01_0007__section220516431119"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0007__p39191032115617">You can preview data on either the <span class="wintitle" id="dli_01_0007__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0007__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0007__ul57312886162410"><li id="dli_01_0007__li46053929162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0007__ol48633399145054"><li id="dli_01_0007__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0007__uicontrol18482320394"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0007__uicontrol748212014913"><b>Databases and Tables</b></span>.</li><li id="dli_01_0007__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0007__wintitle108175242144"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0007__b38223243141">Manage Tables</strong> page.</li><li id="dli_01_0007__li36387870145557">Click <span class="uicontrol" id="dli_01_0007__uicontrol52771577102"><b>More</b></span> in the <strong id="dli_01_0007__b3277187171011">Operation</strong> column of the target table and select <span class="wintitle" id="dli_01_0007__wintitle1827707101011"><b>View Properties</b></span>.</li><li id="dli_01_0007__li86216531552">Click the <span class="wintitle" id="dli_01_0007__wintitle3454141011716"><b>Preview</b></span> tab to preview the table data.</li></ol>
|
<div class="section" id="dli_01_0007__section220516431119"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0007__p39191032115617">You can preview data on either the <span class="wintitle" id="dli_01_0007__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0007__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0007__ul57312886162410"><li id="dli_01_0007__li46053929162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0007__ol48633399145054"><li id="dli_01_0007__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0007__uicontrol18482320394"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0007__uicontrol748212014913"><b>Databases and Tables</b></span>.</li><li id="dli_01_0007__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0007__wintitle108175242144"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0007__b38223243141">Manage Tables</strong> page.</li><li id="dli_01_0007__li36387870145557">Click <span class="uicontrol" id="dli_01_0007__uicontrol52771577102"><b>More</b></span> in the <strong id="dli_01_0007__b3277187171011">Operation</strong> column of the target table and select <span class="wintitle" id="dli_01_0007__wintitle1827707101011"><b>View Properties</b></span>.</li><li id="dli_01_0007__li86216531552">Click the <span class="wintitle" id="dli_01_0007__wintitle3454141011716"><b>Preview</b></span> tab to preview the table data.</li></ol>
|
||||||
</li><li id="dli_01_0007__li11072851162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0007__ol24485723162410"><li id="dli_01_0007__li19044916162410">On the left of the management console, click <span class="uicontrol" id="dli_01_0007__uicontrol666915283918"><b>SQL Editor</b></span>.</li><li id="dli_01_0007__li16991452612">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0007__wintitle146852941019"><b>SQL Editor</b></span> page, click <strong id="dli_01_0007__b0685209161016">Databases</strong>.</li><li id="dli_01_0007__li66243256162410">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0007__li64103520162410">Click <span><img id="dli_01_0007__image1895075254716" src="en-us_image_0237994908.png"></span> on the right of the corresponding table, choose <strong id="dli_01_0007__b18730161715107">View Properties</strong> from the list menu, and click the <strong id="dli_01_0007__b20730717161014">Preview</strong> tab to preview the data of the table.</li></ol>
|
</li><li id="dli_01_0007__li11072851162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0007__ol24485723162410"><li id="dli_01_0007__li19044916162410">On the left of the management console, click <span class="uicontrol" id="dli_01_0007__uicontrol666915283918"><b>SQL Editor</b></span>.</li><li id="dli_01_0007__li16991452612">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0007__wintitle146852941019"><b>SQL Editor</b></span> page, click <strong id="dli_01_0007__b0685209161016">Databases</strong>.</li><li id="dli_01_0007__li66243256162410">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0007__li64103520162410">Click <span><img id="dli_01_0007__image14366125210269" src="en-us_image_0237994908.png"></span> on the right of the corresponding table, choose <strong id="dli_01_0007__b5366852132610">View Properties</strong> from the list menu, and click the <strong id="dli_01_0007__b73671852102615">Preview</strong> tab to preview the data of the table.</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -4,7 +4,7 @@
|
|||||||
<div id="body1501038213757"><div class="section" id="dli_01_0008__section35142993104733"><h4 class="sectiontitle">Metadata Description</h4><ul id="dli_01_0008__ul3266683161032"><li id="dli_01_0008__li54899781161032">Metadata is used to define data types. It describes information about the data, including the source, size, format, and other data features. In database fields, metadata interprets data content in the data warehouse.</li><li id="dli_01_0008__li57091439161034">When you create a table, metadata is defined, consisting of the column name, type, and description.</li><li id="dli_01_0008__li194120268212">The <span class="wintitle" id="dli_01_0008__wintitle4795312310"><b>Metadata</b></span> page displays information about the target table, including <strong id="dli_01_0008__b98013311133">Column Name</strong>, <strong id="dli_01_0008__b184461231103011">Column Type</strong>, <strong id="dli_01_0008__b6809313317">Data Type</strong>, and <strong id="dli_01_0008__b1801231632">Description</strong>.</li></ul>
|
<div id="body1501038213757"><div class="section" id="dli_01_0008__section35142993104733"><h4 class="sectiontitle">Metadata Description</h4><ul id="dli_01_0008__ul3266683161032"><li id="dli_01_0008__li54899781161032">Metadata is used to define data types. It describes information about the data, including the source, size, format, and other data features. In database fields, metadata interprets data content in the data warehouse.</li><li id="dli_01_0008__li57091439161034">When you create a table, metadata is defined, consisting of the column name, type, and description.</li><li id="dli_01_0008__li194120268212">The <span class="wintitle" id="dli_01_0008__wintitle4795312310"><b>Metadata</b></span> page displays information about the target table, including <strong id="dli_01_0008__b98013311133">Column Name</strong>, <strong id="dli_01_0008__b184461231103011">Column Type</strong>, <strong id="dli_01_0008__b6809313317">Data Type</strong>, and <strong id="dli_01_0008__b1801231632">Description</strong>.</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0008__section38089543314"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0008__p11776437345">You can view metadata on either the <span class="wintitle" id="dli_01_0008__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0008__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0008__ul41981589145011"><li id="dli_01_0008__li30083560145011">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0008__ol48633399145054"><li id="dli_01_0008__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0008__uicontrol165882511882"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0008__uicontrol1058910511686"><b>Databases and Tables</b></span>.</li><li id="dli_01_0008__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0008__wintitle6486209315148"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0008__b116953258919">Manage Tables</strong> page.</li><li id="dli_01_0008__li36387870145557">Click <span class="uicontrol" id="dli_01_0008__uicontrol516817179511"><b>More</b></span> in the <strong id="dli_01_0008__b1176621554">Operation</strong> column of the target table and select <strong id="dli_01_0008__b12853104513520">View Properties</strong>. In the <strong id="dli_01_0008__b134534533517">Metadata</strong> tab, view the metadata of the table.</li></ol>
|
<div class="section" id="dli_01_0008__section38089543314"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0008__p11776437345">You can view metadata on either the <span class="wintitle" id="dli_01_0008__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0008__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0008__ul41981589145011"><li id="dli_01_0008__li30083560145011">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0008__ol48633399145054"><li id="dli_01_0008__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0008__uicontrol165882511882"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0008__uicontrol1058910511686"><b>Databases and Tables</b></span>.</li><li id="dli_01_0008__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0008__wintitle6486209315148"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0008__b116953258919">Manage Tables</strong> page.</li><li id="dli_01_0008__li36387870145557">Click <span class="uicontrol" id="dli_01_0008__uicontrol516817179511"><b>More</b></span> in the <strong id="dli_01_0008__b1176621554">Operation</strong> column of the target table and select <strong id="dli_01_0008__b12853104513520">View Properties</strong>. In the <strong id="dli_01_0008__b134534533517">Metadata</strong> tab, view the metadata of the table.</li></ol>
|
||||||
</li><li id="dli_01_0008__li662576911510">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0008__ol566308021525"><li id="dli_01_0008__li621294601525">On the left of the management console, click <span class="uicontrol" id="dli_01_0008__uicontrol64701326919"><b>SQL Editor</b></span>.</li><li id="dli_01_0008__li8680153010311">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0008__wintitle128361538687"><b>SQL Editor</b></span> page, click <strong id="dli_01_0008__b483614381818">Databases</strong>.</li><li id="dli_01_0008__li1089513015246">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0008__li3980594015952">Click <span><img id="dli_01_0008__image1895075254716" src="en-us_image_0237994909.png"></span> on the right of the table and choose <strong id="dli_01_0008__b342233416910">View Properties</strong> from the shortcut menu. On the <strong id="dli_01_0008__b8422133420913">Metadata</strong> tab page, view the metadata of the table.</li></ol>
|
</li><li id="dli_01_0008__li662576911510">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0008__ol566308021525"><li id="dli_01_0008__li621294601525">On the left of the management console, click <span class="uicontrol" id="dli_01_0008__uicontrol64701326919"><b>SQL Editor</b></span>.</li><li id="dli_01_0008__li8680153010311">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0008__wintitle128361538687"><b>SQL Editor</b></span> page, click <strong id="dli_01_0008__b483614381818">Databases</strong>.</li><li id="dli_01_0008__li1089513015246">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0008__li3980594015952">Click <span><img id="dli_01_0008__image5147182682614" src="en-us_image_0237994909.png"></span> on the right of the table and choose <strong id="dli_01_0008__b51481726202618">View Properties</strong> from the shortcut menu. On the <strong id="dli_01_0008__b19149026192613">Metadata</strong> tab page, view the metadata of the table.</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -37,7 +37,7 @@
|
|||||||
<tr id="dli_01_0010__row290212314015"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.3.2.2.2.1.1.2.3.1.1 "><p id="dli_01_0010__p119001331308">Compression Format</p>
|
<tr id="dli_01_0010__row290212314015"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.3.2.2.2.1.1.2.3.1.1 "><p id="dli_01_0010__p119001331308">Compression Format</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.3.2.2.2.1.1.2.3.1.2 "><p id="dli_01_0010__p109005311408">Compression format of the data to be exported. The following compression formats are supported:</p>
|
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.3.2.2.2.1.1.2.3.1.2 "><p id="dli_01_0010__p109005311408">Compression format of the data to be exported. The following compression formats are supported:</p>
|
||||||
<ul id="dli_01_0010__ul1490212318013"><li id="dli_01_0010__li890118311107">none</li><li id="dli_01_0010__li149019311702">bzip2</li><li id="dli_01_0010__li7901133117017">deflate</li><li id="dli_01_0010__li29018313018">gzip</li></ul>
|
<ul id="dli_01_0010__ul1490212318013"><li id="dli_01_0010__li890118311107"><strong id="dli_01_0010__b1383258800102814">none</strong></li><li id="dli_01_0010__li149019311702"><strong id="dli_01_0010__b447714703102819">bzip2</strong></li><li id="dli_01_0010__li7901133117017"><strong id="dli_01_0010__b1387948303102828">deflate</strong></li><li id="dli_01_0010__li29018313018"><strong id="dli_01_0010__b1774599284102831">gzip</strong></li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0010__row10902131809"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.3.2.2.2.1.1.2.3.1.1 "><p id="dli_01_0010__p10902113112020">Storage Path</p>
|
<tr id="dli_01_0010__row10902131809"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.3.2.2.2.1.1.2.3.1.1 "><p id="dli_01_0010__p10902113112020">Storage Path</p>
|
||||||
|
@ -7,7 +7,7 @@
|
|||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0011__section4685189174137"><h4 class="sectiontitle">Deleting a Table</h4><div class="p" id="dli_01_0011__p17554192016499">You can delete a table on either the <span class="wintitle" id="dli_01_0011__wintitle1351164893315"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0011__wintitle035294843313"><b>SQL Editor</b></span> page.<ul id="dli_01_0011__ul10405142364818"><li id="dli_01_0011__li2040592311485">Delete the table on the <span class="wintitle" id="dli_01_0011__wintitle73872501337"><b>Data Management</b></span> page.<ol id="dli_01_0011__ol1735193915485"><li id="dli_01_0011__li2073593924816">On the left of the management console, choose <span class="uicontrol" id="dli_01_0011__uicontrol348919541445"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0011__uicontrol14490145410416"><b>Databases and Tables</b></span>.</li><li id="dli_01_0011__li33015647174137">Locate the row where the database whose tables you want to delete, click the database name to switch to the <strong id="dli_01_0011__b9318135618332">Table Management</strong> page.</li><li id="dli_01_0011__li57021755174137">Locate the row where the target table locates and click <strong id="dli_01_0011__b1751314565019">More</strong> > <span class="uicontrol" id="dli_01_0011__uicontrol43433751174137"><b>Delete</b></span> in the <strong id="dli_01_0011__b1080714149149">Operation</strong> column.</li><li id="dli_01_0011__li55359439174137">In the displayed dialog box, click <span class="uicontrol" id="dli_01_0011__uicontrol27840389155213"><b>Yes</b></span>.</li></ol>
|
<div class="section" id="dli_01_0011__section4685189174137"><h4 class="sectiontitle">Deleting a Table</h4><div class="p" id="dli_01_0011__p17554192016499">You can delete a table on either the <span class="wintitle" id="dli_01_0011__wintitle1351164893315"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0011__wintitle035294843313"><b>SQL Editor</b></span> page.<ul id="dli_01_0011__ul10405142364818"><li id="dli_01_0011__li2040592311485">Delete the table on the <span class="wintitle" id="dli_01_0011__wintitle73872501337"><b>Data Management</b></span> page.<ol id="dli_01_0011__ol1735193915485"><li id="dli_01_0011__li2073593924816">On the left of the management console, choose <span class="uicontrol" id="dli_01_0011__uicontrol348919541445"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0011__uicontrol14490145410416"><b>Databases and Tables</b></span>.</li><li id="dli_01_0011__li33015647174137">Locate the row where the database whose tables you want to delete, click the database name to switch to the <strong id="dli_01_0011__b9318135618332">Table Management</strong> page.</li><li id="dli_01_0011__li57021755174137">Locate the row where the target table locates and click <strong id="dli_01_0011__b1751314565019">More</strong> > <span class="uicontrol" id="dli_01_0011__uicontrol43433751174137"><b>Delete</b></span> in the <strong id="dli_01_0011__b1080714149149">Operation</strong> column.</li><li id="dli_01_0011__li55359439174137">In the displayed dialog box, click <span class="uicontrol" id="dli_01_0011__uicontrol27840389155213"><b>Yes</b></span>.</li></ol>
|
||||||
</li><li id="dli_01_0011__li10384371151118">Delete a table on the <span class="wintitle" id="dli_01_0011__wintitle743355813315"><b>SQL Editor</b></span> page.<ol id="dli_01_0011__ol39382464151459"><li id="dli_01_0011__li26745450151459">On the top menu bar of the DLI management console, click <span class="uicontrol" id="dli_01_0011__uicontrol136221153121411"><b>SQL Editor</b></span>.</li><li id="dli_01_0011__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0011__b1777018312279">Databases</strong>. Click the name of a database where the table you want belongs. The tables of the selected database are displayed.</li><li id="dli_01_0011__li2614201531">Click <span><img id="dli_01_0011__image10279959109" src="en-us_image_0237983632.png"></span> on the right of the table and choose <strong id="dli_01_0011__b534514115015">Delete</strong> from the shortcut menu.</li><li id="dli_01_0011__li0998173818546">In the dialog box that is displayed, click <span class="uicontrol" id="dli_01_0011__en-us_topic_0122016948_en-us_topic_0093946752_uicontrol44850627112429"><b>OK</b></span>.</li></ol>
|
</li><li id="dli_01_0011__li10384371151118">Delete a table on the <span class="wintitle" id="dli_01_0011__wintitle743355813315"><b>SQL Editor</b></span> page.<ol id="dli_01_0011__ol39382464151459"><li id="dli_01_0011__li26745450151459">On the top menu bar of the DLI management console, click <span class="uicontrol" id="dli_01_0011__uicontrol136221153121411"><b>SQL Editor</b></span>.</li><li id="dli_01_0011__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0011__b1777018312279">Databases</strong>. Click the name of a database where the table you want belongs. The tables of the selected database are displayed.</li><li id="dli_01_0011__li2614201531">Click <span><img id="dli_01_0011__image87961316122313" src="en-us_image_0237983632.png"></span> on the right of the table and choose <strong id="dli_01_0011__b379617166234">Delete</strong> from the shortcut menu.</li><li id="dli_01_0011__li0998173818546">In the dialog box that is displayed, click <span class="uicontrol" id="dli_01_0011__en-us_topic_0122016948_en-us_topic_0093946752_uicontrol44850627112429"><b>OK</b></span>.</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -12,6 +12,8 @@
|
|||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0016.html">Deleting a Queue</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0016.html">Deleting a Queue</a></strong><br>
|
||||||
</li>
|
</li>
|
||||||
|
<li class="ulchildlink"><strong><a href="dli_01_0565.html">Allocating a Queue to an Enterprise Project</a></strong><br>
|
||||||
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0443.html">Modifying the CIDR Block</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0443.html">Modifying the CIDR Block</a></strong><br>
|
||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0487.html">Elastic Queue Scaling</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0487.html">Elastic Queue Scaling</a></strong><br>
|
||||||
@ -24,6 +26,8 @@
|
|||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0022.html">Managing Queue Tags</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0022.html">Managing Queue Tags</a></strong><br>
|
||||||
</li>
|
</li>
|
||||||
|
<li class="ulchildlink"><strong><a href="dli_01_0563.html">Setting Queue Properties</a></strong><br>
|
||||||
|
</li>
|
||||||
</ul>
|
</ul>
|
||||||
</div>
|
</div>
|
||||||
|
|
||||||
|
@ -14,7 +14,7 @@
|
|||||||
</li><li id="dli_01_0013__li33942299478">Click <strong id="dli_01_0013__b842352706143321">OK</strong>.</li></ol>
|
</li><li id="dli_01_0013__li33942299478">Click <strong id="dli_01_0013__b842352706143321">OK</strong>.</li></ol>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0013__section3607172865810"><a name="dli_01_0013__section3607172865810"></a><a name="section3607172865810"></a><h4 class="sectiontitle">How Do I Obtain MRS Host Information?</h4><ul id="dli_01_0013__ul2014719191210"><li id="dli_01_0013__li74471471342"><strong id="dli_01_0013__b10964723646">Method 1: View MRS host information on the management console.</strong><p id="dli_01_0013__p2011023525">To obtain the host name and IP address of an MRS cluster, for example, MRS 3.<em id="dli_01_0013__i7634105210619">x</em>, perform the following operations:</p>
|
<div class="section" id="dli_01_0013__section3607172865810"><a name="dli_01_0013__section3607172865810"></a><a name="section3607172865810"></a><h4 class="sectiontitle">How Do I Obtain MRS Host Information?</h4><ul id="dli_01_0013__ul2014719191210"><li id="dli_01_0013__li74471471342"><strong id="dli_01_0013__b10964723646">Method 1: View MRS host information on the management console.</strong><p id="dli_01_0013__p2011023525">To obtain the host name and IP address of an MRS cluster, for example, MRS 3.<em id="dli_01_0013__i7634105210619">x</em>, perform the following operations:</p>
|
||||||
<ol id="dli_01_0013__ol34131830476"><li id="dli_01_0013__li24136334712">Log in to the MRS management console.</li><li id="dli_01_0013__li14136317472">On the <strong id="dli_01_0013__b886618920122">Active Clusters</strong> page displayed, click your desired cluster to access its details page.</li><li id="dli_01_0013__li741363194711">Click the <strong id="dli_01_0013__b228364411164">Components</strong> tab.</li><li id="dli_01_0013__li174136317476">Click <strong id="dli_01_0013__b47249556160">ZooKeeper</strong>.</li><li id="dli_01_0013__li114131237471">Click the <span class="wintitle" id="dli_01_0013__wintitle131141554201820"><b>Instance</b></span> tab to view corresponding service IP addresses. You can select any service IP address.</li><li id="dli_01_0013__li1491513115563">Modify host information by referring to <a href="#dli_01_0013__section6859216954">Modifying Host Information</a>.</li></ol>
|
<ol id="dli_01_0013__ol34131830476"><li id="dli_01_0013__li24136334712">Log in to the MRS management console.</li><li id="dli_01_0013__li14136317472">On the <strong id="dli_01_0013__b886618920122">Active Clusters</strong> page displayed, click your desired cluster to access its details page.</li><li id="dli_01_0013__li741363194711">Click the <strong id="dli_01_0013__b228364411164">Components</strong> tab.</li><li id="dli_01_0013__li174136317476">Click <strong id="dli_01_0013__b47249556160">ZooKeeper</strong>.</li><li id="dli_01_0013__li114131237471">Click the <span class="wintitle" id="dli_01_0013__wintitle131141554201820"><b>Instance</b></span> tab to view the corresponding service IP addresses. You can select any service IP address.</li><li id="dli_01_0013__li1491513115563">Modify host information by referring to <a href="#dli_01_0013__section6859216954">Modifying Host Information</a>.</li></ol>
|
||||||
<div class="note" id="dli_01_0013__note1426252593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0013__p142655145920">If the MRS cluster has multiple IP addresses, enter any service IP address when creating a datasource connection.</p>
|
<div class="note" id="dli_01_0013__note1426252593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0013__p142655145920">If the MRS cluster has multiple IP addresses, enter any service IP address when creating a datasource connection.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li><li id="dli_01_0013__li914799171217"><strong id="dli_01_0013__b1392713419255">Method 2: Obtain MRS host information from the /etc/hosts file on an MRS node.</strong><ol id="dli_01_0013__ol207699227017"><li id="dli_01_0013__li67691922306">Log in to any MRS node as user <strong id="dli_01_0013__b187181123279">root</strong>.</li><li id="dli_01_0013__li17769172215019">Run the following command to obtain MRS hosts information. Copy and save the information.<p id="dli_01_0013__p16131162771410"><a name="dli_01_0013__li17769172215019"></a><a name="li17769172215019"></a><strong id="dli_01_0013__b9843629161411">cat /etc/hosts</strong></p>
|
</li><li id="dli_01_0013__li914799171217"><strong id="dli_01_0013__b1392713419255">Method 2: Obtain MRS host information from the /etc/hosts file on an MRS node.</strong><ol id="dli_01_0013__ol207699227017"><li id="dli_01_0013__li67691922306">Log in to any MRS node as user <strong id="dli_01_0013__b187181123279">root</strong>.</li><li id="dli_01_0013__li17769172215019">Run the following command to obtain MRS hosts information. Copy and save the information.<p id="dli_01_0013__p16131162771410"><a name="dli_01_0013__li17769172215019"></a><a name="li17769172215019"></a><strong id="dli_01_0013__b9843629161411">cat /etc/hosts</strong></p>
|
||||||
|
@ -24,6 +24,7 @@
|
|||||||
<tr id="dli_01_0014__row122452064312"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.2.2.3.3.2.3.1.1 "><p id="dli_01_0014__p1124516623114">IP Address</p>
|
<tr id="dli_01_0014__row122452064312"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.2.2.3.3.2.3.1.1 "><p id="dli_01_0014__p1124516623114">IP Address</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR block of different routes can overlap but cannot be the same.</p>
|
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR block of different routes can overlap but cannot be the same.</p>
|
||||||
|
<p id="dli_01_0014__p993601752819">Do not add the CIDR blocks <strong id="dli_01_0014__b1147314411438">100.125.</strong><em id="dli_01_0014__i141951672436">xx.xx</em> and <strong id="dli_01_0014__b960211118432">100.64.</strong><em id="dli_01_0014__i11964141484310">xx.xx</em> to prevent conflicts with the internal CIDR blocks of services such as SWR. This can lead to failure of the enhanced datasource connection.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
</tbody>
|
</tbody>
|
||||||
|
@ -1,7 +1,7 @@
|
|||||||
<a name="dli_01_0017"></a><a name="dli_01_0017"></a>
|
<a name="dli_01_0017"></a><a name="dli_01_0017"></a>
|
||||||
|
|
||||||
<h1 class="topictitle1">SQL Job Management</h1>
|
<h1 class="topictitle1">SQL Job Management</h1>
|
||||||
<div id="body1501038213757"><p id="dli_01_0017__p1192818410140">SQL jobs allow you to execute SQL statements entered in the <a href="dli_01_0320.html">SQL job editing window</a>, import data, and export data.</p>
|
<div id="body1501038213757"><p id="dli_01_0017__p1192818410140">SQL jobs allow you to execute SQL statements in the SQL job editing window, import data, and export data.</p>
|
||||||
<p id="dli_01_0017__p835610562472">SQL job management provides the following functions:</p>
|
<p id="dli_01_0017__p835610562472">SQL job management provides the following functions:</p>
|
||||||
<ul id="dli_01_0017__ul32249213483"><li id="dli_01_0017__li64311610480"><a href="#dli_01_0017__section71552447166">Searching for Jobs</a>: Search for jobs that meet the search criteria.</li><li id="dli_01_0017__li1032925220118"><a href="#dli_01_0017__section1960402414173">Viewing Job Details</a>: Display job details.</li><li id="dli_01_0017__li68201752220"><a href="#dli_01_0017__section8647175812179">Terminating a Job</a>: Stop a job in the <strong id="dli_01_0017__b42751775137">Submitting</strong> or <strong id="dli_01_0017__b9275179136">Running</strong> status.</li><li id="dli_01_0017__li1566419171522"><a href="#dli_01_0017__section1152211221244">Exporting Query Results</a>: A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can export the data to OBS.</li></ul>
|
<ul id="dli_01_0017__ul32249213483"><li id="dli_01_0017__li64311610480"><a href="#dli_01_0017__section71552447166">Searching for Jobs</a>: Search for jobs that meet the search criteria.</li><li id="dli_01_0017__li1032925220118"><a href="#dli_01_0017__section1960402414173">Viewing Job Details</a>: Display job details.</li><li id="dli_01_0017__li68201752220"><a href="#dli_01_0017__section8647175812179">Terminating a Job</a>: Stop a job in the <strong id="dli_01_0017__b42751775137">Submitting</strong> or <strong id="dli_01_0017__b9275179136">Running</strong> status.</li><li id="dli_01_0017__li1566419171522"><a href="#dli_01_0017__section1152211221244">Exporting Query Results</a>: A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can export the data to OBS.</li></ul>
|
||||||
<div class="section" id="dli_01_0017__section1616314111518"><h4 class="sectiontitle">SQL Jobs Page</h4><p id="dli_01_0017__p66482014175614">On the <strong id="dli_01_0017__b18994133761612">Overview</strong> page of the DLI console, click <strong id="dli_01_0017__b6320155516180">SQL Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0017__b19281104916202">Job Management</strong> > <strong id="dli_01_0017__b827935212010">SQL Jobs</strong>. The job list displays all SQL jobs. If there are a large number of jobs, they will be displayed on multiple pages. You can switch to the specified page as needed. DLI allows you to view jobs in all statuses. By default, jobs in the job list are displayed in descending order of the job creation time.</p>
|
<div class="section" id="dli_01_0017__section1616314111518"><h4 class="sectiontitle">SQL Jobs Page</h4><p id="dli_01_0017__p66482014175614">On the <strong id="dli_01_0017__b18994133761612">Overview</strong> page of the DLI console, click <strong id="dli_01_0017__b6320155516180">SQL Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0017__b19281104916202">Job Management</strong> > <strong id="dli_01_0017__b827935212010">SQL Jobs</strong>. The job list displays all SQL jobs. If there are a large number of jobs, they will be displayed on multiple pages. You can switch to the specified page as needed. DLI allows you to view jobs in all statuses. By default, jobs in the job list are displayed in descending order of the job creation time.</p>
|
||||||
@ -25,7 +25,7 @@
|
|||||||
<tr id="dli_01_0017__row069215885116"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p1089364165215">Type</p>
|
<tr id="dli_01_0017__row069215885116"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p1089364165215">Type</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="78.82000000000001%" headers="mcps1.3.4.3.2.3.1.2 "><p id="dli_01_0017__p089314415220">Job type. The following types are supported:</p>
|
<td class="cellrowborder" valign="top" width="78.82000000000001%" headers="mcps1.3.4.3.2.3.1.2 "><p id="dli_01_0017__p089314415220">Job type. The following types are supported:</p>
|
||||||
<ul id="dli_01_0017__ul1089314412528"><li id="dli_01_0017__li15893144526"><strong id="dli_01_0017__b89995314560">IMPORT</strong>: A job that imports data to DLI</li><li id="dli_01_0017__li1689313495217"><strong id="dli_01_0017__b3117108195615">EXPORT</strong>: A job that exports data from DLI</li><li id="dli_01_0017__li88939417526"><strong id="dli_01_0017__b3997201165618">DCL</strong>: Conventional DCLs and operations related to queue permissions</li><li id="dli_01_0017__li389394115215"><strong id="dli_01_0017__b14581115185619">DDL</strong>:Conventional DDLs, including creating and deleting databases and tables</li><li id="dli_01_0017__li188931440521"><strong id="dli_01_0017__b787481935617">QUERY</strong>: A job that querys data by running SQL statements</li><li id="dli_01_0017__li38939475210"><strong id="dli_01_0017__b18360425175615">INSERT</strong>: A job that inserts data by running SQL statements</li><li id="dli_01_0017__li16894124205217"><strong id="dli_01_0017__b9612121223815">UPDATE</strong>: A job that updates data.</li><li id="dli_01_0017__li16894842520"><strong id="dli_01_0017__b3137104383818">DELETE</strong>: A job that deletes a SQL job.</li><li id="dli_01_0017__li108942475213"><strong id="dli_01_0017__b050994018396">DATA_MIGRATION</strong>: A job that migrates data.</li><li id="dli_01_0017__li1089410415526"><strong id="dli_01_0017__b1136184993916">RESTART_QUEUE</strong>: A job that restarts a queue.</li><li id="dli_01_0017__li1889411415213"><strong id="dli_01_0017__b15467352103416">SCALE_QUEUE</strong>: A job that changes queue specifications, including sale-out and scale-in.</li></ul>
|
<ul id="dli_01_0017__ul1089314412528"><li id="dli_01_0017__li15893144526"><strong id="dli_01_0017__b89995314560">IMPORT</strong>: A job that imports data to DLI</li><li id="dli_01_0017__li1689313495217"><strong id="dli_01_0017__b3117108195615">EXPORT</strong>: A job that exports data from DLI</li><li id="dli_01_0017__li88939417526"><strong id="dli_01_0017__b3997201165618">DCL</strong>: Conventional DCLs and operations related to queue permissions</li><li id="dli_01_0017__li389394115215"><strong id="dli_01_0017__b14581115185619">DDL</strong>:Conventional DDLs, including creating and deleting databases and tables</li><li id="dli_01_0017__li188931440521"><strong id="dli_01_0017__b787481935617">QUERY</strong>: A job that queries data by running SQL statements</li><li id="dli_01_0017__li38939475210"><strong id="dli_01_0017__b18360425175615">INSERT</strong>: A job that inserts data by running SQL statements</li><li id="dli_01_0017__li16894124205217"><strong id="dli_01_0017__b9612121223815">UPDATE</strong>: A job that updates data.</li><li id="dli_01_0017__li16894842520"><strong id="dli_01_0017__b3137104383818">DELETE</strong>: A job that deletes a SQL job.</li><li id="dli_01_0017__li108942475213"><strong id="dli_01_0017__b050994018396">DATA_MIGRATION</strong>: A job that migrates data.</li><li id="dli_01_0017__li1089410415526"><strong id="dli_01_0017__b1136184993916">RESTART_QUEUE</strong>: A job that restarts a queue.</li><li id="dli_01_0017__li1889411415213"><strong id="dli_01_0017__b15467352103416">SCALE_QUEUE</strong>: A job that changes queue specifications, including sale-out and scale-in.</li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0017__row197828317531"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p1932174125314">Status</p>
|
<tr id="dli_01_0017__row197828317531"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p1932174125314">Status</p>
|
||||||
@ -37,7 +37,7 @@
|
|||||||
<tr id="dli_01_0017__row3224193175419"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p16921337195416">Query</p>
|
<tr id="dli_01_0017__row3224193175419"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p16921337195416">Query</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="78.82000000000001%" headers="mcps1.3.4.3.2.3.1.2 "><p id="dli_01_0017__p1269243775415">SQL statements for operations such as exporting and creating tables</p>
|
<td class="cellrowborder" valign="top" width="78.82000000000001%" headers="mcps1.3.4.3.2.3.1.2 "><p id="dli_01_0017__p1269243775415">SQL statements for operations such as exporting and creating tables</p>
|
||||||
<p id="dli_01_0017__p9692193735410">You can click <span><img id="dli_01_0017__image146921537115419" src="en-us_image_0000001209671182.png"></span> to copy the query statement.</p>
|
<p id="dli_01_0017__p9692193735410">You can click <span><img id="dli_01_0017__image201077225104" src="en-us_image_0000001209671182.png"></span> to copy the query statement.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0017__row9808951115410"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p5459195720543">Duration</p>
|
<tr id="dli_01_0017__row9808951115410"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.4.3.2.3.1.1 "><p id="dli_01_0017__p5459195720543">Duration</p>
|
||||||
@ -81,11 +81,11 @@
|
|||||||
<div class="section" id="dli_01_0017__section1152211221244"><a name="dli_01_0017__section1152211221244"></a><a name="section1152211221244"></a><h4 class="sectiontitle">Exporting Query Results</h4><p id="dli_01_0017__p9458163282918">A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can export the data to OBS. The procedure is as follows:</p>
|
<div class="section" id="dli_01_0017__section1152211221244"><a name="dli_01_0017__section1152211221244"></a><a name="section1152211221244"></a><h4 class="sectiontitle">Exporting Query Results</h4><p id="dli_01_0017__p9458163282918">A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can export the data to OBS. The procedure is as follows:</p>
|
||||||
<p id="dli_01_0017__p11388428204">You can export results on the <span class="wintitle" id="dli_01_0017__wintitle2135957101316"><b>SQL Jobs</b></span> page or the <span class="wintitle" id="dli_01_0017__wintitle213685711310"><b>SQL Editor</b></span> page.</p>
|
<p id="dli_01_0017__p11388428204">You can export results on the <span class="wintitle" id="dli_01_0017__wintitle2135957101316"><b>SQL Jobs</b></span> page or the <span class="wintitle" id="dli_01_0017__wintitle213685711310"><b>SQL Editor</b></span> page.</p>
|
||||||
<ul id="dli_01_0017__ul8360118142113"><li id="dli_01_0017__li83604822117">On the <strong id="dli_01_0017__b11515441261">Job Management</strong> > <span class="wintitle" id="dli_01_0017__wintitle4552143819619"><b>SQL Jobs</b></span> page, you can click <strong id="dli_01_0017__b7545122131411">More</strong> > <span class="uicontrol" id="dli_01_0017__uicontrol05461025146"><b>Export Result</b></span> in the <strong id="dli_01_0017__b105461216146">Operation</strong> column to export the query result.</li><li id="dli_01_0017__li4267191916211">After the query statements are successfully executed on the <span class="wintitle" id="dli_01_0017__wintitle3789726191611"><b>SQL Editor</b></span> page, click <span><img id="dli_01_0017__image1412107111917" src="en-us_image_0000001835430521.png"></span> next to the <span class="wintitle" id="dli_01_0017__wintitle979062681614"><b>View Result</b></span> tab page to export query results.</li></ul>
|
<ul id="dli_01_0017__ul8360118142113"><li id="dli_01_0017__li83604822117">On the <strong id="dli_01_0017__b11515441261">Job Management</strong> > <span class="wintitle" id="dli_01_0017__wintitle4552143819619"><b>SQL Jobs</b></span> page, you can click <strong id="dli_01_0017__b7545122131411">More</strong> > <span class="uicontrol" id="dli_01_0017__uicontrol05461025146"><b>Export Result</b></span> in the <strong id="dli_01_0017__b105461216146">Operation</strong> column to export the query result.</li><li id="dli_01_0017__li4267191916211">After the query statements are successfully executed on the <span class="wintitle" id="dli_01_0017__wintitle3789726191611"><b>SQL Editor</b></span> page, click <span><img id="dli_01_0017__image1412107111917" src="en-us_image_0000001835430521.png"></span> next to the <span class="wintitle" id="dli_01_0017__wintitle979062681614"><b>View Result</b></span> tab page to export query results.</li></ul>
|
||||||
<div class="note" id="dli_01_0017__note1284717218412"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0017__p108591921114113">If no column of the numeric type is displayed in the query result, the result cannot be exported.</p>
|
<div class="note" id="dli_01_0017__note1284717218412"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0017__p108591921114113">If there are no numerical columns in the query results, job results cannot be exported.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
<p id="dli_01_0017__p811117120448"></p>
|
<p id="dli_01_0017__p811117120448"></p>
|
||||||
|
|
||||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0017__table7742063143659" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Exporting parameters</caption><thead align="left"><tr id="dli_01_0017__row48986708143659"><th align="left" class="cellrowborder" valign="top" width="13.8%" id="mcps1.3.8.7.2.3.1.1"><p id="dli_01_0017__p8500389143659"><strong id="dli_01_0017__b842352706183148">Parameter</strong></p>
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0017__table7742063143659" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameters</caption><thead align="left"><tr id="dli_01_0017__row48986708143659"><th align="left" class="cellrowborder" valign="top" width="13.8%" id="mcps1.3.8.7.2.3.1.1"><p id="dli_01_0017__p8500389143659"><strong id="dli_01_0017__b842352706183148">Parameter</strong></p>
|
||||||
</th>
|
</th>
|
||||||
<th align="left" class="cellrowborder" valign="top" width="86.2%" id="mcps1.3.8.7.2.3.1.2"><p id="dli_01_0017__p17442940143659"><strong id="dli_01_0017__en-us_topic_0106891196_b84235270693349">Description</strong></p>
|
<th align="left" class="cellrowborder" valign="top" width="86.2%" id="mcps1.3.8.7.2.3.1.2"><p id="dli_01_0017__p17442940143659"><strong id="dli_01_0017__en-us_topic_0106891196_b84235270693349">Description</strong></p>
|
||||||
</th>
|
</th>
|
||||||
@ -98,13 +98,13 @@
|
|||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0017__row33984858114535"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p1310090114535"><strong id="dli_01_0017__b165065915405">Queues</strong></p>
|
<tr id="dli_01_0017__row33984858114535"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p1310090114535"><strong id="dli_01_0017__b165065915405">Queues</strong></p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.8.7.2.3.1.2 "><p id="dli_01_0017__p39008475114535">The queue where the jobs are executed. SQL jobs can be executed only in SQL queues. For details about how to create a queue, see <a href="dli_01_0363.html">Creating a Queue</a>.</p>
|
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.8.7.2.3.1.2 "><p id="dli_01_0017__p39008475114535">The queue where the jobs are executed. SQL jobs can only be executed on SQL queues. For details about how to create a queue, see <a href="dli_01_0363.html">Creating a Queue</a>.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0017__row1774342414552"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p2547309214552"><strong id="dli_01_0017__b15431102114019">Compression Format</strong></p>
|
<tr id="dli_01_0017__row1774342414552"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p2547309214552"><strong id="dli_01_0017__b15431102114019">Compression Format</strong></p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.8.7.2.3.1.2 "><p id="dli_01_0017__p5005459614552">Compression format of the data to be exported. The following options are supported:</p>
|
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.8.7.2.3.1.2 "><p id="dli_01_0017__p5005459614552">Compression format of the data to be exported. The options are:</p>
|
||||||
<ul id="dli_01_0017__ul35000658144913"><li id="dli_01_0017__li26407599145154">none</li><li id="dli_01_0017__li15808987144913">bzip2</li><li id="dli_01_0017__li39569454144913">deflate</li><li id="dli_01_0017__li7424986144913">gzip</li></ul>
|
<ul id="dli_01_0017__ul35000658144913"><li id="dli_01_0017__li26407599145154"><strong id="dli_01_0017__b1256136070102811">none</strong></li><li id="dli_01_0017__li15808987144913"><strong id="dli_01_0017__b113116616102817">bzip2</strong></li><li id="dli_01_0017__li39569454144913"><strong id="dli_01_0017__b949951895102824">deflate</strong></li><li id="dli_01_0017__li7424986144913"><strong id="dli_01_0017__b1437046073102827">gzip</strong></li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0017__row6367025143659"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p3346061614541"><strong id="dli_01_0017__b168321655203913">Storage Path</strong></p>
|
<tr id="dli_01_0017__row6367025143659"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p3346061614541"><strong id="dli_01_0017__b168321655203913">Storage Path</strong></p>
|
||||||
|
@ -30,7 +30,7 @@
|
|||||||
<tr id="dli_01_0019__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.2.2.4.4.2.3.1.1 "><p id="dli_01_0019__p345210468163">Tag value</p>
|
<tr id="dli_01_0019__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.2.2.4.4.2.3.1.1 "><p id="dli_01_0019__p345210468163">Tag value</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.2.2.4.4.2.3.1.2 "><p id="dli_01_0019__p1545619468165">You can perform the following operations:</p>
|
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.2.2.4.4.2.3.1.2 "><p id="dli_01_0019__p1545619468165">You can perform the following operations:</p>
|
||||||
<ul id="dli_01_0019__ul1045720469162"><li id="dli_01_0019__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0019__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0019__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0019__ul1045720469162"><li id="dli_01_0019__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0019__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0019__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
@ -29,7 +29,7 @@
|
|||||||
<tr id="dli_01_0022__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.1.8.4.2.1.2.3.1.1 "><p id="dli_01_0022__p345210468163">Tag value</p>
|
<tr id="dli_01_0022__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.1.8.4.2.1.2.3.1.1 "><p id="dli_01_0022__p345210468163">Tag value</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.1.8.4.2.1.2.3.1.2 "><p id="dli_01_0022__p1545619468165">You can specify the tag value in either of the following ways:</p>
|
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.1.8.4.2.1.2.3.1.2 "><p id="dli_01_0022__p1545619468165">You can specify the tag value in either of the following ways:</p>
|
||||||
<ul id="dli_01_0022__ul1045720469162"><li id="dli_01_0022__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0022__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0022__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0022__ul1045720469162"><li id="dli_01_0022__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0022__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0022__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
@ -7,7 +7,7 @@
|
|||||||
<div class="section" id="dli_01_0253__section46923850144935"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0253__p2990805493216">The data to be imported has been stored on OBS.</p>
|
<div class="section" id="dli_01_0253__section46923850144935"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0253__p2990805493216">The data to be imported has been stored on OBS.</p>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0253__section1935812127104"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0253__ol64023642144515"><li id="dli_01_0253__li2078303115103"><span>You can import data on either the <span class="wintitle" id="dli_01_0253__wintitle6968736183919"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0253__wintitle296873615397"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0253__ul13952860151010"><li id="dli_01_0253__li20669721151337">To import data on the <span class="wintitle" id="dli_01_0253__wintitle718703911393"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0253__ol65658627151340"><li id="dli_01_0253__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0253__uicontrol1861322375215"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0253__uicontrol8614122385211"><b>Databases and Tables</b></span>.</li><li id="dli_01_0253__li29714355165922">Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.</li><li id="dli_01_0253__li14811172414512">Locate the row where the target table resides and choose <strong id="dli_01_0253__b1434424713920">More</strong> > <strong id="dli_01_0253__b834444717393">Import</strong> in the <strong id="dli_01_0253__b113451847143918">Operation</strong> column. The <span class="wintitle" id="dli_01_0253__wintitle9345164715393"><b>Import</b></span> dialog box is displayed.</li></ol>
|
<div class="section" id="dli_01_0253__section1935812127104"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0253__ol64023642144515"><li id="dli_01_0253__li2078303115103"><span>You can import data on either the <span class="wintitle" id="dli_01_0253__wintitle6968736183919"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0253__wintitle296873615397"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0253__ul13952860151010"><li id="dli_01_0253__li20669721151337">To import data on the <span class="wintitle" id="dli_01_0253__wintitle718703911393"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0253__ol65658627151340"><li id="dli_01_0253__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0253__uicontrol1861322375215"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0253__uicontrol8614122385211"><b>Databases and Tables</b></span>.</li><li id="dli_01_0253__li29714355165922">Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.</li><li id="dli_01_0253__li14811172414512">Locate the row where the target table resides and choose <strong id="dli_01_0253__b1434424713920">More</strong> > <strong id="dli_01_0253__b834444717393">Import</strong> in the <strong id="dli_01_0253__b113451847143918">Operation</strong> column. The <span class="wintitle" id="dli_01_0253__wintitle9345164715393"><b>Import</b></span> dialog box is displayed.</li></ol>
|
||||||
</li><li id="dli_01_0253__li10384371151118">To import data on the <span class="wintitle" id="dli_01_0253__wintitle163710502399"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0253__ol39382464151459"><li id="dli_01_0253__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0253__uicontrol1351715612720"><b>SQL Editor</b></span>.</li><li id="dli_01_0253__li1773513617043">In the navigation tree on the left of <span class="uicontrol" id="dli_01_0253__uicontrol1274112477320"><b>SQL Editor</b></span>, click <strong id="dli_01_0253__b19748144733213">Databases</strong> to see all databases. Click the database where the target table belongs. The table list is displayed.</li><li id="dli_01_0253__li2614201531">Click <span><img id="dli_01_0253__image12666523113" src="en-us_image_0237990324.png"></span> on the right of the table and choose <strong id="dli_01_0253__b1726611527114">Import</strong> from the shortcut menu. The <span class="wintitle" id="dli_01_0253__wintitle526612521613"><b>Import</b></span> page is displayed.<p id="dli_01_0253__p186911222355"></p>
|
</li><li id="dli_01_0253__li10384371151118">To import data on the <span class="wintitle" id="dli_01_0253__wintitle163710502399"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0253__ol39382464151459"><li id="dli_01_0253__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0253__uicontrol1351715612720"><b>SQL Editor</b></span>.</li><li id="dli_01_0253__li1773513617043">In the navigation tree on the left of <span class="uicontrol" id="dli_01_0253__uicontrol1274112477320"><b>SQL Editor</b></span>, click <strong id="dli_01_0253__b19748144733213">Databases</strong> to see all databases. Click the database where the target table belongs. The table list is displayed.</li><li id="dli_01_0253__li2614201531">Click <span><img id="dli_01_0253__image12511124192410" src="en-us_image_0237990324.png"></span> on the right of the table and choose <strong id="dli_01_0253__b17511124172416">Import</strong> from the shortcut menu. The <span class="wintitle" id="dli_01_0253__wintitle8521424132418"><b>Import</b></span> page is displayed.<p id="dli_01_0253__p186911222355"></p>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</p></li><li id="dli_01_0253__li88586820311"><span>In the <strong id="dli_01_0253__b1393765403">Import</strong> dialog box, set the parameters based on <a href="#dli_01_0253__table48581581434">Table 1</a>.</span><p>
|
</p></li><li id="dli_01_0253__li88586820311"><span>In the <strong id="dli_01_0253__b1393765403">Import</strong> dialog box, set the parameters based on <a href="#dli_01_0253__table48581581434">Table 1</a>.</span><p>
|
||||||
@ -49,8 +49,8 @@
|
|||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0253__row13845148639"><td class="cellrowborder" valign="top" width="20.3%" headers="mcps1.3.4.2.2.2.1.2.4.1.1 "><p id="dli_01_0253__p178451288318">Path</p>
|
<tr id="dli_01_0253__row13845148639"><td class="cellrowborder" valign="top" width="20.3%" headers="mcps1.3.4.2.2.2.1.2.4.1.1 "><p id="dli_01_0253__p178451288318">Path</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="64.2%" headers="mcps1.3.4.2.2.2.1.2.4.1.2 "><p id="dli_01_0253__p15845286316">You can directly enter a path or click <span><img id="dli_01_0253__image7495724120" src="en-us_image_0206789903.png"></span> and select an OBS path. If no bucket is available, you can directly switch to the OBS management console and create an OBS bucket.</p>
|
<td class="cellrowborder" valign="top" width="64.2%" headers="mcps1.3.4.2.2.2.1.2.4.1.2 "><p id="dli_01_0253__p15845286316">You can directly enter a path or click <span><img id="dli_01_0253__image108564914367" src="en-us_image_0206789903.png"></span> and select an OBS path. If no bucket is available, you can directly switch to the OBS management console and create an OBS bucket.</p>
|
||||||
<ul id="dli_01_0253__ul1231712537815"><li id="dli_01_0253__li18100130185114"><strong id="dli_01_0253__b14309031587">When creating an OBS table, you must specify a folder as the directory. If a file is specified, data import may be failed.</strong></li><li id="dli_01_0253__li827292919521"><strong id="dli_01_0253__b12630137182">If a folder and a file have the same name in the OBS directory, the file path is preferred as the path of the data to be imported.</strong></li></ul>
|
<ul id="dli_01_0253__ul1231712537815"><li id="dli_01_0253__li18100130185114"><strong id="dli_01_0253__b138585573617">When creating an OBS table, you must specify a folder as the directory. If a file is specified, data import may be failed.</strong></li><li id="dli_01_0253__li827292919521"><strong id="dli_01_0253__b12630137182">If a folder and a file have the same name in the OBS directory, the file path is preferred as the path of the data to be imported.</strong></li></ul>
|
||||||
<div class="note" id="dli_01_0253__note3205452194215"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0253__p7205155219427">The path can be a file or folder.</p>
|
<div class="note" id="dli_01_0253__note3205452194215"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0253__p7205155219427">The path can be a file or folder.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</td>
|
</td>
|
||||||
@ -121,7 +121,7 @@
|
|||||||
</div>
|
</div>
|
||||||
</p></li><li id="dli_01_0253__li41140933102555"><span>Click <span class="uicontrol" id="dli_01_0253__uicontrol19729110184318"><b>OK</b></span>.</span></li><li id="dli_01_0253__li1692315414136"><span>You can view the imported data in either of the following ways:</span><p><div class="note" id="dli_01_0253__note1153120501162"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0253__p954315081611">Currently, only the first 10 records are displayed.</p>
|
</p></li><li id="dli_01_0253__li41140933102555"><span>Click <span class="uicontrol" id="dli_01_0253__uicontrol19729110184318"><b>OK</b></span>.</span></li><li id="dli_01_0253__li1692315414136"><span>You can view the imported data in either of the following ways:</span><p><div class="note" id="dli_01_0253__note1153120501162"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0253__p954315081611">Currently, only the first 10 records are displayed.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
<ul id="dli_01_0253__ul115914114133"><li id="dli_01_0253__li1991061831318">Choose <strong id="dli_01_0253__b5957116134314">Data Management</strong> > <strong id="dli_01_0253__b15323451817">Databases and Tables</strong> in the navigation pane of the console. Locate the row that contains the database where the target table belongs and click <strong id="dli_01_0253__b189571612431">More</strong> > <strong id="dli_01_0253__b4958766439">View Properties</strong> in the <strong id="dli_01_0253__b1995816654312">Operation</strong> column. In the displayed dialog box, click the <strong id="dli_01_0253__b39592694316">Preview</strong> tab to view the imported data.</li><li id="dli_01_0253__li916071114133">In the <strong id="dli_01_0253__b12140132332517">Databases</strong> tab of the <strong id="dli_01_0253__b7925152619257">SQL Editor</strong>, click the database name to go to the table list. Click <span><img id="dli_01_0253__image1895075254716" src="en-us_image_0237994911.png"></span> on the right of a table name and choose <strong id="dli_01_0253__b1142918216261">View Properties</strong> from the shortcut menu. In the displayed dialog box, click <strong id="dli_01_0253__b94311246182615">Preview</strong> to view the imported data.</li></ul>
|
<ul id="dli_01_0253__ul115914114133"><li id="dli_01_0253__li1991061831318">Choose <strong id="dli_01_0253__b5957116134314">Data Management</strong> > <strong id="dli_01_0253__b15323451817">Databases and Tables</strong> in the navigation pane of the console. Locate the row that contains the database where the target table belongs and click <strong id="dli_01_0253__b189571612431">More</strong> > <strong id="dli_01_0253__b4958766439">View Properties</strong> in the <strong id="dli_01_0253__b1995816654312">Operation</strong> column. In the displayed dialog box, click the <strong id="dli_01_0253__b39592694316">Preview</strong> tab to view the imported data.</li><li id="dli_01_0253__li916071114133">On the <strong id="dli_01_0253__b9380336102519">Databases</strong> tab of the <strong id="dli_01_0253__b1381536122518">SQL Editor</strong>, click the database name to go to the table list. Click <span><img id="dli_01_0253__image183811836122519" src="en-us_image_0237994911.png"></span> on the right of a table name and choose <strong id="dli_01_0253__b9382153614255">View Properties</strong> from the shortcut menu. In the displayed dialog box, click <strong id="dli_01_0253__b13823367259">Preview</strong> to view the imported data.</li></ul>
|
||||||
</p></li><li id="dli_01_0253__li287251313616"><span>(Optional) View the status and execution result of the importing job on the <span class="wintitle" id="dli_01_0253__wintitle7769151419437"><b>Job Management</b></span> > <strong id="dli_01_0253__b116771945175619">SQL Jobs</strong> page.</span></li></ol>
|
</p></li><li id="dli_01_0253__li287251313616"><span>(Optional) View the status and execution result of the importing job on the <span class="wintitle" id="dli_01_0253__wintitle7769151419437"><b>Job Management</b></span> > <strong id="dli_01_0253__b116771945175619">SQL Jobs</strong> page.</span></li></ol>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -10,7 +10,7 @@
|
|||||||
<p id="dli_01_0320__p58918555015">On the OBS console, you can configure lifecycle rules for a bucket to periodically delete objects in it or change object storage classes.</p>
|
<p id="dli_01_0320__p58918555015">On the OBS console, you can configure lifecycle rules for a bucket to periodically delete objects in it or change object storage classes.</p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0320__ul17140143842412"><li id="dli_01_0320__li13836162923010">SQL statements can be executed in batches on the SQL editor page.</li></ul>
|
<ul id="dli_01_0320__ul17140143842412"><li id="dli_01_0320__li13836162923010">SQL statements can be executed in batches on the SQL editor page.</li></ul>
|
||||||
<ul id="dli_01_0320__ul2626845102419"><li id="dli_01_0320__li06261245182413">Commonly used keyworks in the job editing window are highlighted in different colors.</li><li id="dli_01_0320__li3205154892520">Both single-line comment and multi-line comment are allowed. Use two consecutive hyphens (--) in each line to comment your statements.</li></ul>
|
<ul id="dli_01_0320__ul2626845102419"><li id="dli_01_0320__li06261245182413">Commonly used syntax in the job editing window is highlighted in different colors.</li><li id="dli_01_0320__li3205154892520">Both single-line comment and multi-line comment are allowed. Use two consecutive hyphens (--) in each line to comment your statements.</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0320__en-us_topic_0093946815_section56922894165137"><h4 class="sectiontitle">Navigation pane</h4><p id="dli_01_0320__p6251406415">The navigation pane on the left consists of <strong id="dli_01_0320__b10953840124518">Databases</strong>, <strong id="dli_01_0320__b8953740124518">Queues</strong>, and <strong id="dli_01_0320__b1569505619819">Templates</strong> tabs.</p>
|
<div class="section" id="dli_01_0320__en-us_topic_0093946815_section56922894165137"><h4 class="sectiontitle">Navigation pane</h4><p id="dli_01_0320__p6251406415">The navigation pane on the left consists of <strong id="dli_01_0320__b10953840124518">Databases</strong>, <strong id="dli_01_0320__b8953740124518">Queues</strong>, and <strong id="dli_01_0320__b1569505619819">Templates</strong> tabs.</p>
|
||||||
<div class="p" id="dli_01_0320__p175519511452">
|
<div class="p" id="dli_01_0320__p175519511452">
|
||||||
@ -49,10 +49,10 @@
|
|||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0320__section1643344184212"><h4 class="sectiontitle">SQL Editing Window</h4><p id="dli_01_0320__p945042418424">SQL job editing window is displayed in the upper right part of the page.</p>
|
<div class="section" id="dli_01_0320__section1643344184212"><h4 class="sectiontitle">SQL Editing Window</h4><p id="dli_01_0320__p945042418424">SQL job editing window is displayed in the upper right part of the page. For details about the parameters, see <a href="#dli_01_0320__table18913103220552">Table 2</a>.</p>
|
||||||
<p id="dli_01_0320__p13661598106">The SQL statement editing area is below the operation bar. For details about keyboard shortcuts, see <a href="#dli_01_0320__table209301155311">Table 3</a>.</p>
|
<p id="dli_01_0320__p13661598106">The SQL statement editing area is below the operation bar. For details about keyboard shortcuts, see <a href="#dli_01_0320__table209301155311">Table 3</a>.</p>
|
||||||
<div class="p" id="dli_01_0320__p191534517811">
|
<div class="p" id="dli_01_0320__p191534517811">
|
||||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0320__table18913103220552" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Components of the SQL job editing window</caption><thead align="left"><tr id="dli_01_0320__row169141932105516"><th align="left" class="cellrowborder" valign="top" width="6.297029702970297%" id="mcps1.3.4.4.1.2.4.1.1"><p id="dli_01_0320__p233145451119">No.</p>
|
<div class="tablenoborder"><a name="dli_01_0320__table18913103220552"></a><a name="table18913103220552"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0320__table18913103220552" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Components of the SQL job editing window</caption><thead align="left"><tr id="dli_01_0320__row169141932105516"><th align="left" class="cellrowborder" valign="top" width="6.297029702970297%" id="mcps1.3.4.4.1.2.4.1.1"><p id="dli_01_0320__p233145451119">No.</p>
|
||||||
</th>
|
</th>
|
||||||
<th align="left" class="cellrowborder" valign="top" width="16.33663366336634%" id="mcps1.3.4.4.1.2.4.1.2"><p id="dli_01_0320__p660634117106">Button & Drop-Down List</p>
|
<th align="left" class="cellrowborder" valign="top" width="16.33663366336634%" id="mcps1.3.4.4.1.2.4.1.2"><p id="dli_01_0320__p660634117106">Button & Drop-Down List</p>
|
||||||
</th>
|
</th>
|
||||||
@ -65,7 +65,7 @@
|
|||||||
<td class="cellrowborder" valign="top" width="16.33663366336634%" headers="mcps1.3.4.4.1.2.4.1.2 "><p id="dli_01_0320__en-us_topic_0093946815_p42476751171120">Queues</p>
|
<td class="cellrowborder" valign="top" width="16.33663366336634%" headers="mcps1.3.4.4.1.2.4.1.2 "><p id="dli_01_0320__en-us_topic_0093946815_p42476751171120">Queues</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="77.36633663366337%" headers="mcps1.3.4.4.1.2.4.1.3 "><p id="dli_01_0320__p966853744115">Select a queue from the drop-down list box. If no queue is available, the <strong id="dli_01_0320__b6347202463119">default</strong> queue is displayed. Refer to <a href="dli_01_0363.html">Creating a Queue</a> and create a queue.</p>
|
<td class="cellrowborder" valign="top" width="77.36633663366337%" headers="mcps1.3.4.4.1.2.4.1.3 "><p id="dli_01_0320__p966853744115">Select a queue from the drop-down list box. If no queue is available, the <strong id="dli_01_0320__b6347202463119">default</strong> queue is displayed. Refer to <a href="dli_01_0363.html">Creating a Queue</a> and create a queue.</p>
|
||||||
<p id="dli_01_0320__p1045411185210">SQL jobs can be executed only on SQL queues.</p>
|
<p id="dli_01_0320__p1045411185210">SQL jobs can only be executed on SQL queues.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0320__row79141324554"><td class="cellrowborder" valign="top" width="6.297029702970297%" headers="mcps1.3.4.4.1.2.4.1.1 "><p id="dli_01_0320__p73375471110">3</p>
|
<tr id="dli_01_0320__row79141324554"><td class="cellrowborder" valign="top" width="6.297029702970297%" headers="mcps1.3.4.4.1.2.4.1.1 "><p id="dli_01_0320__p73375471110">3</p>
|
||||||
@ -189,7 +189,7 @@
|
|||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<ul id="dli_01_0320__ul11041275111"><li id="dli_01_0320__li8110128514"><strong id="dli_01_0320__b1126020011363">View Result</strong>
|
<ul id="dli_01_0320__ul11041275111"><li id="dli_01_0320__li8110128514"><strong id="dli_01_0320__b1126020011363">View Result</strong>
|
||||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0320__table6501195117171" frame="border" border="1" rules="all"><caption><b>Table 5 </b>Operations in the result tab</caption><thead align="left"><tr id="dli_01_0320__row14500951131720"><th align="left" class="cellrowborder" valign="top" width="23.810000000000002%" id="mcps1.3.6.1.2.2.3.1.1"><p id="dli_01_0320__p14499051131718">Operation</p>
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0320__table6501195117171" frame="border" border="1" rules="all"><caption><b>Table 5 </b>Operations on the result tab</caption><thead align="left"><tr id="dli_01_0320__row14500951131720"><th align="left" class="cellrowborder" valign="top" width="23.810000000000002%" id="mcps1.3.6.1.2.2.3.1.1"><p id="dli_01_0320__p14499051131718">Operation</p>
|
||||||
</th>
|
</th>
|
||||||
<th align="left" class="cellrowborder" valign="top" width="76.19%" id="mcps1.3.6.1.2.2.3.1.2"><p id="dli_01_0320__p1050017511178">Description</p>
|
<th align="left" class="cellrowborder" valign="top" width="76.19%" id="mcps1.3.6.1.2.2.3.1.2"><p id="dli_01_0320__p1050017511178">Description</p>
|
||||||
</th>
|
</th>
|
||||||
@ -205,16 +205,16 @@
|
|||||||
<td class="cellrowborder" valign="top" width="76.19%" headers="mcps1.3.6.1.2.2.3.1.2 "><p id="dli_01_0320__p18500175171716">Click <span><img id="dli_01_0320__image1350075113170" src="en-us_image_0000001529468213.png"></span> to view the query result in a chart or table.</p>
|
<td class="cellrowborder" valign="top" width="76.19%" headers="mcps1.3.6.1.2.2.3.1.2 "><p id="dli_01_0320__p18500175171716">Click <span><img id="dli_01_0320__image1350075113170" src="en-us_image_0000001529468213.png"></span> to view the query result in a chart or table.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0320__row13501195131714"><td class="cellrowborder" valign="top" width="23.810000000000002%" headers="mcps1.3.6.1.2.2.3.1.1 "><p id="dli_01_0320__p19501551101718">Export the result</p>
|
<tr id="dli_01_0320__row13501195131714"><td class="cellrowborder" valign="top" width="23.810000000000002%" headers="mcps1.3.6.1.2.2.3.1.1 "><p id="dli_01_0320__p19501551101718">Export job results</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="76.19%" headers="mcps1.3.6.1.2.2.3.1.2 "><p id="dli_01_0320__p35015511179">Export the job execution results to the created OBS bucket. For details, see <a href="dli_01_0017.html">SQL Job Management</a>.</p>
|
<td class="cellrowborder" valign="top" width="76.19%" headers="mcps1.3.6.1.2.2.3.1.2 "><p id="dli_01_0320__p35015511179">Export the job execution results to the created OBS bucket. </p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
</tbody>
|
</tbody>
|
||||||
</table>
|
</table>
|
||||||
</div>
|
</div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<div class="section" id="dli_01_0320__en-us_topic_0093946815_section6030699152035"><h4 class="sectiontitle">SQL Query Procedure</h4><ol id="dli_01_0320__ol110111316715"><li id="dli_01_0320__li2070131479">Log in to the DLI management console. On the page displayed, choose <strong id="dli_01_0320__b63618581982">Job Management</strong> > <strong id="dli_01_0320__b74187252918">SQL Jobs</strong>. On the page displayed, click <strong id="dli_01_0320__b59156304102">Create Job</strong>.<div class="note" id="dli_01_0320__note119573472206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0320__p5958124710203">On the SQL editor page, the system prompts you to create an OBS bucket to store temporary data generated by DLI jobs. In the <strong id="dli_01_0320__b291314330127">Set Job Bucket</strong> dialog box, click <strong id="dli_01_0320__b834914436125">Setting</strong>. On the page displayed, click the edit button in the upper right corner of the job bucket card. In the <strong id="dli_01_0320__b138913547131">Set Job Bucket</strong> dialog box displayed, enter the job bucket path and click <strong id="dli_01_0320__b61474198147">OK</strong>.</p>
|
<div class="section" id="dli_01_0320__en-us_topic_0093946815_section6030699152035"><h4 class="sectiontitle">SQL Query Procedure</h4><ol id="dli_01_0320__ol110111316715"><li id="dli_01_0320__li2070131479">Log in to the DLI management console. On the page displayed, choose <strong id="dli_01_0320__b63618581982">Job Management</strong> > <strong id="dli_01_0320__b74187252918">SQL Jobs</strong>. On the page displayed, click <strong id="dli_01_0320__b59156304102">Create Job</strong>.<div class="note" id="dli_01_0320__note119573472206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0320__p5958124710203">On the SQL editor page, the system prompts you to create an OBS bucket to store temporary data generated by DLI jobs. In the <strong id="dli_01_0320__b139551414103118">Set Job Bucket</strong> dialog box, click <strong id="dli_01_0320__b11955121411315">Setting</strong>. On the page displayed, click the edit button in the upper right corner of the job bucket card. In the <strong id="dli_01_0320__b051362316315">Set Job Bucket</strong> dialog box displayed, enter the job bucket path and click <strong id="dli_01_0320__b1651362353110">OK</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li><li id="dli_01_0320__li11718136711">Select a queue from the queue list in the upper left corner of the SQL job editing window. For details about how to create a queue, see <a href="dli_01_0363.html">Creating a Queue</a>.</li><li id="dli_01_0320__li813817834515">In the upper right corner of the SQL job editing window, select a database, for example, <span class="parmvalue" id="dli_01_0320__parmvalue15915351115713"><b>qw</b></span>, from the <strong id="dli_01_0320__b237816275810">Databases</strong> drop-down list.</li><li id="dli_01_0320__li38121318715">Create a table, for example, <strong id="dli_01_0320__b104711617155817">qw</strong>. For details about how to create a database and table, see <a href="dli_01_0005.html">Creating a Database or a Table</a>.</li><li id="dli_01_0320__li11683162919577">In the SQL job editing window, enter the following SQL statement:<div class="codecoloring" codetype="Sql" id="dli_01_0320__screen109547551261"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">qw</span><span class="p">.</span><span class="n">qw</span><span class="w"> </span><span class="k">LIMIT</span><span class="w"> </span><span class="mi">10</span><span class="p">;</span>
|
</li><li id="dli_01_0320__li11718136711">Select a queue from the queue list in the upper left corner of the SQL job editing window. For details about how to create a queue, see <a href="dli_01_0363.html">Creating a Queue</a>.</li><li id="dli_01_0320__li813817834515">In the upper right corner of the SQL job editing window, select a database, for example, <span class="parmvalue" id="dli_01_0320__parmvalue15915351115713"><b>qw</b></span>, from the <strong id="dli_01_0320__b237816275810">Databases</strong> drop-down list.</li><li id="dli_01_0320__li38121318715">Create a table, for example, <strong id="dli_01_0320__b104711617155817">qw</strong>. For details about how to create a database and table, see <a href="dli_01_0005.html">Creating a Database or a Table</a>.</li><li id="dli_01_0320__li11683162919577">In the SQL job editing window, enter the following SQL statement:<div class="codecoloring" codetype="Sql" id="dli_01_0320__screen109547551261"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">qw</span><span class="p">.</span><span class="n">qw</span><span class="w"> </span><span class="k">LIMIT</span><span class="w"> </span><span class="mi">10</span><span class="p">;</span>
|
||||||
</pre></div></td></tr></table></div>
|
</pre></div></td></tr></table></div>
|
||||||
|
@ -8,53 +8,53 @@
|
|||||||
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane of the DLI management console, click <span class="uicontrol" id="dli_01_0363__uicontrol1996404019456"><b>SQL Editor</b></span>.</li><li id="dli_01_0363__li1864613225498">Click <strong id="dli_01_0363__b39030518577">Queues</strong>. On the tab page displayed, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> on the right to create a queue.</li></ol>
|
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane of the DLI management console, click <span class="uicontrol" id="dli_01_0363__uicontrol1996404019456"><b>SQL Editor</b></span>.</li><li id="dli_01_0363__li1864613225498">Click <strong id="dli_01_0363__b39030518577">Queues</strong>. On the tab page displayed, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> on the right to create a queue.</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</li><li id="dli_01_0363__li1472111916293">On the <strong id="dli_01_0363__b1674113163515">Create Queue</strong> page displayed, set the parameters according to <a href="#dli_01_0363__table17301125219910">Table 1</a>.
|
</li><li id="dli_01_0363__li1472111916293">On the <strong id="dli_01_0363__b1674113163515">Create Queue</strong> page displayed, set the parameters according to <a href="#dli_01_0363__table17301125219910">Table 1</a>.
|
||||||
<div class="tablenoborder"><a name="dli_01_0363__table17301125219910"></a><a name="table17301125219910"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0363__table17301125219910" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="dli_01_0363__row112973522913"><th align="left" class="cellrowborder" valign="top" width="14.77%" id="mcps1.3.3.2.2.3.2.3.1.1"><p id="dli_01_0363__p17297145215918">Parameter</p>
|
<div class="tablenoborder"><a name="dli_01_0363__table17301125219910"></a><a name="table17301125219910"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0363__table17301125219910" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="dli_01_0363__row112973522913"><th align="left" class="cellrowborder" valign="top" width="14.75%" id="mcps1.3.3.2.2.3.2.3.1.1"><p id="dli_01_0363__p17297145215918">Parameter</p>
|
||||||
</th>
|
</th>
|
||||||
<th align="left" class="cellrowborder" valign="top" width="85.22999999999999%" id="mcps1.3.3.2.2.3.2.3.1.2"><p id="dli_01_0363__p1229775212915">Description</p>
|
<th align="left" class="cellrowborder" valign="top" width="85.25%" id="mcps1.3.3.2.2.3.2.3.1.2"><p id="dli_01_0363__p1229775212915">Description</p>
|
||||||
</th>
|
</th>
|
||||||
</tr>
|
</tr>
|
||||||
</thead>
|
</thead>
|
||||||
<tbody><tr id="dli_01_0363__row132972521295"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p029718521495">Name</p>
|
<tbody><tr id="dli_01_0363__row132972521295"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p029718521495">Name</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p192978528910">Name of a queue.</p>
|
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p192978528910">Name of a queue.</p>
|
||||||
<ul id="dli_01_0363__ul429710528910"><li id="dli_01_0363__li162973521797">The queue name can contain only digits, letters, and underscores (_), but cannot contain only digits, start with an underscore (_), or be left unspecified.</li><li id="dli_01_0363__li12978521191">The length of the name cannot exceed 128 characters.</li></ul>
|
<ul id="dli_01_0363__ul429710528910"><li id="dli_01_0363__li162973521797">The queue name can contain only digits, letters, and underscores (_), but cannot contain only digits, start with an underscore (_), or be left unspecified.</li><li id="dli_01_0363__li12978521191">The length of the name cannot exceed 128 characters.</li></ul>
|
||||||
<div class="note" id="dli_01_0363__note13297452697"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p192979529919">The queue name is case-insensitive. Uppercase letters will be automatically converted to lowercase letters.</p>
|
<div class="note" id="dli_01_0363__note13297452697"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p192979529919">The queue name is case-insensitive. Uppercase letters will be automatically converted to lowercase letters.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0363__row82981752094"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p629715213917">Type</p>
|
<tr id="dli_01_0363__row82981752094"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p629715213917">Type</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><ul id="dli_01_0363__ul1029875217914"><li id="dli_01_0363__li1229745218914"><strong id="dli_01_0363__b3471630195419">For SQL</strong>: compute resources used for SQL jobs.</li><li id="dli_01_0363__li1829818521296"><strong id="dli_01_0363__b8738194132314">For general purpose</strong>: compute resources used for Spark and Flink jobs.<div class="note" id="dli_01_0363__note17601813184718"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1440855224617">Selecting <strong id="dli_01_0363__b4152202311213">Dedicated Resource Mode</strong> enables you to create a dedicated queue. Enhanced datasource connections can only be created for dedicated queues. </p>
|
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><ul id="dli_01_0363__ul1029875217914"><li id="dli_01_0363__li1229745218914"><strong id="dli_01_0363__b3471630195419">For SQL</strong>: compute resources used for SQL jobs.</li><li id="dli_01_0363__li1829818521296"><strong id="dli_01_0363__b8738194132314">For general purpose</strong>: compute resources used for Spark and Flink jobs.<div class="note" id="dli_01_0363__note17601813184718"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1440855224617">Selecting <strong id="dli_01_0363__b4152202311213">Dedicated Resource Mode</strong> enables you to create a dedicated queue. Enhanced datasource connections can only be created for dedicated queues. </p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0363__row202991052199"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p132987521911">Specifications</p>
|
<tr id="dli_01_0363__row202991052199"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p132987521911">Specifications</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p1992094115406">The compute nodes' total number of CUs. One CU equals one vCPU and 4 GB of memory. DLI automatically assigns CPU and memory resources to each compute node, and the client does not need to know how many compute nodes are being used.</p>
|
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p1992094115406">The compute nodes' total number of CUs. One CU equals one vCPU and 4 GB of memory. DLI automatically assigns CPU and memory resources to each compute node, and the client does not need to know how many compute nodes are being used.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0363__row62996521099"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p1129916526920">Description</p>
|
<tr id="dli_01_0363__row62996521099"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p1129916526920">Description</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p192991252199">Description of the queue to be created. The description can contain a maximum of 128 characters.</p>
|
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p192991252199">Description of the queue to be created. The description can contain a maximum of 128 characters.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0363__row1530012524917"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p3299452791">Advanced Settings</p>
|
<tr id="dli_01_0363__row1530012524917"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p3299452791">Advanced Settings</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><div class="p" id="dli_01_0363__p0300185215911">In the <span class="parmname" id="dli_01_0363__parmname12909114468"><b>Queue Type</b></span> area, select <span class="parmvalue" id="dli_01_0363__parmvalue639181216240"><b>Dedicated Resource Mode</b></span> and then click <strong id="dli_01_0363__b152775425810">Advanced Settings</strong>.<ul id="dli_01_0363__ul4300452895"><li id="dli_01_0363__li829905210913"><strong id="dli_01_0363__b10386158155714">Default</strong>: The system automatically configures the parameter.</li><li id="dli_01_0363__li14300852692"><strong id="dli_01_0363__b5653124465512">Custom</strong><p id="dli_01_0363__p1730085219912"><span class="parmname" id="dli_01_0363__parmname146519343320"><b>CIDR Block</b></span>: You can specify the CIDR block. For details, see <a href="dli_01_0443.html">Modifying the CIDR Block</a>. If DLI enhanced datasource connection is used, the CIDR block of the DLI queue cannot overlap with that of the data source.</p>
|
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><div class="p" id="dli_01_0363__p0300185215911">In the <span class="parmname" id="dli_01_0363__parmname12909114468"><b>Queue Type</b></span> area, select <span class="parmvalue" id="dli_01_0363__parmvalue639181216240"><b>Dedicated Resource Mode</b></span> and then click <strong id="dli_01_0363__b152775425810">Advanced Settings</strong>.<ul id="dli_01_0363__ul4300452895"><li id="dli_01_0363__li829905210913"><strong id="dli_01_0363__b10386158155714">Default</strong>: The system automatically configures the parameter.</li><li id="dli_01_0363__li14300852692"><strong id="dli_01_0363__b5653124465512">Custom</strong><p id="dli_01_0363__p1730085219912"><span class="parmname" id="dli_01_0363__parmname146519343320"><b>CIDR Block</b></span>: You can specify the CIDR block. For details, see <a href="dli_01_0443.html">Modifying the CIDR Block</a>. If DLI enhanced datasource connection is used, the CIDR block of the DLI queue cannot overlap with that of the data source.</p>
|
||||||
<p id="dli_01_0363__p143001521498"><span class="parmname" id="dli_01_0363__parmname371585753911"><b>Queue Type</b></span>: When running an AI-related SQL job, select <span class="parmvalue" id="dli_01_0363__parmvalue74576129408"><b>AI-enhanced</b></span>. When running other jobs, select <span class="parmvalue" id="dli_01_0363__parmvalue124431427194019"><b>Basic</b></span>.</p>
|
<p id="dli_01_0363__p143001521498"><span class="parmname" id="dli_01_0363__parmname371585753911"><b>Queue Type</b></span>: When running an AI-related SQL job, select <span class="parmvalue" id="dli_01_0363__parmvalue74576129408"><b>AI-enhanced</b></span>. When running other jobs, select <span class="parmvalue" id="dli_01_0363__parmvalue124431427194019"><b>Basic</b></span>.</p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0363__row113007527911"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p13300252599">Tags</p>
|
<tr id="dli_01_0363__row113007527911"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.3.2.2.3.2.3.1.1 "><p id="dli_01_0363__p13300252599">Tags</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p7662154145213">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
|
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.3.2.2.3.2.3.1.2 "><p id="dli_01_0363__p7662154145213">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
|
||||||
<div class="note" id="dli_01_0363__note15300105218914"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0363__ul1830018521911"><li id="dli_01_0363__li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0363__li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0363__li14484164661614">The key name in each resource must be unique.</li></ul>
|
<div class="note" id="dli_01_0363__note15300105218914"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0363__ul1830018521911"><li id="dli_01_0363__li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0363__li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0363__li14484164661614">The key name in each resource must be unique.</li></ul>
|
||||||
</div></div>
|
</div></div>
|
||||||
<ul id="dli_01_0363__ul1300052697"><li id="dli_01_0363__li5300952598">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0363__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0363__b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0363__ul1300052697"><li id="dli_01_0363__li5300952598">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0363__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0363__b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li><li id="dli_01_0363__li730019524916">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0363__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
</li><li id="dli_01_0363__li730019524916">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0363__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
@ -47,7 +47,7 @@
|
|||||||
<ul id="dli_01_0367__ul6617123554815"><li id="dli_01_0367__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0367__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0367__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0367__ul6617123554815"><li id="dli_01_0367__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0367__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0367__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0367__ul16911451899"><li id="dli_01_0367__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0367__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0367__ul16911451899"><li id="dli_01_0367__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0367__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
@ -3,7 +3,7 @@
|
|||||||
<h1 class="topictitle1">Modifying the Owners of Databases and Tables</h1>
|
<h1 class="topictitle1">Modifying the Owners of Databases and Tables</h1>
|
||||||
<div id="body1569491496985"><p id="dli_01_0376__p7729122613405">During actual use, developers create databases and tables and submit them to test personnel for testing. After the test is complete, the databases and tables are transferred to O&M personnel for user experience. In this case, you can change the owner of the databases and tables to transfer data to other owners.</p>
|
<div id="body1569491496985"><p id="dli_01_0376__p7729122613405">During actual use, developers create databases and tables and submit them to test personnel for testing. After the test is complete, the databases and tables are transferred to O&M personnel for user experience. In this case, you can change the owner of the databases and tables to transfer data to other owners.</p>
|
||||||
<div class="section" id="dli_01_0376__section48746710711"><h4 class="sectiontitle">Modifying the Database Owner</h4><div class="p" id="dli_01_0376__p17554192016499">You can change the owner of a database on either the <span class="wintitle" id="dli_01_0376__wintitle112031233219"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0376__wintitle112037333118"><b>SQL Editor</b></span> page.<ul id="dli_01_0376__ul10405142364818"><li id="dli_01_0376__li2040592311485">On the <span class="wintitle" id="dli_01_0376__wintitle1588611347119"><b>Data Management</b></span> page, change the database owner.<ol id="dli_01_0376__ol153397745813"><li id="dli_01_0376__li182443471248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0376__uicontrol14267241951"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0376__uicontrol226424355"><b>Databases and Tables</b></span>.</li><li id="dli_01_0376__li1924517478247">On the <span class="wintitle" id="dli_01_0376__wintitle25814432053"><b>Databases and Tables</b></span> page, locate the database you want and click <strong id="dli_01_0376__b029313718312">More</strong> > <span class="uicontrol" id="dli_01_0376__uicontrol119711541751"><b>Modify Database</b></span> in the <strong id="dli_01_0376__b829315585512">Operation</strong> column.</li><li id="dli_01_0376__li1979150165815">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol3175153914115"><b>OK</b></span>.</li></ol>
|
<div class="section" id="dli_01_0376__section48746710711"><h4 class="sectiontitle">Modifying the Database Owner</h4><div class="p" id="dli_01_0376__p17554192016499">You can change the owner of a database on either the <span class="wintitle" id="dli_01_0376__wintitle112031233219"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0376__wintitle112037333118"><b>SQL Editor</b></span> page.<ul id="dli_01_0376__ul10405142364818"><li id="dli_01_0376__li2040592311485">On the <span class="wintitle" id="dli_01_0376__wintitle1588611347119"><b>Data Management</b></span> page, change the database owner.<ol id="dli_01_0376__ol153397745813"><li id="dli_01_0376__li182443471248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0376__uicontrol14267241951"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0376__uicontrol226424355"><b>Databases and Tables</b></span>.</li><li id="dli_01_0376__li1924517478247">On the <span class="wintitle" id="dli_01_0376__wintitle25814432053"><b>Databases and Tables</b></span> page, locate the database you want and click <strong id="dli_01_0376__b029313718312">More</strong> > <span class="uicontrol" id="dli_01_0376__uicontrol119711541751"><b>Modify Database</b></span> in the <strong id="dli_01_0376__b829315585512">Operation</strong> column.</li><li id="dli_01_0376__li1979150165815">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol3175153914115"><b>OK</b></span>.</li></ol>
|
||||||
</li><li id="dli_01_0376__li10384371151118">Change the database owner on the <span class="wintitle" id="dli_01_0376__wintitle1853761213618"><b>SQL Editor</b></span> page.<ol id="dli_01_0376__ol39382464151459"><li id="dli_01_0376__li169951648123920">On the left of the management console, click <strong id="dli_01_0376__b198591277618">SQL Editor</strong>.</li><li id="dli_01_0376__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0376__b589495416313">Databases</strong>, click <span><img id="dli_01_0376__image10279959109" src="en-us_image_0237984360.png"></span> on the right of the database you want to modify, and choose <strong id="dli_01_0376__b590012548318">Modify Database</strong> from the shortcut menu.</li><li id="dli_01_0376__li0998173818546">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol1952613461213"><b>OK</b></span>.</li></ol>
|
</li><li id="dli_01_0376__li10384371151118">Change the database owner on the <span class="wintitle" id="dli_01_0376__wintitle1853761213618"><b>SQL Editor</b></span> page.<ol id="dli_01_0376__ol39382464151459"><li id="dli_01_0376__li169951648123920">On the left of the management console, click <strong id="dli_01_0376__b198591277618">SQL Editor</strong>.</li><li id="dli_01_0376__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0376__b71971655102315">Databases</strong>, click <span><img id="dli_01_0376__image819875518239" src="en-us_image_0237984360.png"></span> on the right of the database you want to modify, and choose <strong id="dli_01_0376__b21982055122314">Modify Database</strong> from the shortcut menu.</li><li id="dli_01_0376__li0998173818546">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol1952613461213"><b>OK</b></span>.</li></ol>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -6,12 +6,61 @@
|
|||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0378__section189215415182"><h4 class="sectiontitle">Functions</h4><p id="dli_01_0378__p3872545124817">You can query and analyze heterogeneous data sources such as RDS, and GaussDB(DWS) on the cloud using access methods, such as visualized interface, RESTful API, JDBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, and ORC.</p>
|
<div class="section" id="dli_01_0378__section189215415182"><h4 class="sectiontitle">Functions</h4><p id="dli_01_0378__p3872545124817">You can query and analyze heterogeneous data sources such as RDS, and GaussDB(DWS) on the cloud using access methods, such as visualized interface, RESTful API, JDBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, and ORC.</p>
|
||||||
<ul id="dli_01_0378__ul95252494910"><li id="dli_01_0378__li37017520555">Basic functions<ul id="dli_01_0378__ul33508814556"><li id="dli_01_0378__li4884112014444">You can use standard SQL statements to query in SQL jobs. </li><li id="dli_01_0378__li583064563216">Flink jobs support Flink SQL online analysis. Aggregation functions such as Window and Join, geographic functions, and CEP functions are supported. SQL is used to express service logic, facilitating service implementation. </li><li id="dli_01_0378__li652124194912">For spark jobs, fully-managed Spark computing can be performed. You can submit computing tasks through interactive sessions or in batch to analyze data in the fully managed Spark queues. </li></ul>
|
<ul id="dli_01_0378__ul95252494910"><li id="dli_01_0378__li37017520555">Basic functions<ul id="dli_01_0378__ul33508814556"><li id="dli_01_0378__li4884112014444">You can use standard SQL statements to query in SQL jobs. </li><li id="dli_01_0378__li583064563216">Flink jobs support Flink SQL online analysis. Aggregation functions such as Window and Join, geographic functions, and CEP functions are supported. SQL is used to express service logic, facilitating service implementation. </li><li id="dli_01_0378__li652124194912">For spark jobs, fully-managed Spark computing can be performed. You can submit computing tasks through interactive sessions or in batch to analyze data in the fully managed Spark queues. </li></ul>
|
||||||
</li><li id="dli_01_0378__li13705141165713">Federated analysis of heterogeneous data sources<ul id="dli_01_0378__ul14754404579"><li id="dli_01_0378__li68911658193117">Spark datasource connection: Data sources such as DWS, RDS, and CSS can be accessed through DLI. </li><li id="dli_01_0378__li9919175613471">Interconnection with multiple cloud services is supported in Flink jobs to form a rich stream ecosystem. The DLI stream ecosystem consists of cloud service ecosystems and open source ecosystems.<ul id="dli_01_0378__ul4978181016481"><li id="dli_01_0378__li10978151011487">Cloud service ecosystem: DLI can interconnect with other services in Flink SQL. You can directly use SQL to read and write data from cloud services.</li><li id="dli_01_0378__li4978610154816">Open-source ecosystems: After connections to other VPCs are established through datasource connections, you can access all data sources and output targets (such as Kafka, HBase, and Elasticsearch) supported by Flink and Spark in your dedicated DLI queue.</li></ul>
|
</li><li id="dli_01_0378__li13705141165713">Federated analysis of heterogeneous data sources<ul id="dli_01_0378__ul14754404579"><li id="dli_01_0378__li68911658193117">Spark datasource connection: Data sources such as GaussDB(DWS), RDS, and CSS can be accessed through DLI. </li><li id="dli_01_0378__li9919175613471">Interconnection with multiple cloud services is supported in Flink jobs to form a rich stream ecosystem. The DLI stream ecosystem consists of cloud service ecosystems and open source ecosystems.<ul id="dli_01_0378__ul4978181016481"><li id="dli_01_0378__li10978151011487">Cloud service ecosystem: DLI can interconnect with other services in Flink SQL. You can directly use SQL to read and write data from cloud services.</li><li id="dli_01_0378__li4978610154816">Open-source ecosystems: After connections to other VPCs are established through datasource connections, you can access all data sources and output targets (such as Kafka, HBase, and Elasticsearch) supported by Flink and Spark in your dedicated DLI queue.</li></ul>
|
||||||
<p id="dli_01_0378__p11978131024820"></p>
|
<p id="dli_01_0378__p11978131024820"></p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</li><li id="dli_01_0378__li620462561618">Storage-compute decoupling<p id="dli_01_0378__p12236173712168"><a name="dli_01_0378__li620462561618"></a><a name="li620462561618"></a>DLI is interconnected with OBS for data analysis. In this architecture where storage and compute are decoupled, resources of these two types are charged separately, helping you reduce costs and improving resource utilization.</p>
|
</li><li id="dli_01_0378__li620462561618">Storage-compute decoupling<p id="dli_01_0378__p12236173712168"><a name="dli_01_0378__li620462561618"></a><a name="li620462561618"></a>DLI is interconnected with OBS for data analysis. In this architecture where storage and compute are decoupled, resources of these two types are charged separately, helping you reduce costs and improving resource utilization.</p>
|
||||||
<p id="dli_01_0378__p656615493515">You can choose single-AZ or multi-AZ storage when you create an OBS bucket for storing redundant data on the DLI console. The differences between the two storage policies are as follows:</p>
|
<p id="dli_01_0378__p656615493515">You can choose single-AZ or multi-AZ storage when you create an OBS bucket for storing redundant data on the DLI console. The differences between the two storage policies are as follows:</p>
|
||||||
<ul id="dli_01_0378__ul1139013284314"><li id="dli_01_0378__li1244173017434">Multi-AZ storage means data is stored in multiple AZs, improving data reliability. If the multi-AZ storage is enabled for a bucket, data is stored in multiple AZs in the same region. If one AZ becomes unavailable, data can still be properly accessed from the other AZs. The multi-AZ storage is ideal for scenarios that demand high reliability. You are advised to use this policy.</li><li id="dli_01_0378__li9190134234418">Single-AZ storage means that data is stored in a single AZ, with lower costs. </li></ul>
|
<ul id="dli_01_0378__ul1139013284314"><li id="dli_01_0378__li1244173017434">Multi-AZ storage means data is stored in multiple AZs, improving data reliability. If the multi-AZ storage is enabled for a bucket, data is stored in multiple AZs in the same region. If one AZ becomes unavailable, data can still be properly accessed from the other AZs. The multi-AZ storage is ideal for scenarios that demand high reliability. You are advised to use this policy.</li><li id="dli_01_0378__li9190134234418">Single-AZ storage means that data is stored in a single AZ, with lower costs. </li></ul>
|
||||||
|
</li><li id="dli_01_0378__li145513501110">Elastic resource pool<p id="dli_01_0378__p1330171916542"><a name="dli_01_0378__li145513501110"></a><a name="li145513501110"></a>Elastic resource pools support the CCE cluster architecture for heterogeneous resources so you can centrally manage and allocate them. For details, see <a href="dli_01_0508.html">Elastic Resource Pool</a>.</p>
|
||||||
|
<p id="dli_01_0378__p3728784154">Elastic resource pools have the following advantages:</p>
|
||||||
|
<ul id="dli_01_0378__ul12164112181519"><li id="dli_01_0378__li016415219151"><strong id="dli_01_0378__b5154155822516">Unified management</strong><ul id="dli_01_0378__ul1218693571714"><li id="dli_01_0378__li2029283011175">You can manage multiple internal clusters and schedule jobs. You can manage millions of cores for compute resources.</li><li id="dli_01_0378__li498114313170">Elastic resource pools can be deployed across multiple AZs to support high availability.</li></ul>
|
||||||
|
</li><li id="dli_01_0378__li1150419264155"><strong id="dli_01_0378__b1368615252613">Tenant resource isolation</strong><p id="dli_01_0378__p290771761819">Resources of different queues are isolated to reduce the impact on each other.</p>
|
||||||
|
</li><li id="dli_01_0378__li272223241513"><strong id="dli_01_0378__b16351662615">Shared access and flexibility</strong><ul id="dli_01_0378__ul23661352161912"><li id="dli_01_0378__li1502749131812">Minute-level scaling helps you to handle request peaks.</li><li id="dli_01_0378__li15905830111913">Queue priorities and CU quotas can be set at different time to improve resource utilization.</li></ul>
|
||||||
|
</li><li id="dli_01_0378__li1367833751512"><strong id="dli_01_0378__b82207116260">Job-level isolation (supported in later versions)</strong><p id="dli_01_0378__p16120111112111">SQL jobs can run on independent Spark instances, reducing mutual impacts between jobs.</p>
|
||||||
|
</li><li id="dli_01_0378__li1559211427153"><strong id="dli_01_0378__b23631514182619">Automatic scaling (supported in later versions)</strong><p id="dli_01_0378__p156211304207">The queue quota is updated in real time based on workload and priority.</p>
|
||||||
|
</li></ul>
|
||||||
|
<p id="dli_01_0378__p116431932124919">Using elastic resource pools has the following advantages.</p>
|
||||||
|
|
||||||
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0378__table194674374565" frame="border" border="1" rules="all"><thead align="left"><tr id="dli_01_0378__row1846743785614"><th align="left" class="cellrowborder" valign="top" width="7.51%" id="mcps1.3.2.3.4.5.1.4.1.1"><p id="dli_01_0378__p1731485951215">Advantage</p>
|
||||||
|
</th>
|
||||||
|
<th align="left" class="cellrowborder" valign="top" width="39.92%" id="mcps1.3.2.3.4.5.1.4.1.2"><p id="dli_01_0378__p19467163745615">No Elastic Resource Pool</p>
|
||||||
|
</th>
|
||||||
|
<th align="left" class="cellrowborder" valign="top" width="52.56999999999999%" id="mcps1.3.2.3.4.5.1.4.1.3"><p id="dli_01_0378__p12467737115610">Use Elastic Resource Pool</p>
|
||||||
|
</th>
|
||||||
|
</tr>
|
||||||
|
</thead>
|
||||||
|
<tbody><tr id="dli_01_0378__row546773765617"><td class="cellrowborder" valign="top" width="7.51%" headers="mcps1.3.2.3.4.5.1.4.1.1 "><p id="dli_01_0378__p931417598126">Efficiency</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="39.92%" headers="mcps1.3.2.3.4.5.1.4.1.2 "><p id="dli_01_0378__p14467193710561">You need to set scaling tasks repeatedly to improve the resource utilization.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="52.56999999999999%" headers="mcps1.3.2.3.4.5.1.4.1.3 "><p id="dli_01_0378__p74679377564">Dynamic scaling can be done in seconds.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0378__row10467637105611"><td class="cellrowborder" rowspan="2" valign="top" width="7.51%" headers="mcps1.3.2.3.4.5.1.4.1.1 "><p id="dli_01_0378__p631415913126">Resource utilization</p>
|
||||||
|
<p id="dli_01_0378__p231913871418"></p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="39.92%" headers="mcps1.3.2.3.4.5.1.4.1.2 "><p id="dli_01_0378__p5467037195618">Resources cannot be shared among different queues.</p>
|
||||||
|
<p id="dli_01_0378__p1127911542114">For example, a queue has idle CUs and another queue is heavily loaded. Resources cannot be shared. You can only scale up the second queue.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="52.56999999999999%" headers="mcps1.3.2.3.4.5.1.4.1.3 "><p id="dli_01_0378__p184671437135615">Queues added to the same elastic resource pool can share compute resources.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0378__row1031911831417"><td class="cellrowborder" valign="top" headers="mcps1.3.2.3.4.5.1.4.1.1 "><p id="dli_01_0378__p5312181119518">When you set a data source, you must allocate different network segments to each queue, which requires a large number of VPC network segments.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.4.5.1.4.1.2 "><p id="dli_01_0378__p769213815134">You can add multiple general-purpose queues in the same elastic resource pool to one network segment, simplifying the data source configuration.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0378__row529116935714"><td class="cellrowborder" valign="top" width="7.51%" headers="mcps1.3.2.3.4.5.1.4.1.1 "><p id="dli_01_0378__p19814163512137">Resource allocation</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="39.92%" headers="mcps1.3.2.3.4.5.1.4.1.2 "><p id="dli_01_0378__p122925915716">If resources are insufficient for scale-out tasks of multiple queues, some queues will fail to be scaled out.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="52.56999999999999%" headers="mcps1.3.2.3.4.5.1.4.1.3 "><p id="dli_01_0378__p029279145715">You can set the priority for each queue in the elastic resource pool based on the peak hours to ensure proper resource allocation.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
</tbody>
|
||||||
|
</table>
|
||||||
|
</div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0378__section19222675412"><h4 class="sectiontitle">DLI Core Engine: Spark+Flink</h4><ul id="dli_01_0378__ul14792133255715"><li id="dli_01_0378__li13792103275712">Spark is a unified analysis engine that is ideal for large-scale data processing. It focuses on query, compute, and analysis. DLI optimizes performance and reconstructs services based on open-source Spark. It is compatible with the Apache Spark ecosystem and interfaces, and improves performance by 2.5x when compared with open-source Spark. In this way, DLI enables you to perform query and analysis of EB's of data within hours.</li><li id="dli_01_0378__li14792133295711">Flink is a distributed compute engine that is ideal for batch processing, that is, for processing static data sets and historical data sets. You can also use it for stream processing, that is, processing real-time data streams and generating data results in real time. DLI enhances features and security based on the open-source Flink and provides the Stream SQL feature required for data processing.</li></ul>
|
<div class="section" id="dli_01_0378__section19222675412"><h4 class="sectiontitle">DLI Core Engine: Spark+Flink</h4><ul id="dli_01_0378__ul14792133255715"><li id="dli_01_0378__li13792103275712">Spark is a unified analysis engine that is ideal for large-scale data processing. It focuses on query, compute, and analysis. DLI optimizes performance and reconstructs services based on open-source Spark. It is compatible with the Apache Spark ecosystem and interfaces, and improves performance by 2.5x when compared with open-source Spark. In this way, DLI enables you to perform query and analysis of EB's of data within hours.</li><li id="dli_01_0378__li14792133295711">Flink is a distributed compute engine that is ideal for batch processing, that is, for processing static data sets and historical data sets. You can also use it for stream processing, that is, processing real-time data streams and generating data results in real time. DLI enhances features and security based on the open-source Flink and provides the Stream SQL feature required for data processing.</li></ul>
|
||||||
|
@ -5,11 +5,11 @@
|
|||||||
<p id="dli_01_0384__p55886519497">On the <strong id="dli_01_0384__b943884293511">Overview</strong> page, click <strong id="dli_01_0384__b202117331159">Create Job</strong> in the upper right corner of the <strong id="dli_01_0384__b1696101133814">Spark Jobs</strong> tab or click <strong id="dli_01_0384__b56361152153720">Create Job</strong> in the upper right corner of the <strong id="dli_01_0384__b993313572052">Spark Jobs</strong> page. The Spark job editing page is displayed.</p>
|
<p id="dli_01_0384__p55886519497">On the <strong id="dli_01_0384__b943884293511">Overview</strong> page, click <strong id="dli_01_0384__b202117331159">Create Job</strong> in the upper right corner of the <strong id="dli_01_0384__b1696101133814">Spark Jobs</strong> tab or click <strong id="dli_01_0384__b56361152153720">Create Job</strong> in the upper right corner of the <strong id="dli_01_0384__b993313572052">Spark Jobs</strong> page. The Spark job editing page is displayed.</p>
|
||||||
<p id="dli_01_0384__p9427817122315">On the Spark job editing page, a message is displayed, indicating that a temporary DLI data bucket will be created. The created bucket is used to store temporary data generated by DLI, such as job logs and job results. You cannot view job logs if you choose not to create it. The bucket will be created and the default bucket name is used.</p>
|
<p id="dli_01_0384__p9427817122315">On the Spark job editing page, a message is displayed, indicating that a temporary DLI data bucket will be created. The created bucket is used to store temporary data generated by DLI, such as job logs and job results. You cannot view job logs if you choose not to create it. The bucket will be created and the default bucket name is used.</p>
|
||||||
<p id="dli_01_0384__p133447114312">If you do not need to create a DLI temporary data bucket and do not want to receive this message, select <strong id="dli_01_0384__b142701146121612">Do not show again</strong> and click <span class="uicontrol" id="dli_01_0384__uicontrol227014464167"><b>Cancel</b></span>.</p>
|
<p id="dli_01_0384__p133447114312">If you do not need to create a DLI temporary data bucket and do not want to receive this message, select <strong id="dli_01_0384__b142701146121612">Do not show again</strong> and click <span class="uicontrol" id="dli_01_0384__uicontrol227014464167"><b>Cancel</b></span>.</p>
|
||||||
<div class="section" id="dli_01_0384__section1661873674317"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0384__ul9494144631313"><li id="dli_01_0384__li749524681310">You have uploaded the dependencies to the corresponding OBS bucket on the <span class="wintitle" id="dli_01_0384__wintitle1216872122520"><b>Data Management > Package Management</b></span> page. For details, see <a href="dli_01_0367.html">Creating a Package</a>.</li><li id="dli_01_0384__li7520181309">Before creating a Spark job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a cross-source connection to enable the network between the job running queue and external data sources.<ul id="dli_01_0384__ul850415199816"><li id="dli_01_0384__li18451528175">For details about the external data sources that can be accessed by Spark jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0384__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0384__p881561411413">On the <strong id="dli_01_0384__b122201520155014">Resources</strong> > <strong id="dli_01_0384__b1022002035016">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0384__b112219202504">More</strong> > <strong id="dli_01_0384__b0221182013507">Test Address Connectivity</strong> in the <strong id="dli_01_0384__b422192015507">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
|
<div class="section" id="dli_01_0384__section1661873674317"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0384__ul9494144631313"><li id="dli_01_0384__li749524681310">You have uploaded the dependencies to the corresponding OBS bucket on the <span class="wintitle" id="dli_01_0384__wintitle1216872122520"><b>Data Management > Package Management</b></span> page. For details, see <a href="dli_01_0367.html">Creating a Package</a>.</li><li id="dli_01_0384__li7520181309">Before creating a Spark job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a datasource connection to enable the network between the job running queue and external data sources.<ul id="dli_01_0384__ul850415199816"><li id="dli_01_0384__li18451528175">For details about the external data sources that can be accessed by Spark jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0384__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0384__p881561411413">On the <strong id="dli_01_0384__b122201520155014">Resources</strong> > <strong id="dli_01_0384__b1022002035016">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0384__b112219202504">More</strong> > <strong id="dli_01_0384__b0221182013507">Test Address Connectivity</strong> in the <strong id="dli_01_0384__b422192015507">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0384__en-us_topic_0115200017_en-us_topic_0093946815_section56922894165137"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0384__ol122721522319"><li id="dli_01_0384__li222710156233">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0384__menucascade132155932616"><b><span class="uicontrol" id="dli_01_0384__uicontrol32118599262">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0384__menucascade72217593267"><b><span class="uicontrol" id="dli_01_0384__uicontrol121165910263">Spark Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0384__wintitle622459102618"><b>Spark Jobs</b></span> page is displayed.<p id="dli_01_0384__p125041257172514">Click <strong id="dli_01_0384__b1440711414513">Create Job</strong> in the upper right corner. In the job editing window, you can set parameters in <span class="wintitle" id="dli_01_0384__wintitle688145014501"><b>Fill Form</b></span> mode or <span class="wintitle" id="dli_01_0384__wintitle52218855114"><b>Write API</b></span> mode.</p>
|
<div class="section" id="dli_01_0384__en-us_topic_0115200017_en-us_topic_0093946815_section56922894165137"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0384__ol122721522319"><li id="dli_01_0384__li222710156233">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0384__menucascade132155932616"><b><span class="uicontrol" id="dli_01_0384__uicontrol32118599262">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0384__menucascade72217593267"><b><span class="uicontrol" id="dli_01_0384__uicontrol121165910263">Spark Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0384__wintitle622459102618"><b>Spark Jobs</b></span> page is displayed.<p id="dli_01_0384__p125041257172514">Click <strong id="dli_01_0384__b1418813320336">Create Job</strong> in the upper right corner. In the job editing window, you can set parameters in <span class="wintitle" id="dli_01_0384__wintitle818813133317"><b>Fill Form</b></span> mode or <span class="wintitle" id="dli_01_0384__wintitle1018853203310"><b>Write API</b></span> mode.</p>
|
||||||
<p id="dli_01_0384__p656240152720">The following uses the <span class="wintitle" id="dli_01_0384__wintitle33192491712"><b>Fill Form</b></span> as an example. In <span class="wintitle" id="dli_01_0384__wintitle10325104915119"><b>Write API</b></span> mode, refer to the <em id="dli_01_0384__i83261649417">Data Lake Insight API Reference</em> for parameter settings.</p>
|
<p id="dli_01_0384__p656240152720">The following uses the <span class="wintitle" id="dli_01_0384__wintitle33192491712"><b>Fill Form</b></span> as an example. In <span class="wintitle" id="dli_01_0384__wintitle10325104915119"><b>Write API</b></span> mode, refer to the <em id="dli_01_0384__i83261649417">Data Lake Insight API Reference</em> for parameter settings.</p>
|
||||||
</li></ol><ol start="2" id="dli_01_0384__ol7424164372311"><li id="dli_01_0384__li5424174342310">Select a queue.<p id="dli_01_0384__p205488292241"><a name="dli_01_0384__li5424174342310"></a><a name="li5424174342310"></a>Select the queue you want to use from the drop-down list box.</p>
|
</li></ol><ol start="2" id="dli_01_0384__ol7424164372311"><li id="dli_01_0384__li5424174342310">Select a queue.<p id="dli_01_0384__p205488292241"><a name="dli_01_0384__li5424174342310"></a><a name="li5424174342310"></a>Select the queue you want to use from the drop-down list box.</p>
|
||||||
</li><li id="dli_01_0384__li1842454372317">Configure the job.<p id="dli_01_0384__p844395655015"><a name="dli_01_0384__li1842454372317"></a><a name="li1842454372317"></a>Configure job parameters by referring to <a href="#dli_01_0384__table15251951125017">Table 1</a>.</p>
|
</li><li id="dli_01_0384__li1842454372317">Configure the job.<p id="dli_01_0384__p844395655015"><a name="dli_01_0384__li1842454372317"></a><a name="li1842454372317"></a>Configure job parameters by referring to <a href="#dli_01_0384__table15251951125017">Table 1</a>.</p>
|
||||||
@ -29,6 +29,7 @@
|
|||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p14248351155014">Select the package to be executed. The value can be <strong id="dli_01_0384__b151323445615">.jar</strong> or <strong id="dli_01_0384__b1275553713561">.py</strong>.</p>
|
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p14248351155014">Select the package to be executed. The value can be <strong id="dli_01_0384__b151323445615">.jar</strong> or <strong id="dli_01_0384__b1275553713561">.py</strong>.</p>
|
||||||
<p id="dli_01_0384__p14448114151112">You can select the name of a JAR or pyFile package that has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_01_0384__b878815345588">obs://</strong><em id="dli_01_0384__i1789534205815">Bucket name</em><strong id="dli_01_0384__b3789534125813">/</strong><em id="dli_01_0384__i479014347589">Package name</em>.</p>
|
<p id="dli_01_0384__p14448114151112">You can select the name of a JAR or pyFile package that has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_01_0384__b878815345588">obs://</strong><em id="dli_01_0384__i1789534205815">Bucket name</em><strong id="dli_01_0384__b3789534125813">/</strong><em id="dli_01_0384__i479014347589">Package name</em>.</p>
|
||||||
|
<p id="dli_01_0384__p845651720914">Spark 3.3.<em id="dli_01_0384__i184278411159">x</em> or later supports only packages in OBS paths.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0384__row82481351105015"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p324815185016">Main Class (--class)</p>
|
<tr id="dli_01_0384__row82481351105015"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p324815185016">Main Class (--class)</p>
|
||||||
|
@ -6,74 +6,64 @@
|
|||||||
<ul id="dli_01_0403__ul3319024204014"><li id="dli_01_0403__li153191024124015"><strong id="dli_01_0403__b582202818343">Flink SQL</strong> uses SQL statements to define jobs and can be submitted to any general purpose queue.</li><li id="dli_01_0403__li069317403210"><strong id="dli_01_0403__b208655222421">Flink Jar</strong> customizes a JAR package job based on Flink APIs. It runs on dedicated queues.</li></ul>
|
<ul id="dli_01_0403__ul3319024204014"><li id="dli_01_0403__li153191024124015"><strong id="dli_01_0403__b582202818343">Flink SQL</strong> uses SQL statements to define jobs and can be submitted to any general purpose queue.</li><li id="dli_01_0403__li069317403210"><strong id="dli_01_0403__b208655222421">Flink Jar</strong> customizes a JAR package job based on Flink APIs. It runs on dedicated queues.</li></ul>
|
||||||
<p id="dli_01_0403__p66161828392">Flink job management provides the following functions:</p>
|
<p id="dli_01_0403__p66161828392">Flink job management provides the following functions:</p>
|
||||||
<ul id="dli_01_0403__ul8657743184112"><li id="dli_01_0403__li81824019583"><a href="dli_01_0479.html">Managing Flink Job Permissions</a></li><li id="dli_01_0403__li19657124354118"><a href="dli_01_0455.html">Creating a Flink SQL Job</a></li><li id="dli_01_0403__li49002025195814"><a href="dli_01_0457.html">Creating a Flink Jar Job</a></li><li id="dli_01_0403__li321633381117"><a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a job</a></li><li id="dli_01_0403__li149164314117"><a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a></li><li id="dli_01_0403__li1918757145613"><a href="dli_01_0461.html#dli_01_0461__section8678193324114">Stopping a Job</a></li><li id="dli_01_0403__li14179161612574"><a href="dli_01_0461.html#dli_01_0461__section1691624195713">Deleting a Job</a></li><li id="dli_01_0403__li529715414492"><a href="dli_01_0461.html#dli_01_0461__section135831511323">Exporting a Job</a></li><li id="dli_01_0403__li12456172025013"><a href="dli_01_0461.html#dli_01_0461__section75781665389">Importing a Job</a></li><li id="dli_01_0403__li7887305574"><a href="dli_01_0461.html#dli_01_0461__section15861321183619">Modifying Name and Description</a></li><li id="dli_01_0403__li131144243198"><a href="dli_01_0461.html#dli_01_0461__section83412445175">Importing to a Savepoint</a></li><li id="dli_01_0403__li5693174816504"><a href="dli_01_0461.html#dli_01_0461__section11401152191015">Triggering a Savepoint</a></li><li id="dli_01_0403__li255018247317"><a href="dli_01_0461.html#dli_01_0461__section48961252113110">Runtime Configuration</a></li><li id="dli_01_0403__li153181731145913"><a href="dli_01_0462.html">Job Details</a></li></ul>
|
<ul id="dli_01_0403__ul8657743184112"><li id="dli_01_0403__li81824019583"><a href="dli_01_0479.html">Managing Flink Job Permissions</a></li><li id="dli_01_0403__li19657124354118"><a href="dli_01_0455.html">Creating a Flink SQL Job</a></li><li id="dli_01_0403__li49002025195814"><a href="dli_01_0457.html">Creating a Flink Jar Job</a></li><li id="dli_01_0403__li321633381117"><a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a job</a></li><li id="dli_01_0403__li149164314117"><a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a></li><li id="dli_01_0403__li1918757145613"><a href="dli_01_0461.html#dli_01_0461__section8678193324114">Stopping a Job</a></li><li id="dli_01_0403__li14179161612574"><a href="dli_01_0461.html#dli_01_0461__section1691624195713">Deleting a Job</a></li><li id="dli_01_0403__li529715414492"><a href="dli_01_0461.html#dli_01_0461__section135831511323">Exporting a Job</a></li><li id="dli_01_0403__li12456172025013"><a href="dli_01_0461.html#dli_01_0461__section75781665389">Importing a Job</a></li><li id="dli_01_0403__li7887305574"><a href="dli_01_0461.html#dli_01_0461__section15861321183619">Modifying Name and Description</a></li><li id="dli_01_0403__li131144243198"><a href="dli_01_0461.html#dli_01_0461__section83412445175">Importing to a Savepoint</a></li><li id="dli_01_0403__li5693174816504"><a href="dli_01_0461.html#dli_01_0461__section11401152191015">Triggering a Savepoint</a></li><li id="dli_01_0403__li255018247317"><a href="dli_01_0461.html#dli_01_0461__section48961252113110">Runtime Configuration</a></li><li id="dli_01_0403__li153181731145913"><a href="dli_01_0462.html">Job Details</a></li></ul>
|
||||||
<div class="section" id="dli_01_0403__section12518143518488"><h4 class="sectiontitle">Assigning Agency Permissions</h4><p id="dli_01_0403__p147561066544">Agencies are required for DLI to execute Flink jobs. You can set the agency when logging in to the management console for the first time or go to <strong id="dli_01_0403__b209911447379">Global Configurations</strong> > <a href="dli_01_0486.html">Service Authorization</a> to modify the agencies.</p>
|
|
||||||
<p id="dli_01_0403__p112123218557">The permissions are as follows:</p>
|
|
||||||
<ul id="dli_01_0403__ul1393104512501"><li id="dli_01_0403__li53932045105016"><strong id="dli_01_0403__b825511452452">Tenant Administrator (global)</strong> permissions are required to access data from OBS to execute Flink jobs on DLI, for example, obtaining OBS/GaussDB(DWS) data sources, log dump (including bucket authorization), checkpointing enabling, and job import and export.<div class="note" id="dli_01_0403__note45081932194818"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p95082324484">Due to cloud service cache differences, permission setting operations require about 60 minutes to take effect.</p>
|
|
||||||
</div></div>
|
|
||||||
</li><li id="dli_01_0403__li65241851125015"><strong id="dli_01_0403__b7690104924514">DIS Administrator</strong> permissions are required to use DIS data as the data source of DLI Flink jobs.<div class="note" id="dli_01_0403__note2048353604212"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p1648414365424">Due to cloud service cache differences, permission setting operations require about 30 minutes to take effect.</p>
|
|
||||||
</div></div>
|
|
||||||
</li><li id="dli_01_0403__li15237101705317">To use CloudTable data as the data source of DLI Flink jobs, <strong id="dli_01_0403__b41312369567">CloudTable Administrator</strong> permissions are required.<div class="note" id="dli_01_0403__note0630838143813"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p663117386382">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
|
|
||||||
</div></div>
|
|
||||||
</li></ul>
|
|
||||||
</div>
|
|
||||||
<div class="section" id="dli_01_0403__section12526165519235"><h4 class="sectiontitle">Flink Jobs Page</h4><p id="dli_01_0403__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0403__b5725174712329">Overview</strong> page, click <strong id="dli_01_0403__b16730204714323">Flink Jobs</strong> to go to the Flink job management page. Alternatively, you can choose <strong id="dli_01_0403__b177319476328">Job Management</strong> > <strong id="dli_01_0403__b173184718320">Flink Jobs</strong> from the navigation pane on the left. The page displays all Flink jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>
|
<div class="section" id="dli_01_0403__section12526165519235"><h4 class="sectiontitle">Flink Jobs Page</h4><p id="dli_01_0403__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0403__b5725174712329">Overview</strong> page, click <strong id="dli_01_0403__b16730204714323">Flink Jobs</strong> to go to the Flink job management page. Alternatively, you can choose <strong id="dli_01_0403__b177319476328">Job Management</strong> > <strong id="dli_01_0403__b173184718320">Flink Jobs</strong> from the navigation pane on the left. The page displays all Flink jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>
|
||||||
|
|
||||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0403__en-us_topic_0122090417_table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Job management parameters</caption><thead align="left"><tr id="dli_01_0403__en-us_topic_0122090417_row2555468715120"><th align="left" class="cellrowborder" valign="top" width="16.07%" id="mcps1.3.7.3.2.3.1.1"><p id="dli_01_0403__en-us_topic_0122090417_p4021197415120">Parameter</p>
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0403__en-us_topic_0122090417_table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Job management parameters</caption><thead align="left"><tr id="dli_01_0403__en-us_topic_0122090417_row2555468715120"><th align="left" class="cellrowborder" valign="top" width="16.07%" id="mcps1.3.6.3.2.3.1.1"><p id="dli_01_0403__en-us_topic_0122090417_p4021197415120">Parameter</p>
|
||||||
</th>
|
</th>
|
||||||
<th align="left" class="cellrowborder" valign="top" width="83.93%" id="mcps1.3.7.3.2.3.1.2"><p id="dli_01_0403__en-us_topic_0122090417_p3594448915120">Description</p>
|
<th align="left" class="cellrowborder" valign="top" width="83.93%" id="mcps1.3.6.3.2.3.1.2"><p id="dli_01_0403__en-us_topic_0122090417_p3594448915120">Description</p>
|
||||||
</th>
|
</th>
|
||||||
</tr>
|
</tr>
|
||||||
</thead>
|
</thead>
|
||||||
<tbody><tr id="dli_01_0403__en-us_topic_0122090417_row46758327132"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p16413434141957">ID</p>
|
<tbody><tr id="dli_01_0403__en-us_topic_0122090417_row46758327132"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p16413434141957">ID</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p54419740141957">ID of a submitted Flink job, which is generated by the system by default.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p54419740141957">ID of a submitted Flink job, which is generated by the system by default.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__en-us_topic_0122090417_row32873162171713"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p45480448171713">Name</p>
|
<tr id="dli_01_0403__en-us_topic_0122090417_row32873162171713"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p45480448171713">Name</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p18579134217227">Name of the submitted Flink job.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p18579134217227">Name of the submitted Flink job.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__row3289513151315"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__p102901113161318">Type</p>
|
<tr id="dli_01_0403__row3289513151315"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p102901113161318">Type</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__p1029001315135">Type of the submitted Flink job. Including:</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p1029001315135">Type of the submitted Flink job. Including:</p>
|
||||||
<ul id="dli_01_0403__ul864114454138"><li id="dli_01_0403__li464144518136">Flink SQL: Flink SQL jobs</li><li id="dli_01_0403__li1896411561765">Flink Jar: Flink Jar jobs</li></ul>
|
<ul id="dli_01_0403__ul864114454138"><li id="dli_01_0403__li464144518136">Flink SQL: Flink SQL jobs</li><li id="dli_01_0403__li1896411561765">Flink Jar: Flink Jar jobs</li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__en-us_topic_0122090417_row31011923151038"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p10671857151038">Status</p>
|
<tr id="dli_01_0403__en-us_topic_0122090417_row31011923151038"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p10671857151038">Status</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p59114099151038">Job statuses, including:</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p59114099151038">Job statuses, including:</p>
|
||||||
<ul id="dli_01_0403__en-us_topic_0122090417_ul32930526154023"><li id="dli_01_0403__li5304438104719"><strong id="dli_01_0403__b1218612714459">Draft</strong></li><li id="dli_01_0403__li230510384473"><strong id="dli_01_0403__b312364144518">Submitting</strong></li><li id="dli_01_0403__li1530543815477"><strong id="dli_01_0403__b10386111119456">Submission failed</strong></li><li id="dli_01_0403__li530483810474"><strong id="dli_01_0403__b54881649194919">Running</strong>: After the job is submitted, a normal result is returned.</li><li id="dli_01_0403__li27807399719"><strong id="dli_01_0403__b343275416497">Running exception</strong>: The job stops running due to an exception.</li><li id="dli_01_0403__li1196810358454"><strong id="dli_01_0403__b194672233472">Downloading</strong></li><li id="dli_01_0403__li194778183469"><strong id="dli_01_0403__b3168162564710">Idle</strong></li><li id="dli_01_0403__li19305838104720"><strong id="dli_01_0403__b5819182654717">Stopping</strong></li><li id="dli_01_0403__li130510384477"><strong id="dli_01_0403__b10747633104717">Stopped</strong></li><li id="dli_01_0403__li1430520388475"><strong id="dli_01_0403__b202671406472">Stopping failed</strong></li><li id="dli_01_0403__li73970453461"><strong id="dli_01_0403__b12394545124713">Creating the savepoint</strong></li><li id="dli_01_0403__li1330553812474"><strong id="dli_01_0403__b158604563497">Completed</strong></li></ul>
|
<ul id="dli_01_0403__en-us_topic_0122090417_ul32930526154023"><li id="dli_01_0403__li5304438104719"><strong id="dli_01_0403__b1218612714459">Draft</strong></li><li id="dli_01_0403__li230510384473"><strong id="dli_01_0403__b312364144518">Submitting</strong></li><li id="dli_01_0403__li1530543815477"><strong id="dli_01_0403__b10386111119456">Submission failed</strong></li><li id="dli_01_0403__li530483810474"><strong id="dli_01_0403__b54881649194919">Running</strong>: After the job is submitted, a normal result is returned.</li><li id="dli_01_0403__li27807399719"><strong id="dli_01_0403__b343275416497">Running exception</strong>: The job stops running due to an exception.</li><li id="dli_01_0403__li1196810358454"><strong id="dli_01_0403__b194672233472">Downloading</strong></li><li id="dli_01_0403__li194778183469"><strong id="dli_01_0403__b3168162564710">Idle</strong></li><li id="dli_01_0403__li19305838104720"><strong id="dli_01_0403__b5819182654717">Stopping</strong></li><li id="dli_01_0403__li130510384477"><strong id="dli_01_0403__b10747633104717">Stopped</strong></li><li id="dli_01_0403__li1430520388475"><strong id="dli_01_0403__b202671406472">Stopping failed</strong></li><li id="dli_01_0403__li73970453461"><strong id="dli_01_0403__b12394545124713">Creating the savepoint</strong></li><li id="dli_01_0403__li1330553812474"><strong id="dli_01_0403__b158604563497">Completed</strong></li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__en-us_topic_0122090417_row36301606171658"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p14394959151048">Description</p>
|
<tr id="dli_01_0403__en-us_topic_0122090417_row36301606171658"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p14394959151048">Description</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p51238775151048">Description of the submitted Flink job.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p51238775151048">Description of the submitted Flink job.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__row4736911141810"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__p1973721141811">Username</p>
|
<tr id="dli_01_0403__row4736911141810"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p1973721141811">Username</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__p373781161815">Name of the user who submits a job.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p373781161815">Name of the user who submits a job.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__en-us_topic_0122090417_row6424839516213"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p50569641162134">Created</p>
|
<tr id="dli_01_0403__en-us_topic_0122090417_row6424839516213"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p50569641162134">Created</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p18910361162145">Time when a job is created.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p18910361162145">Time when a job is created.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__row15840729143612"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__p13841152911367">Started</p>
|
<tr id="dli_01_0403__row15840729143612"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p13841152911367">Started</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__p20841122983612">Time when a Flink job starts to run.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p20841122983612">Time when a Flink job starts to run.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__row1536633125019"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__p145363334505">Duration</p>
|
<tr id="dli_01_0403__row1536633125019"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p145363334505">Duration</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_01_0403__p153603315013">Time consumed by job running.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p153603315013">Time consumed by job running.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0403__en-us_topic_0122090417_row1662880815250"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p475621615250">Operation</p>
|
<tr id="dli_01_0403__en-us_topic_0122090417_row1662880815250"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p475621615250">Operation</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.7.3.2.3.1.2 "><ul id="dli_01_0403__en-us_topic_0122090417_ul181927155164"><li id="dli_01_0403__en-us_topic_0122090417_li18623798286"><strong id="dli_01_0403__b692115307259">Edit</strong>: Edit a created job. For details, see <a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a Job</a>.</li><li id="dli_01_0403__li016442515152"><strong id="dli_01_0403__b4887113372511">Start</strong>: Start and run a job. For details, see <a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a>.</li><li id="dli_01_0403__li1228521944015"><strong id="dli_01_0403__b1893782782517">More</strong><ul id="dli_01_0403__ul2162826144010"><li id="dli_01_0403__en-us_topic_0122090417_li11155202552811"><strong id="dli_01_0403__b857792212255">FlinkUI</strong>: After you click this button, the Flink job execution page is displayed.<div class="note" id="dli_01_0403__note151024818191"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0403__p5501165371013">When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click <strong id="dli_01_0403__b25538517556">FlinkUI</strong> before the cluster is created, an empty <strong id="dli_01_0403__b668185785511">projectID</strong> will be cached. The <strong id="dli_01_0403__b541324185618">FlinkUI</strong> page cannot be displayed.</p>
|
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><ul id="dli_01_0403__en-us_topic_0122090417_ul181927155164"><li id="dli_01_0403__en-us_topic_0122090417_li18623798286"><strong id="dli_01_0403__b692115307259">Edit</strong>: Edit a created job. For details, see <a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a Job</a>.</li><li id="dli_01_0403__li016442515152"><strong id="dli_01_0403__b4887113372511">Start</strong>: Start and run a job. For details, see <a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a>.</li><li id="dli_01_0403__li1228521944015"><strong id="dli_01_0403__b1893782782517">More</strong><ul id="dli_01_0403__ul2162826144010"><li id="dli_01_0403__en-us_topic_0122090417_li11155202552811"><strong id="dli_01_0403__b857792212255">FlinkUI</strong>: After you click this button, the Flink job execution page is displayed.<div class="note" id="dli_01_0403__note151024818191"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0403__p5501165371013">When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click <strong id="dli_01_0403__b25538517556">FlinkUI</strong> before the cluster is created, an empty <strong id="dli_01_0403__b668185785511">projectID</strong> will be cached. The <strong id="dli_01_0403__b541324185618">FlinkUI</strong> page cannot be displayed.</p>
|
||||||
<p id="dli_01_0403__p181031586197">You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check <strong id="dli_01_0403__b890617447568">FlinkUI</strong>.</p>
|
<p id="dli_01_0403__p181031586197">You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check <strong id="dli_01_0403__b890617447568">FlinkUI</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li><li id="dli_01_0403__li2385531539"><strong id="dli_01_0403__b1631116258182">Stop</strong>: Stop a Flink job. If this function is unavailable, jobs in the current status cannot be stopped.</li><li id="dli_01_0403__li156921658183219"><strong id="dli_01_0403__b12871121811253">Delete</strong>: Delete a job.<div class="note" id="dli_01_0403__note386711433506"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0403__p16867104316506">A deleted job cannot be restored.</p>
|
</li><li id="dli_01_0403__li2385531539"><strong id="dli_01_0403__b1631116258182">Stop</strong>: Stop a Flink job. If this function is unavailable, jobs in the current status cannot be stopped.</li><li id="dli_01_0403__li156921658183219"><strong id="dli_01_0403__b12871121811253">Delete</strong>: Delete a job.<div class="note" id="dli_01_0403__note386711433506"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0403__p16867104316506">A deleted job cannot be restored.</p>
|
||||||
|
@ -119,7 +119,7 @@
|
|||||||
<td class="cellrowborder" valign="top" width="19.23%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dli_01_0410__p1172210377539">√</p>
|
<td class="cellrowborder" valign="top" width="19.23%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dli_01_0410__p1172210377539">√</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0410__row18722437135315"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dli_01_0410__p157221337115313">RDS MySQL</p>
|
<tr id="dli_01_0410__row18722437135315"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dli_01_0410__p157221337115313">RDS for MySQL</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="19.11%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dli_01_0410__p67221937185316">√</p>
|
<td class="cellrowborder" valign="top" width="19.11%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dli_01_0410__p67221937185316">√</p>
|
||||||
</td>
|
</td>
|
||||||
|
@ -2,7 +2,7 @@
|
|||||||
|
|
||||||
<h1 class="topictitle1">Creating an IAM User and Granting Permissions</h1>
|
<h1 class="topictitle1">Creating an IAM User and Granting Permissions</h1>
|
||||||
<div id="body1557992073881"><p id="dli_01_0418__p1843116365528">You can use Identity and Access Management (IAM) to implement fine-grained permissions control on DLI resources. For details, see <a href="dli_01_0440.html">Overview</a>.</p>
|
<div id="body1557992073881"><p id="dli_01_0418__p1843116365528">You can use Identity and Access Management (IAM) to implement fine-grained permissions control on DLI resources. For details, see <a href="dli_01_0440.html">Overview</a>.</p>
|
||||||
<p id="dli_01_0418__p1316316443569">If your cloud account does not need individual IAM users, then you may skip over this chapter.</p>
|
<p id="dli_01_0418__p1316316443569">If your cloud account does not need individual IAM users, then you may skip over this section.</p>
|
||||||
<p id="dli_01_0418__p19117754135713">This section describes how to create an IAM user and grant DLI permissions to the user. <a href="#dli_01_0418__fig4118155455715">Figure 1</a> shows the procedure.</p>
|
<p id="dli_01_0418__p19117754135713">This section describes how to create an IAM user and grant DLI permissions to the user. <a href="#dli_01_0418__fig4118155455715">Figure 1</a> shows the procedure.</p>
|
||||||
<div class="section" id="dli_01_0418__section3299192113013"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0418__p13734854619">Before assigning permissions to user groups, you should learn about system policies and select the policies based on service requirements. For details about system permissions supported by DLI, see <a href="dli_01_0440.html#dli_01_0440__section6224422143120">DLI System Permissions</a>.</p>
|
<div class="section" id="dli_01_0418__section3299192113013"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0418__p13734854619">Before assigning permissions to user groups, you should learn about system policies and select the policies based on service requirements. For details about system permissions supported by DLI, see <a href="dli_01_0440.html#dli_01_0440__section6224422143120">DLI System Permissions</a>.</p>
|
||||||
</div>
|
</div>
|
||||||
@ -12,7 +12,7 @@
|
|||||||
<ol id="dli_01_0418__ol139492810017"><li id="dli_01_0418__li895020818018"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group and grant the permission to it.<p id="dli_01_0418__p99501985019"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group on the IAM console, and assign the <strong id="dli_01_0418__b163744195013">DLI ReadOnlyAccess</strong> permission to the group.</p>
|
<ol id="dli_01_0418__ol139492810017"><li id="dli_01_0418__li895020818018"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group and grant the permission to it.<p id="dli_01_0418__p99501985019"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group on the IAM console, and assign the <strong id="dli_01_0418__b163744195013">DLI ReadOnlyAccess</strong> permission to the group.</p>
|
||||||
</li><li id="dli_01_0418__li59503817014">Create a user and add the user to the user group.<p id="dli_01_0418__p4950882013"><a name="dli_01_0418__li59503817014"></a><a name="li59503817014"></a>Create a user on the IAM console and add the user to the group created in <a href="#dli_01_0418__li895020818018">1</a>.</p>
|
</li><li id="dli_01_0418__li59503817014">Create a user and add the user to the user group.<p id="dli_01_0418__p4950882013"><a name="dli_01_0418__li59503817014"></a><a name="li59503817014"></a>Create a user on the IAM console and add the user to the group created in <a href="#dli_01_0418__li895020818018">1</a>.</p>
|
||||||
</li><li id="dli_01_0418__li159506814017">Log in and verify the permission.<p id="dli_01_0418__p29911201511"><a name="dli_01_0418__li159506814017"></a><a name="li159506814017"></a>Log in to the management console using the newly created user, and verify that the user's permissions.</p>
|
</li><li id="dli_01_0418__li159506814017">Log in and verify the permission.<p id="dli_01_0418__p29911201511"><a name="dli_01_0418__li159506814017"></a><a name="li159506814017"></a>Log in to the management console using the newly created user, and verify that the user's permissions.</p>
|
||||||
<ul id="dli_01_0418__ul9992304111"><li id="dli_01_0418__li149921301015">Choose <strong id="dli_01_0418__b1995251441">Service List</strong> > <strong id="dli_01_0418__b1092401376">Data Lake Insight</strong>. The DLI management console is displayed. If you can view the queue list on the <strong id="dli_01_0418__b86423619315">Queue Management</strong> page but cannot buy DLI queues by clicking <strong id="dli_01_0418__b1701367313">Buy Queue</strong> in the upper right corner (assume that the current permission contains only <strong id="dli_01_0418__b1070193615314">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b7710363316">DLI ReadOnlyAccess</strong> permission has taken effect.</li><li id="dli_01_0418__li29921500115">Choose any other service in <strong id="dli_01_0418__b6827231507">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b148281231700">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
|
<ul id="dli_01_0418__ul9992304111"><li id="dli_01_0418__li149921301015">Choose <strong id="dli_01_0418__b651616084">Service List</strong> > <strong id="dli_01_0418__b1573796139">Data Lake Insight</strong>. The DLI management console is displayed. If you can view the queue list on the <strong id="dli_01_0418__b86423619315">Queue Management</strong> page but cannot buy DLI queues by clicking <strong id="dli_01_0418__b1701367313">Buy Queue</strong> in the upper right corner (assume that the current permission contains only <strong id="dli_01_0418__b1070193615314">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b7710363316">DLI ReadOnlyAccess</strong> permission has taken effect.</li><li id="dli_01_0418__li29921500115">Choose any other service in <strong id="dli_01_0418__b688152518442">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b17881525164411">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
<p id="dli_01_0418__p05981420125912"></p>
|
<p id="dli_01_0418__p05981420125912"></p>
|
||||||
</div>
|
</div>
|
||||||
|
@ -4,11 +4,11 @@
|
|||||||
<div id="body1569392609574"><p id="dli_01_0440__p14514730192514">DLI has a comprehensive permission control mechanism and supports fine-grained authentication through Identity and Access Management (IAM). You can create policies in IAM to manage DLI permissions. You can use both the DLI's permission control mechanism and the IAM service for permission management.</p>
|
<div id="body1569392609574"><p id="dli_01_0440__p14514730192514">DLI has a comprehensive permission control mechanism and supports fine-grained authentication through Identity and Access Management (IAM). You can create policies in IAM to manage DLI permissions. You can use both the DLI's permission control mechanism and the IAM service for permission management.</p>
|
||||||
<div class="section" id="dli_01_0440__section1696813910587"><h4 class="sectiontitle">Application Scenarios of IAM Authentication</h4><p id="dli_01_0440__p1764135516319">When using DLI on the cloud, enterprise users need to manage DLI resources (queues) used by employees in different departments, including creating, deleting, using, and isolating resources. In addition, data of different departments needs to be managed, including data isolation and sharing.</p>
|
<div class="section" id="dli_01_0440__section1696813910587"><h4 class="sectiontitle">Application Scenarios of IAM Authentication</h4><p id="dli_01_0440__p1764135516319">When using DLI on the cloud, enterprise users need to manage DLI resources (queues) used by employees in different departments, including creating, deleting, using, and isolating resources. In addition, data of different departments needs to be managed, including data isolation and sharing.</p>
|
||||||
<p id="dli_01_0440__p16317291479">DLI uses IAM for refined enterprise-level multi-tenant management. IAM provides identity authentication, permissions management, and access control, helping you securely access to your cloud resources.</p>
|
<p id="dli_01_0440__p16317291479">DLI uses IAM for refined enterprise-level multi-tenant management. IAM provides identity authentication, permissions management, and access control, helping you securely access to your cloud resources.</p>
|
||||||
<p id="dli_01_0440__p188991750134717">With IAM, you can use your cloud account to create IAM users for your employees, and assign permissions to the users to control their access to specific resource types. For example, some software developers in your enterprise need to use DLI resources but must not delete them or perform any high-risk operations. To achieve this result, you can create IAM users for the software developers and grant them only the permissions required for using DLI resources.</p>
|
<p id="dli_01_0440__p188991750134717">With IAM, you can use your account to create IAM users for your employees, and assign permissions to the users to control their access to specific resource types. For example, some software developers in your enterprise need to use DLI resources but must not delete them or perform any high-risk operations. To achieve this result, you can create IAM users for the software developers and grant them only the permissions required for using DLI resources.</p>
|
||||||
<div class="note" id="dli_01_0440__note17965103310292"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0440__p2966183352919">For a new user, you need to log in for the system to record the metadata before using DLI.</p>
|
<div class="note" id="dli_01_0440__note17965103310292"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0440__p2966183352919">For a new user, you need to log in for the system to record the metadata before using DLI.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
<p id="dli_01_0440__p446382154810">IAM is free of charge. You pay only for the resources you use. </p>
|
<p id="dli_01_0440__p446382154810">IAM is free to use, and you only need to pay for the resources in your account. </p>
|
||||||
<p id="dli_01_0440__p8642155123119">If your cloud account does not need individual IAM users for permissions management, skip this chapter.</p>
|
<p id="dli_01_0440__p8642155123119">If your account does not need individual IAM users for permissions management, skip over this section.</p>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0440__section6224422143120"><a name="dli_01_0440__section6224422143120"></a><a name="section6224422143120"></a><h4 class="sectiontitle">DLI System Permissions</h4><p id="dli_01_0440__p81616496240"><a href="#dli_01_0440__table6578220217">Table 1</a> lists all the system-defined roles and policies supported by DLI.</p>
|
<div class="section" id="dli_01_0440__section6224422143120"><a name="dli_01_0440__section6224422143120"></a><a name="section6224422143120"></a><h4 class="sectiontitle">DLI System Permissions</h4><p id="dli_01_0440__p81616496240"><a href="#dli_01_0440__table6578220217">Table 1</a> lists all the system-defined roles and policies supported by DLI.</p>
|
||||||
<div class="p" id="dli_01_0440__p934171813107">Type: There are roles and policies.<ul id="dli_01_0440__ul2804101433117"><li id="dli_01_0440__li28043143315">Roles: A type of coarse-grained authorization mechanism that defines permissions related to user responsibilities. Only a limited number of service-level roles are available. When using roles to grant permissions, you also need to assign other roles on which the permissions depend. However, roles are not an ideal choice for fine-grained authorization and secure access control.</li><li id="dli_01_0440__li480481493115">Policies: A type of fine-grained authorization mechanism that defines permissions required to perform operations on specific cloud resources under certain conditions. This mechanism allows for more flexible policy-based authorization, meeting requirements for secure access control. For example, you can grant DLI users only the permissions for managing a certain type of ECSs.</li></ul>
|
<div class="p" id="dli_01_0440__p934171813107">Type: There are roles and policies.<ul id="dli_01_0440__ul2804101433117"><li id="dli_01_0440__li28043143315">Roles: A type of coarse-grained authorization mechanism that defines permissions related to user responsibilities. Only a limited number of service-level roles are available. When using roles to grant permissions, you also need to assign other roles on which the permissions depend. However, roles are not an ideal choice for fine-grained authorization and secure access control.</li><li id="dli_01_0440__li480481493115">Policies: A type of fine-grained authorization mechanism that defines permissions required to perform operations on specific cloud resources under certain conditions. This mechanism allows for more flexible policy-based authorization, meeting requirements for secure access control. For example, you can grant DLI users only the permissions for managing a certain type of ECSs.</li></ul>
|
||||||
@ -156,7 +156,7 @@
|
|||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0440__section2355719152316"><h4 class="sectiontitle">Examples</h4><p id="dli_01_0440__p20132185722311">An Internet company mainly provides game and music services. DLI is used to analyze user behaviors and assist decision making.</p>
|
<div class="section" id="dli_01_0440__section2355719152316"><h4 class="sectiontitle">Examples</h4><p id="dli_01_0440__p20132185722311">An Internet company mainly provides game and music services. DLI is used to analyze user behaviors and assist decision making.</p>
|
||||||
<p id="dli_01_0440__p213345772311">As shown in <a href="#dli_01_0440__fig3861162219415">Figure 1</a>, the <strong id="dli_01_0440__b1410520447913">Leader of the Basic Platform Team</strong> has applied for a <strong id="dli_01_0440__b35121459499">Tenant Administrator</strong> account to manage and use cloud services. The <strong id="dli_01_0440__b947313519325">Leader of the Basic Platform Team</strong> creates a subaccount with the <strong id="dli_01_0440__b15250924143216">DLI Service Administrator</strong> permission to manage and use DLI, as the <strong id="dli_01_0440__b1390015135269">Big Data Platform Team</strong> requires DLI for data analysis. The <span class="parmvalue" id="dli_01_0440__parmvalue1497641412616"><b>Leader of the Basic Platform Team</b></span> creates a <span class="parmvalue" id="dli_01_0440__parmvalue59771114865"><b>Queue A</b></span> and assigns it to <span class="parmvalue" id="dli_01_0440__parmvalue149779148617"><b>Data Engineer A</b></span> to analyze the gaming data. A <span class="parmvalue" id="dli_01_0440__parmvalue5977101411611"><b>Queue B</b></span> is also assigned to <span class="parmvalue" id="dli_01_0440__parmvalue69775141664"><b>Data Engineer B</b></span> to analyze the music data. Besides granting the queue usage permission, the <span class="parmvalue" id="dli_01_0440__parmvalue189779141569"><b>Leader of the Basic Platform Team</b></span> grants data (except the database) management and usage permissions to the two engineers.</p>
|
<p id="dli_01_0440__p213345772311">As shown in <a href="#dli_01_0440__fig3861162219415">Figure 1</a>, the <strong id="dli_01_0440__b15163175558">Leader of the Basic Platform Team</strong> has applied for a <strong id="dli_01_0440__b15516141745511">Tenant Administrator</strong> account to manage and use cloud services. The <strong id="dli_01_0440__b144071145552">Leader of the Basic Platform Team</strong> creates a subaccount with the <strong id="dli_01_0440__b1240764165511">DLI Service Administrator</strong> permission to manage and use DLI, as the <strong id="dli_01_0440__b4407144145511">Big Data Platform Team</strong> requires DLI for data analysis. The <span class="parmvalue" id="dli_01_0440__parmvalue1497641412616"><b>Leader of the Basic Platform Team</b></span> creates a <span class="parmvalue" id="dli_01_0440__parmvalue59771114865"><b>Queue A</b></span> and assigns it to <span class="parmvalue" id="dli_01_0440__parmvalue149779148617"><b>Data Engineer A</b></span> to analyze the gaming data. A <span class="parmvalue" id="dli_01_0440__parmvalue5977101411611"><b>Queue B</b></span> is also assigned to <span class="parmvalue" id="dli_01_0440__parmvalue69775141664"><b>Data Engineer B</b></span> to analyze the music data. Besides granting the queue usage permission, the <span class="parmvalue" id="dli_01_0440__parmvalue189779141569"><b>Leader of the Basic Platform Team</b></span> grants data (except the database) management and usage permissions to the two engineers.</p>
|
||||||
<div class="fignone" id="dli_01_0440__fig3861162219415"><a name="dli_01_0440__fig3861162219415"></a><a name="fig3861162219415"></a><span class="figcap"><b>Figure 1 </b>Granting permissions</span><br><span><img id="dli_01_0440__image886218222041" src="en-us_image_0206789784.png"></span></div>
|
<div class="fignone" id="dli_01_0440__fig3861162219415"><a name="dli_01_0440__fig3861162219415"></a><a name="fig3861162219415"></a><span class="figcap"><b>Figure 1 </b>Granting permissions</span><br><span><img id="dli_01_0440__image886218222041" src="en-us_image_0206789784.png"></span></div>
|
||||||
<p id="dli_01_0440__p12835161042">The <span class="parmvalue" id="dli_01_0440__parmvalue1972911299620"><b>Data Engineer A</b></span> creates a table named <strong id="dli_01_0440__b4729182919619">gameTable</strong> for storing game prop data and a table named <strong id="dli_01_0440__b177295299615">userTable</strong> for storing game user data. The music service is a new service. To explore potential music users among existing game users, the <span class="parmvalue" id="dli_01_0440__parmvalue058518326617"><b>Data Engineer A</b></span> assigns the query permission on the <strong id="dli_01_0440__b1458511321618">userTable</strong> to the <span class="parmvalue" id="dli_01_0440__parmvalue958517321568"><b>Data Engineer B</b></span>. In addition, <span class="parmvalue" id="dli_01_0440__parmvalue12777133417612"><b>Data Engineer B</b></span> creates a table named <strong id="dli_01_0440__b8778133419614">musicTable</strong> for storing music copyrights information.</p>
|
<p id="dli_01_0440__p12835161042">The <span class="parmvalue" id="dli_01_0440__parmvalue1972911299620"><b>Data Engineer A</b></span> creates a table named <strong id="dli_01_0440__b4729182919619">gameTable</strong> for storing game prop data and a table named <strong id="dli_01_0440__b177295299615">userTable</strong> for storing game user data. The music service is a new service. To explore potential music users among existing game users, the <span class="parmvalue" id="dli_01_0440__parmvalue058518326617"><b>Data Engineer A</b></span> assigns the query permission on the <strong id="dli_01_0440__b1458511321618">userTable</strong> to the <span class="parmvalue" id="dli_01_0440__parmvalue958517321568"><b>Data Engineer B</b></span>. In addition, <span class="parmvalue" id="dli_01_0440__parmvalue12777133417612"><b>Data Engineer B</b></span> creates a table named <strong id="dli_01_0440__b8778133419614">musicTable</strong> for storing music copyrights information.</p>
|
||||||
<p id="dli_01_0440__p16288016447"><a href="#dli_01_0440__table1190715568239">Table 3</a> describes the queue and data permissions of <span class="parmvalue" id="dli_01_0440__parmvalue1022820371961"><b>Data Engineer A</b></span> and <span class="parmvalue" id="dli_01_0440__parmvalue922820371064"><b>Data Engineer B</b></span>.</p>
|
<p id="dli_01_0440__p16288016447"><a href="#dli_01_0440__table1190715568239">Table 3</a> describes the queue and data permissions of <span class="parmvalue" id="dli_01_0440__parmvalue1022820371961"><b>Data Engineer A</b></span> and <span class="parmvalue" id="dli_01_0440__parmvalue922820371064"><b>Data Engineer B</b></span>.</p>
|
||||||
|
File diff suppressed because it is too large
Load Diff
@ -59,7 +59,7 @@
|
|||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0447__section168711128399"><h4 class="sectiontitle">Modifying Permissions for an Existing User or Project</h4><p id="dli_01_0447__p121761144184017">For a user or project that has some permissions on the database, you can revoke the existing permissions or grant new ones.</p>
|
<div class="section" id="dli_01_0447__section168711128399"><h4 class="sectiontitle">Modifying Permissions for an Existing User or Project</h4><p id="dli_01_0447__p121761144184017">For a user or project that has some permissions on the database, you can revoke the existing permissions or grant new ones.</p>
|
||||||
<div class="note" id="dli_01_0447__note44273512119"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0447__p18427155115">If the options in <span class="parmname" id="dli_01_0447__parmname575715245582"><b>Set Permission</b></span> are gray, the corresponding account does not have the permission to modify the database. You can apply to the administrator, database owner, or other authorized users for granting and revoking permissions of databases.</p>
|
<div class="note" id="dli_01_0447__note44273512119"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0447__p18427155115">If the options in <span class="parmname" id="dli_01_0447__parmname1098291932020"><b>Set Permission</b></span> are gray, the corresponding account does not have the permission to modify the database. You can apply to the administrator, database owner, or other authorized users for granting and revoking permissions of databases.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
<div class="p" id="dli_01_0447__p13250114216"><ol id="dli_01_0447__ol588081015518"><li id="dli_01_0447__li987520101554">In the <span class="parmname" id="dli_01_0447__parmname148617558584"><b>User Permission Info</b></span> list, find the user whose permission needs to be set.<ul id="dli_01_0447__ul11246355178"><li id="dli_01_0447__li1224616552711">If the user is a sub-user, you can set permissions for it.</li><li id="dli_01_0447__li71027304812">If the user is already an administrator, you can only view the permissions information.</li></ul>
|
<div class="p" id="dli_01_0447__p13250114216"><ol id="dli_01_0447__ol588081015518"><li id="dli_01_0447__li987520101554">In the <span class="parmname" id="dli_01_0447__parmname148617558584"><b>User Permission Info</b></span> list, find the user whose permission needs to be set.<ul id="dli_01_0447__ul11246355178"><li id="dli_01_0447__li1224616552711">If the user is a sub-user, you can set permissions for it.</li><li id="dli_01_0447__li71027304812">If the user is already an administrator, you can only view the permissions information.</li></ul>
|
||||||
<p id="dli_01_0447__p170524711552">In the <span class="parmname" id="dli_01_0447__parmname0995181125915"><b>Project Permission Info</b></span> list, locate the project for which you want to set permissions and click <strong id="dli_01_0447__b1499571155914">Set Permission</strong>.</p>
|
<p id="dli_01_0447__p170524711552">In the <span class="parmname" id="dli_01_0447__parmname0995181125915"><b>Project Permission Info</b></span> list, locate the project for which you want to set permissions and click <strong id="dli_01_0447__b1499571155914">Set Permission</strong>.</p>
|
||||||
|
@ -47,29 +47,29 @@
|
|||||||
</div>
|
</div>
|
||||||
</li><li id="dli_01_0448__li365614004815">For details about the OBS table permissions, see <a href="#dli_01_0448__table36563404488">Table 2</a>.<p id="dli_01_0448__p18723165283"></p>
|
</li><li id="dli_01_0448__li365614004815">For details about the OBS table permissions, see <a href="#dli_01_0448__table36563404488">Table 2</a>.<p id="dli_01_0448__p18723165283"></p>
|
||||||
|
|
||||||
<div class="tablenoborder"><a name="dli_01_0448__table36563404488"></a><a name="table36563404488"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0448__table36563404488" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0448__row1065211403488"><th align="left" class="cellrowborder" valign="top" width="18.75%" id="mcps1.3.4.2.1.2.2.2.3.2.3.1.1"><p id="dli_01_0448__p1465254024818">Parameter</p>
|
<div class="tablenoborder"><a name="dli_01_0448__table36563404488"></a><a name="table36563404488"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0448__table36563404488" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0448__row1065211403488"><th align="left" class="cellrowborder" valign="top" width="17.119999999999997%" id="mcps1.3.4.2.1.2.2.2.3.2.3.1.1"><p id="dli_01_0448__p1465254024818">Parameter</p>
|
||||||
</th>
|
</th>
|
||||||
<th align="left" class="cellrowborder" valign="top" width="81.25%" id="mcps1.3.4.2.1.2.2.2.3.2.3.1.2"><p id="dli_01_0448__p136521640164820">Description</p>
|
<th align="left" class="cellrowborder" valign="top" width="82.88%" id="mcps1.3.4.2.1.2.2.2.3.2.3.1.2"><p id="dli_01_0448__p136521640164820">Description</p>
|
||||||
</th>
|
</th>
|
||||||
</tr>
|
</tr>
|
||||||
</thead>
|
</thead>
|
||||||
<tbody><tr id="dli_01_0448__row565224044819"><td class="cellrowborder" valign="top" width="18.75%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.1 "><p id="dli_01_0448__p9652144074816">Authorization Object</p>
|
<tbody><tr id="dli_01_0448__row565224044819"><td class="cellrowborder" valign="top" width="17.119999999999997%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.1 "><p id="dli_01_0448__p9652144074816">Authorization Object</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="81.25%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.2 "><p id="dli_01_0448__p14652174017486">Select <strong id="dli_01_0448__b1836684765">User</strong> or <strong id="dli_01_0448__b1550655958">Project</strong>.</p>
|
<td class="cellrowborder" valign="top" width="82.88%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.2 "><p id="dli_01_0448__p14652174017486">Select <strong id="dli_01_0448__b650614192">User</strong> or <strong id="dli_01_0448__b378614144">Project</strong>.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0448__row166532040114818"><td class="cellrowborder" valign="top" width="18.75%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.1 "><p id="dli_01_0448__p565219406486">Username/Project</p>
|
<tr id="dli_01_0448__row166532040114818"><td class="cellrowborder" valign="top" width="17.119999999999997%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.1 "><p id="dli_01_0448__p565219406486">Username/Project</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="81.25%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.2 "><ul id="dli_01_0448__ul126532403482"><li id="dli_01_0448__li16652440194810">If you select <strong id="dli_01_0448__b522860825">User</strong>, enter the IAM username when granting table permissions to the user.<div class="note" id="dli_01_0448__note42264017164"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0448__p2232130161618">The username is an existing IAM user name and has logged in to the DLI management console.</p>
|
<td class="cellrowborder" valign="top" width="82.88%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.2 "><ul id="dli_01_0448__ul126532403482"><li id="dli_01_0448__li16652440194810">If you select <strong id="dli_01_0448__b472241843">User</strong>, enter the IAM username when granting table permissions to the user.<div class="note" id="dli_01_0448__note42264017164"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0448__p2232130161618">The username is an existing IAM user name and has logged in to the DLI management console.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li><li id="dli_01_0448__li765312406486">If you select <strong id="dli_01_0448__b1394871595">Project</strong>, select the project to be authorized in the current region.<div class="note" id="dli_01_0448__note5437185910377"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0448__p3437159143716">If you select <strong id="dli_01_0448__b222310053715">Project</strong>, you can only view information about the authorized tables and their databases.</p>
|
</li><li id="dli_01_0448__li765312406486">If you select <strong id="dli_01_0448__b1523843209">Project</strong>, select the project to be authorized in the current region.<div class="note" id="dli_01_0448__note5437185910377"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0448__p3437159143716">If you select <strong id="dli_01_0448__b222310053715">Project</strong>, you can only view information about the authorized tables and their databases.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0448__row116546401484"><td class="cellrowborder" valign="top" width="18.75%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.1 "><p id="dli_01_0448__p0653184018489">Non-inheritable Permissions</p>
|
<tr id="dli_01_0448__row116546401484"><td class="cellrowborder" valign="top" width="17.119999999999997%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.1 "><p id="dli_01_0448__p0653184018489">Non-inheritable Permissions</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="81.25%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.2 "><div class="p" id="dli_01_0448__p26531940154817">Select a permission to grant it to the user, or deselect a permission to revoke it.<ul id="dli_01_0448__ul186541940194819"><li id="dli_01_0448__li1037614422018">The following permissions are applicable to both user and project authorization:<ul id="dli_01_0448__ul11414111319209"><li id="dli_01_0448__li17280185220227"><strong id="dli_01_0448__b1475611842911">View Table Creation Statement</strong>: This permission allows you to view the statement for creating the current table.</li><li id="dli_01_0448__li6385363379"><strong id="dli_01_0448__b88661213112914">View Table Information</strong>: This permission allows you to view information about the current table.</li><li id="dli_01_0448__li1365364034816"><strong id="dli_01_0448__b313497768">Select Table</strong>: This permission allows you to query data of the current table.</li><li id="dli_01_0448__li9653240154816"><strong id="dli_01_0448__b291334707">Drop Table</strong>: This permission allows you to delete the current table.</li><li id="dli_01_0448__li56531540144810"><strong id="dli_01_0448__b417028568">Rename Table</strong>: Rename the current table.</li><li id="dli_01_0448__li1465374011487"><strong id="dli_01_0448__b1562278110">Insert</strong>: This permission allows you to insert data into the current table.</li><li id="dli_01_0448__li1965364014817"><strong id="dli_01_0448__b2015126778">Overwrite</strong>: This permission allows you to insert data to overwrite the data in the current table.</li><li id="dli_01_0448__li6653194011481"><strong id="dli_01_0448__b1868414236293">Add Column</strong>: This permission allows you to add columns to the current table.</li><li id="dli_01_0448__li186531240124810"><strong id="dli_01_0448__b11229173814372">Grant Permission</strong>: This permission allows you to grant table permissions to other users or projects.</li><li id="dli_01_0448__li66531440174811"><strong id="dli_01_0448__b1752995116373">Revoke Permission</strong>: This permission allows you to revoke the table's permissions that other users or projects have but cannot revoke the table owner's permissions.</li><li id="dli_01_0448__li8654194024817"><strong id="dli_01_0448__b814732953819">View Other Users' Permissions</strong>: This permission allows you to query other users' permission on the current table.</li></ul>
|
<td class="cellrowborder" valign="top" width="82.88%" headers="mcps1.3.4.2.1.2.2.2.3.2.3.1.2 "><div class="p" id="dli_01_0448__p26531940154817">Select a permission to grant it to the user, or deselect a permission to revoke it.<ul id="dli_01_0448__ul186541940194819"><li id="dli_01_0448__li1037614422018">The following permissions are applicable to both user and project authorization:<ul id="dli_01_0448__ul11414111319209"><li id="dli_01_0448__li17280185220227"><strong id="dli_01_0448__b1475611842911">View Table Creation Statement</strong>: This permission allows you to view the statement for creating the current table.</li><li id="dli_01_0448__li6385363379"><strong id="dli_01_0448__b88661213112914">View Table Information</strong>: This permission allows you to view information about the current table.</li><li id="dli_01_0448__li1365364034816"><strong id="dli_01_0448__b1310890772">Select Table</strong>: This permission allows you to query data of the current table.</li><li id="dli_01_0448__li9653240154816"><strong id="dli_01_0448__b1861150579">Drop Table</strong>: This permission allows you to delete the current table.</li><li id="dli_01_0448__li56531540144810"><strong id="dli_01_0448__b986396609">Rename Table</strong>: Rename the current table.</li><li id="dli_01_0448__li1465374011487"><strong id="dli_01_0448__b935117059">Insert</strong>: This permission allows you to insert data into the current table.</li><li id="dli_01_0448__li1965364014817"><strong id="dli_01_0448__b1774717364">Overwrite</strong>: This permission allows you to insert data to overwrite the data in the current table.</li><li id="dli_01_0448__li6653194011481"><strong id="dli_01_0448__b1868414236293">Add Column</strong>: This permission allows you to add columns to the current table.</li><li id="dli_01_0448__li186531240124810"><strong id="dli_01_0448__b11229173814372">Grant Permission</strong>: This permission allows you to grant table permissions to other users or projects.</li><li id="dli_01_0448__li66531440174811"><strong id="dli_01_0448__b1752995116373">Revoke Permission</strong>: This permission allows you to revoke the table's permissions that other users or projects have but cannot revoke the table owner's permissions.</li><li id="dli_01_0448__li8654194024817"><strong id="dli_01_0448__b814732953819">View Other Users' Permissions</strong>: This permission allows you to query other users' permission on the current table.</li></ul>
|
||||||
<div class="p" id="dli_01_0448__p18654640154814">The partition table also has the following permissions:<ul id="dli_01_0448__ul76544409484"><li id="dli_01_0448__li1865415406488"><strong id="dli_01_0448__b46593558555">Add Partition</strong>: This permission allows you to add a partition to a partition table.</li><li id="dli_01_0448__li126548407483"><strong id="dli_01_0448__b126796584556">Delete Partition</strong>: This permission allows you to delete existing partitions from a partition table.</li><li id="dli_01_0448__li965474084819"><strong id="dli_01_0448__b523170183913">Configure Path for Partition</strong>: This permission allows you to set the path of a partition in a partition table to a specified OBS path.</li><li id="dli_01_0448__li1065424019489"><strong id="dli_01_0448__b69983116565">Rename Table Partition</strong>: This permission allows you to rename partitions in a partition table.</li><li id="dli_01_0448__li126547402487"><strong id="dli_01_0448__b088993155619">Restore Table Partition</strong>: This permission allows you to export partition information from the file system and save the information to metadata.</li><li id="dli_01_0448__li86541140134815"><strong id="dli_01_0448__b323918620561">View All Partitions</strong>: This permission allows you to view all partitions in a partition table.</li></ul>
|
<div class="p" id="dli_01_0448__p18654640154814">The partition table also has the following permissions:<ul id="dli_01_0448__ul76544409484"><li id="dli_01_0448__li1865415406488"><strong id="dli_01_0448__b46593558555">Add Partition</strong>: This permission allows you to add a partition to a partition table.</li><li id="dli_01_0448__li126548407483"><strong id="dli_01_0448__b126796584556">Delete Partition</strong>: This permission allows you to delete existing partitions from a partition table.</li><li id="dli_01_0448__li965474084819"><strong id="dli_01_0448__b523170183913">Configure Path for Partition</strong>: This permission allows you to set the path of a partition in a partition table to a specified OBS path.</li><li id="dli_01_0448__li1065424019489"><strong id="dli_01_0448__b69983116565">Rename Table Partition</strong>: This permission allows you to rename partitions in a partition table.</li><li id="dli_01_0448__li126547402487"><strong id="dli_01_0448__b088993155619">Restore Table Partition</strong>: This permission allows you to export partition information from the file system and save the information to metadata.</li><li id="dli_01_0448__li86541140134815"><strong id="dli_01_0448__b323918620561">View All Partitions</strong>: This permission allows you to view all partitions in a partition table.</li></ul>
|
||||||
</div>
|
</div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
@ -92,7 +92,7 @@
|
|||||||
</thead>
|
</thead>
|
||||||
<tbody><tr id="dli_01_0448__row20659134011489"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.1.2.2.3.3.2.3.1.1 "><p id="dli_01_0448__p1265724017483">Authorization Object</p>
|
<tbody><tr id="dli_01_0448__row20659134011489"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.1.2.2.3.3.2.3.1.1 "><p id="dli_01_0448__p1265724017483">Authorization Object</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.4.2.1.2.2.3.3.2.3.1.2 "><p id="dli_01_0448__p565864034813">Select <strong id="dli_01_0448__b883842996">User</strong> or <strong id="dli_01_0448__b1515428361">Project</strong>.</p>
|
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.4.2.1.2.2.3.3.2.3.1.2 "><p id="dli_01_0448__p565864034813">Select <strong id="dli_01_0448__b1162020414">User</strong> or <strong id="dli_01_0448__b1129348229">Project</strong>.</p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0448__row19659140144815"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.1.2.2.3.3.2.3.1.1 "><p id="dli_01_0448__p1865915409485">Username/Project</p>
|
<tr id="dli_01_0448__row19659140144815"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.1.2.2.3.3.2.3.1.1 "><p id="dli_01_0448__p1865915409485">Username/Project</p>
|
||||||
|
@ -143,12 +143,12 @@
|
|||||||
</thead>
|
</thead>
|
||||||
<tbody><tr id="dli_01_0451__row13563124471618"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p156384461618">DLI:*:*:table:databases.dbname.tables.*</p>
|
<tbody><tr id="dli_01_0451__row13563124471618"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p156384461618">DLI:*:*:table:databases.dbname.tables.*</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="55.279999999999994%" headers="mcps1.3.6.3.2.2.2.3.1.2 "><p id="dli_01_0451__p125635440163">DLI, any region, any account ID, all table resources of database <strong id="dli_01_0451__b62271611306">dbname</strong></p>
|
<td class="cellrowborder" valign="top" width="55.279999999999994%" headers="mcps1.3.6.3.2.2.2.3.1.2 "><p id="dli_01_0451__p125635440163">DLI, any region, any account ID, all table resources of database <strong id="dli_01_0451__b3159549134215">dbname</strong></p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0451__row7563144413162"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p1256384461610">DLI:*:*:database:databases.dbname</p>
|
<tr id="dli_01_0451__row7563144413162"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p1256384461610">DLI:*:*:database:databases.dbname</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="55.279999999999994%" headers="mcps1.3.6.3.2.2.2.3.1.2 "><p id="dli_01_0451__p6563744121615">DLI, any region, any account ID, resource of database <strong id="dli_01_0451__b1558161313321">dbname</strong></p>
|
<td class="cellrowborder" valign="top" width="55.279999999999994%" headers="mcps1.3.6.3.2.2.2.3.1.2 "><p id="dli_01_0451__p6563744121615">DLI, any region, any account ID, resource of database <strong id="dli_01_0451__b1143920521426">dbname</strong></p>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
<tr id="dli_01_0451__row356494415169"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p4564244131615">DLI:*:*:queue:queues.*</p>
|
<tr id="dli_01_0451__row356494415169"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p4564244131615">DLI:*:*:queue:queues.*</p>
|
||||||
@ -240,7 +240,7 @@
|
|||||||
</table>
|
</table>
|
||||||
</div>
|
</div>
|
||||||
|
|
||||||
</li><li id="dli_01_0451__li116081140142218">Combine all the preceding fields into a JSON file to form a complete policy. You can set multiple actions and resources. You can also create a policy on the visualized page provided by IAM. For example:<p id="dli_01_0451__p1680453102415"><a name="dli_01_0451__li116081140142218"></a><a name="li116081140142218"></a>The authorized user has the permission to create and delete any database, submit jobs for any queue, and delete any table under any account ID in any region of DLI.</p>
|
</li><li id="dli_01_0451__li116081140142218">Combine all the preceding fields into a JSON file to form a complete policy. You can set multiple actions and resources. You can also create a policy on the visualized page provided by IAM. For example:<p id="dli_01_0451__p1680453102415"><a name="dli_01_0451__li116081140142218"></a><a name="li116081140142218"></a>Create a policy that grants users the permission to create and delete databases, submit jobs for any queue, and delete tables under any account ID in any region of DLI.</p>
|
||||||
<pre class="screen" id="dli_01_0451__screen1810312362518">{
|
<pre class="screen" id="dli_01_0451__screen1810312362518">{
|
||||||
"Version": "1.1",
|
"Version": "1.1",
|
||||||
"Statement": [
|
"Statement": [
|
||||||
|
@ -3,7 +3,7 @@
|
|||||||
<h1 class="topictitle1">Creating a Flink SQL Job</h1>
|
<h1 class="topictitle1">Creating a Flink SQL Job</h1>
|
||||||
<div id="body1574761276020"><p id="dli_01_0455__p1426222391410">This section describes how to create a Flink SQL job. You can use Flink SQLs to develop jobs to meet your service requirements. Using SQL statements simplifies logic implementation. You can edit Flink SQL statements for your job in the DLI SQL editor. This section describes how to use the SQL editor to write Flink SQL statements.</p>
|
<div id="body1574761276020"><p id="dli_01_0455__p1426222391410">This section describes how to create a Flink SQL job. You can use Flink SQLs to develop jobs to meet your service requirements. Using SQL statements simplifies logic implementation. You can edit Flink SQL statements for your job in the DLI SQL editor. This section describes how to use the SQL editor to write Flink SQL statements.</p>
|
||||||
<p id="dli_01_0455__p0792237205215"><a href="dli_01_0498.html">DLI Flink OpenSource SQL jobs</a> are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the community. In addition, Redis, GaussDB(DWS), and DIS data source types are added based on the community connector.</p>
|
<p id="dli_01_0455__p0792237205215"><a href="dli_01_0498.html">DLI Flink OpenSource SQL jobs</a> are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the community. In addition, Redis, GaussDB(DWS), and DIS data source types are added based on the community connector.</p>
|
||||||
<div class="section" id="dli_01_0455__section9243114805018"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0455__ul32010161007"><li id="dli_01_0455__li142013162002">You have prepared the data input and data output channels. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>.</li><li id="dli_01_0455__li7520181309">When you use a Flink SQL job to access other external data sources, such as OpenTSDB, HBase, Kafka, DWS, RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0455__ul3477133419715"><li id="dli_01_0455__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0455__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>. After a datasource connection is created, you can choose <strong id="dli_01_0455__b136411947171620">More</strong> > <strong id="dli_01_0455__b8991851171618">Test Address Connectivity</strong> in the <strong id="dli_01_0455__b2161654131616">Operation</strong> column on the <strong id="dli_01_0455__b65150213175">Queue Management</strong> page to check whether the network connection between the queue and the external data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</li></ul>
|
<div class="section" id="dli_01_0455__section9243114805018"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0455__ul32010161007"><li id="dli_01_0455__li142013162002">You have prepared the data input and data output channels. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>.</li><li id="dli_01_0455__li7520181309">When you use a Flink SQL job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a datasource connection to connect the job running queue to the external data source.<ul id="dli_01_0455__ul3477133419715"><li id="dli_01_0455__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0455__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>. After a datasource connection is created, you can choose <strong id="dli_01_0455__b136411947171620">More</strong> > <strong id="dli_01_0455__b8991851171618">Test Address Connectivity</strong> in the <strong id="dli_01_0455__b2161654131616">Operation</strong> column on the <strong id="dli_01_0455__b65150213175">Queue Management</strong> page to check whether the network connection between the queue and the external data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</li></ul>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0455__section28145411519"><h4 class="sectiontitle">Creating a Flink SQL Job</h4><ol id="dli_01_0455__ol15995121431920"><li id="dli_01_0455__li899510144197"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0455__menucascade10969155116523"><b><span class="uicontrol" id="dli_01_0455__uicontrol3969145120529">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0455__menucascade114421945855"><b><span class="uicontrol" id="dli_01_0455__uicontrol044254519511">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0455__wintitle6857152523411"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0455__li1832715401765"><span>In the upper right corner of the <span class="wintitle" id="dli_01_0455__wintitle149654113418"><b>Flink Jobs</b></span> page, click <span class="uicontrol" id="dli_01_0455__uicontrol1968964993415"><b>Create Job</b></span>.</span></li><li id="dli_01_0455__li1414012319596"><span>Specify job parameters.</span><p>
|
<div class="section" id="dli_01_0455__section28145411519"><h4 class="sectiontitle">Creating a Flink SQL Job</h4><ol id="dli_01_0455__ol15995121431920"><li id="dli_01_0455__li899510144197"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0455__menucascade10969155116523"><b><span class="uicontrol" id="dli_01_0455__uicontrol3969145120529">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0455__menucascade114421945855"><b><span class="uicontrol" id="dli_01_0455__uicontrol044254519511">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0455__wintitle6857152523411"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0455__li1832715401765"><span>In the upper right corner of the <span class="wintitle" id="dli_01_0455__wintitle149654113418"><b>Flink Jobs</b></span> page, click <span class="uicontrol" id="dli_01_0455__uicontrol1968964993415"><b>Create Job</b></span>.</span></li><li id="dli_01_0455__li1414012319596"><span>Specify job parameters.</span><p>
|
||||||
@ -43,7 +43,7 @@
|
|||||||
<ul id="dli_01_0455__ul55819552289"><li id="dli_01_0455__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0455__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0455__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0455__ul55819552289"><li id="dli_01_0455__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0455__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0455__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0455__ul16911451899"><li id="dli_01_0455__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0455__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0455__ul16911451899"><li id="dli_01_0455__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0455__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
@ -2,7 +2,7 @@
|
|||||||
|
|
||||||
<h1 class="topictitle1">Creating a Flink Jar Job</h1>
|
<h1 class="topictitle1">Creating a Flink Jar Job</h1>
|
||||||
<div id="body1574761279830"><p id="dli_01_0457__p76741043151420">This section describes how to create a Flink Jar job. You can perform secondary development based on Flink APIs, build your own JAR file, and submit the JAR file to DLI queues. DLI is fully compatible with open-source community APIs. To create a custom Flink job, you need to compile and build application JAR files. You must have a certain understanding of Flink secondary development and have high requirements related to stream computing complexity.</p>
|
<div id="body1574761279830"><p id="dli_01_0457__p76741043151420">This section describes how to create a Flink Jar job. You can perform secondary development based on Flink APIs, build your own JAR file, and submit the JAR file to DLI queues. DLI is fully compatible with open-source community APIs. To create a custom Flink job, you need to compile and build application JAR files. You must have a certain understanding of Flink secondary development and have high requirements related to stream computing complexity.</p>
|
||||||
<div class="section" id="dli_01_0457__section13123183424115"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0457__ul198451926172619"><li id="dli_01_0457__li51821947175614">Ensure that a dedicated queue has been created. To create a dedicated queue, select <strong id="dli_01_0457__b46637459575">Dedicated Resource Mode</strong> when you choose the type of a queue during purchase.</li><li id="dli_01_0457__li7520181309">When creating a Flink Jar job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0457__ul850415199816"><li id="dli_01_0457__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0457__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0457__p881561411413">On the <strong id="dli_01_0457__b232324774013">Resources</strong> > <strong id="dli_01_0457__b132414714406">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0457__b12324154712404">More</strong> > <strong id="dli_01_0457__b432415477400">Test Address Connectivity</strong> in the <strong id="dli_01_0457__b4324847174012">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
|
<div class="section" id="dli_01_0457__section13123183424115"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0457__ul198451926172619"><li id="dli_01_0457__li51821947175614">Ensure that a dedicated queue has been created. To create a dedicated queue, select <strong id="dli_01_0457__b46637459575">Dedicated Resource Mode</strong> when you choose the type of a queue during purchase.</li><li id="dli_01_0457__li7520181309">When you use a Flink Jar job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a datasource connection to connect the job running queue to the external data source.<ul id="dli_01_0457__ul850415199816"><li id="dli_01_0457__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0457__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0457__p881561411413">On the <strong id="dli_01_0457__b232324774013">Resources</strong> > <strong id="dli_01_0457__b132414714406">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0457__b12324154712404">More</strong> > <strong id="dli_01_0457__b432415477400">Test Address Connectivity</strong> in the <strong id="dli_01_0457__b4324847174012">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</li><li id="dli_01_0457__li17845142616266">When running a Flink Jar job, you need to build the secondary development application code into a Jar package and upload the JAR package to the created OBS bucket. Choose <strong id="dli_01_0457__b14988132715315">Data Management</strong> > <strong id="dli_01_0457__b121417311332">Package Management</strong> to create a package. For details, see <a href="dli_01_0367.html">Creating a Package</a>.<div class="note" id="dli_01_0457__note38679553417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0457__p108692554412">DLI does not support the download function. If you need to modify the uploaded data file, please edit the local file and upload it again.</p>
|
</li><li id="dli_01_0457__li17845142616266">When running a Flink Jar job, you need to build the secondary development application code into a Jar package and upload the JAR package to the created OBS bucket. Choose <strong id="dli_01_0457__b14988132715315">Data Management</strong> > <strong id="dli_01_0457__b121417311332">Package Management</strong> to create a package. For details, see <a href="dli_01_0367.html">Creating a Package</a>.<div class="note" id="dli_01_0457__note38679553417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0457__p108692554412">DLI does not support the download function. If you need to modify the uploaded data file, please edit the local file and upload it again.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
@ -43,7 +43,7 @@
|
|||||||
<ul id="dli_01_0457__ul55819552289"><li id="dli_01_0457__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0457__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0457__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0457__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0457__ul55819552289"><li id="dli_01_0457__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0457__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0457__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0457__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0457__ul16911451899"><li id="dli_01_0457__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0457__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0457__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0457__ul16911451899"><li id="dli_01_0457__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0457__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0457__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
@ -19,7 +19,7 @@
|
|||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0461__section8678193324114"><a name="dli_01_0461__section8678193324114"></a><a name="section8678193324114"></a><h4 class="sectiontitle">Stopping a Job</h4><p id="dli_01_0461__p10413556134214">You can stop a job in the <strong id="dli_01_0461__b199511322168">Running</strong> or <span class="parmvalue" id="dli_01_0461__parmvalue16170152024918"><b>Submitting</b></span> state.</p>
|
<div class="section" id="dli_01_0461__section8678193324114"><a name="dli_01_0461__section8678193324114"></a><a name="section8678193324114"></a><h4 class="sectiontitle">Stopping a Job</h4><p id="dli_01_0461__p10413556134214">You can stop a job in the <strong id="dli_01_0461__b199511322168">Running</strong> or <span class="parmvalue" id="dli_01_0461__parmvalue16170152024918"><b>Submitting</b></span> state.</p>
|
||||||
<ol id="dli_01_0461__ol999765714431"><li id="dli_01_0461__li1537162515919"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade4839243185810"><b><span class="uicontrol" id="dli_01_0461__uicontrol7834114315813">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0461__menucascade3839143155817"><b><span class="uicontrol" id="dli_01_0461__uicontrol17839124317581">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle984019439581"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0461__li97556283351"><span>Stop a job using either of the following methods:</span><p><ul id="dli_01_0461__ul1663022133517"><li id="dli_01_0461__li1684613360294">Stopping a job<p id="dli_01_0461__p539375319543"><a name="dli_01_0461__li1684613360294"></a><a name="li1684613360294"></a>Locate the row that contains the job to be stopped, click <span class="uicontrol" id="dli_01_0461__uicontrol14303162712597"><b>More</b></span> in the <span class="parmname" id="dli_01_0461__parmname5957193318596"><b>Operation</b></span> column, and select <span class="uicontrol" id="dli_01_0461__uicontrol34263915919"><b>Stop</b></span>.</p>
|
<ol id="dli_01_0461__ol999765714431"><li id="dli_01_0461__li1537162515919"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade4839243185810"><b><span class="uicontrol" id="dli_01_0461__uicontrol7834114315813">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0461__menucascade3839143155817"><b><span class="uicontrol" id="dli_01_0461__uicontrol17839124317581">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle984019439581"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0461__li97556283351"><span>Stop a job using either of the following methods:</span><p><ul id="dli_01_0461__ul1663022133517"><li id="dli_01_0461__li1684613360294">Stopping a job<p id="dli_01_0461__p539375319543"><a name="dli_01_0461__li1684613360294"></a><a name="li1684613360294"></a>Locate the row that contains the job to be stopped, click <span class="uicontrol" id="dli_01_0461__uicontrol14303162712597"><b>More</b></span> in the <span class="parmname" id="dli_01_0461__parmname5957193318596"><b>Operation</b></span> column, and select <span class="uicontrol" id="dli_01_0461__uicontrol34263915919"><b>Stop</b></span>.</p>
|
||||||
<p id="dli_01_0461__p1224864211298">Alternatively, you can select the row where the job you want to stop locates and click <span class="uicontrol" id="dli_01_0461__uicontrol1460464143"><b>Stop</b></span> in the upper left of the job list.</p>
|
<p id="dli_01_0461__p1224864211298">Alternatively, you can select the row where the job you want to stop locates and click <span class="uicontrol" id="dli_01_0461__uicontrol662162704"><b>Stop</b></span> in the upper left of the job list.</p>
|
||||||
</li><li id="dli_01_0461__li103984412300">Batch stopping jobs<p id="dli_01_0461__p1176518147308"><a name="dli_01_0461__li103984412300"></a><a name="li103984412300"></a>Locate the rows containing the jobs you want to stop and click <span class="uicontrol" id="dli_01_0461__uicontrol1927821713351"><b>Stop</b></span> in the upper left of the job list.</p>
|
</li><li id="dli_01_0461__li103984412300">Batch stopping jobs<p id="dli_01_0461__p1176518147308"><a name="dli_01_0461__li103984412300"></a><a name="li103984412300"></a>Locate the rows containing the jobs you want to stop and click <span class="uicontrol" id="dli_01_0461__uicontrol1927821713351"><b>Stop</b></span> in the upper left of the job list.</p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</p></li><li id="dli_01_0461__li14333204535219"><span>In the displayed <span class="wintitle" id="dli_01_0461__wintitle1796120483017"><b>Stop Job</b></span> dialog box, click <span class="uicontrol" id="dli_01_0461__uicontrol1453612541409"><b>OK</b></span> to stop the job.</span><p><div class="p" id="dli_01_0461__p167175381238"><div class="note" id="dli_01_0461__note16893119216"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0461__ul186891211102111"><li id="dli_01_0461__li768881110218">Before stopping a job, you can trigger a savepoint to save the job status information. When you start the job again, you can choose whether to restore the job from the savepoint.</li><li id="dli_01_0461__li5688161116219">If you select <strong id="dli_01_0461__b1533414174116">Trigger savepoint</strong>, a savepoint is created. If <strong id="dli_01_0461__b108781513154118">Trigger savepoint</strong> is not selected, no savepoint is created. By default, the savepoint function is disabled.</li><li id="dli_01_0461__li106891811102110">The lifecycle of a savepoint starts when the savepoint is triggered and stops the job, and ends when the job is restarted. The savepoint is automatically deleted after the job is restarted.</li></ul>
|
</p></li><li id="dli_01_0461__li14333204535219"><span>In the displayed <span class="wintitle" id="dli_01_0461__wintitle1796120483017"><b>Stop Job</b></span> dialog box, click <span class="uicontrol" id="dli_01_0461__uicontrol1453612541409"><b>OK</b></span> to stop the job.</span><p><div class="p" id="dli_01_0461__p167175381238"><div class="note" id="dli_01_0461__note16893119216"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0461__ul186891211102111"><li id="dli_01_0461__li768881110218">Before stopping a job, you can trigger a savepoint to save the job status information. When you start the job again, you can choose whether to restore the job from the savepoint.</li><li id="dli_01_0461__li5688161116219">If you select <strong id="dli_01_0461__b1533414174116">Trigger savepoint</strong>, a savepoint is created. If <strong id="dli_01_0461__b108781513154118">Trigger savepoint</strong> is not selected, no savepoint is created. By default, the savepoint function is disabled.</li><li id="dli_01_0461__li106891811102110">The lifecycle of a savepoint starts when the savepoint is triggered and stops the job, and ends when the job is restarted. The savepoint is automatically deleted after the job is restarted.</li></ul>
|
||||||
@ -51,7 +51,7 @@
|
|||||||
<div class="note" id="dli_01_0461__note10293547104214"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0461__ul152587411449"><li id="dli_01_0461__li1425816414446">When switching to another project or user, you need to grant permissions to the new project or user. For details, see <a href="dli_01_0479.html">Managing Flink Job Permissions</a>.</li><li id="dli_01_0461__li125913474417">Only jobs whose data format is the same as that of Flink jobs exported from DLI can be imported.</li></ul>
|
<div class="note" id="dli_01_0461__note10293547104214"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0461__ul152587411449"><li id="dli_01_0461__li1425816414446">When switching to another project or user, you need to grant permissions to the new project or user. For details, see <a href="dli_01_0479.html">Managing Flink Job Permissions</a>.</li><li id="dli_01_0461__li125913474417">Only jobs whose data format is the same as that of Flink jobs exported from DLI can be imported.</li></ul>
|
||||||
</div></div>
|
</div></div>
|
||||||
<ol id="dli_01_0461__ol55781266387"><li id="dli_01_0461__li1757816618386"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade113281655173817"><b><span class="uicontrol" id="dli_01_0461__uicontrol183274559388">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0461__menucascade432875583817"><b><span class="uicontrol" id="dli_01_0461__uicontrol1932814554388">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle1432819554381"><b>Flink Jobs</b></span> page is displayed.</span></li></ol><ol start="2" id="dli_01_0461__ol19578136113820"><li id="dli_01_0461__li12976193720419"><span>Click <span class="uicontrol" id="dli_01_0461__uicontrol78907524411"><b>Import Job</b></span> in the upper right corner. The <span class="wintitle" id="dli_01_0461__wintitle10552525174113"><b>Import Job</b></span> dialog box is displayed.</span><p><p id="dli_01_0461__p778004722517"></p>
|
<ol id="dli_01_0461__ol55781266387"><li id="dli_01_0461__li1757816618386"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade113281655173817"><b><span class="uicontrol" id="dli_01_0461__uicontrol183274559388">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0461__menucascade432875583817"><b><span class="uicontrol" id="dli_01_0461__uicontrol1932814554388">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle1432819554381"><b>Flink Jobs</b></span> page is displayed.</span></li></ol><ol start="2" id="dli_01_0461__ol19578136113820"><li id="dli_01_0461__li12976193720419"><span>Click <span class="uicontrol" id="dli_01_0461__uicontrol78907524411"><b>Import Job</b></span> in the upper right corner. The <span class="wintitle" id="dli_01_0461__wintitle10552525174113"><b>Import Job</b></span> dialog box is displayed.</span><p><p id="dli_01_0461__p778004722517"></p>
|
||||||
</p></li><li id="dli_01_0461__li165786615385"><span>Select the complete OBS path of the job configuration file to be imported. Click <span class="uicontrol" id="dli_01_0461__uicontrol296424514417"><b>Next</b></span>.</span></li><li id="dli_01_0461__li6199827194519"><span>Configure the same-name job policy and click next. Click <span class="uicontrol" id="dli_01_0461__uicontrol113581820114619"><b>Next</b></span>.</span><p><ul id="dli_01_0461__ul61271837174515"><li id="dli_01_0461__li17128193754520">Select <span class="wintitle" id="dli_01_0461__wintitle15193110175012"><b>Overwrite job of the same name</b></span>. If the name of the job to be imported already exists, the existing job configuration will be overwritten and the job status switches to <strong id="dli_01_0461__b134195919519">Draft</strong>.</li><li id="dli_01_0461__li12456144610452">If <span class="wintitle" id="dli_01_0461__wintitle19380194316511"><b>Overwrite job of the same name</b></span> is not selected and the name of the job to be imported already exists, the job will not be imported.</li></ul>
|
</p></li><li id="dli_01_0461__li165786615385"><span>Select the complete OBS path of the job configuration file to be imported. Click <span class="uicontrol" id="dli_01_0461__uicontrol296424514417"><b>Next</b></span>.</span></li><li id="dli_01_0461__li6199827194519"><span>Configure the same-name job policy and click next. Click <span class="uicontrol" id="dli_01_0461__uicontrol113581820114619"><b>Next</b></span>.</span><p><ul id="dli_01_0461__ul61271837174515"><li id="dli_01_0461__li17128193754520">Select <span class="wintitle" id="dli_01_0461__wintitle10600312193215"><b>Overwrite job of the same name</b></span>. If the name of the job to be imported already exists, the existing job configuration will be overwritten and the job status switches to <strong id="dli_01_0461__b1360051233211">Draft</strong>.</li><li id="dli_01_0461__li12456144610452">If <span class="wintitle" id="dli_01_0461__wintitle15846419123210"><b>Overwrite job of the same name</b></span> is not selected and the name of the job to be imported already exists, the job will not be imported.</li></ul>
|
||||||
</p></li><li id="dli_01_0461__li12578566385"><span>Ensure that <strong id="dli_01_0461__b55309219536">Config File</strong> and <strong id="dli_01_0461__b68521040145313">Overwrite Same-Name Job</strong> are correctly configured. Click <span class="uicontrol" id="dli_01_0461__uicontrol158241845175314"><b>Confirm</b></span> to import the job.</span></li></ol>
|
</p></li><li id="dli_01_0461__li12578566385"><span>Ensure that <strong id="dli_01_0461__b55309219536">Config File</strong> and <strong id="dli_01_0461__b68521040145313">Overwrite Same-Name Job</strong> are correctly configured. Click <span class="uicontrol" id="dli_01_0461__uicontrol158241845175314"><b>Confirm</b></span> to import the job.</span></li></ol>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0461__section15861321183619"><a name="dli_01_0461__section15861321183619"></a><a name="section15861321183619"></a><h4 class="sectiontitle">Modifying Name and Description</h4><p id="dli_01_0461__p103435523374">You can change the job name and description as required.</p>
|
<div class="section" id="dli_01_0461__section15861321183619"><a name="dli_01_0461__section15861321183619"></a><a name="section15861321183619"></a><h4 class="sectiontitle">Modifying Name and Description</h4><p id="dli_01_0461__p103435523374">You can change the job name and description as required.</p>
|
||||||
|
@ -2,7 +2,7 @@
|
|||||||
|
|
||||||
<h1 class="topictitle1">Flink Job Details</h1>
|
<h1 class="topictitle1">Flink Job Details</h1>
|
||||||
<div id="body1574761290628"><p id="dli_01_0462__p12907112213116">After creating a job, you can view the job details to learn about the following information:</p>
|
<div id="body1574761290628"><p id="dli_01_0462__p12907112213116">After creating a job, you can view the job details to learn about the following information:</p>
|
||||||
<ul id="dli_01_0462__ul180110913013"><li id="dli_01_0462__li732482943119"><a href="#dli_01_0462__section18786181516319">Viewing Job Details</a></li><li id="dli_01_0462__li980039123010"><a href="#dli_01_0462__section93781115103311">Checking the Job Monitoring Information</a></li><li id="dli_01_0462__li921116013814"><a href="#dli_01_0462__section11677164916529">Viewing the Task List of a Job</a></li><li id="dli_01_0462__li98005913306"><a href="#dli_01_0462__section9397163320">Viewing the Job Execution Plan</a></li><li id="dli_01_0462__li840206101015"><a href="#dli_01_0462__section18556377020">Viewing Job Submission Logs</a></li><li id="dli_01_0462__li1380189173020"><a href="#dli_01_0462__section91816183316">Viewing Job Running Logs</a></li></ul>
|
<ul id="dli_01_0462__ul180110913013"><li id="dli_01_0462__li732482943119"><a href="#dli_01_0462__section18786181516319">Viewing Job Details</a></li><li id="dli_01_0462__li980039123010"><a href="#dli_01_0462__section93781115103311">Checking Job Monitoring Information</a></li><li id="dli_01_0462__li921116013814"><a href="#dli_01_0462__section11677164916529">Viewing the Task List of a Job</a></li><li id="dli_01_0462__li98005913306"><a href="#dli_01_0462__section9397163320">Viewing the Job Execution Plan</a></li><li id="dli_01_0462__li840206101015"><a href="#dli_01_0462__section18556377020">Viewing Job Submission Logs</a></li><li id="dli_01_0462__li1380189173020"><a href="#dli_01_0462__section91816183316">Viewing Job Running Logs</a></li></ul>
|
||||||
<div class="section" id="dli_01_0462__section18786181516319"><a name="dli_01_0462__section18786181516319"></a><a name="section18786181516319"></a><h4 class="sectiontitle">Viewing Job Details</h4><p id="dli_01_0462__p130084115314">This section describes how to view job details. After you create and save a job, you can click the job name to view job details, including SQL statements and parameter settings. For a Jar job, you can only view its parameter settings.</p>
|
<div class="section" id="dli_01_0462__section18786181516319"><a name="dli_01_0462__section18786181516319"></a><a name="section18786181516319"></a><h4 class="sectiontitle">Viewing Job Details</h4><p id="dli_01_0462__p130084115314">This section describes how to view job details. After you create and save a job, you can click the job name to view job details, including SQL statements and parameter settings. For a Jar job, you can only view its parameter settings.</p>
|
||||||
<ol id="dli_01_0462__ol16902248948"><li id="dli_01_0462__li890284812416"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0462__menucascade242921423117"><b><span class="uicontrol" id="dli_01_0462__uicontrol1342391412310">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0462__menucascade64291014123115"><b><span class="uicontrol" id="dli_01_0462__uicontrol142921493111">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0462__wintitle4429414113114"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0462__li1689318511219"><span>Click the name of the job to be viewed. The <span class="wintitle" id="dli_01_0462__wintitle5101185023115"><b>Job Detail</b></span> tab is displayed.</span><p><p id="dli_01_0462__p244145142920">In the <span class="uicontrol" id="dli_01_0462__uicontrol17342132819011"><b>Job Details</b></span> tab, you can view SQL statements, configured parameters.</p>
|
<ol id="dli_01_0462__ol16902248948"><li id="dli_01_0462__li890284812416"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0462__menucascade242921423117"><b><span class="uicontrol" id="dli_01_0462__uicontrol1342391412310">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0462__menucascade64291014123115"><b><span class="uicontrol" id="dli_01_0462__uicontrol142921493111">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0462__wintitle4429414113114"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0462__li1689318511219"><span>Click the name of the job to be viewed. The <span class="wintitle" id="dli_01_0462__wintitle5101185023115"><b>Job Detail</b></span> tab is displayed.</span><p><p id="dli_01_0462__p244145142920">In the <span class="uicontrol" id="dli_01_0462__uicontrol17342132819011"><b>Job Details</b></span> tab, you can view SQL statements, configured parameters.</p>
|
||||||
<div class="p" id="dli_01_0462__p159819531993">The following uses a Flink SQL job as an example.
|
<div class="p" id="dli_01_0462__p159819531993">The following uses a Flink SQL job as an example.
|
||||||
@ -158,7 +158,7 @@
|
|||||||
</div>
|
</div>
|
||||||
</p></li></ol>
|
</p></li></ol>
|
||||||
</div>
|
</div>
|
||||||
<div class="section" id="dli_01_0462__section93781115103311"><a name="dli_01_0462__section93781115103311"></a><a name="section93781115103311"></a><h4 class="sectiontitle">Checking the Job Monitoring Information</h4><p id="dli_01_0462__p479419503514">You can use Cloud Eye to view details about job data input and output.</p>
|
<div class="section" id="dli_01_0462__section93781115103311"><a name="dli_01_0462__section93781115103311"></a><a name="section93781115103311"></a><h4 class="sectiontitle">Checking Job Monitoring Information</h4><p id="dli_01_0462__p479419503514">You can use Cloud Eye to view details about job data input and output.</p>
|
||||||
<ol id="dli_01_0462__ol579433119338"><li id="dli_01_0462__li1942951103"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0462__menucascade14174143516343"><b><span class="uicontrol" id="dli_01_0462__uicontrol171741635163418">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0462__menucascade12175835183416"><b><span class="uicontrol" id="dli_01_0462__uicontrol18175103513340">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0462__wintitle11175103512343"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0462__li174285117011"><span>Click the name of the job you want. The job details are displayed.</span><p><p id="dli_01_0462__p118991151614">Click <span class="uicontrol" id="dli_01_0462__uicontrol1174717203569"><b>Job Monitoring</b></span> in the upper right corner of the page to switch to the Cloud Eye console.</p>
|
<ol id="dli_01_0462__ol579433119338"><li id="dli_01_0462__li1942951103"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0462__menucascade14174143516343"><b><span class="uicontrol" id="dli_01_0462__uicontrol171741635163418">Job Management</span></b></span> > <span class="menucascade" id="dli_01_0462__menucascade12175835183416"><b><span class="uicontrol" id="dli_01_0462__uicontrol18175103513340">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0462__wintitle11175103512343"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0462__li174285117011"><span>Click the name of the job you want. The job details are displayed.</span><p><p id="dli_01_0462__p118991151614">Click <span class="uicontrol" id="dli_01_0462__uicontrol1174717203569"><b>Job Monitoring</b></span> in the upper right corner of the page to switch to the Cloud Eye console.</p>
|
||||||
<p id="dli_01_0462__p96871629105213">The following table describes monitoring metrics related to Flink jobs.</p>
|
<p id="dli_01_0462__p96871629105213">The following table describes monitoring metrics related to Flink jobs.</p>
|
||||||
|
|
||||||
|
@ -31,7 +31,7 @@
|
|||||||
<tr id="dli_01_0463__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.8.3.5.2.1.2.3.1.1 "><p id="dli_01_0463__p345210468163">Tag value</p>
|
<tr id="dli_01_0463__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.8.3.5.2.1.2.3.1.1 "><p id="dli_01_0463__p345210468163">Tag value</p>
|
||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.8.3.5.2.1.2.3.1.2 "><p id="dli_01_0463__p1545619468165">You can perform the following operations:</p>
|
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.8.3.5.2.1.2.3.1.2 "><p id="dli_01_0463__p1545619468165">You can perform the following operations:</p>
|
||||||
<ul id="dli_01_0463__ul1045720469162"><li id="dli_01_0463__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0463__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0463__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0463__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0463__ul1045720469162"><li id="dli_01_0463__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0463__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0463__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0463__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
File diff suppressed because it is too large
Load Diff
@ -12,8 +12,6 @@
|
|||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0533.html">Permission Management for Global Variables</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0533.html">Permission Management for Global Variables</a></strong><br>
|
||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0486.html">Service Authorization</a></strong><br>
|
|
||||||
</li>
|
|
||||||
</ul>
|
</ul>
|
||||||
</div>
|
</div>
|
||||||
|
|
||||||
|
@ -1,57 +0,0 @@
|
|||||||
<a name="dli_01_0486"></a><a name="dli_01_0486"></a>
|
|
||||||
|
|
||||||
<h1 class="topictitle1">Service Authorization</h1>
|
|
||||||
<div id="body1592465927727"><div class="section" id="dli_01_0486__section15133713144615"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0486__p9618111512469">Only the tenant account or a subaccount of user group <strong id="dli_01_0486__b579915002716">admin</strong> can authorize access.</p>
|
|
||||||
</div>
|
|
||||||
<div class="section" id="dli_01_0486__section88041626154617"><h4 class="sectiontitle">Procedure</h4><p id="dli_01_0486__p14101142142817">After entering the DLI management console, you are advised to set agency permissions to ensure that DLI can be used properly.</p>
|
|
||||||
<p id="dli_01_0486__p102201148151616">If you need to adjust the agency permissions, modify them on the <strong id="dli_01_0486__b925314125519">Service Authorization</strong> page. For details about the required agency permissions, see <a href="#dli_01_0486__table57135458133">Table 1</a>.</p>
|
|
||||||
<ol id="dli_01_0486__ol7305105054114"><li id="dli_01_0486__li5306135018415">Select required agency permissions and click <strong id="dli_01_0486__b6220132564310">Update Authorization</strong>. Only the tenant account or a subaccount of user group <strong id="dli_01_0486__b5489113744315">admin</strong> can authorize access. If the message "Agency permissions updated" is displayed, the update is successful.</li><li id="dli_01_0486__li591885154119">Once service authorization has succeeded, an agency named <strong id="dli_01_0486__b1946550124610">dli_admin_agency</strong> on IAM will be created. Go to the agency list to view the details. Do not delete <strong id="dli_01_0486__b940015120215">dli_admin_agency</strong>.<p id="dli_01_0486__p49921410319"></p>
|
|
||||||
</li></ol>
|
|
||||||
|
|
||||||
<div class="tablenoborder"><a name="dli_01_0486__table57135458133"></a><a name="table57135458133"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0486__table57135458133" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DLI agency permissions</caption><thead align="left"><tr id="dli_01_0486__dli_01_0399_row167125457139"><th align="left" class="cellrowborder" valign="top" width="28.26282628262826%" id="mcps1.3.2.5.2.4.1.1"><p id="dli_01_0486__dli_01_0399_p1971244511312">Permission</p>
|
|
||||||
</th>
|
|
||||||
<th align="left" class="cellrowborder" valign="top" width="43.03430343034304%" id="mcps1.3.2.5.2.4.1.2"><p id="dli_01_0486__dli_01_0399_p107129454131">Details</p>
|
|
||||||
</th>
|
|
||||||
<th align="left" class="cellrowborder" valign="top" width="28.7028702870287%" id="mcps1.3.2.5.2.4.1.3"><p id="dli_01_0486__dli_01_0399_p1571234517132">Remarks</p>
|
|
||||||
</th>
|
|
||||||
</tr>
|
|
||||||
</thead>
|
|
||||||
<tbody><tr id="dli_01_0486__dli_01_0399_row271214453135"><td class="cellrowborder" valign="top" width="28.26282628262826%" headers="mcps1.3.2.5.2.4.1.1 "><p id="dli_01_0486__dli_01_0399_p12712174541311">Tenant Administrator (global service)</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="43.03430343034304%" headers="mcps1.3.2.5.2.4.1.2 "><p id="dli_01_0486__dli_01_0399_p107121945121314"><strong id="dli_01_0486__dli_01_0399_b710162915528">Tenant Administrator</strong> permissions are required to access data from OBS to execute Flink jobs on DLI, for example, obtaining OBS/DWS data sources, log dump (including bucket authorization), checkpointing enabling, and job import and export.</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="28.7028702870287%" headers="mcps1.3.2.5.2.4.1.3 "><p id="dli_01_0486__dli_01_0399_p14712194515132">Due to cloud service cache differences, permission setting operations require about 60 minutes to take effect.</p>
|
|
||||||
</td>
|
|
||||||
</tr>
|
|
||||||
<tr id="dli_01_0486__dli_01_0399_row20713164510133"><td class="cellrowborder" valign="top" width="28.26282628262826%" headers="mcps1.3.2.5.2.4.1.1 "><p id="dli_01_0486__dli_01_0399_p16713174591316">DIS Administrator</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="43.03430343034304%" headers="mcps1.3.2.5.2.4.1.2 "><p id="dli_01_0486__dli_01_0399_p117138459131"><strong id="dli_01_0486__dli_01_0399_b201481540115214">DIS Administrator</strong> permissions are required to use DIS data as the data source of DLI Flink jobs.</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="28.7028702870287%" headers="mcps1.3.2.5.2.4.1.3 "><p id="dli_01_0486__dli_01_0399_p13713134511315">Due to cloud service cache differences, permission setting operations require about 30 minutes to take effect.</p>
|
|
||||||
</td>
|
|
||||||
</tr>
|
|
||||||
<tr id="dli_01_0486__dli_01_0399_row1371364515139"><td class="cellrowborder" valign="top" width="28.26282628262826%" headers="mcps1.3.2.5.2.4.1.1 "><p id="dli_01_0486__dli_01_0399_p5713164531320">VPC Administrator</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="43.03430343034304%" headers="mcps1.3.2.5.2.4.1.2 "><p id="dli_01_0486__dli_01_0399_p3713545181311"><strong id="dli_01_0486__dli_01_0399_b13885155115318">VPC Administrator</strong> permissions are required to use the VPC, subnet, route, VPC peering connection, and port for DLI datasource connections.</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="28.7028702870287%" headers="mcps1.3.2.5.2.4.1.3 "><p id="dli_01_0486__dli_01_0399_p13713445201315">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
|
|
||||||
</td>
|
|
||||||
</tr>
|
|
||||||
<tr id="dli_01_0486__dli_01_0399_row1171334518133"><td class="cellrowborder" valign="top" width="28.26282628262826%" headers="mcps1.3.2.5.2.4.1.1 "><p id="dli_01_0486__dli_01_0399_p1713745181315">SMN Administrator</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="43.03430343034304%" headers="mcps1.3.2.5.2.4.1.2 "><p id="dli_01_0486__dli_01_0399_p18713845121320">To receive notifications when a DLI job fails, <strong id="dli_01_0486__dli_01_0399_b073319105532">SMN Administrator</strong> permissions are required.</p>
|
|
||||||
</td>
|
|
||||||
<td class="cellrowborder" valign="top" width="28.7028702870287%" headers="mcps1.3.2.5.2.4.1.3 "><p id="dli_01_0486__dli_01_0399_p371312455133">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
|
|
||||||
</td>
|
|
||||||
</tr>
|
|
||||||
</tbody>
|
|
||||||
</table>
|
|
||||||
</div>
|
|
||||||
</div>
|
|
||||||
</div>
|
|
||||||
<div>
|
|
||||||
<div class="familylinks">
|
|
||||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0485.html">Global Configuration</a></div>
|
|
||||||
</div>
|
|
||||||
</div>
|
|
||||||
|
|
@ -1,7 +1,7 @@
|
|||||||
<a name="dli_01_0489"></a><a name="dli_01_0489"></a>
|
<a name="dli_01_0489"></a><a name="dli_01_0489"></a>
|
||||||
|
|
||||||
<h1 class="topictitle1">Testing Address Connectivity</h1>
|
<h1 class="topictitle1">Testing Address Connectivity</h1>
|
||||||
<div id="body1594301082896"><p id="dli_01_0489__p8060118">It can be used to test the connectivity between the DLI queue and the peer IP address specified by the user in common scenarios, or the connectivity between the DLI queue and the peer IP address bound to the datasource connection in cross-source connection scenarios. The operation is as follows:</p>
|
<div id="body1594301082896"><p id="dli_01_0489__p8060118">It can be used to test the connectivity between the DLI queue and the peer IP address specified by the user in common scenarios, or the connectivity between the DLI queue and the peer IP address bound to the datasource connection in datasource connection scenarios. The operation is as follows:</p>
|
||||||
<ol id="dli_01_0489__ol1244412250287"><li id="dli_01_0489__li1771354513304">On the <span class="wintitle" id="dli_01_0489__wintitle14507737191011"><b>Queue Management</b></span> page, locate the row containing the target queue, click <strong id="dli_01_0489__b6992221920">More</strong> in the <span class="parmname" id="dli_01_0489__parmname12662123131512"><b>Operation</b></span> column, and select <strong id="dli_01_0489__b156808121698">Test Address Connectivity</strong>.</li><li id="dli_01_0489__li9592558175016">On the <strong id="dli_01_0489__b743522610911">Test Address Connectivity</strong> page, enter the address to be tested. The domain name and IP address are supported, and the port number can be specified.</li><li id="dli_01_0489__li915918121711">Click <strong id="dli_01_0489__b84235270614344">Test</strong>.<p id="dli_01_0489__p1461846070">If the test address is reachable, a message is displayed on the page, indicating that the address is reachable.</p>
|
<ol id="dli_01_0489__ol1244412250287"><li id="dli_01_0489__li1771354513304">On the <span class="wintitle" id="dli_01_0489__wintitle14507737191011"><b>Queue Management</b></span> page, locate the row containing the target queue, click <strong id="dli_01_0489__b6992221920">More</strong> in the <span class="parmname" id="dli_01_0489__parmname12662123131512"><b>Operation</b></span> column, and select <strong id="dli_01_0489__b156808121698">Test Address Connectivity</strong>.</li><li id="dli_01_0489__li9592558175016">On the <strong id="dli_01_0489__b743522610911">Test Address Connectivity</strong> page, enter the address to be tested. The domain name and IP address are supported, and the port number can be specified.</li><li id="dli_01_0489__li915918121711">Click <strong id="dli_01_0489__b84235270614344">Test</strong>.<p id="dli_01_0489__p1461846070">If the test address is reachable, a message is displayed on the page, indicating that the address is reachable.</p>
|
||||||
<p id="dli_01_0489__p11009167716">If the test address is unreachable, the system displays a message indicating that the address is unreachable. Check the network configurations and try again. Network configurations include the VPC peering and the datasource connection. Check whether they have been activated.</p>
|
<p id="dli_01_0489__p11009167716">If the test address is unreachable, the system displays a message indicating that the address is unreachable. Check the network configurations and try again. Network configurations include the VPC peering and the datasource connection. Check whether they have been activated.</p>
|
||||||
</li></ol>
|
</li></ol>
|
||||||
|
@ -3,7 +3,7 @@
|
|||||||
<h1 class="topictitle1">(Recommended) Creating a Flink OpenSource SQL Job</h1>
|
<h1 class="topictitle1">(Recommended) Creating a Flink OpenSource SQL Job</h1>
|
||||||
<div id="body0000001078931613"><p id="dli_01_0498__p085764624712">This section describes how to create a Flink OpenSource SQL job.</p>
|
<div id="body0000001078931613"><p id="dli_01_0498__p085764624712">This section describes how to create a Flink OpenSource SQL job.</p>
|
||||||
<p id="dli_01_0498__p11239138144511">DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the community. In addition, Redis, GaussDB(DWS), and DIS data source types are added based on the community connector. For details about the syntax and restrictions of Flink SQL DDL, DML, and functions, see <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/" target="_blank" rel="noopener noreferrer">Table API & SQL</a>.</p>
|
<p id="dli_01_0498__p11239138144511">DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the community. In addition, Redis, GaussDB(DWS), and DIS data source types are added based on the community connector. For details about the syntax and restrictions of Flink SQL DDL, DML, and functions, see <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/" target="_blank" rel="noopener noreferrer">Table API & SQL</a>.</p>
|
||||||
<div class="section" id="dli_01_0498__section9243114805018"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0498__ul23468771316"><li id="dli_01_0498__li434615710136">You have prepared the data input and data output channels. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>.</li><li id="dli_01_0498__li7520181309">Before creating a Flink OpenSource SQL job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0498__ul850415199816"><li id="dli_01_0498__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0498__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0498__p881561411413">On the <strong id="dli_01_0498__b1715483452718">Resources</strong> > <strong id="dli_01_0498__b15450175204114">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0498__b645115144115">More</strong> > <strong id="dli_01_0498__b44511659418">Test Address Connectivity</strong> in the <strong id="dli_01_0498__b13451175144117">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
|
<div class="section" id="dli_01_0498__section9243114805018"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0498__ul23468771316"><li id="dli_01_0498__li434615710136">You have prepared the data input and data output channels. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>.</li><li id="dli_01_0498__li7520181309">Before creating a Flink OpenSource SQL job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS, you need to create a datasource connection to connect the job running queue to the external data source.<ul id="dli_01_0498__ul850415199816"><li id="dli_01_0498__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0498__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0498__p881561411413">On the <strong id="dli_01_0498__b1715483452718">Resources</strong> > <strong id="dli_01_0498__b15450175204114">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0498__b645115144115">More</strong> > <strong id="dli_01_0498__b44511659418">Test Address Connectivity</strong> in the <strong id="dli_01_0498__b13451175144117">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</div>
|
</div>
|
||||||
@ -45,7 +45,7 @@
|
|||||||
<ul id="dli_01_0498__ul6660330125016"><li id="dli_01_0498__li196601230125017">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0498__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0498__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0498__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
<ul id="dli_01_0498__ul6660330125016"><li id="dli_01_0498__li196601230125017">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0498__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0498__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0498__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
<ul id="dli_01_0498__ul16911451899"><li id="dli_01_0498__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0498__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0498__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
<ul id="dli_01_0498__ul16911451899"><li id="dli_01_0498__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0498__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0498__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</li></ul>
|
</li></ul>
|
||||||
</td>
|
</td>
|
||||||
|
113
docs/dli/umn/dli_01_0504.html
Normal file
113
docs/dli/umn/dli_01_0504.html
Normal file
File diff suppressed because it is too large
Load Diff
83
docs/dli/umn/dli_01_0505.html
Normal file
83
docs/dli/umn/dli_01_0505.html
Normal file
@ -0,0 +1,83 @@
|
|||||||
|
<a name="dli_01_0505"></a><a name="dli_01_0505"></a>
|
||||||
|
|
||||||
|
<h1 class="topictitle1">Creating an Elastic Resource Pool</h1>
|
||||||
|
<div id="body0000001262327348"><p id="dli_01_0505__p8060118">For details about the application scenarios of elastic resource pools, see the <a href="dli_01_0504.html">Overview</a>. This section describes how to create an elastic resource pool.</p>
|
||||||
|
<div class="section" id="dli_01_0505__section124281747104415"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0505__ul34516753514"><li id="dli_01_0505__li145117710353">If you use an enhanced datasource connection, the network segment of the elastic resource pool cannot overlap that of the data source.</li><li id="dli_01_0505__li2071731103519">The network segment of an elastic resource pool cannot be changed after being set.</li></ul>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0505__section261216163408"><h4 class="sectiontitle">Creating an Elastic Resource Pool</h4><ol id="dli_01_0505__ol1695974713408"><li id="dli_01_0505__li7959347174010"><span>In the navigation pane on the left, choose <strong id="dli_01_0505__b03371755121112">Resources</strong> > <strong id="dli_01_0505__b6496158191111">Resource Pool</strong>.</span></li><li id="dli_01_0505__li925655144013"><span>On the <strong id="dli_01_0505__b192492731217">Resource Pool</strong> page, click <strong id="dli_01_0505__b49371596179">Buy Resource Pool</strong> in the upper right corner.</span></li><li id="dli_01_0505__li122961218154216"><span>On the displayed page, set the following parameters:</span><p>
|
||||||
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0505__table67098261452" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="dli_01_0505__row1670902620453"><th align="left" class="cellrowborder" valign="top" width="19.84%" id="mcps1.3.3.2.3.2.1.2.3.1.1"><p id="dli_01_0505__p27091526194510">Parameter</p>
|
||||||
|
</th>
|
||||||
|
<th align="left" class="cellrowborder" valign="top" width="80.16%" id="mcps1.3.3.2.3.2.1.2.3.1.2"><p id="dli_01_0505__p1570911262450">Description</p>
|
||||||
|
</th>
|
||||||
|
</tr>
|
||||||
|
</thead>
|
||||||
|
<tbody><tr id="dli_01_0505__row114511525664"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p1345192516620">Region</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p1515521112508">Select a region. Select a region near you to ensure the lowest latency possible.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row1861619301364"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p261611307614">Project</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p1374818344289">Each region corresponds to a project.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row87097266456"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p87092269457">Name</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p7610681714">Name of the elastic resource pool.</p>
|
||||||
|
<ul id="dli_01_0505__ul103971287278"><li id="dli_01_0505__li10564123662717">The name can contain only digits, letters, and underscores (_), but cannot contain only digits or start with an underscore (_) or digit.</li><li id="dli_01_0505__li12978521191">The description can contain a maximum of 128 characters.</li></ul>
|
||||||
|
<div class="note" id="dli_01_0505__note13297452697"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0505__p192979529919">The elastic resource pool name is case-insensitive. Uppercase letters will be automatically converted to lowercase letters.</p>
|
||||||
|
</div></div>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row997892416712"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p897872416710">CU Range</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p697813249712">The maximum and minimum CUs allowed for the elastic resource pool.</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row9709326154519"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p1770982614510">Description</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p6709026134519">Description of the elastic resource pool</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row186546547502"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p76546546506">CIDR Block</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p18654854155016">The CIDR block to which the elastic resource pool belongs. If you use an enhanced datasource connection, the CIDR block of the elastic resource pool cannot overlap that of the data source. <strong id="dli_01_0505__b36391129164419">The CIDR block of an elastic resource pool cannot be modified after being set.</strong></p>
|
||||||
|
<p id="dli_01_0505__p480544463014">Recommended CIDR block:</p>
|
||||||
|
<p id="dli_01_0505__p15392123325615">10.0.0.0~10.255.0.0/16~19</p>
|
||||||
|
<p id="dli_01_0505__p1239283345611">172.16.0.0~172.31.0.0/16~19</p>
|
||||||
|
<p id="dli_01_0505__p1939216336565">192.168.0.0~192.168.0.0/16~19</p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row2087516590"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p47271145191218">Enterprise Project</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p672884514124">If the created elastic resource pool belongs to an enterprise project, select the enterprise project.</p>
|
||||||
|
<p id="dli_01_0505__p17927191522611">An enterprise project facilitates project-level management and grouping of cloud resources and users.</p>
|
||||||
|
<div class="note" id="dli_01_0505__note10728164511122"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0505__p1728184551214">This parameter is displayed only for users who have enabled the Enterprise Management Service.</p>
|
||||||
|
</div></div>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0505__row529416151216"><td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0505__p105901518162120">Tags</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="80.16%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0505__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
|
||||||
|
<div class="note" id="dli_01_0505__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0505__dli_01_0363_ul1830018521911"><li id="dli_01_0505__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0505__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0505__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
|
||||||
|
</div></div>
|
||||||
|
<ul id="dli_01_0505__ul55819552289"><li id="dli_01_0505__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0505__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0505__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0505__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||||
|
</div></div>
|
||||||
|
</li></ul>
|
||||||
|
<ul id="dli_01_0505__ul16911451899"><li id="dli_01_0505__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0505__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0505__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
|
||||||
|
</div></div>
|
||||||
|
</li></ul>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
</tbody>
|
||||||
|
</table>
|
||||||
|
</div>
|
||||||
|
</p></li><li id="dli_01_0505__li9674195975717"><span>Click <strong id="dli_01_0505__b16846132452214">Buy</strong> and confirm the configurations.</span></li><li id="dli_01_0505__li48164249158"><span>Click <strong id="dli_01_0505__b8481111513224">Pay</strong>. Wait until the status of the elastic resource pool changes to <strong id="dli_01_0505__b1180052892318">Available</strong>. The elastic resource pool is successfully created.</span></li><li id="dli_01_0505__li13315114114414"><span>Refer to <a href="dli_01_0515.html">Creating an Elastic Resource Pool and Running a Job</a> and <a href="dli_01_0516.html">Configuring Scaling Policies for Queues</a> to perform subsequent operations as needed.</span></li></ol>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
<div>
|
||||||
|
<div class="familylinks">
|
||||||
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0529.html">Regular Operations</a></div>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
|
177
docs/dli/umn/dli_01_0506.html
Normal file
177
docs/dli/umn/dli_01_0506.html
Normal file
File diff suppressed because it is too large
Load Diff
26
docs/dli/umn/dli_01_0507.html
Normal file
26
docs/dli/umn/dli_01_0507.html
Normal file
@ -0,0 +1,26 @@
|
|||||||
|
<a name="dli_01_0507"></a><a name="dli_01_0507"></a>
|
||||||
|
|
||||||
|
<h1 class="topictitle1">Setting CUs</h1>
|
||||||
|
<div id="body0000001310007485"><p id="dli_01_0507__p1676113259231">CU settings are used to control the maximum and minimum CU ranges for elastic resource pools to avoid unlimited resource scaling.</p>
|
||||||
|
<p id="dli_01_0507__p254825922115">For example, an elastic resource pool has a maximum of 256 and two queues, and each queue must have at least 64 CUs. If you want to add another queue that needs at lest 256 CUs to the elastic resource pool, the operation is not allowed due to the maximum CUs of the elastic resource pool.</p>
|
||||||
|
<div class="section" id="dli_01_0507__section034917415190"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0507__ul1340419438109"><li id="dli_01_0507__li640494313101">In any time segment of a day, the total minimum CUs of all queues in an elastic resource pool cannot be more than the minimum CUs of the pool.</li><li id="dli_01_0507__li146137141114">In any time segment of a day, the maximum CUs of any queue in an elastic resource pool cannot be more than the maximum CUs of the pool.</li><li id="dli_01_0507__li0665175514555">When you change the minimum CUs of a created elastic resource pool, ensure that the value is no more than the current CU value. Otherwise, the modification fails.</li></ul>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0507__section038671618228"><h4 class="sectiontitle">Setting CUs</h4><ol id="dli_01_0507__ol3527133810450"><li id="dli_01_0507__li252773874515"><span>In the navigation pane on the left, choose <strong id="dli_01_0507__b1222413013282">Resources</strong> > <strong id="dli_01_0507__b172241130132816">Resource Pool</strong>.</span></li><li id="dli_01_0507__li3147165213456"><span>Locate the row that contains the desired elastic resource pool, click <strong id="dli_01_0507__b10635115112914">More</strong> in the <strong id="dli_01_0507__b436468192915">Operation</strong> column, and select <strong id="dli_01_0507__b12687151172912">Set CUs</strong>.</span></li><li id="dli_01_0507__li11521185517507"><span>In the <strong id="dli_01_0507__b5276658124015">Set CUs</strong> dialog box, set the minimum CUs on the left and the maximum CUs on the right. Click <strong id="dli_01_0507__b178181416104418">OK</strong>.</span></li></ol>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0507__section1620863815219"><h4 class="sectiontitle">FAQ</h4><ul id="dli_01_0507__ul5166191519259"><li id="dli_01_0507__li16166715192519"><strong id="dli_01_0507__b194541952193211">How Do I Change the Minimum CUs of the Existing Queues in an Elastic Resource Pool If the Total CUs of the Queues Equal the Minimum CUs of the Elastic Resource Pool?</strong><p id="dli_01_0507__p17885237132914">Answer:</p>
|
||||||
|
<ul id="dli_01_0507__ul854532153714"><li id="dli_01_0507__li154911418133719">Step 1: Increase the maximum number of CUs of the existing queues so that the current number of CUs of the elastic resource pool is no less than the target minimum number of CUs (the sum of the minimum number of CUs of the queues you want to change to).<div class="note" id="dli_01_0507__note157380144311"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0507__p187313044318">If the maximum number of CUs of the elastic resource pool is equal to its minimum number of CUs, increase the maximum number of CUs.</p>
|
||||||
|
</div></div>
|
||||||
|
</li><li id="dli_01_0507__li849941813717">Step 2: Set the minimum CUs of the elastic resource pool.</li><li id="dli_01_0507__li45081818143713">Step 3: Change the minimum CUs of the existing queues in the elastic resource pool.</li></ul>
|
||||||
|
</li><li id="dli_01_0507__li7726122819324"><strong id="dli_01_0507__b7521758155012">How Do I Add Queues to an Elastic Resource Pool If the Total CUs of the Queues Equal the Minimum CUs of the Elastic Resource Pool?</strong><p id="dli_01_0507__p10752193512376">Answer:</p>
|
||||||
|
<ul id="dli_01_0507__ul1975215354370"><li id="dli_01_0507__li9752335133715"><a name="dli_01_0507__li9752335133715"></a><a name="li9752335133715"></a>Step 1: Increase the maximum number of CUs of the existing queues so that the current number of CUs of the elastic resource pool is no less than the target minimum number of CUs (the sum of the minimum number of CUs of the queues you want to change to).<div class="note" id="dli_01_0507__note2087784474612"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0507__p187754414616">If the maximum number of CUs of the elastic resource pool is equal to its minimum number of CUs, increase the maximum number of CUs.</p>
|
||||||
|
</div></div>
|
||||||
|
</li><li id="dli_01_0507__li14752163513715">Step 2: Set the minimum CUs of the elastic resource pool.</li><li id="dli_01_0507__li775211358378">Step 3: Add queues to the elastic resource pool.</li><li id="dli_01_0507__li361517224">Step 4: Restore the maximum CUs of the queues you have increased in <a href="#dli_01_0507__li9752335133715">Step 1</a>.</li></ul>
|
||||||
|
</li></ul>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
<div>
|
||||||
|
<div class="familylinks">
|
||||||
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0529.html">Regular Operations</a></div>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
|
13
docs/dli/umn/dli_01_0508.html
Normal file
13
docs/dli/umn/dli_01_0508.html
Normal file
@ -0,0 +1,13 @@
|
|||||||
|
<a name="dli_01_0508"></a><a name="dli_01_0508"></a>
|
||||||
|
|
||||||
|
<h1 class="topictitle1">Elastic Resource Pool</h1>
|
||||||
|
<div id="body0000001309847537"></div>
|
||||||
|
<div>
|
||||||
|
<ul class="ullinks">
|
||||||
|
<li class="ulchildlink"><strong><a href="dli_01_0528.html">Before You Start</a></strong><br>
|
||||||
|
</li>
|
||||||
|
<li class="ulchildlink"><strong><a href="dli_01_0529.html">Regular Operations</a></strong><br>
|
||||||
|
</li>
|
||||||
|
</ul>
|
||||||
|
</div>
|
||||||
|
|
104
docs/dli/umn/dli_01_0509.html
Normal file
104
docs/dli/umn/dli_01_0509.html
Normal file
File diff suppressed because it is too large
Load Diff
@ -14,7 +14,7 @@
|
|||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0318.html">DLI Operations That Can Be Recorded by CTS</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0318.html">DLI Operations That Can Be Recorded by CTS</a></strong><br>
|
||||||
</li>
|
</li>
|
||||||
<li class="ulchildlink"><strong><a href="dli_01_0550.html">Quotas</a></strong><br>
|
<li class="ulchildlink"><strong><a href="dli_01_0550.html">Quota Management</a></strong><br>
|
||||||
</li>
|
</li>
|
||||||
</ul>
|
</ul>
|
||||||
</div>
|
</div>
|
||||||
|
@ -32,7 +32,7 @@
|
|||||||
</td>
|
</td>
|
||||||
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0514__p2059062317589">Datasource connection status. The following three statuses are available:</p>
|
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0514__p2059062317589">Datasource connection status. The following three statuses are available:</p>
|
||||||
<ul id="dli_01_0514__ul15899620876"><li id="dli_01_0514__li118999201473">Creating</li><li id="dli_01_0514__li789910201877">Active</li><li id="dli_01_0514__li1089914207718">Failed</li></ul>
|
<ul id="dli_01_0514__ul15899620876"><li id="dli_01_0514__li118999201473">Creating</li><li id="dli_01_0514__li789910201877">Active</li><li id="dli_01_0514__li1089914207718">Failed</li></ul>
|
||||||
<div class="note" id="dli_01_0514__note1964641888"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0514__p1864620111814">If the connection status is <strong id="dli_01_0514__b1931035216528">Failed</strong>, click <span><img id="dli_01_0514__image122211841291" src="en-us_image_0000001151957753.png"></span> on the left to view the detailed error information.</p>
|
<div class="note" id="dli_01_0514__note1964641888"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0514__p1864620111814">If the connection status is <strong id="dli_01_0514__b3348182673014">Failed</strong>, click <span><img id="dli_01_0514__image83493267303" src="en-us_image_0000001151957753.png"></span> on the left to view the detailed error information.</p>
|
||||||
</div></div>
|
</div></div>
|
||||||
</td>
|
</td>
|
||||||
</tr>
|
</tr>
|
||||||
|
94
docs/dli/umn/dli_01_0515.html
Normal file
94
docs/dli/umn/dli_01_0515.html
Normal file
@ -0,0 +1,94 @@
|
|||||||
|
<a name="dli_01_0515"></a><a name="dli_01_0515"></a>
|
||||||
|
|
||||||
|
<h1 class="topictitle1">Creating an Elastic Resource Pool and Running a Job</h1>
|
||||||
|
<div id="body0000001261847600"><div class="p" id="dli_01_0515__p8060118">This section walks you through the procedure of adding a queue to an elastic resource pool and binding an enhanced datasource connection to the elastic resource pool.<div class="fignone" id="dli_01_0515__fig14806195882919"><span class="figcap"><b>Figure 1 </b>Process of creating an elastic resource pool</span><br><span><img id="dli_01_0515__image1180795842916" src="en-us_image_0000001309847545.png"></span></div>
|
||||||
|
</div>
|
||||||
|
|
||||||
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0515__table1627962913538" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Procedure</caption><thead align="left"><tr id="dli_01_0515__row13279929105316"><th align="left" class="cellrowborder" valign="top" width="18.56185618561856%" id="mcps1.3.2.2.4.1.1"><p id="dli_01_0515__p152791529105319">Step</p>
|
||||||
|
</th>
|
||||||
|
<th align="left" class="cellrowborder" valign="top" width="36.41364136413641%" id="mcps1.3.2.2.4.1.2"><p id="dli_01_0515__p927912294532">Description</p>
|
||||||
|
</th>
|
||||||
|
<th align="left" class="cellrowborder" valign="top" width="45.02450245024502%" id="mcps1.3.2.2.4.1.3"><p id="dli_01_0515__p12279192965315">Reference</p>
|
||||||
|
</th>
|
||||||
|
</tr>
|
||||||
|
</thead>
|
||||||
|
<tbody><tr id="dli_01_0515__row42791293532"><td class="cellrowborder" valign="top" width="18.56185618561856%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0515__p15863113762413">Create an elastic resource pool</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="36.41364136413641%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0515__p1186393702415">Create an elastic resource pool and configure basic information, such as the billing mode, CU range, and CIDR block.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="45.02450245024502%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0515__p32731651132920"><a href="dli_01_0505.html">Creating an Elastic Resource Pool</a></p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0515__row14280142945313"><td class="cellrowborder" valign="top" width="18.56185618561856%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0515__p112807291532">Add a queue to the elastic resource pool</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="36.41364136413641%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0515__p1628019295539">Add the queue where your jobs will run on to the elastic resource pool. The operations are as follows:</p>
|
||||||
|
<ol id="dli_01_0515__ol428392615372"><li id="dli_01_0515__li19283162618373">Set basic information about the queue, such as the name and type.</li><li id="dli_01_0515__li2087572517387">Configure the scaling policy of the queue, including the priority, period, and the maximum and minimum CUs allowed for scaling.</li></ol>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="45.02450245024502%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0515__p7607355122416"><a href="dli_01_0509.html">Adding a Queue</a></p>
|
||||||
|
<p id="dli_01_0515__p1177165518331"><a href="dli_01_0506.html">Managing Queues</a></p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0515__row3280152975314"><td class="cellrowborder" valign="top" width="18.56185618561856%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0515__p13759134118253">(Optional) Create an enhanced datasource connection.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="36.41364136413641%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0515__p375924113253">If a job needs to access data from other data sources, for example, GaussDB(DWS) and RDS, you need to create a datasource connection.</p>
|
||||||
|
<p id="dli_01_0515__p14698201510405">The created datasource connection must be bound to the elastic resource pool.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="45.02450245024502%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0515__p1459372713302"><a href="dli_01_0006.html">Creating an Enhanced Datasource Connection</a></p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
<tr id="dli_01_0515__row94491837194210"><td class="cellrowborder" valign="top" width="18.56185618561856%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0515__p844913712422">Run a job.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="36.41364136413641%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0515__p54498376425">Create and submit the job as you need.</p>
|
||||||
|
</td>
|
||||||
|
<td class="cellrowborder" valign="top" width="45.02450245024502%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0515__p194614411307"><a href="dli_01_0017.html">SQL Job Management</a></p>
|
||||||
|
<p id="dli_01_0515__p15288125803011"><a href="dli_01_0403.html">Overview</a></p>
|
||||||
|
<p id="dli_01_0515__p78946405436"><a href="dli_01_0384.html">Creating a Spark Job</a></p>
|
||||||
|
</td>
|
||||||
|
</tr>
|
||||||
|
</tbody>
|
||||||
|
</table>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0515__section20375737115219"><a name="dli_01_0515__section20375737115219"></a><a name="section20375737115219"></a><h4 class="sectiontitle">Step 1: Create an Elastic Resource Pool</h4><ol id="dli_01_0515__ol193907145108"><li id="dli_01_0515__li3390161431020">Log in to the DLI management console. In the navigation pane on the left, choose <strong id="dli_01_0515__b9970191603415">Resources</strong> > <strong id="dli_01_0515__b103186202344">Resource Pool</strong>.</li><li id="dli_01_0515__li5390171401016">On the displayed <strong id="dli_01_0515__b7628346595254">Resource Pool</strong> page, click <strong id="dli_01_0515__b20534676135254">Buy Resource Pool</strong> in the upper right corner.</li><li id="dli_01_0515__li133901314191011">On the displayed page, set the following parameters:<ul id="dli_01_0515__ul161521581016"><li id="dli_01_0515__li9378124110319"><strong id="dli_01_0515__b7313439154312">Name</strong>: Enter the name of the elastic resource pool. For example, <strong id="dli_01_0515__b124651949174319">pool_test</strong>.</li><li id="dli_01_0515__li1761814682119"><strong id="dli_01_0515__b659517014441">CU range</strong>: Minimum and maximum CUs of the elastic resource pool.</li><li id="dli_01_0515__li615215819015"><strong id="dli_01_0515__b202517712453">CIDR Block</strong>: Network segment of the elastic resource pool. For example, <strong id="dli_01_0515__b1042673324515">172.16.0.0/18</strong>.</li><li id="dli_01_0515__li1066019193813">Set other parameters as required.</li></ul>
|
||||||
|
<p id="dli_01_0515__p163731569598">For details about how to create an elastic resource pool, see <a href="dli_01_0505.html">Creating an Elastic Resource Pool</a>.</p>
|
||||||
|
</li><li id="dli_01_0515__li83901314181011">Click <strong id="dli_01_0515__b16330435104710">Buy</strong>. Confirm the configuration and click <strong id="dli_01_0515__b185262264818">Pay</strong>.</li><li id="dli_01_0515__li1961716168262">Go to the <strong id="dli_01_0515__b4518165025016">Resource Pool</strong> page to view the creation status. If the status is <strong id="dli_01_0515__b1179818313529">Available</strong>, the elastic resource pool is ready for use.</li></ol>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0515__section117761251115"><a name="dli_01_0515__section117761251115"></a><a name="section117761251115"></a><h4 class="sectiontitle">Step 2: Add a Queue to the Elastic Resource Pool</h4><ol id="dli_01_0515__ol16830854201114"><li id="dli_01_0515__li183095419119">In the <strong id="dli_01_0515__b138852185531">Operation</strong> column of the created elastic resource pool, click <strong id="dli_01_0515__b11412132318535">Add Queue</strong>.</li><li id="dli_01_0515__li5830125471112">Specify the basic information about the queue. The configuration parameters are as follows:<ul id="dli_01_0515__ul93971623123012"><li id="dli_01_0515__li14397192315302"><strong id="dli_01_0515__b4184152817545">Name</strong>: Queue name</li><li id="dli_01_0515__li3625140133011"><strong id="dli_01_0515__b169021476544">Type</strong>: Queue type In this example, select <strong id="dli_01_0515__b185822018557">For general purpose</strong>.<p id="dli_01_0515__p888382123114"><strong id="dli_01_0515__b438116810566">For SQL</strong>: The queue is used to run Spark SQL jobs.</p>
|
||||||
|
<p id="dli_01_0515__p1370418113211"><strong id="dli_01_0515__b1790011055618">For general purpose</strong>: The queue is used to run Flink and Spark Jar jobs.</p>
|
||||||
|
</li><li id="dli_01_0515__li13175512163311">Set other parameters as required.</li></ul>
|
||||||
|
</li><li id="dli_01_0515__li1083010548115">Click <strong id="dli_01_0515__b1195691745817">Next</strong>. On the displayed page, set <strong id="dli_01_0515__b19736623155813">Min CU</strong> to <strong id="dli_01_0515__b2584325175812">64</strong> and <strong id="dli_01_0515__b784512274583">Max CU</strong> to <strong id="dli_01_0515__b126931929195812">64</strong>.</li><li id="dli_01_0515__li98302542118">Click <strong id="dli_01_0515__b115543195918">OK</strong>. The queue is added.</li></ol>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0515__section645683212597"><h4 class="sectiontitle">(Optional) Step 3: Create an Enhanced Datasource Connection</h4><p id="dli_01_0515__p254610301600">In this example, a datasource connection is required to connect to RDS. You need to create a datasource connection. If your job does not need to connect to an external data source, skip this step.</p>
|
||||||
|
<ol id="dli_01_0515__ol101976313017"><li id="dli_01_0515__li151970319013">Log in to the RDS console and create an RDS DB instance. For details, see . Log in to the RDS instance, create a database and name it <strong id="dli_01_0515__b684715512110">test2</strong>.</li><li id="dli_01_0515__li1197938019">Locate the row that contains the <strong id="dli_01_0515__b1241920327144">test2</strong> database, click <strong id="dli_01_0515__b1658845112167">Query SQL Statements</strong> in the <strong id="dli_01_0515__b3419754131615">Operation</strong> column. On the displayed page, enter the following statement to create table <strong id="dli_01_0515__b179956462">tabletest2</strong>. Click <strong id="dli_01_0515__b10349174381719">Execute SQL</strong>. The table creation statement is as follows:<pre class="screen" id="dli_01_0515__screen1777162834820">CREATE TABLE `tabletest2` (
|
||||||
|
`id` int(11) unsigned,
|
||||||
|
`name` VARCHAR(32)
|
||||||
|
) ENGINE = InnoDB DEFAULT CHARACTER SET = utf8mb4;</pre>
|
||||||
|
</li><li id="dli_01_0515__li71971337017">On the RDS console, choose <strong id="dli_01_0515__b118163711814">Instances</strong> form the navigation pane. Click the name of a created RDS DB instance to view its basic information.</li><li id="dli_01_0515__li19197133109"><a name="dli_01_0515__li19197133109"></a><a name="li19197133109"></a>In the <strong id="dli_01_0515__b25491517142013">Connection Information</strong> pane, obtain the floating IP address, database port, VPC, and subnet.</li><li id="dli_01_0515__li557658113910">Click the security group name. In the <strong id="dli_01_0515__b77636242112">Inbound Rules</strong> tab, add a rule to allow access from the CIDR block of the elastic resource pool. For example, if the CIDR block of the elastic resource pool is <strong id="dli_01_0515__b6824178103511">172.16.0.0/18</strong> and the database port is <strong id="dli_01_0515__b14824985352">3306</strong>, set the rule <strong id="dli_01_0515__b178247893512">Priority</strong> to <strong id="dli_01_0515__b188251081350">1</strong>, <strong id="dli_01_0515__b38254813352">Action</strong> to <strong id="dli_01_0515__b08251286353">Allow</strong>, <strong id="dli_01_0515__b782517811352">Protocol</strong> to <strong id="dli_01_0515__b082518893515">TCP</strong> and <strong id="dli_01_0515__b482517853516">Port </strong>to <strong id="dli_01_0515__b1982618818356">3306</strong>, Type to <strong id="dli_01_0515__b188263818359">IPv4</strong>, and <strong id="dli_01_0515__b28267853514">Source</strong> to <strong id="dli_01_0515__b5826168173517">172.16.0.0/18</strong>.<p id="dli_01_0515__p27761354104212">Click <strong id="dli_01_0515__b25692112415">OK</strong>. The security group rule is added.</p>
|
||||||
|
</li><li id="dli_01_0515__li11976319011">Log in to the DLI management console. In the navigation pane on the left, choose <strong id="dli_01_0515__b14396163132512">Datasource Connections</strong>. On the displayed page, click <strong id="dli_01_0515__b11344133192517">Create</strong> in the <strong id="dli_01_0515__b15521213258">Enhanced</strong> tab.</li><li id="dli_01_0515__li19197531803">In the displayed dialog box, set the following parameters:<ul id="dli_01_0515__ul1032935016521"><li id="dli_01_0515__li1332914503526"><strong id="dli_01_0515__b039811535266">Connection Name</strong>: Name of the enhanced datasource connection</li><li id="dli_01_0515__li432905017524"><strong id="dli_01_0515__b229414227271">Resource Pool</strong>: Select the elastic resource pool created in <a href="#dli_01_0515__section20375737115219">Step 1: Create an Elastic Resource Pool</a>.<div class="note" id="dli_01_0515__note13297503525"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0515__p12329125010524">If you cannot decide the elastic resource pool in this step, you can skip this parameter, go to the <strong id="dli_01_0515__b1123863219280">Enhanced</strong> tab, and click <strong id="dli_01_0515__b112479355280">More</strong> > <strong id="dli_01_0515__b1068955132817">Bind Resource Pool</strong> in the <strong id="dli_01_0515__b6223165452818">Operation</strong> column of the row that contains this datasource connection after it is created.</p>
|
||||||
|
</div></div>
|
||||||
|
</li><li id="dli_01_0515__li1932945012529"><strong id="dli_01_0515__b8860928183019">VPC</strong>: Select the VPC of the RDS DB instance obtained in <a href="#dli_01_0515__li19197133109">4</a>.</li><li id="dli_01_0515__li5329750115213"><strong id="dli_01_0515__b25381117183112">Subnet</strong>: Select the subnet of the RDS DB instance obtained in <a href="#dli_01_0515__li19197133109">4</a>. </li><li id="dli_01_0515__li16590071163">Set other parameters as you need.</li></ul>
|
||||||
|
<p id="dli_01_0515__p3174856105519">Click <strong id="dli_01_0515__b655217163219">OK</strong>. Click the name of the created datasource connection to view its status. You can perform subsequent steps only after the connection status changes to <strong id="dli_01_0515__b6878058103217">Active</strong>.</p>
|
||||||
|
</li><li id="dli_01_0515__li18197531400">Click <strong id="dli_01_0515__b67248137341">Resources</strong> > <strong id="dli_01_0515__b83941616113413">Queue Management</strong>, select the target queue, for example, <strong id="dli_01_0515__b138721729173412">general_test</strong>. In the <strong id="dli_01_0515__b8919332103411">Operation</strong> column, click <strong id="dli_01_0515__b432023517349">More</strong> and select <strong id="dli_01_0515__b54365583416">Test Address Connectivity</strong>.</li><li id="dli_01_0515__li171971831506">In the displayed dialog box, enter <em id="dli_01_0515__i823835011356">Floating IP address</em><strong id="dli_01_0515__b7803952173517">:</strong><em id="dli_01_0515__i816114463355">Database port</em> of the RDS database in the <strong id="dli_01_0515__b10282917143617">Address</strong> box and click <strong id="dli_01_0515__b96671930203616">Test</strong> to check whether the database is reachable.</li></ol>
|
||||||
|
</div>
|
||||||
|
<div class="section" id="dli_01_0515__section188525619486"><h4 class="sectiontitle">Step 4: Run a Job</h4><p id="dli_01_0515__p187312040205017">Run a Flink SQL jab on a queue in an elastic resource pool.</p>
|
||||||
|
<ol id="dli_01_0515__ol1119613122511"><li id="dli_01_0515__li219661215114">On the DLI management console, choose <strong id="dli_01_0515__b12388517151813">Job Management</strong> > <strong id="dli_01_0515__b8557171911186">Flink Jobs</strong>. On the <strong id="dli_01_0515__b12166926161813">Flink Jobs</strong> page, click <strong id="dli_01_0515__b462293221815">Create Job</strong>.</li><li id="dli_01_0515__li18197181225114">In the <strong id="dli_01_0515__b11709161711913">Create Job</strong> dialog box, set <strong id="dli_01_0515__b8588193661920">Type</strong> to <strong id="dli_01_0515__b9957114216199">Flink SQL</strong> and <strong id="dli_01_0515__b99842457199">Name</strong> to <strong id="dli_01_0515__b11688175591913">testFlinkSqlJob</strong>. Click <strong id="dli_01_0515__b15118103152011">OK</strong>.</li><li id="dli_01_0515__li119731295112">On the job editing page, set the following parameters:<ul id="dli_01_0515__ul1970291612112"><li id="dli_01_0515__li6702216152118"><strong id="dli_01_0515__b91315380235">Queue</strong>: Select the <strong id="dli_01_0515__b15121729183718">general_test</strong> queue added to the elastic resource pool in <a href="#dli_01_0515__section117761251115">Step 2: Add a Queue to the Elastic Resource Pool</a>.</li><li id="dli_01_0515__li84401118192110"><strong id="dli_01_0515__b14362921151218">Save Job Log</strong>: Enable this function.</li><li id="dli_01_0515__li12684193718212"><strong id="dli_01_0515__b7548154743813">OBS Bucket</strong>: Select an OBS bucket for storing job logs and grant access permissions of the OBS bucket as prompted.</li><li id="dli_01_0515__li1382275713215"><strong id="dli_01_0515__b2618023144120">Enable Checkpointing</strong>: Enable.</li><li id="dli_01_0515__li1479717252318">Enter the SQL statement in the editing pane. The following is an example. Modify the parameters in bold as you need.<pre class="screen" id="dli_01_0515__screen19498132492920">CREATE SINK STREAM car_info (id INT, name STRING) WITH (
|
||||||
|
type = "rds",
|
||||||
|
<strong id="dli_01_0515__b349815243292"> region = ""</strong>, /* Change the value to the current region ID. */
|
||||||
|
'pwd_auth_name'="xxxxx", // Name of the datasource authentication of the password type created on DLI. If datasource authentication is used, you do not need to set the username and password for the job.
|
||||||
|
<strong id="dli_01_0515__b1349882413291">db_url = "mysql://<em id="dli_01_0515__i549862482919">192.168.x.x:3306</em>/<em id="dli_01_0515__i1436220158539">test2</em>"</strong>, /* The format is mysql://<em id="dli_01_0515__i835816353465">floating IP address:port number of the RDS database</em>/<em id="dli_01_0515__i1431193834619">database name</em>. */
|
||||||
|
<strong id="dli_01_0515__b164985240298">table_name = "<em id="dli_01_0515__i12549151795319">tabletest2</em>"</strong> /* Table name in RDS database */
|
||||||
|
);
|
||||||
|
INSERT INTO
|
||||||
|
car_info
|
||||||
|
SELECT
|
||||||
|
13,
|
||||||
|
'abc';</pre>
|
||||||
|
</li></ul>
|
||||||
|
</li><li id="dli_01_0515__li219761217517">Click <strong id="dli_01_0515__b26731781126">Check Semantic</strong> and ensure that the SQL statement passes the check. Click <strong id="dli_01_0515__b84235270611518">Save</strong>. Click <strong id="dli_01_0515__b465311851320">Start</strong>, confirm the job parameters, and click <strong id="dli_01_0515__b13252183971319">Start Now</strong> to execute the job.</li><li id="dli_01_0515__li51972012145112">Wait until the job is complete. The job status changes to <strong id="dli_01_0515__b1733324618131">Completed</strong>.</li><li id="dli_01_0515__li17197512105118">Log in to the RDS console, click the name of the RDS DB instance. On the displayed page, click the name of the created database, for example, <strong id="dli_01_0515__b236719280141">test2</strong>, and click <strong id="dli_01_0515__b5607184731413">Query SQL Statements</strong> in the <strong id="dli_01_0515__b107121249141415">Operation</strong> column of the row that containing the <strong id="dli_01_0515__b126641411516">tabletest2</strong> table.</li><li id="dli_01_0515__li161972012115114">On the displayed page, click <strong id="dli_01_0515__b882319337256">Execute SQL</strong>. Check whether data has been written into the RDS table.</li></ol>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
<div>
|
||||||
|
<div class="familylinks">
|
||||||
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0528.html">Before You Start</a></div>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
|
Some files were not shown because too many files have changed in this diff Show More
Loading…
x
Reference in New Issue
Block a user