vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity

dli_umn_1012_version

Browse Source 
Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
This commit is contained in:
Su, Xiaomeng 2023-11-06 15:42:17 +00:00 committed by zuul
parent 622c4aee1b
commit 0940d74189
265 changed files with 6194 additions and 3007 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4114
docs/dli/umn/ALL_META.TXT.json
View File

File diff suppressed because it is too large Load Diff

1402
docs/dli/umn/CLASS.TXT.json
View File

File diff suppressed because it is too large Load Diff

20
docs/dli/umn/dli_01_00006.html
View File

@ -8,7 +8,25 @@
</th>
</tr>
</thead>
<tbody><tr id="dli_01_00006__row33702917592"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p1528713120599">2023-05-11</p>
<tbody><tr id="dli_01_00006__row1569106191216"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p36566919122">2023-10-08</p>
</td>
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p465618951211">Modified the following content:</p>
<ul id="dli_01_00006__ul82951936181419"><li id="dli_01_00006__li129511362149">Modified the example format in <a href="dli_01_0384.html#dli_01_0384__table17326112613420">Table 2</a>.</li><li id="dli_01_00006__li3295163691419">Added constraints and limitations on tag keys and tag values to <a href="dli_01_0455.html">Creating a Flink SQL Job</a> and <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</li></ul>
</td>
</tr>
<tr id="dli_01_00006__row12145240104716"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p193441641970">2023-09-07</p>
</td>
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p63854280713">Added the following sections:</p>
<ul id="dli_01_00006__ul895111424710"><li id="dli_01_00006__li5328124733814"><a href="dli_01_0552.html">Managing Tags</a></li><li id="dli_01_00006__li11801555203817"><a href="dli_01_0384.html#dli_01_0384__table17326112613420">Table 2</a></li><li id="dli_01_00006__li109276713912"><a href="dli_01_0534.html">Enabling Dynamic Scaling for Flink Jobs</a></li><li id="dli_01_00006__li1356101513915"><a href="dli_01_0535.html">Setting the Priority for a Job</a></li></ul>
<p id="dli_01_00006__p523145072419">Deleted the following section:</p>
<ul id="dli_01_00006__ul204315504240"><li id="dli_01_00006__li64316503244">Deleted the content related to Flink job debugging.</li></ul>
<p id="dli_01_00006__p19615231153914">Modified the following section:</p>
<ul id="dli_01_00006__ul561713318395"><li id="dli_01_00006__li10617203123911"><a href="dli_01_0461.html">Performing Operations on a Flink Job</a>: Modified the description of the <strong id="dli_01_00006__b85796421240">Auto Restart upon Exception</strong> parameter in the runtime configuration. Flink SQL jobs and Flink OpenSource SQL jobs cannot be restored from checkpoints.</li></ul>
<div class="p" id="dli_01_00006__p10632114012391">Optimized the following sections:<ul id="dli_01_00006__ul1350219391399"><li id="dli_01_00006__li18502193953911"><a href="dli_01_0426.html">Enhanced Datasource Connections</a></li><li id="dli_01_00006__li12502839173915"><a href="dli_01_0422.html">Datasource Authentication</a></li></ul>
</div>
</td>
</tr>
<tr id="dli_01_00006__row33702917592"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p1528713120599">2023-05-11</p>
</td>
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p16287151205919">Modified the following content:</p>
<ul id="dli_01_00006__ul209491872110"><li id="dli_01_00006__li99491719111">Added the dependency package information of Spark 2.4.5 and Flink 1.12 to <a href="dli_01_0397.html">Built-in Dependencies</a>.</li><li id="dli_01_00006__li119492716114">Modified the description of log buckets in <a href="dli_01_0320.html">SQL Editor</a>.</li></ul>

4
docs/dli/umn/dli_01_0001.html
View File

@ -4,12 +4,16 @@
<div id="body1532683323732"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0567.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0017.html">SQL Job Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0389.html">Flink Job Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0465.html">Spark Job Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0535.html">Setting the Priority for a Job</a></strong><br>
</li>
</ul>
</div>

16
docs/dli/umn/dli_01_0002.html
View File

@ -1,7 +1,7 @@
<a name="dli_01_0002"></a><a name="dli_01_0002"></a>
<h1 class="topictitle1">Creating and Submitting a Spark SQL Job</h1>
<div id="body1501038213757"><div class="section" id="dli_01_0002__section76281123162520"><h4 class="sectiontitle">Scenarios</h4><p id="dli_01_0002__p11420171102612">DLI can query data stored in OBS. This section describes how to us a Spark SQL job on DLI to query OBS data.</p>
<div id="body1501038213757"><div class="section" id="dli_01_0002__section76281123162520"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0002__p11420171102612">DLI can query data stored in OBS. This section describes how to us a Spark SQL job on DLI to query OBS data.</p>
</div>
<div class="section" id="dli_01_0002__section136122917251"><h4 class="sectiontitle">Procedure</h4><p id="dli_01_0002__p8060118">You can use DLI to submit a Spark SQL job to query data. The general procedure is as follows:</p>
<p id="dli_01_0002__p1391181313415"><a href="#dli_01_0002__section61379418181550">Step 1: Upload Data to OBS</a></p>
@ -11,10 +11,10 @@
<p id="dli_01_0002__p9606134314412"><a href="#dli_01_0002__section37788816112733">Step 5: Query Data</a></p>
</div>
<div class="section" id="dli_01_0002__section61379418181550"><a name="dli_01_0002__section61379418181550"></a><a name="section61379418181550"></a><h4 class="sectiontitle">Step 1: Upload Data to OBS</h4><p id="dli_01_0002__p161899822612">Before you use DLI to query and analyze data, upload data files to OBS.</p>
<ol id="dli_01_0002__ol19047014145745"><li id="dli_01_0002__li17461001806">Go to the DLI console.</li><li id="dli_01_0002__li18770142812720">In the service list, click <strong id="dli_01_0002__b1075523782712">Object Storage Service</strong> under <strong id="dli_01_0002__b11498104092711">Storage</strong>. The OBS console page is displayed.</li><li id="dli_01_0002__li1385211252717">Create a bucket. In this example, the bucket name is <strong id="dli_01_0002__b2533143112814">obs1</strong>.<ol type="a" id="dli_01_0002__ol182612310711"><li id="dli_01_0002__li462934116719">Click <span class="uicontrol" id="dli_01_0002__uicontrol481933104114"><b>Create Bucket</b></span> in the upper right corner.</li><li id="dli_01_0002__li183491949872">On the displayed <strong id="dli_01_0002__b997218337576">Create Bucket</strong> page, enter the <strong id="dli_01_0002__b41931653205710">Bucket Name</strong>. Retain the default values for other parameters or set them as required.<div class="note" id="dli_01_0002__note1145175833410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p7146205812341">You must select the same region as the DLI management console.</p>
<ol id="dli_01_0002__ol19047014145745"><li id="dli_01_0002__li17461001806">Go to the DLI console.</li><li id="dli_01_0002__li18770142812720">In the service list, click <strong id="dli_01_0002__b1075523782712">Object Storage Service</strong> under <strong id="dli_01_0002__b11498104092711">Storage</strong>. The OBS console page is displayed.</li><li id="dli_01_0002__li1385211252717">Create a bucket. In this example, the bucket name is <strong id="dli_01_0002__b2533143112814">obs1</strong>.<ol type="a" id="dli_01_0002__ol182612310711"><li id="dli_01_0002__li462934116719">Click <span class="uicontrol" id="dli_01_0002__uicontrol481933104114"><b>Create Bucket</b></span> in the upper right corner.</li><li id="dli_01_0002__li183491949872">On the displayed <strong id="dli_01_0002__b997218337576">Create Bucket</strong> page, enter the <strong id="dli_01_0002__b41931653205710">Bucket Name</strong>. Retain the default values for other parameters or adjust them as needed.<div class="note" id="dli_01_0002__note1145175833410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p7146205812341">You must select the same region as the DLI management console.</p>
</div></div>
</li><li id="dli_01_0002__li3583138155449">Click <strong id="dli_01_0002__b55859547573">Create Now</strong>.</li></ol>
</li><li id="dli_01_0002__li17845354105919">Click <strong id="dli_01_0002__b1314010449132">obs1</strong> to switch to the <strong id="dli_01_0002__b22171556131317">Overview</strong> page.</li><li id="dli_01_0002__li9783175118519">In the left navigation pane, click <strong id="dli_01_0002__b1083044015274">Objects</strong>. Click <strong id="dli_01_0002__b1830164072711">Upload Object</strong>. In the displayed dialog box, drag files or folders to upload or add file, for example, <span class="parmname" id="dli_01_0002__parmname11831040102710"><b>sampledata.csv</b></span> to the file upload box. Then, click <span class="uicontrol" id="dli_01_0002__uicontrol13831134072715"><b>Upload</b></span>.<div class="p" id="dli_01_0002__p1366220522517">You can create a <strong id="dli_01_0002__b19103192713017">sampledata.txt</strong> file, copy the following content separated by commas (,), and save the file as <strong id="dli_01_0002__b1597217291805">sampledata.csv</strong>.<pre class="screen" id="dli_01_0002__screen14345174815219">12,test</pre>
</li><li id="dli_01_0002__li17845354105919">Click <strong id="dli_01_0002__b1314010449132">obs1</strong> to access its <strong id="dli_01_0002__b22171556131317">Objects</strong> tab page.</li><li id="dli_01_0002__li9783175118519">Click <strong id="dli_01_0002__b1830164072711">Upload Object</strong>. In the displayed dialog box, drag a desired file or folder, for example, <span class="parmname" id="dli_01_0002__parmname11831040102710"><b>sampledata.csv</b></span> to the <strong id="dli_01_0002__b191881648105918">Upload Object</strong> area. Then, click <span class="uicontrol" id="dli_01_0002__uicontrol13831134072715"><b>Upload</b></span>.<div class="p" id="dli_01_0002__p1366220522517">You can create a <strong id="dli_01_0002__b19103192713017">sampledata.txt</strong> file, copy the following content separated by commas (,), and save the file as <strong id="dli_01_0002__b1597217291805">sampledata.csv</strong>.<pre class="screen" id="dli_01_0002__screen14345174815219">12,test</pre>
</div>
<p id="dli_01_0002__p1540915717295">After the file is uploaded successfully, the file path is <span class="filepath" id="dli_01_0002__filepath82411311208"><b>obs://obs1/sampledata.csv</b></span>.</p>
<div class="note" id="dli_01_0002__note11115319367"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0002__ul1234018993918"><li id="dli_01_0002__li71801921936">For more information about OBS operations, see the <em id="dli_01_0002__i15721531173210">Object Storage Service Console Operation Guide</em>.</li><li id="dli_01_0002__li21801214311">For more information about the tool, see the <em id="dli_01_0002__i142921634153219">OBS Tool Guide</em>.</li><li id="dli_01_0002__li1418042110310">You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.<ul id="dli_01_0002__ul569116231937"><li id="dli_01_0002__li17525130154011">OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS.</li></ul>
@ -23,7 +23,7 @@
</li></ol>
</div>
<div class="section" id="dli_01_0002__section10742144985011"><a name="dli_01_0002__section10742144985011"></a><a name="section10742144985011"></a><h4 class="sectiontitle">Step 2: Create a Queue</h4><p id="dli_01_0002__p313914434915">A queue is the basis for using DLI. Before executing an SQL job, you need to create a queue.</p>
<ul id="dli_01_0002__ul17202247195010"><li id="dli_01_0002__li131931114812">An available queue <span class="parmvalue" id="dli_01_0002__parmvalue1369741014488"><b>default</b></span> is preset in DLI.</li><li id="dli_01_0002__li1131916110481">You can also create queues as needed.<ol id="dli_01_0002__ol15578144671515"><li id="dli_01_0002__li13332820164119">Log in to the DLI management console.</li><li id="dli_01_0002__li2578546131517">On the DLI management console, click <strong id="dli_01_0002__b16611756192915">SQL Editor</strong> in the navigation pane on the left. The <strong id="dli_01_0002__b1120919212301">SQL Editor</strong> page is displayed.</li><li id="dli_01_0002__li844914584169">On the left pane, select the <strong id="dli_01_0002__b8902351334">Queues</strong> tab, and click <span><img id="dli_01_0002__image17450135891614" src="en-us_image_0276441461.png"></span> next to <strong id="dli_01_0002__b1478271612">Queues</strong>.<p id="dli_01_0002__p17288510177">For details, see Creating a Queue.</p>
<ul id="dli_01_0002__ul17202247195010"><li id="dli_01_0002__li131931114812">An available queue <span class="parmvalue" id="dli_01_0002__parmvalue1369741014488"><b>default</b></span> is preset in DLI.</li><li id="dli_01_0002__li1131916110481">You can also create queues as needed.<ol id="dli_01_0002__ol15578144671515"><li id="dli_01_0002__li13332820164119">Log in to the DLI management console.</li><li id="dli_01_0002__li2578546131517">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b16611756192915">SQL Editor</strong>.</li><li id="dli_01_0002__li844914584169">On the left pane, select the <strong id="dli_01_0002__b8902351334">Queues</strong> tab, and click <span><img id="dli_01_0002__image17450135891614" src="en-us_image_0276441461.png"></span> next to <strong id="dli_01_0002__b1478271612">Queues</strong>.<p id="dli_01_0002__p17288510177">For details, see Creating a Queue.</p>
<p id="dli_01_0002__p8128252161516"></p>
</li></ol>
</li></ul>
@ -31,20 +31,20 @@
<div class="section" id="dli_01_0002__section21433273112656"><a name="dli_01_0002__section21433273112656"></a><a name="section21433273112656"></a><h4 class="sectiontitle">Step 3: Create a Database</h4><p id="dli_01_0002__p498774501214">Before querying data, create a database, for example, <strong id="dli_01_0002__b84235270619941">db1</strong>.</p>
<div class="note" id="dli_01_0002__note23711139194010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p143724399404">The <strong id="dli_01_0002__b842352706172053">default</strong> database is a built-in database. You cannot create the <strong id="dli_01_0002__b842352706172112">default</strong>. database.</p>
</div></div>
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">On the DLI management console, click <strong id="dli_01_0002__b1635163117400">SQL Editor</strong> in the navigation pane on the left. The <strong id="dli_01_0002__b12483735174016">SQL Editor</strong> page is displayed.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
<p id="dli_01_0002__p38732969153456">After database <strong id="dli_01_0002__b842352706161813">db1</strong> is successfully created, <strong id="dli_01_0002__b842352706161823">db1</strong> will be displayed in the <strong id="dli_01_0002__b842352706161834">Database</strong> list.</p>
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b124165381758">SQL Editor</strong>.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
<p id="dli_01_0002__p38732969153456">After the database is successfully created, click <span><img id="dli_01_0002__image147095116392" src="en-us_image_0000001597283981.png"></span> in the middle pane to refresh the database list. The new database <strong id="dli_01_0002__b58200197711">db1</strong> is displayed in the list.</p>
<div class="note" id="dli_01_0002__note108505219593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p1862192165910">When you execute a query on the DLI management console for the first time, you need to read the privacy agreement. You can perform operations only after you agree to the agreement. For later queries, you will not need to read the privacy agreement again.</p>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0002__section21590507141153"><a name="dli_01_0002__section21590507141153"></a><a name="section21590507141153"></a><h4 class="sectiontitle">Step 4: Create a Table</h4><p id="dli_01_0002__p35220739144319">After database <strong id="dli_01_0002__b1827512525545">db1</strong> is created, create a table (for example, <strong id="dli_01_0002__b8275145215544">table1</strong>) containing data in the sample file <span class="filepath" id="dli_01_0002__filepath427515215419"><b>obs://obs1/sampledata.csv</b></span> stored on OBS in <strong id="dli_01_0002__b4277135245414">db1</strong>.</p>
<ol id="dli_01_0002__ol39318463153849"><li id="dli_01_0002__li23198164153933">In the SQL editing window of the<span class="wintitle" id="dli_01_0002__wintitle1132135205811"><b> SQL Editor</b></span> page, select the <strong id="dli_01_0002__b9133145155814">default</strong> queue and database <strong id="dli_01_0002__b31330515816">db1</strong>.</li><li id="dli_01_0002__li22227453153849">Enter the following SQL statement in the job editor window and click <strong id="dli_01_0002__b8418103081114">Execute</strong>:<pre class="screen" id="dli_01_0002__screen114301935133717">create table table1 (id int, name string) using csv options (path 'obs://obs1/sampledata.csv');</pre>
<p id="dli_01_0002__p6761159153849">After the table is created, click the <strong id="dli_01_0002__b924464317219">Databases</strong> tab and then select <strong id="dli_01_0002__b16240727145816">db1</strong>. The created table <strong id="dli_01_0002__b122531636185811">table1</strong> is displayed in the <span class="parmname" id="dli_01_0002__parmname1926113527581"><b>Table</b></span> area.</p>
<p id="dli_01_0002__p6761159153849">After the table is successfully created, click the <strong id="dli_01_0002__b924464317219">Databases</strong> tab then <strong id="dli_01_0002__b16240727145816">db1</strong>. The created table <strong id="dli_01_0002__b122531636185811">table1</strong> is displayed in the table list.</p>
</li></ol>
</div>
<div class="section" id="dli_01_0002__section37788816112733"><a name="dli_01_0002__section37788816112733"></a><a name="section37788816112733"></a><h4 class="sectiontitle">Step 5: Query Data</h4><p id="dli_01_0002__p489584411557">After performing the preceding steps, you can start querying data.</p>
<ol id="dli_01_0002__ol6245542914546"><li id="dli_01_0002__li146528414546">In the <span class="parmname" id="dli_01_0002__parmname1356301610013"><b>Table</b></span> tab on the <span class="wintitle" id="dli_01_0002__wintitle556341610020"><b>SQL Editor</b></span> page, double-click the created table <strong id="dli_01_0002__b856419161100">table1</strong>. The SQL statement is automatically displayed in the SQL job editing window in the right pane. Run following statement to query 1,000 records in the <strong id="dli_01_0002__b1456411165017">table1</strong> table:<pre class="screen" id="dli_01_0002__screen18201181093815">select * from db1.table1 limit 1000;</pre>
</li><li id="dli_01_0002__li19582472145233">Click <strong id="dli_01_0002__b126126091410">Execute</strong>. The system starts the query.<p id="dli_01_0002__p2694027411345">After the SQL statement is executed successfully, you can view the query result in <strong id="dli_01_0002__b294691411285">View Result</strong> under the SQL job editing window.</p>
</li><li id="dli_01_0002__li19582472145233">Click <strong id="dli_01_0002__b126126091410">Execute</strong>. The system starts the query.<p id="dli_01_0002__p2694027411345">After the SQL statement is successfully executed or fails to be executed, you can view the query result on the <strong id="dli_01_0002__b294691411285">View Result</strong> tab under the SQL job editing window.</p>
</li></ol>
</div>
</div>

58
docs/dli/umn/dli_01_0003.html
View File

@ -1,54 +1,18 @@
<a name="dli_01_0003"></a><a name="dli_01_0003"></a>
<h1 class="topictitle1">Overview</h1>
<div id="body0000001105195630"><p id="dli_01_0003__p1192818410140">The enhanced datasource connection uses VPC peering at the bottom layer to directly connect the VPC network between the DLI cluster and the destination datasource. Data is exchanged in point-to-point mode. The enhanced datasource connection function supports all cross-source services implemented by DLI, including CloudTable HBase, CloudTableOpenTSDB, MRS OpenTSDB, DWS, RDS, CSS, DCS, and DDS. In addition, UDFs, Spark jobs, and Flink jobs can be used to access self-built data sources.</p>
<div class="note" id="dli_01_0003__note12603103574920"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0003__ul5455165810144"><li id="dli_01_0003__li698500101511">The CIDR block of the DLI queue bound with a datasource connection cannot overlap with that of the data source.</li><li id="dli_01_0003__li6187125017427">Datasource connections cannot be created for the default queue.</li><li id="dli_01_0003__li483541514213">To access a datasource connection table, you need to use the queue for which a datasource connection has been created.</li><li id="dli_01_0003__li174571010446">The preview function is not supported for datasource tables.</li></ul>
</div></div>
<p id="dli_01_0003__p15424938144017">The enhanced datasource scenario provides the following functions:</p>
<ul id="dli_01_0003__ul124856554111"><li id="dli_01_0003__li34861158416"><a href="dli_01_0006.html">Creating, Querying, and Deleting an Enhanced Datasource Connection</a></li><li id="dli_01_0003__li3299111519412"><a href="dli_01_0009.html">Binding and Unbinding a Queue</a></li><li id="dli_01_0003__li15471102418415"><a href="dli_01_0013.html#dli_01_0013__section636281512389">Modifying Host Information</a></li><li id="dli_01_0003__li020412619615"><a href="dli_01_0014.html">Custom Route Information</a></li><li id="dli_01_0003__li416418421417"><a href="dli_01_0018.html">Enhanced Datasource Connection Permission Management</a></li></ul>
<div class="section" id="dli_01_0003__section1616314111518"><h4 class="sectiontitle">Enhanced Datasource Connection Page</h4><p id="dli_01_0003__p66482014175614">This page displays all enhanced datasource connections. If there are a large number of connections, they are displayed on multiple pages.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0003__table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Datasource connection list parameters</caption><thead align="left"><tr id="dli_01_0003__row2555468715120"><th align="left" class="cellrowborder" valign="top" width="13.469999999999999%" id="mcps1.3.6.3.2.3.1.1"><p id="dli_01_0003__p4021197415120">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="86.53%" id="mcps1.3.6.3.2.3.1.2"><p id="dli_01_0003__p3594448915120">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0003__row46758327132"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p16413434141957">Connection Name</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p54419740141957">Name of the created datasource connection.</p>
</td>
</tr>
<tr id="dli_01_0003__row32873162171713"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p45480448171713">Connection Status</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p59114099151038">Status of a datasource connection. Currently, the console displays only connections in the <strong id="dli_01_0003__b118558917341">Active</strong> state.</p>
</td>
</tr>
<tr id="dli_01_0003__row31011923151038"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p10671857151038">VPC</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p13779322112316">VPC used by the destination data source. </p>
</td>
</tr>
<tr id="dli_01_0003__row36301606171658"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p14394959151048">Subnet</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p1483474582618">Subnet used by the destination data source. </p>
</td>
</tr>
<tr id="dli_01_0003__row2449114254419"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p1845010423449">Created</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p114506429448">Time when a connection is created. The connections in the connection list can be displayed according to the creation time in ascending or descending order.</p>
</td>
</tr>
<tr id="dli_01_0003__row1662880815250"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p475621615250">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><ul id="dli_01_0003__ul516210510267"><li id="dli_01_0003__li516213514262"><strong id="dli_01_0003__b206518963613">Delete Connection</strong>: Delete a created enhanced datasource connection.</li><li id="dli_01_0003__li147650321108"><strong id="dli_01_0003__b661741203612">Manage Route</strong>: Used to display the custom route information of the enhanced datasource connection.</li><li id="dli_01_0003__li1811271917219"><strong id="dli_01_0003__b12339223361">More</strong>:<ul id="dli_01_0003__ul7693135513119"><li id="dli_01_0003__li14572121218336"><strong id="dli_01_0003__b1855064611464">Modify Host</strong>: Customize the IP address corresponding to the host or domain name.</li><li id="dli_01_0003__li26931355113113"><strong id="dli_01_0003__b1806131145415">Bind Queue</strong>: Bind a queue to an enhanced datasource connection.</li><li id="dli_01_0003__li196937557317"><strong id="dli_01_0003__b1128519301367">Unbind Queue</strong>: Unbind an enhanced datasource connection from a queue.</li><li id="dli_01_0003__li469320551312"><strong id="dli_01_0003__b1338173517368">Add Route</strong>: Add a custom route for the enhanced datasource connection.</li><li id="dli_01_0003__li20693155513119"><strong id="dli_01_0003__b45131338163614">Delete Route</strong>: Delete a custom route for an enhanced datasource connection.</li><li id="dli_01_0003__li769310555311"><strong id="dli_01_0003__b109311423363">Manage Permissions</strong>: Authorize or reclaim permissions for other projects.</li></ul>
</li></ul>
</td>
</tr>
</tbody>
</table>
<div id="body0000001105195630"><div class="section" id="dli_01_0003__section96073483278"><h4 class="sectiontitle">What Is Enhanced Datasource Connection?</h4><p id="dli_01_0003__p22151355203913">Typically, you cannot use DLI to directly access a data source in a VPC other than the one where DLI is because the network between DLI and the data source is disconnected. For proper access, you need to establish a network connection between them.</p>
<p id="dli_01_0003__p1086631203616">DLI provides enhanced connections. Establishing a VPC peering connection allows DLI to communicate with the VPC of the data source, supporting cross-source data analysis.</p>
<p id="dli_01_0003__p5494121814320">For details about the data sources that support cross-source access, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</p>
</div>
<div class="section" id="dli_01_0003__section12469945134416"><h4 class="sectiontitle">Constraints</h4><ul id="dli_01_0003__ul920917130139"><li id="dli_01_0003__dli_07_0005_li82094136131">Datasource connections cannot be created for the <strong id="dli_01_0003__dli_07_0005_b275994812408">default</strong> queue.</li><li id="dli_01_0003__dli_07_0005_li2599248131320">Flink jobs can directly access DIS, OBS, and SMN data sources without using datasource connections.</li><li id="dli_01_0003__dli_07_0005_li3320184019107"><strong id="dli_01_0003__dli_07_0005_b15858611104116">VPC Administrator</strong> permissions are required for enhanced connections to use VPCs, subnets, routes, VPC peering connections.</li><li id="dli_01_0003__dli_07_0005_li196339467176">If you use an enhanced datasource connection, the CIDR block of the elastic resource pool or queue cannot overlap with that of the data source.</li><li id="dli_01_0003__dli_07_0005_li3209111310134">Only queues bound with datasource connections can access datasource tables.</li><li id="dli_01_0003__dli_07_0005_li1120931310136">Datasource tables do not support the preview function.</li><li id="dli_01_0003__dli_07_0005_li11700174614348">When checking the connectivity of datasource connections, the constraints on IP addresses are as follows:<ul id="dli_01_0003__dli_07_0005_ul1254904218358"><li id="dli_01_0003__dli_07_0005_li15478548367">The IP address must be valid, which consists of four decimal numbers separated by periods (.). The value ranges from 0 to 255.</li><li id="dli_01_0003__dli_07_0005_li151317527373">During the test, you can add a port after the IP address and separate them with colons (:). The port can contain a maximum of five digits. The value ranges from 0 to 65535.<p id="dli_01_0003__dli_07_0005_p26801956133713"><a name="dli_01_0003__dli_07_0005_li151317527373"></a><a name="dli_07_0005_li151317527373"></a>For example, <strong id="dli_01_0003__dli_07_0005_b11869171511417">192.168.</strong><em id="dli_01_0003__dli_07_0005_i1917651964115">xx</em><strong id="dli_01_0003__dli_07_0005_b37501722194120">.</strong><em id="dli_01_0003__dli_07_0005_i151751326134116">xx</em> or <strong id="dli_01_0003__dli_07_0005_b4220103184115">192.168.</strong><em id="dli_01_0003__dli_07_0005_i7940153620413">xx</em><strong id="dli_01_0003__dli_07_0005_b11270124004111">.</strong><em id="dli_01_0003__dli_07_0005_i197261843124114">xx</em><strong id="dli_01_0003__dli_07_0005_b14999194774118">:8181</strong>.</p>
</li></ul>
</li><li id="dli_01_0003__dli_07_0005_li1152733115719">When checking the connectivity of datasource connections, the constraints on domain names are as follows:<ul id="dli_01_0003__dli_07_0005_ul166789287574"><li id="dli_01_0003__dli_07_0005_li46789287572">The domain name can contain 1 to 255 characters. Only letters, digits, underscores (_), and hyphens (-) are allowed.</li><li id="dli_01_0003__dli_07_0005_li667882815577">The top-level domain name must contain at least two letters, for example, <strong id="dli_01_0003__dli_07_0005_b11901337154319">.com</strong>, <strong id="dli_01_0003__dli_07_0005_b1028814124319">.net</strong>, and <strong id="dli_01_0003__dli_07_0005_b19839144614436">.cn</strong>.</li><li id="dli_01_0003__dli_07_0005_li1867852835715">During the test, you can add a port after the domain name and separate them with colons (:). The port can contain a maximum of five digits. The value ranges from 0 to 65535.<p id="dli_01_0003__dli_07_0005_p1667882814575"><a name="dli_01_0003__dli_07_0005_li1867852835715"></a><a name="dli_07_0005_li1867852835715"></a>For example, <strong id="dli_01_0003__dli_07_0005_b177998236451">example.com:8080</strong>.</p>
</li></ul>
</li></ul>
</div>
<div class="section" id="dli_01_0003__section12566111415470"><h4 class="sectiontitle">Cross-Source Analysis Process</h4><p id="dli_01_0003__p239162984817">To use DLI for cross-source analysis, you need to create a datasource connection to connect DLI to the data source, and then develop jobs to access the data source.</p>
<div class="fignone" id="dli_01_0003__fig1175617348416"><span class="figcap"><b>Figure 1 </b>Cross-source analysis flowchart</span><br><span><img id="dli_01_0003__image20990341165118" src="en-us_image_0000001570712116.png"></span></div>
</div>
</div>
<div>

41
docs/dli/umn/dli_01_0005.html
View File

@ -14,28 +14,35 @@
</li><li id="dli_01_0005__li10384371151118">To create a database on the <span class="wintitle" id="dli_01_0005__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0005__ol39382464151459"><li id="dli_01_0005__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0005__uicontrol1481531519315"><b>SQL Editor</b></span>.</li><li id="dli_01_0005__li1773513617043">In the navigation pane on the left, click <span><img id="dli_01_0005__image654613242326" src="en-us_image_0237539077.png"></span> beside <strong id="dli_01_0005__b8303205915164">Databases</strong>.</li></ol>
</li></ul>
</p></li><li id="dli_01_0005__li66896638102224"><span>In the displayed <span class="wintitle" id="dli_01_0005__wintitle129565131811"><b>Create Database</b></span> dialog box, specify <strong id="dli_01_0005__b1230118521815">Name</strong> and <strong id="dli_01_0005__b130145161811">Description</strong> by referring to <a href="#dli_01_0005__table055917491187">Table 1</a>.</span><p>
<div class="tablenoborder"><a name="dli_01_0005__table055917491187"></a><a name="table055917491187"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0005__table055917491187" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Description</caption><thead align="left"><tr id="dli_01_0005__row12558124921818"><th align="left" class="cellrowborder" valign="top" width="13%" id="mcps1.3.3.2.2.2.1.2.4.1.1"><p id="dli_01_0005__p12558144931813">Parameter</p>
<div class="tablenoborder"><a name="dli_01_0005__table055917491187"></a><a name="table055917491187"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0005__table055917491187" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Description</caption><thead align="left"><tr id="dli_01_0005__row12558124921818"><th align="left" class="cellrowborder" valign="top" width="15.290000000000001%" id="mcps1.3.3.2.2.2.1.2.3.1.1"><p id="dli_01_0005__p12558144931813">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="72%" id="mcps1.3.3.2.2.2.1.2.4.1.2"><p id="dli_01_0005__p055814991814">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="15%" id="mcps1.3.3.2.2.2.1.2.4.1.3"><p id="dli_01_0005__p11558144941813">Example</p>
<th align="left" class="cellrowborder" valign="top" width="84.71%" id="mcps1.3.3.2.2.2.1.2.3.1.2"><p id="dli_01_0005__p055814991814">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0005__row55596491188"><td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.2.2.1.2.4.1.1 "><p id="dli_01_0005__p1355884915188">Database Name</p>
<tbody><tr id="dli_01_0005__row55596491188"><td class="cellrowborder" valign="top" width="15.290000000000001%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0005__p1355884915188">Database Name</p>
</td>
<td class="cellrowborder" valign="top" width="72%" headers="mcps1.3.3.2.2.2.1.2.4.1.2 "><ul id="dli_01_0005__ul8558154951816"><li id="dli_01_0005__li175581049171817">The database name can contain only digits, letters, and underscores (_), but cannot contain only digits or start with an underscore (_).</li><li id="dli_01_0005__li3558849141817">The database name is case insensitive and cannot be left blank.</li><li id="dli_01_0005__li13558174914181">The length of the database name cannot exceed 128 characters.</li></ul>
<td class="cellrowborder" valign="top" width="84.71%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><ul id="dli_01_0005__ul8558154951816"><li id="dli_01_0005__li175581049171817">The database name can contain only digits, letters, and underscores (_), but cannot contain only digits or start with an underscore (_).</li><li id="dli_01_0005__li3558849141817">The database name is case insensitive and cannot be left blank.</li><li id="dli_01_0005__li13558174914181">The length of the database name cannot exceed 128 characters.</li></ul>
<div class="note" id="dli_01_0005__note105591449171815"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__p195593494182">The <strong id="dli_01_0005__b28441763415">default</strong> database is a built-in database. You cannot create the <strong id="dli_01_0005__b384414618417">default</strong>. database.</p>
</div></div>
</td>
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.3.2.2.2.1.2.4.1.3 "><p id="dli_01_0005__p11558749171819">DB01</p>
</tr>
<tr id="dli_01_0005__row755994911815"><td class="cellrowborder" valign="top" width="15.290000000000001%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0005__p1055934920186">Description</p>
</td>
<td class="cellrowborder" valign="top" width="84.71%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0005__p14559549171816">Description of a database.</p>
</td>
</tr>
<tr id="dli_01_0005__row755994911815"><td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.2.2.1.2.4.1.1 "><p id="dli_01_0005__p1055934920186">Description</p>
<tr id="dli_01_0005__row574551354713"><td class="cellrowborder" valign="top" width="15.290000000000001%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0005__p105901518162120">Tag</p>
</td>
<td class="cellrowborder" valign="top" width="72%" headers="mcps1.3.3.2.2.2.1.2.4.1.2 "><p id="dli_01_0005__p14559549171816">Description of a database.</p>
</td>
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.3.2.2.2.1.2.4.1.3 "><p id="dli_01_0005__p9559144941818">-</p>
<td class="cellrowborder" valign="top" width="84.71%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0005__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
<div class="note" id="dli_01_0005__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0005__dli_01_0363_ul1830018521911"><li id="dli_01_0005__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0005__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0005__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
<ul id="dli_01_0005__ul55819552289"><li id="dli_01_0005__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0005__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0005__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
<ul id="dli_01_0005__ul16911451899"><li id="dli_01_0005__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0005__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0005__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
@ -45,9 +52,9 @@
</p></li></ol>
</div>
<div class="section" id="dli_01_0005__section46221651175510"><h4 class="sectiontitle">Creating a Table</h4><p id="dli_01_0005__p56362480175534">Before creating a table, ensure that a database has been created.</p>
<ol id="dli_01_0005__ol12637600103738"><li id="dli_01_0005__li59972234153426"><span>You can create a table on either the <span class="wintitle" id="dli_01_0005__wintitle1824439563"><b>Databases and Tables</b></span> page or the <span class="wintitle" id="dli_01_0005__wintitle144676590"><b>SQL Editor</b></span> page.</span><p><div class="note" id="dli_01_0005__note159813598457"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0005__p4599175984510">Datasource connection tables, such as View tables, HBase (MRS) tables, OpenTSDB (MRS) tables, DWS tables, RDS tables, and CSS tables, cannot be created. You can use SQL to create views and datasource connection tables. For details, see sections <strong id="dli_01_0005__b168941558103516">Creating a View</strong> and <strong id="dli_01_0005__b1989435873520">Creating a Datasource Connection Table</strong> in the <em id="dli_01_0005__i12894358133518">Data Lake Insight SQL Syntax Reference</em>.</p>
<ol id="dli_01_0005__ol12637600103738"><li id="dli_01_0005__li59972234153426"><span>You can create a table on either the <span class="wintitle" id="dli_01_0005__wintitle1434561990"><b>Databases and Tables</b></span> page or the <span class="wintitle" id="dli_01_0005__wintitle541971626"><b>SQL Editor</b></span> page.</span><p><div class="note" id="dli_01_0005__note159813598457"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0005__p4599175984510">Datasource connection tables, such as View tables, HBase (MRS) tables, OpenTSDB (MRS) tables, DWS tables, RDS tables, and CSS tables, cannot be created. You can use SQL to create views and datasource connection tables. For details, see sections <strong id="dli_01_0005__b168941558103516">Creating a View</strong> and <strong id="dli_01_0005__b1989435873520">Creating a Datasource Connection Table</strong> in the <em id="dli_01_0005__i12894358133518">Data Lake Insight SQL Syntax Reference</em>.</p>
</div></div>
<ul id="dli_01_0005__ul22405571153537"><li id="dli_01_0005__li323555153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle1498676755"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0005__ol2911995153537"><li id="dli_01_0005__li26207957153537">On the left of the management console, choose <span class="uicontrol" id="dli_01_0005__uicontrol1559686145"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0005__uicontrol8597462415"><b>Databases and Tables</b></span>.</li><li id="dli_01_0005__li17500832153537">On the <strong id="dli_01_0005__b1211154675314">Databases and Tables</strong> page, select the database for which you want to create a table. In the <strong id="dli_01_0005__b10345811102717">Operation</strong> column, click <strong id="dli_01_0005__b12918326165019">More</strong> &gt; <strong id="dli_01_0005__b63873822719">Create Table</strong> to create a table in the current database.</li></ol>
<ul id="dli_01_0005__ul22405571153537"><li id="dli_01_0005__li323555153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle640209786"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0005__ol2911995153537"><li id="dli_01_0005__li26207957153537">On the left of the management console, choose <span class="uicontrol" id="dli_01_0005__uicontrol1559686145"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0005__uicontrol8597462415"><b>Databases and Tables</b></span>.</li><li id="dli_01_0005__li17500832153537">On the <strong id="dli_01_0005__b1211154675314">Databases and Tables</strong> page, select the database for which you want to create a table. In the <strong id="dli_01_0005__b10345811102717">Operation</strong> column, click <strong id="dli_01_0005__b12918326165019">More</strong> &gt; <strong id="dli_01_0005__b63873822719">Create Table</strong> to create a table in the current database.</li></ol>
</li><li id="dli_01_0005__li8281288153537">To create a table on the <span class="wintitle" id="dli_01_0005__wintitle8700317181735"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0005__ol7422733153537"><li id="dli_01_0005__li66804605153537">On the left of the management console, click <span class="uicontrol" id="dli_01_0005__uicontrol11208161745"><b>SQL Editor</b></span>.</li><li id="dli_01_0005__li17512154252514">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0005__wintitle13614162313185"><b>SQL Editor</b></span> page, click <strong id="dli_01_0005__b4615162311183">Databases</strong>. You can create a table in either of the following ways:<ul id="dli_01_0005__ul782474512255"><li id="dli_01_0005__li1893119202619">Click a database name. In the <strong id="dli_01_0005__b11582159133716">Tables</strong> area, click <span><img id="dli_01_0005__image15644111617506" src="en-us_image_0237539075.png"></span> on the right to create a table in the current database.</li><li id="dli_01_0005__li16824154518252">Click <span><img id="dli_01_0005__image1322473935113" src="en-us_image_0237532018.png"></span> on the right of the database and choose <strong id="dli_01_0005__b135378142190">Create Table</strong> from the shortcut menu to create a table in the current database.</li></ul>
</li></ol>
</li></ul>
@ -101,7 +108,7 @@
<tr id="dli_01_0005__row16943758105944"><td class="cellrowborder" valign="top" width="14.38%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.1 "><p id="dli_01_0005__p30267119105944">Type</p>
</td>
<td class="cellrowborder" valign="top" width="71.45%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.2 "><p id="dli_01_0005__p35717569105944">Data type of a column. This parameter corresponds to <span class="parmname" id="dli_01_0005__parmname4155795592938"><b>Column Name</b></span>.</p>
<ul id="dli_01_0005__ul2957726293032"><li id="dli_01_0005__li159154616209"><strong id="dli_01_0005__b12861523131117">string</strong>: The data is of the string type.</li><li id="dli_01_0005__li5035776893042"><strong id="dli_01_0005__b84235270617190">int</strong>: Each integer is stored on four bytes.</li><li id="dli_01_0005__li197172662015"><strong id="dli_01_0005__b71123713114">date</strong>: The value ranges from 0000-01-01 to 9999-12-31.</li><li id="dli_01_0005__li15276123414204"><strong id="dli_01_0005__b2073283811110">double</strong>: Each number is stored on eight bytes.</li><li id="dli_01_0005__li122191918102110"><strong id="dli_01_0005__b87406418113">boolean</strong>: Each value is stored on one byte.</li><li id="dli_01_0005__li616884422117"><strong id="dli_01_0005__b842352706172140">decimal</strong>: The valid bits are positive integers between 1 to 38, including 1 and 38. The decimal digits are integers less than 10.</li><li id="dli_01_0005__li6039945193127"><strong id="dli_01_0005__b1606967536">smallint/short</strong>: The number is stored on two bytes.</li><li id="dli_01_0005__li157282298387"><strong id="dli_01_0005__b461113533">bigint/long</strong>: The number is stored on eight bytes.</li><li id="dli_01_0005__li4930135112217"><strong id="dli_01_0005__b1251694319111">timestamp</strong>: The data indicates a date and time. The value can be accurate to six decimal points.</li><li id="dli_01_0005__li482517952312"><strong id="dli_01_0005__b161442457112">float</strong>: Each number is stored on four bytes.</li><li id="dli_01_0005__li246310417404"><strong id="dli_01_0005__b0368141417399">tinyint</strong>: Each number is stored on one byte. Only OBS tables support this data type.</li></ul>
<ul id="dli_01_0005__ul2957726293032"><li id="dli_01_0005__li159154616209"><strong id="dli_01_0005__b12861523131117">string</strong>: The data is of the string type.</li><li id="dli_01_0005__li5035776893042"><strong id="dli_01_0005__b84235270617190">int</strong>: Each integer is stored on four bytes.</li><li id="dli_01_0005__li197172662015"><strong id="dli_01_0005__b71123713114">date</strong>: The value ranges from 0000-01-01 to 9999-12-31.</li><li id="dli_01_0005__li15276123414204"><strong id="dli_01_0005__b2073283811110">double</strong>: Each number is stored on eight bytes.</li><li id="dli_01_0005__li122191918102110"><strong id="dli_01_0005__b87406418113">boolean</strong>: Each value is stored on one byte.</li><li id="dli_01_0005__li616884422117"><strong id="dli_01_0005__b842352706172140">decimal</strong>: The valid bits are positive integers between 1 to 38, including 1 and 38. The decimal digits are integers less than 10.</li><li id="dli_01_0005__li6039945193127"><strong id="dli_01_0005__b948204713">smallint/short</strong>: The number is stored on two bytes.</li><li id="dli_01_0005__li157282298387"><strong id="dli_01_0005__b1165212357">bigint/long</strong>: The number is stored on eight bytes.</li><li id="dli_01_0005__li4930135112217"><strong id="dli_01_0005__b1251694319111">timestamp</strong>: The data indicates a date and time. The value can be accurate to six decimal points.</li><li id="dli_01_0005__li482517952312"><strong id="dli_01_0005__b161442457112">float</strong>: Each number is stored on four bytes.</li><li id="dli_01_0005__li246310417404"><strong id="dli_01_0005__b0368141417399">tinyint</strong>: Each number is stored on one byte. Only OBS tables support this data type.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="14.17%" headers="mcps1.3.4.3.2.2.1.2.5.2.4.1.3 "><p id="dli_01_0005__p7441963105944">string</p>
</td>
@ -137,7 +144,7 @@
<tbody><tr id="dli_01_0005__row3015013618314"><td class="cellrowborder" valign="top" width="16.6%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.1 "><p id="dli_01_0005__p3709008118455">Data Format</p>
</td>
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p5150660918455">DLI supports the following data formats:</p>
<ul id="dli_01_0005__ul4173603518455"><li id="dli_01_0005__li4007999518455"><strong id="dli_01_0005__b84235270614338">Parquet</strong>: DLI can read non-compressed data or data that is compressed using Snappy and gzip.</li><li id="dli_01_0005__li2517563618455"><strong id="dli_01_0005__b1981815355">CSV</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li2525413518455"><strong id="dli_01_0005__b1789934416">ORC</strong>: DLI can read non-compressed data or data that is compressed using Snappy.</li><li id="dli_01_0005__li2596063018455"><strong id="dli_01_0005__b1180375596">JSON</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li20203144172320"><strong id="dli_01_0005__b14575133533814">Avro</strong>: DLI can read uncompressed Avro data.</li></ul>
<ul id="dli_01_0005__ul4173603518455"><li id="dli_01_0005__li4007999518455"><strong id="dli_01_0005__b84235270614338">Parquet</strong>: DLI can read non-compressed data or data that is compressed using Snappy and gzip.</li><li id="dli_01_0005__li2517563618455"><strong id="dli_01_0005__b608475975">CSV</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li2525413518455"><strong id="dli_01_0005__b2027485322">ORC</strong>: DLI can read non-compressed data or data that is compressed using Snappy.</li><li id="dli_01_0005__li2596063018455"><strong id="dli_01_0005__b986683361">JSON</strong>: DLI can read non-compressed data or data that is compressed using gzip.</li><li id="dli_01_0005__li20203144172320"><strong id="dli_01_0005__b14575133533814">Avro</strong>: DLI can read uncompressed Avro data.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="30.330000000000002%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.3 "><p id="dli_01_0005__p2243627218455">CSV</p>
</td>
@ -170,7 +177,7 @@
</tr>
<tr id="dli_01_0005__row21739275111826"><td class="cellrowborder" valign="top" width="16.6%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.1 "><p id="dli_01_0005__p39917803111836">User-defined Quotation Character</p>
</td>
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p056181715520">This parameter is valid only when <span class="parmname" id="dli_01_0005__parmname917259724"><b>Data Format</b></span> is set to <span class="parmvalue" id="dli_01_0005__parmvalue968546622"><b>CSV</b></span> and you select <strong id="dli_01_0005__b1515618674">User-defined Quotation Character</strong>.</p>
<td class="cellrowborder" valign="top" width="53.06999999999999%" headers="mcps1.3.4.3.2.2.1.2.6.2.4.1.2 "><p id="dli_01_0005__p056181715520">This parameter is valid only when <span class="parmname" id="dli_01_0005__parmname1498421651"><b>Data Format</b></span> is set to <span class="parmvalue" id="dli_01_0005__parmvalue1075709676"><b>CSV</b></span> and you select <strong id="dli_01_0005__b50884634">User-defined Quotation Character</strong>.</p>
<p id="dli_01_0005__p57404199154711">The following quotation characters are supported:</p>
<ul id="dli_01_0005__ul41920423111836"><li id="dli_01_0005__li41739488111836">Single quotation mark (')</li><li id="dli_01_0005__li40111075111836">Double quotation marks (")</li><li id="dli_01_0005__li25455362111836">Others: Enter a user-defined quotation character.</li></ul>
</td>
@ -206,7 +213,7 @@
</table>
</div>
</li></ul>
</p></li><li id="dli_01_0005__li6436679692218"><span>Click <span class="uicontrol" id="dli_01_0005__uicontrol1346028235151847"><b>OK</b></span>.</span><p><p id="dli_01_0005__p2255887315231">After a table is created, you can view and select the table for use on the <span class="wintitle" id="dli_01_0005__wintitle1228761699"><b>Data Management</b></span> page or <strong id="dli_01_0005__b1747557251">SQL Editor</strong> page.</p>
</p></li><li id="dli_01_0005__li6436679692218"><span>Click <span class="uicontrol" id="dli_01_0005__uicontrol1346028235151847"><b>OK</b></span>.</span><p><p id="dli_01_0005__p2255887315231">After a table is created, you can view and select the table for use on the <span class="wintitle" id="dli_01_0005__wintitle1490820795"><b>Data Management</b></span> page or <strong id="dli_01_0005__b1705654393">SQL Editor</strong> page.</p>
</p></li><li id="dli_01_0005__li66082750104919"><span>(Optional) After a DLI table is created, you can decide whether to directly import data to the table.</span></li></ol>
</div>
</div>

146
docs/dli/umn/dli_01_0006.html
View File

File diff suppressed because it is too large Load Diff

68
docs/dli/umn/dli_01_0009.html
View File

@ -1,68 +0,0 @@
<a name="dli_01_0009"></a><a name="dli_01_0009"></a>
<h1 class="topictitle1">Binding and Unbinding a Queue</h1>
<div id="body0000001105515438"><div class="section" id="dli_01_0009__section886913432077"><h4 class="sectiontitle">Constraints</h4><ul id="dli_01_0009__ul5455165810144"><li id="dli_01_0009__li698500101511">The CIDR block of the DLI queue that is bound with a datasource connection cannot overlap with that of the data source.</li><li id="dli_01_0009__li6187125017427">The default queue cannot be bound with a connection.</li></ul>
</div>
<div class="section" id="dli_01_0009__section027361173415"><h4 class="sectiontitle">Binding a Queue</h4><p id="dli_01_0009__p16692124573113">Before using an enhanced datasource connection, you must bind a queue and ensure that the VPC peering connection is in the <strong id="dli_01_0009__b2924131519506">Active</strong> state.</p>
<ul id="dli_01_0009__ul784114313210"><li id="dli_01_0009__li384943163217">Method 1<p id="dli_01_0009__p1147624319295"><a name="dli_01_0009__li384943163217"></a><a name="li384943163217"></a>In the <span class="wintitle" id="dli_01_0009__wintitle20802172417"><b>Enhanced</b></span> tab, select a connection and click <strong id="dli_01_0009__b141412218242">Bind Queue</strong> in the <strong id="dli_01_0009__b815182162418">Operation</strong> column. In the dialog box that is displayed, select the queues to be bound and click <strong id="dli_01_0009__b215172162411">OK</strong>.</p>
</li></ul>
<ul id="dli_01_0009__ul125401946133217"><li id="dli_01_0009__li1754094653210">Method 2<p id="dli_01_0009__p20434173018318"><a name="dli_01_0009__li1754094653210"></a><a name="li1754094653210"></a>Click the name of the selected connection. The <strong id="dli_01_0009__b186114284503">Details</strong> page is displayed. Click <strong id="dli_01_0009__b11346537195013">Create</strong> in the upper left corner. In the dialog box that is displayed, select the queues to be bound and click <strong id="dli_01_0009__b0352153775015">OK</strong>.</p>
<p id="dli_01_0009__p712717203419"></p>
</li></ul>
</div>
<div class="section" id="dli_01_0009__section48371514207"><h4 class="sectiontitle">Viewing Details about a Bound Queue</h4><div class="p" id="dli_01_0009__p174823421415">On the <span class="wintitle" id="dli_01_0009__wintitle1866111118518"><b>Enhanced</b></span> tab page, select a connection and click the connection name to view the information about the bound queue.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0009__table2058910236588" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters in the details list of datasource connection queues</caption><thead align="left"><tr id="dli_01_0009__row135891123145816"><th align="left" class="cellrowborder" valign="top" width="13.850000000000001%" id="mcps1.3.3.2.2.2.3.1.1"><p id="dli_01_0009__p1759018239585">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="86.15%" id="mcps1.3.3.2.2.2.3.1.2"><p id="dli_01_0009__p85906234580">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0009__row259022345814"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p659052315816">VPC Peering ID</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p15739171410">ID of the VPC peering connection created in the cluster to which the queue belongs.</p>
<div class="note" id="dli_01_0009__note1330219211843"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0009__p130214211248">A VPC peering connection is created for each queue bound to an enhanced datasource connection. The VPC peering connection is used for cross-VPC communication. Ensure that the security group used by the data source allows access from the DLI queue CIDR block, and do not delete the VPC peering connection during the datasource connection.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0009__row0590172375818"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p95906231587">Name</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p651916432717">Name of a bound queue.</p>
</td>
</tr>
<tr id="dli_01_0009__row165901238588"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p1859020234589">Connection Status</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p2059062317589">Datasource connection status. The following three statuses are available:</p>
<ul id="dli_01_0009__ul15899620876"><li id="dli_01_0009__li118999201473">Creating</li><li id="dli_01_0009__li789910201877">Active</li><li id="dli_01_0009__li1089914207718">Failed</li></ul>
<div class="note" id="dli_01_0009__note1964641888"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0009__p1864620111814">If the connection status is <strong id="dli_01_0009__b1931035216528">Failed</strong>, click <span><img id="dli_01_0009__image122211841291" src="en-us_image_0000001151957753.png"></span> on the left to view the detailed error information.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0009__row18590123185815"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p165901923195811">Updated</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p1859016232586">Time when a connection is updated. The connections in the connection list can be displayed according to the update time in ascending or descending order.</p>
</td>
</tr>
<tr id="dli_01_0009__row15590152315812"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p6590182316588">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p25914531233"><strong id="dli_01_0009__b11566143816538">Unbind Queue</strong>: This operation is used to unbind a datasource connection from a queue.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div class="section" id="dli_01_0009__section16495153616367"><h4 class="sectiontitle">Unbinding a Queue</h4><p id="dli_01_0009__p179936555312">If you do not need to use an enhanced datasource connection, you can unbind the queue from it to release resources.</p>
<ul id="dli_01_0009__ul68671113339"><li id="dli_01_0009__li08671513335">Method 1<p id="dli_01_0009__p168681193310"><a name="dli_01_0009__li08671513335"></a><a name="li08671513335"></a>On the <span class="wintitle" id="dli_01_0009__wintitle611643105411"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0009__b612114385413">More</strong> &gt; <strong id="dli_01_0009__b212213317541">Unbind Queue</strong> in the <strong id="dli_01_0009__b512215314543">Operation</strong> column. In the dialog box that is displayed, select the queues to be unbound and click <strong id="dli_01_0009__b5122431547">OK</strong>.</p>
</li></ul>
<ul id="dli_01_0009__ul1286817114335"><li id="dli_01_0009__li188682119331">Method 2<p id="dli_01_0009__p28681415333"><a name="dli_01_0009__li188682119331"></a><a name="li188682119331"></a>Click the name of the target connection. The <strong id="dli_01_0009__b1810216825412">Details</strong> page is displayed. Select the queue to be unbound and click <strong id="dli_01_0009__b3453161116548">Unbind Queue</strong> in the <strong id="dli_01_0009__b745991155420">Operation</strong> column. In the displayed dialog box, confirm the queue to be unbound and click <strong id="dli_01_0009__b154599116545">Yes</strong>.</p>
<p id="dli_01_0009__p17855145294411"></p>
</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

4
docs/dli/umn/dli_01_0012.html
View File

@ -14,7 +14,7 @@
</li>
<li class="ulchildlink"><strong><a href="dli_01_0443.html">Modifying the CIDR Block</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0487.html">Elastic Scaling</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0487.html">Elastic Queue Scaling</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0488.html">Scheduling CU Changes</a></strong><br>
</li>
@ -22,6 +22,8 @@
</li>
<li class="ulchildlink"><strong><a href="dli_01_0421.html">Creating a Message Notification Topic</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0022.html">Managing Queue Tags</a></strong><br>
</li>
</ul>
</div>

31
docs/dli/umn/dli_01_0013.html
View File

@ -1,18 +1,27 @@
<a name="dli_01_0013"></a><a name="dli_01_0013"></a>
<h1 class="topictitle1">Modifying Host Information</h1>
<div id="body0000001152155459"><div class="section" id="dli_01_0013__section636281512389"><a name="dli_01_0013__section636281512389"></a><a name="section636281512389"></a><h4 class="sectiontitle">Modifying Hosts Information</h4><p id="dli_01_0013__p10301174711583"><strong id="dli_01_0013__b1047812430315">Method 1: Copy hosts information in /etc/hosts of an MRS node.</strong></p>
<ol id="dli_01_0013__ol1042353512453"><li id="dli_01_0013__li4423735204520"><span>Log in to any MRS node as the <strong id="dli_01_0013__b15955624103412">root</strong> user.</span></li><li id="dli_01_0013__li5236194744818"><a name="dli_01_0013__li5236194744818"></a><a name="li5236194744818"></a><span>Run the following command to obtain MRS hosts information. Copy and save the information.</span><p><p id="dli_01_0013__p16131162771410"><strong id="dli_01_0013__b9843629161411">cat /etc/hosts</strong></p>
<div class="fignone" id="dli_01_0013__fig15752030165413"><span class="figcap"><b>Figure 1 </b>Obtaining hosts information</span><br><span><img id="dli_01_0013__image4830201818144" src="en-us_image_0000001142261092.png"></span></div>
</p></li><li id="dli_01_0013__li129707130545"><span>Log in to the DLI console, choose <strong id="dli_01_0013__b763993910323">Datasource Connections</strong> &gt; <strong id="dli_01_0013__b1463920393321">Enhanced</strong>. On the <span class="wintitle" id="dli_01_0013__wintitle1829016468320"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0013__b0296154633212">Modify Host</strong>. In the displayed dialog box, paste the host information copied in <a href="#dli_01_0013__li5236194744818">2</a>. Click <strong id="dli_01_0013__b458113369331">OK</strong>.</span></li></ol>
<p id="dli_01_0013__p1710115560582"><strong id="dli_01_0013__b205621803362">Method 2: Log in to FusionInsight Manager to obtain MRS hosts information.</strong></p>
<ol id="dli_01_0013__ol634316416599"><li id="dli_01_0013__li2344174125916"><span>Log in to FusionInsight Manager.</span></li><li id="dli_01_0013__li207601326501"><a name="dli_01_0013__li207601326501"></a><a name="li207601326501"></a><span>On FusionInsight Manager, click <strong id="dli_01_0013__b126271239102310">Hosts</strong>. On the <strong id="dli_01_0013__b7556143492419">Hosts</strong> page, obtain the host names and service IP addresses of the MRS hosts.</span></li><li id="dli_01_0013__li6531739178"><span>Log in to the DLI console, choose <strong id="dli_01_0013__b3845162412918">Datasource Connections</strong> &gt; <strong id="dli_01_0013__b898522519296">Enhanced</strong>. On the <span class="wintitle" id="dli_01_0013__wintitle17397193063712"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0013__b640218309379">Modify Host</strong>. In the displayed dialog box, enter the host information. Click <strong id="dli_01_0013__b10151136163714">OK</strong>.</span><p><p id="dli_01_0013__p14257184014718">The host information is in the format of <em id="dli_01_0013__i5544141173013">Service IP address</em> <em id="dli_01_0013__i1844586143016">Host name</em>. Specify the IP addresses and host names obtained in <a href="#dli_01_0013__li207601326501">2</a>, and separate multiple records by line breaks.</p>
<p id="dli_01_0013__p1422455416818">For example:</p>
<p id="dli_01_0013__p16991312086">192.168.0.22 node-masterxxx1.com</p>
<p id="dli_01_0013__p0726125917819">192.168.0.23 node-masterxxx2.com</p>
</p></li></ol>
<div class="note" id="dli_01_0013__note463551414368"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0013__ul1973359203914"><li id="dli_01_0013__li1173155917399">After this configuration, all hosts information is overwritten.</li><li id="dli_01_0013__li973175920397">A host name or domain name can contain a maximum of 128 characters, including digits, letters, underscores (_), hyphens (-), and periods (.). It must start with a letter.</li><li id="dli_01_0013__li253124115716">The host information is <em id="dli_01_0013__i0601191512126">IP address Host name/Domain name</em> format. Separate multiple records by line breaks.</li></ul>
<div id="body0000001152155459"><div class="section" id="dli_01_0013__section17615192019582"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0013__p171819419301">Host information is the mapping between host IP addresses and domain names. After you configure host information, jobs can only use the configured domain names to access corresponding hosts. After a datasource connection is created, you can modify the host information.</p>
<p id="dli_01_0013__p10340194113302">When accessing the HBase cluster of MRS, you need to configure the host name (domain name) and IP address of the instance.</p>
</div>
<div class="section" id="dli_01_0013__section1137039955"><h4 class="sectiontitle">Constraints</h4><p id="dli_01_0013__p412134219514">You have obtained the MRS host information by referring to <a href="#dli_01_0013__section3607172865810">How Do I Obtain MRS Host Information?</a></p>
</div>
<div class="section" id="dli_01_0013__section6859216954"><a name="dli_01_0013__section6859216954"></a><a name="section6859216954"></a><h4 class="sectiontitle">Modifying Host Information</h4><ol id="dli_01_0013__ol194665011112"><li id="dli_01_0013__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0013__li918675917143">In the left navigation pane, choose <strong id="dli_01_0013__b17656194117209">Datasource Connections</strong>.</li><li id="dli_01_0013__li16324435150">On the <strong id="dli_01_0013__b1879911443570">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to be modified, click <strong id="dli_01_0013__b19218829195811">More</strong> in the <strong id="dli_01_0013__b1529210539585">Operation</strong> column, and select <strong id="dli_01_0013__b9167149195813">Modify Host</strong>.</li><li id="dli_01_0013__li20260172914910">In the <strong id="dli_01_0013__b159175219015">Modify Host</strong> dialog box displayed, enter the obtained host information.<p id="dli_01_0013__p215110281626">Enter host information in the format of <em id="dli_01_0013__i1019185510110">Host IP address</em><strong id="dli_01_0013__b943812207215"> </strong><em id="dli_01_0013__i13582791126">Host name</em>. Information about multiple hosts is separated by line breaks.</p>
<p id="dli_01_0013__p119411248895">Example:</p>
<p id="dli_01_0013__p636511511217">192.168.0.22 node-masterxxx1.com</p>
<p id="dli_01_0013__p1536517151321">192.168.0.23 node-masterxxx2.com</p>
<p id="dli_01_0013__p20985104161012">Obtain the MRS host information by referring to <a href="#dli_01_0013__section3607172865810">How Do I Obtain MRS Host Information?</a></p>
</li><li id="dli_01_0013__li33942299478">Click <strong id="dli_01_0013__b842352706143321">OK</strong>.</li></ol>
</div>
<div class="section" id="dli_01_0013__section3607172865810"><a name="dli_01_0013__section3607172865810"></a><a name="section3607172865810"></a><h4 class="sectiontitle">How Do I Obtain MRS Host Information?</h4><ul id="dli_01_0013__ul2014719191210"><li id="dli_01_0013__li74471471342"><strong id="dli_01_0013__b10964723646">Method 1: View MRS host information on the management console.</strong><p id="dli_01_0013__p2011023525">To obtain the host name and IP address of an MRS cluster, for example, MRS 3.<em id="dli_01_0013__i7634105210619">x</em>, perform the following operations:</p>
<ol id="dli_01_0013__ol34131830476"><li id="dli_01_0013__li24136334712">Log in to the MRS management console.</li><li id="dli_01_0013__li14136317472">On the <strong id="dli_01_0013__b886618920122">Active Clusters</strong> page displayed, click your desired cluster to access its details page.</li><li id="dli_01_0013__li741363194711">Click the <strong id="dli_01_0013__b228364411164">Components</strong> tab.</li><li id="dli_01_0013__li174136317476">Click <strong id="dli_01_0013__b47249556160">ZooKeeper</strong>.</li><li id="dli_01_0013__li114131237471">Click the <span class="wintitle" id="dli_01_0013__wintitle131141554201820"><b>Instance</b></span> tab to view corresponding service IP addresses. You can select any service IP address.</li><li id="dli_01_0013__li1491513115563">Modify host information by referring to <a href="#dli_01_0013__section6859216954">Modifying Host Information</a>.</li></ol>
<div class="note" id="dli_01_0013__note1426252593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0013__p142655145920">If the MRS cluster has multiple IP addresses, enter any service IP address when creating a datasource connection.</p>
</div></div>
</li><li id="dli_01_0013__li914799171217"><strong id="dli_01_0013__b1392713419255">Method 2: Obtain MRS host information from the /etc/hosts file on an MRS node.</strong><ol id="dli_01_0013__ol207699227017"><li id="dli_01_0013__li67691922306">Log in to any MRS node as user <strong id="dli_01_0013__b187181123279">root</strong>.</li><li id="dli_01_0013__li17769172215019">Run the following command to obtain MRS hosts information. Copy and save the information.<p id="dli_01_0013__p16131162771410"><a name="dli_01_0013__li17769172215019"></a><a name="li17769172215019"></a><strong id="dli_01_0013__b9843629161411">cat /etc/hosts</strong></p>
<div class="fignone" id="dli_01_0013__fig15752030165413"><span class="figcap"><b>Figure 1 </b>Obtaining hosts information</span><br><span><img id="dli_01_0013__image4830201818144" src="en-us_image_0000001586217017.png"></span></div>
</li><li id="dli_01_0013__li1176911221002">Modify host information by referring to <a href="#dli_01_0013__section6859216954">Modifying Host Information</a>.</li></ol>
</li><li id="dli_01_0013__li014759141210"><strong id="dli_01_0013__b565525112718">Method 3: Log in to FusionInsight Manager to obtain host information.</strong><ol id="dli_01_0013__ol3769417115"><li id="dli_01_0013__li676915171813">Log in to FusionInsight Manager.</li><li id="dli_01_0013__li177698179113">On FusionInsight Manager, click <strong id="dli_01_0013__b126271239102310">Hosts</strong>. On the <strong id="dli_01_0013__b7556143492419">Hosts</strong> page, obtain the host names and service IP addresses of the MRS hosts.</li><li id="dli_01_0013__li146541436234">Modify host information by referring to <a href="#dli_01_0013__section6859216954">Modifying Host Information</a>.</li></ol>
</li></ul>
</div>
</div>
<div>

28
docs/dli/umn/dli_01_0014.html
View File

@ -1,33 +1,35 @@
<a name="dli_01_0014"></a><a name="dli_01_0014"></a>
<h1 class="topictitle1">Custom Route Information</h1>
<div id="body0000001151955397"><div class="section" id="dli_01_0014__section19599154272217"><h4 class="sectiontitle">Customizing Route Information</h4><p id="dli_01_0014__p109651445173115">After an enhanced datasource connection is created and bound to a queue, the system automatically configures route information. You can also add a custom route for the queue to which the enhanced connection is bound.</p>
<ul id="dli_01_0014__ul943687142519"><li id="dli_01_0014__li2436476256">Viewing route information<p id="dli_01_0014__p14457929182310"><a name="dli_01_0014__li2436476256"></a><a name="li2436476256"></a>On the <span class="wintitle" id="dli_01_0014__wintitle1018173013185"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0014__b12184307186">Manage Route</strong> in the <strong id="dli_01_0014__b15181930111819">Operation</strong> column to view the route information of the datasource connection.</p>
<h1 class="topictitle1">Adding a Route</h1>
<div id="body0000001151955397"><div class="section" id="dli_01_0014__section2071923931014"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0014__p197659534560">A route is configured with the destination, next hop type, and next hop to determine where the network traffic is directed. Routes are classified into system routes and custom routes.</p>
<p id="dli_01_0014__p477315405482">After an enhanced connection is created, the subnet is automatically associated with the default route. You can add custom routes as needed to forward traffic destined for the destination to the specified next hop.</p>
<div class="note" id="dli_01_0014__note111421815105414"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0014__ul17762151184110"><li id="dli_01_0014__li22368248550">When an enhanced connection is created, the associated route table is the one associated with the subnet of the data source.</li><li id="dli_01_0014__li18611123515516">The route to be added in the <strong id="dli_01_0014__b16657053314">Add Route</strong> dialog box must be one in the route table associated with the subnet of the resource pool.</li><li id="dli_01_0014__li1037929184116">The subnet of the data source must be different from that used by the resource pool. Otherwise, a network segment conflict occurs.</li></ul>
</div></div>
</div>
<div class="section" id="dli_01_0014__section15147134471017"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0014__ol194665011112"><li id="dli_01_0014__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0014__li918675917143">In the left navigation pane, choose <strong id="dli_01_0014__b10271163810368">Datasource Connections</strong>.</li><li id="dli_01_0014__li392585072817">On the <strong id="dli_01_0014__b11744144083617">Enhanced</strong> tab page displayed, locate the row containing the enhanced connection to which a route needs to be added, and add the route.<ul id="dli_01_0014__ul738113128302"><li id="dli_01_0014__li738131211308">Method 1:<ol type="a" id="dli_01_0014__ol162321854175518"><li id="dli_01_0014__li16324435150">On the <strong id="dli_01_0014__b178531518183712">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to which a route needs to be added and click <strong id="dli_01_0014__b18853131819370">Manage Route</strong> in the <strong id="dli_01_0014__b28541418103716">Operation</strong> column.</li><li id="dli_01_0014__li68349103411">Click <strong id="dli_01_0014__b17616559388">Add Route</strong>.</li><li id="dli_01_0014__li20260172914910">In the <strong id="dli_01_0014__b1796015143388">Add Route</strong> dialog box, enter the route information. For details about the parameters, see <a href="#dli_01_0014__table42440623119">Table 1</a>.</li><li id="dli_01_0014__li33942299478">Click <strong id="dli_01_0014__b660111761113243">OK</strong>.</li></ol>
</li><li id="dli_01_0014__li107318579335">Method 2:<ol type="a" id="dli_01_0014__ol27313571336"><li id="dli_01_0014__li14734111510300">On the <strong id="dli_01_0014__b834074083816">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to which a route needs to be added, click <strong id="dli_01_0014__b6340164012388">More</strong> in the <strong id="dli_01_0014__b034114404384">Operation</strong> column, and select <strong id="dli_01_0014__b734204015384">Add Route</strong>.</li><li id="dli_01_0014__li14631114193214">In the <strong id="dli_01_0014__b1459920815398">Add Route</strong> dialog box, enter the route information. For details about the parameters, see <a href="#dli_01_0014__table42440623119">Table 1</a>.</li><li id="dli_01_0014__li67311357173311">Click <strong id="dli_01_0014__b423331158113243">OK</strong>.</li></ol>
</li></ul>
<ul id="dli_01_0014__ul757391362520"><li id="dli_01_0014__li20573413142515">Adding a route<p id="dli_01_0014__p7906201015259"><a name="dli_01_0014__li20573413142515"></a><a name="li20573413142515"></a>On the <span class="wintitle" id="dli_01_0014__wintitle1060673481815"><b>Enhanced</b></span> tab page, select a connection and choose <strong id="dli_01_0014__b3612203431813">More</strong> &gt; <strong id="dli_01_0014__b2612534181813">Add Route</strong> in the <strong id="dli_01_0014__b561263413180">Operation</strong> column, or click <strong id="dli_01_0014__b186131234161818">Add Route</strong> on the <span class="wintitle" id="dli_01_0014__wintitle4613133410184"><b>Details</b></span> page of the connection to add a custom route. In the displayed dialog box, enter the route name and route CIDR block. For details about the parameters, see <a href="#dli_01_0014__table42440623119">Table 1</a>.</p>
<div class="tablenoborder"><a name="dli_01_0014__table42440623119"></a><a name="table42440623119"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0014__table42440623119" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters for adding a custom route</caption><thead align="left"><tr id="dli_01_0014__row1624410615313"><th align="left" class="cellrowborder" valign="top" width="17.46%" id="mcps1.3.1.4.1.2.2.3.1.1"><p id="dli_01_0014__p172444619318">Parameter</p>
<div class="tablenoborder"><a name="dli_01_0014__table42440623119"></a><a name="table42440623119"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0014__table42440623119" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters for adding a custom route</caption><thead align="left"><tr id="dli_01_0014__row1624410615313"><th align="left" class="cellrowborder" valign="top" width="17.46%" id="mcps1.3.2.2.3.3.2.3.1.1"><p id="dli_01_0014__p172444619318">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="82.54%" id="mcps1.3.1.4.1.2.2.3.1.2"><p id="dli_01_0014__p1244106163117">Description</p>
<th align="left" class="cellrowborder" valign="top" width="82.54%" id="mcps1.3.2.2.3.3.2.3.1.2"><p id="dli_01_0014__p1244106163117">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0014__row624518623112"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.1.4.1.2.2.3.1.1 "><p id="dli_01_0014__p1024516613118">Route Name</p>
<tbody><tr id="dli_01_0014__row624518623112"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.2.2.3.3.2.3.1.1 "><p id="dli_01_0014__p1024516613118">Route Name</p>
</td>
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.1.4.1.2.2.3.1.2 "><p id="dli_01_0014__p152455618315">Name of a custom route, which is unique in the same enhanced datasource scenario. The name contains 1 to 64 characters, including digits, letters, underscores (_), and hyphens (-).</p>
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p152455618315">Name of a custom route, which is unique in the same enhanced datasource scenario. The name can contain 1 to 64 characters. Only digits, letters, underscores (_), and hyphens (-) are allowed.</p>
</td>
</tr>
<tr id="dli_01_0014__row122452064312"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.1.4.1.2.2.3.1.1 "><p id="dli_01_0014__p1124516623114">IP Address</p>
<tr id="dli_01_0014__row122452064312"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.2.2.3.3.2.3.1.1 "><p id="dli_01_0014__p1124516623114">IP Address</p>
</td>
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.1.4.1.2.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR block of different routes can overlap but cannot be the same.</p>
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR block of different routes can overlap but cannot be the same.</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ul>
<ul id="dli_01_0014__ul4323161983711"><li id="dli_01_0014__li163231219153716">Deleting a route<p id="dli_01_0014__p20921330121210"><a name="dli_01_0014__li163231219153716"></a><a name="li163231219153716"></a>On the <span class="wintitle" id="dli_01_0014__wintitle4169310181914"><b>Enhanced</b></span> page, select a connection and choose <strong id="dli_01_0014__b116912105194">More</strong> &gt; <strong id="dli_01_0014__b3170141021919">Delete Route</strong> in the <strong id="dli_01_0014__b81709102192">Operation</strong> column, or click <strong id="dli_01_0014__b1917011021913">Delete Route</strong> on the <span class="wintitle" id="dli_01_0014__wintitle1589845133710"><b>Details</b></span> page of the connection to delete a custom route.</p>
</li></ul>
</li><li id="dli_01_0014__li55563287555">After adding a route, you can view the route information on the route details page.</li></ol>
</div>
</div>
<div>

4
docs/dli/umn/dli_01_0015.html
View File

@ -1,7 +1,7 @@
<a name="dli_01_0015"></a><a name="dli_01_0015"></a>
<h1 class="topictitle1">Queue Permission Management</h1>
<div id="body1501038213757"><div class="section" id="dli_01_0015__section11499577152559"><h4 class="sectiontitle">Scenarios</h4><ul id="dli_01_0015__ul45004672142627"><li id="dli_01_0015__li27643373142627">You can isolate queues allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0015__li24342715142316">The administrator and queue owner have all permissions, which cannot be set or modified by other users.</li></ul>
<div id="body1501038213757"><div class="section" id="dli_01_0015__section11499577152559"><h4 class="sectiontitle">Scenario</h4><ul id="dli_01_0015__ul45004672142627"><li id="dli_01_0015__li27643373142627">You can isolate queues allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0015__li24342715142316">The administrator and queue owner have all permissions, which cannot be set or modified by other users.</li></ul>
</div>
<div class="section" id="dli_01_0015__section20128473551"><h4 class="sectiontitle">Operations</h4><ol id="dli_01_0015__ol31809540103928"><li id="dli_01_0015__li10639209101950"><span>On the top menu bar of the DLI management console, click <strong id="dli_01_0015__b761084715252">Resources</strong> &gt; <span class="uicontrol" id="dli_01_0015__uicontrol4872154310282"><b>Queue Management</b></span>.</span></li><li id="dli_01_0015__li5676629917517"><span>Select the queue to be configured and choose <strong id="dli_01_0015__b1355011215377">Manage Permissions</strong> in the <strong id="dli_01_0015__b165505213716">Operation</strong> column. The <strong id="dli_01_0015__b842352706171520">User Permission Info</strong> area displays the list of users who have permissions on the queue.</span><p><p id="dli_01_0015__p123538119117">You can assign queue permissions to new users, modify permissions for users who have some permissions of a queue, and revoke all permissions of a user on a queue.</p>
<ul id="dli_01_0015__ul60761295191140"><li id="dli_01_0015__li188984072720">Assign permissions to a new user.<div class="p" id="dli_01_0015__p3651154182719"><a name="dli_01_0015__li188984072720"></a><a name="li188984072720"></a>A new user does not have permissions on the queue.<ol type="a" id="dli_01_0015__ol38619773141515"><li id="dli_01_0015__li1545661718056">Click <strong id="dli_01_0015__b16897820560">Set Permission</strong> on the right of <strong id="dli_01_0015__b1908875614">User Permissions</strong> page. The <span class="wintitle" id="dli_01_0015__wintitle1990108175620"><b>Set Permission</b></span> dialog box is displayed.</li><li id="dli_01_0015__li12033638141515">Specify <span class="parmname" id="dli_01_0015__parmname1572165209191914"><b>Username</b></span> and select corresponding permissions.</li><li id="dli_01_0015__li136261439132">Click <span class="uicontrol" id="dli_01_0015__uicontrol131405151191935"><b>OK</b></span>.<p id="dli_01_0015__p97671211131410"><a href="#dli_01_0015__table15710625151416">Table 1</a> describes the related parameters.</p>
@ -31,7 +31,7 @@
</div>
</li><li id="dli_01_0015__li5373564191140">To assign or revoke permissions of a user who has some permissions on the queue, perform the following steps:<ol type="a" id="dli_01_0015__ol64022357191649"><li id="dli_01_0015__li11136112815177">In the list under <span class="wintitle" id="dli_01_0015__wintitle2724849191220"><b>User Permission Info</b></span> for a queue, select the user whose permissions need to be modified and click <span class="uicontrol" id="dli_01_0015__uicontrol197263497126"><b>Set Permission</b></span> in the <span class="uicontrol" id="dli_01_0015__uicontrol156991298917161"><b>Operation</b></span> column.</li><li id="dli_01_0015__li3483530142353">In the displayed <span class="wintitle" id="dli_01_0015__wintitle1283331883119"><b>Set Permission</b></span> dialog box, modify the permissions of the current user. <a href="#dli_01_0015__table15710625151416">Table 1</a> lists the detailed permission descriptions.<p id="dli_01_0015__p3341848294412">If all options under <span class="parmname" id="dli_01_0015__parmname191181136193316"><b>Set Permission</b></span> are gray, you are not allowed to change permissions on this queue. You can apply to the administrator, queue owner, or other authorized users for queue permission granting and revoking.</p>
</li><li id="dli_01_0015__li10389193018234">Click <span class="uicontrol" id="dli_01_0015__uicontrol1516336014162242"><b>OK</b></span>.</li></ol>
</li><li id="dli_01_0015__li2536165618122">To revoke all permission of a user on the queue, perform the following steps:<p id="dli_01_0015__p41775579123"><a name="dli_01_0015__li2536165618122"></a><a name="li2536165618122"></a>In the user list under <span class="wintitle" id="dli_01_0015__wintitle418550809"><b>Permission Info</b></span>, select the user whose permission needs to be revoked and click <span class="uicontrol" id="dli_01_0015__uicontrol1291310555"><b>Revoke Permission</b></span> under <span class="uicontrol" id="dli_01_0015__uicontrol18942202419342"><b>Operation</b></span>. In the <strong id="dli_01_0015__b19765113823218">Revoke Permission</strong> dialog box, click <span class="uicontrol" id="dli_01_0015__uicontrol35891343193211"><b>OK</b></span>. All permissions on this queue are revoked.</p>
</li><li id="dli_01_0015__li2536165618122">To revoke all permission of a user on the queue, perform the following steps:<p id="dli_01_0015__p41775579123"><a name="dli_01_0015__li2536165618122"></a><a name="li2536165618122"></a>In the user list under <span class="wintitle" id="dli_01_0015__wintitle652036544"><b>Permission Info</b></span>, select the user whose permission needs to be revoked and click <span class="uicontrol" id="dli_01_0015__uicontrol1439083445"><b>Revoke Permission</b></span> under <span class="uicontrol" id="dli_01_0015__uicontrol18942202419342"><b>Operation</b></span>. In the <strong id="dli_01_0015__b19765113823218">Revoke Permission</strong> dialog box, click <span class="uicontrol" id="dli_01_0015__uicontrol35891343193211"><b>OK</b></span>. All permissions on this queue are revoked.</p>
</li></ul>
</p></li></ol>
</div>

12
docs/dli/umn/dli_01_0017.html
View File

@ -4,7 +4,7 @@
<div id="body1501038213757"><p id="dli_01_0017__p1192818410140">SQL jobs allow you to execute SQL statements entered in the <a href="dli_01_0320.html">SQL job editing window</a>, import data, and export data.</p>
<p id="dli_01_0017__p835610562472">SQL job management provides the following functions:</p>
<ul id="dli_01_0017__ul32249213483"><li id="dli_01_0017__li64311610480"><a href="#dli_01_0017__section71552447166">Searching for Jobs</a>: Search for jobs that meet the search criteria.</li><li id="dli_01_0017__li1032925220118"><a href="#dli_01_0017__section1960402414173">Viewing Job Details</a>: Display job details.</li><li id="dli_01_0017__li68201752220"><a href="#dli_01_0017__section8647175812179">Terminating a Job</a>: Stop a job in the <strong id="dli_01_0017__b42751775137">Submitting</strong> or <strong id="dli_01_0017__b9275179136">Running</strong> status.</li><li id="dli_01_0017__li1566419171522"><a href="#dli_01_0017__section1152211221244">Exporting Query Results</a>: A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can export the data to OBS.</li></ul>
<div class="section" id="dli_01_0017__section1616314111518"><h4 class="sectiontitle">SQL Jobs page</h4><p id="dli_01_0017__p66482014175614">On the <strong id="dli_01_0017__b18994133761612">Overview</strong> page of the DLI console, click <strong id="dli_01_0017__b6320155516180">SQL Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0017__b19281104916202">Job Management</strong> &gt; <strong id="dli_01_0017__b827935212010">SQL Jobs</strong>. The job list displays all SQL jobs. If there are a large number of jobs, they will be displayed on multiple pages. You can switch to the specified page as needed. DLI allows you to view jobs in all statuses. By default, jobs in the job list are displayed in descending order of the job creation time.</p>
<div class="section" id="dli_01_0017__section1616314111518"><h4 class="sectiontitle">SQL Jobs Page</h4><p id="dli_01_0017__p66482014175614">On the <strong id="dli_01_0017__b18994133761612">Overview</strong> page of the DLI console, click <strong id="dli_01_0017__b6320155516180">SQL Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0017__b19281104916202">Job Management</strong> &gt; <strong id="dli_01_0017__b827935212010">SQL Jobs</strong>. The job list displays all SQL jobs. If there are a large number of jobs, they will be displayed on multiple pages. You can switch to the specified page as needed. DLI allows you to view jobs in all statuses. By default, jobs in the job list are displayed in descending order of the job creation time.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0017__table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>SQL Job management parameters</caption><thead align="left"><tr id="dli_01_0017__row2555468715120"><th align="left" class="cellrowborder" valign="top" width="21.18%" id="mcps1.3.4.3.2.3.1.1"><p id="dli_01_0017__p4021197415120">Parameter</p>
</th>
@ -72,8 +72,10 @@
<ul id="dli_01_0017__ul6666708314"><li id="dli_01_0017__li133057619316">Select a queue name.</li><li id="dli_01_0017__li18247191173118">Set the date range.</li><li id="dli_01_0017__li628013159312">Enter a username, statement, or job ID.</li><li id="dli_01_0017__li4674222143113">Select the creation time in ascending or descending order.</li><li id="dli_01_0017__li1351410309312">Select a job type.</li><li id="dli_01_0017__li27941038143114">Select a job status.</li><li id="dli_01_0017__li16661309314">Select the job execution duration in ascending or descending order.</li></ul>
</div>
<div class="section" id="dli_01_0017__section1960402414173"><a name="dli_01_0017__section1960402414173"></a><a name="section1960402414173"></a><h4 class="sectiontitle">Viewing Job Details</h4><p id="dli_01_0017__p20163836141017">On the <span class="wintitle" id="dli_01_0017__wintitle1816311360107"><b>SQL Jobs</b></span> page, you can click <span><img id="dli_01_0017__image31693218331" src="en-us_image_0206789824.png"></span> in front of a job record to view details about the job.</p>
<p id="dli_01_0017__p1415104681017">The following describes how to load data, create a table, and select a job. The job details vary depending on the job types, status, and configuration options.</p>
<ul id="dli_01_0017__ul466323121417"><li id="dli_01_0017__li166631331419"><strong id="dli_01_0017__b140748101618">Load data</strong> (job type: IMPORT) include the following information: queue, job ID, username, type, status, execution statement, running duration, creation time, end time, parameter settings, label, number of results, scanned data, number of scanned data, number of error records, storage path, data format, database, table, table header, separator, reference character, escape character, date format, and timestamp format.</li><li id="dli_01_0017__li46631311141"><strong id="dli_01_0017__b1091261081611">Create table</strong> (job type: DDL) include the following information: queue, job ID, username, type, status, execution statement, running duration, creation time, end time, parameter settings, tags, number of results, scanned data, and database.</li><li id="dli_01_0017__li042171511520"><strong id="dli_01_0017__b108391371173">Select</strong> (job type: QUERY) include the following information: queue, job ID, username, type, status, execution statement, running duration, creation time, end time, parameter setting, label, number of results (results of successful executions can be exported), and scanned data, username, result status (results of successful tasks can be viewed. Failure causes of failed tasks are displayed), and database.</li></ul>
<p id="dli_01_0017__p1415104681017">Job details vary with job types. The job details vary depending on the job types, status, and configuration options. The following describes how to load data, create a table, and select a job. For details about other job types, see the information on the management console.</p>
<ul id="dli_01_0017__ul466323121417"><li id="dli_01_0017__li166631331419"><strong id="dli_01_0017__b140748101618">Load data</strong> (job type: IMPORT) include the following information: queue, job ID, username, type, status, execution statement, running duration, creation time, end time, parameter settings, label, number of results, scanned data, number of scanned data, number of error records, storage path, data format, database, table, table header, separator, reference character, escape character, date format, timestamp format, total CPU used, and output bytes.</li><li id="dli_01_0017__li46631311141"><strong id="dli_01_0017__b1091261081611">Create table</strong> (job type: DDL) include the following information: queue, job ID, username, type, status, execution statement, running duration, creation time, end time, parameter settings, tags, number of results, scanned data, and database.</li><li id="dli_01_0017__li042171511520"><strong id="dli_01_0017__b108391371173">Select</strong> (job type: QUERY) include the following information: queue, job ID, username, type, status, execution statement, running duration, creation time, end time, parameter setting, label, number of results (results of successful executions can be exported), and scanned data, username, result status (results of successful tasks can be viewed. Failure causes of failed tasks are displayed), database, total CPU used, and output bytes.<div class="note" id="dli_01_0017__note195951310367"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0017__ul23411296368"><li id="dli_01_0017__li93482973619"><strong id="dli_01_0017__b151417022817">Total CPU Used (Core x ms)</strong>: total CPU used during job execution.</li><li id="dli_01_0017__li1034829153611"><strong id="dli_01_0017__b1371610552272">Output Bytes</strong>: number of output bytes after the job is executed.</li></ul>
</div></div>
</li></ul>
</div>
<div class="section" id="dli_01_0017__section8647175812179"><a name="dli_01_0017__section8647175812179"></a><a name="section8647175812179"></a><h4 class="sectiontitle">Terminating a Job</h4><p id="dli_01_0017__p98091683185">On the <span class="wintitle" id="dli_01_0017__wintitle262055291319"><b>SQL Jobs</b></span> page, you can click <span class="uicontrol" id="dli_01_0017__uicontrol1862065216131"><b>Terminate</b></span> in the <strong id="dli_01_0017__b8620135201310">Operation</strong> column to stop a submitting or running job.</p>
</div>
@ -90,9 +92,9 @@
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0017__row55162434145333"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p21307823145337"><strong id="dli_01_0017__b1281141224018">Data Format</strong></p>
<tbody><tr id="dli_01_0017__row55162434145333"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p21307823145337">Data Format</p>
</td>
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.8.7.2.3.1.2 "><p id="dli_01_0017__p48212085145337">Format of the exported query result file. Formats other than JSON will be supported in later versions.</p>
<td class="cellrowborder" valign="top" width="86.2%" headers="mcps1.3.8.7.2.3.1.2 "><p id="dli_01_0017__p48212085145337">Format of the exported query result file. This parameter can be set to <strong id="dli_01_0017__b0669616101720">json</strong> or <strong id="dli_01_0017__b1066921618179">csv</strong>.</p>
</td>
</tr>
<tr id="dli_01_0017__row33984858114535"><td class="cellrowborder" valign="top" width="13.8%" headers="mcps1.3.8.7.2.3.1.1 "><p id="dli_01_0017__p1310090114535"><strong id="dli_01_0017__b165065915405">Queues</strong></p>

14
docs/dli/umn/dli_01_0018.html
View File

@ -1,17 +1,21 @@
<a name="dli_01_0018"></a><a name="dli_01_0018"></a>
<h1 class="topictitle1">Enhanced Datasource Connection Permission Management</h1>
<div id="body0000001105035810"><div class="section" id="dli_01_0018__section208289518114"><h4 class="sectiontitle">Permission Management</h4><p id="dli_01_0018__p193191562115">You can grant or revoke permissions for enhanced datasource connections of other projects.</p>
<ul id="dli_01_0018__ul1876718716162"><li id="dli_01_0018__li222865395916">Authorization<ol id="dli_01_0018__ol328015169018"><li id="dli_01_0018__li5280181610014">Log in to the DLI management console, choose <strong id="dli_01_0018__b17958832174518">Datasource Connections</strong> and select the <strong id="dli_01_0018__b4470115894517">Enhanced</strong> tab, select a datasource connection, and choose <strong id="dli_01_0018__b5577192616461">More</strong> &gt; <strong id="dli_01_0018__b183395290462">Manage Permission</strong> in the <strong id="dli_01_0018__b47861731104614">Operation</strong> column. In the displayed <strong id="dli_01_0018__b15385115110815">Permissions</strong> dialog box, select <strong id="dli_01_0018__b13973145513814">Grant Permission</strong>, enter the project ID, and click <strong id="dli_01_0018__b1957418162912">OK</strong>.</li><li id="dli_01_0018__li291031715020">After a project is authorized, you can log in to the system as a user of the authorized project or switch to the corresponding project. In the <strong id="dli_01_0018__b10092937640030">Enhanced</strong> tab, you can view the authorized datasource connection and bind the created queue to the datasource connection. Cross-project datasource connections and routes can be created.</li></ol>
<h1 class="topictitle1">Enhanced Connection Permission Management</h1>
<div id="body0000001105035810"><div class="section" id="dli_01_0018__section38171015153615"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0018__p1792024325313">Enhanced connections support user authorization by project. After authorization, users in the project have the permission to perform operations on the enhanced connection, including viewing the enhanced connection, binding a created resource pool to the enhanced connection, and creating custom routes. In this way, the enhanced connection can be used across projects. Grant and revoke permissions to and from a user for an enhanced connection.</p>
<div class="note" id="dli_01_0018__note15501142236"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0018__ul17620456635"><li id="dli_01_0018__li179143815513">If the authorized projects belong to different users in the same region, you can use the user account of the authorized projects to log in.</li><li id="dli_01_0018__li206221564316">If the authorized projects belong to the same user in the same region, you can use the current account to switch to the corresponding project.</li></ul>
</div></div>
<p id="dli_01_0018__p1244910177274">For example, if project B needs to access the data source of project A, perform the following operations:</p>
</div>
<div class="section" id="dli_01_0018__section11934254125419"><h4 class="sectiontitle">Use Cases</h4><p id="dli_01_0018__p1244910177274">Project B needs to access the data source of project A. The operations are as follows:</p>
<ul id="dli_01_0018__ul69144842713"><li id="dli_01_0018__li19954415272">For Project A:<ol id="dli_01_0018__ol166981958182717"><li id="dli_01_0018__li1769820584278">Log in to DLI using the account of project A.</li><li id="dli_01_0018__li13781682299">Create an enhanced datasource connection <strong id="dli_01_0018__b7703175121916">ds</strong> in DLI based on the VPC information of the corresponding data source.</li><li id="dli_01_0018__li14201345202915">Grant project B the permission to access the enhanced datasource connection <strong id="dli_01_0018__b164661155191911">ds</strong>.</li></ol>
</li></ul>
<ul id="dli_01_0018__ul179078214395"><li id="dli_01_0018__li5908192193910">For Project B:<ol id="dli_01_0018__ol198631919113910"><li id="dli_01_0018__li7863191923911">Log in to DLI using the account of project B.</li><li id="dli_01_0018__li5851105920396">Bind the enhanced datasource connection <strong id="dli_01_0018__b8473166207">ds</strong> to a queue.</li><li id="dli_01_0018__li1550325212175">(Optional) Set host information and create a route.</li></ol>
</li></ul>
<p id="dli_01_0018__p126011320104116">After creating a VPC peering connection and route between the enhanced datasource connection of project A and the queue of project B, you can create a job in the queue of project B to access the data source of project A.</p>
</li><li id="dli_01_0018__li124815423164">Revoke: In the <strong id="dli_01_0018__b115071914162012">Manage Permissions</strong> dialog box, select <strong id="dli_01_0018__b1251321418207">Revoke Permission</strong> and select the ID of the project whose permissions need to be revoked.</li></ul>
</div>
<div class="section" id="dli_01_0018__section868620183613"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0018__ol194665011112"><li id="dli_01_0018__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0018__li918675917143">In the left navigation pane, choose <strong id="dli_01_0018__b114961232427">Datasource Connections</strong>.</li><li id="dli_01_0018__li392585072817">On the <strong id="dli_01_0018__b165204381424">Enhanced</strong> tab page displayed, locate the desired enhanced connection, click <strong id="dli_01_0018__b145215381125">More</strong> in the <strong id="dli_01_0018__b6521173813211">Operation</strong> column, and select <strong id="dli_01_0018__b052115387219">Manage Permission</strong>.<ul id="dli_01_0018__ul738113128302"><li id="dli_01_0018__li738131211308"><strong id="dli_01_0018__b123601733135">Granting permission</strong><ol type="a" id="dli_01_0018__ol162321854175518"><li id="dli_01_0018__li16324435150">In the <strong id="dli_01_0018__b622182918414">Permissions</strong> dialog box displayed, select <strong id="dli_01_0018__b766835217418">Grant Permission</strong> for <strong id="dli_01_0018__b09311323520">Set Permission</strong>.</li><li id="dli_01_0018__li20260172914910">Enter the project ID.</li><li id="dli_01_0018__li33942299478">Click <strong id="dli_01_0018__b643114417515">OK</strong> to grant the resource pool operation permission to the project.</li></ol>
</li><li id="dli_01_0018__li107318579335"><strong id="dli_01_0018__b9748165894114">Revoking permission</strong><ol type="a" id="dli_01_0018__ol27313571336"><li id="dli_01_0018__li105681553154018">In the <strong id="dli_01_0018__b594517311263">Permissions</strong> dialog box displayed, select <strong id="dli_01_0018__b129461831469">Revoke Permission</strong> for <strong id="dli_01_0018__b79461931065">Set Permission</strong>.</li><li id="dli_01_0018__li25686535401">Select a project ID.</li><li id="dli_01_0018__li13568145384020">Click <strong id="dli_01_0018__b683511710718">OK</strong> to revoke the resource pool operation permission from the specified project.</li></ol>
</li></ul>
</li></ol>
</div>
</div>
<div>

49
docs/dli/umn/dli_01_0019.html Normal file
View File

@ -0,0 +1,49 @@
<a name="dli_01_0019"></a><a name="dli_01_0019"></a>
<h1 class="topictitle1">Enhanced Datasource Connection Tag Management</h1>
<div id="body0000001151875549"><div class="section" id="dli_01_0019__section1670871310579"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0019__p985684415815">A tag is a key-value pair customized by users and used to identify cloud resources. It helps users to classify and search for cloud resources. A tag consists of a tag key and a tag value.</p>
<p id="dli_01_0019__p1650242964010">If you use tags in other cloud services, you are advised to create the same tag key-value pairs for cloud resources used by the same business to keep consistency.</p>
<p id="dli_01_0019__p16364141220591">DLI supports the following two types of tags:</p>
<ul id="dli_01_0019__ul75413231279"><li id="dli_01_0019__li1466720183510">Resource tags: non-global tags created on DLI.</li></ul>
<ul id="dli_01_0019__ul1577516103102"><li id="dli_01_0019__li14345142518119">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0019__p16703594315"><a name="dli_01_0019__li14345142518119"></a><a name="li14345142518119"></a></p>
</li></ul>
<p id="dli_01_0019__p12367184618163">DLI allows you to add, modify, or delete tags for datasource connections.</p>
</div>
<div class="section" id="dli_01_0019__section255181815714"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0019__ol12288184619571"><li id="dli_01_0019__li72887464571">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0019__b10897141315487">Datasource Connections</strong>.</li><li id="dli_01_0019__li02886464577">In the <strong id="dli_01_0019__b1854435122215">Operation</strong> column of the link, choose <strong id="dli_01_0019__b17238103118223">More</strong> &gt; <strong id="dli_01_0019__b6982627112219">Tags</strong>.</li><li id="dli_01_0019__li142881346185720">The tag management page is displayed, showing the tag information about the current connection.</li><li id="dli_01_0019__li152881946175715">Click <span class="uicontrol" id="dli_01_0019__uicontrol12584321205011"><b>Add/Edit Tag</b></span>. The <span class="wintitle" id="dli_01_0019__wintitle758412195016"><b>Add/Edit Tag</b></span> dialog is displayed. Add or edit tag keys and values and click <strong id="dli_01_0019__b5886358549">OK</strong>.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0019__table139874691610" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Tag parameters</caption><thead align="left"><tr id="dli_01_0019__row1640724610160"><th align="left" class="cellrowborder" valign="top" width="12.94%" id="mcps1.3.2.2.4.4.2.3.1.1"><p id="dli_01_0019__p17410246121616">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="87.06%" id="mcps1.3.2.2.4.4.2.3.1.2"><p id="dli_01_0019__p154131746131615">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0019__row13417154613164"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.2.2.4.4.2.3.1.1 "><p id="dli_01_0019__p74201346111616">Tag key</p>
</td>
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.2.2.4.4.2.3.1.2 "><p id="dli_01_0019__p642018464167">You can perform the following operations:</p>
<ul id="dli_01_0019__ul6423144611162"><li id="dli_01_0019__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0019__p12169132323510"><a name="dli_01_0019__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the <span class="parmname" id="dli_01_0019__parmname17849229544175"><b>Tag key</b></span> drop-down list. You can click <strong id="dli_01_0019__b39408883441711">View predefined tags</strong> to go to the <strong id="dli_01_0019__b119048434541711">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0019__b141119490641711">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
<p id="dli_01_0019__p1926211187356"></p>
</li></ul>
<ul id="dli_01_0019__ul643911462165"><li id="dli_01_0019__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0019__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0019__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
</td>
</tr>
<tr id="dli_01_0019__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.2.2.4.4.2.3.1.1 "><p id="dli_01_0019__p345210468163">Tag value</p>
</td>
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.2.2.4.4.2.3.1.2 "><p id="dli_01_0019__p1545619468165">You can perform the following operations:</p>
<ul id="dli_01_0019__ul1045720469162"><li id="dli_01_0019__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0019__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0019__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</li><li id="dli_01_0019__li82881746115717">Click <span class="uicontrol" id="dli_01_0019__uicontrol8832125062414"><b>OK</b></span>.</li><li id="dli_01_0019__li14288194613570">(Optional) To delete a tag, locate the row where the tag locates in the tag list and click <span class="uicontrol" id="dli_01_0019__uicontrol21461249175117"><b>Delete</b></span> in the <span class="parmname" id="dli_01_0019__parmname131466497518"><b>Operation</b></span> column to delete the tag.</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

50
docs/dli/umn/dli_01_0022.html Normal file
View File

@ -0,0 +1,50 @@
<a name="dli_01_0022"></a><a name="dli_01_0022"></a>
<h1 class="topictitle1">Managing Queue Tags</h1>
<div id="body0000001167728179"><div class="section" id="dli_01_0022__section570224151519"><h4 class="sectiontitle">Tag Management</h4><p id="dli_01_0022__p985684415815">A tag is a key-value pair that you can customize to identify cloud resources. It helps you to classify and search for cloud resources. A tag consists of a tag key and a tag value.</p>
<p id="dli_01_0022__p1650242964010">If you use tags in other cloud services, you are advised to create the same tag (key-value pairs) for cloud resources used by the same business to keep consistency.</p>
<p id="dli_01_0022__p16364141220591">DLI supports the following two types of tags:</p>
<ul id="dli_01_0022__ul75413231279"><li id="dli_01_0022__li1466720183510">Resource tags: non-global tags created on DLI</li></ul>
<ul id="dli_01_0022__ul1577516103102"><li id="dli_01_0022__li61271284311">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0022__p16703594315"><a name="dli_01_0022__li61271284311"></a><a name="li61271284311"></a></p>
</li></ul>
<p id="dli_01_0022__p12367184618163">DLI allows you to add, modify, or delete tags for queues.</p>
<ol id="dli_01_0022__ol113701546131616"><li id="dli_01_0022__li159548152199"><span>In the navigation pane of the DLI management console, choose <strong id="dli_01_0022__b1269494934416">Resources</strong> &gt; <span class="uicontrol" id="dli_01_0022__uicontrol369419499449"><b>Queue Management</b></span>.</span></li><li id="dli_01_0022__li49543159191"><span>In the <strong id="dli_01_0022__b18927195935615">Operation</strong> column of the queue, choose <strong id="dli_01_0022__b19331459165611">More</strong> &gt; <strong id="dli_01_0022__b7934105919563">Tags</strong>.</span></li><li id="dli_01_0022__li4382946161614"><span>The tag management page is displayed, showing the tag information about the current queue.</span></li><li id="dli_01_0022__li13387164631618"><span>Click <span class="uicontrol" id="dli_01_0022__uicontrol561019162567"><b>Add/Edit Tag</b></span> to switch to the <span class="wintitle" id="dli_01_0022__wintitle3616161605619"><b>Add/Edit Tag</b></span> dialog box. Enter a tag and a value, and click <strong id="dli_01_0022__b1945411675720">Add</strong>.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0022__table139874691610" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Tag parameters</caption><thead align="left"><tr id="dli_01_0022__row1640724610160"><th align="left" class="cellrowborder" valign="top" width="12.94%" id="mcps1.3.1.8.4.2.1.2.3.1.1"><p id="dli_01_0022__p17410246121616">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="87.06%" id="mcps1.3.1.8.4.2.1.2.3.1.2"><p id="dli_01_0022__p154131746131615">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0022__row13417154613164"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.1.8.4.2.1.2.3.1.1 "><p id="dli_01_0022__p74201346111616">Tag key</p>
</td>
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.1.8.4.2.1.2.3.1.2 "><p id="dli_01_0022__p642018464167">You can specify the tag key in either of the following ways:</p>
<ul id="dli_01_0022__ul6423144611162"><li id="dli_01_0022__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0022__p12169132323510"><a name="dli_01_0022__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the <span class="parmname" id="dli_01_0022__parmname672234855114"><b>Tag key</b></span> drop-down list. You can click <strong id="dli_01_0022__b1270845085112">View predefined tags</strong> to go to the <strong id="dli_01_0022__b170955055115">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0022__b157091850115120">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
<p id="dli_01_0022__p1926211187356"></p>
</li></ul>
<ul id="dli_01_0022__ul643911462165"><li id="dli_01_0022__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0022__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0022__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
</td>
</tr>
<tr id="dli_01_0022__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.1.8.4.2.1.2.3.1.1 "><p id="dli_01_0022__p345210468163">Tag value</p>
</td>
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.1.8.4.2.1.2.3.1.2 "><p id="dli_01_0022__p1545619468165">You can specify the tag value in either of the following ways:</p>
<ul id="dli_01_0022__ul1045720469162"><li id="dli_01_0022__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0022__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0022__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
<div class="note" id="dli_01_0022__note647119469162"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0022__dli_01_0363_ul1830018521911"><li id="dli_01_0022__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0022__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0022__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
</p></li><li id="dli_01_0022__li5488164614169"><span>Click <span class="uicontrol" id="dli_01_0022__uicontrol13975204518575"><b>OK</b></span>.</span></li><li id="dli_01_0022__li6498346161614"><span>(Optional) To delete a tag, locate the row where the tag resides in the tag list and click <span class="uicontrol" id="dli_01_0022__uicontrol29481049155719"><b>Delete</b></span> in the <span class="parmname" id="dli_01_0022__parmname179481497573"><b>Operation</b></span> column to delete the tag.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0012.html">Queue Management</a></div>
</div>
</div>

77
docs/dli/umn/dli_01_0228.html
View File

File diff suppressed because it is too large Load Diff

16
docs/dli/umn/dli_01_0320.html
View File

@ -2,11 +2,11 @@
<h1 class="topictitle1">SQL Editor</h1>
<div id="body1527736306892"><div class="section" id="dli_01_0320__section61610192582"><h4 class="sectiontitle">Introduction</h4><p id="dli_01_0320__p113718292584">You can edit and run SQL statements in the SQL job editor to execute data query.</p>
<p id="dli_01_0320__p8701547290">DLI supports SQL 2003 and complies with Spark SQL.</p>
<p id="dli_01_0320__p1288719211593">To access the SQL editor, click <strong id="dli_01_0320__b62764558193">SQL Editor</strong> in the navigation pane on the left of the <strong id="dli_01_0320__b7276125516192">Overview</strong> page, or click <strong id="dli_01_0320__b427685512194">Create Job</strong> in the upper right corner of the <strong id="dli_01_0320__b18276185515193">SQL Jobs</strong> pane. The <strong id="dli_01_0320__b1327695516198">SQL Editor</strong> page is displayed.</p>
<p id="dli_01_0320__p1280717219552">The editor supports SQL:2003 and is compatible with Spark SQL. For details about the syntax, see .</p>
<p id="dli_01_0320__p8701547290">To access the SQL editor, choose <strong id="dli_01_0320__b497417236202">SQL Editor</strong> in the left navigation pane of the DLI console, or click <strong id="dli_01_0320__b10977923112010">Create Job</strong> in the upper right corner of the <strong id="dli_01_0320__b8448141619225">Job Management</strong> &gt; <strong id="dli_01_0320__b9977132352019">SQL Jobs</strong> page.</p>
<p id="dli_01_0320__p149006399215">This topic describes the main functions of the SQL editor.</p>
</div>
<div class="section" id="dli_01_0320__section481537195816"><h4 class="sectiontitle">Notes</h4><ul id="dli_01_0320__ul7477016252"><li id="dli_01_0320__li14774152514">When you go to the SQL editor page, a message will be displayed, indicating that a temporary DLI data bucket will be created. The created bucket is used to store temporary data generated by DLI, such as job logs.<p id="dli_01_0320__p140716192591"><a name="dli_01_0320__li14774152514"></a><a name="li14774152514"></a>You cannot view job logs if you choose not to create the bucket. The bucket name will be set by the system.</p>
<div class="section" id="dli_01_0320__section481537195816"><h4 class="sectiontitle">Notes</h4><ul id="dli_01_0320__ul7477016252"><li id="dli_01_0320__li14774152514">If you access the SQL editor for the first time, the system prompts you to set a bucket for DLI jobs. The created bucket is used to store temporary data generated by DLI, such as job logs.<p id="dli_01_0320__p140716192591"><a name="dli_01_0320__li14774152514"></a><a name="li14774152514"></a>You cannot view job logs if you choose not to create the bucket. The bucket name will be set by the system.</p>
<p id="dli_01_0320__p58918555015">On the OBS console, you can configure lifecycle rules for a bucket to periodically delete objects in it or change object storage classes.</p>
</li></ul>
<ul id="dli_01_0320__ul17140143842412"><li id="dli_01_0320__li13836162923010">SQL statements can be executed in batches on the SQL editor page.</li></ul>
@ -54,7 +54,7 @@
<div class="p" id="dli_01_0320__p191534517811">
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0320__table18913103220552" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Components of the SQL job editing window</caption><thead align="left"><tr id="dli_01_0320__row169141932105516"><th align="left" class="cellrowborder" valign="top" width="7.920792079207921%" id="mcps1.3.4.4.1.2.4.1.1"><p id="dli_01_0320__p233145451119">No.</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="14.85148514851485%" id="mcps1.3.4.4.1.2.4.1.2"><p id="dli_01_0320__p660634117106">Button</p>
<th align="left" class="cellrowborder" valign="top" width="14.85148514851485%" id="mcps1.3.4.4.1.2.4.1.2"><p id="dli_01_0320__p660634117106">Button &amp; Drop-Down List</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="77.22772277227723%" id="mcps1.3.4.4.1.2.4.1.3"><p id="dli_01_0320__p1161019414106">Description</p>
</th>
@ -155,8 +155,8 @@
</div>
</div>
</div>
<div class="section" id="dli_01_0320__section1349425519436"><h4 class="sectiontitle"><strong id="dli_01_0320__b11685181916523">Execution Queries</strong> and <strong id="dli_01_0320__b108762585214">View Result</strong></h4><p id="dli_01_0320__p20363154734312">After the SQL job is executed, you can view the execution history and result in the lower part of the editing area.</p>
<ul id="dli_01_0320__ul9942194944518"><li id="dli_01_0320__li994234910455"><strong id="dli_01_0320__b1811192914339">Executed Queries</strong><p id="dli_01_0320__p62655503226">You can filter the execution history in the following ways:</p>
<div class="section" id="dli_01_0320__section1349425519436"><h4 class="sectiontitle">Executed Queries (Last Day) and View Result</h4><p id="dli_01_0320__p20363154734312">After the SQL job is executed, you can view the execution history and result in the lower part of the editing area.</p>
<ul id="dli_01_0320__ul9942194944518"><li id="dli_01_0320__li994234910455"><strong id="dli_01_0320__b261218783117">Executed Queries (Last Day)</strong><p id="dli_01_0320__p62655503226">You can filter the execution history in the following ways:</p>
<ul id="dli_01_0320__ul1126535015221"><li id="dli_01_0320__li1026514509229">In the search box in the upper right corner of the <strong id="dli_01_0320__b161619337392">Executed Queries (Last Day)</strong> pane, select a queue name or enter an execution statement in the search box.</li><li id="dli_01_0320__li8265135002214">In the list, click the icon next to <strong id="dli_01_0320__b810817241338">Created</strong> and choose <strong id="dli_01_0320__b5225521034">Ascending</strong> or <strong id="dli_01_0320__b108871254638">Descending</strong>.</li><li id="dli_01_0320__li20265750182212">Select a job status from the <strong id="dli_01_0320__b15673185753915">Status</strong> list.</li></ul>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0320__table56651456181516" frame="border" border="1" rules="all"><caption><b>Table 4 </b>Area description</caption><thead align="left"><tr id="dli_01_0320__row6664356161512"><th align="left" class="cellrowborder" valign="top" width="22.84%" id="mcps1.3.5.3.1.4.2.3.1.1"><p id="dli_01_0320__p176641561152">Area</p>
@ -217,14 +217,14 @@
</table>
</div>
</li></ul>
<div class="section" id="dli_01_0320__en-us_topic_0093946815_section6030699152035"><h4 class="sectiontitle">SQL Query Procedure</h4><ol id="dli_01_0320__ol110111316715"><li id="dli_01_0320__li2070131479">Log in to the Data Lake Insight management console, choose <strong id="dli_01_0320__b1342994619436">Job Management</strong> &gt; <strong id="dli_01_0320__b615383914816">SQL Jobs</strong>. In the displayed page, click <strong id="dli_01_0320__b109151915398">Create Job</strong> to go to the <span class="wintitle" id="dli_01_0320__wintitle13834185618499"><b>SQL Editor</b></span> page.<div class="note" id="dli_01_0320__note119573472206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0320__p5958124710203">After you enter the <span class="wintitle" id="dli_01_0320__wintitle152921635144016"><b>SQL Editor</b></span> page, the system prompts you to create a temporary OBS bucket to store temporary data generated by DLI, such as job logs. You cannot view job logs if you choose not to create it. Click <strong id="dli_01_0320__b7878145174015">OK</strong>. The system displays a message indicating that the temporary bucket is created successfully.</p>
<div class="section" id="dli_01_0320__en-us_topic_0093946815_section6030699152035"><h4 class="sectiontitle">SQL Query Procedure</h4><ol id="dli_01_0320__ol110111316715"><li id="dli_01_0320__li2070131479">Log in to the DLI management console. On the page displayed, choose <strong id="dli_01_0320__b63618581982">Job Management</strong> &gt; <strong id="dli_01_0320__b74187252918">SQL Jobs</strong>. On the page displayed, click <strong id="dli_01_0320__b59156304102">Create Job</strong>.<div class="note" id="dli_01_0320__note119573472206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0320__p5958124710203">On the SQL editor page, the system prompts you to create an OBS bucket to store temporary data generated by DLI jobs. In the <strong id="dli_01_0320__b291314330127">Set Job Bucket</strong> dialog box, click <strong id="dli_01_0320__b834914436125">Setting</strong>. On the page displayed, click the edit button in the upper right corner of the job bucket card. In the <strong id="dli_01_0320__b138913547131">Set Job Bucket</strong> dialog box displayed, enter the job bucket path and click <strong id="dli_01_0320__b61474198147">OK</strong>.</p>
</div></div>
</li><li id="dli_01_0320__li11718136711">Select a queue from the queue list in the upper left corner of the SQL job editing window. For details about how to create a queue, see <a href="dli_01_0363.html">Creating a Queue</a>.</li><li id="dli_01_0320__li813817834515">In the upper right corner of the SQL job editing window, select a database, for example, <span class="parmvalue" id="dli_01_0320__parmvalue15915351115713"><b>qw</b></span>, from the <strong id="dli_01_0320__b237816275810">Databases</strong> drop-down list.</li><li id="dli_01_0320__li38121318715">Create a table, for example, <strong id="dli_01_0320__b104711617155817">qw</strong>. For details about how to create a database and table, see <a href="dli_01_0005.html">Creating a Database or a Table</a>.</li><li id="dli_01_0320__li11683162919577">In the SQL job editing window, enter the following SQL statement:<div class="codecoloring" codetype="Sql" id="dli_01_0320__screen109547551261"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">qw</span><span class="p">.</span><span class="n">qw</span><span class="w"> </span><span class="k">LIMIT</span><span class="w"> </span><span class="mi">10</span><span class="p">;</span>
</pre></div></td></tr></table></div>
</div>
<p id="dli_01_0320__p96831529105716">Alternatively, you can double-click the table name <strong id="dli_01_0320__b17891859173716">qw</strong>. The query statement is automatically entered in the SQL job editing window.</p>
</li><li id="dli_01_0320__li492135719">On top of the editing window, click <strong id="dli_01_0320__b26243389451">More</strong> &gt; <span class="uicontrol" id="dli_01_0320__uicontrol58893394529"><b>Verify Syntax</b></span> to check whether the SQL statement is correct.<ol type="a" id="dli_01_0320__ol1395130715"><li id="dli_01_0320__li1498131370">If the verification fails, check the SQL statement syntax by referring to <em id="dli_01_0320__i62311625184919">Data Lake Insight SQL Syntax Reference</em>.</li><li id="dli_01_0320__li09121319713">If the syntax verification is successful, click <strong id="dli_01_0320__b238821051610">Execute</strong>. Read and agree to the privacy agreement. Click <strong id="dli_01_0320__b386161413163">OK</strong> to execute the SQL statement.</li><li id="dli_01_0320__li4991320712">After the execution is complete, you can view the execution result in the area under the SQL job editing window.</li></ol>
</li><li id="dli_01_0320__li492135719">On top of the editing window, click <strong id="dli_01_0320__b26243389451">More</strong> &gt; <span class="uicontrol" id="dli_01_0320__uicontrol58893394529"><b>Verify Syntax</b></span> to check whether the SQL statement is correct.<ol type="a" id="dli_01_0320__ol1395130715"><li id="dli_01_0320__li153171751102318">If the verification fails, check the SQL statement syntax by referring to <em id="dli_01_0320__i5105915141610">Data Lake Insight SQL Syntax Reference</em>.</li><li id="dli_01_0320__li09121319713">If the syntax verification is successful, click <strong id="dli_01_0320__b238821051610">Execute</strong>. Read and agree to the privacy agreement. Click <strong id="dli_01_0320__b386161413163">OK</strong> to execute the SQL statement.</li><li id="dli_01_0320__li4991320712">After the execution is complete, you can view the execution result in the area under the SQL job editing window.</li></ol>
</li><li id="dli_01_0320__li3553502386">(Optional) A maximum of 1000 records can be displayed in the query result on the current console. To view more or all data, click <span><img id="dli_01_0320__image1255155017385" src="en-us_image_0000001209489750.png"></span> to export the data to OBS.</li><li id="dli_01_0320__li12101713274">(Optional) In the <strong id="dli_01_0320__b1191025764012">View Result</strong> tab, click <span><img id="dli_01_0320__image13139111555519" src="en-us_image_0000001254369651.png"></span> to display the query result in a chart. Click <span><img id="dli_01_0320__image104587194711" src="en-us_image_0000001265889586.png"></span> to switch back to the table view.<div class="note" id="dli_01_0320__note111071319716"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0320__ul71014131377"><li id="dli_01_0320__li21015132715">If no column of the numeric type is displayed in the execution result, the result cannot be represented in charts.</li><li id="dli_01_0320__li131014132072">You can view the data in a bar chart, line chart, or fan chart.</li><li id="dli_01_0320__li191031315713">In the bar chart and line chart, the X axis can be any column, while the Y axis can only be columns of the numeric type. The fan chart displays the corresponding legends and indicators.</li></ul>
</div></div>
</li></ol>

18
docs/dli/umn/dli_01_0363.html
View File

@ -5,7 +5,7 @@
<div class="note" id="dli_01_0363__note1293204515206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0363__ul17341756521"><li id="dli_01_0363__li1174985419502">If you use a sub-account to create a queue for the first time, log in to the DLI management console using the main account and keep records in the DLI database before creating a queue.</li><li id="dli_01_0363__li1373411525216">It takes 6 to 10 minutes for a job running on a new queue for the first time.</li><li id="dli_01_0363__li11343161015521">After a queue is created, if no job is run within one hour, the system releases the queue.</li></ul>
</div></div>
<div class="section" id="dli_01_0363__section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0363__ol24716195296"><li id="dli_01_0363__li947220195291">You can create a queue on the <span class="wintitle" id="dli_01_0363__wintitle686912613315"><b>Overview</b></span>, <span class="wintitle" id="dli_01_0363__wintitle20869192623118"><b>SQL Editor</b></span>, or <span class="wintitle" id="dli_01_0363__wintitle18870626173120"><b>Queue Management</b></span> page.<ul id="dli_01_0363__ul435871517496"><li id="dli_01_0363__li1359201518491">In the upper right corner of the <strong id="dli_01_0363__b3686177172119">Overview</strong> page, click Create Queue.</li><li id="dli_01_0363__li8634112214911">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle1782046172416"><b>Queue Management</b></span> page:<ol type="a" id="dli_01_0363__ol1592205194915"><li id="dli_01_0363__li1059116511492">In the navigation pane of the DLI management console, choose <strong id="dli_01_0363__b15623755102515">Resources</strong> &gt;<span class="uicontrol" id="dli_01_0363__uicontrol1712082421418"><b>Queue Management</b></span>.</li><li id="dli_01_0363__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0363__wintitle1629419173214"><b>Queue Management</b></span> page, click <strong id="dli_01_0363__b152951717182111">Create Queue</strong> to create a queue.</li></ol>
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane of the DLI management console, click <span class="uicontrol" id="dli_01_0363__uicontrol1996404019456"><b>SQL Editor</b></span>.</li><li id="dli_01_0363__li1864613225498">On the left pane of the displayed <strong id="dli_01_0363__b6128105210351">SQL Editor</strong> page, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> to the right of <strong id="dli_01_0363__b135291883619">Queues</strong>.</li></ol>
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane of the DLI management console, click <span class="uicontrol" id="dli_01_0363__uicontrol1996404019456"><b>SQL Editor</b></span>.</li><li id="dli_01_0363__li1864613225498">Click <strong id="dli_01_0363__b39030518577">Queues</strong>. On the tab page displayed, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> on the right to create a queue.</li></ol>
</li></ul>
</li><li id="dli_01_0363__li1472111916293">In the displayed Create Queue dialog box, set related parameters by referring to <a href="#dli_01_0363__table17301125219910">Table 1</a>.<div class="p" id="dli_01_0363__p206522012141215">
<div class="tablenoborder"><a name="dli_01_0363__table17301125219910"></a><a name="table17301125219910"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0363__table17301125219910" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="dli_01_0363__row112973522913"><th align="left" class="cellrowborder" valign="top" width="14.77%" id="mcps1.3.3.2.2.2.1.2.3.1.1"><p id="dli_01_0363__p17297145215918">Parameter</p>
@ -24,7 +24,7 @@
</tr>
<tr id="dli_01_0363__row82981752094"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p629715213917">Type</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><ul id="dli_01_0363__ul1029875217914"><li id="dli_01_0363__li1229745218914"><strong id="dli_01_0363__b3471630195419">For SQL</strong>: compute resources used for SQL jobs.</li><li id="dli_01_0363__li1829818521296"><strong id="dli_01_0363__b8738194132314">For general purpose</strong>: compute resources used for Spark and Flink jobs.</li><li id="dli_01_0363__li1970512436542"><div class="note" id="dli_01_0363__note1829815214917"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p329815212917">In <strong id="dli_01_0363__b114679913236">Dedicated Resource Mode</strong>, you can create enhanced datasource connections. </p>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><ul id="dli_01_0363__ul1029875217914"><li id="dli_01_0363__li1229745218914"><strong id="dli_01_0363__b3471630195419">For SQL</strong>: compute resources used for SQL jobs.</li><li id="dli_01_0363__li1829818521296"><strong id="dli_01_0363__b8738194132314">For general purpose</strong>: compute resources used for Spark and Flink jobs.<div class="note" id="dli_01_0363__note17601813184718"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1440855224617">Selecting <strong id="dli_01_0363__b4152202311213">Dedicated Resource Mode</strong> enables you to create a dedicated queue. Enhanced datasource connections can only be created for dedicated queues. </p>
</div></div>
</li></ul>
</td>
@ -37,7 +37,7 @@
</tr>
<tr id="dli_01_0363__row62996521099"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p1129916526920">Description</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0363__p192991252199">Description of the queue to be created. The length of the queue name cannot exceed 256 characters.</p>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0363__p192991252199">Description of the queue to be created. The description can contain a maximum of 128 characters.</p>
</td>
</tr>
<tr id="dli_01_0363__row1530012524917"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p3299452791">Advanced Settings</p>
@ -48,6 +48,18 @@
</div>
</td>
</tr>
<tr id="dli_01_0363__row113007527911"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p13300252599">Tag</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0363__p7662154145213">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
<div class="note" id="dli_01_0363__note15300105218914"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0363__ul1830018521911"><li id="dli_01_0363__li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0363__li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0363__li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
<ul id="dli_01_0363__ul1300052697"><li id="dli_01_0363__li5300952598">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0363__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0363__b544594615499">_sys_</strong>.</p>
</div></div>
</li><li id="dli_01_0363__li730019524916">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0363__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>

33
docs/dli/umn/dli_01_0367.html
View File

@ -7,38 +7,51 @@
<div class="section" id="dli_01_0367__section18887174943920"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0367__p420613556395">All software packages must be uploaded to OBS for storage in advance.</p>
</div>
<div class="section" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0367__ol172795412248"><li id="dli_01_0367__li0727165414248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0367__uicontrol155446476912"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0367__uicontrol1252865218920"><b>Package Management</b></span>.</li><li id="dli_01_0367__li13727135411249">On the <span class="wintitle" id="dli_01_0367__wintitle196674031013"><b>Package Management</b></span> page, click <strong id="dli_01_0367__b14725441019">Create</strong> in the upper right corner to create a package.</li><li id="dli_01_0367__li10728165402418">In the displayed <span class="wintitle" id="dli_01_0367__wintitle11408195612575"><b>Create Package</b></span> dialog box, set related parameters by referring to <a href="#dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536">Table 1</a>.
<div class="tablenoborder"><a name="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><a name="en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row15177266171536"><th align="left" class="cellrowborder" valign="top" width="17.05%" id="mcps1.3.4.2.3.3.2.3.1.1"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p5976489517160">Parameter</p>
<div class="tablenoborder"><a name="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><a name="en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row15177266171536"><th align="left" class="cellrowborder" valign="top" width="16.32%" id="mcps1.3.4.2.3.3.2.3.1.1"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p5976489517160">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="82.95%" id="mcps1.3.4.2.3.3.2.3.1.2"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p911830717160">Description</p>
<th align="left" class="cellrowborder" valign="top" width="83.67999999999999%" id="mcps1.3.4.2.3.3.2.3.1.2"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p911830717160">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0367__row0411835105712"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p25317410132926">Package Type</p>
<tbody><tr id="dli_01_0367__row0411835105712"><td class="cellrowborder" valign="top" width="16.32%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p25317410132926">Package Type</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p37444329132926">The following package types are supported:</p>
<td class="cellrowborder" valign="top" width="83.67999999999999%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p37444329132926">The following package types are supported:</p>
<ul id="dli_01_0367__en-us_topic_0122016946_ul19355124635412"><li id="dli_01_0367__en-us_topic_0122016946_li173552046135410">JAR: JAR file</li><li id="dli_01_0367__en-us_topic_0122016946_li1035554615417">PyFile: User Python file</li><li id="dli_01_0367__en-us_topic_0122016946_li73551146195414">File: User file</li></ul>
</td>
</tr>
<tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row56284350171536"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p4555561017160">Package File Path</p>
<tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row56284350171536"><td class="cellrowborder" valign="top" width="16.32%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p4555561017160">Package File Path</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__en-us_topic_0122016946_p12672162955118">Select the OBS path of the corresponding packages.</p>
<td class="cellrowborder" valign="top" width="83.67999999999999%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__en-us_topic_0122016946_p12672162955118">Select the OBS path of the corresponding packages.</p>
<div class="note" id="dli_01_0367__note1287585810107"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0367__ul04810218124"><li id="dli_01_0367__li2482142101215">The packages must be uploaded to OBS for storage in advance.</li><li id="dli_01_0367__li1748213216127">Only files can be selected.</li></ul>
</div></div>
</td>
</tr>
<tr id="dli_01_0367__row415617241883"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p715712241188">Group Policy</p>
<tr id="dli_01_0367__row415617241883"><td class="cellrowborder" valign="top" width="16.32%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p715712241188">Group Policy</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__p515762417817">You can select <strong id="dli_01_0367__b1860445618266">Use existing group</strong>, <strong id="dli_01_0367__b2902121152716">Use new group</strong>, or <strong id="dli_01_0367__b78942072711">No grouping</strong>.</p>
<td class="cellrowborder" valign="top" width="83.67999999999999%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__p515762417817">You can select <strong id="dli_01_0367__b1860445618266">Use existing group</strong>, <strong id="dli_01_0367__b2902121152716">Use new group</strong>, or <strong id="dli_01_0367__b78942072711">No grouping</strong>.</p>
</td>
</tr>
<tr id="dli_01_0367__row740151051019"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p14131010102">Group Name</p>
<tr id="dli_01_0367__row740151051019"><td class="cellrowborder" valign="top" width="16.32%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p14131010102">Group Name</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><ul id="dli_01_0367__ul17658122119107"><li id="dli_01_0367__li102146242916"><strong id="dli_01_0367__b796141762818">Use existing group</strong>: Select an existing group.</li><li id="dli_01_0367__li11658221171019"><strong id="dli_01_0367__b1172465713287">Use new group</strong>: Enter a custom group name.</li><li id="dli_01_0367__li3756181791116"><strong id="dli_01_0367__b167792018299">No grouping</strong>: No need to select or enter a group name.</li></ul>
<td class="cellrowborder" valign="top" width="83.67999999999999%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><ul id="dli_01_0367__ul17658122119107"><li id="dli_01_0367__li102146242916"><strong id="dli_01_0367__b796141762818">Use existing group</strong>: Select an existing group.</li><li id="dli_01_0367__li11658221171019"><strong id="dli_01_0367__b1172465713287">Use new group</strong>: Enter a custom group name.</li><li id="dli_01_0367__li3756181791116"><strong id="dli_01_0367__b167792018299">No grouping</strong>: No need to select or enter a group name.</li></ul>
<div class="note" id="dli_01_0367__note459512341000"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0367__ul147622187210"><li id="dli_01_0367__li5762181811211">If you select a group, the permission management refers to the permissions of the corresponding package group.</li><li id="dli_01_0367__li1376219183220">If no group is selected, the permission management refers to the permissions of the corresponding package.</li></ul>
<p id="dli_01_0367__p17681040525">For details about how to manage permissions on package groups and packages, see <a href="dli_01_0477.html">Managing Permissions on Packages and Package Groups</a>.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0367__row016422516486"><td class="cellrowborder" valign="top" width="16.32%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p26171435204818">Tag</p>
</td>
<td class="cellrowborder" valign="top" width="83.67999999999999%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
<div class="note" id="dli_01_0367__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0367__dli_01_0363_ul1830018521911"><li id="dli_01_0367__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0367__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0367__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
<ul id="dli_01_0367__ul6617123554815"><li id="dli_01_0367__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0367__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0367__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
<ul id="dli_01_0367__ul16911451899"><li id="dli_01_0367__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0367__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>

8
docs/dli/umn/dli_01_0375.html
View File

@ -1,7 +1,7 @@
<a name="dli_01_0375"></a><a name="dli_01_0375"></a>
<h1 class="topictitle1">Creating and Submitting a Spark Jar Job</h1>
<div id="body1531966492787"><div class="section" id="dli_01_0375__section18602102002716"><h4 class="sectiontitle">Scenarios</h4><p id="dli_01_0375__p2824922152712">DLI can query data stored in OBS. This section describes how to use a Spark Jar job on DLI to query OBS data in real time.</p>
<div id="body1531966492787"><div class="section" id="dli_01_0375__section18602102002716"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0375__p2824922152712">DLI can query data stored in OBS. This section describes how to use a Spark Jar job on DLI to query OBS data in real time.</p>
</div>
<div class="section" id="dli_01_0375__section14374132910279"><h4 class="sectiontitle">Procedure</h4><p id="dli_01_0375__p934442315541">You can use DLI to submit Spark jobs for real-time computing. The general procedure is as follows:</p>
<p id="dli_01_0375__p5746512114914"><a href="#dli_01_0375__section10891114913473">Step 1: Upload Data to OBS</a></p>
@ -9,19 +9,19 @@
<p id="dli_01_0375__p13369418124916"><a href="#dli_01_0375__section21433273112656">Step 3: Create a Package</a></p>
<p id="dli_01_0375__p132924161969"><a href="#dli_01_0375__section21590507141153">Step 4: Submit a Spark Job</a></p>
</div>
<div class="section" id="dli_01_0375__section10891114913473"><a name="dli_01_0375__section10891114913473"></a><a name="section10891114913473"></a><h4 class="sectiontitle">Step 1: Upload Data to OBS</h4><p id="dli_01_0375__p551741275618">Write a Spark Jar job program , and compile and package it as <strong id="dli_01_0375__b281881725913">spark-examples.jar</strong>. Perform the following steps to submit the job:</p>
<div class="section" id="dli_01_0375__section10891114913473"><a name="dli_01_0375__section10891114913473"></a><a name="section10891114913473"></a><h4 class="sectiontitle">Step 1: Upload Data to OBS</h4><p id="dli_01_0375__p551741275618">Write a Spark Jar job program, and compile and pack it as <strong id="dli_01_0375__b281881725913">spark-examples.jar</strong>. Perform the following steps to submit the job:</p>
<p id="dli_01_0375__p45348185145915">Before submitting Spark Jar jobs, upload data files to OBS.</p>
<ol id="dli_01_0375__ol18891449164710"><li id="dli_01_0375__li12281133046">Log in to the DLI console.</li><li id="dli_01_0375__li18770142812720">In the service list, click <strong id="dli_01_0375__b912513195911">Object Storage Service</strong> under <strong id="dli_01_0375__b8125151910912">Storage</strong>. The OBS console page is displayed.</li><li id="dli_01_0375__li1385211252717">Create a bucket. In this example, name it <strong id="dli_01_0375__b41010361919">dli-test-obs01</strong>.<ol type="a" id="dli_01_0375__ol182612310711"><li id="dli_01_0375__li462934116719">Click <span class="uicontrol" id="dli_01_0375__uicontrol3515111010568"><b>Create Bucket</b></span>.</li><li id="dli_01_0375__li183491949872">On the displayed <strong id="dli_01_0375__b1736513156263">Create Bucket</strong> page, enter the <strong id="dli_01_0375__b153711815192617">Bucket Name</strong>. Retain the default values for other parameters or set them as required.<div class="note" id="dli_01_0375__note1145175833410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0375__p7146205812341">When creating an OBS bucket, you must select the same region as the DLI management console.</p>
</div></div>
</li><li id="dli_01_0375__li1089354984713">Click <strong id="dli_01_0375__b55859547573">Create Now</strong>.</li></ol>
</li><li id="dli_01_0375__li13893749154715">Click <strong id="dli_01_0375__b198121931182012">dli-test-obs01</strong> to switch to the <strong id="dli_01_0375__b168121831102014">Overview</strong> page.</li><li id="dli_01_0375__li1129115358610">From the left navigation tree, click <strong id="dli_01_0375__b17105173492019">Objects</strong>. Click <strong id="dli_01_0375__b310514347204">Upload Object</strong>. In the displayed dialog box, drag files or folders to upload or add file to the file upload box, for example, <span class="parmname" id="dli_01_0375__parmname477111272516"><b>spark-examples.jar</b></span>. Then, click <span class="uicontrol" id="dli_01_0375__uicontrol1160514822611"><b>Upload</b></span>.<p id="dli_01_0375__p53510371013">After the file is uploaded successfully, the file path is <span class="filepath" id="dli_01_0375__filepath8679102112119"><b>obs://dli-test-obs01/spark-examples.jar</b></span>.</p>
</li><li id="dli_01_0375__li13893749154715">Click <strong id="dli_01_0375__b198121931182012">dli-test-obs01</strong> to switch to the <strong id="dli_01_0375__b168121831102014">Objects</strong> tab page.</li><li id="dli_01_0375__li1129115358610">Click <strong id="dli_01_0375__b310514347204">Upload Object</strong>. In the dialog box displayed, drag or add files or folders, for example, <span class="parmname" id="dli_01_0375__parmname477111272516"><b>spark-examples.jar</b></span>, to the upload area. Then, click <span class="uicontrol" id="dli_01_0375__uicontrol1160514822611"><b>Upload</b></span>.<p id="dli_01_0375__p53510371013">After the file is uploaded successfully, the file path is <span class="filepath" id="dli_01_0375__filepath8679102112119"><b>obs://dli-test-obs01/spark-examples.jar</b></span>.</p>
<div class="note" id="dli_01_0375__note121534311285"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0375__ul12727649112820"><li id="dli_01_0375__li1990710154514">For more information about OBS operations, see the <em id="dli_01_0375__i1410111914262">Object Storage Service Console Operation Guide</em>.</li><li id="dli_01_0375__li1090710151850">For more information about the tool, see the <em id="dli_01_0375__i1218132242612">OBS Tool Guide</em>.</li><li id="dli_01_0375__li8907315659">You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.<ul id="dli_01_0375__ul1195116186510"><li id="dli_01_0375__li182202533286">OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS. You are advised to use this tool to create buckets or upload objects.</li></ul>
</li></ul>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0375__section122981023152710"><a name="dli_01_0375__section122981023152710"></a><a name="section122981023152710"></a><h4 class="sectiontitle">Step 2: Create a Queue</h4><p id="dli_01_0375__p5551648414">If you submit a Spark job for the first time, you need to create a queue first. For example, create a queue named <strong id="dli_01_0375__b18940163725910">sparktest</strong> and set <strong id="dli_01_0375__b9941203755913">Queue Type</strong> to <strong id="dli_01_0375__b07631213164717">General Queue</strong>.</p>
<ol id="dli_01_0375__ol1977217571226"><li id="dli_01_0375__li13332820164119">Log in to the DLI management console.</li><li id="dli_01_0375__li1059116511492">In the navigation pane of the DLI management console, choose <span class="uicontrol" id="dli_01_0375__uicontrol510284210593"><b>Queue Management</b></span>.</li><li id="dli_01_0375__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0375__wintitle4186197182915"><b>Queue Management</b></span> page, click <strong id="dli_01_0375__b16186107192918">Create Queue</strong> to create a queue.</li><li id="dli_01_0375__li550904418312">Create a queue, name it <strong id="dli_01_0375__b4533124655914">sparktest</strong>, and set the queue usage to for general purpose. For details, see Creating a Queue.<p id="dli_01_0375__p86371522489"></p>
<ol id="dli_01_0375__ol1977217571226"><li id="dli_01_0375__li13332820164119">Log in to the DLI management console.</li><li id="dli_01_0375__li1059116511492">In the navigation pane of the DLI management console, choose <strong id="dli_01_0375__b1423182818139">Resources</strong> &gt; <strong id="dli_01_0375__b7476115621311">Queue Management</strong>.</li><li id="dli_01_0375__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0375__wintitle4186197182915"><b>Queue Management</b></span> page, click <strong id="dli_01_0375__b16186107192918">Create Queue</strong> to create a queue.</li><li id="dli_01_0375__li550904418312">Create a queue, name it <strong id="dli_01_0375__b4533124655914">sparktest</strong>, and set the queue usage to for general purpose. For details, see Creating a Queue.<p id="dli_01_0375__p86371522489"></p>
</li><li id="dli_01_0375__li647261910292">Click <span class="uicontrol" id="dli_01_0375__uicontrol338141308"><b>Create Now</b></span> to create a queue.</li></ol>
</div>
<div class="section" id="dli_01_0375__section21433273112656"><a name="dli_01_0375__section21433273112656"></a><a name="section21433273112656"></a><h4 class="sectiontitle">Step 3: Create a Package</h4><p id="dli_01_0375__p498774501214">Before submitting a Spark job, you need to create a package, for example, <strong id="dli_01_0375__b17591192235312">spark-examples.jar</strong>.</p>

2
docs/dli/umn/dli_01_0377.html
View File

@ -3,7 +3,7 @@
<h1 class="topictitle1">DLI Console Overview</h1>
<div id="body1532683323732"><p id="dli_01_0377__p19682162013016">The <strong id="dli_01_0377__b535816326619">Overview</strong> page of the DLI console provides you with the DLI workflow and resource usage.</p>
<div class="section" id="dli_01_0377__section7541203715336"><h4 class="sectiontitle">How to Use DLI</h4><p id="dli_01_0377__p1797340143412">The process of using DLI is as follows:</p>
<ol id="dli_01_0377__ol1121119317351"><li id="dli_01_0377__li221114373520"><strong id="dli_01_0377__b17561621973">Create a queue.</strong><p id="dli_01_0377__p664319264367">Queues are computing resources of DLI. There are queues for SQL jobs and for general purpose. You can submit Spark SQL jobs only to SQL queues, and Spark programs, Flink SQL jobs, and Flink Jar jobs to general queues.</p>
<ol id="dli_01_0377__ol1121119317351"><li id="dli_01_0377__li221114373520"><strong id="dli_01_0377__b17561621973">Create a queue.</strong><p id="dli_01_0377__p664319264367">Queues are DLI's compute resources. There are SQL queues and general-purpose queues. For a SQL queue, you can only submit Spark SQL jobs. For a general-purpose queue, you can submit Spark programs, Flink OpenSource SQL jobs, and Flink Jar jobs.</p>
</li><li id="dli_01_0377__li20271118193517"><strong id="dli_01_0377__b183815436312">Prepare data.</strong><p id="dli_01_0377__p5643825193617">Create databases and tables before you run a Spark SQL job. Upload a program package before you run a Spark job or a Flink Jar job.</p>
</li><li id="dli_01_0377__li18383152593512"><strong id="dli_01_0377__b13693154719103">Edit and submit a job.</strong><p id="dli_01_0377__p372844153816">After you set the job parameters, you can submit the job.</p>
</li><li id="dli_01_0377__li1015653416359"><strong id="dli_01_0377__b166172496311">View job status.</strong><p id="dli_01_0377__p372012313368">Go to the <strong id="dli_01_0377__b9247924181213">Job Management</strong> page to view the job execution status.</p>

6
docs/dli/umn/dli_01_0378.html
View File

@ -4,8 +4,8 @@
<div id="body39451090"><div class="section" id="dli_01_0378__section118410576246"><h4 class="sectiontitle">DLI Introduction</h4><p id="dli_01_0378__p104391318592">Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with <a href="https://spark.apache.org/" target="_blank" rel="noopener noreferrer">Apache Spark</a> and <a href="https://flink.apache.org/" target="_blank" rel="noopener noreferrer">Apache Flink</a> ecosystems. It frees you from managing any servers.</p>
<p id="dli_01_0378__p35691490142221">DLI supports standard SQL and is compatible with Spark SQL and Flink SQL. It also supports multiple access modes, and is compatible with mainstream data formats. DLI supports SQL statements and Spark applications for heterogeneous data sources, including CloudTable, RDS, GaussDB(DWS), CSS, OBS, custom databases on ECSs, and offline databases.</p>
</div>
<div class="section" id="dli_01_0378__section189215415182"><h4 class="sectiontitle">Functions</h4><p id="dli_01_0378__p3872545124817">You can query and analyze heterogeneous data sources such as RDS, and DWS on the cloud using access methods, such as visualized interface, RESTful API, JDBC, ODBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, and ORC.</p>
<ul id="dli_01_0378__ul95252494910"><li id="dli_01_0378__li37017520555">Basic functions<ul id="dli_01_0378__ul33508814556"><li id="dli_01_0378__li4884112014444">You can use standard SQL statements to query in SQL jobs. </li><li id="dli_01_0378__li583064563216">Flink jobs support Flink SQL online analysis. Aggregation functions such as Window and Join, geographic functions, and CEP functions are supported. SQL is used to express service logic, facilitating service implementation. For details, see .</li><li id="dli_01_0378__li652124194912">For spark jobs, fully-managed Spark computing can be performed. You can submit computing tasks through interactive sessions or in batch to analyze data in the fully managed Spark queues. For details, see .</li></ul>
<div class="section" id="dli_01_0378__section189215415182"><h4 class="sectiontitle">Functions</h4><p id="dli_01_0378__p3872545124817">You can query and analyze heterogeneous data sources such as RDS, and GaussDB(DWS) on the cloud using access methods, such as visualized interface, RESTful API, JDBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, and ORC.</p>
<ul id="dli_01_0378__ul95252494910"><li id="dli_01_0378__li37017520555">Basic functions<ul id="dli_01_0378__ul33508814556"><li id="dli_01_0378__li4884112014444">You can use standard SQL statements to query in SQL jobs. For details, see .</li><li id="dli_01_0378__li583064563216">Flink jobs support Flink SQL online analysis. Aggregation functions such as Window and Join, geographic functions, and CEP functions are supported. SQL is used to express service logic, facilitating service implementation. For details, see .</li><li id="dli_01_0378__li652124194912">For spark jobs, fully-managed Spark computing can be performed. You can submit computing tasks through interactive sessions or in batch to analyze data in the fully managed Spark queues. For details, see .</li></ul>
</li><li id="dli_01_0378__li13705141165713">Federated analysis of heterogeneous data sources<ul id="dli_01_0378__ul14754404579"><li id="dli_01_0378__li68911658193117">Spark datasource connection: Data sources such as DWS, RDS, and CSS can be accessed through DLI. For details, see .</li><li id="dli_01_0378__li9919175613471">Interconnection with multiple cloud services is supported in Flink jobs to form a rich stream ecosystem. The DLI stream ecosystem consists of cloud service ecosystems and open source ecosystems.<ul id="dli_01_0378__ul4978181016481"><li id="dli_01_0378__li10978151011487">Cloud service ecosystem: DLI can interconnect with other services in Flink SQL. You can directly use SQL to read and write data from cloud services.</li><li id="dli_01_0378__li4978610154816">Open-source ecosystems: After connections to other VPCs are established through datasource connections, you can access all data sources and output targets (such as Kafka, HBase, and Elasticsearch) supported by Flink and Spark in your dedicated DLI queue.</li></ul>
<p id="dli_01_0378__p11978131024820">For details, see .</p>
</li></ul>
@ -19,7 +19,7 @@
<div class="section" id="dli_01_0378__section128371951391"><h4 class="sectiontitle">Serverless Architecture</h4><p id="dli_01_0378__p439010110106">DLI is a serverless big data query and analysis service. It has the following advantages:</p>
<ul id="dli_01_0378__ul156203189145"><li id="dli_01_0378__li166201818121418">Auto scaling: DLI ensures you always have enough capacity on hand to deal with any traffic spikes.</li></ul>
</div>
<div class="section" id="dli_01_0378__section173909441109"><h4 class="sectiontitle">Accessing DLI</h4><p id="dli_01_0378__p8366328105017">A web-based service management platform is provided. You can access DLI using the management console or HTTPS-based APIs, or connect to the DLI server through a client such as JDBC or ODBC.</p>
<div class="section" id="dli_01_0378__section173909441109"><h4 class="sectiontitle">Accessing DLI</h4><p id="dli_01_0378__p8366328105017">A web-based service management platform is provided. You can access DLI using the management console or HTTPS-based APIs, or connect to the DLI server through the JDBC client.</p>
<ul id="dli_01_0378__ul0613194011284"><li id="dli_01_0378__li172844319285">Using the management console<p id="dli_01_0378__p928643102819"><a name="dli_01_0378__li172844319285"></a><a name="li172844319285"></a>You can submit SQL, Spark, or Flink jobs on the DLI management console. Log in to the management console. Choose <strong id="dli_01_0378__b459287151313">EI Enterprise Intelligence</strong> &gt; <strong id="dli_01_0378__b1317953119138">Data Lake Insight</strong>.</p>
</li></ul>
<ul id="dli_01_0378__ul6602184155118"><li id="dli_01_0378__li17602645513">Using APIs<p id="dli_01_0378__p886223541010"><a name="dli_01_0378__li17602645513"></a><a name="li17602645513"></a>If you need to integrate DLI into a third-party system for secondary development, you can call DLI APIs to use the service.</p>

29
docs/dli/umn/dli_01_0384.html
View File

@ -5,11 +5,11 @@
<p id="dli_01_0384__p55886519497">On the <strong id="dli_01_0384__b943884293511">Overview</strong> page, click <strong id="dli_01_0384__b202117331159">Create Job</strong> in the upper right corner of the <strong id="dli_01_0384__b1696101133814">Spark Jobs</strong> tab or click <strong id="dli_01_0384__b56361152153720">Create Job</strong> in the upper right corner of the <strong id="dli_01_0384__b993313572052">Spark Jobs</strong> page. The Spark job editing page is displayed.</p>
<p id="dli_01_0384__p9427817122315">On the Spark job editing page, a message is displayed, indicating that a temporary DLI data bucket will be created. The created bucket is used to store temporary data generated by DLI, such as job logs and job results. You cannot view job logs if you choose not to create it. The bucket will be created and the default bucket name is used.</p>
<p id="dli_01_0384__p133447114312">If you do not need to create a DLI temporary data bucket and do not want to receive this message, select <strong id="dli_01_0384__b142701146121612">Do not show again</strong> and click <span class="uicontrol" id="dli_01_0384__uicontrol227014464167"><b>Cancel</b></span>.</p>
<div class="section" id="dli_01_0384__section1661873674317"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0384__ul9494144631313"><li id="dli_01_0384__li749524681310">You have uploaded the dependencies to the corresponding OBS bucket on the <span class="wintitle" id="dli_01_0384__wintitle1216872122520"><b>Data Management &gt; Package Management</b></span> page. For details, see <a href="dli_01_0367.html">Creating a Package</a>.</li><li id="dli_01_0384__li7520181309">Before creating a Spark job to access other external data sources, such as OpenTSDB, HBase, Kafka, DWS, RDS, CSS, CloudTable, DCS Redis, and DDS Mongos, you need to create a cross-source connection to enable the network between the job running queue and external data sources.<ul id="dli_01_0384__ul850415199816"><li id="dli_01_0384__li18451528175">For details about the external data sources that can be accessed by Spark jobs, see <a href="dli_01_0410.html">Datasource Connection and Cross-Source Analysis</a>.</li><li id="dli_01_0384__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0384__p881561411413">On the <strong id="dli_01_0384__b38341183198">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0384__b198343811196">More</strong> &gt; <strong id="dli_01_0384__b3835784199">Test Address Connectivity</strong> in the <strong id="dli_01_0384__b38350851913">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
<div class="section" id="dli_01_0384__section1661873674317"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0384__ul9494144631313"><li id="dli_01_0384__li749524681310">You have uploaded the dependencies to the corresponding OBS bucket on the <span class="wintitle" id="dli_01_0384__wintitle1216872122520"><b>Data Management &gt; Package Management</b></span> page. For details, see <a href="dli_01_0367.html">Creating a Package</a>.</li><li id="dli_01_0384__li7520181309">Before creating a Spark job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS MongoDB, you need to create a cross-source connection to enable the network between the job running queue and external data sources.<ul id="dli_01_0384__ul850415199816"><li id="dli_01_0384__li18451528175">For details about the external data sources that can be accessed by Spark jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0384__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0384__p881561411413">On the <strong id="dli_01_0384__b122201520155014">Resources</strong> &gt; <strong id="dli_01_0384__b1022002035016">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0384__b112219202504">More</strong> &gt; <strong id="dli_01_0384__b0221182013507">Test Address Connectivity</strong> in the <strong id="dli_01_0384__b422192015507">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
</li></ul>
</li></ul>
</div>
<div class="section" id="dli_01_0384__en-us_topic_0115200017_en-us_topic_0093946815_section56922894165137"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0384__ol122721522319"><li id="dli_01_0384__li222710156233">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0384__menucascade132155932616"><b><span class="uicontrol" id="dli_01_0384__uicontrol32118599262">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0384__menucascade72217593267"><b><span class="uicontrol" id="dli_01_0384__uicontrol121165910263">Spark Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0384__wintitle622459102618"><b>Spark Jobs</b></span> page is displayed.<p id="dli_01_0384__p125041257172514">In the job editing window, you can set parameters in <span class="wintitle" id="dli_01_0384__wintitle688145014501"><b>Fill Form</b></span> mode or <span class="wintitle" id="dli_01_0384__wintitle52218855114"><b>Write API</b></span> mode.</p>
<div class="section" id="dli_01_0384__en-us_topic_0115200017_en-us_topic_0093946815_section56922894165137"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0384__ol122721522319"><li id="dli_01_0384__li222710156233">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0384__menucascade132155932616"><b><span class="uicontrol" id="dli_01_0384__uicontrol32118599262">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0384__menucascade72217593267"><b><span class="uicontrol" id="dli_01_0384__uicontrol121165910263">Spark Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0384__wintitle622459102618"><b>Spark Jobs</b></span> page is displayed.<p id="dli_01_0384__p125041257172514">Click <strong id="dli_01_0384__b1440711414513">Create Job</strong> in the upper right corner. In the job editing window, you can set parameters in <span class="wintitle" id="dli_01_0384__wintitle688145014501"><b>Fill Form</b></span> mode or <span class="wintitle" id="dli_01_0384__wintitle52218855114"><b>Write API</b></span> mode.</p>
<p id="dli_01_0384__p656240152720">The following uses the <span class="wintitle" id="dli_01_0384__wintitle33192491712"><b>Fill Form</b></span> as an example. In <span class="wintitle" id="dli_01_0384__wintitle10325104915119"><b>Write API</b></span> mode, refer to the <em id="dli_01_0384__i83261649417">Data Lake Insight API Reference</em> for parameter settings.</p>
</li></ol><ol start="2" id="dli_01_0384__ol7424164372311"><li id="dli_01_0384__li5424174342310">Select a queue.<p id="dli_01_0384__p205488292241"><a name="dli_01_0384__li5424174342310"></a><a name="li5424174342310"></a>Select the queue you want to use from the drop-down list box.</p>
</li><li id="dli_01_0384__li1842454372317">Configure the job.<p id="dli_01_0384__p844395655015"><a name="dli_01_0384__li1842454372317"></a><a name="li1842454372317"></a>Configure job parameters by referring to <a href="#dli_01_0384__table15251951125017">Table 1</a>.</p>
@ -20,7 +20,7 @@
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0384__row1724825145012"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p424815135017">Job Name</p>
<tbody><tr id="dli_01_0384__row1724825145012"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p424815135017">Job Name (--name)</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p824825110503">Set a job name.</p>
</td>
@ -30,12 +30,12 @@
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p14248351155014">Select the package to be executed. The value can be <strong id="dli_01_0384__b151323445615">.jar</strong> or <strong id="dli_01_0384__b1275553713561">.py</strong>.</p>
</td>
</tr>
<tr id="dli_01_0384__row82481351105015"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p324815185016">Main Class</p>
<tr id="dli_01_0384__row82481351105015"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p324815185016">Main Class (--class)</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p162481151145016">Enter the name of the main class. When the application type is <strong id="dli_01_0384__b1550211461566">.jar</strong>, the main class name cannot be empty.</p>
</td>
</tr>
<tr id="dli_01_0384__row824935175016"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p142481951125016">Spark Arguments</p>
<tr id="dli_01_0384__row824935175016"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p142481951125016">Spark Arguments (--conf)</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p1024855155014">Enter a parameter in the format of <strong id="dli_01_0384__b525425345812">key=value</strong>. Press Enter to separate multiple key-value pairs. </p>
<p id="dli_01_0384__p182493511506">These parameters can be replaced using global variables. For example, if you create a global variable <strong id="dli_01_0384__b1464915212517">custom_class</strong> on the <strong id="dli_01_0384__b136551024510">Global Configuration</strong> &gt;<strong id="dli_01_0384__b116551626511"> Global Variables</strong> page, you can use <strong id="dli_01_0384__b0655121656">"spark.sql.catalog"={{custom_class}}</strong> to replace a parameter with this variable after the job is submitted.</p>
@ -49,17 +49,17 @@
<ul id="dli_01_0384__ul1824995113508"><li id="dli_01_0384__li1624914519506"><strong id="dli_01_0384__b330820243114">Basic</strong>: Basic images provided by DLI. Select this option for non-AI jobs.</li><li id="dli_01_0384__li2024995175018"><strong id="dli_01_0384__b1815813449217">AI-enhanced</strong>: AI images provided by DLI. Select this option for AI jobs.</li><li id="dli_01_0384__li1124912516506"><strong id="dli_01_0384__b13691867228">Image</strong>: Custom Spark images. Select an existing image name and version on SWR.</li></ul>
</td>
</tr>
<tr id="dli_01_0384__row1124911517506"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p2024910519506">JAR Package Dependencies</p>
<tr id="dli_01_0384__row1124911517506"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p2024910519506">JAR Package Dependencies (--jars)</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p924914511507">JAR file on which the Spark job depends. You can enter the JAR package name or the corresponding OBS path. The format is as follows: <strong id="dli_01_0384__b66383314429">obs://<em id="dli_01_0384__i10637163184216">Bucket name</em><em id="dli_01_0384__i19637173164213">/Folder name/</em><em id="dli_01_0384__i17638123124213">Package name</em></strong>.</p>
</td>
</tr>
<tr id="dli_01_0384__row92501151105018"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p3249451165013">Python File Dependencies</p>
<tr id="dli_01_0384__row92501151105018"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p3249451165013">Python File Dependencies (--py-files)</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p3249155114502">py-files on which the Spark job depends. You can enter the Python file name or the corresponding OBS path of the Python file. The format is as follows: <strong id="dli_01_0384__b8347124713261">obs://<em id="dli_01_0384__i1469855152610">Bucket name</em>/<em id="dli_01_0384__i9319814144">Folder name</em>/<em id="dli_01_0384__i136471354132610">File name</em></strong>.</p>
</td>
</tr>
<tr id="dli_01_0384__row14250351145011"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p112501351105020">Other Dependencies</p>
<tr id="dli_01_0384__row14250351145011"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.2.2.1.2.3.1.1 "><p id="dli_01_0384__p112501351105020">Other Dependencies (--files)</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.2.2.1.2.3.1.2 "><p id="dli_01_0384__p125012514502">Other files on which the Spark job depends. You can enter the name of the dependency file or the corresponding OBS path of the dependency file. The format is as follows: <strong id="dli_01_0384__b4540142352715">obs://<em id="dli_01_0384__i8291153962710">Bucket name</em>/<em id="dli_01_0384__i138860112159">Folder name</em>/<em id="dli_01_0384__i1346113612273">File name</em></strong>.</p>
</td>
@ -92,7 +92,7 @@
</div>
</div>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0384__table17326112613420" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Spark Parameter (--conf) configuration</caption><thead align="left"><tr id="dli_01_0384__row3326122664212"><th align="left" class="cellrowborder" valign="top" width="25.6%" id="mcps1.3.6.3.2.3.2.3.1.1"><p id="dli_01_0384__p17326132694213">Datasource</p>
<div class="tablenoborder"><a name="dli_01_0384__table17326112613420"></a><a name="table17326112613420"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0384__table17326112613420" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Spark Parameter (--conf) configuration</caption><thead align="left"><tr id="dli_01_0384__row3326122664212"><th align="left" class="cellrowborder" valign="top" width="25.6%" id="mcps1.3.6.3.2.3.2.3.1.1"><p id="dli_01_0384__p17326132694213">Datasource</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="74.4%" id="mcps1.3.6.3.2.3.2.3.1.2"><p id="dli_01_0384__p132616262429">Example Value</p>
</th>
@ -106,7 +106,8 @@
</tr>
<tr id="dli_01_0384__row13326102614424"><td class="cellrowborder" valign="top" width="25.6%" headers="mcps1.3.6.3.2.3.2.3.1.1 "><p id="dli_01_0384__p932613264429">DWS</p>
</td>
<td class="cellrowborder" valign="top" width="74.4%" headers="mcps1.3.6.3.2.3.2.3.1.2 "><p id="dli_01_0384__p1486412526525">spark.driver.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/dws/* spark.executor.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/dws/*</p>
<td class="cellrowborder" valign="top" width="74.4%" headers="mcps1.3.6.3.2.3.2.3.1.2 "><p id="dli_01_0384__p932451192914">spark.driver.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/dws/*</p>
<p id="dli_01_0384__p1486412526525">spark.executor.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/dws/*</p>
</td>
</tr>
<tr id="dli_01_0384__row1459922115314"><td class="cellrowborder" valign="top" width="25.6%" headers="mcps1.3.6.3.2.3.2.3.1.1 "><p id="dli_01_0384__p15599102125318">HBase</p>
@ -133,12 +134,6 @@
<p id="dli_01_0384__p12154727175716">spark.executor.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/redis/*</p>
</td>
</tr>
<tr id="dli_01_0384__row13786530135715"><td class="cellrowborder" valign="top" width="25.6%" headers="mcps1.3.6.3.2.3.2.3.1.1 "><p id="dli_01_0384__p678612303578">Mongo</p>
</td>
<td class="cellrowborder" valign="top" width="74.4%" headers="mcps1.3.6.3.2.3.2.3.1.2 "><p id="dli_01_0384__p849514587574">spark.driver.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/mongo/*</p>
<p id="dli_01_0384__p12495358195719">spark.executor.extraClassPath=/usr/share/extension/dli/spark-jar/datasource/mongo/*</p>
</td>
</tr>
</tbody>
</table>
</div>
@ -150,7 +145,7 @@
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0384__row188851011125312"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.3.2.2.3.1.1 "><p id="dli_01_0384__p12885411145320">Module Name</p>
<tbody><tr id="dli_01_0384__row188851011125312"><td class="cellrowborder" valign="top" width="17.34%" headers="mcps1.3.6.3.3.2.2.3.1.1 "><p id="dli_01_0384__p12885411145320">modules</p>
</td>
<td class="cellrowborder" valign="top" width="82.66%" headers="mcps1.3.6.3.3.2.2.3.1.2 "><p id="dli_01_0384__p171215491471">If the Spark version is <strong id="dli_01_0384__b141851813319">3.1.1</strong>, you do not need to select a module. Configure <strong id="dli_01_0384__b151858818333">Spark parameters (--conf)</strong>.</p>
<div class="p" id="dli_01_0384__p1488591112538">Dependency modules provided by DLI for executing datasource connection jobs. To access different services, you need to select different modules.<ul id="dli_01_0384__ul6885171116534"><li id="dli_01_0384__li11885201145317">MRS HBase: sys.datasource.hbase</li><li id="dli_01_0384__li138851111205312">DDS: sys.datasource.mongo</li><li id="dli_01_0384__li13885411105313">MRS OpenTSDB: sys.datasource.opentsdb</li><li id="dli_01_0384__li988531120538">DWS: sys.datasource.dws</li><li id="dli_01_0384__li2885611175318">RDS MySQL: sys.datasource.rds</li><li id="dli_01_0384__li6885121185311">RDS PostGre: sys.datasource.rds</li><li id="dli_01_0384__li68859112531">DCS: sys.datasource.redis</li><li id="dli_01_0384__li288541117534">CSS: sys.datasource.css</li></ul>

6
docs/dli/umn/dli_01_0389.html
View File

@ -16,12 +16,14 @@
</li>
<li class="ulchildlink"><strong><a href="dli_01_0457.html">Creating a Flink Jar Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0458.html">Debugging a Flink Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0461.html">Performing Operations on a Flink Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0462.html">Flink Job Details</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0463.html">Tag Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0534.html">Enabling Dynamic Scaling for Flink Jobs</a></strong><br>
</li>
</ul>
<div class="familylinks">

2
docs/dli/umn/dli_01_0390.html
View File

@ -24,6 +24,8 @@
</li>
<li class="ulchildlink"><strong><a href="dli_01_0007.html">Previewing Data</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0552.html">Managing Tags</a></strong><br>
</li>
</ul>
<div class="familylinks">

4
docs/dli/umn/dli_01_0397.html
View File

File diff suppressed because one or more lines are too long

65
docs/dli/umn/dli_01_0402.html
View File

File diff suppressed because it is too large Load Diff

6
docs/dli/umn/dli_01_0403.html
View File

@ -4,17 +4,15 @@
<div id="body1543376454662"><p id="dli_01_0403__p1866444210407">On the Job Management page of Flink jobs, you can submit a Flink job. Currently, the following job types are supported:</p>
<ul id="dli_01_0403__ul3319024204014"><li id="dli_01_0403__li153191024124015"><strong id="dli_01_0403__b582202818343">Flink SQL</strong> uses SQL statements to define jobs and can be submitted to any general purpose queue.</li><li id="dli_01_0403__li069317403210"><strong id="dli_01_0403__b208655222421">Flink Jar</strong> customizes a JAR package job based on Flink APIs. It runs on dedicated queues.</li></ul>
<p id="dli_01_0403__p66161828392">Flink job management provides the following functions:</p>
<ul id="dli_01_0403__ul8657743184112"><li id="dli_01_0403__li81824019583"><a href="dli_01_0479.html">Managing Flink Job Permissions</a></li><li id="dli_01_0403__li19657124354118"><a href="dli_01_0455.html">Creating a Flink SQL Job</a></li><li id="dli_01_0403__li49002025195814"><a href="dli_01_0457.html">Creating a Flink Jar Job</a></li><li id="dli_01_0403__li1966122614815"><a href="dli_01_0458.html">Debugging a Job</a></li><li id="dli_01_0403__li321633381117"><a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a job</a></li><li id="dli_01_0403__li149164314117"><a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a></li><li id="dli_01_0403__li1918757145613"><a href="dli_01_0461.html#dli_01_0461__section8678193324114">Stopping a Job</a></li><li id="dli_01_0403__li14179161612574"><a href="dli_01_0461.html#dli_01_0461__section1691624195713">Deleting a Job</a></li><li id="dli_01_0403__li529715414492"><a href="dli_01_0461.html#dli_01_0461__section135831511323">Exporting a Job</a></li><li id="dli_01_0403__li12456172025013"><a href="dli_01_0461.html#dli_01_0461__section75781665389">Importing a Job</a></li><li id="dli_01_0403__li7887305574"><a href="dli_01_0461.html#dli_01_0461__section15861321183619">Modifying Name and Description</a></li><li id="dli_01_0403__li131144243198"><a href="dli_01_0461.html#dli_01_0461__section83412445175">Importing to a Savepoint</a></li><li id="dli_01_0403__li5693174816504"><a href="dli_01_0461.html#dli_01_0461__section11401152191015">Triggering a Savepoint</a></li><li id="dli_01_0403__li255018247317"><a href="dli_01_0461.html#dli_01_0461__section48961252113110">Runtime Configuration</a></li><li id="dli_01_0403__li153181731145913"><a href="dli_01_0462.html">Job Details</a></li></ul>
<ul id="dli_01_0403__ul8657743184112"><li id="dli_01_0403__li81824019583"><a href="dli_01_0479.html">Managing Flink Job Permissions</a></li><li id="dli_01_0403__li19657124354118"><a href="dli_01_0455.html">Creating a Flink SQL Job</a></li><li id="dli_01_0403__li49002025195814"><a href="dli_01_0457.html">Creating a Flink Jar Job</a></li><li id="dli_01_0403__li321633381117"><a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a job</a></li><li id="dli_01_0403__li149164314117"><a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a></li><li id="dli_01_0403__li1918757145613"><a href="dli_01_0461.html#dli_01_0461__section8678193324114">Stopping a Job</a></li><li id="dli_01_0403__li14179161612574"><a href="dli_01_0461.html#dli_01_0461__section1691624195713">Deleting a Job</a></li><li id="dli_01_0403__li529715414492"><a href="dli_01_0461.html#dli_01_0461__section135831511323">Exporting a Job</a></li><li id="dli_01_0403__li12456172025013"><a href="dli_01_0461.html#dli_01_0461__section75781665389">Importing a Job</a></li><li id="dli_01_0403__li7887305574"><a href="dli_01_0461.html#dli_01_0461__section15861321183619">Modifying Name and Description</a></li><li id="dli_01_0403__li131144243198"><a href="dli_01_0461.html#dli_01_0461__section83412445175">Importing to a Savepoint</a></li><li id="dli_01_0403__li5693174816504"><a href="dli_01_0461.html#dli_01_0461__section11401152191015">Triggering a Savepoint</a></li><li id="dli_01_0403__li255018247317"><a href="dli_01_0461.html#dli_01_0461__section48961252113110">Runtime Configuration</a></li><li id="dli_01_0403__li153181731145913"><a href="dli_01_0462.html">Job Details</a></li></ul>
<div class="section" id="dli_01_0403__section12518143518488"><h4 class="sectiontitle">Assigning Agency Permissions</h4><p id="dli_01_0403__p147561066544">Agencies are required for DLI to execute Flink jobs. You can set the agency when logging in to the management console for the first time or go to <strong id="dli_01_0403__b209911447379">Global Configurations</strong> &gt; <a href="dli_01_0486.html">Service Authorization</a> to modify the agencies.</p>
<p id="dli_01_0403__p112123218557">The permissions are as follows:</p>
<ul id="dli_01_0403__ul1393104512501"><li id="dli_01_0403__li53932045105016"><strong id="dli_01_0403__b825511452452">Tenant Administrator (global)</strong> permissions are required to access data from OBS to execute Flink jobs on DLI, for example, obtaining OBS/DWS data sources, log dump (including bucket authorization), checkpointing enabling, and job import and export.<div class="note" id="dli_01_0403__note45081932194818"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p95082324484">Due to cloud service cache differences, permission setting operations require about 60 minutes to take effect.</p>
<ul id="dli_01_0403__ul1393104512501"><li id="dli_01_0403__li53932045105016"><strong id="dli_01_0403__b825511452452">Tenant Administrator (global)</strong> permissions are required to access data from OBS to execute Flink jobs on DLI, for example, obtaining OBS/GaussDB(DWS) data sources, log dump (including bucket authorization), checkpointing enabling, and job import and export.<div class="note" id="dli_01_0403__note45081932194818"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p95082324484">Due to cloud service cache differences, permission setting operations require about 60 minutes to take effect.</p>
</div></div>
</li><li id="dli_01_0403__li65241851125015"><strong id="dli_01_0403__b7690104924514">DIS Administrator</strong> permissions are required to use DIS data as the data source of DLI Flink jobs.<div class="note" id="dli_01_0403__note2048353604212"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p1648414365424">Due to cloud service cache differences, permission setting operations require about 30 minutes to take effect.</p>
</div></div>
</li><li id="dli_01_0403__li15237101705317">To use CloudTable data as the data source of DLI Flink jobs, <strong id="dli_01_0403__b41312369567">CloudTable Administrator</strong> permissions are required.<div class="note" id="dli_01_0403__note0630838143813"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p663117386382">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
</div></div>
</li><li id="dli_01_0403__li18108653125412"><strong id="dli_01_0403__b851110592312">Tenant Administrator (Project-level)</strong> permissions are required if you use services that can run only with these permissions.<div class="note" id="dli_01_0403__note103326521192"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p83324521995">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
</div></div>
</li></ul>
</div>
<div class="section" id="dli_01_0403__section12526165519235"><h4 class="sectiontitle">Flink Jobs Page</h4><p id="dli_01_0403__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0403__b5725174712329">Overview</strong> page, click <strong id="dli_01_0403__b16730204714323">Flink Jobs</strong> to go to the Flink job management page. Alternatively, you can choose <strong id="dli_01_0403__b177319476328">Job Management</strong> &gt; <strong id="dli_01_0403__b173184718320">Flink Jobs</strong> from the navigation pane on the left. The page displays all Flink jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>

39
docs/dli/umn/dli_01_0407.html
View File

@ -5,53 +5,56 @@
<ul id="dli_01_0407__ul8657743184112"><li id="dli_01_0407__li14139145132717"><a href="dli_01_0477.html">Managing Package Permissions</a></li><li id="dli_01_0407__li19657124354118"><a href="dli_01_0367.html">Creating a Package</a></li><li id="dli_01_0407__li9471154134119"><a href="dli_01_0369.html">Deleting a Package</a><div class="note" id="dli_01_0407__note1393218181435"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0407__p79328181837">You can delete program packages in batches.</p>
</div></div>
</li><li id="dli_01_0407__li624821620217"><a href="dli_01_0478.html">Modifying the Owner</a></li></ul>
<div class="section" id="dli_01_0407__section194110185420"><h4 class="sectiontitle">Constraints</h4><ul id="dli_01_0407__ul1261192724211"><li id="dli_01_0407__dli_07_0005_li349215401873">A package can be deleted, but a package group cannot be deleted.</li><li id="dli_01_0407__dli_07_0005_li19798321755">The following types of packages can be uploaded:<ul id="dli_01_0407__dli_07_0005_ul1349114421957"><li id="dli_01_0407__dli_07_0005_li359082764320"><strong id="dli_01_0407__dli_07_0005_b13479075378">JAR</strong>: JAR file</li><li id="dli_01_0407__dli_07_0005_li125901627144314"><strong id="dli_01_0407__dli_07_0005_b494901012379">PyFile</strong>: User Python file</li><li id="dli_01_0407__dli_07_0005_li165901027104315"><strong id="dli_01_0407__dli_07_0005_b2012941493715">File</strong>: User file</li><li id="dli_01_0407__dli_07_0005_li259002734313"><strong id="dli_01_0407__dli_07_0005_b17210171817377">ModelFile</strong>: User AI model file</li></ul>
</li></ul>
</div>
<div class="section" id="dli_01_0407__section153923398422"><h4 class="sectiontitle">Package Management Page</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0407__table96567183916" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Package management parameters</caption><thead align="left"><tr id="dli_01_0407__row666212153915"><th align="left" class="cellrowborder" valign="top" width="19.35%" id="mcps1.3.3.2.2.3.1.1"><p id="dli_01_0407__p46667183914">Parameter</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0407__table96567183916" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Package management parameters</caption><thead align="left"><tr id="dli_01_0407__row666212153915"><th align="left" class="cellrowborder" valign="top" width="19.35%" id="mcps1.3.4.2.2.3.1.1"><p id="dli_01_0407__p46667183914">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="80.65%" id="mcps1.3.3.2.2.3.1.2"><p id="dli_01_0407__p96671811393">Description</p>
<th align="left" class="cellrowborder" valign="top" width="80.65%" id="mcps1.3.4.2.2.3.1.2"><p id="dli_01_0407__p96671811393">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0407__row1350920501725"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p6509150629">Group Name</p>
<tbody><tr id="dli_01_0407__row1350920501725"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p6509150629">Group Name</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p550985016212">Name of the group to which the package belongs. If the package is not grouped, <strong id="dli_01_0407__b188720490331">--</strong> is displayed.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p550985016212">Name of the group to which the package belongs. If the package is not grouped, <strong id="dli_01_0407__b188720490331">--</strong> is displayed.</p>
</td>
</tr>
<tr id="dli_01_0407__row11671191143912"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p367511143910">Package Name</p>
<tr id="dli_01_0407__row11671191143912"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p367511143910">Package Name</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p4141250171510">Name of a package.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p4141250171510">Name of a package.</p>
</td>
</tr>
<tr id="dli_01_0407__row169710366100"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p149816362107">Owner</p>
<tr id="dli_01_0407__row169710366100"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p149816362107">Owner</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p49843661015">Name of the user who uploads the package.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p49843661015">Name of the user who uploads the package.</p>
</td>
</tr>
<tr id="dli_01_0407__row611412316405"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p1211616239406">Type</p>
<tr id="dli_01_0407__row611412316405"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p1211616239406">Type</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p17806105744415">Type of a package. The following package types are supported:</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p17806105744415">Type of a package. The following package types are supported:</p>
<ul id="dli_01_0407__en-us_topic_0122016946_ul19355124635412"><li id="dli_01_0407__en-us_topic_0122016946_li173552046135410">JAR: JAR file</li><li id="dli_01_0407__en-us_topic_0122016946_li1035554615417">PyFile: User Python file</li><li id="dli_01_0407__en-us_topic_0122016946_li73551146195414">File: User file</li></ul>
</td>
</tr>
<tr id="dli_01_0407__row368271163910"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p126843119397">Status</p>
<tr id="dli_01_0407__row368271163910"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p126843119397">Status</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p16879163915">Status of the package to be created.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p16879163915">Status of the package to be created.</p>
<ul id="dli_01_0407__ul32851446111915"><li id="dli_01_0407__li073743101315">Uploading: The file is being uploaded.</li><li id="dli_01_0407__li1029302118132">Finished: The resource package has been uploaded.</li><li id="dli_01_0407__li62851446101912">Failed: The resource package upload failed.</li></ul>
</td>
</tr>
<tr id="dli_01_0407__row164492116534"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p1444914114533">Created</p>
<tr id="dli_01_0407__row164492116534"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p1444914114533">Created</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p1244981165312">Time when a package is created.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p1244981165312">Time when a package is created.</p>
</td>
</tr>
<tr id="dli_01_0407__row1808175125310"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p108087545313">Updated</p>
<tr id="dli_01_0407__row1808175125310"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p108087545313">Updated</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p4808551537">Time when the package is updated.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p4808551537">Time when the package is updated.</p>
</td>
</tr>
<tr id="dli_01_0407__row1695151133915"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p369521113915">Operation</p>
<tr id="dli_01_0407__row1695151133915"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_01_0407__p369521113915">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p112943491118">Manage Permissions: Manage user permissions for a package.</p>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_01_0407__p112943491118">Manage Permissions: Manage user permissions for a package.</p>
<p id="dli_01_0407__p176451142141714">Delete: Delete the package.</p>
<p id="dli_01_0407__p144116478547"><strong id="dli_01_0407__b53017941114">More</strong>:</p>
<ul id="dli_01_0407__ul162095820541"><li id="dli_01_0407__li4620145814545"><strong id="dli_01_0407__b0675171911118">Modify Owner</strong>: Modify the owner of the package.</li></ul>

164
docs/dli/umn/dli_01_0410.html
View File

File diff suppressed because it is too large Load Diff

2
docs/dli/umn/dli_01_0418.html
View File

@ -12,7 +12,7 @@
<ol id="dli_01_0418__ol139492810017"><li id="dli_01_0418__li895020818018"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group and grant the permission to it.<p id="dli_01_0418__p99501985019"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group on the IAM console, and assign the <strong id="dli_01_0418__b163744195013">DLI ReadOnlyAccess</strong> permission to the group.</p>
</li><li id="dli_01_0418__li59503817014">Create a user and add the user to the user group.<p id="dli_01_0418__p4950882013"><a name="dli_01_0418__li59503817014"></a><a name="li59503817014"></a>Create a user on the IAM console and add the user to the group created in <a href="#dli_01_0418__li895020818018">1</a>.</p>
</li><li id="dli_01_0418__li159506814017">Log in and verify the permission.<p id="dli_01_0418__p29911201511"><a name="dli_01_0418__li159506814017"></a><a name="li159506814017"></a>Log in to the management console using the newly created user, and verify that the user's permissions.</p>
<ul id="dli_01_0418__ul9992304111"><li id="dli_01_0418__li149921301015">Choose <strong id="dli_01_0418__b903531909">Service List</strong> &gt; <strong id="dli_01_0418__b1933557329">Data Lake Insight</strong>. The DLI management console is displayed. If you can view the queue list on the <strong id="dli_01_0418__b86423619315">Queue Management</strong> page but cannot buy DLI queues by clicking <strong id="dli_01_0418__b1701367313">Buy Queue</strong> in the upper right corner (assume that the current permission contains only <strong id="dli_01_0418__b1070193615314">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b7710363316">DLI ReadOnlyAccess</strong> permission has taken effect.</li><li id="dli_01_0418__li29921500115">Choose any other service in <strong id="dli_01_0418__b6827231507">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b148281231700">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
<ul id="dli_01_0418__ul9992304111"><li id="dli_01_0418__li149921301015">Choose <strong id="dli_01_0418__b1995251441">Service List</strong> &gt; <strong id="dli_01_0418__b1092401376">Data Lake Insight</strong>. The DLI management console is displayed. If you can view the queue list on the <strong id="dli_01_0418__b86423619315">Queue Management</strong> page but cannot buy DLI queues by clicking <strong id="dli_01_0418__b1701367313">Buy Queue</strong> in the upper right corner (assume that the current permission contains only <strong id="dli_01_0418__b1070193615314">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b7710363316">DLI ReadOnlyAccess</strong> permission has taken effect.</li><li id="dli_01_0418__li29921500115">Choose any other service in <strong id="dli_01_0418__b6827231507">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b148281231700">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
</li></ol>
<p id="dli_01_0418__p05981420125912"></p>
</div>

4
docs/dli/umn/dli_01_0421.html
View File

@ -3,10 +3,10 @@
<h1 class="topictitle1">Creating a Message Notification Topic</h1>
<div id="body1566197386597"><div class="section" id="dli_01_0421__section5242489132"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0421__p1153362612142">Once you have created a message notification topic, you can <strong id="dli_01_0421__b596222242318">Add subscription</strong> of the topic on the <strong id="dli_01_0421__b179621022142319">Topic Management</strong> page of the Simple Message Notification service. You can select different ways (such as text messages or emails) to subscribe. After the subscription succeeds, any job failure will automatically be sent to your subscription endpoints.</p>
</div>
<div class="section" id="dli_01_0421__section742629201411"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0421__ol25920582507"><li id="dli_01_0421__li9592558175016">On the <strong id="dli_01_0421__b1990823713261">Queue Management</strong> page, click <strong id="dli_01_0421__b1914153715265">Create SMN Topic</strong> on the upper left side. The <strong id="dli_01_0421__b15914113762619">Create SMN Topic</strong> dialog box is displayed.</li><li id="dli_01_0421__li144161849165115">Select a queue and click <strong id="dli_01_0421__b8335131614183">OK</strong>.<div class="note" id="dli_01_0421__note1848145063719"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0421__ul731513171718"><li id="dli_01_0421__li780591161620">You can select a single queue or all queues.</li><li id="dli_01_0421__li04613151711">If you create a topic for a queue and another topic for all queues, the SMN of all queues does not include the message of the single queue.</li><li id="dli_01_0421__li174141311718">After a notification topic is created, you will receive a notification only when a session or a batch job fails to be created.</li></ul>
<div class="section" id="dli_01_0421__section742629201411"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0421__ol25920582507"><li id="dli_01_0421__li9592558175016">On the <strong id="dli_01_0421__b13249815101012">Resources</strong> &gt; <strong id="dli_01_0421__b1990823713261">Queue Management</strong> page, click <strong id="dli_01_0421__b1914153715265">Create SMN Topic</strong> on the upper left side. The <strong id="dli_01_0421__b15914113762619">Create SMN Topic</strong> dialog box is displayed.</li><li id="dli_01_0421__li144161849165115">Select a queue and click <strong id="dli_01_0421__b8335131614183">OK</strong>.<div class="note" id="dli_01_0421__note1848145063719"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0421__ul731513171718"><li id="dli_01_0421__li780591161620">You can select a single queue or all queues.</li><li id="dli_01_0421__li04613151711">If you create a topic for a queue and another topic for all queues, the SMN of all queues does not include the message of the single queue.</li><li id="dli_01_0421__li174141311718">After a message notification topic is created, you will receive a message notification only when a Spark job created on the subscription queue fails.</li></ul>
</div></div>
<p id="dli_01_0421__p0261153411191"></p>
</li><li id="dli_01_0421__li10453153145415">Click <strong id="dli_01_0421__b955534693012">Topic Management</strong> in the prompt for a successfully created topic to go to the <strong id="dli_01_0421__b258111280317">Topic Management</strong> page of SMN.</li><li id="dli_01_0421__li1720834116576">In the <strong id="dli_01_0421__b9213191510275">Operation</strong> column of the topic, click <strong id="dli_01_0421__b422011514271">Add Subscription</strong>. Select <strong id="dli_01_0421__b7220141562711">Protocol</strong> to determine the subscription mode.<p id="dli_01_0421__p11811112417238"></p>
</li><li id="dli_01_0421__li10453153145415">Click <strong id="dli_01_0421__b1391917281324">Topic Management</strong> in to go to the <strong id="dli_01_0421__b17424848853">Topic Management</strong> page of the SMN service.</li><li id="dli_01_0421__li1720834116576">In the <strong id="dli_01_0421__b9213191510275">Operation</strong> column of the topic, click <strong id="dli_01_0421__b422011514271">Add Subscription</strong>. Select <strong id="dli_01_0421__b7220141562711">Protocol</strong> to determine the subscription mode.<p id="dli_01_0421__p11811112417238"></p>
</li><li id="dli_01_0421__li105037206332">After you click the link in the email, you will receive a message indicating that the subscription is successful.</li><li id="dli_01_0421__li165897201922">Go to the <strong id="dli_01_0421__b123031745123314">Subscriptions</strong> page of SMN, and check that subscription status is <strong id="dli_01_0421__b2101122153418">Confirmed</strong>.</li></ol>
</div>
</div>

14
docs/dli/umn/dli_01_0422.html
View File

@ -1,16 +1,20 @@
<a name="dli_01_0422"></a><a name="dli_01_0422"></a>
<h1 class="topictitle1">Datasource Connections</h1>
<h1 class="topictitle1">Datasource Authentication</h1>
<div id="body1568103018192"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0410.html">Datasource Connection and Cross-Source Analysis</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0561.html">Introduction</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0426.html">Enhanced Datasource Connections</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0427.html">Creating a CSS Datasource Authentication</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0480.html">Managing Datasource Connection Permissions</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0558.html">Creating a Kerberos Datasource Authentication</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0427.html">Creating and Managing Datasource Authentication</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0560.html">Creating a Kafka_SSL Datasource Authentication</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0559.html">Creating a Password Datasource Authentication</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0480.html">Datasource Authentication Permission Management</a></strong><br>
</li>
</ul>
</div>

20
docs/dli/umn/dli_01_0426.html
View File

@ -6,20 +6,24 @@
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0003.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0006.html">Creating, Querying, and Deleting an Enhanced Datasource Connection</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0009.html">Binding and Unbinding a Queue</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0006.html">Creating an Enhanced Datasource Connection</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0553.html">Deleting an Enhanced Datasource Connection</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0013.html">Modifying Host Information</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0014.html">Custom Route Information</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0514.html">Binding and Unbinding a Queue</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0018.html">Enhanced Datasource Connection Permission Management</a></strong><br>
<li class="ulchildlink"><strong><a href="dli_01_0014.html">Adding a Route</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0556.html">Deleting a Route</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0018.html">Enhanced Connection Permission Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0019.html">Enhanced Datasource Connection Tag Management</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0422.html">Datasource Connections</a></div>
</div>
</div>

183
docs/dli/umn/dli_01_0427.html
View File

File diff suppressed because it is too large Load Diff

2
docs/dli/umn/dli_01_0440.html
View File

@ -133,7 +133,7 @@
</td>
<td class="cellrowborder" valign="top" width="15.409999999999998%" headers="mcps1.3.4.3.2.6.1.2 "><p id="dli_01_0440__p76331121189">Datasource connection permissions</p>
</td>
<td class="cellrowborder" valign="top" width="20.21%" headers="mcps1.3.4.3.2.6.1.3 "><p id="dli_01_0440__p1963351216818">For details, see <a href="dli_01_0480.html">Managing Datasource Connection Permissions</a>.</p>
<td class="cellrowborder" valign="top" width="20.21%" headers="mcps1.3.4.3.2.6.1.3 "><p id="dli_01_0440__p1963351216818">For details, see <a href="dli_01_0480.html">Datasource Authentication Permission Management</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="25.900000000000002%" headers="mcps1.3.4.3.2.6.1.4 "><p id="dli_01_0440__p14633181215811">None</p>
</td>

2
docs/dli/umn/dli_01_0443.html
View File

@ -4,7 +4,7 @@
<div id="body1569569735360"><p id="dli_01_0443__p16461459191012">If the CIDR block of the DLI queue conflicts with that of the user data source, you can change the CIDR block of the queue.</p>
<div class="note" id="dli_01_0443__note9413185151111"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0443__p1741310581115">If the queue whose CIDR block is to be modified has jobs that are being submitted or running, or the queue has been bound to enhanced datasource connections, the CIDR block cannot be modified.</p>
</div></div>
<div class="section" id="dli_01_0443__section1632464319610"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0443__ol0259153792819"><li id="dli_01_0443__li132598378281">On the left of the DLI management console, click <strong id="dli_01_0443__b1265413719307">Resources</strong> &gt;<span class="uicontrol" id="dli_01_0443__uicontrol3654143716304"><b>Queue Management</b></span>.</li><li id="dli_01_0443__li925912374280">Select the queue to be modified and click <span class="uicontrol" id="dli_01_0443__uicontrol5494155415535"><b>Modify CIDR Block</b></span> in the <span class="parmname" id="dli_01_0443__parmname1750011544539"><b>Operation</b></span> column.</li><li id="dli_01_0443__li18259133752817">Enter the required CIDR block and click <span class="uicontrol" id="dli_01_0443__uicontrol5699182218613"><b>OK</b></span>.</li></ol>
<div class="section" id="dli_01_0443__section1632464319610"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0443__ol0259153792819"><li id="dli_01_0443__li132598378281">On the left of the DLI management console, click <strong id="dli_01_0443__b1265413719307">Resources</strong> &gt;<span class="uicontrol" id="dli_01_0443__uicontrol3654143716304"><b>Queue Management</b></span>.</li><li id="dli_01_0443__li925912374280">Select the queue to be modified and click <span class="uicontrol" id="dli_01_0443__uicontrol5494155415535"><b>Modify CIDR Block</b></span> in the <span class="parmname" id="dli_01_0443__parmname1750011544539"><b>Operation</b></span> column.</li><li id="dli_01_0443__li18259133752817">Enter the required CIDR block and click <span class="uicontrol" id="dli_01_0443__uicontrol5699182218613"><b>OK</b></span>. After the CIDR block of the queue is successfully changed, wait for 5 to 10 minutes until the cluster to which the queue belongs is restarted and then run jobs on the queue.</li></ol>
</div>
</div>
<div>

2
docs/dli/umn/dli_01_0447.html
View File

@ -1,7 +1,7 @@
<a name="dli_01_0447"></a><a name="dli_01_0447"></a>
<h1 class="topictitle1">Managing Database Permissions</h1>
<div id="body1571736789703"><div class="section" id="dli_01_0447__section2883543204514"><h4 class="sectiontitle">Operation Scenarios</h4><ul id="dli_01_0447__ul6751144710454"><li id="dli_01_0447__li18752174718455">You can isolate databases allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0447__li16752047104516">The administrator and database owner have all permissions, which cannot be set or modified by other users.</li></ul>
<div id="body1571736789703"><div class="section" id="dli_01_0447__section2883543204514"><h4 class="sectiontitle">Scenario</h4><ul id="dli_01_0447__ul6751144710454"><li id="dli_01_0447__li18752174718455">You can isolate databases allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0447__li16752047104516">The administrator and database owner have all permissions, which cannot be set or modified by other users.</li></ul>
</div>
<div class="section" id="dli_01_0447__section13393554152612"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0447__ul16414185422619"><li id="dli_01_0447__li44137546264">Lower-level objects automatically inherit permissions granted to upper-level objects. The hierarchical relationship is database &gt; table &gt; column.</li><li id="dli_01_0447__li971149172410">The database owner, table owner, and <span class="parmname" id="dli_01_0447__parmname13746731125417"><b>authorized</b></span> users can assign permissions on the database and tables.</li><li id="dli_01_0447__li10413145418269">Columns can only inherit the query permission. For details about <span class="parmname" id="dli_01_0447__parmname15888124214540"><b>Inheritable Permissions</b></span>, see <a href="dli_01_0447.html">Managing Database Permissions</a>.</li><li id="dli_01_0447__li16413175413264">The permissions can be revoked only at the initial level to which the permissions are granted. You need to grant and revoke permissions at the same level. You need to grant and revoke permissions at the same level. For example, after you are granted the insertion permission on a database, you can obtain the insertion permission on the tables in the database. Your insertion permission can be revoked only at the database level.</li><li id="dli_01_0447__li29052232217">If you create a database with the same name as a deleted database, the database permissions will not be inherited. In this case, you need to grant the database permissions to users or projects.<p id="dli_01_0447__p08812692719"><a name="dli_01_0447__li29052232217"></a><a name="li29052232217"></a>For example, user A is granted with the permission to delete the <strong id="dli_01_0447__b20228161610456">testdb</strong> database. Delete the database and create another one with the same name. You need to grant user A the deletion permission of the <strong id="dli_01_0447__b76882037184612">testdb</strong> database again.</p>
</li></ul>

27
docs/dli/umn/dli_01_0451.html
View File

@ -12,7 +12,7 @@
{
"Effect": "Allow",
"Action": [
"dli:database:create_table"
"dli:database:createTable"
],
"Resource": [
"dli:*:*:database:*"
@ -148,7 +148,7 @@
</tr>
<tr id="dli_01_0451__row7563144413162"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p1256384461610">DLI:*:*:database:databases.dbname</p>
</td>
<td class="cellrowborder" valign="top" width="55.279999999999994%" headers="mcps1.3.6.3.2.2.2.3.1.2 "><p id="dli_01_0451__p6563744121615">DLI, any region, any account ID, queue of database <strong id="dli_01_0451__b1558161313321">dbname</strong></p>
<td class="cellrowborder" valign="top" width="55.279999999999994%" headers="mcps1.3.6.3.2.2.2.3.1.2 "><p id="dli_01_0451__p6563744121615">DLI, any region, any account ID, resource of database <strong id="dli_01_0451__b1558161313321">dbname</strong></p>
</td>
</tr>
<tr id="dli_01_0451__row356494415169"><td class="cellrowborder" valign="top" width="44.72%" headers="mcps1.3.6.3.2.2.2.3.1.1 "><p id="dli_01_0451__p4564244131615">DLI:*:*:queue:queues.*</p>
@ -247,10 +247,10 @@
{
"Effect": " Allow",
"Action": [
"dli:database:create_database",
"dli:database:drop_database",
"dli:queue:submit_job",
"dli:table:drop_table"
"dli:database:createDatabase",
"dli:database:dropDatabase",
"dli:queue:submitJob",
"dli:table:dropTable"
],
"Resource": [
"dli:*:*:database:*",
@ -268,7 +268,7 @@
{
"Effect": "Allow",
"Action": [
"dli:database:create_table"
"dli:database:createTable"
],
"Resource": [
"dli:*:*:database:*"
@ -291,17 +291,18 @@
]
}</pre>
</li></ul>
</li><li id="dli_01_0451__li7512174718283">Example 2: Deny policies<p id="dli_01_0451__p1023215261890"><a name="dli_01_0451__li7512174718283"></a><a name="li7512174718283"></a>A deny policy must be used in conjunction with other policies to take effect. If the permissions assigned to a user contain both Allow and Deny actions, the Deny actions take precedence over the Allow actions.</p>
</li><li id="dli_01_0451__li7512174718283">Example 2: Deny policies<p id="dli_01_0451__p189014271392"><a name="dli_01_0451__li7512174718283"></a><a name="li7512174718283"></a>A deny policy must be used together with other policies. That is, a user can set a deny policy only after being assigned some operation permissions. Otherwise, the deny policy does not take effect.</p>
<p id="dli_01_0451__p1023215261890">If the permissions assigned to a user contain both Allow and Deny actions, the Deny actions take precedence over the Allow actions.</p>
<ul id="dli_01_0451__ul216211955016"><li id="dli_01_0451__li912563413325">Deny users to create or delete databases, submit jobs (except the default queue), or delete tables.<pre class="screen" id="dli_01_0451__screen59661958133014">{
"Version": "1.1",
"Statement": [
{
"Effect": "Deny",
"Action": [
"dli:database:create_database",
"dli:database:drop_database",
"dli:queue:submit_job",
"dli:table:drop_table"
"dli:database:createDatabase",
"dli:database:dropDatabase",
"dli:queue:submitJob",
"dli:table:dropTable"
],
"Resource": [
"dli:*:*:database:*",
@ -317,7 +318,7 @@
{
"Effect": "Deny",
"Action": [
"dli:queue:submit_job"
"dli:queue:submitJob"
],
"Resource": [
"dli:*:*:queue:queues.demo"

35
docs/dli/umn/dli_01_0455.html
View File

@ -2,8 +2,8 @@
<h1 class="topictitle1">Creating a Flink SQL Job</h1>
<div id="body1574761276020"><p id="dli_01_0455__p1426222391410">This section describes how to create a Flink SQL job. You can use Flink SQLs to develop jobs to meet your service requirements. Using SQL statements simplifies logic implementation. You can edit Flink SQL statements for your job in the DLI SQL editor. This section describes how to use the SQL editor to write Flink SQL statements.</p>
<p id="dli_01_0455__p0792237205215"><a href="dli_01_0498.html">DLI Flink OpenSource SQL jobs</a> are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the community. In addition, Redis, DWS(GaussDB), and DIS data source types are added based on the community connector.</p>
<div class="section" id="dli_01_0455__section9243114805018"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0455__ul32010161007"><li id="dli_01_0455__li142013162002">You have prepared the data input and data output channels. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>.</li><li id="dli_01_0455__li7520181309">When you use a Flink SQL job to access other external data sources, such as OpenTSDB, HBase, Kafka, DWS, RDS, CSS, CloudTable, DCS Redis, and DDS Mongos, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0455__ul3477133419715"><li id="dli_01_0455__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Datasource Connection and Cross-Source Analysis</a>.</li><li id="dli_01_0455__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>. After a datasource connection is created, you can choose <strong id="dli_01_0455__b136411947171620">More</strong> &gt; <strong id="dli_01_0455__b8991851171618">Test Address Connectivity</strong> in the <strong id="dli_01_0455__b2161654131616">Operation</strong> column on the <strong id="dli_01_0455__b65150213175">Queue Management</strong> page to check whether the network connection between the queue and the external data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</li></ul>
<p id="dli_01_0455__p0792237205215"><a href="dli_01_0498.html">DLI Flink OpenSource SQL jobs</a> are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the community. In addition, Redis, GaussDB(DWS), and DIS data source types are added based on the community connector.</p>
<div class="section" id="dli_01_0455__section9243114805018"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0455__ul32010161007"><li id="dli_01_0455__li142013162002">You have prepared the data input and data output channels. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>.</li><li id="dli_01_0455__li7520181309">When you use a Flink SQL job to access other external data sources, such as OpenTSDB, HBase, Kafka, DWS, RDS, CSS, CloudTable, DCS Redis, and DDS MongoDB, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0455__ul3477133419715"><li id="dli_01_0455__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0455__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>. After a datasource connection is created, you can choose <strong id="dli_01_0455__b136411947171620">More</strong> &gt; <strong id="dli_01_0455__b8991851171618">Test Address Connectivity</strong> in the <strong id="dli_01_0455__b2161654131616">Operation</strong> column on the <strong id="dli_01_0455__b65150213175">Queue Management</strong> page to check whether the network connection between the queue and the external data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</li></ul>
</li></ul>
</div>
<div class="section" id="dli_01_0455__section28145411519"><h4 class="sectiontitle">Creating a Flink SQL Job</h4><ol id="dli_01_0455__ol15995121431920"><li id="dli_01_0455__li899510144197"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0455__menucascade10969155116523"><b><span class="uicontrol" id="dli_01_0455__uicontrol3969145120529">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0455__menucascade114421945855"><b><span class="uicontrol" id="dli_01_0455__uicontrol044254519511">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0455__wintitle6857152523411"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0455__li1832715401765"><span>In the upper right corner of the <span class="wintitle" id="dli_01_0455__wintitle149654113418"><b>Flink Jobs</b></span> page, click <span class="uicontrol" id="dli_01_0455__uicontrol1968964993415"><b>Create Job</b></span>.</span></li><li id="dli_01_0455__li1414012319596"><span>Specify job parameters.</span><p>
@ -27,7 +27,7 @@
</tr>
<tr id="dli_01_0455__row93625589418"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.3.2.1.2.3.1.1 "><p id="dli_01_0455__p183619581415">Description</p>
</td>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.4.2.3.2.1.2.3.1.2 "><p id="dli_01_0455__p17362758174118">Description of a job. It can contain up to 512 characters.</p>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.4.2.3.2.1.2.3.1.2 "><p id="dli_01_0455__p17362758174118">Description of a job. It can contain a maximum of 512 characters.</p>
</td>
</tr>
<tr id="dli_01_0455__row53646587415"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.3.2.1.2.3.1.1 "><p id="dli_01_0455__p2364958104115">Template Name</p>
@ -35,10 +35,23 @@
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.4.2.3.2.1.2.3.1.2 "><p id="dli_01_0455__p15364458144115">You can select a sample template or a custom job template. For details about templates, see <a href="dli_01_0464.html">Managing Flink Templates</a>.</p>
</td>
</tr>
<tr id="dli_01_0455__row258931813218"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.4.2.3.2.1.2.3.1.1 "><p id="dli_01_0455__p105901518162120">Tag</p>
</td>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.4.2.3.2.1.2.3.1.2 "><p id="dli_01_0455__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
<div class="note" id="dli_01_0455__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0455__dli_01_0363_ul1830018521911"><li id="dli_01_0455__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0455__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0455__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
<ul id="dli_01_0455__ul55819552289"><li id="dli_01_0455__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0455__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0455__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
<ul id="dli_01_0455__ul16911451899"><li id="dli_01_0455__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0455__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="dli_01_0455__li92195103200"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol1386273859193128"><b>OK</b></span> to enter the <span class="menucascade" id="dli_01_0455__menucascade72192010102011"><b><span class="uicontrol" id="dli_01_0455__uicontrol22198109204">Edit</span></b></span> page.</span></li><li id="dli_01_0455__li1058817119598"><span>Edit a Flink SQL job.</span><p><p id="dli_01_0455__p98569287311">Enter details SQL statements in the statement editing area. For details about SQL syntax, see the Data Lake Insight SQL Syntax Reference.</p>
</p></li><li id="dli_01_0455__li92195103200"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol13388103212398"><b>OK</b></span> to enter the editing page.</span></li><li id="dli_01_0455__li1058817119598"><span>Edit a Flink SQL job.</span><p><p id="dli_01_0455__p98569287311">Enter details SQL statements in the statement editing area. For details about SQL syntax, see the Data Lake Insight SQL Syntax Reference.</p>
</p></li><li id="dli_01_0455__li1220121020207"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol1642192517522"><b>Check Semantics</b></span>.</span><p><ul id="dli_01_0455__ul522031013207"><li id="dli_01_0455__li152200108206">You can <span class="uicontrol" id="dli_01_0455__uicontrol52850716184"><b>Debug</b></span> or <span class="uicontrol" id="dli_01_0455__uicontrol0988152784619"><b>Start</b></span> a job only after the semantic verification is successful.</li><li id="dli_01_0455__li15220710162011">If verification is successful, the message "The SQL semantic verification is complete. No error." will be displayed.</li><li id="dli_01_0455__li3220210122017">If verification fails, a red "X" mark will be displayed in front of each SQL statement that produced an error. You can move the cursor to the "X" mark to view error details and change the SQL statement as prompted.</li></ul>
</p></li><li id="dli_01_0455__li19229151020209"><span>Set job running parameters.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0455__table15162847029" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Running parameters</caption><thead align="left"><tr id="dli_01_0455__row715815471125"><th align="left" class="cellrowborder" valign="top" width="22.189999999999998%" id="mcps1.3.4.2.7.2.1.2.3.1.1"><p id="dli_01_0455__p1115818476214">Parameter</p>
@ -89,7 +102,7 @@
<tr id="dli_01_0455__row18647541958"><td class="cellrowborder" valign="top" width="22.189999999999998%" headers="mcps1.3.4.2.7.2.1.2.3.1.1 "><p id="dli_01_0455__p11348012112710">OBS Bucket</p>
</td>
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.4.2.7.2.1.2.3.1.2 "><p id="dli_01_0455__p7348161252715">OBS bucket to store job logs and checkpoint information. If the selected OBS bucket is not authorized, click <span class="uicontrol" id="dli_01_0455__uicontrol78081464210"><b>Authorize</b></span>.</p>
<div class="note" id="dli_01_0455__note675883711459"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__p193093317582">If both <span class="uicontrol" id="dli_01_0455__uicontrol34601155112115"><b>Enable Checkpointing</b></span> and <span class="uicontrol" id="dli_01_0455__uicontrol8465105572112"><b>Save Job Log</b></span> are selected, you only need to authorize OBS once.</p>
<div class="note" id="dli_01_0455__note675883711459"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__p193093317582">If <strong id="dli_01_0455__b10821821143915">Enable Checkpointing</strong> and <strong id="dli_01_0455__b18312210394">Save Job Log</strong> are both selected, you only need to authorize OBS once.</p>
</div></div>
</td>
</tr>
@ -99,7 +112,7 @@
<div class="caution" id="dli_01_0455__note01592479215"><span class="cautiontitle"> CAUTION: </span><div class="cautionbody"><p id="dli_01_0455__p9159947824">You are advised to select this parameter. Otherwise, no run log is generated after the job is executed. If the job is abnormal, the run log cannot be obtained for fault locating.</p>
</div></div>
<p id="dli_01_0455__p141596472219">If this option is selected, you need to set the following parameters:</p>
<div class="p" id="dli_01_0455__p10159647525"><span class="parmname" id="dli_01_0455__parmname2095574317192"><b>OBS Bucket</b></span>: Select an OBS bucket to store user job logs. If the selected OBS bucket is not authorized, click <span class="uicontrol" id="dli_01_0455__uicontrol17351463209"><b>Authorize</b></span>.<div class="note" id="dli_01_0455__note515914471629"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__p81591547627">If both <span class="uicontrol" id="dli_01_0455__uicontrol2030436459"><b>Enable Checkpointing</b></span> and <span class="uicontrol" id="dli_01_0455__uicontrol22834079"><b>Save Job Log</b></span> are selected, you only need to authorize OBS once.</p>
<div class="p" id="dli_01_0455__p10159647525"><span class="parmname" id="dli_01_0455__parmname2095574317192"><b>OBS Bucket</b></span>: Select an OBS bucket to store user job logs. If the selected OBS bucket is not authorized, click <span class="uicontrol" id="dli_01_0455__uicontrol17351463209"><b>Authorize</b></span>.<div class="note" id="dli_01_0455__note515914471629"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__p81591547627">If <strong id="dli_01_0455__b8719192313408">Enable Checkpointing</strong> and <strong id="dli_01_0455__b1971911230402">Save Job Log</strong> are both selected, you only need to authorize OBS once.</p>
</div></div>
</div>
</td>
@ -109,7 +122,7 @@
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.4.2.7.2.1.2.3.1.2 "><p id="dli_01_0455__p91598471423">Whether to report job exceptions, for example, abnormal job running or exceptions due to an insufficient balance, to users via SMS or email</p>
<p id="dli_01_0455__p215912471821">If this option is selected, you need to set the following parameters:</p>
<p id="dli_01_0455__p51591473211"><span class="parmname" id="dli_01_0455__parmname488102320195"><b>SMN Topic</b></span></p>
<p id="dli_01_0455__p61591247829">Select a user-defined SMN topic. For details about how to customize SMN topics, see <span class="filepath" id="dli_01_0455__filepath371593817476"><b>Creating a Topic</b></span> in the <em id="dli_01_0455__i1715153824715">Simple Message Notification User Guide</em>.</p>
<p id="dli_01_0455__p61591247829">Select a user-defined SMN topic. For details about how to create a custom SMN topic, see "Creating a Topic" in <em id="dli_01_0455__i188831724164115">Simple Message Notification User Guide</em>.</p>
</td>
</tr>
<tr id="dli_01_0455__row116044711219"><td class="cellrowborder" valign="top" width="22.189999999999998%" headers="mcps1.3.4.2.7.2.1.2.3.1.1 "><p id="dli_01_0455__p016017474211">Enable Checkpointing</p>
@ -117,7 +130,7 @@
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.4.2.7.2.1.2.3.1.2 "><p id="dli_01_0455__p1616018476219">Whether to enable job snapshots. If this function is enabled, jobs can be restored based on the checkpoints.</p>
<div class="p" id="dli_01_0455__p91601847123">If this option is selected, you need to set the following parameters:<ul id="dli_01_0455__ul1916054719213"><li id="dli_01_0455__li13160647425"><strong id="dli_01_0455__b229715251956">Checkpoint Interval</strong> indicates the interval for creating checkpoints. The value ranges from 1 to 999999, and the default value is <strong id="dli_01_0455__b8298525756">30</strong>.</li><li id="dli_01_0455__li181601476214"><span class="parmname" id="dli_01_0455__parmname937975317211"><b>Checkpoint Mode</b></span> can be set to either of the following values:<ul id="dli_01_0455__ul121605471821"><li id="dli_01_0455__li1316015475211"><strong id="dli_01_0455__b843991241219">At least once</strong>: Events are processed at least once.</li><li id="dli_01_0455__li416014713213"><strong id="dli_01_0455__b23541019122219">Exactly once</strong>: Events are processed only once.</li></ul>
</li></ul>
<ul id="dli_01_0455__ul161601047722"><li id="dli_01_0455__li1016018471214"><span class="parmname" id="dli_01_0455__parmname816305152217"><b>OBS Bucket</b></span>: Select an OBS bucket to store your checkpoints. If the selected OBS bucket is not authorized, click <span class="uicontrol" id="dli_01_0455__uicontrol7742929132915"><b>Authorize</b></span>.<div class="p" id="dli_01_0455__p181605471229">The checkpoint path is <em id="dli_01_0455__i15217181002319">Bucket name</em><strong id="dli_01_0455__b8520151982310">/jobs/checkpoint/</strong><em id="dli_01_0455__i8849192316232">Directory starting with the job ID</em>.<div class="note" id="dli_01_0455__note13160447220"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__p1316015471525">You only need to authorize OBS once for both <span class="uicontrol" id="dli_01_0455__uicontrol102435277226"><b>Enable Checkpointing</b></span> and <span class="uicontrol" id="dli_01_0455__uicontrol3243152752210"><b>Save Job Log</b></span>.</p>
<ul id="dli_01_0455__ul161601047722"><li id="dli_01_0455__li1016018471214"><span class="parmname" id="dli_01_0455__parmname816305152217"><b>OBS Bucket</b></span>: Select an OBS bucket to store your checkpoints. If the selected OBS bucket is not authorized, click <span class="uicontrol" id="dli_01_0455__uicontrol7742929132915"><b>Authorize</b></span>.<div class="p" id="dli_01_0455__p181605471229">The checkpoint path is <em id="dli_01_0455__i15217181002319">Bucket name</em><strong id="dli_01_0455__b8520151982310">/jobs/checkpoint/</strong><em id="dli_01_0455__i8849192316232">Directory starting with the job ID</em>.<div class="note" id="dli_01_0455__note13160447220"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0455__p1316015471525">If <strong id="dli_01_0455__b64131244134214">Enable Checkpointing</strong> and <strong id="dli_01_0455__b341314415426">Save Job Log</strong> are both selected, you only need to authorize OBS once.</p>
</div></div>
</div>
</li></ul>
@ -128,7 +141,7 @@
</td>
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.4.2.7.2.1.2.3.1.2 "><p id="dli_01_0455__p1316111471829">Whether to enable automatic restart. If this function is enabled, any job that has become abnormal will be automatically restarted.</p>
<p id="dli_01_0455__p1316117474214">If this option is selected, you need to set the following parameters:</p>
<ul id="dli_01_0455__ul1016114471221"><li id="dli_01_0455__li161611247924"><span class="parmname" id="dli_01_0455__parmname7802155151110"><b>Max. Retry Attempts</b></span>: maximum number of retry times upon an exception. The unit is <strong id="dli_01_0455__b227312261415">Times/hour</strong>.<ul id="dli_01_0455__ul16161104712211"><li id="dli_01_0455__li816184718215"><strong id="dli_01_0455__b6726650143">Unlimited</strong>: The number of retries is unlimited.</li><li id="dli_01_0455__li171611547823"><strong id="dli_01_0455__b362881016141">Limited</strong>: The number of retries is user-defined.</li></ul>
<ul id="dli_01_0455__ul1016114471221"><li id="dli_01_0455__li161611247924"><span class="parmname" id="dli_01_0455__parmname7802155151110"><b>Max. Retry Attempts</b></span>: maximum number of retry times upon an exception. The unit is times/hour.<ul id="dli_01_0455__ul16161104712211"><li id="dli_01_0455__li816184718215"><strong id="dli_01_0455__b6726650143">Unlimited</strong>: The number of retries is unlimited.</li><li id="dli_01_0455__li171611547823"><strong id="dli_01_0455__b362881016141">Limited</strong>: The number of retries is user-defined.</li></ul>
</li><li id="dli_01_0455__li18161247828"><span class="parmname" id="dli_01_0455__parmname1876818159142"><b>Restore Job from Checkpoint</b></span>: This parameter is available only when <span class="uicontrol" id="dli_01_0455__uicontrol10774171581410"><b>Enable Checkpointing</b></span> is selected.</li></ul>
</td>
</tr>
@ -152,10 +165,10 @@
</tbody>
</table>
</div>
</p></li><li id="dli_01_0455__li1221681812112"><span>(Optional) Debug parameters as required. The job debugging function is used only to verify the SQL logic and does not involve data write operations. For details, see <a href="dli_01_0458.html">Debugging a Flink Job</a>.</span></li><li id="dli_01_0455__li17823132175610"><span>(Optional) Set the runtime configuration as required. Set Custom Configuration to User-defined.</span></li><li id="dli_01_0455__li11229131018207"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol17229111020205"><b>Save</b></span>.</span></li><li id="dli_01_0455__li16242610152011"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol134129258530"><b>Start</b></span>. On the displayed <span class="wintitle" id="dli_01_0455__wintitle041892518535"><b>Start Flink Jobs</b></span> page, confirm the job specifications, and click <span class="uicontrol" id="dli_01_0455__uicontrol1441813255531"><b>Start Now</b></span> to start the job.</span><p><p id="dli_01_0455__p923161020209">After the job is started, the system automatically switches to the <span class="menucascade" id="dli_01_0455__menucascade1386410741211"><b><span class="uicontrol" id="dli_01_0455__uicontrol148598715121">Flink Jobs</span></b></span> page, and the created job is displayed in the job list. You can view the job status in the <span class="menucascade" id="dli_01_0455__menucascade98651075126"><b><span class="uicontrol" id="dli_01_0455__uicontrol4865167151220">Status</span></b></span> column. After a job is successfully submitted, the job status will change from <span class="menucascade" id="dli_01_0455__menucascade18547194018129"><b><span class="uicontrol" id="dli_01_0455__uicontrol12546114021218">Submitting</span></b></span> to <span class="menucascade" id="dli_01_0455__menucascade354794010120"><b><span class="uicontrol" id="dli_01_0455__uicontrol11547104012126">Running</span></b></span>. After the execution is complete, the message <strong id="dli_01_0455__b10775101051616">Completed</strong> is displayed.</p>
</p></li><li id="dli_01_0455__li17823132175610"><span>(Optional) Set the runtime configuration as required.</span></li><li id="dli_01_0455__li11229131018207"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol17229111020205"><b>Save</b></span>.</span></li><li id="dli_01_0455__li16242610152011"><span>Click <span class="uicontrol" id="dli_01_0455__uicontrol134129258530"><b>Start</b></span>. On the displayed <span class="wintitle" id="dli_01_0455__wintitle041892518535"><b>Start Flink Jobs</b></span> page, confirm the job specifications, and click <span class="uicontrol" id="dli_01_0455__uicontrol1441813255531"><b>Start Now</b></span> to start the job.</span><p><p id="dli_01_0455__p923161020209">After the job is started, the system automatically switches to the <span class="menucascade" id="dli_01_0455__menucascade1386410741211"><b><span class="uicontrol" id="dli_01_0455__uicontrol148598715121">Flink Jobs</span></b></span> page, and the created job is displayed in the job list. You can view the job status in the <span class="menucascade" id="dli_01_0455__menucascade98651075126"><b><span class="uicontrol" id="dli_01_0455__uicontrol4865167151220">Status</span></b></span> column. After a job is successfully submitted, the job status will change from <span class="menucascade" id="dli_01_0455__menucascade18547194018129"><b><span class="uicontrol" id="dli_01_0455__uicontrol12546114021218">Submitting</span></b></span> to <span class="menucascade" id="dli_01_0455__menucascade354794010120"><b><span class="uicontrol" id="dli_01_0455__uicontrol11547104012126">Running</span></b></span>. After the execution is complete, the message <strong id="dli_01_0455__b10775101051616">Completed</strong> is displayed.</p>
<p id="dli_01_0455__p1244644734517">If the job status is <span class="menucascade" id="dli_01_0455__menucascade75611515151619"><b><span class="uicontrol" id="dli_01_0455__uicontrol1856051511614">Submission failed</span></b></span> or <span class="menucascade" id="dli_01_0455__menucascade15611715151615"><b><span class="uicontrol" id="dli_01_0455__uicontrol135611315191612">Running exception</span></b></span>, the job submission failed or the job did not execute successfully. In this case, you can move the cursor over the status icon in the <span class="menucascade" id="dli_01_0455__menucascade21252631613"><b><span class="uicontrol" id="dli_01_0455__uicontrol5121426141615">Status</span></b></span> column of the job list to view the error details. You can click <span><img id="dli_01_0455__image1212122641612" src="en-us_image_0207655173.png"></span> to copy error information. After handling the fault based on the provided information, resubmit the job.</p>
<div class="note" id="dli_01_0455__note9631123617199"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0455__p063214367199">Other available buttons are as follows:</p>
<ul id="dli_01_0455__ul714032215234"><li id="dli_01_0455__li773855071616"><strong id="dli_01_0455__b842352706101945">Save As</strong>: Save the created job as a new job.</li><li id="dli_01_0455__li121391322172310"><strong id="dli_01_0455__b842352706101926">Debug</strong>: Perform job debugging. For details, see <a href="dli_01_0458.html">Debugging a Flink Job</a>.</li><li id="dli_01_0455__li1032014325312"><strong id="dli_01_0455__b12393474119">Format</strong>: Format the SQL statements in the editing box.</li><li id="dli_01_0455__li17139112215236"><strong id="dli_01_0455__b2070215674110">Set as Template</strong>: Set the created SQL statements as a job template.</li><li id="dli_01_0455__li914082202317"><strong id="dli_01_0455__b14351139184117">Theme Settings</strong>: Set the theme related parameters, including <strong id="dli_01_0455__b17325816172312">Font Size</strong>, <strong id="dli_01_0455__b132612165235">Wrap</strong>, and <strong id="dli_01_0455__b63271816192314">Page Style</strong>.</li></ul>
<ul id="dli_01_0455__ul714032215234"><li id="dli_01_0455__li773855071616"><strong id="dli_01_0455__b842352706101945">Save As</strong>: Save the created job as a new job.</li><li id="dli_01_0455__li1032014325312"><strong id="dli_01_0455__b12393474119">Format</strong>: Format the SQL statements in the editing box.</li><li id="dli_01_0455__li17139112215236"><strong id="dli_01_0455__b2070215674110">Set as Template</strong>: Set the created SQL statements as a job template.</li><li id="dli_01_0455__li914082202317"><strong id="dli_01_0455__b14351139184117">Theme Settings</strong>: Set the theme related parameters, including <strong id="dli_01_0455__b17325816172312">Font Size</strong>, <strong id="dli_01_0455__b132612165235">Wrap</strong>, and <strong id="dli_01_0455__b63271816192314">Page Style</strong>.</li></ul>
</div></div>
</p></li></ol>
</div>

34
docs/dli/umn/dli_01_0457.html
View File

@ -2,7 +2,7 @@
<h1 class="topictitle1">Creating a Flink Jar Job</h1>
<div id="body1574761279830"><p id="dli_01_0457__p76741043151420">This section describes how to create a Flink Jar job. You can perform secondary development based on Flink APIs, build your own JAR file, and submit the JAR file to DLI queues. DLI is fully compatible with open-source community APIs. To create a custom Flink job, you need to compile and build application JAR files. You must have a certain understanding of Flink secondary development and have high requirements related to stream computing complexity.</p>
<div class="section" id="dli_01_0457__section13123183424115"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0457__ul198451926172619"><li id="dli_01_0457__li51821947175614">Ensure that a dedicated queue has been created. To create a dedicated queue, select <strong id="dli_01_0457__b46637459575">Dedicated Resource Mode</strong> when you choose the type of a queue during purchase.</li><li id="dli_01_0457__li7520181309">When creating a Flink Jar job to access other external data sources, such as OpenTSDB, HBase, Kafka, DWS, RDS, CSS, CloudTable, DCS Redis, and DDS Mongos, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0457__ul850415199816"><li id="dli_01_0457__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Datasource Connection and Cross-Source Analysis</a>.</li><li id="dli_01_0457__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0457__p881561411413">On the <strong id="dli_01_0457__b1649571111716">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0457__b837601519329">More</strong> &gt; <strong id="dli_01_0457__b732214226329">Test Address Connectivity</strong> in the <strong id="dli_01_0457__b195861283312">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
<div class="section" id="dli_01_0457__section13123183424115"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_01_0457__ul198451926172619"><li id="dli_01_0457__li51821947175614">Ensure that a dedicated queue has been created. To create a dedicated queue, select <strong id="dli_01_0457__b46637459575">Dedicated Resource Mode</strong> when you choose the type of a queue during purchase.</li><li id="dli_01_0457__li7520181309">When creating a Flink Jar job to access other external data sources, such as OpenTSDB, HBase, Kafka, GaussDB(DWS), RDS, CSS, CloudTable, DCS Redis, and DDS MongoDB, you need to create a cross-source connection to connect the job running queue to the external data source.<ul id="dli_01_0457__ul850415199816"><li id="dli_01_0457__li18451528175">For details about the external data sources that can be accessed by Flink jobs, see <a href="dli_01_0410.html">Cross-Source Analysis Development Methods</a>.</li><li id="dli_01_0457__li28469131945">For details about how to create a datasource connection, see <a href="dli_01_0426.html">Enhanced Datasource Connections</a>.<p id="dli_01_0457__p881561411413">On the <strong id="dli_01_0457__b232324774013">Resources</strong> &gt; <strong id="dli_01_0457__b132414714406">Queue Management</strong> page, locate the queue you have created, and choose <strong id="dli_01_0457__b12324154712404">More</strong> &gt; <strong id="dli_01_0457__b432415477400">Test Address Connectivity</strong> in the <strong id="dli_01_0457__b4324847174012">Operation</strong> column to check whether the network connection between the queue and the data source is normal. For details, see <a href="dli_01_0489.html">Testing Address Connectivity</a>.</p>
</li></ul>
</li><li id="dli_01_0457__li17845142616266">When running a Flink Jar job, you need to build the secondary development application code into a Jar package and upload the JAR package to the created OBS bucket. Choose <strong id="dli_01_0457__b14988132715315">Data Management</strong> &gt; <strong id="dli_01_0457__b121417311332">Package Management</strong> to create a package. For details, see <a href="dli_01_0367.html">Creating a Package</a>.<div class="note" id="dli_01_0457__note38679553417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0457__p108692554412">DLI does not support the download function. If you need to modify the uploaded data file, please edit the local file and upload it again.</p>
</div></div>
@ -34,10 +34,24 @@
<td class="cellrowborder" valign="top" width="85.52%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0457__p567317241018">Description of a job. It can be up to 512 characters long.</p>
</td>
</tr>
<tr id="dli_01_0457__row19732328111712"><td class="cellrowborder" valign="top" width="14.48%" headers="mcps1.3.3.2.3.2.1.2.3.1.1 "><p id="dli_01_0457__p105901518162120">Tag</p>
</td>
<td class="cellrowborder" valign="top" width="85.52%" headers="mcps1.3.3.2.3.2.1.2.3.1.2 "><p id="dli_01_0457__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
<p id="dli_01_0457__p1617084433310">For details, see .</p>
<div class="note" id="dli_01_0457__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0457__dli_01_0363_ul1830018521911"><li id="dli_01_0457__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0457__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0457__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
<ul id="dli_01_0457__ul55819552289"><li id="dli_01_0457__li185895532814">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0457__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0457__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0457__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
<ul id="dli_01_0457__ul16911451899"><li id="dli_01_0457__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0457__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0457__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="dli_01_0457__li569314247015"><span>Click <span class="uicontrol" id="dli_01_0457__uicontrol8486132220520"><b>OK</b></span> to enter the page for job information editing.</span></li><li id="dli_01_0457__li106011835103311"><span>Select a queue. Flink Jar jobs can run only on dedicated queues.</span><p><div class="note" id="dli_01_0457__note218315571477"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0457__ul1483193318"><li id="dli_01_0457__li14853910315">A Flink Jar job can run only on a pre-created dedicated queue.</li><li id="dli_01_0457__li154851897310">If no dedicated queue is available in the <span class="parmname" id="dli_01_0457__parmname4176751379"><b>Queue</b></span> drop-down list, create a dedicated queue and bind it to the current user.</li></ul>
</p></li><li id="dli_01_0457__li569314247015"><span>Click <span class="uicontrol" id="dli_01_0457__uicontrol926491019414"><b>OK</b></span> to enter the editing page.</span></li><li id="dli_01_0457__li106011835103311"><span>Select a queue. Flink Jar jobs can run only on dedicated queues.</span><p><div class="note" id="dli_01_0457__note218315571477"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0457__ul1483193318"><li id="dli_01_0457__li14853910315">A Flink Jar job can run only on a pre-created dedicated queue.</li><li id="dli_01_0457__li154851897310">If no dedicated queue is available in the <span class="parmname" id="dli_01_0457__parmname4176751379"><b>Queue</b></span> drop-down list, create a dedicated queue and bind it to the current user.</li></ul>
</div></div>
</p></li><li id="dli_01_0457__li8384853145814"><span>Configuring Flink Jar Job parameters</span><p><p id="dli_01_0457__p152312093718"></p>
<div class="p" id="dli_01_0457__p153016209375">
@ -47,9 +61,15 @@
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0457__row11524520183716"><td class="cellrowborder" valign="top" width="16.59%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.1 "><p id="dli_01_0457__p0523152013718">Application</p>
<tbody><tr id="dli_01_0457__row1980914463565"><td class="cellrowborder" valign="top" width="16.59%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.1 "><p id="dli_01_0457__p18243191711412">Queue</p>
</td>
<td class="cellrowborder" valign="top" width="83.41%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.2 "><p id="dli_01_0457__p1852492013376">User-defined package. Before selecting a JAR file to be inserted, upload the corresponding JAR file to the OBS bucket and choose <span class="menucascade" id="dli_01_0457__menucascade1484102618810"><b><span class="uicontrol" id="dli_01_0457__uicontrol19830261987">Data Management &gt; Package Management</span></b></span> to create a package. For details, see <a href="dli_01_0367.html">Creating a Package</a>. For details about the built-in dependencies, see <a href="dli_01_0397.html#dli_01_0397__section38822016193611">Flink 1.7.2 Dependencies</a> and <a href="dli_01_0397.html#dli_01_0397__section269411551620">Flink 1.10 Dependencies</a>.</p>
<td class="cellrowborder" valign="top" width="83.41%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.2 "><p id="dli_01_0457__p1361215284396">A shared queue is selected by default. You can select a custom queue as needed.</p>
</td>
</tr>
<tr id="dli_01_0457__row11524520183716"><td class="cellrowborder" valign="top" width="16.59%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.1 "><p id="dli_01_0457__p0523152013718">Application</p>
</td>
<td class="cellrowborder" valign="top" width="83.41%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.2 "><p id="dli_01_0457__p19704229123318">User-defined package. Before selecting a JAR file to be inserted, upload the corresponding JAR file to the OBS bucket and choose <strong id="dli_01_0457__b4130957134118">Data Management</strong> &gt; <strong id="dli_01_0457__b2987165974117">Package Management</strong> to create a package. For details, see <a href="dli_01_0367.html">Creating a Package</a>.</p>
<p id="dli_01_0457__p1852492013376">For details about built-in dependency packages, see <a href="dli_01_0397.html">Built-in Dependencies</a>.</p>
</td>
</tr>
<tr id="dli_01_0457__row16525820203716"><td class="cellrowborder" valign="top" width="16.59%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.1 "><p id="dli_01_0457__p2052412012375">Main Class</p>
@ -70,7 +90,7 @@
</td>
<td class="cellrowborder" valign="top" width="83.41%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.2 "><p id="dli_01_0457__p75265201373">Select a user-defined package dependency. The dependent program packages are stored in the classpath directory of the cluster.</p>
<p id="dli_01_0457__p8527420193715">Before selecting a JAR file to be inserted, upload the corresponding JAR file to the OBS bucket and choose <span class="menucascade" id="dli_01_0457__menucascade1874413251551"><b><span class="uicontrol" id="dli_01_0457__uicontrol9743925252">Data Management &gt; Package Management</span></b></span> to create a package. Select <strong id="dli_01_0457__b77445251852">JAR</strong> as the package type. For details, see <a href="dli_01_0367.html">Creating a Package</a>.</p>
<p id="dli_01_0457__p552711206373">For details about the built-in dependencies, see <a href="dli_01_0397.html#dli_01_0397__section38822016193611">Flink 1.7.2 Dependencies</a> and <a href="dli_01_0397.html#dli_01_0397__section269411551620">Flink 1.10 Dependencies</a>.</p>
<p id="dli_01_0457__p552711206373">For details about built-in dependency packages, see <a href="dli_01_0397.html">Built-in Dependencies</a>.</p>
</td>
</tr>
<tr id="dli_01_0457__row11528102033715"><td class="cellrowborder" valign="top" width="16.59%" headers="mcps1.3.3.2.6.2.2.1.2.3.1.1 "><p id="dli_01_0457__p852702017373">Other Dependencies</p>
@ -105,7 +125,7 @@
</thead>
<tbody><tr id="dli_01_0457__row1951903815407"><td class="cellrowborder" valign="top" width="16.220000000000002%" headers="mcps1.3.3.2.7.2.1.2.3.1.1 "><p id="dli_01_0457__p051983817405">CUs</p>
</td>
<td class="cellrowborder" valign="top" width="83.78%" headers="mcps1.3.3.2.7.2.1.2.3.1.2 "><p id="dli_01_0457__p1519153814405">One CU has one vCPU and 4-GB memory. The number of CUs ranges from 2 to 400.</p>
<td class="cellrowborder" valign="top" width="83.78%" headers="mcps1.3.3.2.7.2.1.2.3.1.2 "><p id="dli_01_0457__p1519153814405">One CU has one vCPU and 4-GB memory. The number of CUs ranges from 2 to 10,000.</p>
</td>
</tr>
<tr id="dli_01_0457__row1152053811400"><td class="cellrowborder" valign="top" width="16.220000000000002%" headers="mcps1.3.3.2.7.2.1.2.3.1.1 "><p id="dli_01_0457__p151919386406">Job Manager CUs</p>
@ -115,7 +135,7 @@
</tr>
<tr id="dli_01_0457__row252103844018"><td class="cellrowborder" valign="top" width="16.220000000000002%" headers="mcps1.3.3.2.7.2.1.2.3.1.1 "><p id="dli_01_0457__p14520113884014">Parallelism</p>
</td>
<td class="cellrowborder" valign="top" width="83.78%" headers="mcps1.3.3.2.7.2.1.2.3.1.2 "><p id="dli_01_0457__p952018383405">Maximum number of parallel operators in a job.</p>
<td class="cellrowborder" valign="top" width="83.78%" headers="mcps1.3.3.2.7.2.1.2.3.1.2 "><p id="dli_01_0457__p952018383405">Maximum number of parallel operators in a job. The value ranges from 1 to 10,000.</p>
<div class="note" id="dli_01_0457__note252173884012"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0457__ul55215387403"><li id="dli_01_0457__li175208387405">The value must be less than or equal to four times the number of compute units (CUs minus the number of job manager CUs).</li><li id="dli_01_0457__li19520173818405">You are advised to set this parameter to a value greater than that configured in the code. Otherwise, job submission may fail.</li></ul>
</div></div>
</td>

25
docs/dli/umn/dli_01_0458.html
View File

@ -1,25 +0,0 @@
<a name="dli_01_0458"></a><a name="dli_01_0458"></a>
<h1 class="topictitle1">Debugging a Flink Job</h1>
<div id="body1574761281789"><p id="dli_01_0458__p15390943104017">The job debugging function helps you check the logic correctness of your compiled SQL statements before running a job.</p>
<div class="note" id="dli_01_0458__note117456916519"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0458__ul11529173814143"><li id="dli_01_0458__li753012384147">Currently, only Flink SQL jobs support this function.</li><li id="dli_01_0458__li1753093891415">The job debugging function is used only to verify the SQL logic and does not involve data write operations.</li></ul>
</div></div>
<div class="section" id="dli_01_0458__section610115011434"><h4 class="sectiontitle">Procedures</h4><ol id="dli_01_0458__ol077443514394"><li id="dli_01_0458__li561395535111"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0458__menucascade1078623412516"><b><span class="uicontrol" id="dli_01_0458__uicontrol4780133413257">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0458__menucascade778673418253"><b><span class="uicontrol" id="dli_01_0458__uicontrol15786123452515">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0458__wintitle378733432519"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0458__li161312138523"><span>In the <span class="menucascade" id="dli_01_0458__menucascade4828124195311"><b><span class="uicontrol" id="dli_01_0458__uicontrol1882819241538">Operation</span></b></span> column of the created Flink SQL job, click <span class="uicontrol" id="dli_01_0458__uicontrol1988815318542"><b>Edit</b></span>. The page for editing the Flink SQL job is displayed.</span><p><p id="dli_01_0458__p78341740175220">For a job that is being created, you can debug the job on the editing page.</p>
</p></li><li id="dli_01_0458__li2280172114275"><span>Click <span class="uicontrol" id="dli_01_0458__uicontrol7981124473618"><b>Debug</b></span> above the SQL editing box to parse the edited SQL statements. The <span class="menucascade" id="dli_01_0458__menucascade938109471145557"><b><span class="uicontrol" id="dli_01_0458__uicontrol1350739082144221">Debugging Parameters</span></b></span> tab is displayed on the right of the page.</span><p><p id="dli_01_0458__p1521749101214"></p>
<p id="dli_01_0458__p052213492120"></p>
<ul id="dli_01_0458__ul2052214931214"><li id="dli_01_0458__li1452254991219"><span class="parmname" id="dli_01_0458__parmname1723183812345"><b>Dump Bucket</b></span>: Select an OBS bucket to save debugging logs. If you select an unauthorized OBS bucket, click <span class="uicontrol" id="dli_01_0458__uicontrol6231938133413"><b>Authorize</b></span>.</li><li id="dli_01_0458__li125229499124"><span class="parmname" id="dli_01_0458__parmname93421511205614"><b>Data Input Mode</b></span>: You can select CSV data stored in the OBS bucket or manually enter the data.<ul id="dli_01_0458__ul3522104912122"><li id="dli_01_0458__li25221949171211"><span class="parmvalue" id="dli_01_0458__parmvalue2165183911566"><b>OBS (CSV)</b></span><p id="dli_01_0458__p1552264991217">If you select this value, prepare OBS data first before using DLI. For details, see <a href="dli_01_0454.html">Preparing Flink Job Data</a>. OBS data is stored in CSV format, where multiple records are separated by line breaks and different fields in a single record are separated by commas (,). In addition, you need to select a specific object in OBS as the input source data.</p>
<p id="dli_01_0458__p17522134961216"></p>
</li><li id="dli_01_0458__li552254921212"><span class="parmvalue" id="dli_01_0458__parmvalue109470199816"><b>Manual typing</b></span><p id="dli_01_0458__p125221249181216">If you select this value, compile SQL statements as data sources. In this mode, you need to enter the value of each field in a single record.</p>
<p id="dli_01_0458__p7522174916121"></p>
</li></ul>
</li></ul>
</p></li><li id="dli_01_0458__li15234164712911"><span>Click <span class="uicontrol" id="dli_01_0458__uicontrol891873687145739"><b>Start Debugging</b></span>. Once debugging is complete, the <span class="menucascade" id="dli_01_0458__menucascade13235934814584"><b><span class="uicontrol" id="dli_01_0458__uicontrol209383070414584">Debugging Result</span></b></span> page appears.</span><p><ul id="dli_01_0458__ul293616433915"><li id="dli_01_0458__li18935143391">If the debugging result meets the expectation, the job is running properly.</li><li id="dli_01_0458__li793614438920">If the debugging result does not meet the expectation, business logic errors may have occurred. In this case, modify SQL statements and conduct debugging again.</li></ul>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Flink Job Management</a></div>
</div>
</div>

17
docs/dli/umn/dli_01_0461.html
View File

@ -4,7 +4,7 @@
<div id="body1574761287036"><p id="dli_01_0461__p14627103122810">After a job is created, you can perform operations on the job as required.</p>
<ul id="dli_01_0461__ul1874912353535"><li id="dli_01_0461__li974912354536"><a href="#dli_01_0461__section1950210297542">Editing a Job</a></li><li id="dli_01_0461__li12749123525312"><a href="#dli_01_0461__section20957159163012">Starting a Job</a></li><li id="dli_01_0461__li274973517537"><a href="#dli_01_0461__section8678193324114">Stopping a Job</a></li><li id="dli_01_0461__li13749183512534"><a href="#dli_01_0461__section1691624195713">Deleting a Job</a></li><li id="dli_01_0461__li162522214328"><a href="#dli_01_0461__section135831511323">Exporting a Job</a></li><li id="dli_01_0461__li26711525131014"><a href="#dli_01_0461__section75781665389">Importing a Job</a></li><li id="dli_01_0461__li99767461357"><a href="#dli_01_0461__section15861321183619">Modifying Name and Description</a></li><li id="dli_01_0461__li1484544017293"><a href="#dli_01_0461__section83412445175">Importing to a Savepoint</a></li><li id="dli_01_0461__li170017185493"><a href="#dli_01_0461__section11401152191015">Triggering a Savepoint</a></li><li id="dli_01_0461__li151651511113117"><a href="#dli_01_0461__section48961252113110">Runtime Configuration</a></li></ul>
<div class="section" id="dli_01_0461__section1950210297542"><a name="dli_01_0461__section1950210297542"></a><a name="section1950210297542"></a><h4 class="sectiontitle">Editing a Job</h4><p id="dli_01_0461__p1793816566544">You can edit a created job, for example, by modifying the SQL statement, job name, job description, or job configurations.</p>
<ol id="dli_01_0461__ol866211392578"><li id="dli_01_0461__li11662133945716"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade13460710142610"><b><span class="uicontrol" id="dli_01_0461__uicontrol445412100263">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0461__menucascade1146020108267"><b><span class="uicontrol" id="dli_01_0461__uicontrol2460171011264">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle546012107266"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0461__li166716381752"><span>In the row where the job you want to edit locates, click <span class="uicontrol" id="dli_01_0461__en-us_topic_0084895458_uicontrol1883761772155951"><b>Edit</b></span> in the <span class="parmname" id="dli_01_0461__en-us_topic_0084895458_parmname13844356781602"><b>Operation</b></span> column to switch to the <span class="wintitle" id="dli_01_0461__en-us_topic_0084895458_wintitle35693077716316"><b>Edit</b></span> page.</span></li><li id="dli_01_0461__li17203554191612"><span>Edit the job as required.</span><p><p id="dli_01_0461__p12203854161615">For details about how to edit a Flink SQL job, see Step 5 to Step 7 in <a href="dli_01_0455.html">Creating a Flink SQL Job</a>.</p>
<ol id="dli_01_0461__ol866211392578"><li id="dli_01_0461__li11662133945716"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade13460710142610"><b><span class="uicontrol" id="dli_01_0461__uicontrol445412100263">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0461__menucascade1146020108267"><b><span class="uicontrol" id="dli_01_0461__uicontrol2460171011264">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle546012107266"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0461__li166716381752"><span>In the row where the job you want to edit locates, click <span class="uicontrol" id="dli_01_0461__uicontrol12664846194317"><b>Edit</b></span> in the <span class="parmname" id="dli_01_0461__parmname866564664314"><b>Operation</b></span> column to switch to the editing page.</span></li><li id="dli_01_0461__li17203554191612"><span>Edit the job as required.</span><p><p id="dli_01_0461__p12203854161615">For details about how to edit a Flink SQL job, see Step 5 to Step 7 in <a href="dli_01_0455.html">Creating a Flink SQL Job</a>.</p>
<p id="dli_01_0461__p369185110117">For details about how to edit a user-defined Flink job, see Step 5 to Step 7 in <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</p>
</p></li></ol>
</div>
@ -19,7 +19,7 @@
</div>
<div class="section" id="dli_01_0461__section8678193324114"><a name="dli_01_0461__section8678193324114"></a><a name="section8678193324114"></a><h4 class="sectiontitle">Stopping a Job</h4><p id="dli_01_0461__p10413556134214">You can stop a job in the <strong id="dli_01_0461__b199511322168">Running</strong> or <span class="parmvalue" id="dli_01_0461__parmvalue16170152024918"><b>Submitting</b></span> state.</p>
<ol id="dli_01_0461__ol999765714431"><li id="dli_01_0461__li1537162515919"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade4839243185810"><b><span class="uicontrol" id="dli_01_0461__uicontrol7834114315813">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0461__menucascade3839143155817"><b><span class="uicontrol" id="dli_01_0461__uicontrol17839124317581">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle984019439581"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0461__li97556283351"><span>Stop a job using either of the following methods:</span><p><ul id="dli_01_0461__ul1663022133517"><li id="dli_01_0461__li1684613360294">Stopping a job<p id="dli_01_0461__p539375319543"><a name="dli_01_0461__li1684613360294"></a><a name="li1684613360294"></a>Locate the row that contains the job to be stopped, click <span class="uicontrol" id="dli_01_0461__uicontrol14303162712597"><b>More</b></span> in the <span class="parmname" id="dli_01_0461__parmname5957193318596"><b>Operation</b></span> column, and select <span class="uicontrol" id="dli_01_0461__uicontrol34263915919"><b>Stop</b></span>.</p>
<p id="dli_01_0461__p1224864211298">Alternatively, you can select the row where the job you want to stop locates and click <span class="uicontrol" id="dli_01_0461__uicontrol139240364"><b>Stop</b></span> in the upper left of the job list.</p>
<p id="dli_01_0461__p1224864211298">Alternatively, you can select the row where the job you want to stop locates and click <span class="uicontrol" id="dli_01_0461__uicontrol1460464143"><b>Stop</b></span> in the upper left of the job list.</p>
</li><li id="dli_01_0461__li103984412300">Batch stopping jobs<p id="dli_01_0461__p1176518147308"><a name="dli_01_0461__li103984412300"></a><a name="li103984412300"></a>Locate the rows containing the jobs you want to stop and click <span class="uicontrol" id="dli_01_0461__uicontrol1927821713351"><b>Stop</b></span> in the upper left of the job list.</p>
</li></ul>
</p></li><li id="dli_01_0461__li14333204535219"><span>In the displayed <span class="wintitle" id="dli_01_0461__wintitle1796120483017"><b>Stop Job</b></span> dialog box, click <span class="uicontrol" id="dli_01_0461__uicontrol1453612541409"><b>OK</b></span> to stop the job.</span><p><div class="p" id="dli_01_0461__p167175381238"><div class="note" id="dli_01_0461__note16893119216"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0461__ul186891211102111"><li id="dli_01_0461__li768881110218">Before stopping a job, you can trigger a savepoint to save the job status information. When you start the job again, you can choose whether to restore the job from the savepoint.</li><li id="dli_01_0461__li5688161116219">If you select <strong id="dli_01_0461__b1533414174116">Trigger savepoint</strong>, a savepoint is created. If <strong id="dli_01_0461__b108781513154118">Trigger savepoint</strong> is not selected, no savepoint is created. By default, the savepoint function is disabled.</li><li id="dli_01_0461__li106891811102110">The lifecycle of a savepoint starts when the savepoint is triggered and stops the job, and ends when the job is restarted. The savepoint is automatically deleted after the job is restarted.</li></ul>
@ -47,12 +47,12 @@
</div>
<div class="section" id="dli_01_0461__section75781665389"><a name="dli_01_0461__section75781665389"></a><a name="section75781665389"></a><h4 class="sectiontitle">Importing a Job</h4><p id="dli_01_0461__p195783616382">You can import the Flink job configuration file stored in the OBS bucket to the <strong id="dli_01_0461__b462516574455">Flink Jobs</strong> page of DLI.</p>
<p id="dli_01_0461__p1629324710420">This mode is applicable to the scenario where a large number of jobs need to be created when you switch to another region, project, or user. In this case, you do not need to create a job. You only need to export the original job, log in to the system in a new region or project, or use a new user to import the job.</p>
<p id="dli_01_0461__p474110307448">If you need to import a self-created job, you are advised to use the job creation function. For details, see <a href="dli_01_0455.html">Creating a Flink SQL Job</a>, <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</p>
<p id="dli_01_0461__p474110307448">If you need to import a self-created job, you are advised to use the job creation function. For details, see <a href="dli_01_0455.html">Creating a Flink SQL Job</a> and <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</p>
<div class="note" id="dli_01_0461__note10293547104214"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0461__ul152587411449"><li id="dli_01_0461__li1425816414446">When switching to another project or user, you need to grant permissions to the new project or user. For details, see <a href="dli_01_0479.html">Managing Flink Job Permissions</a>.</li><li id="dli_01_0461__li125913474417">Only jobs whose data format is the same as that of Flink jobs exported from DLI can be imported.</li></ul>
</div></div>
<ol id="dli_01_0461__ol55781266387"><li id="dli_01_0461__li1757816618386"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade113281655173817"><b><span class="uicontrol" id="dli_01_0461__uicontrol183274559388">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0461__menucascade432875583817"><b><span class="uicontrol" id="dli_01_0461__uicontrol1932814554388">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle1432819554381"><b>Flink Jobs</b></span> page is displayed.</span></li></ol><ol start="2" id="dli_01_0461__ol19578136113820"><li id="dli_01_0461__li12976193720419"><span>Click <span class="uicontrol" id="dli_01_0461__uicontrol78907524411"><b>Import Job</b></span> in the upper right corner. The <span class="wintitle" id="dli_01_0461__wintitle10552525174113"><b>Import Job</b></span> dialog box is displayed.</span><p><p id="dli_01_0461__p778004722517"></p>
</p></li><li id="dli_01_0461__li165786615385"><span>Select the complete OBS path of the job configuration file to be imported. Click <span class="uicontrol" id="dli_01_0461__uicontrol296424514417"><b>Next</b></span>.</span></li><li id="dli_01_0461__li6199827194519"><span>Configure the same-name job policy and click next. Click <span class="uicontrol" id="dli_01_0461__uicontrol113581820114619"><b>Next</b></span>.</span><p><ul id="dli_01_0461__ul61271837174515"><li id="dli_01_0461__li17128193754520">Select <span class="wintitle" id="dli_01_0461__wintitle15193110175012"><b>Overwrite job of the same name</b></span>. If the name of the job to be imported already exists, the existing job configuration will be overwritten and the job status switches to <strong id="dli_01_0461__b134195919519">Draft</strong>.</li><li id="dli_01_0461__li12456144610452">If <span class="wintitle" id="dli_01_0461__wintitle19380194316511"><b>Overwrite job of the same name</b></span> is not selected and the name of the job to be imported already exists, the job will not be imported.</li></ul>
</p></li><li id="dli_01_0461__li12578566385"><span>Ensure that <strong id="dli_01_0461__b55309219536">Config File</strong> and <strong id="dli_01_0461__b68521040145313">Overwrite Same-Name Job</strong> are correctly configured. Click <span class="uicontrol" id="dli_01_0461__uicontrol158241845175314"><b>Confirm</b></span> to export the job.</span></li></ol>
</p></li><li id="dli_01_0461__li12578566385"><span>Ensure that <strong id="dli_01_0461__b55309219536">Config File</strong> and <strong id="dli_01_0461__b68521040145313">Overwrite Same-Name Job</strong> are correctly configured. Click <span class="uicontrol" id="dli_01_0461__uicontrol158241845175314"><b>Confirm</b></span> to import the job.</span></li></ol>
</div>
<div class="section" id="dli_01_0461__section15861321183619"><a name="dli_01_0461__section15861321183619"></a><a name="section15861321183619"></a><h4 class="sectiontitle">Modifying Name and Description</h4><p id="dli_01_0461__p103435523374">You can change the job name and description as required.</p>
<ol id="dli_01_0461__ol313811191119"><li id="dli_01_0461__li613891119111"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0461__menucascade13641126848"><b><span class="uicontrol" id="dli_01_0461__uicontrol19641326544">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0461__menucascade36411626344"><b><span class="uicontrol" id="dli_01_0461__uicontrol6641826045">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle064217268412"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0461__li1616613121426"><span>In the <span class="parmname" id="dli_01_0461__parmname6935035142"><b>Operation</b></span> column of the job whose name and description need to be modified, choose <span class="menucascade" id="dli_01_0461__menucascade569213064314"><b><span class="uicontrol" id="dli_01_0461__uicontrol1569210011431">More &gt; Modify Name and Description</span></b></span>. The <span class="wintitle" id="dli_01_0461__wintitle174868211557"><b>Modify Name and Description</b></span> dialog box is displayed. Change the name or modify the description of a job.</span></li><li id="dli_01_0461__li1365245111415"><span>Click <span class="uicontrol" id="dli_01_0461__uicontrol1555710432511"><b>OK</b></span>.</span></li></ol>
@ -75,7 +75,12 @@
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0461__row9415135074517"><td class="cellrowborder" valign="top" width="22.189999999999998%" headers="mcps1.3.13.4.2.2.2.3.1.1 "><p id="dli_01_0461__p1178862351913">Alarm Generation upon Job Exception</p>
<tbody><tr id="dli_01_0461__row1514014913216"><td class="cellrowborder" valign="top" width="22.189999999999998%" headers="mcps1.3.13.4.2.2.2.3.1.1 "><p id="dli_01_0461__p161412491521">Name</p>
</td>
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.13.4.2.2.2.3.1.2 "><p id="dli_01_0461__p191416491424">Job name.</p>
</td>
</tr>
<tr id="dli_01_0461__row9415135074517"><td class="cellrowborder" valign="top" width="22.189999999999998%" headers="mcps1.3.13.4.2.2.2.3.1.1 "><p id="dli_01_0461__p1178862351913">Alarm Generation upon Job Exception</p>
</td>
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.13.4.2.2.2.3.1.2 "><p id="dli_01_0461__p7788172313199">Whether to report job exceptions, for example, abnormal job running or exceptions due to an insufficient balance, to users via SMS or email.</p>
<p id="dli_01_0461__p7145192645819">If this option is selected, you need to set the following parameters:</p>
@ -88,7 +93,7 @@
<td class="cellrowborder" valign="top" width="77.81%" headers="mcps1.3.13.4.2.2.2.3.1.2 "><p id="dli_01_0461__p14416722154613">Whether to enable automatic restart. If this function is enabled, any job that has become abnormal will be automatically restarted.</p>
<p id="dli_01_0461__p182651820924">If this option is selected, you need to set the following parameters:</p>
<ul id="dli_01_0461__ul12114713615"><li id="dli_01_0461__li182111871362"><span class="parmname" id="dli_01_0461__parmname421954171315"><b>Max. Retry Attempts</b></span>: maximum number of retry times upon an exception. The unit is times/hour.<ul id="dli_01_0461__ul1442116221967"><li id="dli_01_0461__li18351183619"><strong id="dli_01_0461__b761584331320">Unlimited</strong>: The number of retries is unlimited.</li><li id="dli_01_0461__li132308401613"><strong id="dli_01_0461__b1571064491314">Limited</strong>: The number of retries is user-defined.</li></ul>
</li><li id="dli_01_0461__li72122071368"><span class="parmname" id="dli_01_0461__parmname1288514614138"><b>Restore Job from Checkpoint</b></span>: Restore the job from the saved checkpoint.<div class="note" id="dli_01_0461__note152266205264"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0461__p192031814330">For Flink streaming SQL jobs, you need to select <span class="uicontrol" id="dli_01_0461__uicontrol15982681500"><b>Enable Checkpoint</b></span> on the job editing page before configuring this parameter.</p>
</li><li id="dli_01_0461__li72122071368"><span class="parmname" id="dli_01_0461__parmname1288514614138"><b>Restore Job from Checkpoint</b></span>: Restore the job from the saved checkpoint.<div class="note" id="dli_01_0461__note128612016204"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0461__p178614012015">This parameter cannot be configured for Flink SQL jobs or Flink OpenSource SQL jobs.</p>
</div></div>
<p id="dli_01_0461__p188771621153314">If this parameter is selected, you need to set <strong id="dli_01_0461__b1673211211146">Checkpoint Path</strong> for Flink Jar jobs.</p>
<p id="dli_01_0461__p16925725172715"><span class="parmname" id="dli_01_0461__parmname1653831418142"><b>Checkpoint Path</b></span>: Select the checkpoint saving path. The checkpoint path must be the same as that you set in the application package. Note that the checkpoint path for each job must be unique. Otherwise, the checkpoint cannot be obtained. </p>

20
docs/dli/umn/dli_01_0462.html
View File

@ -38,15 +38,9 @@
<p id="dli_01_0462__p1420172423611">If your job runs on a custom queue with dedicated resources, this parameter is <strong id="dli_01_0462__b348824771210">Exclusive</strong>.</p>
</td>
</tr>
<tr id="dli_01_0462__row136467316590"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p1584131035913">Queue</p>
<tr id="dli_01_0462__row1431819522445"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p1859195814445">Flink Version</p>
</td>
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p15930174712362">If the queue where the job runs is a shared queue, the shared queue is displayed.</p>
<p id="dli_01_0462__p693064723616">If the queue where the job runs is a custom queue with dedicated resources, the queue name is displayed.</p>
</td>
</tr>
<tr id="dli_01_0462__row88332121599"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p356832210599">UDF Jar</p>
</td>
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p95096563715">This parameter is displayed when a non-shared queue is selected for the job and <strong id="dli_01_0462__b1937541617204">UDF Jar</strong> is configured.</p>
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p031865234420">Version of Flink selected for the job.</p>
</td>
</tr>
<tr id="dli_01_0462__row17146152555914"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p6146162575910">Runtime Configuration</p>
@ -109,16 +103,6 @@
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p750219316311">Maximum number of retry times upon an exception. <strong id="dli_01_0462__b1677917174142">Unlimited</strong> means the number is not limited.</p>
</td>
</tr>
<tr id="dli_01_0462__row878617191938"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p59872441582">Restore Job from Checkpoint</p>
</td>
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p11987124413813">Whether the job can be restored from a checkpoint</p>
</td>
</tr>
<tr id="dli_01_0462__row49896498173"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p34571726172514">ID</p>
</td>
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p74576268254">Job ID</p>
</td>
</tr>
<tr id="dli_01_0462__row16925540237"><td class="cellrowborder" valign="top" width="25.3%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0462__p9281102710918">Savepoint</p>
</td>
<td class="cellrowborder" valign="top" width="74.7%" headers="mcps1.3.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0462__p1281122714911">OBS path of the savepoint</p>

55
docs/dli/umn/dli_01_0463.html Normal file
View File

@ -0,0 +1,55 @@
<a name="dli_01_0463"></a><a name="dli_01_0463"></a>
<h1 class="topictitle1">Tag Management</h1>
<div id="body1574940187020"><p id="dli_01_0463__p985684415815">A tag is a key-value pair customized by users and used to identify cloud resources. It helps users to classify and search for cloud resources. A tag consists of a tag key and a tag value.</p>
<p id="dli_01_0463__p1650242964010">DLI allows you to add tags to Flink jobs. You can add tags to Flink jobs to identify information such as the project name, service type, and background. If you use tags in other cloud services, you are advised to create the same tag key-value pairs for cloud resources used by the same business to keep consistency.</p>
<p id="dli_01_0463__p16364141220591">DLI supports the following two types of tags:</p>
<ul id="dli_01_0463__ul75413231279"><li id="dli_01_0463__li1466720183510">Resource tags: indicate non-global tags created on DLI.</li></ul>
<ul id="dli_01_0463__ul1577516103102"><li id="dli_01_0463__li43733200318">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0463__p16703594315"><a name="dli_01_0463__li43733200318"></a><a name="li43733200318"></a></p>
</li></ul>
<p id="dli_01_0463__p790314107193">This section includes the following content:</p>
<ul id="dli_01_0463__ul7704102119455"><li id="dli_01_0463__li20703122120450"><a href="#dli_01_0463__section236374613167">Managing a Job Tag</a></li><li id="dli_01_0463__li1870314215454"><a href="#dli_01_0463__section911882919307">Searching for a Job by Tag</a></li></ul>
<div class="section" id="dli_01_0463__section236374613167"><a name="dli_01_0463__section236374613167"></a><a name="section236374613167"></a><h4 class="sectiontitle">Managing a Job Tag</h4><p id="dli_01_0463__p12367184618163">DLI allows you to add, modify, or delete tags for jobs.</p>
<ol id="dli_01_0463__ol113701546131616"><li id="dli_01_0463__li159548152199"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0463__menucascade124994288208"><b><span class="uicontrol" id="dli_01_0463__uicontrol448872872015">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0463__menucascade85006285206"><b><span class="uicontrol" id="dli_01_0463__uicontrol650032842012">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0463__wintitle145011628182012"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0463__li49543159191"><span>Click the name of the job to be viewed. The <span class="wintitle" id="dli_01_0463__wintitle1454183115208"><b>Job Details</b></span> page is displayed.</span></li><li id="dli_01_0463__li4382946161614"><span>Click <span class="uicontrol" id="dli_01_0463__uicontrol52445817430"><b>Tags</b></span> to display the tag information about the current job.</span></li><li id="dli_01_0463__li13387164631618"><span>Click <span class="uicontrol" id="dli_01_0463__uicontrol5390124691612"><b>Add/Edit Tag</b></span> to open to the <span class="wintitle" id="dli_01_0463__wintitle53916466169"><b>Add/Edit Tag</b></span> dialog box.</span></li><li id="dli_01_0463__li133932046111618"><span>Configure the tag parameters in the <span class="wintitle" id="dli_01_0463__wintitle1195401484101250"><b>Add/Edit Tag</b></span> dialog box.</span><p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0463__table139874691610" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Tag parameters</caption><thead align="left"><tr id="dli_01_0463__row1640724610160"><th align="left" class="cellrowborder" valign="top" width="12.94%" id="mcps1.3.8.3.5.2.1.2.3.1.1"><p id="dli_01_0463__p17410246121616">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="87.06%" id="mcps1.3.8.3.5.2.1.2.3.1.2"><p id="dli_01_0463__p154131746131615">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0463__row13417154613164"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.8.3.5.2.1.2.3.1.1 "><p id="dli_01_0463__p74201346111616">Tag key</p>
</td>
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.8.3.5.2.1.2.3.1.2 "><p id="dli_01_0463__p642018464167">You can perform the following operations:</p>
<ul id="dli_01_0463__ul6423144611162"><li id="dli_01_0463__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0463__p12169132323510"><a name="dli_01_0463__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the <span class="parmname" id="dli_01_0463__parmname86344567166"><b>Tag key</b></span> drop-down list. You can click <strong id="dli_01_0463__b152006091718">View predefined tags</strong> to go to the <strong id="dli_01_0463__b420017013179">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0463__b12001404179">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
<p id="dli_01_0463__p1926211187356"></p>
</li></ul>
<ul id="dli_01_0463__ul643911462165"><li id="dli_01_0463__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0463__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0463__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0463__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
</td>
</tr>
<tr id="dli_01_0463__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.8.3.5.2.1.2.3.1.1 "><p id="dli_01_0463__p345210468163">Tag value</p>
</td>
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.8.3.5.2.1.2.3.1.2 "><p id="dli_01_0463__p1545619468165">You can perform the following operations:</p>
<ul id="dli_01_0463__ul1045720469162"><li id="dli_01_0463__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0463__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0463__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0463__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
<div class="note" id="dli_01_0463__note647119469162"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0463__dli_01_0363_ul1830018521911"><li id="dli_01_0463__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0463__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0463__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
</p></li><li id="dli_01_0463__li5488164614169"><span>Click <span class="uicontrol" id="dli_01_0463__uicontrol1801153212211"><b>OK</b></span>.</span></li><li id="dli_01_0463__li6498346161614"><span>(Optional) In the tag list, locate the row where the tag you want to delete resides, click <span class="uicontrol" id="dli_01_0463__uicontrol7735155515565"><b>Delete</b></span> in the <span class="parmname" id="dli_01_0463__parmname873635585615"><b>Operation</b></span> column to delete the tag.</span></li></ol>
</div>
<div class="section" id="dli_01_0463__section911882919307"><a name="dli_01_0463__section911882919307"></a><a name="section911882919307"></a><h4 class="sectiontitle">Searching for a Job by Tag</h4><p id="dli_01_0463__p71223294305">If tags have been added to a job, you can search for the job by setting tag filtering conditions to quickly find it.</p>
<ol id="dli_01_0463__ol1112420293308"><li id="dli_01_0463__li312710296309"><span>In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0463__menucascade16563957123010"><b><span class="uicontrol" id="dli_01_0463__uicontrol4562057173011">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0463__menucascade11564185719306"><b><span class="uicontrol" id="dli_01_0463__uicontrol156395723011">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0463__wintitle17564155720306"><b>Flink Jobs</b></span> page is displayed.</span></li><li id="dli_01_0463__li151341229173013"><span>In the upper right corner of the page, click the search box and select <strong id="dli_01_0463__b1812818296469">Tags</strong>.</span></li><li id="dli_01_0463__li1814852953016"><span>Choose a tag key and value as prompted. If no tag key or value is available, create a tag for the job. For details, see <a href="#dli_01_0463__section236374613167">Managing a Job Tag</a>.</span></li><li id="dli_01_0463__li15162142923018"><span>Choose other tags to generate a tag combination for job search. </span></li><li id="dli_01_0463__li218492953015"><span>Click search icon. The target job will be displayed in the job list.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Flink Job Management</a></div>
</div>
</div>

53
docs/dli/umn/dli_01_0464.html
View File

@ -90,54 +90,67 @@
<td class="cellrowborder" valign="top" width="85.86%" headers="mcps1.3.6.3.1.2.3.3.2.3.1.2 "><p id="dli_01_0464__p9133101127">Description of a template. It contains 0 to 512 characters.</p>
</td>
</tr>
<tr id="dli_01_0464__row56071565108"><td class="cellrowborder" valign="top" width="14.14%" headers="mcps1.3.6.3.1.2.3.3.2.3.1.1 "><p id="dli_01_0464__p26171435204818">Tags</p>
</td>
<td class="cellrowborder" valign="top" width="85.86%" headers="mcps1.3.6.3.1.2.3.3.2.3.1.2 "><p id="dli_01_0464__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
<div class="note" id="dli_01_0464__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0464__dli_01_0363_ul1830018521911"><li id="dli_01_0464__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0464__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0464__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
</div></div>
<ul id="dli_01_0464__ul6617123554815"><li id="dli_01_0464__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0464__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0464__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0464__dli_01_0363_b544594615499">_sys_</strong>.</p>
</div></div>
</li></ul>
<ul id="dli_01_0464__ul16911451899"><li id="dli_01_0464__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0464__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0464__dli_01_0363_p4702194215507">A tag value can contain a maximum of 225 characters. Only letters, digits, spaces, and special characters (_.:=+-@) are allowed. The value cannot start or end with a space.</p>
</div></div>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</li><li id="dli_01_0464__li7422204313416">Click <span class="uicontrol" id="dli_01_0464__uicontrol202704898519184"><b>OK</b></span> to enter the <span class="menucascade" id="dli_01_0464__menucascade1479320427303"><b><span class="uicontrol" id="dli_01_0464__uicontrol1079374263018">Edit</span></b></span> page.<div class="p" id="dli_01_0464__p94701762559">The <a href="#dli_01_0464__table57746157116">Table 4</a> describes the parameters on the template editing page.
<div class="tablenoborder"><a name="dli_01_0464__table57746157116"></a><a name="table57746157116"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0464__table57746157116" frame="border" border="1" rules="all"><caption><b>Table 4 </b>Template parameters</caption><thead align="left"><tr id="dli_01_0464__row97759154113"><th align="left" class="cellrowborder" valign="top" width="19.75%" id="mcps1.3.6.3.1.2.4.3.2.2.3.1.1"><p id="dli_01_0464__p1977531516120">Parameter</p>
</li><li id="dli_01_0464__li7422204313416">Click <span class="uicontrol" id="dli_01_0464__uicontrol156761348913"><b>OK</b></span> to enter the editing page.<div class="p" id="dli_01_0464__p94701762559">The <a href="#dli_01_0464__table57746157116">Table 4</a> describes the parameters on the template editing page.
<div class="tablenoborder"><a name="dli_01_0464__table57746157116"></a><a name="table57746157116"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0464__table57746157116" frame="border" border="1" rules="all"><caption><b>Table 4 </b>Template parameters</caption><thead align="left"><tr id="dli_01_0464__row97759154113"><th align="left" class="cellrowborder" valign="top" width="19.75%" id="mcps1.3.6.3.1.2.4.2.2.2.3.1.1"><p id="dli_01_0464__p1977531516120">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="80.25%" id="mcps1.3.6.3.1.2.4.3.2.2.3.1.2"><p id="dli_01_0464__p1477501514119">Description</p>
<th align="left" class="cellrowborder" valign="top" width="80.25%" id="mcps1.3.6.3.1.2.4.2.2.2.3.1.2"><p id="dli_01_0464__p1477501514119">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0464__row552923111371"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p1653023193715">Name</p>
<tbody><tr id="dli_01_0464__row552923111371"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p1653023193715">Name</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p1053014316376">You can modify the template name.</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p1053014316376">You can modify the template name.</p>
</td>
</tr>
<tr id="dli_01_0464__row148316183817"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p1083101173811">Description</p>
<tr id="dli_01_0464__row148316183817"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p1083101173811">Description</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p283191123820">You can modify the template description.</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p283191123820">You can modify the template description.</p>
</td>
</tr>
<tr id="dli_01_0464__row776216413916"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p1876294103914">Saving Mode</p>
<tr id="dli_01_0464__row776216413916"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p1876294103914">Saving Mode</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><ul id="dli_01_0464__ul17263191433914"><li id="dli_01_0464__li52631014123918"><strong id="dli_01_0464__b53106521285">Save Here</strong>: Save the modification to the current template.</li><li id="dli_01_0464__li0417124116393"><strong id="dli_01_0464__b892311551387">Save as New</strong>: Save the modification as a new template.</li></ul>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><ul id="dli_01_0464__ul17263191433914"><li id="dli_01_0464__li52631014123918"><strong id="dli_01_0464__b53106521285">Save Here</strong>: Save the modification to the current template.</li><li id="dli_01_0464__li0417124116393"><strong id="dli_01_0464__b892311551387">Save as New</strong>: Save the modification as a new template.</li></ul>
</td>
</tr>
<tr id="dli_01_0464__row11775131511117"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p4776151514117">SQL statement editing area</p>
<tr id="dli_01_0464__row11775131511117"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p4776151514117">SQL statement editing area</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p883019141171">In the area, you can enter detailed SQL statements to implement business logic. For details about how to compile SQL statements, see Data Lake Insight SQL Syntax Reference.</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p883019141171">In the area, you can enter detailed SQL statements to implement business logic. For details about how to compile SQL statements, see Data Lake Insight SQL Syntax Reference.</p>
</td>
</tr>
<tr id="dli_01_0464__row877691510116"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p127779153118">Save</p>
<tr id="dli_01_0464__row877691510116"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p127779153118">Save</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p277716151116">Save the modifications.</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p277716151116">Save the modifications.</p>
</td>
</tr>
<tr id="dli_01_0464__row982893814405"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p3828143812406">Create Job</p>
<tr id="dli_01_0464__row982893814405"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p3828143812406">Create Job</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p9828938194011">Use the current template to create a job.</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p9828938194011">Use the current template to create a job.</p>
</td>
</tr>
<tr id="dli_01_0464__row15379135241612"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p1637916528169">Format</p>
<tr id="dli_01_0464__row15379135241612"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p1637916528169">Format</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p173809528166">Format SQL statements. After SQL statements are formatted, you need to compile SQL statements again.</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p173809528166">Format SQL statements. After SQL statements are formatted, you need to compile SQL statements again.</p>
</td>
</tr>
<tr id="dli_01_0464__row15591758111619"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.1 "><p id="dli_01_0464__p11593583164">Theme Settings</p>
<tr id="dli_01_0464__row15591758111619"><td class="cellrowborder" valign="top" width="19.75%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.1 "><p id="dli_01_0464__p11593583164">Theme Settings</p>
</td>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.3.2.2.3.1.2 "><p id="dli_01_0464__p1459115811610">Change the font size, word wrap, and page style (black or white background).</p>
<td class="cellrowborder" valign="top" width="80.25%" headers="mcps1.3.6.3.1.2.4.2.2.2.3.1.2 "><p id="dli_01_0464__p1459115811610">Change the font size, word wrap, and page style (black or white background).</p>
</td>
</tr>
</tbody>
@ -147,7 +160,7 @@
</li><li id="dli_01_0464__li1517911371076">In the SQL statement editing area, enter SQL statements to implement service logic. For details about how to compile SQL statements, see Data Lake Insight SQL Syntax Reference.</li><li id="dli_01_0464__li33446443617">After the SQL statement is edited, click <span class="uicontrol" id="dli_01_0464__uicontrol1783211917215"><b>Save</b></span> in the upper right corner to complete the template creation.</li><li id="dli_01_0464__li0849182834615">(Optional) If you do not need to modify the template, click <span class="uicontrol" id="dli_01_0464__uicontrol128948351227"><b>Create Job</b></span> in the upper right corner to create a job based on the current template. For details about how to create a job, see <a href="dli_01_0455.html">Creating a Flink SQL Job</a>, and <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</li></ol>
</li><li id="dli_01_0464__li45831519140">Creating a template based on an existing job template<ol id="dli_01_0464__ol49722217143"><li id="dli_01_0464__li159772213149">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0464__menucascade86051016151117"><b><span class="uicontrol" id="dli_01_0464__uicontrol1860591610114">Job Templates</span></b></span> &gt; <span class="menucascade" id="dli_01_0464__menucascade176054166113"><b><span class="uicontrol" id="dli_01_0464__uicontrol260531641113">Flink Templates</span></b></span>. Click the <span class="uicontrol" id="dli_01_0464__uicontrol16799277224"><b>Custom Templates</b></span> tab.</li><li id="dli_01_0464__li19692211411">In the row where the desired template is located in the custom template list, click <span class="uicontrol" id="dli_01_0464__uicontrol65482234919265"><b>Edit</b></span> under <span class="parmname" id="dli_01_0464__parmname1928163280192611"><b>Operation</b></span> to enter the <span class="menucascade" id="dli_01_0464__menucascade717692783192627"><b><span class="uicontrol" id="dli_01_0464__uicontrol1274856627192627">Edit</span></b></span> page.</li><li id="dli_01_0464__li157349464168">After the modification is complete, set <strong id="dli_01_0464__b136119912510">Saving Mode</strong> to <strong id="dli_01_0464__b152117121851">Save as New</strong>.</li><li id="dli_01_0464__li17971422171418">Click <span class="uicontrol" id="dli_01_0464__uicontrol16200193512"><b>Save</b></span> in the upper right corner to save the template as a new one.</li></ol>
</li></ul>
<ul id="dli_01_0464__ul1158422171419"><li id="dli_01_0464__li205813222142">Creating a template using a created job<ol id="dli_01_0464__ol25812228147"><li id="dli_01_0464__li561395535111">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0464__menucascade8206182142317"><b><span class="uicontrol" id="dli_01_0464__uicontrol12061621192312">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0464__menucascade12072021132312"><b><span class="uicontrol" id="dli_01_0464__uicontrol72071321172310">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0464__wintitle1120812192318"><b>Flink Jobs</b></span> page is displayed.</li><li id="dli_01_0464__li36141055105110">Click <span class="uicontrol" id="dli_01_0464__uicontrol64206322238"><b>Create Job</b></span> in the upper right corner. The <span class="wintitle" id="dli_01_0464__wintitle19787541202312"><b>Create Job</b></span> page is displayed.</li><li id="dli_01_0464__li6278163472519">Specify parameters as required.</li><li id="dli_01_0464__li87949711251">Click <span class="uicontrol" id="dli_01_0464__uicontrol1386273859193128"><b>OK</b></span> to enter the <span class="menucascade" id="dli_01_0464__menucascade1458295503193145"><b><span class="uicontrol" id="dli_01_0464__uicontrol558030873193145">Edit</span></b></span> page.</li><li id="dli_01_0464__li126427357269">After the SQL statement is compiled, click <span class="uicontrol" id="dli_01_0464__uicontrol153296181816"><b>Set as Template</b></span>.</li><li id="dli_01_0464__li10120103152811">In the <strong id="dli_01_0464__b84235270616486">Set as Template</strong> dialog box that is displayed, specify <span class="parmname" id="dli_01_0464__parmname84067369164825"><b>Name</b></span> and <span class="parmname" id="dli_01_0464__parmname1879618987164825"><b>Description</b></span> and click <span class="uicontrol" id="dli_01_0464__uicontrol1019699215164831"><b>OK</b></span>.</li></ol>
<ul id="dli_01_0464__ul1158422171419"><li id="dli_01_0464__li205813222142">Creating a template using a created job<ol id="dli_01_0464__ol25812228147"><li id="dli_01_0464__li561395535111">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0464__menucascade8206182142317"><b><span class="uicontrol" id="dli_01_0464__uicontrol12061621192312">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0464__menucascade12072021132312"><b><span class="uicontrol" id="dli_01_0464__uicontrol72071321172310">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0464__wintitle1120812192318"><b>Flink Jobs</b></span> page is displayed.</li><li id="dli_01_0464__li36141055105110">Click <span class="uicontrol" id="dli_01_0464__uicontrol64206322238"><b>Create Job</b></span> in the upper right corner. The <span class="wintitle" id="dli_01_0464__wintitle19787541202312"><b>Create Job</b></span> page is displayed.</li><li id="dli_01_0464__li6278163472519">Specify parameters as required.</li><li id="dli_01_0464__li87949711251">Click <span class="uicontrol" id="dli_01_0464__uicontrol1386273859193128"><b>OK</b></span> to enter the editing page.</li><li id="dli_01_0464__li126427357269">After the SQL statement is compiled, click <span class="uicontrol" id="dli_01_0464__uicontrol153296181816"><b>Set as Template</b></span>.</li><li id="dli_01_0464__li10120103152811">In the <strong id="dli_01_0464__b84235270616486">Set as Template</strong> dialog box that is displayed, specify <span class="parmname" id="dli_01_0464__parmname84067369164825"><b>Name</b></span> and <span class="parmname" id="dli_01_0464__parmname1879618987164825"><b>Description</b></span> and click <span class="uicontrol" id="dli_01_0464__uicontrol1019699215164831"><b>OK</b></span>.</li></ol>
</li><li id="dli_01_0464__li2094793182814">Creating a template based on the existing job<ol id="dli_01_0464__ol777724518321"><li id="dli_01_0464__li16775445103210">In the left navigation pane of the DLI management console, choose <span class="menucascade" id="dli_01_0464__menucascade1479904420242"><b><span class="uicontrol" id="dli_01_0464__uicontrol19798444172418">Job Management</span></b></span> &gt; <span class="menucascade" id="dli_01_0464__menucascade197994447240"><b><span class="uicontrol" id="dli_01_0464__uicontrol1579984432419">Flink Jobs</span></b></span>. The <span class="wintitle" id="dli_01_0464__wintitle3800104419243"><b>Flink Jobs</b></span> page is displayed.</li><li id="dli_01_0464__li187761245103216">In the job list, locate the row where the job that you want to set as a template resides, and click <span class="uicontrol" id="dli_01_0464__uicontrol914883611165135"><b>Edit</b></span> in the <span class="parmname" id="dli_01_0464__parmname105735368165142"><b>Operation</b></span> column.</li><li id="dli_01_0464__li10776845113214">After the SQL statement is compiled, click <span class="menucascade" id="dli_01_0464__menucascade1643917155208"><b><span class="uicontrol" id="dli_01_0464__uicontrol18439315192018">Set as Template</span></b></span>.</li><li id="dli_01_0464__li167773453321">In the <strong id="dli_01_0464__b108151444399">Set as Template</strong> dialog box that is displayed, specify <span class="parmname" id="dli_01_0464__parmname14815144897"><b>Name</b></span> and <span class="parmname" id="dli_01_0464__parmname18816844393"><b>Description</b></span> and click <span class="uicontrol" id="dli_01_0464__uicontrol081618441690"><b>OK</b></span>.</li></ol>
</li></ul>
</div>

16
docs/dli/umn/dli_01_0476.html
View File

@ -1,7 +1,8 @@
<a name="dli_01_0476"></a><a name="dli_01_0476"></a>
<h1 class="topictitle1">Global Variables</h1>
<div id="body1585470126556"><div class="section" id="dli_01_0476__section79715592428"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0476__p8060118">Global variables can be used to simplify complex parameters. For example, long and difficult variables can be replaced to improve the readability of SQL statements.</p>
<div id="body1585470126556"><div class="section" id="dli_01_0476__section79715592428"><h4 class="sectiontitle">What Is a Global Variable?</h4><p id="dli_01_0476__p1325182820272">DLI allows you to set variables that are frequently used during job development as global variables on the DLI management console. This avoids repeated definitions during job editing and reduces development and maintenance costs. Global variables can be used to replace long and difficult variables, simplifying complex parameters and improving the readability of SQL statements.</p>
<p id="dli_01_0476__p18532104113257">This section describes how to create a global variable.</p>
</div>
<div class="section" id="dli_01_0476__section1910480202411"><h4 class="sectiontitle">Creating Variables</h4><ol id="dli_01_0476__ol101671049115710"><li id="dli_01_0476__li1216717496572">In the navigation pane of the DLI console, choose <strong id="dli_01_0476__b5731101211489">Global Configuration</strong> &gt; <strong id="dli_01_0476__b1799752319522">Global Variables</strong>.</li><li id="dli_01_0476__li11674105415712">On the <strong id="dli_01_0476__b152526335525">Global Variables</strong> page, click <strong id="dli_01_0476__b225718337526">Create</strong> in the upper right corner to create a global variable.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0476__table15710625151416" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters description</caption><thead align="left"><tr id="dli_01_0476__row1771212551410"><th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.2.2.2.3.2.3.1.1"><p id="dli_01_0476__p4713132520147">Parameter</p>
@ -15,11 +16,6 @@
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.2.2.2.3.2.3.1.2 "><p id="dli_01_0476__p856985812415">Name of the created global variable.</p>
</td>
</tr>
<tr id="dli_01_0476__row1064151711229"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.3.2.3.1.1 "><p id="dli_01_0476__p66411517172215">Sensitive</p>
</td>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.2.2.2.3.2.3.1.2 "><p id="dli_01_0476__p3641117132215">If the value is sensitive information, such as passwords, set this parameter to <strong id="dli_01_0476__b11576172745315">Yes</strong>. Otherwise, set it to <strong id="dli_01_0476__b576119414542">No</strong>.</p>
</td>
</tr>
<tr id="dli_01_0476__row18950651122515"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.3.2.3.1.1 "><p id="dli_01_0476__p179511651202515">Value</p>
</td>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.2.2.2.3.2.3.1.2 "><p id="dli_01_0476__p495112513251">Global variable value.</p>
@ -28,18 +24,20 @@
</tbody>
</table>
</div>
<div class="note" id="dli_01_0476__note12830104723217"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0476__ul9760623113011"><li id="dli_01_0476__li1676182313011">Only whitelisted users are allowed to create sensitive variables. To use this function, submit a service ticket to the administrator.</li><li id="dli_01_0476__li18761142314302">If passwords or other sensitive information is involved, you can set variables as sensitive ones.</li></ul>
</div></div>
</li><li id="dli_01_0476__li073251925811">After creating a global variable, use <strong id="dli_01_0476__b83791710155420">{{xxxx}}</strong> in the SQL statement to replace the parameter value set as the global variable. <strong id="dli_01_0476__b1476052145415">xxxx</strong> indicates the variable name. For example, if you set global variable <strong id="dli_01_0476__b12182171914195">abc</strong> to represent the table name, replace the actual table name with <strong id="dli_01_0476__b1827018241196">{{abc}}</strong> in the table creation statement.<pre class="screen" id="dli_01_0476__screen12761219105816">create table {{table_name}} (String1 String, int4 int, varchar1 varchar(10))
partitioned by (int1 int,int2 int,int3 int)</pre>
<div class="note" id="dli_01_0476__note183371023201213"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0476__ul924042213298"><li id="dli_01_0476__li1624082212290">Only the user who creates a global variable can use the variable.</li><li id="dli_01_0476__li990193218295">Do not use global variables in <strong id="dli_01_0476__b587151315372">OPTIONS</strong> of the table creation statements.</li></ul>
<div class="note" id="dli_01_0476__note183371023201213"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0476__ul924042213298"><li id="dli_01_0476__li18316224144314">Existing sensitive variables can only be used by their respective creators. Other common global variables are shared by users under the same account and project.</li><li id="dli_01_0476__li990193218295">Do not use global variables in <strong id="dli_01_0476__b587151315372">OPTIONS</strong> of the table creation statements.</li></ul>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0476__section17117296169"><h4 class="sectiontitle">Modifying Variables</h4><p id="dli_01_0476__p1052363621613">On the <strong id="dli_01_0476__b1736614509483">Global Variables</strong> page, click <strong id="dli_01_0476__b83679506483">Modify</strong> in the <strong id="dli_01_0476__b8367125011487">Operation</strong> column of a variable to modify the variable value.</p>
<div class="note" id="dli_01_0476__note15151759141116"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0476__p15516105951114">Only the user who creates a global variable can modify the variable.</p>
<div class="note" id="dli_01_0476__note15151759141116"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0476__p10551113410448">If there are multiple global variables with the same name in the same project under an account, delete the redundant global variables to ensure that the global variables are unique in the same project. In this case, all users who have the permission to modify the global variables can change the variable values.</p>
</div></div>
</div>
<div class="section" id="dli_01_0476__section15942174351618"><h4 class="sectiontitle">Deleting Variables</h4><p id="dli_01_0476__p10226649151619">On the <strong id="dli_01_0476__b736112538487">Global Variables</strong> page, click <strong id="dli_01_0476__b13621953104814">Delete</strong> in the <strong id="dli_01_0476__b1036211532486">Operation</strong> column of a variable to delete the variable value.</p>
<div class="note" id="dli_01_0476__note1082305823417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0476__ul362499184916"><li id="dli_01_0476__li11625991498">Only the user who creates a global variable can delete the variable.</li><li id="dli_01_0476__li26256934919">After a variable is deleted, the variable cannot be used in SQL statements.</li></ul>
<div class="note" id="dli_01_0476__note1082305823417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0476__ul362499184916"><li id="dli_01_0476__li729263804817">If there are multiple global variables with the same name in the same project under an account, delete the global variables created by the user first. If there are only unique global variables, all users who have the delete permission can delete the global variables.</li><li id="dli_01_0476__li26256934919">After a variable is deleted, the variable cannot be used in SQL statements.</li></ul>
</div></div>
</div>
</div>

6
docs/dli/umn/dli_01_0477.html
View File

@ -1,7 +1,7 @@
<a name="dli_01_0477"></a><a name="dli_01_0477"></a>
<h1 class="topictitle1">Managing Permissions on Packages and Package Groups</h1>
<div id="body1587030207355"><div class="section" id="dli_01_0477__section1864417525477"><h4 class="sectiontitle">Scenarios</h4><ul id="dli_01_0477__ul12791459154715"><li id="dli_01_0477__li1579165994711">You can isolate package groups or packages allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0477__li14791559184720">The administrator and the owner of a package group or package have all permissions. You do not need to set permissions and the permissions cannot be modified by other users.</li><li id="dli_01_0477__li157965913479">When you set permissions on a package group or a package to a new user, the user group to which the user belongs must have the Tenant Guest permission. For details about the Tenant Guest permission and how to apply for the permission, see .</li></ul>
<div id="body1587030207355"><div class="section" id="dli_01_0477__section1864417525477"><h4 class="sectiontitle">Scenario</h4><ul id="dli_01_0477__ul12791459154715"><li id="dli_01_0477__li1579165994711">You can isolate package groups or packages allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0477__li14791559184720">The administrator and the owner of a package group or package have all permissions. You do not need to set permissions and the permissions cannot be modified by other users.</li><li id="dli_01_0477__li157965913479">When you set permissions on a package group or a package to a new user, the user group the user belong to must have the Tenant Guest permission. </li></ul>
</div>
<p id="dli_01_0477__p1821519126211">On the <span class="wintitle" id="dli_01_0477__wintitle11113815474"><b>Package Management</b></span> page, click <span class="uicontrol" id="dli_01_0477__uicontrol856214218513"><b>Manage Permissions</b></span> in the <strong id="dli_01_0477__b19527564517">Operation</strong> column of the target package. On the displayed <strong id="dli_01_0477__b16976102217517">User Permission Info</strong> page, you can grant permissions for the package group or package, set and revoke user permissions.</p>
<div class="note" id="dli_01_0477__note1319113011138"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0477__ul147622187210"><li id="dli_01_0477__li5762181811211">If you select a group when creating a package, you can manage permissions of the corresponding program package group.</li><li id="dli_01_0477__li1376219183220">If you select <strong id="dli_01_0477__b1064412212487">No grouping</strong> when creating a package, you can manage permissions of the corresponding package.</li></ul>
@ -58,9 +58,9 @@
</div>
<div class="section" id="dli_01_0477__section12864102317535"><h4 class="sectiontitle">Revoking Permissions on Package Groups and Packages</h4><p id="dli_01_0477__p9976152995316">Click <strong id="dli_01_0477__b1010011713170">Revoke Permission</strong> in the <strong id="dli_01_0477__b15301102016172">Operation</strong> column of a sub-user to revoke the user's permissions. After the operation, the sub-user does not have any permission on the package group or package.</p>
</div>
<div class="section" id="dli_01_0477__section1235152914400"><h4 class="sectiontitle">Permissions Description</h4><ul id="dli_01_0477__ul1867617414564"><li id="dli_01_0477__li1067618413560">Package group permissions<p id="dli_01_0477__p128599218433"><a name="dli_01_0477__li1067618413560"></a><a name="li1067618413560"></a>Querying permissions. A group owner can view the created package group and all packages in the group, and can also view package groups on which he or she has all permissions.</p>
<div class="section" id="dli_01_0477__section1235152914400"><h4 class="sectiontitle">Permissions Description</h4><ul id="dli_01_0477__ul1867617414564"><li id="dli_01_0477__li1067618413560">Package group permissions<p id="dli_01_0477__p128599218433"><a name="dli_01_0477__li1067618413560"></a><a name="li1067618413560"></a>Querying permissions. A group owner can view the created package group and all packages in the group, and can also view package groups on which they have all permissions.</p>
<p id="dli_01_0477__p1085914224310">A package group is a unit. If you select a group when creating a package, you can grant only the permissions of the package group to other users.</p>
</li><li id="dli_01_0477__li1138112716599">Package permissions<p id="dli_01_0477__p787385316559"><a name="dli_01_0477__li1138112716599"></a><a name="li1138112716599"></a>Querying permissions. A package owner can view the created packages, and can also view packages on which he or she has all permissions.</p>
</li><li id="dli_01_0477__li1138112716599">Package permissions<p id="dli_01_0477__p787385316559"><a name="dli_01_0477__li1138112716599"></a><a name="li1138112716599"></a>Querying permissions. A package owner can view the created packages, and can also view packages on which they have all permissions.</p>
</li></ul>
</div>
</div>

Some files were not shown because too many files have changed in this diff Show More