vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity

DLI UMN 0215 version

Browse Source 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
This commit is contained in:
Su, Xiaomeng 2023-05-16 21:35:32 +00:00 committed by zuul
parent 5e9d9a41e7
commit 8d0cd12846
336 changed files with 14972 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2422
docs/dli/umn/ALL_META.TXT.json Normal file
View File

File diff suppressed because it is too large Load Diff

2180
docs/dli/umn/CLASS.TXT.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
docs/dli/umn/PARAMETERS.txt Normal file
View File

@ -0,0 +1,3 @@
version=""
language="en-us"
type=""

20
docs/dli/umn/dli_01_00006.html Normal file
View File

@ -0,0 +1,20 @@
<a name="dli_01_00006"></a><a name="dli_01_00006"></a>
<h1 class="topictitle1">Change History</h1>
<div id="body0000001348980274">
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_00006__table1017191611115" frame="border" border="1" rules="all"><thead align="left"><tr id="dli_01_00006__row151881681119"><th align="left" class="cellrowborder" valign="top" width="33.67%" id="mcps1.3.1.1.3.1.1"><p id="dli_01_00006__p1518416131113">Released On</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="66.33%" id="mcps1.3.1.1.3.1.2"><p id="dli_01_00006__p2018131612113">What's New</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_00006__row01821691115"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p1518161613115">2023-01-30</p>
</td>
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p14331173193510">This issue is the first official release.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>

15
docs/dli/umn/dli_01_0001.html Normal file
View File

@ -0,0 +1,15 @@
<a name="dli_01_0001"></a><a name="dli_01_0001"></a>
<h1 class="topictitle1">Job Management</h1>
<div id="body1532683323732"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0017.html">SQL Job Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0389.html">Flink Job Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0465.html">Spark Job Management</a></strong><br>
</li>
</ul>
</div>

61
docs/dli/umn/dli_01_0002.html Normal file
View File

@ -0,0 +1,61 @@
<a name="dli_01_0002"></a><a name="dli_01_0002"></a>
<h1 class="topictitle1">Creating and Submitting a Spark SQL Job</h1>
<div id="body1501038213757"><p id="dli_01_0002__p8060118">You can use DLI to submit a Spark SQL job to query data. The general procedure is as follows:</p>
<p id="dli_01_0002__p313355315401"><a href="#dli_01_0002__section3751181910618">Step 1: Logging in to the Cloud Platform</a></p>
<p id="dli_01_0002__p1391181313415"><a href="#dli_01_0002__section61379418181550">Step 2: Uploading Data to OBS</a></p>
<p id="dli_01_0002__p10892641184110"><a href="#dli_01_0002__section19012773105034">Step 3: Logging In to the DLI Management Console</a></p>
<p id="dli_01_0002__p146371751184314"><a href="#dli_01_0002__section10742144985011">Step 4: Creating a Queue</a></p>
<p id="dli_01_0002__p13187162154420"><a href="#dli_01_0002__section21433273112656">Step 5: Creating a Database</a></p>
<p id="dli_01_0002__p266214107449"><a href="#dli_01_0002__section21590507141153">Step 6: Creating a Table</a></p>
<p id="dli_01_0002__p9606134314412"><a href="#dli_01_0002__section37788816112733">Step 7: Querying Data</a></p>
<p id="dli_01_0002__p3654323610322">The following illustrates how to query OBS data using DLI. Operations to query DLI data are similar.</p>
<div class="section" id="dli_01_0002__section3751181910618"><a name="dli_01_0002__section3751181910618"></a><a name="section3751181910618"></a><h4 class="sectiontitle">Step 1: Logging in to the Cloud Platform</h4><ol id="dli_01_0002__ol77610191561"><li id="dli_01_0002__li1968871183717">Open the DLI homepage.</li><li id="dli_01_0002__li1597319241563">On the login page, enter the username and password, and click <strong id="dli_01_0002__b380955624716">Log In</strong>.</li></ol>
</div>
<div class="section" id="dli_01_0002__section61379418181550"><a name="dli_01_0002__section61379418181550"></a><a name="section61379418181550"></a><h4 class="sectiontitle">Step 2: Uploading Data to OBS</h4><p id="dli_01_0002__p45348185145915">DLI allows you to query data stored on OBS. Before querying the data, you need to upload data to OBS.</p>
<ol id="dli_01_0002__ol19047014145745"><li id="dli_01_0002__li18770142812720">In the services displayed, click <strong id="dli_01_0002__b16911338132720">Object Storage Service (OBS)</strong> in <strong id="dli_01_0002__b1679352125611">Storage</strong>.</li><li id="dli_01_0002__li2478348216220">The OBS console page is displayed.</li><li id="dli_01_0002__li1385211252717">Create a bucket. The bucket name must be globally unique. In this example, assume that the bucket name is <strong id="dli_01_0002__b349033115613">obs1</strong>.<ol type="a" id="dli_01_0002__ol182612310711"><li id="dli_01_0002__li462934116719">Click <span class="uicontrol" id="dli_01_0002__uicontrol481933104114"><b>Create Bucket</b></span> in the upper right corner.</li><li id="dli_01_0002__li183491949872">On the displayed <strong id="dli_01_0002__b997218337576">Create Bucket</strong> page, enter the <strong id="dli_01_0002__b41931653205710">Bucket Name</strong>. Retain the default values for other parameters or set them as required.</li><li id="dli_01_0002__li3583138155449">Click <strong id="dli_01_0002__b55859547573">Create Now</strong>.</li></ol>
</li><li id="dli_01_0002__li17845354105919">Click <strong id="dli_01_0002__b1314010449132">obs1</strong> to switch to the <strong id="dli_01_0002__b22171556131317">Overview</strong> page.</li><li id="dli_01_0002__li9783175118519">In the left navigation pane, click <strong id="dli_01_0002__b1083044015274">Objects</strong>. Click <strong id="dli_01_0002__b1830164072711">Upload Object</strong>. In the displayed dialog box, drag files or folders to upload or add file, for example, <span class="parmname" id="dli_01_0002__parmname11831040102710"><b>sampledata.csv</b></span> to the file upload box. Then, click <span class="uicontrol" id="dli_01_0002__uicontrol13831134072715"><b>Upload</b></span>.<div class="p" id="dli_01_0002__p1366220522517">You can create a <strong id="dli_01_0002__b19103192713017">sampledata.txt</strong> file, copy the following content separated by commas (,), and save the file as <strong id="dli_01_0002__b1597217291805">sampledata.csv</strong>.<pre class="screen" id="dli_01_0002__screen14345174815219">12,test</pre>
</div>
<p id="dli_01_0002__p1540915717295">After the file is uploaded successfully, the file path is <span class="filepath" id="dli_01_0002__filepath82411311208"><b>obs://obs1/sampledata.csv</b></span>.</p>
<p id="dli_01_0002__p34103573290">For more information about OBS operations, see the <em id="dli_01_0002__i15721531173210">Object Storage Service Console Operation Guide</em>.</p>
<p id="dli_01_0002__p17560428164613">For more information about the tool, see the <em id="dli_01_0002__i142921634153219">OBS Tool Guide</em>.</p>
<div class="note" id="dli_01_0002__note11115319367"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p43881963392">You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.</p>
<ul id="dli_01_0002__ul1234018993918"><li id="dli_01_0002__li17525130154011">OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS.</li></ul>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0002__section19012773105034"><a name="dli_01_0002__section19012773105034"></a><a name="section19012773105034"></a><h4 class="sectiontitle">Step 3: Logging In to the DLI Management Console</h4><ol id="dli_01_0002__ol33542655111116"><li id="dli_01_0002__li2096805415940">.</li><li id="dli_01_0002__li38964926151831">The DLI management console page is displayed. If you log in to the DLI management console for the first time, you need to be authorized to access OBS.<p id="dli_01_0002__p180191065412"><a name="dli_01_0002__li38964926151831"></a><a name="li38964926151831"></a>Note: For this guide, you need at least the <strong id="dli_01_0002__b8797105363018">Tenant Administrator (Global service)</strong> permission.</p>
</li></ol>
</div>
<div class="section" id="dli_01_0002__section10742144985011"><a name="dli_01_0002__section10742144985011"></a><a name="section10742144985011"></a><h4 class="sectiontitle">Step 4: Creating a Queue</h4><p id="dli_01_0002__p313914434915">A queue is the basis for using DLI. Before executing an SQL job, you need to create a queue.</p>
<ul id="dli_01_0002__ul17202247195010"><li id="dli_01_0002__li131931114812">An available queue <span class="parmvalue" id="dli_01_0002__parmvalue1369741014488"><b>default</b></span> is preset in DLI.</li><li id="dli_01_0002__li1131916110481">You can also create queues as needed.<ol id="dli_01_0002__ol15578144671515"><li id="dli_01_0002__li2578546131517">On the DLI management console, click <strong id="dli_01_0002__b16611756192915">SQL Editor</strong> in the navigation pane on the left. The <strong id="dli_01_0002__b1120919212301">SQL Editor</strong> page is displayed.</li><li id="dli_01_0002__li844914584169">On the left pane, select the <strong id="dli_01_0002__b8902351334">Queues</strong> tab, and click <span><img id="dli_01_0002__image17450135891614" src="en-us_image_0276441461.png"></span> next to <strong id="dli_01_0002__b1478271612">Queues</strong>.<p id="dli_01_0002__p17288510177">For details, see Creating a Queue.</p>
<p id="dli_01_0002__p8128252161516"></p>
</li></ol>
</li></ul>
</div>
<div class="section" id="dli_01_0002__section21433273112656"><a name="dli_01_0002__section21433273112656"></a><a name="section21433273112656"></a><h4 class="sectiontitle">Step 5: Creating a Database</h4><p id="dli_01_0002__p498774501214">Before querying data, create a database, for example, <strong id="dli_01_0002__b84235270619941">db1</strong>.</p>
<div class="note" id="dli_01_0002__note23711139194010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p143724399404">The <strong id="dli_01_0002__b842352706172053">default</strong> database is a built-in database. You cannot create the database named <strong id="dli_01_0002__b842352706172112">default</strong>.</p>
</div></div>
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">On the DLI management console, click <strong id="dli_01_0002__b1635163117400">SQL Editor</strong> in the navigation pane on the left. The <strong id="dli_01_0002__b12483735174016">SQL Editor</strong> page is displayed.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
<p id="dli_01_0002__p38732969153456">After database <strong id="dli_01_0002__b842352706161813">db1</strong> is successfully created, <strong id="dli_01_0002__b842352706161823">db1</strong> will be displayed in the <strong id="dli_01_0002__b842352706161834">Database</strong> list.</p>
<div class="note" id="dli_01_0002__note108505219593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p1862192165910">When you execute a query on the DLI management console for the first time, you need to read the privacy agreement. You can perform operations only after you agree to the agreement. For later queries, you will not need to read the privacy agreement again.</p>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0002__section21590507141153"><a name="dli_01_0002__section21590507141153"></a><a name="section21590507141153"></a><h4 class="sectiontitle">Step 6: Creating a Table</h4><p id="dli_01_0002__p35220739144319">After database <strong id="dli_01_0002__b1827512525545">db1</strong> is created, create a table (for example, <strong id="dli_01_0002__b8275145215544">table1</strong>) containing data in the sample file <span class="filepath" id="dli_01_0002__filepath427515215419"><b>obs://obs1/sampledata.csv</b></span> stored on OBS in <strong id="dli_01_0002__b4277135245414">db1</strong>.</p>
<ol id="dli_01_0002__ol39318463153849"><li id="dli_01_0002__li23198164153933">In the SQL editing window of the<span class="wintitle" id="dli_01_0002__wintitle1132135205811"><b> SQL Editor</b></span> page, select the <strong id="dli_01_0002__b9133145155814">default</strong> queue and database <strong id="dli_01_0002__b31330515816">db1</strong>.</li><li id="dli_01_0002__li22227453153849">Enter the following SQL statement in the job editor window and click <strong id="dli_01_0002__b8418103081114">Execute</strong>:<pre class="screen" id="dli_01_0002__screen114301935133717">create table table1 (id int, name string) using csv options (path 'obs://obs1/sampledata.csv');</pre>
<p id="dli_01_0002__p6761159153849">After the table is created, click the <strong id="dli_01_0002__b924464317219">Databases</strong> tab and then select <strong id="dli_01_0002__b16240727145816">db1</strong>. The created table <strong id="dli_01_0002__b122531636185811">table1</strong> is displayed in the <span class="parmname" id="dli_01_0002__parmname1926113527581"><b>Table</b></span> area.</p>
</li></ol>
</div>
<div class="section" id="dli_01_0002__section37788816112733"><a name="dli_01_0002__section37788816112733"></a><a name="section37788816112733"></a><h4 class="sectiontitle">Step 7: Querying Data</h4><p id="dli_01_0002__p489584411557">After performing the preceding steps, you can start querying data.</p>
<ol id="dli_01_0002__ol6245542914546"><li id="dli_01_0002__li146528414546">In the <span class="parmname" id="dli_01_0002__parmname1356301610013"><b>Table</b></span> tab on the <span class="wintitle" id="dli_01_0002__wintitle556341610020"><b>SQL Editor</b></span> page, double-click the created table <strong id="dli_01_0002__b856419161100">table1</strong>. The SQL statement is automatically displayed in the SQL job editing window in the right pane. Run following statement to query 1,000 records in the <strong id="dli_01_0002__b1456411165017">table1</strong> table:<pre class="screen" id="dli_01_0002__screen18201181093815">select * from db1.table1 limit 1000;</pre>
</li><li id="dli_01_0002__li19582472145233">Click <strong id="dli_01_0002__b126126091410">Execute</strong>. The system starts the query.<p id="dli_01_0002__p2694027411345">After the SQL statement is executed successfully, you can view the query result in <strong id="dli_01_0002__b294691411285">View Result</strong> under the SQL job editing window.</p>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0220.html">Getting Started</a></div>
</div>
</div>

59
docs/dli/umn/dli_01_0003.html Normal file
View File

@ -0,0 +1,59 @@
<a name="dli_01_0003"></a><a name="dli_01_0003"></a>
<h1 class="topictitle1">Overview</h1>
<div id="body0000001105195630"><p id="dli_01_0003__p1192818410140">The enhanced datasource connection uses VPC peering at the bottom layer to directly connect the VPC network between the DLI cluster and the destination datasource. Data is exchanged in point-to-point mode. The enhanced datasource connection function supports all cross-source services implemented by DLI, including CloudTable HBase, CloudTableOpenTSDB, MRS OpenTSDB, DWS, RDS, CSS, DCS, and DDS. In addition, UDFs, Spark jobs, and Flink jobs can be used to access self-built data sources.</p>
<div class="note" id="dli_01_0003__note12603103574920"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0003__ul5455165810144"><li id="dli_01_0003__li698500101511">The CIDR block of the DLI queue bound with a datasource connection cannot overlap with that of the data source.</li><li id="dli_01_0003__li6187125017427">Datasource connections cannot be created for the default queue.</li><li id="dli_01_0003__li483541514213">To access a datasource connection table, you need to use the queue for which a datasource connection has been created.</li><li id="dli_01_0003__li174571010446">The preview function is not supported for datasource tables.</li></ul>
</div></div>
<p id="dli_01_0003__p15424938144017">The enhanced datasource scenario provides the following functions:</p>
<ul id="dli_01_0003__ul124856554111"><li id="dli_01_0003__li34861158416"><a href="dli_01_0006.html">Creating, Querying, and Deleting an Enhanced Datasource Connection</a></li><li id="dli_01_0003__li3299111519412"><a href="dli_01_0009.html">Binding and Unbinding a Queue</a></li><li id="dli_01_0003__li15471102418415"><a href="dli_01_0013.html#dli_01_0013__section636281512389">Modifying Host Information</a></li><li id="dli_01_0003__li020412619615"><a href="dli_01_0014.html">Custom Route Information</a></li><li id="dli_01_0003__li416418421417"><a href="dli_01_0018.html">Enhanced Datasource Connection Permission Management</a></li></ul>
<div class="section" id="dli_01_0003__section1616314111518"><h4 class="sectiontitle">Enhanced Datasource Connection Page</h4><p id="dli_01_0003__p66482014175614">This page displays all enhanced datasource connections. If there are a large number of connections, they are displayed on multiple pages.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0003__table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Datasource connection list parameters</caption><thead align="left"><tr id="dli_01_0003__row2555468715120"><th align="left" class="cellrowborder" valign="top" width="13.469999999999999%" id="mcps1.3.6.3.2.3.1.1"><p id="dli_01_0003__p4021197415120">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="86.53%" id="mcps1.3.6.3.2.3.1.2"><p id="dli_01_0003__p3594448915120">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0003__row46758327132"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p16413434141957">Connection Name</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p54419740141957">Name of the created datasource connection.</p>
</td>
</tr>
<tr id="dli_01_0003__row32873162171713"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p45480448171713">Connection Status</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p59114099151038">Status of a datasource connection. Currently, the console displays only connections in the <strong id="dli_01_0003__b118558917341">Active</strong> state.</p>
</td>
</tr>
<tr id="dli_01_0003__row31011923151038"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p10671857151038">VPC</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p13779322112316">VPC used by the destination data source. </p>
</td>
</tr>
<tr id="dli_01_0003__row36301606171658"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p14394959151048">Subnet</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p1483474582618">Subnet used by the destination data source. </p>
</td>
</tr>
<tr id="dli_01_0003__row2449114254419"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p1845010423449">Created</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0003__p114506429448">Time when a connection is created. The connections in the connection list can be displayed according to the creation time in ascending or descending order.</p>
</td>
</tr>
<tr id="dli_01_0003__row1662880815250"><td class="cellrowborder" valign="top" width="13.469999999999999%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0003__p475621615250">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="86.53%" headers="mcps1.3.6.3.2.3.1.2 "><ul id="dli_01_0003__ul516210510267"><li id="dli_01_0003__li516213514262"><strong id="dli_01_0003__b206518963613">Delete Connection</strong>: Delete a created enhanced datasource connection.</li><li id="dli_01_0003__li147650321108"><strong id="dli_01_0003__b661741203612">Manage Route</strong>: Used to display the custom route information of the enhanced datasource connection.</li><li id="dli_01_0003__li1811271917219"><strong id="dli_01_0003__b12339223361">More</strong>:<ul id="dli_01_0003__ul7693135513119"><li id="dli_01_0003__li14572121218336"><strong id="dli_01_0003__b1855064611464">Modify Host</strong>: Customize the IP address corresponding to the host or domain name.</li><li id="dli_01_0003__li26931355113113"><strong id="dli_01_0003__b1806131145415">Bind Queue</strong>: Bind a queue to an enhanced datasource connection.</li><li id="dli_01_0003__li196937557317"><strong id="dli_01_0003__b1128519301367">Unbind Queue</strong>: Unbind an enhanced datasource connection from a queue.</li><li id="dli_01_0003__li469320551312"><strong id="dli_01_0003__b1338173517368">Add Route</strong>: Add a custom route for the enhanced datasource connection.</li><li id="dli_01_0003__li20693155513119"><strong id="dli_01_0003__b45131338163614">Delete Route</strong>: Delete a custom route for an enhanced datasource connection.</li><li id="dli_01_0003__li769310555311"><strong id="dli_01_0003__b109311423363">Manage Permissions</strong>: Authorize or reclaim permissions for other projects.</li></ul>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

13
docs/dli/umn/dli_01_0004.html Normal file
View File

@ -0,0 +1,13 @@
<a name="dli_01_0004"></a><a name="dli_01_0004"></a>
<h1 class="topictitle1">Data Management</h1>
<div id="body1501038213757"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0390.html">Databases and Tables</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0366.html">Package Management</a></strong><br>
</li>
</ul>
</div>

218
docs/dli/umn/dli_01_0005.html Normal file
View File

File diff suppressed because it is too large Load Diff

70
docs/dli/umn/dli_01_0006.html Normal file
View File

@ -0,0 +1,70 @@
<a name="dli_01_0006"></a><a name="dli_01_0006"></a>
<h1 class="topictitle1">Creating, Querying, and Deleting an Enhanced Datasource Connection</h1>
<div id="body0000001152035527"><div class="section" id="dli_01_0006__section73391334165211"><h4 class="sectiontitle">Creating an Enhanced Datasource Connection</h4><p id="dli_01_0006__p34935145496">The following describes how to create a datasource HBase connection for MRS.</p>
<div class="note" id="dli_01_0006__note55352006432"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0006__p1053780184318">Only enhanced datasource connection to MRS HBase is supported.</p>
</div></div>
<ol id="dli_01_0006__ol194665011112"><li id="dli_01_0006__li322142705519">Apply for a cluster in MRS.<p id="dli_01_0006__p1166656182213"><a name="dli_01_0006__li322142705519"></a><a name="li322142705519"></a>If a cluster is available, you do not need to apply for one.</p>
</li><li id="dli_01_0006__li918675917143">In the navigation pane of the DLI management console, choose <span class="wintitle" id="dli_01_0006__wintitle7647752205418"><b>Datasource Connections</b></span>.</li><li id="dli_01_0006__li16324435150">Click the <strong id="dli_01_0006__b196273113384">Enhanced</strong> tab and click <strong id="dli_01_0006__b1263315183820">Create</strong> in the upper left corner.<p id="dli_01_0006__p114601031134519">Enter the <strong id="dli_01_0006__b899536143813">Connection Name</strong>, select the <strong id="dli_01_0006__b099519611386">Bind Queue</strong> (optional), <strong id="dli_01_0006__b2099613612386">VPC</strong>, and <strong id="dli_01_0006__b1399614615382">Subnet</strong>, and enter the <strong id="dli_01_0006__b999614616388">Host Information</strong> (optional). For details about the parameters, see <a href="#dli_01_0006__table24931148155220">Table 1</a>.</p>
<p id="dli_01_0006__p158349011310"></p>
<div class="tablenoborder"><a name="dli_01_0006__table24931148155220"></a><a name="table24931148155220"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0006__table24931148155220" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0006__row1149712486527"><th align="left" class="cellrowborder" valign="top" width="15.920000000000002%" id="mcps1.3.1.4.3.5.2.3.1.1"><p id="dli_01_0006__p349916487526">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="84.08%" id="mcps1.3.1.4.3.5.2.3.1.2"><p id="dli_01_0006__p115011548105211">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0006__row1350324845215"><td class="cellrowborder" valign="top" width="15.920000000000002%" headers="mcps1.3.1.4.3.5.2.3.1.1 "><p id="dli_01_0006__p8504184814524">Connection Name</p>
</td>
<td class="cellrowborder" valign="top" width="84.08%" headers="mcps1.3.1.4.3.5.2.3.1.2 "><p id="dli_01_0006__p1550604814528">Name of the created datasource connection.</p>
<ul id="dli_01_0006__ul185072486523"><li id="dli_01_0006__li650717489523">The name can contain only letters, digits, and underscores (_). The parameter must be specified.</li><li id="dli_01_0006__li1350913489529">A maximum of 64 characters are allowed.</li></ul>
</td>
</tr>
<tr id="dli_01_0006__row113282120419"><td class="cellrowborder" valign="top" width="15.920000000000002%" headers="mcps1.3.1.4.3.5.2.3.1.1 "><p id="dli_01_0006__p632112174118">Bound Queue </p>
</td>
<td class="cellrowborder" valign="top" width="84.08%" headers="mcps1.3.1.4.3.5.2.3.1.2 "><p id="dli_01_0006__p133212111414">(Optional) Bind a queue that requires datasource connections.</p>
<div class="note" id="dli_01_0006__note13421165512496"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0006__p943095519492">Before using an enhanced datasource connection, you must bind a queue and ensure that the VPC peering connection is in the <strong id="dli_01_0006__b11412161014431">Active</strong> state.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0006__row7764655142317"><td class="cellrowborder" valign="top" width="15.920000000000002%" headers="mcps1.3.1.4.3.5.2.3.1.1 "><p id="dli_01_0006__p16764105532311">VPC</p>
</td>
<td class="cellrowborder" valign="top" width="84.08%" headers="mcps1.3.1.4.3.5.2.3.1.2 "><p id="dli_01_0006__p1676416559237">VPC used by the destination data source.</p>
</td>
</tr>
<tr id="dli_01_0006__row1095810374248"><td class="cellrowborder" valign="top" width="15.920000000000002%" headers="mcps1.3.1.4.3.5.2.3.1.1 "><p id="dli_01_0006__p1495903712415">Subnet</p>
</td>
<td class="cellrowborder" valign="top" width="84.08%" headers="mcps1.3.1.4.3.5.2.3.1.2 "><p id="dli_01_0006__p1795918371243">Subnet used by the destination data source.</p>
</td>
</tr>
<tr id="dli_01_0006__row11771019513"><td class="cellrowborder" valign="top" width="15.920000000000002%" headers="mcps1.3.1.4.3.5.2.3.1.1 "><p id="dli_01_0006__p41891015518">Host Information</p>
</td>
<td class="cellrowborder" valign="top" width="84.08%" headers="mcps1.3.1.4.3.5.2.3.1.2 "><p id="dli_01_0006__p1184104510">(Optional) When connecting to the HBase cluster of MRS, enter the host name and IP address of the ZooKeeper instance. Enter one record in each line. The format is as follows: <strong id="dli_01_0006__b6308101634416">IP address Host name/Domain name</strong>.</p>
<p id="dli_01_0006__p2011023525">To obtain the host name and IP address of the MRS cluster, perform the following steps (with MRS3.x as an example):</p>
<ol type="a" id="dli_01_0006__ol34131830476"><li id="dli_01_0006__li24136334712">Log in to the MRS management console.</li><li id="dli_01_0006__li14136317472">In the navigation pane, choose <strong id="dli_01_0006__b20689123710445">Clusters</strong> &gt; <strong id="dli_01_0006__b7695737114411">Active Clusters</strong>. Click the target cluster name to access the cluster details page.</li><li id="dli_01_0006__li741363194711">Click <span class="wintitle" id="dli_01_0006__wintitle499972615559"><b>Component Management</b></span>.</li><li id="dli_01_0006__li174136317476">Click <strong id="dli_01_0006__b196843014459">Zookeeper</strong>.</li><li id="dli_01_0006__li114131237471">Click the <span class="wintitle" id="dli_01_0006__wintitle16169762457"><b>Instance</b></span> tab to view the corresponding service IP address. You can select any service IP address.</li></ol>
<div class="note" id="dli_01_0006__note1426252593"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0006__p142655145920">If the MRS cluster has multiple IP addresses, enter any service IP address when creating a datasource connection.</p>
</div></div>
</td>
</tr>
</tbody>
</table>
</div>
</li><li id="dli_01_0006__li9142144141616">Click <span class="uicontrol" id="dli_01_0006__uicontrol1787622894613"><b>OK</b></span>.</li><li id="dli_01_0006__li137440184715">To connect to Kafka, DWS, and RDS instances, add security group rules for the DLI network segment to the security group where the instances belong. The following uses RDS as an example:<ol type="a" id="dli_01_0006__ol89018481616"><li id="dli_01_0006__li3500123095914">Choose <strong id="dli_01_0006__b35631153204514">Resources</strong> &gt; <strong id="dli_01_0006__b103961815165711">Queue Management</strong> in the navigation pane. Select the target queue, and click <span><img id="dli_01_0006__image105154539180" src="en-us_image_0000001259009999.png"></span> to expand the row containing the target queue to view its CIDR block.</li><li id="dli_01_0006__li15781102518551">On the <strong id="dli_01_0006__b87522541614">Instance Management</strong> page of the RDS console, click the instance name. In the <strong id="dli_01_0006__b3276633424">Connection Information</strong> area, view the port number of the RDS database instance.</li><li id="dli_01_0006__li88331728195516">In the <strong id="dli_01_0006__b17744122491213">Connection Information</strong> area locate the<strong id="dli_01_0006__b5747714161312"> Security Group</strong> and click the group name to switch to the security group management page. Select the <strong id="dli_01_0006__b446210532137">Inbound Rules</strong> tab and click <strong id="dli_01_0006__b196062591418">Add Rule</strong>. Set the priority to 1, protocol to TCP, port to the database port number, and source to the CIDR block of the DLI queue. Click <strong id="dli_01_0006__b4416755131517">OK</strong>.</li></ol>
</li><li id="dli_01_0006__li68345507185">Test the connectivity between the DLI queue and the connection instance. The following example describes how to test the connectivity between DLI and an RDS DB instance.<ol type="a" id="dli_01_0006__ol19285185311814"><li id="dli_01_0006__li112310149192">On the <strong id="dli_01_0006__b1673917298175">Instance Management</strong> page, click the target DB instance. On the displayed page, locate the <strong id="dli_01_0006__b177458291174">Connection Information</strong> pane and view the floating IP address. In the <strong id="dli_01_0006__b1434312191914">Connection Information</strong> pane, locate the <strong id="dli_01_0006__b11459142202015">Database Port</strong> to view the port number of the RDS DB instance.</li><li id="dli_01_0006__li10880157142314">Go back to the DLI console. On the <strong id="dli_01_0006__b737654518310">Resources</strong> &gt; <strong id="dli_01_0006__b5653513132015">Queue Management</strong> page, locate the target queue. In the <strong id="dli_01_0006__b19660201310208">Operation</strong> column, click <strong id="dli_01_0006__b1366081302018">More</strong> &gt; <strong id="dli_01_0006__b266061312019">Test Address Connectivity</strong>.</li><li id="dli_01_0006__li15869145571811">Enter the connection address of the RDS DB instance and port number in the format of <strong id="dli_01_0006__b0259173692111">IP address</strong><strong id="dli_01_0006__b10485193932113">:port</strong> to test the network connectivity.</li></ol>
</li></ol>
</div>
<div class="section" id="dli_01_0006__section9644161019415"><h4 class="sectiontitle">Querying an Enhanced Datasource Connection</h4><p id="dli_01_0006__p049105611378">On the <span class="wintitle" id="dli_01_0006__wintitle1323715521461"><b>Enhanced</b></span> tab page, you can enter the keyword of a connection name in the search box to search for the matching connection.</p>
</div>
<div class="section" id="dli_01_0006__section1960402414173"><h4 class="sectiontitle">Viewing Details</h4><p id="dli_01_0006__p14808334419">On the <span class="wintitle" id="dli_01_0006__wintitle1631973119471"><b>Enhanced</b></span> tab page, select a connection and click <span><img id="dli_01_0006__image16836107193612" src="en-us_image_0000001105517798.png"></span> to view its details. The connection ID and host information are displayed.</p>
</div>
<div class="section" id="dli_01_0006__section8647175812179"><h4 class="sectiontitle">Deleting an Enhanced Datasource Connection</h4><p id="dli_01_0006__p98091683185">On the <span class="wintitle" id="dli_01_0006__wintitle12647135274716"><b>Enhanced</b></span> tab page, click <span class="uicontrol" id="dli_01_0006__uicontrol166531652134716"><b>Delete Connection</b></span> in the <strong id="dli_01_0006__b26531952124719">Operation</strong> column to delete an unnecessary connection.</p>
<div class="note" id="dli_01_0006__note0408153733715"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0006__p5411183718372">A connection with <span class="parmname" id="dli_01_0006__parmname8889145711475"><b>Connection Status</b></span> of <span class="parmvalue" id="dli_01_0006__parmvalue1789565714717"><b>Creating</b></span> cannot be deleted.</p>
</div></div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

16
docs/dli/umn/dli_01_0007.html Normal file
View File

@ -0,0 +1,16 @@
<a name="dli_01_0007"></a><a name="dli_01_0007"></a>
<h1 class="topictitle1">Previewing Data</h1>
<div id="body1501038213757"><p id="dli_01_0007__p569436192936">The <span class="wintitle" id="dli_01_0007__wintitle159646911143"><b>Preview</b></span> page displays the first 10 records in the table.</p>
<div class="section" id="dli_01_0007__section220516431119"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0007__p39191032115617">You can preview data on either the <span class="wintitle" id="dli_01_0007__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0007__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0007__ul57312886162410"><li id="dli_01_0007__li46053929162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0007__ol48633399145054"><li id="dli_01_0007__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0007__uicontrol18482320394"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0007__uicontrol748212014913"><b>Databases and Tables</b></span>.</li><li id="dli_01_0007__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0007__wintitle108175242144"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0007__b38223243141">Manage Tables</strong> page.</li><li id="dli_01_0007__li36387870145557">Click <span class="uicontrol" id="dli_01_0007__uicontrol52771577102"><b>More</b></span> in the <strong id="dli_01_0007__b3277187171011">Operation</strong> column of the target table and select <span class="wintitle" id="dli_01_0007__wintitle1827707101011"><b>View Properties</b></span>.</li><li id="dli_01_0007__li86216531552">Click the <span class="wintitle" id="dli_01_0007__wintitle3454141011716"><b>Preview</b></span> tab to preview the table data.</li></ol>
</li><li id="dli_01_0007__li11072851162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0007__ol24485723162410"><li id="dli_01_0007__li19044916162410">On the left of the management console, click <span class="uicontrol" id="dli_01_0007__uicontrol666915283918"><b>SQL Editor</b></span>.</li><li id="dli_01_0007__li16991452612">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0007__wintitle146852941019"><b>SQL Editor</b></span> page, click <strong id="dli_01_0007__b0685209161016">Databases</strong>.</li><li id="dli_01_0007__li66243256162410">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0007__li64103520162410">Click <span><img id="dli_01_0007__image1895075254716" src="en-us_image_0237994908.png"></span> on the right of the corresponding table, choose <strong id="dli_01_0007__b18730161715107">View Properties</strong> from the list menu, and click the <strong id="dli_01_0007__b20730717161014">Preview</strong> tab to preview the data of the table.</li></ol>
</li></ul>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Databases and Tables</a></div>
</div>
</div>

17
docs/dli/umn/dli_01_0008.html Normal file
View File

@ -0,0 +1,17 @@
<a name="dli_01_0008"></a><a name="dli_01_0008"></a>
<h1 class="topictitle1">Viewing Metadata</h1>
<div id="body1501038213757"><div class="section" id="dli_01_0008__section35142993104733"><h4 class="sectiontitle">Metadata Description</h4><ul id="dli_01_0008__ul3266683161032"><li id="dli_01_0008__li54899781161032">Metadata is used to define data types. It describes information about the data, including the source, size, format, and other data features. In database fields, metadata interprets data content in the data warehouse.</li><li id="dli_01_0008__li57091439161034">When you create a table, metadata is defined, consisting of the column name, type, and description.</li><li id="dli_01_0008__li194120268212">The <span class="wintitle" id="dli_01_0008__wintitle4795312310"><b>Metadata</b></span> page displays information about the target table, including <strong id="dli_01_0008__b98013311133">Column Name</strong>, <strong id="dli_01_0008__b184461231103011">Column Type</strong>, <strong id="dli_01_0008__b6809313317">Data Type</strong>, and <strong id="dli_01_0008__b1801231632">Description</strong>.</li></ul>
</div>
<div class="section" id="dli_01_0008__section38089543314"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0008__p11776437345">You can view metadata on either the <span class="wintitle" id="dli_01_0008__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0008__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0008__ul41981589145011"><li id="dli_01_0008__li30083560145011">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0008__ol48633399145054"><li id="dli_01_0008__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0008__uicontrol165882511882"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0008__uicontrol1058910511686"><b>Databases and Tables</b></span>.</li><li id="dli_01_0008__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0008__wintitle6486209315148"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0008__b116953258919">Manage Tables</strong> page.</li><li id="dli_01_0008__li36387870145557">Click <span class="uicontrol" id="dli_01_0008__uicontrol516817179511"><b>More</b></span> in the <strong id="dli_01_0008__b1176621554">Operation</strong> column of the target table and select <strong id="dli_01_0008__b12853104513520">View Properties</strong>. In the <strong id="dli_01_0008__b134534533517">Metadata</strong> tab, view the metadata of the table.</li></ol>
</li><li id="dli_01_0008__li662576911510">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0008__ol566308021525"><li id="dli_01_0008__li621294601525">On the left of the management console, click <span class="uicontrol" id="dli_01_0008__uicontrol64701326919"><b>SQL Editor</b></span>.</li><li id="dli_01_0008__li8680153010311">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0008__wintitle128361538687"><b>SQL Editor</b></span> page, click <strong id="dli_01_0008__b483614381818">Databases</strong>.</li><li id="dli_01_0008__li1089513015246">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0008__li3980594015952">Click <span><img id="dli_01_0008__image1895075254716" src="en-us_image_0237994909.png"></span> on the right of the table and choose <strong id="dli_01_0008__b342233416910">View Properties</strong> from the shortcut menu. On the <strong id="dli_01_0008__b8422133420913">Metadata</strong> tab page, view the metadata of the table.</li></ol>
</li></ul>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Databases and Tables</a></div>
</div>
</div>

68
docs/dli/umn/dli_01_0009.html Normal file
View File

@ -0,0 +1,68 @@
<a name="dli_01_0009"></a><a name="dli_01_0009"></a>
<h1 class="topictitle1">Binding and Unbinding a Queue</h1>
<div id="body0000001105515438"><div class="section" id="dli_01_0009__section886913432077"><h4 class="sectiontitle">Constraints</h4><ul id="dli_01_0009__ul5455165810144"><li id="dli_01_0009__li698500101511">The CIDR block of the DLI queue that is bound with a datasource connection cannot overlap with that of the data source.</li><li id="dli_01_0009__li6187125017427">The default queue cannot be bound with a connection.</li></ul>
</div>
<div class="section" id="dli_01_0009__section027361173415"><h4 class="sectiontitle">Binding a Queue</h4><p id="dli_01_0009__p16692124573113">Before using an enhanced datasource connection, you must bind a queue and ensure that the VPC peering connection is in the <strong id="dli_01_0009__b2924131519506">Active</strong> state.</p>
<ul id="dli_01_0009__ul784114313210"><li id="dli_01_0009__li384943163217">Method 1<p id="dli_01_0009__p1147624319295"><a name="dli_01_0009__li384943163217"></a><a name="li384943163217"></a>In the <span class="wintitle" id="dli_01_0009__wintitle20802172417"><b>Enhanced</b></span> tab, select a connection and click <strong id="dli_01_0009__b141412218242">Bind Queue</strong> in the <strong id="dli_01_0009__b815182162418">Operation</strong> column. In the dialog box that is displayed, select the queues to be bound and click <strong id="dli_01_0009__b215172162411">OK</strong>.</p>
</li></ul>
<ul id="dli_01_0009__ul125401946133217"><li id="dli_01_0009__li1754094653210">Method 2<p id="dli_01_0009__p20434173018318"><a name="dli_01_0009__li1754094653210"></a><a name="li1754094653210"></a>Click the name of the selected connection. The <strong id="dli_01_0009__b186114284503">Details</strong> page is displayed. Click <strong id="dli_01_0009__b11346537195013">Create</strong> in the upper left corner. In the dialog box that is displayed, select the queues to be bound and click <strong id="dli_01_0009__b0352153775015">OK</strong>.</p>
<p id="dli_01_0009__p712717203419"></p>
</li></ul>
</div>
<div class="section" id="dli_01_0009__section48371514207"><h4 class="sectiontitle">Viewing Details about a Bound Queue</h4><div class="p" id="dli_01_0009__p174823421415">On the <span class="wintitle" id="dli_01_0009__wintitle1866111118518"><b>Enhanced</b></span> tab page, select a connection and click the connection name to view the information about the bound queue.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0009__table2058910236588" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters in the details list of datasource connection queues</caption><thead align="left"><tr id="dli_01_0009__row135891123145816"><th align="left" class="cellrowborder" valign="top" width="13.850000000000001%" id="mcps1.3.3.2.2.2.3.1.1"><p id="dli_01_0009__p1759018239585">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="86.15%" id="mcps1.3.3.2.2.2.3.1.2"><p id="dli_01_0009__p85906234580">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0009__row259022345814"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p659052315816">VPC Peering ID</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p15739171410">ID of the VPC peering connection created in the cluster to which the queue belongs.</p>
<div class="note" id="dli_01_0009__note1330219211843"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0009__p130214211248">A VPC peering connection is created for each queue bound to an enhanced datasource connection. The VPC peering connection is used for cross-VPC communication. Ensure that the security group used by the data source allows access from the DLI queue CIDR block, and do not delete the VPC peering connection during the datasource connection.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0009__row0590172375818"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p95906231587">Name</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p651916432717">Name of a bound queue.</p>
</td>
</tr>
<tr id="dli_01_0009__row165901238588"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p1859020234589">Connection Status</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p2059062317589">Datasource connection status. The following three statuses are available:</p>
<ul id="dli_01_0009__ul15899620876"><li id="dli_01_0009__li118999201473">Creating</li><li id="dli_01_0009__li789910201877">Active</li><li id="dli_01_0009__li1089914207718">Failed</li></ul>
<div class="note" id="dli_01_0009__note1964641888"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0009__p1864620111814">If the connection status is <strong id="dli_01_0009__b1931035216528">Failed</strong>, click <span><img id="dli_01_0009__image122211841291" src="en-us_image_0000001151957753.png"></span> on the left to view the detailed error information.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0009__row18590123185815"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p165901923195811">Updated</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p1859016232586">Time when a connection is updated. The connections in the connection list can be displayed according to the update time in ascending or descending order.</p>
</td>
</tr>
<tr id="dli_01_0009__row15590152315812"><td class="cellrowborder" valign="top" width="13.850000000000001%" headers="mcps1.3.3.2.2.2.3.1.1 "><p id="dli_01_0009__p6590182316588">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="86.15%" headers="mcps1.3.3.2.2.2.3.1.2 "><p id="dli_01_0009__p25914531233"><strong id="dli_01_0009__b11566143816538">Unbind Queue</strong>: This operation is used to unbind a datasource connection from a queue.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div class="section" id="dli_01_0009__section16495153616367"><h4 class="sectiontitle">Unbinding a Queue</h4><p id="dli_01_0009__p179936555312">If you do not need to use an enhanced datasource connection, you can unbind the queue from it to release resources.</p>
<ul id="dli_01_0009__ul68671113339"><li id="dli_01_0009__li08671513335">Method 1<p id="dli_01_0009__p168681193310"><a name="dli_01_0009__li08671513335"></a><a name="li08671513335"></a>On the <span class="wintitle" id="dli_01_0009__wintitle611643105411"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0009__b612114385413">More</strong> &gt; <strong id="dli_01_0009__b212213317541">Unbind Queue</strong> in the <strong id="dli_01_0009__b512215314543">Operation</strong> column. In the dialog box that is displayed, select the queues to be unbound and click <strong id="dli_01_0009__b5122431547">OK</strong>.</p>
</li></ul>
<ul id="dli_01_0009__ul1286817114335"><li id="dli_01_0009__li188682119331">Method 2<p id="dli_01_0009__p28681415333"><a name="dli_01_0009__li188682119331"></a><a name="li188682119331"></a>Click the name of the target connection. The <strong id="dli_01_0009__b1810216825412">Details</strong> page is displayed. Select the queue to be unbound and click <strong id="dli_01_0009__b3453161116548">Unbind Queue</strong> in the <strong id="dli_01_0009__b745991155420">Operation</strong> column. In the displayed dialog box, confirm the queue to be unbound and click <strong id="dli_01_0009__b154599116545">Yes</strong>.</p>
<p id="dli_01_0009__p17855145294411"></p>
</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

72
docs/dli/umn/dli_01_0010.html Normal file
View File

@ -0,0 +1,72 @@
<a name="dli_01_0010"></a><a name="dli_01_0010"></a>
<h1 class="topictitle1">Exporting Data from DLI to OBS</h1>
<div id="body1501291906720"><p id="dli_01_0010__p12368142105715">You can export data from a DLI table to OBS. During the export, a folder is created in OBS or the content in the existing folder is overwritten.</p>
<div class="section" id="dli_01_0010__section181111466568"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0010__ul12225587299"><li id="dli_01_0010__li0222105872918">The exported file can be in JSON format, and the text format can only be UTF-8.</li><li id="dli_01_0010__li6222205822916">Only the data in the DLI table (the table type is <strong id="dli_01_0010__b17552458537">Managed</strong>) can be exported to the OBS bucket, and the export path must be specified to the folder level.</li><li id="dli_01_0010__li675153163611">Data can be exported across accounts. That is, after account B authorizes account A, account A can export data to the OBS path of account B if account A has the permission to read the metadata and permission information about the OBS bucket of account B and read and write the path.</li></ul>
</div>
<div class="section" id="dli_01_0010__section42958999144515"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0010__ol16716195143659"><li id="dli_01_0010__li2078303115103"><span>You can export data on either the <span class="wintitle" id="dli_01_0010__wintitle189235461532"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0010__wintitle392464655315"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0010__ul13952860151010"><li id="dli_01_0010__li20669721151337">To export data on the <span class="wintitle" id="dli_01_0010__wintitle4564762181553"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0010__ol65658627151340"><li id="dli_01_0010__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0010__uicontrol1582814278819"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0010__uicontrol882811271784"><b>Databases and Tables</b></span>.</li><li id="dli_01_0010__li29714355165922">Click the name of the database corresponding to the table where data is to be exported to switch to the <strong id="dli_01_0010__b681715115537">Manage Tables</strong> page.</li><li id="dli_01_0010__li14811172414512">Select the corresponding table (DLI table) and choose <strong id="dli_01_0010__b03118415457">More</strong> &gt; <strong id="dli_01_0010__b731104154514">Export</strong> in the <strong id="dli_01_0010__b123220419453">Operation</strong> column. The <span class="wintitle" id="dli_01_0010__wintitle63234104516"><b>Export Data</b></span> page is displayed.</li></ol>
</li><li id="dli_01_0010__li10384371151118">To export data on the <span class="wintitle" id="dli_01_0010__wintitle134925579488"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0010__ol39382464151459"><li id="dli_01_0010__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0010__uicontrol7578153418814"><b>SQL Editor</b></span>.</li><li id="dli_01_0010__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0010__b20683530717">Databases</strong> to see all databases. Click the database name corresponding to the table to which data is to be exported. The tables are displayed.</li><li id="dli_01_0010__li2614201531">Click <span><img id="dli_01_0010__image10601210194513" src="en-us_image_0237994910.png"></span> on the right of the managed table (DLI table) whose data is to be exported, and choose <strong id="dli_01_0010__b1860815103455">Export</strong> from the shortcut menu.<p id="dli_01_0010__p584671624616"></p>
</li></ol>
</li></ul>
</p></li><li id="dli_01_0010__li10037634143659"><span>In the displayed <span class="wintitle" id="dli_01_0010__wintitle4856260395119"><b>Export Data</b></span> dialog box, specify parameters by referring to <a href="#dli_01_0010__table7742063143659">Table 1</a>.</span><p>
<div class="tablenoborder"><a name="dli_01_0010__table7742063143659"></a><a name="table7742063143659"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0010__table7742063143659" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0010__row48986708143659"><th align="left" class="cellrowborder" valign="top" width="18.57%" id="mcps1.3.3.2.2.2.1.2.3.1.1"><p id="dli_01_0010__p8500389143659">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="81.43%" id="mcps1.3.3.2.2.2.1.2.3.1.2"><p id="dli_01_0010__p17442940143659">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0010__row55162434145333"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p21307823145337">Databases</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p48212085145337">Database where the current table is located.</p>
</td>
</tr>
<tr id="dli_01_0010__row54786783145255"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p5670283814532">Table Name</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p2952718314532">Name of the current table.</p>
</td>
</tr>
<tr id="dli_01_0010__row59287839143659"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p37585653143659">Data Format</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p24539023143659">Format of the file storing data to be exported. Formats other than JSON will be supported in later versions.</p>
</td>
</tr>
<tr id="dli_01_0010__row33984858114535"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p1310090114535">Queue</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p39008475114535">Select a queue.</p>
</td>
</tr>
<tr id="dli_01_0010__row1774342414552"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p2547309214552">Compression Format</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p5005459614552">Compression format of the data to be exported. The following compression formats are supported:</p>
<ul id="dli_01_0010__ul35000658144913"><li id="dli_01_0010__li26407599145154">none</li><li id="dli_01_0010__li15808987144913">bzip2</li><li id="dli_01_0010__li39569454144913">deflate</li><li id="dli_01_0010__li7424986144913">gzip</li></ul>
</td>
</tr>
<tr id="dli_01_0010__row6367025143659"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p3346061614541">Storage Path</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><ul id="dli_01_0010__ul194291955145519"><li id="dli_01_0010__li74291755195510">Enter or select an OBS path.</li><li id="dli_01_0010__li94291755205513">The export path must be a folder that does not exist in the OBS bucket. Specifically, you need to create a folder in the target OBS directory.</li><li id="dli_01_0010__li194294550559">The folder name cannot contain the special characters of <strong id="dli_01_0010__b198865712220">\/:*?</strong> <strong id="dli_01_0010__b52895136212">"&lt;&gt;|</strong>, and cannot start or end with a dot (.).</li></ul>
</td>
</tr>
<tr id="dli_01_0010__row48430784114641"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p30579455114641">Export Mode</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p61016786114641">Storage mode of the data to be exported.</p>
<ul id="dli_01_0010__ul625034191496"><li id="dli_01_0010__li1968673914926"><strong id="dli_01_0010__b1864119122549">New OBS directory</strong>: If the specified export directory exists, an error is reported and the export operation cannot be performed.</li><li id="dli_01_0010__li7475124010252"><strong id="dli_01_0010__b1138281495413">Existing OBS directory (Overwritten)</strong>: If you create a file in the specified directory, the existing file will be overwritten.</li></ul>
</td>
</tr>
<tr id="dli_01_0010__row1218154413337"><td class="cellrowborder" valign="top" width="18.57%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0010__p44720296144515">Table Header: No/Yes</p>
</td>
<td class="cellrowborder" valign="top" width="81.43%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0010__p15245155210525">Whether the data to be exported contains the table header.</p>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="dli_01_0010__li48215562113558"><span>Click <span class="uicontrol" id="dli_01_0010__uicontrol1346108317431"><b>OK</b></span>.</span></li><li id="dli_01_0010__li7840124181212"><span>(Optional) You can view the job status (indicated by <span class="parmname" id="dli_01_0010__parmname158399481215"><b>Status</b></span>), statements (indicated by <span class="parmname" id="dli_01_0010__parmname883964151211"><b>Statement</b></span>), and other information about exporting jobs on the <span class="wintitle" id="dli_01_0010__wintitle283934191210"><b>SQL Jobs</b></span> page.</span><p><ol type="a" id="dli_01_0010__ol484010416125"><li id="dli_01_0010__li9839540126">Select <span class="parmvalue" id="dli_01_0010__parmvalue1650172515298"><b>EXPORT</b></span> from the <span class="parmname" id="dli_01_0010__parmname13789193911292"><b>Job Type</b></span> drop-down list box and specify the time range for exporting data. The jobs meeting the requirements are displayed in the job list.</li><li id="dli_01_0010__li28407441211">Click <span><img id="dli_01_0010__image1166513199136" src="en-us_image_0206789824.png"></span> to view details about an exporting job.</li></ol>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Databases and Tables</a></div>
</div>
</div>

24
docs/dli/umn/dli_01_0011.html Normal file
View File

@ -0,0 +1,24 @@
<a name="dli_01_0011"></a><a name="dli_01_0011"></a>
<h1 class="topictitle1">Deleting a Database or a Table</h1>
<div id="body1501038213757"><p id="dli_01_0011__p72900011460">You can delete unnecessary databases and tables based on actual conditions.</p>
<div class="section" id="dli_01_0011__section591721184417"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0011__ul9368914114615"><li id="dli_01_0011__li8641339162958">You are not allowed to delete databases or tables that are being used for running jobs.</li><li id="dli_01_0011__li55947051162958">The administrator, database owner, and users with the database deletion permission can delete the database. The administrator, database owner, and users with the table deletion permission can delete the table. <div class="note" id="dli_01_0011__note2036861411465"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0011__p236921415463">If a database or table is deleted, it cannot be recovered. Exercise caution when performing this operation.</p>
</div></div>
</li></ul>
</div>
<div class="section" id="dli_01_0011__section4685189174137"><h4 class="sectiontitle">Deleting a Table</h4><div class="p" id="dli_01_0011__p17554192016499">You can delete a table on either the <span class="wintitle" id="dli_01_0011__wintitle1351164893315"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0011__wintitle035294843313"><b>SQL Editor</b></span> page.<ul id="dli_01_0011__ul10405142364818"><li id="dli_01_0011__li2040592311485">Delete the table on the <span class="wintitle" id="dli_01_0011__wintitle73872501337"><b>Data Management</b></span> page.<ol id="dli_01_0011__ol1735193915485"><li id="dli_01_0011__li2073593924816">On the left of the management console, choose <span class="uicontrol" id="dli_01_0011__uicontrol348919541445"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0011__uicontrol14490145410416"><b>Databases and Tables</b></span>.</li><li id="dli_01_0011__li33015647174137">Locate the row where the database whose tables you want to delete, click the database name to switch to the <strong id="dli_01_0011__b9318135618332">Table Management</strong> page.</li><li id="dli_01_0011__li57021755174137">Locate the row where the target table locates and click <strong id="dli_01_0011__b1751314565019">More</strong> &gt; <span class="uicontrol" id="dli_01_0011__uicontrol43433751174137"><b>Delete</b></span> in the <strong id="dli_01_0011__b1080714149149">Operation</strong> column.</li><li id="dli_01_0011__li55359439174137">In the displayed dialog box, click <span class="uicontrol" id="dli_01_0011__uicontrol27840389155213"><b>Yes</b></span>.</li></ol>
</li><li id="dli_01_0011__li10384371151118">Delete a table on the <span class="wintitle" id="dli_01_0011__wintitle743355813315"><b>SQL Editor</b></span> page.<ol id="dli_01_0011__ol39382464151459"><li id="dli_01_0011__li26745450151459">On the top menu bar of the DLI management console, click <span class="uicontrol" id="dli_01_0011__uicontrol136221153121411"><b>SQL Editor</b></span>.</li><li id="dli_01_0011__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0011__b1777018312279">Databases</strong>. Click the name of a database where the table you want belongs. The tables of the selected database are displayed.</li><li id="dli_01_0011__li2614201531">Click <span><img id="dli_01_0011__image10279959109" src="en-us_image_0237983632.png"></span> on the right of the table and choose <strong id="dli_01_0011__b534514115015">Delete</strong> from the shortcut menu.</li><li id="dli_01_0011__li0998173818546">In the dialog box that is displayed, click <span class="uicontrol" id="dli_01_0011__en-us_topic_0122016948_en-us_topic_0093946752_uicontrol44850627112429"><b>OK</b></span>.</li></ol>
</li></ul>
</div>
</div>
<div class="section" id="dli_01_0011__section168648524611"><h4 class="sectiontitle">Deleting a Database</h4><ol id="dli_01_0011__ol547114061117"><li id="dli_01_0011__li447124091115">On the left of the management console, choose <span class="uicontrol" id="dli_01_0011__uicontrol146221132504"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0011__uicontrol1162281395018"><b>Databases and Tables</b></span>.</li><li id="dli_01_0011__li1148194015113">Locate the row where the target database locates and click <strong id="dli_01_0011__b7893516155013">More</strong> &gt; <span class="uicontrol" id="dli_01_0011__uicontrol189361635014"><b>Drop Database</b></span> in the <strong id="dli_01_0011__b189419168503">Operation</strong> column.<div class="note" id="dli_01_0011__note16416124311218"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0011__p24172043172113">You cannot delete databases that contain tables. To delete a database containing tables, delete the tables first.</p>
</div></div>
</li><li id="dli_01_0011__li13481408117">In the displayed dialog box, click <span class="uicontrol" id="dli_01_0011__uicontrol153561931162917"><b>Yes</b></span>.</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Databases and Tables</a></div>
</div>
</div>

27
docs/dli/umn/dli_01_0012.html Normal file
View File

@ -0,0 +1,27 @@
<a name="dli_01_0012"></a><a name="dli_01_0012"></a>
<h1 class="topictitle1">Queue Management</h1>
<div id="body1501038213757"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0402.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0015.html">Queue Permission Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0363.html">Creating a Queue</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0016.html">Deleting a Queue</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0443.html">Modifying the CIDR Block</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0487.html">Elastic Scaling</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0488.html">Scheduling CU Changes</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0489.html">Testing Address Connectivity</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0421.html">Creating a Message Notification Topic</a></strong><br>
</li>
</ul>
</div>

23
docs/dli/umn/dli_01_0013.html Normal file
View File

@ -0,0 +1,23 @@
<a name="dli_01_0013"></a><a name="dli_01_0013"></a>
<h1 class="topictitle1">Modifying Host Information</h1>
<div id="body0000001152155459"><div class="section" id="dli_01_0013__section636281512389"><a name="dli_01_0013__section636281512389"></a><a name="section636281512389"></a><h4 class="sectiontitle">Modifying Hosts Information</h4><p id="dli_01_0013__p10301174711583"><strong id="dli_01_0013__b1047812430315">Method 1: Copy hosts information in /etc/hosts of an MRS node.</strong></p>
<ol id="dli_01_0013__ol1042353512453"><li id="dli_01_0013__li4423735204520"><span>Log in to any MRS node as the <strong id="dli_01_0013__b15955624103412">root</strong> user.</span></li><li id="dli_01_0013__li5236194744818"><a name="dli_01_0013__li5236194744818"></a><a name="li5236194744818"></a><span>Run the following command to obtain MRS hosts information. Copy and save the information.</span><p><p id="dli_01_0013__p16131162771410"><strong id="dli_01_0013__b9843629161411">cat /etc/hosts</strong></p>
<div class="fignone" id="dli_01_0013__fig15752030165413"><span class="figcap"><b>Figure 1 </b>Obtaining hosts information</span><br><span><img id="dli_01_0013__image4830201818144" src="en-us_image_0000001142261092.png"></span></div>
</p></li><li id="dli_01_0013__li129707130545"><span>Log in to the DLI console, choose <strong id="dli_01_0013__b763993910323">Datasource Connections</strong> &gt; <strong id="dli_01_0013__b1463920393321">Enhanced</strong>. On the <span class="wintitle" id="dli_01_0013__wintitle1829016468320"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0013__b0296154633212">Modify Host</strong>. In the displayed dialog box, paste the host information copied in <a href="#dli_01_0013__li5236194744818">2</a>. Click <strong id="dli_01_0013__b458113369331">OK</strong>.</span></li></ol>
<p id="dli_01_0013__p1710115560582"><strong id="dli_01_0013__b205621803362">Method 2: Log in to FusionInsight Manager to obtain MRS hosts information.</strong></p>
<ol id="dli_01_0013__ol634316416599"><li id="dli_01_0013__li2344174125916"><span>Log in to FusionInsight Manager.</span></li><li id="dli_01_0013__li207601326501"><a name="dli_01_0013__li207601326501"></a><a name="li207601326501"></a><span>On FusionInsight Manager, click <strong id="dli_01_0013__b126271239102310">Hosts</strong>. On the <strong id="dli_01_0013__b7556143492419">Hosts</strong> page, obtain the host names and service IP addresses of the MRS hosts.</span></li><li id="dli_01_0013__li6531739178"><span>Log in to the DLI console, choose <strong id="dli_01_0013__b3845162412918">Datasource Connections</strong> &gt; <strong id="dli_01_0013__b898522519296">Enhanced</strong>. On the <span class="wintitle" id="dli_01_0013__wintitle17397193063712"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0013__b640218309379">Modify Host</strong>. In the displayed dialog box, enter the host information. Click <strong id="dli_01_0013__b10151136163714">OK</strong>.</span><p><p id="dli_01_0013__p14257184014718">The host information is in the format of <em id="dli_01_0013__i5544141173013">Service IP address</em> <em id="dli_01_0013__i1844586143016">Host name</em>. Specify the IP addresses and host names obtained in <a href="#dli_01_0013__li207601326501">2</a>, and separate multiple records by line breaks.</p>
<p id="dli_01_0013__p1422455416818">For example:</p>
<p id="dli_01_0013__p16991312086">192.168.0.22 node-masterxxx1.com</p>
<p id="dli_01_0013__p0726125917819">192.168.0.23 node-masterxxx2.com</p>
</p></li></ol>
<div class="note" id="dli_01_0013__note463551414368"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0013__ul1973359203914"><li id="dli_01_0013__li1173155917399">After this configuration, all hosts information is overwritten.</li><li id="dli_01_0013__li973175920397">A host name or domain name can contain a maximum of 128 characters, including digits, letters, underscores (_), hyphens (-), and periods (.). It must start with a letter.</li><li id="dli_01_0013__li253124115716">The host information is <em id="dli_01_0013__i0601191512126">IP address Host name/Domain name</em> format. Separate multiple records by line breaks.</li></ul>
</div></div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

38
docs/dli/umn/dli_01_0014.html Normal file
View File

@ -0,0 +1,38 @@
<a name="dli_01_0014"></a><a name="dli_01_0014"></a>
<h1 class="topictitle1">Custom Route Information</h1>
<div id="body0000001151955397"><div class="section" id="dli_01_0014__section19599154272217"><h4 class="sectiontitle">Customizing Route Information</h4><p id="dli_01_0014__p109651445173115">After an enhanced datasource connection is created and bound to a queue, the system automatically configures route information. You can also add a custom route for the queue to which the enhanced connection is bound.</p>
<ul id="dli_01_0014__ul943687142519"><li id="dli_01_0014__li2436476256">Viewing route information<p id="dli_01_0014__p14457929182310"><a name="dli_01_0014__li2436476256"></a><a name="li2436476256"></a>On the <span class="wintitle" id="dli_01_0014__wintitle1018173013185"><b>Enhanced</b></span> tab page, select a connection and click <strong id="dli_01_0014__b12184307186">Manage Route</strong> in the <strong id="dli_01_0014__b15181930111819">Operation</strong> column to view the route information of the datasource connection.</p>
</li></ul>
<ul id="dli_01_0014__ul757391362520"><li id="dli_01_0014__li20573413142515">Adding a route<p id="dli_01_0014__p7906201015259"><a name="dli_01_0014__li20573413142515"></a><a name="li20573413142515"></a>On the <span class="wintitle" id="dli_01_0014__wintitle1060673481815"><b>Enhanced</b></span> tab page, select a connection and choose <strong id="dli_01_0014__b3612203431813">More</strong> &gt; <strong id="dli_01_0014__b2612534181813">Add Route</strong> in the <strong id="dli_01_0014__b561263413180">Operation</strong> column, or click <strong id="dli_01_0014__b186131234161818">Add Route</strong> on the <span class="wintitle" id="dli_01_0014__wintitle4613133410184"><b>Details</b></span> page of the connection to add a custom route. In the displayed dialog box, enter the route name and route CIDR block. For details about the parameters, see <a href="#dli_01_0014__table42440623119">Table 1</a>.</p>
<div class="tablenoborder"><a name="dli_01_0014__table42440623119"></a><a name="table42440623119"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0014__table42440623119" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters for adding a custom route</caption><thead align="left"><tr id="dli_01_0014__row1624410615313"><th align="left" class="cellrowborder" valign="top" width="17.46%" id="mcps1.3.1.4.1.2.2.3.1.1"><p id="dli_01_0014__p172444619318">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="82.54%" id="mcps1.3.1.4.1.2.2.3.1.2"><p id="dli_01_0014__p1244106163117">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0014__row624518623112"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.1.4.1.2.2.3.1.1 "><p id="dli_01_0014__p1024516613118">Route Name</p>
</td>
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.1.4.1.2.2.3.1.2 "><p id="dli_01_0014__p152455618315">Name of a custom route, which is unique in the same enhanced datasource scenario. The name contains 1 to 64 characters, including digits, letters, underscores (_), and hyphens (-).</p>
</td>
</tr>
<tr id="dli_01_0014__row122452064312"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.1.4.1.2.2.3.1.1 "><p id="dli_01_0014__p1124516623114">IP Address</p>
</td>
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.1.4.1.2.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR block of different routes can overlap but cannot be the same.</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ul>
<ul id="dli_01_0014__ul4323161983711"><li id="dli_01_0014__li163231219153716">Deleting a route<p id="dli_01_0014__p20921330121210"><a name="dli_01_0014__li163231219153716"></a><a name="li163231219153716"></a>On the <span class="wintitle" id="dli_01_0014__wintitle4169310181914"><b>Enhanced</b></span> page, select a connection and choose <strong id="dli_01_0014__b116912105194">More</strong> &gt; <strong id="dli_01_0014__b3170141021919">Delete Route</strong> in the <strong id="dli_01_0014__b81709102192">Operation</strong> column, or click <strong id="dli_01_0014__b1917011021913">Delete Route</strong> on the <span class="wintitle" id="dli_01_0014__wintitle1589845133710"><b>Details</b></span> page of the connection to delete a custom route.</p>
</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

44
docs/dli/umn/dli_01_0015.html Normal file
View File

@ -0,0 +1,44 @@
<a name="dli_01_0015"></a><a name="dli_01_0015"></a>
<h1 class="topictitle1">Queue Permission Management</h1>
<div id="body1501038213757"><div class="section" id="dli_01_0015__section11499577152559"><h4 class="sectiontitle">Scenarios</h4><ul id="dli_01_0015__ul45004672142627"><li id="dli_01_0015__li27643373142627">You can isolate queues allocated to different users by setting permissions to ensure data query performance.</li><li id="dli_01_0015__li24342715142316">The administrator and queue owner have all permissions, which cannot be set or modified by other users.</li></ul>
</div>
<div class="section" id="dli_01_0015__section20128473551"><h4 class="sectiontitle">Operations</h4><ol id="dli_01_0015__ol31809540103928"><li id="dli_01_0015__li10639209101950"><span>On the top menu bar of the DLI management console, click <strong id="dli_01_0015__b761084715252">Resources</strong> &gt; <span class="uicontrol" id="dli_01_0015__uicontrol4872154310282"><b>Queue Management</b></span>.</span></li><li id="dli_01_0015__li5676629917517"><span>Select the queue to be configured and choose <strong id="dli_01_0015__b1355011215377">Manage Permissions</strong> in the <strong id="dli_01_0015__b165505213716">Operation</strong> column. The <strong id="dli_01_0015__b842352706171520">User Permission Info</strong> area displays the list of users who have permissions on the queue.</span><p><p id="dli_01_0015__p123538119117">You can assign queue permissions to new users, modify permissions for users who have some permissions of a queue, and revoke all permissions of a user on a queue.</p>
<ul id="dli_01_0015__ul60761295191140"><li id="dli_01_0015__li188984072720">Assign permissions to a new user.<div class="p" id="dli_01_0015__p3651154182719"><a name="dli_01_0015__li188984072720"></a><a name="li188984072720"></a>A new user does not have permissions on the queue.<ol type="a" id="dli_01_0015__ol38619773141515"><li id="dli_01_0015__li1545661718056">Click <strong id="dli_01_0015__b16897820560">Set Permission</strong> on the right of <strong id="dli_01_0015__b1908875614">User Permissions</strong> page. The <span class="wintitle" id="dli_01_0015__wintitle1990108175620"><b>Set Permission</b></span> dialog box is displayed.</li><li id="dli_01_0015__li12033638141515">Specify <span class="parmname" id="dli_01_0015__parmname1572165209191914"><b>Username</b></span> and select corresponding permissions.</li><li id="dli_01_0015__li136261439132">Click <span class="uicontrol" id="dli_01_0015__uicontrol131405151191935"><b>OK</b></span>.<p id="dli_01_0015__p97671211131410"><a href="#dli_01_0015__table15710625151416">Table 1</a> describes the related parameters.</p>
<div class="tablenoborder"><a name="dli_01_0015__table15710625151416"></a><a name="table15710625151416"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0015__table15710625151416" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0015__row1771212551410"><th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.2.2.2.2.2.1.1.1.3.3.2.3.1.1"><p id="dli_01_0015__p4713132520147">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="80%" id="mcps1.3.2.2.2.2.2.1.1.1.3.3.2.3.1.2"><p id="dli_01_0015__p1971410256146">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0015__row207191525121418"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.2.1.1.1.3.3.2.3.1.1 "><p id="dli_01_0015__p5721152541411">Username</p>
</td>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.2.2.2.2.2.1.1.1.3.3.2.3.1.2 "><p id="dli_01_0015__p77232254145">Name of the authorized user.</p>
<div class="note" id="dli_01_0015__note18961324477"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0015__p13896623472">The username is an existing IAM user name and has logged in to the DLI management console.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0015__row1273232517141"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.2.1.1.1.3.3.2.3.1.1 "><p id="dli_01_0015__p1873352541412">Permission Settings</p>
</td>
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.2.2.2.2.2.1.1.1.3.3.2.3.1.2 "><ul id="dli_01_0015__ul19734132517140"><li id="dli_01_0015__li1273552518147"><strong id="dli_01_0015__b19616182775213">Delete Queues</strong>: This permission allows you to delete the queue.</li><li id="dli_01_0015__li57405251141"><strong id="dli_01_0015__b842352706165610">Submit Jobs</strong>: This permission allows you to submit jobs using this queue.</li><li id="dli_01_0015__li6741725151419"><strong id="dli_01_0015__b842352706165628">Terminate Jobs</strong>: This permission allows you to terminate jobs submitted using this queue.</li><li id="dli_01_0015__li187441525101419"><strong id="dli_01_0015__b842352706165645">Grant Permission</strong>: This permission allows you to grant queue permissions to other users.</li><li id="dli_01_0015__li1574612513141"><strong id="dli_01_0015__b84235270616572">Revoke Permission</strong>: This permission allows you to revoke the queue permissions that other users have but cannot revoke the queue owner's permissions.</li><li id="dli_01_0015__li55847342101527"><strong id="dli_01_0015__b842352706162234">View Other User's Permissions</strong>: This permission allows you to view the queue permissions of other users.</li><li id="dli_01_0015__li17629232181312"><strong id="dli_01_0015__b204581124191616">Restart Queues</strong>: This permission allows you to restart queues.</li><li id="dli_01_0015__li590916091412"><strong id="dli_01_0015__b350110393199">Modify Queue Specifications</strong>: This permission allows you to modify queue specifications.</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</li></ol>
</div>
</li><li id="dli_01_0015__li5373564191140">To assign or revoke permissions of a user who has some permissions on the queue, perform the following steps:<ol type="a" id="dli_01_0015__ol64022357191649"><li id="dli_01_0015__li11136112815177">In the list under <span class="wintitle" id="dli_01_0015__wintitle2724849191220"><b>User Permission Info</b></span> for a queue, select the user whose permissions need to be modified and click <span class="uicontrol" id="dli_01_0015__uicontrol197263497126"><b>Set Permission</b></span> in the <span class="uicontrol" id="dli_01_0015__uicontrol156991298917161"><b>Operation</b></span> column.</li><li id="dli_01_0015__li3483530142353">In the displayed <span class="wintitle" id="dli_01_0015__wintitle1283331883119"><b>Set Permission</b></span> dialog box, modify the permissions of the current user. <a href="#dli_01_0015__table15710625151416">Table 1</a> lists the detailed permission descriptions.<p id="dli_01_0015__p3341848294412">If all options under <span class="parmname" id="dli_01_0015__parmname191181136193316"><b>Set Permission</b></span> are gray, you are not allowed to change permissions on this queue. You can apply to the administrator, queue owner, or other authorized users for queue permission granting and revoking.</p>
</li><li id="dli_01_0015__li10389193018234">Click <span class="uicontrol" id="dli_01_0015__uicontrol1516336014162242"><b>OK</b></span>.</li></ol>
</li><li id="dli_01_0015__li2536165618122">To revoke all permission of a user on the queue, perform the following steps:<p id="dli_01_0015__p41775579123"><a name="dli_01_0015__li2536165618122"></a><a name="li2536165618122"></a>In the user list under <span class="wintitle" id="dli_01_0015__wintitle418550809"><b>Permission Info</b></span>, select the user whose permission needs to be revoked and click <span class="uicontrol" id="dli_01_0015__uicontrol1291310555"><b>Revoke Permission</b></span> under <span class="uicontrol" id="dli_01_0015__uicontrol18942202419342"><b>Operation</b></span>. In the <strong id="dli_01_0015__b19765113823218">Revoke Permission</strong> dialog box, click <span class="uicontrol" id="dli_01_0015__uicontrol35891343193211"><b>OK</b></span>. All permissions on this queue are revoked.</p>
</li></ul>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0012.html">Queue Management</a></div>
</div>
</div>

17
docs/dli/umn/dli_01_0016.html Normal file
View File

@ -0,0 +1,17 @@
<a name="dli_01_0016"></a><a name="dli_01_0016"></a>
<h1 class="topictitle1">Deleting a Queue</h1>
<div id="body1501038213757"><p id="dli_01_0016__p16461459191012">You can delete a queue based on actual conditions.</p>
<div class="note" id="dli_01_0016__note9413185151111"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0016__ul45795743311"><li id="dli_01_0016__li1358011733310">This operation will fail if there are jobs in the <strong id="dli_01_0016__b27141763611">Submitting</strong> or <strong id="dli_01_0016__b125820153610">Running</strong> state on this queue.</li><li id="dli_01_0016__li1063413282129">Deleting a queue does not cause table data loss in your database.</li></ul>
</div></div>
<div class="section" id="dli_01_0016__section1015535913555"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0016__ol17321838112226"><li id="dli_01_0016__li10639209101950"><span>On the left of the DLI management console, click <strong id="dli_01_0016__b178272619304">Resources</strong> &gt;<span class="uicontrol" id="dli_01_0016__uicontrol89261914012"><b>Queue Management</b></span>.</span></li><li id="dli_01_0016__li172323754417"><span>Locate the row where the target queue locates and click <span class="uicontrol" id="dli_01_0016__uicontrol115498314509"><b>Delete</b></span> in the <span class="parmname" id="dli_01_0016__parmname11555193125011"><b>Operation</b></span> column.</span><p><div class="note" id="dli_01_0016__note2123195011570"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0016__p1477434110573">If <span class="uicontrol" id="dli_01_0016__uicontrol18933114220509"><b>Delete</b></span> in the <span class="parmname" id="dli_01_0016__parmname29395425502"><b>Operation</b></span> column is gray, the current user does not have the permission of deleting the queue. You can apply to the administrator for the permission.</p>
</div></div>
</p></li><li id="dli_01_0016__li2295562111246"><span>In the displayed dialog box, click <span class="uicontrol" id="dli_01_0016__uicontrol24383318512"><b>OK</b></span>.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0012.html">Queue Management</a></div>
</div>
</div>

142
docs/dli/umn/dli_01_0017.html Normal file
View File

File diff suppressed because it is too large Load Diff

22
docs/dli/umn/dli_01_0018.html Normal file
View File

@ -0,0 +1,22 @@
<a name="dli_01_0018"></a><a name="dli_01_0018"></a>
<h1 class="topictitle1">Enhanced Datasource Connection Permission Management</h1>
<div id="body0000001105035810"><div class="section" id="dli_01_0018__section208289518114"><h4 class="sectiontitle">Permission Management</h4><p id="dli_01_0018__p193191562115">You can grant or revoke permissions for enhanced datasource connections of other projects.</p>
<ul id="dli_01_0018__ul1876718716162"><li id="dli_01_0018__li222865395916">Authorization<ol id="dli_01_0018__ol328015169018"><li id="dli_01_0018__li5280181610014">Log in to the DLI management console, choose <strong id="dli_01_0018__b17958832174518">Datasource Connections</strong> and select the <strong id="dli_01_0018__b4470115894517">Enhanced</strong> tab, select a datasource connection, and choose <strong id="dli_01_0018__b5577192616461">More</strong> &gt; <strong id="dli_01_0018__b183395290462">Manage Permission</strong> in the <strong id="dli_01_0018__b47861731104614">Operation</strong> column. In the displayed <strong id="dli_01_0018__b15385115110815">Permissions</strong> dialog box, select <strong id="dli_01_0018__b13973145513814">Grant Permission</strong>, enter the project ID, and click <strong id="dli_01_0018__b1957418162912">OK</strong>.</li><li id="dli_01_0018__li291031715020">After a project is authorized, you can log in to the system as a user of the authorized project or switch to the corresponding project. In the <strong id="dli_01_0018__b10092937640030">Enhanced</strong> tab, you can view the authorized datasource connection and bind the created queue to the datasource connection. Cross-project datasource connections and routes can be created.</li></ol>
<div class="note" id="dli_01_0018__note15501142236"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0018__ul17620456635"><li id="dli_01_0018__li179143815513">If the authorized projects belong to different users in the same region, you can use the user account of the authorized projects to log in.</li><li id="dli_01_0018__li206221564316">If the authorized projects belong to the same user in the same region, you can use the current account to switch to the corresponding project.</li></ul>
</div></div>
<p id="dli_01_0018__p1244910177274">For example, if project B needs to access the data source of project A, perform the following operations:</p>
<ul id="dli_01_0018__ul69144842713"><li id="dli_01_0018__li19954415272">For Project A:<ol id="dli_01_0018__ol166981958182717"><li id="dli_01_0018__li1769820584278">Log in to DLI using the account of project A.</li><li id="dli_01_0018__li13781682299">Create an enhanced datasource connection <strong id="dli_01_0018__b7703175121916">ds</strong> in DLI based on the VPC information of the corresponding data source.</li><li id="dli_01_0018__li14201345202915">Grant project B the permission to access the enhanced datasource connection <strong id="dli_01_0018__b164661155191911">ds</strong>.</li></ol>
</li></ul>
<ul id="dli_01_0018__ul179078214395"><li id="dli_01_0018__li5908192193910">For Project B:<ol id="dli_01_0018__ol198631919113910"><li id="dli_01_0018__li7863191923911">Log in to DLI using the account of project B.</li><li id="dli_01_0018__li5851105920396">Bind the enhanced datasource connection <strong id="dli_01_0018__b8473166207">ds</strong> to a queue.</li><li id="dli_01_0018__li1550325212175">(Optional) Set host information and create a route.</li></ol>
</li></ul>
<p id="dli_01_0018__p126011320104116">After creating a VPC peering connection and route between the enhanced datasource connection of project A and the queue of project B, you can create a job in the queue of project B to access the data source of project A.</p>
</li><li id="dli_01_0018__li124815423164">Revoke: In the <strong id="dli_01_0018__b115071914162012">Manage Permissions</strong> dialog box, select <strong id="dli_01_0018__b1251321418207">Revoke Permission</strong> and select the ID of the project whose permissions need to be revoked.</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0426.html">Enhanced Datasource Connections</a></div>
</div>
</div>

140
docs/dli/umn/dli_01_0021.html Normal file
View File

File diff suppressed because it is too large Load Diff

17
docs/dli/umn/dli_01_0220.html Normal file
View File

@ -0,0 +1,17 @@
<a name="dli_01_0220"></a><a name="dli_01_0220"></a>
<h1 class="topictitle1">Getting Started</h1>
<div id="body1510283588485"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0002.html">Creating and Submitting a Spark SQL Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0512.html">Developing and Submitting a Spark SQL Job Using the TPC-H Sample Template</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0375.html">Creating and Submitting a Spark Jar Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0531.html">Creating and Submitting a Flink OpenSource SQL Job</a></strong><br>
</li>
</ul>
</div>

119
docs/dli/umn/dli_01_0228.html Normal file
View File

File diff suppressed because it is too large Load Diff

134
docs/dli/umn/dli_01_0253.html Normal file
View File

File diff suppressed because it is too large Load Diff

296
docs/dli/umn/dli_01_0320.html Normal file
View File

File diff suppressed because it is too large Load Diff

66
docs/dli/umn/dli_01_0363.html Normal file
View File

@ -0,0 +1,66 @@
<a name="dli_01_0363"></a><a name="dli_01_0363"></a>
<h1 class="topictitle1">Creating a Queue</h1>
<div id="body1501038213757"><p id="dli_01_0363__p1731419482089">Before executing a job, you need to create a queue.</p>
<div class="note" id="dli_01_0363__note1293204515206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0363__ul17341756521"><li id="dli_01_0363__li1174985419502">If you use a sub-account to create a queue for the first time, log in to the DLI management console using the main account and keep records in the DLI database before creating a queue.</li><li id="dli_01_0363__li1373411525216">It takes 6 to 10 minutes for a job running on a new queue for the first time.</li><li id="dli_01_0363__li11343161015521">After a queue is created, if no job is run within one hour, the system releases the queue.</li></ul>
</div></div>
<div class="section" id="dli_01_0363__section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0363__ol24716195296"><li id="dli_01_0363__li947220195291">You can create a queue on the <span class="wintitle" id="dli_01_0363__wintitle686912613315"><b>Overview</b></span>, <span class="wintitle" id="dli_01_0363__wintitle20869192623118"><b>SQL Editor</b></span>, or <span class="wintitle" id="dli_01_0363__wintitle18870626173120"><b>Queue Management</b></span> page.<ul id="dli_01_0363__ul435871517496"><li id="dli_01_0363__li1359201518491">In the upper right corner of the <strong id="dli_01_0363__b3686177172119">Overview</strong> page, click Create Queue.</li><li id="dli_01_0363__li8634112214911">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle1782046172416"><b>Queue Management</b></span> page:<ol type="a" id="dli_01_0363__ol1592205194915"><li id="dli_01_0363__li1059116511492">In the navigation pane of the DLI management console, choose <strong id="dli_01_0363__b15623755102515">Resources</strong> &gt;<span class="uicontrol" id="dli_01_0363__uicontrol1712082421418"><b>Queue Management</b></span>.</li><li id="dli_01_0363__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0363__wintitle1629419173214"><b>Queue Management</b></span> page, click <strong id="dli_01_0363__b152951717182111">Create Queue</strong> to create a queue.</li></ol>
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane of the DLI management console, click <span class="uicontrol" id="dli_01_0363__uicontrol1996404019456"><b>SQL Editor</b></span>.</li><li id="dli_01_0363__li1864613225498">On the left pane of the displayed <strong id="dli_01_0363__b6128105210351">SQL Editor</strong> page, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> to the right of <strong id="dli_01_0363__b135291883619">Queues</strong>.</li></ol>
</li></ul>
</li><li id="dli_01_0363__li1472111916293">In the displayed Create Queue dialog box, set related parameters by referring to <a href="#dli_01_0363__table17301125219910">Table 1</a>.<div class="p" id="dli_01_0363__p206522012141215">
<div class="tablenoborder"><a name="dli_01_0363__table17301125219910"></a><a name="table17301125219910"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0363__table17301125219910" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="dli_01_0363__row112973522913"><th align="left" class="cellrowborder" valign="top" width="14.77%" id="mcps1.3.3.2.2.2.1.2.3.1.1"><p id="dli_01_0363__p17297145215918">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="85.22999999999999%" id="mcps1.3.3.2.2.2.1.2.3.1.2"><p id="dli_01_0363__p1229775212915">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0363__row132972521295"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p029718521495">Name</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0363__p192978528910">Name of a queue.</p>
<ul id="dli_01_0363__ul429710528910"><li id="dli_01_0363__li162973521797">The queue name can contain only digits, letters, and underscores (_), but cannot contain only digits, start with an underscore (_), or be left unspecified.</li><li id="dli_01_0363__li12978521191">The length of the name cannot exceed 128 characters.</li></ul>
<div class="note" id="dli_01_0363__note13297452697"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p192979529919">The queue name is case-insensitive. Uppercase letters will be automatically converted to lowercase letters.</p>
</div></div>
</td>
</tr>
<tr id="dli_01_0363__row82981752094"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p629715213917">Type</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><ul id="dli_01_0363__ul1029875217914"><li id="dli_01_0363__li1229745218914"><strong id="dli_01_0363__b3471630195419">For SQL</strong>: compute resources used for SQL jobs.</li><li id="dli_01_0363__li1829818521296"><strong id="dli_01_0363__b8738194132314">For general purpose</strong>: compute resources used for Spark and Flink jobs.<div class="note" id="dli_01_0363__note1829815214917"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p329815212917">In <strong id="dli_01_0363__b114679913236">Dedicated Resource Mode</strong>, you can create enhanced datasource connections. </p>
</div></div>
</li></ul>
</td>
</tr>
<tr id="dli_01_0363__row202991052199"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p132987521911">Specifications</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0363__p13298105216917">Select queue specifications as required. A CU includes one core and 4 GB memory. You can set the total number of CUs on all compute nodes of a queue. DLI automatically allocates the memory and vCPUs for each node.</p>
<ul id="dli_01_0363__ul92992521991"><li id="dli_01_0363__li529919522917">Fixed specifications include <span class="parmvalue" id="dli_01_0363__parmvalue12849285516"><b>16 CUs</b></span>, <span class="parmvalue" id="dli_01_0363__parmvalue1859916711558"><b>64 CUs</b></span>, <span class="parmvalue" id="dli_01_0363__parmvalue947752245514"><b>256 CUs</b></span>, and <span class="parmvalue" id="dli_01_0363__parmvalue2109152775515"><b>512 CUs</b></span>.</li><li id="dli_01_0363__li16299852795"><strong id="dli_01_0363__b195120381321">Custom</strong>: Set the specifications as required.</li></ul>
</td>
</tr>
<tr id="dli_01_0363__row62996521099"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p1129916526920">Description</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><p id="dli_01_0363__p192991252199">Description of the queue to be created. The length of the queue name cannot exceed 256 characters.</p>
</td>
</tr>
<tr id="dli_01_0363__row1530012524917"><td class="cellrowborder" valign="top" width="14.77%" headers="mcps1.3.3.2.2.2.1.2.3.1.1 "><p id="dli_01_0363__p3299452791">Advanced Settings</p>
</td>
<td class="cellrowborder" valign="top" width="85.22999999999999%" headers="mcps1.3.3.2.2.2.1.2.3.1.2 "><div class="p" id="dli_01_0363__p0300185215911">In the <span class="parmname" id="dli_01_0363__parmname12909114468"><b>Queue Type</b></span> area, select <span class="parmvalue" id="dli_01_0363__parmvalue639181216240"><b>Dedicated Resource Mode</b></span> and then click <strong id="dli_01_0363__b152775425810">Advanced Settings</strong>.<ul id="dli_01_0363__ul4300452895"><li id="dli_01_0363__li829905210913"><strong id="dli_01_0363__b10386158155714">Default</strong>: The system automatically configures the parameter.</li><li id="dli_01_0363__li14300852692"><strong id="dli_01_0363__b5653124465512">Custom</strong><p id="dli_01_0363__p1730085219912"><span class="parmname" id="dli_01_0363__parmname146519343320"><b>CIDR Block</b></span>: You can specify the CIDR block. For details, see <a href="dli_01_0443.html">Modifying the Queue CIDR Block</a>. If DLI enhanced datasource connection is used, the CIDR block of the DLI queue cannot overlap with that of the data source.</p>
<p id="dli_01_0363__p143001521498"><span class="parmname" id="dli_01_0363__parmname371585753911"><b>Queue Type</b></span>: When running an AI-related SQL job, select <span class="parmvalue" id="dli_01_0363__parmvalue74576129408"><b>AI-enhanced</b></span>. When running other jobs, select <span class="parmvalue" id="dli_01_0363__parmvalue124431427194019"><b>Basic</b></span>.</p>
</li></ul>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</li><li id="dli_01_0363__li647261910292">Click <span class="uicontrol" id="dli_01_0363__uicontrol19947846102516"><b>Create Now</b></span> to create a queue.<p id="dli_01_0363__p1543112413517">After a queue is created, you can view and select the queue for use on the <span class="wintitle" id="dli_01_0363__wintitle64862717152748"><b>Queue Management</b></span> page.</p>
<div class="note" id="dli_01_0363__note731816483410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0363__p193203483416">It takes 6 to 10 minutes for a job running on a new queue for the first time.</p>
</div></div>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0012.html">Queue Management</a></div>
</div>
</div>

25
docs/dli/umn/dli_01_0366.html Normal file
View File

@ -0,0 +1,25 @@
<a name="dli_01_0366"></a><a name="dli_01_0366"></a>
<h1 class="topictitle1">Package Management</h1>
<div id="body8662426"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0407.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0477.html">Managing Permissions on Packages and Package Groups</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0367.html">Creating a Package</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0369.html">Deleting a Package</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0478.html">Modifying the Owner</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0397.html">Built-in Dependencies</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0004.html">Data Management</a></div>
</div>
</div>

54
docs/dli/umn/dli_01_0367.html Normal file
View File

@ -0,0 +1,54 @@
<a name="dli_01_0367"></a><a name="dli_01_0367"></a>
<h1 class="topictitle1">Creating a Package</h1>
<div id="body8662426"><p id="dli_01_0367__en-us_topic_0122016946_p93081221124114">DLI allows you to submit program packages in batches to the general-use queue for running.</p>
<div class="note" id="dli_01_0367__note7234131133213"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0367__p92352011173213">If you need to update a package, you can use the same package or file to upload it to the same location (in the same group) on DLI to overwrite the original package or file.</p>
</div></div>
<div class="section" id="dli_01_0367__section18887174943920"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0367__p420613556395">All software packages must be uploaded to OBS for storage in advance.</p>
</div>
<div class="section" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0367__ol172795412248"><li id="dli_01_0367__li0727165414248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0367__uicontrol155446476912"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0367__uicontrol1252865218920"><b>Package Management</b></span>.</li><li id="dli_01_0367__li13727135411249">On the <span class="wintitle" id="dli_01_0367__wintitle196674031013"><b>Package Management</b></span> page, click <strong id="dli_01_0367__b14725441019">Create</strong> in the upper right corner to create a package.</li><li id="dli_01_0367__li10728165402418">In the displayed <span class="wintitle" id="dli_01_0367__wintitle11408195612575"><b>Create Package</b></span> dialog box, set related parameters by referring to <a href="#dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536">Table 1</a>.
<div class="tablenoborder"><a name="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><a name="en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row15177266171536"><th align="left" class="cellrowborder" valign="top" width="17.05%" id="mcps1.3.4.2.3.3.2.3.1.1"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p5976489517160">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="82.95%" id="mcps1.3.4.2.3.3.2.3.1.2"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p911830717160">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0367__row0411835105712"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p25317410132926">Package Type</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p37444329132926">The following package types are supported:</p>
<ul id="dli_01_0367__en-us_topic_0122016946_ul19355124635412"><li id="dli_01_0367__en-us_topic_0122016946_li173552046135410">JAR: JAR file</li><li id="dli_01_0367__en-us_topic_0122016946_li1035554615417">PyFile: User Python file</li><li id="dli_01_0367__en-us_topic_0122016946_li73551146195414">File: User file</li></ul>
</td>
</tr>
<tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row56284350171536"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p4555561017160">Package File Path</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__en-us_topic_0122016946_p12672162955118">Select the OBS path of the corresponding packages.</p>
<div class="note" id="dli_01_0367__note1287585810107"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0367__ul04810218124"><li id="dli_01_0367__li2482142101215">The packages must be uploaded to OBS for storage in advance.</li><li id="dli_01_0367__li1748213216127">Only files can be selected.</li></ul>
</div></div>
</td>
</tr>
<tr id="dli_01_0367__row415617241883"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p715712241188">Group Policy</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__p515762417817">You can select <strong id="dli_01_0367__b1860445618266">Use existing group</strong>, <strong id="dli_01_0367__b2902121152716">Use new group</strong>, or <strong id="dli_01_0367__b78942072711">No grouping</strong>.</p>
</td>
</tr>
<tr id="dli_01_0367__row740151051019"><td class="cellrowborder" valign="top" width="17.05%" headers="mcps1.3.4.2.3.3.2.3.1.1 "><p id="dli_01_0367__p14131010102">Group Name</p>
</td>
<td class="cellrowborder" valign="top" width="82.95%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><ul id="dli_01_0367__ul17658122119107"><li id="dli_01_0367__li102146242916"><strong id="dli_01_0367__b796141762818">Use existing group</strong>: Select an existing group.</li><li id="dli_01_0367__li11658221171019"><strong id="dli_01_0367__b1172465713287">Use new group</strong>: Enter a custom group name.</li><li id="dli_01_0367__li3756181791116"><strong id="dli_01_0367__b167792018299">No grouping</strong>: No need to select or enter a group name.</li></ul>
<div class="note" id="dli_01_0367__note459512341000"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0367__ul147622187210"><li id="dli_01_0367__li5762181811211">If you select a group, the permission management refers to the permissions of the corresponding package group.</li><li id="dli_01_0367__li1376219183220">If no group is selected, the permission management refers to the permissions of the corresponding package.</li></ul>
<p id="dli_01_0367__p17681040525">For details about how to manage permissions on package groups and packages, see <a href="dli_01_0477.html">Managing Permissions on Packages and Package Groups</a>.</p>
</div></div>
</td>
</tr>
</tbody>
</table>
</div>
</li><li id="dli_01_0367__li472825420248">Click <span class="uicontrol" id="dli_01_0367__uicontrol4864202813586"><b>OK</b></span>.<p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p1543112413517">After a package is created, you can view and select the package for use on the <span class="wintitle" id="dli_01_0367__wintitle1066123765811"><b>Package Management</b></span> page.</p>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0366.html">Package Management</a></div>
</div>
</div>

13
docs/dli/umn/dli_01_0369.html Normal file
View File

@ -0,0 +1,13 @@
<a name="dli_01_0369"></a><a name="dli_01_0369"></a>
<h1 class="topictitle1">Deleting a Package</h1>
<div id="body8662426"><p id="dli_01_0369__en-us_topic_0122016948_en-us_topic_0093946752_p19218322171945">You can delete a package based on actual conditions.</p>
<div class="section" id="dli_01_0369__en-us_topic_0122016948_en-us_topic_0093946752_section1015535913555"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0369__ol92311048152411"><li id="dli_01_0369__li82319482246">On the left of the management console, choose <span class="uicontrol" id="dli_01_0369__uicontrol0527755124512"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0369__uicontrol12527185517458"><b>Package Management</b></span>.</li><li id="dli_01_0369__li2231144811249">Click <span class="uicontrol" id="dli_01_0369__uicontrol192517519462"><b>Delete</b></span> in the <span class="parmname" id="dli_01_0369__parmname17366101213467"><b>Operation</b></span> column of the package to be deleted.</li><li id="dli_01_0369__li2232104852413">In the dialog box that is displayed, click <span class="uicontrol" id="dli_01_0369__uicontrol177411619462"><b>Yes</b></span>.</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0366.html">Package Management</a></div>
</div>
</div>

52
docs/dli/umn/dli_01_0375.html Normal file
View File

@ -0,0 +1,52 @@
<a name="dli_01_0375"></a><a name="dli_01_0375"></a>
<h1 class="topictitle1">Creating and Submitting a Spark Jar Job</h1>
<div id="body1531966492787"><p id="dli_01_0375__p934442315541">You can use DLI to submit Spark jobs for real-time computing. The general procedure is as follows:</p>
<p id="dli_01_0375__p117221010204913"><a href="#dli_01_0375__section3751181910618">Step 1: Logging in to the Cloud</a></p>
<p id="dli_01_0375__p5746512114914"><a href="#dli_01_0375__section10891114913473">Step 2: Uploading Data to OBS</a></p>
<p id="dli_01_0375__p8291815134918"><a href="#dli_01_0375__section19012773105034">Step 3: Logging In to the DLI Management Console</a></p>
<p id="dli_01_0375__p07722016154920"><a href="#dli_01_0375__section122981023152710">Step 4: Creating a Queue</a></p>
<p id="dli_01_0375__p13369418124916"><a href="#dli_01_0375__section21433273112656">Step 5: Creating a Package</a></p>
<p id="dli_01_0375__p132924161969"><a href="#dli_01_0375__section21590507141153">Step 6: Submitting a Spark Job</a></p>
<div class="section" id="dli_01_0375__section3751181910618"><a name="dli_01_0375__section3751181910618"></a><a name="section3751181910618"></a><h4 class="sectiontitle">Step 1: Logging in to the Cloud</h4><p id="dli_01_0375__p79731024469">To use DLI, you need to log in to the cloud.</p>
</div>
<ol id="dli_01_0375__ol77610191561"><li id="dli_01_0375__li1873417233111">Open the DLI home page.</li><li id="dli_01_0375__li1597319241563">On the login page, enter the username and password, and click <strong id="dli_01_0375__b87301033104820">Log In</strong>.</li></ol>
<div class="section" id="dli_01_0375__section10891114913473"><a name="dli_01_0375__section10891114913473"></a><a name="section10891114913473"></a><h4 class="sectiontitle">Step 2: Uploading Data to OBS</h4><p id="dli_01_0375__p551741275618">Write a Spark Jar job program , and compile and package it as <strong id="dli_01_0375__b281881725913">spark-examples.jar</strong>. Perform the following steps to submit the job:</p>
<p id="dli_01_0375__p45348185145915">Before submitting Spark Jar jobs, upload data files to OBS.</p>
<ol id="dli_01_0375__ol18891449164710"><li id="dli_01_0375__li18770142812720">In the services displayed, click <strong id="dli_01_0375__b10681912113315">Object Storage Service (OBS)</strong> in <strong id="dli_01_0375__b86819122333">Storage</strong>.</li><li id="dli_01_0375__li108923494479">The OBS console page is displayed.</li><li id="dli_01_0375__li1385211252717">Create a bucket. The bucket name must be globally unique. In this example, assume that the bucket name is <strong id="dli_01_0375__b349033115613">dli-test-obs01</strong>.<ol type="a" id="dli_01_0375__ol182612310711"><li id="dli_01_0375__li462934116719">Click <span class="uicontrol" id="dli_01_0375__uicontrol3515111010568"><b>Create Bucket</b></span>.</li><li id="dli_01_0375__li183491949872">On the displayed <strong id="dli_01_0375__b1736513156263">Create Bucket</strong> page, enter the <strong id="dli_01_0375__b153711815192617">Bucket Name</strong>. Retain the default values for other parameters or set them as required.</li><li id="dli_01_0375__li1089354984713">Click <strong id="dli_01_0375__b55859547573">Create Now</strong>.</li></ol>
</li><li id="dli_01_0375__li13893749154715">Click <strong id="dli_01_0375__b198121931182012">dli-test-obs01</strong> to switch to the <strong id="dli_01_0375__b168121831102014">Overview</strong> page.</li><li id="dli_01_0375__li1129115358610">From the left navigation tree, click <strong id="dli_01_0375__b17105173492019">Objects</strong>. Click <strong id="dli_01_0375__b310514347204">Upload Object</strong>. In the displayed dialog box, drag files or folders to upload or add file to the file upload box, for example, <span class="parmname" id="dli_01_0375__parmname477111272516"><b>spark-examples.jar</b></span>. Then, click <span class="uicontrol" id="dli_01_0375__uicontrol1160514822611"><b>Upload</b></span>.<p id="dli_01_0375__p53510371013">After the file is uploaded successfully, the file path is <span class="filepath" id="dli_01_0375__filepath8679102112119"><b>obs://dli-test-obs01/spark-examples.jar</b></span>.</p>
<p id="dli_01_0375__p9375852182812">For more information about OBS operations, see the <em id="dli_01_0375__i1410111914262">Object Storage Service Console Operation Guide</em>.</p>
<p id="dli_01_0375__p1644914312293">For more information about the tool, see the <em id="dli_01_0375__i1218132242612">OBS Tool Guide</em>.</p>
<div class="note" id="dli_01_0375__note121534311285"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0375__p277224772810">You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.</p>
<ul id="dli_01_0375__ul12727649112820"><li id="dli_01_0375__li182202533286">OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS. You are advised to use this tool to create buckets or upload objects.</li></ul>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0375__section19012773105034"><a name="dli_01_0375__section19012773105034"></a><a name="section19012773105034"></a><h4 class="sectiontitle">Step 3: Logging In to the DLI Management Console</h4><p id="dli_01_0375__p170111716265">To submit Spark jobs, you need to enter the Spark job creation page first.</p>
<ol id="dli_01_0375__ol33542655111116"><li id="dli_01_0375__li2096805415940">In the list, choose .</li><li id="dli_01_0375__li38964926151831">The DLI management console page is displayed.<div class="note" id="dli_01_0375__note231512513316"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0375__p231925193114">If you log in to the DLI management console for the first time, you need to be authorized to access OBS. For details, see "Service Authorization".</p>
</div></div>
</li></ol>
</div>
<div class="section" id="dli_01_0375__section122981023152710"><a name="dli_01_0375__section122981023152710"></a><a name="section122981023152710"></a><h4 class="sectiontitle">Step 4: Creating a Queue</h4><p id="dli_01_0375__p5551648414">If you submit a Spark job for the first time, you need to create a queue first. For example, create a queue named <strong id="dli_01_0375__b18940163725910">sparktest</strong> and set <strong id="dli_01_0375__b9941203755913">Queue Type</strong> to <strong id="dli_01_0375__b07631213164717">General Queue</strong>.</p>
<ol id="dli_01_0375__ol1977217571226"><li id="dli_01_0375__li1059116511492">In the navigation pane of the DLI management console, choose <span class="uicontrol" id="dli_01_0375__uicontrol510284210593"><b>Queue Management</b></span>.</li><li id="dli_01_0375__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0375__wintitle4186197182915"><b>Queue Management</b></span> page, click <strong id="dli_01_0375__b16186107192918">Create Queue</strong> to create a queue.</li><li id="dli_01_0375__li550904418312">Create a queue, name it <strong id="dli_01_0375__b4533124655914">sparktest</strong>, and set the queue usage to for general purpose. For details, see Creating a Queue.<p id="dli_01_0375__p86371522489"></p>
</li><li id="dli_01_0375__li647261910292">Click <span class="uicontrol" id="dli_01_0375__uicontrol338141308"><b>Create Now</b></span> to create a queue.</li></ol>
</div>
<div class="section" id="dli_01_0375__section21433273112656"><a name="dli_01_0375__section21433273112656"></a><a name="section21433273112656"></a><h4 class="sectiontitle">Step 5: Creating a Package</h4><p id="dli_01_0375__p498774501214">Before submitting a Spark job, you need to create a package, for example, <strong id="dli_01_0375__b17591192235312">spark-examples.jar</strong>.</p>
<ol id="dli_01_0375__ol6181725181410"><li id="dli_01_0375__li0727165414248">In the navigation pane on the left of the DLI console, choose <span class="uicontrol" id="dli_01_0375__uicontrol16727106102"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0375__uicontrol772715611012"><b>Package Management</b></span>.</li><li id="dli_01_0375__li13727135411249">On the <span class="wintitle" id="dli_01_0375__wintitle1923015915014"><b>Package Management</b></span> page, click <strong id="dli_01_0375__b42312091008">Create</strong> in the upper right corner to create a package.</li><li id="dli_01_0375__li10728165402418">In the <strong id="dli_01_0375__b51515151302">Create Package</strong> dialog box, set <strong id="dli_01_0375__b151614152015">Type</strong> to <strong id="dli_01_0375__b1316131513010">JAR</strong>, <strong id="dli_01_0375__b17169152002">OBS Path</strong> to the path of the spark-examples.jar package in <a href="#dli_01_0375__section10891114913473">Step 2: Uploading Data to OBS</a>, and <strong id="dli_01_0375__b15175152002">Group</strong> to <strong id="dli_01_0375__b2172151509">Do not use</strong>.<p id="dli_01_0375__p1853715711915"></p>
</li><li id="dli_01_0375__li472825420248">Click <span class="uicontrol" id="dli_01_0375__uicontrol13383131711010"><b>OK</b></span>.<p id="dli_01_0375__en-us_topic_0122016946_en-us_topic_0093946917_p1543112413517">You can view and select the package on the <span class="wintitle" id="dli_01_0375__wintitle7855171912016"><b>Package Management</b></span> page.</p>
</li></ol>
<p id="dli_01_0375__p152403475316">For details about how to create a package, see "Creating a Package".</p>
</div>
<div class="section" id="dli_01_0375__section21590507141153"><a name="dli_01_0375__section21590507141153"></a><a name="section21590507141153"></a><h4 class="sectiontitle">Step 6: Submitting a Spark Job</h4><ol id="dli_01_0375__ol13334841116"><li id="dli_01_0375__li787014474310">On the DLI management console, choose <strong id="dli_01_0375__b252635684513">Job Management &gt; Spark Jobs</strong> in the navigation pane on the left. On the displayed page, click <strong id="dli_01_0375__b11359182644">Create Job</strong>.</li><li id="dli_01_0375__li68657434228">On the Spark job editing page, set <strong id="dli_01_0375__b11433131752">Queues</strong> to the queue created in <a href="#dli_01_0375__section122981023152710">Step 4: Creating a Queue</a> and <strong id="dli_01_0375__b1112910211056">Application</strong> to the package created in <a href="#dli_01_0375__section21433273112656">Step 5: Creating a Package</a>.<p id="dli_01_0375__p8407123292413">For details about other parameters, see the description of the Spark job editing page in "Creating a Spark Job".</p>
</li><li id="dli_01_0375__li793921414487">Click <strong id="dli_01_0375__b1648118125414">Execute</strong> in the upper right corner of the Spark job editing window, read and agree to the privacy agreement, and click <strong id="dli_01_0375__b19493885411">OK</strong>. Submit the job. A message is displayed, indicating that the job is submitted.<p id="dli_01_0375__p171961850152716"></p>
</li><li id="dli_01_0375__li91513419184">(Optional) Switch to the <strong id="dli_01_0375__b774111583518">Job Management &gt; Spark Jobs</strong> page to view the status and logs of the submitted Spark job.<div class="note" id="dli_01_0375__note8365749164313"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0375__p19786105514174">When you click <strong id="dli_01_0375__b3208155475413">Execute</strong> on the DLI management console for the first time, you need to read the privacy agreement. Once agreed to the agreement, you will not receive any privacy agreement messages for subsequent operations.</p>
</div></div>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0220.html">Getting Started</a></div>
</div>
</div>

18
docs/dli/umn/dli_01_0376.html Normal file
View File

@ -0,0 +1,18 @@
<a name="dli_01_0376"></a><a name="dli_01_0376"></a>
<h1 class="topictitle1">Modifying the Owners of Databases and Tables</h1>
<div id="body1569491496985"><p id="dli_01_0376__p7729122613405">During actual use, developers create databases and tables and submit them to test personnel for testing. After the test is complete, the databases and tables are transferred to O&amp;M personnel for user experience. In this case, you can change the owner of the databases and tables to transfer data to other owners.</p>
<div class="section" id="dli_01_0376__section48746710711"><h4 class="sectiontitle">Modifying the Database Owner</h4><div class="p" id="dli_01_0376__p17554192016499">You can change the owner of a database on either the <span class="wintitle" id="dli_01_0376__wintitle112031233219"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0376__wintitle112037333118"><b>SQL Editor</b></span> page.<ul id="dli_01_0376__ul10405142364818"><li id="dli_01_0376__li2040592311485">On the <span class="wintitle" id="dli_01_0376__wintitle1588611347119"><b>Data Management</b></span> page, change the database owner.<ol id="dli_01_0376__ol153397745813"><li id="dli_01_0376__li182443471248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0376__uicontrol14267241951"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0376__uicontrol226424355"><b>Databases and Tables</b></span>.</li><li id="dli_01_0376__li1924517478247">On the <span class="wintitle" id="dli_01_0376__wintitle25814432053"><b>Databases and Tables</b></span> page, locate the database you want and click <strong id="dli_01_0376__b029313718312">More</strong> &gt; <span class="uicontrol" id="dli_01_0376__uicontrol119711541751"><b>Modify Database</b></span> in the <strong id="dli_01_0376__b829315585512">Operation</strong> column.</li><li id="dli_01_0376__li1979150165815">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol3175153914115"><b>OK</b></span>.</li></ol>
</li><li id="dli_01_0376__li10384371151118">Change the database owner on the <span class="wintitle" id="dli_01_0376__wintitle1853761213618"><b>SQL Editor</b></span> page.<ol id="dli_01_0376__ol39382464151459"><li id="dli_01_0376__li169951648123920">On the left of the management console, click <strong id="dli_01_0376__b198591277618">SQL Editor</strong>.</li><li id="dli_01_0376__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0376__b589495416313">Databases</strong>, click <span><img id="dli_01_0376__image10279959109" src="en-us_image_0237984360.png"></span> on the right of the database you want to modify, and choose <strong id="dli_01_0376__b590012548318">Modify Database</strong> from the shortcut menu.</li><li id="dli_01_0376__li0998173818546">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol1952613461213"><b>OK</b></span>.</li></ol>
</li></ul>
</div>
</div>
<div class="section" id="dli_01_0376__section587311710717"><h4 class="sectiontitle">Modifying the Table Owner</h4><ol id="dli_01_0376__ol1098894162614"><li id="dli_01_0376__li5988141102620">On the left of the management console, choose <span class="uicontrol" id="dli_01_0376__uicontrol07043303612"><b>Data Management</b></span> &gt; <span class="uicontrol" id="dli_01_0376__uicontrol57057309615"><b>Databases and Tables</b></span>.</li><li id="dli_01_0376__li11988184117268">Click the name of the database corresponding to the table to be modified. The <strong id="dli_01_0376__b4573203212613">Manage Tables</strong> page of the database is displayed.</li><li id="dli_01_0376__li14988134192617">In the <strong id="dli_01_0376__b5541114516512">Operation</strong> column of the target table, choose <span class="uicontrol" id="dli_01_0376__uicontrol7358125715115"><b>More</b></span> &gt; <span class="uicontrol" id="dli_01_0376__uicontrol13196251527"><b>Modify Owner</b></span>.</li><li id="dli_01_0376__li698814192614">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol66025616110"><b>OK</b></span>.</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Databases and Tables</a></div>
</div>
</div>

91
docs/dli/umn/dli_01_0377.html Normal file
View File

@ -0,0 +1,91 @@
<a name="dli_01_0377"></a><a name="dli_01_0377"></a>
<h1 class="topictitle1">DLI Console Overview</h1>
<div id="body1532683323732"><div class="section" id="dli_01_0377__section1952482781110"><h4 class="sectiontitle">Overview</h4><p id="dli_01_0377__p1193063418125">Log in to DLI and go to the <strong id="dli_01_0377__b13968151841">Overview</strong> page.</p>
<p id="dli_01_0377__p1994102119152">The following table describes the functional areas of the <strong id="dli_01_0377__b1179311963811">Overview</strong> page.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0377__en-us_topic_0093946815_table48732667171120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Areas</caption><thead align="left"><tr id="dli_01_0377__en-us_topic_0093946815_row19196955171120"><th align="left" class="cellrowborder" valign="top" width="7.841584158415841%" id="mcps1.3.1.4.2.4.1.1"><p id="dli_01_0377__p1851454085710">No.</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.782178217821784%" id="mcps1.3.1.4.2.4.1.2"><p id="dli_01_0377__en-us_topic_0093946815_p35936586171120">Area</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="73.37623762376238%" id="mcps1.3.1.4.2.4.1.3"><p id="dli_01_0377__en-us_topic_0093946815_p25182390171120">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0377__row13177151111619"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p14178851151619">1</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p2178851121614">Navigation pane</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p1617813516160">The navigation bar on the DLI management console, including <strong id="dli_01_0377__b1252026365">Overview</strong>, <strong id="dli_01_0377__b65217265614">SQL Editor</strong>, <strong id="dli_01_0377__b45202616613">Job Management</strong>, <strong id="dli_01_0377__b165216261166">Queue Management</strong>, <strong id="dli_01_0377__b165312617617">Data Management</strong>, <strong id="dli_01_0377__b353226165">Job Templates</strong>, <strong id="dli_01_0377__b65372613619">Datasource Connections</strong>, and <strong id="dli_01_0377__b65319262611">Global Configuration</strong>.</p>
</td>
</tr>
<tr id="dli_01_0377__row6996420121612"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p11996320161619">2</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p179961920171615">DLI introduction</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p1399717205164">Data Lake Insight (DLI) is a fully hosted big data processing and analysis service. It frees you from managing any server. DLI supports standard SQL and is compatible with Spark and Flink SQL. It also supports multiple access modes, and is compatible with mainstream data formats.</p>
</td>
</tr>
<tr id="dli_01_0377__row08254546429"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p6758120134315">3</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p18758170204317">Upper right corner</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p77581209431">Click <span class="uicontrol" id="dli_01_0377__uicontrol1945301812112"><b>Create Queue</b></span> to create a queue.</p>
</td>
</tr>
<tr id="dli_01_0377__row1099418791615"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p199419761619">4</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p9994471160">SQL job introduction</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p793864851412">Click <strong id="dli_01_0377__b1591014181212">Create Job</strong> in this area to access the <strong id="dli_01_0377__b5683195311113">SQL Editor</strong> page. For details about how to create a package, see <a href="dli_01_0320.html">SQL Editor</a>.</p>
</td>
</tr>
<tr id="dli_01_0377__row8464152220348"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p1525520416406">5</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p9255144119401">Flink job introduction</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p452319588148">Click <strong id="dli_01_0377__b19519318111411">Create Job</strong> in this area to go to the <strong id="dli_01_0377__b12535158161419">Flink Jobs</strong> page. For details about how to create a package, see <a href="dli_01_0389.html">Flink Job Management</a>.</p>
</td>
</tr>
<tr id="dli_01_0377__row127891135877"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p1151444025710">6</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p19789635772">Spark job introduction</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p1399617271520">Click <strong id="dli_01_0377__b192241534161415">Create Job</strong> in this area to access the <strong id="dli_01_0377__b1514743084715">Spark Jobs</strong> page. For details about how to create a Spark job, see <a href="dli_01_0384.html">Creating a Spark Job</a>.</p>
</td>
</tr>
<tr id="dli_01_0377__row187892354715"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p651484015710">8</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p779013514719">Queue usage (hours)</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p091719442195">This area displays the usage of all queues of the last day, week, or month.</p>
</td>
</tr>
<tr id="dli_01_0377__row1886971017575"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p852615361818">9</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p05371419101913">Selected queue usage (hours)</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p11598159201910">This area displays the usage of a queue in the last week or month. </p>
</td>
</tr>
<tr id="dli_01_0377__row16131132095916"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p1213117202592">10</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p1251012712194">Common links</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dli_01_0377__p1151015712191">Including:</p>
<ul id="dli_01_0377__ul251017101918"><li id="dli_01_0377__li1251017181913"><em id="dli_01_0377__i18984111016335">User Guide</em></li><li id="dli_01_0377__li11510117141913"><em id="dli_01_0377__i105323363332">API Reference</em></li><li id="dli_01_0377__li145100715195"><em id="dli_01_0377__i778574694918">SDK Download</em></li></ul>
</td>
</tr>
<tr id="dli_01_0377__row747015017188"><td class="cellrowborder" valign="top" width="7.841584158415841%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dli_01_0377__p046820599189">11</p>
</td>
<td class="cellrowborder" valign="top" width="18.782178217821784%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dli_01_0377__p1546845951810">Get started in four simple steps</p>
</td>
<td class="cellrowborder" valign="top" width="73.37623762376238%" headers="mcps1.3.1.4.2.4.1.3 "><ol id="dli_01_0377__ol15468859191817"><li id="dli_01_0377__li16468145914187">Create a queue</li><li id="dli_01_0377__li12469155981813">Preparing data</li><li id="dli_01_0377__li2469459201819">Editing and submitting a job</li><li id="dli_01_0377__li1946995915189">Viewing job status</li></ol>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>

35
docs/dli/umn/dli_01_0378.html Normal file
View File

@ -0,0 +1,35 @@
<a name="dli_01_0378"></a><a name="dli_01_0378"></a>
<h1 class="topictitle1">DLI Introduction</h1>
<div id="body39451090"><div class="section" id="dli_01_0378__section118410576246"><h4 class="sectiontitle">What Is Data Lake Insight?</h4><p id="dli_01_0378__p104391318592">Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with <a href="https://spark.apache.org/" target="_blank" rel="noopener noreferrer">Apache Spark</a> and <a href="https://flink.apache.org/" target="_blank" rel="noopener noreferrer">Apache Flink</a> ecosystems. It frees you from managing any server.</p>
<p id="dli_01_0378__p35691490142221">DLI supports standard SQL and is compatible with Spark SQL and Flink SQL. It also supports multiple access modes, and is compatible with mainstream data formats. DLI supports SQL statements and Spark applications for heterogeneous data sources, including CloudTable, RDS, GaussDB(DWS), CSS, OBS, custom databases on ECSs, and offline databases.</p>
</div>
<div class="section" id="dli_01_0378__section189215415182"><h4 class="sectiontitle">Function Description</h4><p id="dli_01_0378__p3872545124817">You can query and analyze heterogeneous data sources such as RDS, and DWS on the cloud using access methods, such as visualized interface, RESTful API, JDBC, ODBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, and ORC.</p>
<ul id="dli_01_0378__ul95252494910"><li id="dli_01_0378__li37017520555">Basic functions<ul id="dli_01_0378__ul33508814556"><li id="dli_01_0378__li4884112014444">You can use standard SQL statements to query in SQL jobs. </li><li id="dli_01_0378__li583064563216">Flink jobs support Flink SQL online analysis. Aggregation functions such as Window and Join, geographic functions, and CEP functions are supported. SQL is used to express service logic, facilitating service implementation. For details, see .</li><li id="dli_01_0378__li652124194912">For spark jobs, fully-managed Spark computing can be performed. You can submit computing tasks through interactive sessions or in batch to analyze data in the fully managed Spark queues. For details, see .</li></ul>
</li><li id="dli_01_0378__li13705141165713">Federated analysis of heterogeneous data sources<ul id="dli_01_0378__ul14754404579"><li id="dli_01_0378__li68911658193117">Spark datasource connection: Data sources such as DWS, RDS, and CSS can be accessed through DLI. For details, see .</li><li id="dli_01_0378__li9919175613471">Interconnection with multiple cloud services is supported in Flink jobs to form a rich stream ecosystem. The DLI stream ecosystem consists of cloud service ecosystems and open source ecosystems.<ul id="dli_01_0378__ul4978181016481"><li id="dli_01_0378__li10978151011487">Cloud service ecosystem: DLI can interconnect with other services in Flink SQL. You can directly use SQL to read and write data from cloud services.</li><li id="dli_01_0378__li4978610154816">Open-source ecosystems: After connections to other VPCs are established through datasource connections, you can access all data sources and output targets (such as Kafka, HBase, and Elasticsearch) supported by Flink and Spark in your exclusive DLI queue.</li></ul>
<p id="dli_01_0378__p11978131024820">For details, see .</p>
</li></ul>
</li><li id="dli_01_0378__li620462561618">Storage-compute decoupling<p id="dli_01_0378__p12236173712168"><a name="dli_01_0378__li620462561618"></a><a name="li620462561618"></a>DLI is interconnected with OBS for data analysis. In this architecture where storage and compute are decoupled, resources of these two types are charged separately, helping you reduce costs and improving resource utilization.</p>
<p id="dli_01_0378__p656615493515">You can choose single-AZ or multi-AZ storage when you create an OBS bucket for storing redundant data on the DLI console. The differences between the two storage policies are as follows:</p>
<ul id="dli_01_0378__ul1139013284314"><li id="dli_01_0378__li1244173017434">Multi-AZ storage means data is stored in multiple AZs, improving data reliability. If the multi-AZ storage is enabled for a bucket, data is stored in multiple AZs in the same region. If one AZ becomes unavailable, data can still be properly accessed from the other AZs. The multi-AZ storage is ideal for scenarios that demand high reliability. You are advised to use this policy.</li><li id="dli_01_0378__li9190134234418">Single-AZ storage means that data is stored in a single AZ, with lower costs. </li></ul>
</li></ul>
</div>
<div class="section" id="dli_01_0378__section19222675412"><h4 class="sectiontitle">DLI Core Engine: Spark+Flink</h4><ul id="dli_01_0378__ul14792133255715"><li id="dli_01_0378__li13792103275712">Spark is a unified analysis engine that is ideal for large-scale data processing. It focuses on query, compute, and analysis. DLI optimizes performance and reconstructs services based on open-source Spark. It is compatible with the Apache Spark ecosystem and interfaces, and improves performance by 2.5x when compared with open-source Spark. In this way, DLI enables you to perform query and analysis of EB's of data within hours.</li><li id="dli_01_0378__li14792133295711">Flink is a distributed compute engine that is ideal for batch processing, that is, for processing static data sets and historical data sets. You can also use it for stream processing, that is, processing real-time data streams and generating data results in real time. DLI enhances features and security based on the open-source Flink and provides the Stream SQL feature required for data processing.</li></ul>
</div>
<div class="section" id="dli_01_0378__section128371951391"><h4 class="sectiontitle">Serverless Architecture</h4><p id="dli_01_0378__p439010110106">DLI is a serverless big data query and analysis service. It has the following advantages:</p>
<ul id="dli_01_0378__ul156203189145"><li id="dli_01_0378__li166201818121418">Auto scaling: DLI ensures you always have enough capacity on hand to deal with any traffic spikes.</li></ul>
</div>
<div class="section" id="dli_01_0378__section173909441109"><h4 class="sectiontitle">Accessing DLI</h4><p id="dli_01_0378__p8366328105017">A web-based service management platform is provided. You can access DLI using the management console or HTTPS-based APIs, or connect to the DLI server through a client such as JDBC or ODBC.</p>
<ul id="dli_01_0378__ul0613194011284"><li id="dli_01_0378__li172844319285">Using the management console<p id="dli_01_0378__p928643102819"><a name="dli_01_0378__li172844319285"></a><a name="li172844319285"></a>You can submit SQL, Spark, or Flink jobs on the DLI management console. Log in to the management console. Choose <strong id="dli_01_0378__b459287151313">EI Enterprise Intelligence</strong> &gt; <strong id="dli_01_0378__b1317953119138">Data Lake Insight</strong>.</p>
</li></ul>
<ul id="dli_01_0378__ul6602184155118"><li id="dli_01_0378__li17602645513">Using APIs<p id="dli_01_0378__p886223541010"><a name="dli_01_0378__li17602645513"></a><a name="li17602645513"></a>If you need to integrate DLI into a third-party system for secondary development, you can call DLI APIs to use the service.</p>
<p id="dli_01_0378__p1932395211161">For details, see <em id="dli_01_0378__i641914274913">Data Lake Insight API Reference</em>.</p>
</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0538.html">Service Overview</a></div>
</div>
</div>

15
docs/dli/umn/dli_01_0379.html Normal file
View File

@ -0,0 +1,15 @@
<a name="dli_01_0379"></a><a name="dli_01_0379"></a>
<h1 class="topictitle1">Job Templates</h1>
<div id="body1532683323732"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0021.html">SQL Template Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0464.html">Flink Template Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_05110.html">Appendix</a></strong><br>
</li>
</ul>
</div>

261
docs/dli/umn/dli_01_0384.html Normal file
View File

File diff suppressed because it is too large Load Diff

80
docs/dli/umn/dli_01_0385.html Normal file
View File

@ -0,0 +1,80 @@
<a name="dli_01_0385"></a><a name="dli_01_0385"></a>
<h1 class="topictitle1">Spark Job Management</h1>
<div id="body8662426"><p id="dli_01_0385__li13792103275712p0">Based on the open-source Spark, DLI optimizes performance and reconstructs services to be compatible with the Apache Spark ecosystem and interfaces, and executes batch processing tasks.</p>
<p id="dli_01_0385__p1543415146258">DLI also allows you to use Spark jobs to access DLI metadata.</p>
<p id="dli_01_0385__p66161828392">Spark job management provides the following functions:</p>
<ul id="dli_01_0385__ul8657743184112"><li id="dli_01_0385__li135810130187"><a href="dli_01_0384.html">Creating a Spark Job</a></li><li id="dli_01_0385__li19657124354118"><a href="#dli_01_0385__section168728364416">Re-executing a Job</a></li><li id="dli_01_0385__li9471154134119"><a href="#dli_01_0385__section9242154518244">Searching for a Job</a></li><li id="dli_01_0385__li68120361581"><a href="#dli_01_0385__en-us_topic_0122090417_section3753111385816">Terminating a Job</a></li></ul>
<p id="dli_01_0385__p1435019551239">In addition, you can click <strong id="dli_01_0385__b313811421683">Quick Links</strong> to switch to the details on <em id="dli_01_0385__i1713814210814">User Guide</em>.</p>
<div class="section" id="dli_01_0385__section12526165519235"><h4 class="sectiontitle">Spark Jobs Page</h4><p id="dli_01_0385__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0385__b12378211295">Overview</strong> page, click <strong id="dli_01_0385__b33842119911">Spark Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0385__b14384815912">Job Management</strong> &gt; <strong id="dli_01_0385__b203841011191">Spark Jobs</strong>. The page displays all Spark jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0385__en-us_topic_0122090417_table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Job management parameters</caption><thead align="left"><tr id="dli_01_0385__en-us_topic_0122090417_row2555468715120"><th align="left" class="cellrowborder" valign="top" width="16.07%" id="mcps1.3.6.3.2.3.1.1"><p id="dli_01_0385__en-us_topic_0122090417_p4021197415120">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="83.93%" id="mcps1.3.6.3.2.3.1.2"><p id="dli_01_0385__en-us_topic_0122090417_p3594448915120">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0385__en-us_topic_0122090417_row46758327132"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__en-us_topic_0122090417_p16413434141957">Job ID</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__en-us_topic_0122090417_p54419740141957">ID of a submitted Spark job, which is generated by the system by default.</p>
</td>
</tr>
<tr id="dli_01_0385__en-us_topic_0122090417_row32873162171713"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__en-us_topic_0122090417_p45480448171713">Name</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__en-us_topic_0122090417_p18579134217227">Name of a submitted Spark job.</p>
</td>
</tr>
<tr id="dli_01_0385__row861981775614"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__p126191217125614">Queues</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__p448202510569">Queue where the submitted Spark job runs</p>
</td>
</tr>
<tr id="dli_01_0385__row1140933010565"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__p74098303564">Username</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__p15101132685817">Name of the user who executed the Spark job</p>
</td>
</tr>
<tr id="dli_01_0385__row3110429195719"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__p111109294578">Status</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__p476421517585">Job status. The following values are available:</p>
<ul id="dli_01_0385__ul14764191515583"><li id="dli_01_0385__li8764121513588"><strong id="dli_01_0385__b135641011868">Starting</strong>: The job is being started.</li><li id="dli_01_0385__li207641415185817"><strong id="dli_01_0385__b1955918121260">Running</strong>: The job is being executed.</li><li id="dli_01_0385__li7764315175820"><strong id="dli_01_0385__b203530131567">Failed</strong>: The session has exited.</li><li id="dli_01_0385__li476471519584"><strong id="dli_01_0385__b8011419617">Finished</strong>: The session is successfully executed.</li><li id="dli_01_0385__li7764191535817"><strong id="dli_01_0385__b1571694014810">Restoring</strong>: The job is being restored.</li></ul>
</td>
</tr>
<tr id="dli_01_0385__en-us_topic_0122090417_row6424839516213"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__en-us_topic_0122090417_p50569641162134">Created</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__en-us_topic_0122090417_p18910361162145">Time when a job is created. Jobs can be displayed in ascending or descending order of the job creation time.</p>
</td>
</tr>
<tr id="dli_01_0385__row1536633125019"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__p145363334505">Last Modified</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0385__p153603315013">Time when a job is completed.</p>
</td>
</tr>
<tr id="dli_01_0385__en-us_topic_0122090417_row1662880815250"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0385__en-us_topic_0122090417_p475621615250">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><ul id="dli_01_0385__en-us_topic_0122090417_ul181927155164"><li id="dli_01_0385__li31578516594"><strong id="dli_01_0385__b105273101889">Edit</strong>: You can modify the current job configuration and re-execute the job.</li><li id="dli_01_0385__li156921658183219"><strong id="dli_01_0385__b1971814139819">SparkUI</strong>: After you click this button, the Spark job execution page is displayed.<div class="note" id="dli_01_0385__note1149352315379"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0385__ul17774418206"><li id="dli_01_0385__li47774118203">The SparkUI page cannot be viewed for jobs in the <strong id="dli_01_0385__b10335047121315">Starting</strong> state.</li><li id="dli_01_0385__li1375744472013">Currently, only the latest 100 job information records are displayed on the SparkUI of DLI.</li></ul>
</div></div>
</li><li id="dli_01_0385__li1370757905"><strong id="dli_01_0385__b6248346869">Terminate Job</strong>: Cancel a job that is being started or running.</li><li id="dli_01_0385__li99661755165919"><strong id="dli_01_0385__b109467691584043">Re-execute</strong>: Run the job again.</li><li id="dli_01_0385__li10304115213253"><strong id="dli_01_0385__b10525747115219">Archive Log</strong>: Save job logs to the temporary bucket created by DLI.</li><li id="dli_01_0385__li113222516517"><strong id="dli_01_0385__b10216205015215">Export Log</strong>: Export logs to the created OBS bucket.<div class="note" id="dli_01_0385__note9317379552"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0385__ul1447511257345"><li id="dli_01_0385__li104752259341">You have the permission to create OBS buckets.</li><li id="dli_01_0385__li10475325103415">If the job is in the <strong id="dli_01_0385__b2161614101418">Running</strong> state, logs cannot be exported.</li></ul>
</div></div>
</li><li id="dli_01_0385__en-us_topic_0122090417_li11155202552811"><strong id="dli_01_0385__b25716541817">Commit Log</strong>: View the logs of submitted jobs.</li><li id="dli_01_0385__li245513563418"><strong id="dli_01_0385__b188631512145">Driver Log</strong>: View the logs of running jobs.</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_01_0385__section168728364416"><a name="dli_01_0385__section168728364416"></a><a name="section168728364416"></a><h4 class="sectiontitle">Re-executing a Job</h4><p id="dli_01_0385__p1654818201253">On the <span class="wintitle" id="dli_01_0385__wintitle71721024113012"><b>Spark Jobs</b></span> page, click <span class="uicontrol" id="dli_01_0385__uicontrol142071616153014"><b>Edit</b></span> in the <strong id="dli_01_0385__b34941574308">Operation</strong> column of the job. On the Spark job creation page that is displayed, modify parameters as required and execute the job.</p>
</div>
<div class="section" id="dli_01_0385__section9242154518244"><a name="dli_01_0385__section9242154518244"></a><a name="section9242154518244"></a><h4 class="sectiontitle">Searching for a Job</h4><p id="dli_01_0385__p8421143910714">On the <span class="wintitle" id="dli_01_0385__wintitle136462051812"><b>Spark Jobs</b></span> page, select <strong id="dli_01_0385__b733422871812">Status</strong> or <strong id="dli_01_0385__b1616814325181">Queues</strong>. The system displays the jobs that meet the filter condition in the job list.</p>
</div>
<div class="section" id="dli_01_0385__en-us_topic_0122090417_section3753111385816"><a name="dli_01_0385__en-us_topic_0122090417_section3753111385816"></a><a name="en-us_topic_0122090417_section3753111385816"></a><h4 class="sectiontitle">Terminating a Job</h4><p id="dli_01_0385__en-us_topic_0122090417_p209202331547">On the <span class="wintitle" id="dli_01_0385__wintitle18382471933"><b>Spark Jobs</b></span> page, choose <strong id="dli_01_0385__b143351153134">More</strong> &gt; <span class="uicontrol" id="dli_01_0385__uicontrol688113571241"><b>Terminate Job</b></span> in the <strong id="dli_01_0385__b7732018513">Operation</strong> column of the job that you want to stop.</p>
</div>
<div class="section" id="dli_01_0385__section64241412354"><h4 class="sectiontitle">Exporting Logs</h4><p id="dli_01_0385__p04251741153511">On the <span class="wintitle" id="dli_01_0385__wintitle1247511611510"><b>Spark Jobs</b></span> page, choose <span class="uicontrol" id="dli_01_0385__uicontrol155241812141510"><b>More </b></span>&gt; <strong id="dli_01_0385__b442820251290">Export Log</strong> in the Operation column of the corresponding job. In the dialog box that is displayed, enter the path of the created OBS bucket and click <strong id="dli_01_0385__b13687165841416">OK</strong>.</p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0465.html">Spark Job Management</a></div>
</div>
</div>

31
docs/dli/umn/dli_01_0389.html Normal file
View File

@ -0,0 +1,31 @@
<a name="dli_01_0389"></a><a name="dli_01_0389"></a>
<h1 class="topictitle1">Flink Job Management</h1>
<div id="body1536287138300"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0403.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0479.html">Managing Flink Job Permissions</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0454.html">Preparing Flink Job Data</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0498.html">(Recommended) Creating a Flink OpenSource SQL Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0455.html">Creating a Flink SQL job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0457.html">Creating a Flink Jar Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0458.html">Debugging a Flink Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0461.html">Performing Operations on a Flink Job</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0462.html">Flink Job Details</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0001.html">Job Management</a></div>
</div>
</div>

33
docs/dli/umn/dli_01_0390.html Normal file
View File

@ -0,0 +1,33 @@
<a name="dli_01_0390"></a><a name="dli_01_0390"></a>
<h1 class="topictitle1">Databases and Tables</h1>
<div id="body1536287138300"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0228.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0447.html">Database Permission Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0448.html">Table Permission Management</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0005.html">Creating a Database or a Table</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0011.html">Deleting a Database or a Table</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0376.html">Modifying the Owners of Databases and Tables</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0253.html">Importing Data to the Table</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0010.html">Exporting Data from DLI to OBS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0008.html">Viewing Metadata</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0007.html">Previewing Data</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0004.html">Data Management</a></div>
</div>
</div>

18
docs/dli/umn/dli_01_0397.html Normal file
View File

File diff suppressed because one or more lines are too long

123
docs/dli/umn/dli_01_0402.html Normal file
View File

File diff suppressed because it is too large Load Diff

96
docs/dli/umn/dli_01_0403.html Normal file
View File

@ -0,0 +1,96 @@
<a name="dli_01_0403"></a><a name="dli_01_0403"></a>
<h1 class="topictitle1">Overview</h1>
<div id="body1543376454662"><p id="dli_01_0403__p1866444210407">On the Job Management page of Flink jobs, you can submit a Flink job. Currently, the following job types are supported:</p>
<ul id="dli_01_0403__ul3319024204014"><li id="dli_01_0403__li153191024124015"><strong id="dli_01_0403__b582202818343">Flink SQL</strong> uses SQL statements to define jobs and can be submitted to any general purpose queue.</li><li id="dli_01_0403__li069317403210"><strong id="dli_01_0403__b208655222421">Flink Jar</strong> customizes a JAR package job based on Flink APIs. It runs on dedicated queues.</li></ul>
<p id="dli_01_0403__p66161828392">Flink job management provides the following functions:</p>
<ul id="dli_01_0403__ul8657743184112"><li id="dli_01_0403__li81824019583"><a href="dli_01_0479.html">Managing Flink Job Permissions</a></li><li id="dli_01_0403__li19657124354118"><a href="dli_01_0455.html">Creating a Flink SQL Job</a></li><li id="dli_01_0403__li49002025195814"><a href="dli_01_0457.html">Creating a Flink Jar Job</a></li><li id="dli_01_0403__li1966122614815"><a href="dli_01_0458.html">Debugging a Job</a></li><li id="dli_01_0403__li321633381117"><a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a job</a></li><li id="dli_01_0403__li149164314117"><a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a></li><li id="dli_01_0403__li1918757145613"><a href="dli_01_0461.html#dli_01_0461__section8678193324114">Stopping a Job</a></li><li id="dli_01_0403__li14179161612574"><a href="dli_01_0461.html#dli_01_0461__section1691624195713">Deleting a Job</a></li><li id="dli_01_0403__li529715414492"><a href="dli_01_0461.html#dli_01_0461__section135831511323">Exporting a Job</a></li><li id="dli_01_0403__li12456172025013"><a href="dli_01_0461.html#dli_01_0461__section75781665389">Importing a Job</a></li><li id="dli_01_0403__li7887305574"><a href="dli_01_0461.html#dli_01_0461__section15861321183619">Modifying Name and Description</a></li><li id="dli_01_0403__li131144243198"><a href="dli_01_0461.html#dli_01_0461__section83412445175">Importing to a Savepoint</a></li><li id="dli_01_0403__li5693174816504"><a href="dli_01_0461.html#dli_01_0461__section11401152191015">Triggering a Savepoint</a></li><li id="dli_01_0403__li255018247317"><a href="dli_01_0461.html#dli_01_0461__section48961252113110">Runtime Configuration</a></li><li id="dli_01_0403__li153181731145913"><a href="dli_01_0462.html">Job Details</a></li></ul>
<div class="section" id="dli_01_0403__section12518143518488"><h4 class="sectiontitle">Assigning Agency Permissions</h4><p id="dli_01_0403__p147561066544">Agencies are required for DLI to execute Flink jobs. You can set the agency when logging in to the management console for the first time or go to <strong id="dli_01_0403__b209911447379">Global Configurations</strong> &gt; <a href="dli_01_0486.html">Service Authorization</a> to modify the agencies.</p>
<p id="dli_01_0403__p112123218557">The permissions are as follows:</p>
<ul id="dli_01_0403__ul1393104512501"><li id="dli_01_0403__li53932045105016"><strong id="dli_01_0403__b825511452452">Tenant Administrator (global)</strong> permissions are required to access data from OBS to execute Flink jobs on DLI, for example, obtaining OBS/DWS data sources, log dump (including bucket authorization), checkpointing enabling, and job import and export.<div class="note" id="dli_01_0403__note45081932194818"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p95082324484">Due to cloud service cache differences, permission setting operations require about 60 minutes to take effect.</p>
</div></div>
</li><li id="dli_01_0403__li65241851125015"><strong id="dli_01_0403__b7690104924514">DIS Administrator</strong> permissions are required to use DIS data as the data source of DLI Flink jobs.<div class="note" id="dli_01_0403__note2048353604212"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p1648414365424">Due to cloud service cache differences, permission setting operations require about 30 minutes to take effect.</p>
</div></div>
</li><li id="dli_01_0403__li15237101705317">To use CloudTable data as the data source of DLI Flink jobs, <strong id="dli_01_0403__b41312369567">CloudTable Administrator</strong> permissions are required.<div class="note" id="dli_01_0403__note0630838143813"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p663117386382">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
</div></div>
</li><li id="dli_01_0403__li18108653125412"><strong id="dli_01_0403__b851110592312">Tenant Administrator (Project-level)</strong> permissions are required if you use services that can run only with these permissions.<div class="note" id="dli_01_0403__note103326521192"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0403__p83324521995">Due to cloud service cache differences, permission setting operations require about 3 minutes to take effect.</p>
</div></div>
</li></ul>
</div>
<div class="section" id="dli_01_0403__section12526165519235"><h4 class="sectiontitle">Flink Jobs Page</h4><p id="dli_01_0403__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0403__b5725174712329">Overview</strong> page, click <strong id="dli_01_0403__b16730204714323">Flink Jobs</strong> to go to the Flink job management page. Alternatively, you can choose <strong id="dli_01_0403__b177319476328">Job Management</strong> &gt; <strong id="dli_01_0403__b173184718320">Flink Jobs</strong> from the navigation pane on the left. The page displays all Flink jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0403__en-us_topic_0122090417_table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Job management parameters</caption><thead align="left"><tr id="dli_01_0403__en-us_topic_0122090417_row2555468715120"><th align="left" class="cellrowborder" valign="top" width="16.07%" id="mcps1.3.6.3.2.3.1.1"><p id="dli_01_0403__en-us_topic_0122090417_p4021197415120">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="83.93%" id="mcps1.3.6.3.2.3.1.2"><p id="dli_01_0403__en-us_topic_0122090417_p3594448915120">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0403__en-us_topic_0122090417_row46758327132"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p16413434141957">ID</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p54419740141957">ID of a submitted Flink job, which is generated by the system by default.</p>
</td>
</tr>
<tr id="dli_01_0403__en-us_topic_0122090417_row32873162171713"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p45480448171713">Name</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p18579134217227">Name of the submitted Flink job.</p>
</td>
</tr>
<tr id="dli_01_0403__row3289513151315"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p102901113161318">Type</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p1029001315135">Type of the submitted Flink job. Including:</p>
<ul id="dli_01_0403__ul864114454138"><li id="dli_01_0403__li464144518136">Flink SQL: Flink SQL jobs</li><li id="dli_01_0403__li1896411561765">Flink Jar: Flink Jar jobs</li></ul>
</td>
</tr>
<tr id="dli_01_0403__en-us_topic_0122090417_row31011923151038"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p10671857151038">Status</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p59114099151038">Job statuses, including:</p>
<ul id="dli_01_0403__en-us_topic_0122090417_ul32930526154023"><li id="dli_01_0403__li5304438104719"><strong id="dli_01_0403__b1218612714459">Draft</strong></li><li id="dli_01_0403__li230510384473"><strong id="dli_01_0403__b312364144518">Submitting</strong></li><li id="dli_01_0403__li1530543815477"><strong id="dli_01_0403__b10386111119456">Submission failed</strong></li><li id="dli_01_0403__li530483810474"><strong id="dli_01_0403__b54881649194919">Running</strong>: After the job is submitted, a normal result is returned.</li><li id="dli_01_0403__li27807399719"><strong id="dli_01_0403__b343275416497">Running exception</strong>: The job stops running due to an exception.</li><li id="dli_01_0403__li1196810358454"><strong id="dli_01_0403__b194672233472">Downloading</strong></li><li id="dli_01_0403__li194778183469"><strong id="dli_01_0403__b3168162564710">Idle</strong></li><li id="dli_01_0403__li19305838104720"><strong id="dli_01_0403__b5819182654717">Stopping</strong></li><li id="dli_01_0403__li130510384477"><strong id="dli_01_0403__b10747633104717">Stopped</strong></li><li id="dli_01_0403__li1430520388475"><strong id="dli_01_0403__b202671406472">Stopping failed</strong></li><li id="dli_01_0403__li73970453461"><strong id="dli_01_0403__b12394545124713">Creating the savepoint</strong></li><li id="dli_01_0403__li1330553812474"><strong id="dli_01_0403__b158604563497">Completed</strong></li></ul>
</td>
</tr>
<tr id="dli_01_0403__en-us_topic_0122090417_row36301606171658"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p14394959151048">Description</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p51238775151048">Description of the submitted Flink job.</p>
</td>
</tr>
<tr id="dli_01_0403__row4736911141810"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p1973721141811">Username</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p373781161815">Name of the user who submits a job.</p>
</td>
</tr>
<tr id="dli_01_0403__en-us_topic_0122090417_row6424839516213"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p50569641162134">Created</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__en-us_topic_0122090417_p18910361162145">Time when a job is created.</p>
</td>
</tr>
<tr id="dli_01_0403__row15840729143612"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p13841152911367">Started</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p20841122983612">Time when a Flink job starts to run.</p>
</td>
</tr>
<tr id="dli_01_0403__row1536633125019"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__p145363334505">Duration</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><p id="dli_01_0403__p153603315013">Time consumed by job running.</p>
</td>
</tr>
<tr id="dli_01_0403__en-us_topic_0122090417_row1662880815250"><td class="cellrowborder" valign="top" width="16.07%" headers="mcps1.3.6.3.2.3.1.1 "><p id="dli_01_0403__en-us_topic_0122090417_p475621615250">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="83.93%" headers="mcps1.3.6.3.2.3.1.2 "><ul id="dli_01_0403__en-us_topic_0122090417_ul181927155164"><li id="dli_01_0403__en-us_topic_0122090417_li18623798286"><strong id="dli_01_0403__b692115307259">Edit</strong>: Edit a created job. For details, see <a href="dli_01_0461.html#dli_01_0461__section1950210297542">Editing a Job</a>.</li><li id="dli_01_0403__li016442515152"><strong id="dli_01_0403__b4887113372511">Start</strong>: Start and run a job. For details, see <a href="dli_01_0461.html#dli_01_0461__section20957159163012">Starting a Job</a>.</li><li id="dli_01_0403__li1228521944015"><strong id="dli_01_0403__b1893782782517">More</strong><ul id="dli_01_0403__ul2162826144010"><li id="dli_01_0403__en-us_topic_0122090417_li11155202552811"><strong id="dli_01_0403__b857792212255">FlinkUI</strong>: After you click this button, the Flink job execution page is displayed.<div class="note" id="dli_01_0403__note151024818191"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0403__p5501165371013">When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click <strong id="dli_01_0403__b25538517556">FlinkUI</strong> before the cluster is created, an empty <strong id="dli_01_0403__b668185785511">projectID</strong> will be cached. The <strong id="dli_01_0403__b541324185618">FlinkUI</strong> page cannot be displayed.</p>
<p id="dli_01_0403__p181031586197">You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check <strong id="dli_01_0403__b890617447568">FlinkUI</strong>.</p>
</div></div>
</li><li id="dli_01_0403__li2385531539"><strong id="dli_01_0403__b1631116258182">Stop</strong>: Stop a Flink job. If this function is unavailable, jobs in the current status cannot be stopped.</li><li id="dli_01_0403__li156921658183219"><strong id="dli_01_0403__b12871121811253">Delete</strong>: Delete a job.<div class="note" id="dli_01_0403__note386711433506"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0403__p16867104316506">A deleted job cannot be restored.</p>
</div></div>
</li><li id="dli_01_0403__li206103185417"><strong id="dli_01_0403__b16895181212519">Modify Name and Description</strong>: You can modify the name and description of a job. For details, see <a href="dli_01_0461.html#dli_01_0461__section15861321183619">Modifying Name and Description</a>.</li><li id="dli_01_0403__li263854454016"><strong id="dli_01_0403__b19473912254">Import Savepoint</strong>: Import the data exported from the original CS job. For details, see <a href="dli_01_0461.html#dli_01_0461__section83412445175">Importing to a Savepoint</a>.</li><li id="dli_01_0403__li108001859451"><strong id="dli_01_0403__b14100464255">Trigger Savepoint</strong>: You can click this button for jobs in the <strong id="dli_01_0403__b1979513473815">Running</strong> status to save the job status. For details, see <a href="dli_01_0461.html#dli_01_0461__section11401152191015">Triggering a Savepoint</a>.</li><li id="dli_01_0403__li104707813616"><strong id="dli_01_0403__b107351826254">Permissions</strong>: You can view the user permissions corresponding to the job and grant permissions to other users. For details, see <a href="dli_01_0479.html">Managing Flink Job Permissions</a>.</li><li id="dli_01_0403__li048918565301"><strong id="dli_01_0403__b1813663111189">Runtime Configuration</strong>: You can enable <strong id="dli_01_0403__b7850337197">Alarm Generation upon Job Exception</strong> and <strong id="dli_01_0403__b13219115315918">Auto Restart upon Exception</strong>. For details, see <a href="dli_01_0461.html#dli_01_0461__section48961252113110">Runtime Configuration</a>.</li></ul>
</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Flink Job Management</a></div>
</div>
</div>

70
docs/dli/umn/dli_01_0407.html Normal file
View File

@ -0,0 +1,70 @@
<a name="dli_01_0407"></a><a name="dli_01_0407"></a>
<h1 class="topictitle1">Overview</h1>
<div id="body1544008491695"><p id="dli_01_0407__p66161828392">Package management provides the following functions:</p>
<ul id="dli_01_0407__ul8657743184112"><li id="dli_01_0407__li14139145132717"><a href="dli_01_0477.html">Managing Package Permissions</a></li><li id="dli_01_0407__li19657124354118"><a href="dli_01_0367.html">Creating a Package</a></li><li id="dli_01_0407__li9471154134119"><a href="dli_01_0369.html">Deleting a Package</a><div class="note" id="dli_01_0407__note1393218181435"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0407__p79328181837">You can delete program packages in batches.</p>
</div></div>
</li><li id="dli_01_0407__li624821620217"><a href="dli_01_0478.html">Modifying the Owner</a></li></ul>
<div class="section" id="dli_01_0407__section153923398422"><h4 class="sectiontitle">Package Management Page</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0407__table96567183916" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Package management parameters</caption><thead align="left"><tr id="dli_01_0407__row666212153915"><th align="left" class="cellrowborder" valign="top" width="19.35%" id="mcps1.3.3.2.2.3.1.1"><p id="dli_01_0407__p46667183914">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="80.65%" id="mcps1.3.3.2.2.3.1.2"><p id="dli_01_0407__p96671811393">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0407__row1350920501725"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p6509150629">Group Name</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p550985016212">Name of the group to which the package belongs. If the package is not grouped, <strong id="dli_01_0407__b188720490331">--</strong> is displayed.</p>
</td>
</tr>
<tr id="dli_01_0407__row11671191143912"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p367511143910">Package Name</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p4141250171510">Name of a package.</p>
</td>
</tr>
<tr id="dli_01_0407__row169710366100"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p149816362107">Owner</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p49843661015">Name of the user who uploads the package.</p>
</td>
</tr>
<tr id="dli_01_0407__row611412316405"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p1211616239406">Type</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p17806105744415">Type of a package. The following package types are supported:</p>
<ul id="dli_01_0407__en-us_topic_0122016946_ul19355124635412"><li id="dli_01_0407__en-us_topic_0122016946_li173552046135410">JAR: JAR file</li><li id="dli_01_0407__en-us_topic_0122016946_li1035554615417">PyFile: User Python file</li><li id="dli_01_0407__en-us_topic_0122016946_li73551146195414">File: User file</li></ul>
</td>
</tr>
<tr id="dli_01_0407__row368271163910"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p126843119397">Status</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p16879163915">Status of the package to be created.</p>
<ul id="dli_01_0407__ul32851446111915"><li id="dli_01_0407__li073743101315">Uploading: The file is being uploaded.</li><li id="dli_01_0407__li1029302118132">Finished: The resource package has been uploaded.</li><li id="dli_01_0407__li62851446101912">Failed: The resource package upload failed.</li></ul>
</td>
</tr>
<tr id="dli_01_0407__row164492116534"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p1444914114533">Created</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p1244981165312">Time when a package is created.</p>
</td>
</tr>
<tr id="dli_01_0407__row1808175125310"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p108087545313">Updated</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p4808551537">Time when the package is updated.</p>
</td>
</tr>
<tr id="dli_01_0407__row1695151133915"><td class="cellrowborder" valign="top" width="19.35%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0407__p369521113915">Operation</p>
</td>
<td class="cellrowborder" valign="top" width="80.65%" headers="mcps1.3.3.2.2.3.1.2 "><p id="dli_01_0407__p112943491118">Manage Permissions: Manage user permissions for a package.</p>
<p id="dli_01_0407__p176451142141714">Delete: Delete the package.</p>
<p id="dli_01_0407__p144116478547"><strong id="dli_01_0407__b53017941114">More</strong>:</p>
<ul id="dli_01_0407__ul162095820541"><li id="dli_01_0407__li4620145814545"><strong id="dli_01_0407__b0675171911118">Modify Owner</strong>: Modify the owner of the package.</li></ul>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0366.html">Package Management</a></div>
</div>
</div>

21
docs/dli/umn/dli_01_0408.html Normal file
View File

@ -0,0 +1,21 @@
<a name="dli_01_0408"></a><a name="dli_01_0408"></a>
<h1 class="topictitle1">Permissions Management</h1>
<div id="body1544671596630"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0440.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0418.html">Creating an IAM User and Granting Permissions</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0451.html">Creating a Custom Policy</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0417.html">DLI Resources</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0475.html">DLI Request Conditions</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0441.html">Common Operations Supported by DLI System Policy</a></strong><br>
</li>
</ul>
</div>

31
docs/dli/umn/dli_01_0410.html Normal file
View File

@ -0,0 +1,31 @@
<a name="dli_01_0410"></a><a name="dli_01_0410"></a>
<h1 class="topictitle1">Datasource Connection and Cross-Source Analysis</h1>
<div id="body1568974021769"><p id="dli_01_0410__p82341101018">DLI supports the datasource capability of the native Spark and extends it. With DLI datasource connection, you can access other data storage services through SQL statements, Spark jobs, and Flink jobs and import, query, analyze, and process data in the services.</p>
<div class="section" id="dli_01_0410__section390162410466"><h4 class="sectiontitle">Datasource Connections</h4><p id="dli_01_0410__p879575781920">Before using DLI to perform cross source analysis, you need to set up a datasource connection to enable the network between data sources.</p>
<p id="dli_01_0410__p1593528944">The enhanced datasource connection uses VPC peering at the bottom layer to directly connect the VPC network between the DLI queue and the destination datasource. Data is exchanged in point-to-point mode.</p>
<div class="note" id="dli_01_0410__note6225712410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0410__ul9456100513"><li id="dli_01_0410__li54651010513">Datasource connections cannot be created for the default queue.</li><li id="dli_01_0410__li18641201213518"><strong id="dli_01_0410__b1054013291417">VPC Administrator</strong> permissions are required to use the VPC, subnet, route, VPC peering connection, and port for DLI datasource connections. You can set this parameter in <a href="dli_01_0486.html">Service Authorization</a>.</li></ul>
</div></div>
</div>
<div class="section" id="dli_01_0410__section139046257612"><h4 class="sectiontitle">Cross-Source Analysis</h4><p id="dli_01_0410__p2874834193212">The enhanced datasource connection supports all cross-source services implemented by DLI and implements access to self-built data sources by using UDFs, Spark jobs, and Flink jobs. </p>
<p id="dli_01_0410__p1231572884712">Currently, DLI supports datasource connection to the following data sources: CloudTable HBase, CloudTable OpenTSDB, CSS, DCS Redis, DDS Mongo, DIS, DMS, DWS, MRS HBase, MRS Kafka, MRS OpenTSDB, OBS, RDS MySQL, RDS PostGre, and SMN. </p>
<div class="note" id="dli_01_0410__note121881106816"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0410__ul948610171989"><li id="dli_01_0410__li578511191883">To access a datasource connection table, you need to use the queue for which a datasource connection has been created.</li><li id="dli_01_0410__li77861819187">The preview function is not supported for datasource tables.</li></ul>
</div></div>
</div>
<div class="section" id="dli_01_0410__section189406592915"><h4 class="sectiontitle">Datasource Connection Analysis Process</h4><p id="dli_01_0410__p1273092784413">To use DLI for cross-source analysis, you need to create datasource connections and then develop different jobs to access data sources. Perform the following steps:</p>
<ol id="dli_01_0410__ol35266308447"><li id="dli_01_0410__li1054131719406">Create a datasource connection. You can create a connection in either of the following ways:<ul id="dli_01_0410__ul3770183384017"><li id="dli_01_0410__li87711033144013">Create a datasource connection on the management console.</li><li id="dli_01_0410__li65121013144513">Create a datasource connection through an API.</li></ul>
</li><li id="dli_01_0410__li1552643020443">Develop a DLI job to connect to a datasource. You can connect to a datasource in one of the following ways:<ul id="dli_01_0410__ul16997644125118"><li id="dli_01_0410__li1997444175117">Develop a SQL job to connect to a datasource.</li><li id="dli_01_0410__li17552141115210">Develop a Spark job to connect to a datasource.</li><li id="dli_01_0410__li2694846204418">Develop a Flink job to connect to a datasource.</li></ul>
</li></ol>
<p id="dli_01_0410__p127121611204711">The following describes the basic processes of developing SQL jobs, Spark jobs, and Flink jobs for datasource connection.</p>
<ul id="dli_01_0410__ul18977534113613"><li id="dli_01_0410__li149774349364">SQL Job<div class="fignone" id="dli_01_0410__fig476353210455"><span class="figcap"><b>Figure 1 </b>Datasource connection analysis process</span><br><span><img id="dli_01_0410__image1225414794514" src="en-us_image_0264894338.png"></span></div>
</li><li id="dli_01_0410__li1113116431490">Spark Job<div class="fignone" id="dli_01_0410__fig2372185314304"><span class="figcap"><b>Figure 2 </b>Datasource connection analysis process</span><br><span><img id="dli_01_0410__image1031610506317" src="en-us_image_0264934285.png"></span></div>
</li><li id="dli_01_0410__li41951350104919">Flink Job<div class="fignone" id="dli_01_0410__fig52709143418"><span class="figcap"><b>Figure 3 </b>Datasource connection analysis process</span><br><span><img id="dli_01_0410__image8573541909" src="en-us_image_0264975521.png"></span></div>
</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0422.html">Datasource Connections</a></div>
</div>
</div>

79
docs/dli/umn/dli_01_0417.html Normal file
View File

@ -0,0 +1,79 @@
<a name="dli_01_0417"></a><a name="dli_01_0417"></a>
<h1 class="topictitle1">DLI Resources</h1>
<div id="body1557992073881"><p id="dli_01_0417__p169111456125711">A resource is an object that exists within a service. You can select DLI resources by specifying their paths.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0417__table17762145616578" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DLI resources and their paths</caption><thead align="left"><tr id="dli_01_0417__dli_01_0451_row1691118561571"><th align="left" class="cellrowborder" valign="top" width="17.77%" id="mcps1.3.2.2.4.1.1"><p id="dli_01_0417__dli_01_0451_p9912105615575">Resource Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.74%" id="mcps1.3.2.2.4.1.2"><p id="dli_01_0417__dli_01_0451_p10130637163016">Resource Names</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="59.489999999999995%" id="mcps1.3.2.2.4.1.3"><p id="dli_01_0417__dli_01_0451_p13912105611577">Path</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_01_0417__dli_01_0451_row59128562574"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p204333213513">queue</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p1113119377307">DLI queue</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p86653855311">queues.queuename</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row2230131615118"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p184313212518">database</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p11131237143019">DLI database</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p166568175319">databases.dbname</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row1095412247517"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p64393235116">table</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p12131133753010">DLI table</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p56665812534">databases.dbname.tables.tbname</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row395411241511"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p3431432125114">column</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p313123753011">DLI column</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p6666198145313">databases.dbname.tables.tbname.columns.colname</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row630345682110"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p994510338234">jobs</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p494553372318">DLI Flink job</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p1794553314234">jobs.flink.jobid</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row1823511125249"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p19236141217246">resource</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p15236151217244">DLI package</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p523711215247">resources.resourcename</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row3895191612240"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p48957164240">group</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p18895191612415">DLI package group</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p2895191612411">groups.groupname</p>
</td>
</tr>
<tr id="dli_01_0417__dli_01_0451_row1466512915114"><td class="cellrowborder" valign="top" width="17.77%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0417__dli_01_0451_p184415322519">datasourceauth</p>
</td>
<td class="cellrowborder" valign="top" width="22.74%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0417__dli_01_0451_p4131193710306">DLI cross-source authentication information</p>
</td>
<td class="cellrowborder" valign="top" width="59.489999999999995%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0417__dli_01_0451_p266618125317">datasourceauth.name</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0408.html">Permissions Management</a></div>
</div>
</div>

25
docs/dli/umn/dli_01_0418.html Normal file
View File

@ -0,0 +1,25 @@
<a name="dli_01_0418"></a><a name="dli_01_0418"></a>
<h1 class="topictitle1">Creating an IAM User and Granting Permissions</h1>
<div id="body1557992073881"><p id="dli_01_0418__p1843116365528">You can use Identity and Access Management (IAM) to implement fine-grained permissions control on DLI resources. For details, see <a href="dli_01_0440.html">Overview</a>.</p>
<p id="dli_01_0418__p1316316443569">If your cloud account does not need individual IAM users, then you may skip over this chapter.</p>
<p id="dli_01_0418__p19117754135713">This section describes how to create an IAM user and grant DLI permissions to the user. <a href="#dli_01_0418__fig4118155455715">Figure 1</a> shows the procedure.</p>
<div class="section" id="dli_01_0418__section3299192113013"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0418__p13734854619">Before assigning permissions to user groups, you should learn about system policies and select the policies based on service requirements. For details about system permissions supported by DLI, see <a href="dli_01_0440.html#dli_01_0440__section6224422143120">DLI System Permissions</a>.</p>
</div>
<div class="section" id="dli_01_0418__section63665495717"><h4 class="sectiontitle">Process Flow</h4><div class="fignone" id="dli_01_0418__fig4118155455715"><a name="dli_01_0418__fig4118155455715"></a><a name="fig4118155455715"></a><span class="figcap"><b>Figure 1 </b>Process for granting DLI permissions</span><br><span><img id="dli_01_0418__image03801418915" src="en-us_image_0206789726.jpg"></span></div>
<p id="dli_01_0418__p582413330719"></p>
<p id="dli_01_0418__p626243075914"></p>
<ol id="dli_01_0418__ol139492810017"><li id="dli_01_0418__li895020818018"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group and grant the permission to it.<p id="dli_01_0418__p99501985019"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group on the IAM console, and assign the <strong id="dli_01_0418__b163744195013">DLI ReadOnlyAccess</strong> permission to the group.</p>
</li><li id="dli_01_0418__li59503817014">Create a user and add the user to the user group.<p id="dli_01_0418__p4950882013"><a name="dli_01_0418__li59503817014"></a><a name="li59503817014"></a>Create a user on the IAM console and add the user to the group created in <a href="#dli_01_0418__li895020818018">1</a>.</p>
</li><li id="dli_01_0418__li159506814017">Log in and verify the permission.<p id="dli_01_0418__p29911201511"><a name="dli_01_0418__li159506814017"></a><a name="li159506814017"></a>Log in to the management console using the newly created user, and verify that the user's permissions.</p>
<ul id="dli_01_0418__ul9992304111"><li id="dli_01_0418__li149921301015">Choose <strong id="dli_01_0418__b1538390723">Service List</strong> &gt; <strong id="dli_01_0418__b2428344">Data Lake Insight</strong>. The DLI management console is displayed. If you can view the queue list on the <strong id="dli_01_0418__b86423619315">Queue Management</strong> page but cannot buy DLI queues by clicking <strong id="dli_01_0418__b1701367313">Buy Queue</strong> in the upper right corner (assume that the current permission contains only <strong id="dli_01_0418__b1070193615314">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b7710363316">DLI ReadOnlyAccess</strong> permission has taken effect.</li><li id="dli_01_0418__li29921500115">Choose any other service in <strong id="dli_01_0418__b6827231507">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b148281231700">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
</li></ol>
<p id="dli_01_0418__p05981420125912"></p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0408.html">Permissions Management</a></div>
</div>
</div>

15
docs/dli/umn/dli_01_0421.html Normal file
View File

@ -0,0 +1,15 @@
<a name="dli_01_0421"></a><a name="dli_01_0421"></a>
<h1 class="topictitle1">Creating a Message Notification Topic</h1>
<div id="body1566197386597"><p id="dli_01_0421__p95711691043">Once you have created a message notification topic, you can <strong id="dli_01_0421__b11606173513119">Add subscription</strong> of the topic on the <strong id="dli_01_0421__b1213852219334">Topic Management</strong> page of the Simple Message Notification service. You can select different ways (such as text messages or emails) to subscribe. After the subscription succeeds, any job failure will automatically be sent to your subscription endpoints. The operation is as follows:</p>
<ol id="dli_01_0421__ol25920582507"><li id="dli_01_0421__li9592558175016">On the <strong id="dli_01_0421__b1990823713261">Queue Management</strong> page, click <strong id="dli_01_0421__b1914153715265">Create SMN Topic</strong> on the upper left side. The <strong id="dli_01_0421__b15914113762619">Create SMN Topic</strong> dialog box is displayed.</li><li id="dli_01_0421__li144161849165115">Select a queue and click <strong id="dli_01_0421__b8335131614183">OK</strong>. The dialog box is displayed.<div class="note" id="dli_01_0421__note1848145063719"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0421__ul731513171718"><li id="dli_01_0421__li04613151711">You can select a single queue or all queues. If the subscription endpoints of a single queue are different from those of all queues, when a single queue and all queues are both selected, the SMN of all queues does not include the message of the single queue.</li><li id="dli_01_0421__li174141311718">After a notification topic is created, you will receive a notification only when a session or a batch job fails to be created.</li></ul>
</div></div>
</li><li id="dli_01_0421__li10453153145415">Click <strong id="dli_01_0421__b159641031271">Topic Management</strong> to go to the <strong id="dli_01_0421__b6970236273">Topic Management</strong> page of the SMN service.</li><li id="dli_01_0421__li1720834116576">In the <strong id="dli_01_0421__b9213191510275">Operation</strong> column of the corresponding topic in , click <strong id="dli_01_0421__b422011514271">Add Subscription</strong>. Select <strong id="dli_01_0421__b7220141562711">Protocol</strong> to determine the subscription mode.<ul id="dli_01_0421__ul161132031182414"><li id="dli_01_0421__li765194572414">If you select <strong id="dli_01_0421__b1433681216278">Email</strong>, enter the email address for receiving the confirmation email in the <strong id="dli_01_0421__b13530125172710">Endpoint</strong> text box.</li></ul>
</li><li id="dli_01_0421__li105037206332">After you click the link in the email, you will receive a message indicating that the subscription is successful.</li><li id="dli_01_0421__li165897201922">Return to the <strong id="dli_01_0421__b2096810231281">Topic Management</strong> page and click <strong id="dli_01_0421__b596982314284">Subscriptions</strong> on the left. If the subscription status is <strong id="dli_01_0421__b096982315283">Confirmed</strong>, the subscription is successful.</li></ol>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0012.html">Queue Management</a></div>
</div>
</div>

17
docs/dli/umn/dli_01_0422.html Normal file
View File

@ -0,0 +1,17 @@
<a name="dli_01_0422"></a><a name="dli_01_0422"></a>
<h1 class="topictitle1">Datasource Connections</h1>
<div id="body1568103018192"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dli_01_0410.html">Datasource Connection and Cross-Source Analysis</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0426.html">Enhanced Datasource Connections</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0480.html">Managing Datasource Connection Permissions</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dli_01_0427.html">Creating and Managing Datasource Authentication</a></strong><br>
</li>
</ul>
</div>

Some files were not shown because too many files have changed in this diff Show More