forked from docs/doc-exports
Su, Xiaomeng
04d4597cf3
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com> Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
140 lines
15 KiB
HTML
140 lines
15 KiB
HTML
<a name="dli_08_0310"></a><a name="dli_08_0310"></a>
|
|
|
|
<h1 class="topictitle1">DIS Result Table</h1>
|
|
<div id="body8662426"><div class="section" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_en-us_topic_0111555124_section12877153413613"><h4 class="sectiontitle">Function</h4><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0241_en-us_topic_0111501792_p5388433123618">DLI writes the Flink job output data into DIS. The data is filtered and imported to the DIS stream for future processing.</p>
|
|
<p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0241_en-us_topic_0111501792_p14200989332">DIS addresses the challenge of transmitting data outside cloud services to cloud services. DIS builds data intake streams for custom applications capable of processing or analyzing streaming data. DIS continuously captures, transmits, and stores terabytes of data from hundreds of thousands of sources every hour, such as logs, Internet of Things (IoT) data, social media feeds, website clickstreams, and location-tracking events. For more information about DIS, see the <em id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0235_i1551785682011">Data Ingestion Service User Guide</em>.</p>
|
|
</div>
|
|
<div class="section" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_en-us_topic_0111555124_section15771218124216"><h4 class="sectiontitle">Syntax</h4><div class="codecoloring" codetype="Sql" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_screen746013311958"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="n">disSink</span><span class="w"> </span><span class="p">(</span>
|
|
<span class="w"> </span><span class="n">attr_name</span><span class="w"> </span><span class="n">attr_type</span><span class="w"> </span>
|
|
<span class="w"> </span><span class="p">(</span><span class="s1">','</span><span class="w"> </span><span class="n">attr_name</span><span class="w"> </span><span class="n">attr_type</span><span class="p">)</span><span class="o">*</span><span class="w"> </span>
|
|
<span class="w"> </span><span class="p">(</span><span class="s1">','</span><span class="k">PRIMARY</span><span class="w"> </span><span class="k">KEY</span><span class="w"> </span><span class="p">(</span><span class="n">attr_name</span><span class="p">,</span><span class="w"> </span><span class="p">...)</span><span class="w"> </span><span class="k">NOT</span><span class="w"> </span><span class="n">ENFORCED</span><span class="p">)</span>
|
|
<span class="p">)</span>
|
|
<span class="k">with</span><span class="w"> </span><span class="p">(</span>
|
|
<span class="w"> </span><span class="s1">'connector.type'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'dis'</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'connector.region'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'connector.channel'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'format.type'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span>
|
|
<span class="p">);</span>
|
|
</pre></div></td></tr></table></div>
|
|
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_section0991105411202"><h4 class="sectiontitle">Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_table2192818122414" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row10192181817246"><th align="left" class="cellrowborder" valign="top" width="19.401940194019403%" id="mcps1.3.3.2.2.4.1.1"><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p7192181882419">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="8.010801080108012%" id="mcps1.3.3.2.2.4.1.2"><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p1019271892414">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="72.58725872587259%" id="mcps1.3.3.2.2.4.1.3"><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p13192718112416">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row1119211802410"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p31921218192419">connector.type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p17192131812248">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p15192201852418">Data source type. Set this parameter to <strong id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_b1966652551410">dis</strong>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row7192191892420"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p319211817249">connector.region</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p191929186242">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p21921218122410">Region where DIS for storing the data locates.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row16192141802414"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p11192518152411">connector.ak</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p6192161832419">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p1219241812245">Access key ID. This parameter must be set in pair with <strong id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_b2077164411147">sk</strong>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row1919211802419"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p20192718172418">connector.sk</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p619281816244">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p8192161811246">Secret access key. This parameter must be set in pair with <strong id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_b7884105011412">ak</strong>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row1219216180245"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p21921818142418">connector.channel</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p919210187249">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p15192151822420">Name of the DIS stream where data is located.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row101921818142420"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p319251811247">format.type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p819261819248">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p6192118112412">Data coding format. The value can be <strong id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_b130817014154">csv</strong> or <strong id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_b13081708156">json</strong>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row10192618182415"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p1919231813244">format.field-delimiter</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p17192151882416">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p31922184244">Attribute delimiter. You can customize the attribute delimiter only when the encoding format is CSV. The default delimiter is a comma (,).</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_row4192118172414"><td class="cellrowborder" valign="top" width="19.401940194019403%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p919281842413">connector.partition-key</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.010801080108012%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p1119281822413">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="72.58725872587259%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p1519211813248">Group primary key. Multiple primary keys are separated by commas (,). If this parameter is not specified, data is randomly written to DIS partitions.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_section1942141010711"><h4 class="sectiontitle">Precautions</h4><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_p687164016285">None</p>
|
|
</div>
|
|
<div class="section" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_en-us_topic_0111555124_section34021023184217"><h4 class="sectiontitle">Example</h4><p id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_en-us_topic_0111555124_p127151381217">Output the data in the <strong id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_b257924520156">disSink</strong> stream to DIS.</p>
|
|
<div class="codecoloring" codetype="Sql" id="dli_08_0310__en-us_topic_0000001166031873_en-us_topic_0000001081131034_dli_08_0243_en-us_topic_0111555124_screen4717587212"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="n">disSink</span><span class="p">(</span>
|
|
<span class="w"> </span><span class="n">car_id</span><span class="w"> </span><span class="n">STRING</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">car_owner</span><span class="w"> </span><span class="n">STRING</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">car_brand</span><span class="w"> </span><span class="n">STRING</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">car_speed</span><span class="w"> </span><span class="nb">INT</span>
|
|
<span class="p">)</span>
|
|
<span class="k">with</span><span class="w"> </span><span class="p">(</span>
|
|
<span class="w"> </span><span class="s1">'connector.type'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'dis'</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'connector.region'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'connector.channel'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'disOutput'</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'connector.partition-key'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'car_id,car_owner'</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="s1">'format.type'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'csv'</span>
|
|
<span class="p">);</span>
|
|
</pre></div></td></tr></table></div>
|
|
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_08_0307.html">Creating a Result Table</a></div>
|
|
</div>
|
|
</div>
|
|
|