vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dli/sqlreference/dli_08_0405.html
Su, Xiaomeng 76a5b1ee83 dli_sqlreference_20240227 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2024-03-27 22:02:33 +00:00

470 lines
49 KiB
HTML
Raw Blame History

<a name="dli_08_0405"></a><a name="dli_08_0405"></a>
<h1 class="topictitle1">JDBC Dimension Table</h1>
<div id="body8662426"><p id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_p7798335163614">Create a JDBC dimension table to connect to the source stream.</p>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_section149656154515"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_08_0405__en-us_topic_0000001262335934_p16778111322111">You have created a JDBC instance for your account.</p>
</div>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_section1139982771913"><h4 class="sectiontitle">Precautions</h4><ul id="dli_08_0405__en-us_topic_0000001262335934_ul11332134833210"><li id="dli_08_0405__en-us_topic_0000001262335934_li399615484359">When you create a Flink OpenSource SQL job, set <strong id="dli_08_0405__en-us_topic_0000001262335934_b5371171171113">Flink Version</strong> to <strong id="dli_08_0405__en-us_topic_0000001262335934_b9372121112115">1.12</strong> in the <strong id="dli_08_0405__en-us_topic_0000001262335934_b20372311121111">Running Parameters</strong> tab. Select <strong id="dli_08_0405__en-us_topic_0000001262335934_b33721911151118">Save Job Log</strong>, and specify the OBS bucket for saving job logs.</li></ul>
</div>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_section1691193353316"><h4 class="sectiontitle">Syntax</h4><div class="codecoloring" codetype="Sql" id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_screen5122423123018"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">table_id</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="n">attr_name</span><span class="w"> </span><span class="n">attr_type</span><span class="w"> </span>
<span class="w"> </span><span class="p">(</span><span class="s1">','</span><span class="w"> </span><span class="n">attr_name</span><span class="w"> </span><span class="n">attr_type</span><span class="p">)</span><span class="o">*</span><span class="w"> </span>
<span class="p">)</span>
<span class="w"> </span><span class="k">WITH</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="s1">'connector'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'jdbc'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'url'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'table-name'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'driver'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'username'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'password'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span>
<span class="p">);</span>
</pre></div></td></tr></table></div>
</div>
</div>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_section52043281918"><h4 class="sectiontitle">Parameters</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_table115011952171611" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row7534452171619"><th align="left" class="cellrowborder" valign="top" width="26.919999999999998%" id="mcps1.3.5.2.2.4.1.1"><p id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_p145430522169">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="16.79%" id="mcps1.3.5.2.2.4.1.2"><p id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_p955415216164">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="56.28999999999999%" id="mcps1.3.5.2.2.4.1.3"><p id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_p1056555281615">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row8575105261616"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p16535121422812">connector</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p5535141410287">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p5535114162811">Data source type. The value is fixed to <strong id="dli_08_0405__en-us_topic_0000001262335934_b1773534181112">jdbc</strong>.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row11645852191610"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p15535141432819">url</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1653517144282">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p12535914122818">Database URL</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row166821052141616"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p17535131482814">table-name</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p653621414283">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p2536191418289">Name of the table where the data will be read from the database</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row1871675211610"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p95361214202815">driver</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1353613148281">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1453631462817">Driver required for connecting to the database. If you do not set this parameter, the automatically extracted URL will be used.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row177441952131614"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p105364142285">username</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1128519229372">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p175361714162814">Database authentication user name. This parameter must be configured in pair with <strong id="dli_08_0405__en-us_topic_0000001262335934_b19628536128">password</strong>.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row69411319206"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p6536614122819">password</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p6536131442814">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p953641462814">Database authentication password. This parameter must be configured in pair with <strong id="dli_08_0405__en-us_topic_0000001262335934_b268129111218">username</strong>.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row189061849441"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p145360147285">scan.partition.column</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p2053671411284">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p116589384217">Name of the column used to partition the input</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p553619143288">This parameter must be set when <strong id="dli_08_0405__en-us_topic_0000001262335934_b1828704494618">scan.partition.lower-bound</strong>, <strong id="dli_08_0405__en-us_topic_0000001262335934_b172871644154617">scan.partition.upper-bound</strong>, and <strong id="dli_08_0405__en-us_topic_0000001262335934_b1628713448461">scan.partition.num</strong> are all configured, and should not be set when other three parameters are not.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_row4905049143"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p13536121417280">scan.partition.lower-bound</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p12536141432814">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p288018561266">Lower bound of values to be fetched for the first partition</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1959201591213">This parameter must be set when <strong id="dli_08_0405__en-us_topic_0000001262335934_b310310124711">scan.partition.column</strong>, <strong id="dli_08_0405__en-us_topic_0000001262335934_b181035016475">scan.partition.upper-bound</strong>, and <strong id="dli_08_0405__en-us_topic_0000001262335934_b810312017473">scan.partition.num</strong> are all configured, and should not be set when other three parameters are not.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row523825412155"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1536111412282">scan.partition.upper-bound</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p19536114202818">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p121666952715">Upper bound of values to be fetched for the last partition</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1817519503128">This parameter must be set when <strong id="dli_08_0405__en-us_topic_0000001262335934_b186318411478">scan.partition.column</strong>, <strong id="dli_08_0405__en-us_topic_0000001262335934_b4631164144713">scan.partition.lower-bound</strong>, and <strong id="dli_08_0405__en-us_topic_0000001262335934_b1963114204718">scan.partition.num</strong> are all configured, and should not be set when other three parameters are not.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row164711259201519"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p05361514192815">scan.partition.num</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p353615142286">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p169219816221">Number of partitions to be created</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p91551751111210">This parameter must be set when <strong id="dli_08_0405__en-us_topic_0000001262335934_b04958784718">scan.partition.column</strong>, <strong id="dli_08_0405__en-us_topic_0000001262335934_b049615713471">scan.partition.upper-bound</strong>, and <strong id="dli_08_0405__en-us_topic_0000001262335934_b449617764718">scan.partition.upper-bound</strong> are all configured, and should not be set when other three parameters are not.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row681110575152"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p13536161420286">scan.fetch-size</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p153631417288">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p726673414232">Number of rows fetched from the database each time. The default value is <strong id="dli_08_0405__en-us_topic_0000001262335934_b144731117181518">0</strong>, indicating the hint is ignored.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row1051145671512"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p95361514152815">lookup.cache.max-rows</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1653691422810">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p155363147283">Maximum number of cached rows in a dimension table. If the number of cached rows exceeds the value , old data will be deleted. The value <strong id="dli_08_0405__en-us_topic_0000001262335934_b189781625101514">-1</strong> indicates that data cache disabled.</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row716712523158"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p105369142281">lookup.cache.ttl</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p8536141412285">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_en-us_topic_0000001080679435_p1380199153514">Maximum time to live (TTL) of for every rows in lookup cache. Caches exceeding the TTL will be expired. The format is {length value}{time unit label}, for example, <strong id="dli_08_0405__en-us_topic_0000001262335934_b11707113071517">123ms, 321s</strong>. The supported time units include d, h, min, s, and ms (default unit).</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row56349261286"><td class="cellrowborder" valign="top" width="26.919999999999998%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p353671472816">lookup.max-retries</p>
</td>
<td class="cellrowborder" valign="top" width="16.79%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1453691412814">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.28999999999999%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1763517261086">Maximum number of attempts to obtain data from the dimension table. The default value is <strong id="dli_08_0405__en-us_topic_0000001262335934_b10922173417158">3</strong>.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_section1798284817267"><h4 class="sectiontitle">Data Type Mapping</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_08_0405__en-us_topic_0000001262335934_table1763835011280" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Data type mapping</caption><thead align="left"><tr id="dli_08_0405__en-us_topic_0000001262335934_row1638125032818"><th align="left" class="cellrowborder" valign="top" width="27.339999999999996%" id="mcps1.3.6.2.2.4.1.1"><p id="dli_08_0405__en-us_topic_0000001262335934_p2063895012811">MySQL Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="26.419999999999998%" id="mcps1.3.6.2.2.4.1.2"><p id="dli_08_0405__en-us_topic_0000001262335934_p192231755102915">PostgreSQL Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="46.239999999999995%" id="mcps1.3.6.2.2.4.1.3"><p id="dli_08_0405__en-us_topic_0000001262335934_p963855013286">Flink SQL Type</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_08_0405__en-us_topic_0000001262335934_row156381350142816"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p31591335132718">TINYINT</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p18223175514292">-</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1563885082814">TINYINT</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row363865082813"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1562412015278">SMALLINT</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1562440162719">TINYINT UNSIGNED</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p8362313123110">SMALLINT</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p3641315173118">INT2</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p113023181317">SMALLSERIAL</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1522395514291">SERIAL2</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p6638105011280">SMALLINT</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row11638125012281"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p953995032711">INT</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p428445819276">MEDIUMINT</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p6638950112817">SMALLINT UNSIGNED</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p184911541319">INTEGER</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p6223155512291">SERIAL</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p2063818509282">INT</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row13638450112816"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1729512711282">BIGINT</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p206381450112812">INT UNSIGNED</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1828235614304">BIGINT</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p11223175532910">BIGSERIAL</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1263865022815">BIGINT</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row13638250192812"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p15638115052818">BIGINT UNSIGNED</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p222315558298">-</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p263825032811">DECIMAL(20, 0)</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row2063845012816"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p9638750182819">BIGINT</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p6223115519291">BIGINT</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p2638135012812">BIGINT</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row20638195018282"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1163835062813">FLOAT</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p189716430307">REAL</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p6223195512919">FLOAT4</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p116388508284">FLOAT</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row1063805022817"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p123932031102812">DOUBLE</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p2638105062810">DOUBLE PRECISION</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1773253420308">FLOAT8</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1022320555298">DOUBLE PRECISION</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p6638185017285">DOUBLE</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row66381502282"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p169583762812">NUMERIC(p, s)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p14638165042819">DECIMAL(p, s)</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p378392733020">NUMERIC(p, s)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p722355562911">DECIMAL(p, s)</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p2638205072819">DECIMAL(p, s)</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row16638650192819"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p2413502283">BOOLEAN</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1663875011285">TINYINT(1)</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p622365520291">BOOLEAN</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1263835016287">BOOLEAN</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row46385509281"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1463845017289">DATE</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p9223055192918">DATE</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p3638145012818">DATE</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row106381950122815"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p12638165018287">TIME [(p)]</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p102232556296">TIME [(p)] [WITHOUT TIMEZONE]</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1863875042813">TIME [(p)] [WITHOUT TIMEZONE]</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row1363825082820"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p196381950182814">DATETIME [(p)]</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p622312554298">TIMESTAMP [(p)] [WITHOUT TIMEZONE]</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p5638350132818">TIMESTAMP [(p)] [WITHOUT TIMEZONE]</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row4638175032820"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p182297293">CHAR(n)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p16753613202914">VARCHAR(n)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p16638850182817">TEXT</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p69611143172914">CHAR(n)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p197622463293">CHARACTER(n)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p782394862919">VARCHAR(n)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p1266195692910">CHARACTER</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p174231553192914">VARYING(n)</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p0223555152916">TEXT</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p6638195019280">STRING</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row663845017282"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p10502721132918">BINARY</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p15293925132912">VARBINARY</p>
<p id="dli_08_0405__en-us_topic_0000001262335934_p12638150192818">BLOB</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p922325542917">BYTEA</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p96382503282">BYTES</p>
</td>
</tr>
<tr id="dli_08_0405__en-us_topic_0000001262335934_row16638450142813"><td class="cellrowborder" valign="top" width="27.339999999999996%" headers="mcps1.3.6.2.2.4.1.1 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1638185042816">-</p>
</td>
<td class="cellrowborder" valign="top" width="26.419999999999998%" headers="mcps1.3.6.2.2.4.1.2 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1322316556293">ARRAY</p>
</td>
<td class="cellrowborder" valign="top" width="46.239999999999995%" headers="mcps1.3.6.2.2.4.1.3 "><p id="dli_08_0405__en-us_topic_0000001262335934_p1463805022811">ARRAY</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_dli_08_0261_section13376151217347"><h4 class="sectiontitle">Example</h4><p id="dli_08_0405__en-us_topic_0000001262335934_p147351058848">Read data from a Kafka source table, use a JDBC table as the dimension table. Write table information generated by the source and dimension tables to a Kafka result table. The procedure is as follows:</p>
<ol id="dli_08_0405__en-us_topic_0000001262335934_ol14392076231"><li id="dli_08_0405__en-us_topic_0000001262335934_li6127741153217">Create an enhanced datasource connection in the VPC and subnet where MySQL and Kafka locate, and bind the connection to the required Flink elastic resource pool.</li><li id="dli_08_0405__en-us_topic_0000001262335934_li1233002211514">Set MySQL and Kafka security groups and add inbound rules to allow access from the Flink queue. Test the connectivity using the MySQL and Kafka address. If the connection passes the test, it is bound to the queue.</li><li id="dli_08_0405__en-us_topic_0000001262335934_li9392678239">Connect to the MySQL database instance, create a table in the flink database as a dimension table, and name the table <strong id="dli_08_0405__en-us_topic_0000001262335934_b9145131615017">area_info</strong>. Example SQL statements are as follows:<pre class="screen" id="dli_08_0405__en-us_topic_0000001262335934_screen135451812134017">CREATE TABLE `flink`.`area_info` (
`area_id` VARCHAR(32) NOT NULL,
`area_province_name` VARCHAR(32) NOT NULL,
`area_city_name` VARCHAR(32) NOT NULL,
`area_county_name` VARCHAR(32) NOT NULL,
`area_street_name` VARCHAR(32) NOT NULL,
`region_name` VARCHAR(32) NOT NULL,
PRIMARY KEY (`area_id`)
) ENGINE = InnoDB
DEFAULT CHARACTER SET = utf8mb4
COLLATE = utf8mb4_general_ci;</pre>
</li><li id="dli_08_0405__en-us_topic_0000001262335934_li21001253154210">Connect to the MySQL database and run the following statement to insert test data into the JDBC dimension table <strong id="dli_08_0405__en-us_topic_0000001262335934_b144481047610">area_info</strong>:<pre class="screen" id="dli_08_0405__en-us_topic_0000001262335934_screen1051974354312">insert into flink.area_info
(area_id, area_province_name, area_city_name, area_county_name, area_street_name, region_name)
values
('330102', 'a1', 'b1', 'c1', 'd1', 'e1'),
('330106', 'a1', 'b1', 'c2', 'd2', 'e1'),
('330108', 'a1', 'b1', 'c3', 'd3', 'e1'), ('330110', 'a1', 'b1', 'c4', 'd4', 'e1');</pre>
</li><li id="dli_08_0405__en-us_topic_0000001262335934_li252222512418">Create a Flink OpenSource SQL job Enter the following job script and submit the job. The job script uses Kafka as the data source and a JDBC table as the dimension table. Data is output to a Kafka result table.<div class="p" id="dli_08_0405__en-us_topic_0000001262335934_p8584143834112"><a name="dli_08_0405__en-us_topic_0000001262335934_li252222512418"></a><a name="en-us_topic_0000001262335934_li252222512418"></a>When you create a job, set <strong id="dli_08_0405__en-us_topic_0000001262335934_b62009148473">Flink Version</strong> to <strong id="dli_08_0405__en-us_topic_0000001262335934_b9206814174715">1.12</strong> in the <strong id="dli_08_0405__en-us_topic_0000001262335934_b112077146474">Running Parameters</strong> tab. Select <strong id="dli_08_0405__en-us_topic_0000001262335934_b0207131444717">Save Job Log</strong>, and specify the OBS bucket for saving job logs. <strong id="dli_08_0405__en-us_topic_0000001262335934_b20888617174716">Set the values of the parameters in bold in the following script as needed.</strong><div class="codecoloring" codetype="Sql" id="dli_08_0405__en-us_topic_0000001262335934_screen1528514322413"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span>
<span class="normal">13</span>
<span class="normal">14</span>
<span class="normal">15</span>
<span class="normal">16</span>
<span class="normal">17</span>
<span class="normal">18</span>
<span class="normal">19</span>
<span class="normal">20</span>
<span class="normal">21</span>
<span class="normal">22</span>
<span class="normal">23</span>
<span class="normal">24</span>
<span class="normal">25</span>
<span class="normal">26</span>
<span class="normal">27</span>
<span class="normal">28</span>
<span class="normal">29</span>
<span class="normal">30</span>
<span class="normal">31</span>
<span class="normal">32</span>
<span class="normal">33</span>
<span class="normal">34</span>
<span class="normal">35</span>
<span class="normal">36</span>
<span class="normal">37</span>
<span class="normal">38</span>
<span class="normal">39</span>
<span class="normal">40</span>
<span class="normal">41</span>
<span class="normal">42</span>
<span class="normal">43</span>
<span class="normal">44</span>
<span class="normal">45</span>
<span class="normal">46</span>
<span class="normal">47</span>
<span class="normal">48</span>
<span class="normal">49</span>
<span class="normal">50</span>
<span class="normal">51</span>
<span class="normal">52</span>
<span class="normal">53</span>
<span class="normal">54</span>
<span class="normal">55</span>
<span class="normal">56</span>
<span class="normal">57</span>
<span class="normal">58</span>
<span class="normal">59</span>
<span class="normal">60</span>
<span class="normal">61</span>
<span class="normal">62</span>
<span class="normal">63</span>
<span class="normal">64</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">orders</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="n">order_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">order_channel</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">order_time</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">pay_amount</span><span class="w"> </span><span class="n">double</span><span class="p">,</span>
<span class="w"> </span><span class="n">real_pay</span><span class="w"> </span><span class="n">double</span><span class="p">,</span>
<span class="w"> </span><span class="n">pay_time</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">user_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">user_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">proctime</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">Proctime</span><span class="p">()</span>
<span class="p">)</span><span class="w"> </span><span class="k">WITH</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="s1">'connector'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'kafka'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'topic'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'KafkaSourceTopic'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'properties.bootstrap.servers'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'KafkaAddress1:KafkaPort,KafkaAddress2:KafkaPort'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'properties.group.id'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'jdbc-order'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'scan.startup.mode'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'latest-offset'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'format'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'json'</span>
<span class="p">);</span>
<span class="c1">-- Create an address dimension table</span>
<span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="n">area_info</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="n">area_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span><span class="w"> </span>
<span class="w"> </span><span class="n">area_province_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_city_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_county_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span><span class="w"> </span>
<span class="w"> </span><span class="n">area_street_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span><span class="w"> </span>
<span class="w"> </span><span class="n">region_name</span><span class="w"> </span><span class="n">string</span><span class="w"> </span>
<span class="p">)</span><span class="w"> </span><span class="k">WITH</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="s1">'connector'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'jdbc'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'url'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'jdbc:mysql://JDBCAddress:JDBCPort/flink'</span><span class="p">,</span><span class="c1">--flink is the MySQL database where the area_info table locates.</span>
<span class="w"> </span><span class="s1">'table-name'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'area_info'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'username'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'JDBCUserName'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'password'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'JDBCPassWord'</span>
<span class="p">);</span>
<span class="c1">-- Generate a wide table based on the address dimension table containing detailed order information.</span>
<span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="n">order_detail</span><span class="p">(</span>
<span class="w"> </span><span class="n">order_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">order_channel</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">order_time</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">pay_amount</span><span class="w"> </span><span class="n">double</span><span class="p">,</span>
<span class="w"> </span><span class="n">real_pay</span><span class="w"> </span><span class="n">double</span><span class="p">,</span>
<span class="w"> </span><span class="n">pay_time</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">user_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">user_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_province_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_city_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_county_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">area_street_name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">region_name</span><span class="w"> </span><span class="n">string</span>
<span class="p">)</span><span class="w"> </span><span class="k">with</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="s1">'connector'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'kafka'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'topic'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'KafkaSinkTopic'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'properties.bootstrap.servers'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'KafkaAddress1:KafkaPort,KafkaAddress2:KafkaPort'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'format'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'json'</span>
<span class="p">);</span>
<span class="k">insert</span><span class="w"> </span><span class="k">into</span><span class="w"> </span><span class="n">order_detail</span>
<span class="w"> </span><span class="k">select</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">order_id</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">order_channel</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">order_time</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">pay_amount</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">real_pay</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">pay_time</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">user_id</span><span class="p">,</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">user_name</span><span class="p">,</span>
<span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">area_id</span><span class="p">,</span><span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">area_province_name</span><span class="p">,</span><span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">area_city_name</span><span class="p">,</span><span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">area_county_name</span><span class="p">,</span>
<span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">area_street_name</span><span class="p">,</span><span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">region_name</span><span class="w"> </span><span class="k">from</span><span class="w"> </span><span class="n">orders</span><span class="w"> </span>
<span class="w"> </span><span class="k">left</span><span class="w"> </span><span class="k">join</span><span class="w"> </span><span class="n">area_info</span><span class="w"> </span><span class="k">for</span><span class="w"> </span><span class="n">system_time</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">proctime</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">area</span><span class="w"> </span><span class="k">on</span><span class="w"> </span><span class="n">orders</span><span class="p">.</span><span class="n">area_id</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">area</span><span class="p">.</span><span class="n">area_id</span><span class="p">;</span>
</pre></div></td></tr></table></div>
</div>
</div>
</li><li id="dli_08_0405__en-us_topic_0000001262335934_li43921470232">Connect to the Kafka cluster and insert the following test data into the source topic in Kafka:<pre class="screen" id="dli_08_0405__en-us_topic_0000001262335934_screen1877314256281">{"order_id":"202103241606060001", "order_channel":"appShop", "order_time":"2021-03-24 16:06:06", "pay_amount":"200.00", "real_pay":"180.00", "pay_time":"2021-03-24 16:10:06", "user_id":"0001", "user_name":"Alice", "area_id":"330106"}
{"order_id":"202103251202020001", "order_channel":"miniAppShop", "order_time":"2021-03-25 12:02:02", "pay_amount":"60.00", "real_pay":"60.00", "pay_time":"2021-03-25 12:03:00", "user_id":"0002", "user_name":"Bob", "area_id":"330110"}
{"order_id":"202103251505050001", "order_channel":"qqShop", "order_time":"2021-03-25 15:05:05", "pay_amount":"500.00", "real_pay":"400.00", "pay_time":"2021-03-25 15:10:00", "user_id":"0003", "user_name":"Cindy", "area_id":"330108"}</pre>
</li><li id="dli_08_0405__en-us_topic_0000001262335934_li11392373235">Connect to the Kafka cluster and read data from the sink topic of Kafka.<pre class="screen" id="dli_08_0405__en-us_topic_0000001262335934_screen17278195492917">{"order_id":"202103241606060001","order_channel":"appShop","order_time":"2021-03-24 16:06:06","pay_amount":200.0,"real_pay":180.0,"pay_time":"2021-03-24 16:10:06","user_id":"0001","user_name":"Alice","area_id":"330106","area_province_name":"a1","area_city_name":"b1","area_county_name":"c2","area_street_name":"d2","region_name":"e1"}
{"order_id":"202103251202020001","order_channel":"miniAppShop","order_time":"2021-03-25 12:02:02","pay_amount":60.0,"real_pay":60.0,"pay_time":"2021-03-25 12:03:00","user_id":"0002","user_name":"Bob","area_id":"330110","area_province_name":"a1","area_city_name":"b1","area_county_name":"c4","area_street_name":"d4","region_name":"e1"}
{"order_id":"202103251505050001","order_channel":"qqShop","order_time":"2021-03-25 15:05:05","pay_amount":500.0,"real_pay":400.0,"pay_time":"2021-03-25 15:10:00","user_id":"0003","user_name":"Cindy","area_id":"330108","area_province_name":"a1","area_city_name":"b1","area_county_name":"c3","area_street_name":"d3","region_name":"e1"}</pre>
</li></ol>
</div>
<div class="section" id="dli_08_0405__en-us_topic_0000001262335934_section789212289323"><h4 class="sectiontitle">FAQs</h4><p id="dli_08_0405__en-us_topic_0000001262335934_p672834115327">None</p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_08_0402.html">Creating Dimension Tables</a></div>
</div>
</div>
View Git Blame Copy Permalink