vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dli/sqlreference/dli_08_0344.html
Su, Xiaomeng 04d4597cf3 dli_sqlreference_0511_version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2023-11-02 14:34:08 +00:00

222 lines
25 KiB
HTML
Raw Blame History

<a name="dli_08_0344"></a><a name="dli_08_0344"></a>
<h1 class="topictitle1">ClickHouse Result Table</h1>
<div id="body8662426"><div class="section" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_en-us_topic_0132788972_section108631122164917"><h4 class="sectiontitle">Function</h4><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p661816320442">DLI exports Flink job data to ClickHouse result tables.</p>
<p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p2618163211448">ClickHouse is a column-based database oriented to online analysis and processing. It supports SQL query and provides good query performance. The aggregation analysis and query performance based on large and wide tables is excellent, which is one order of magnitude faster than other analytical databases. </p>
</div>
<div class="section" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_en-us_topic_0132788972_section2579142713429"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_ul16362030161817"><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li7362123012186">Ensure your jobs run on an exclusive queue (non-shared queue) of DLI.</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li7801231131817">You have established an enhanced datasource connection to ClickHouse and set the port in the security group rule of the ClickHouse cluster as needed.<p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p010380124513"><a name="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li7801231131817"></a><a name="en-us_topic_0000001196726101_en-us_topic_0000001191161595_li7801231131817"></a>For details about how to set up an enhanced datasource connection. For details, see "Enhanced Datasource Connection" in the <em id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_i1549402101513">Data Lake Insight User Guide</em>.</p>
</li></ul>
</div>
<div class="section" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_section9685114274916"><h4 class="sectiontitle">Precautions</h4><ul id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_ul13298309230"><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li8627172413266">When you create a ClickHouse cluster for MRS, set the cluster version to MRS 3.1.0 and do not enable Kerberos authentication.</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li11291830192316">Do not define a primary key in Flink SQL statements. Do not use any syntax that generates primary keys, such as <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b192918163219">insert into clickhouseSink select id, cout(*) from sourceName group by id</strong>.</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li18722511382">Flink supports the following data types: string, tinyint, smallint, int, long, float, double, date, timestamp, decimal, and Array.<p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p5810135218381"><a name="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li18722511382"></a><a name="en-us_topic_0000001196726101_en-us_topic_0000001191161595_li18722511382"></a>The array supports only the int, bigint, string, float, and double data types.</p>
</li></ul>
</div>
<div class="section" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_en-us_topic_0132788972_section3126105364419"><h4 class="sectiontitle">Syntax</h4><div class="codecoloring" codetype="Sql" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_screen1461215294716"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span>
<span class="normal">3</span>
<span class="normal">4</span>
<span class="normal">5</span>
<span class="normal">6</span>
<span class="normal">7</span>
<span class="normal">8</span>
<span class="normal">9</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="n">clickhouseSink</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="n">attr_name</span><span class="w"> </span><span class="n">attr_type</span><span class="w"> </span>
<span class="w"> </span><span class="p">(</span><span class="s1">','</span><span class="w"> </span><span class="n">attr_name</span><span class="w"> </span><span class="n">attr_type</span><span class="p">)</span><span class="o">*</span><span class="w"> </span>
<span class="p">)</span>
<span class="k">with</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="s1">'connector.type'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'clickhouse'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'connector.url'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'connector.table'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">''</span>
<span class="p">);</span>
</pre></div></td></tr></table></div>
</div>
</div>
<div class="section" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_section4299113491"><h4 class="sectiontitle">Parameters</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_table11617424154613" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row146177242466"><th align="left" class="cellrowborder" valign="top" width="21.47214721472147%" id="mcps1.3.5.2.2.4.1.1"><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1361712418461">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="8.930893089308931%" id="mcps1.3.5.2.2.4.1.2"><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p176171424114615">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="69.5969596959696%" id="mcps1.3.5.2.2.4.1.3"><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p261712247467">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row136171242461"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p992213916285">connector.type</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p169221598288">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1492219917287">Result table type. Set this parameter to <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b81351155172220">clickhouse</strong>.</p>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row1961742414462"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p189227911283">connector.url</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p119227912817">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p271993713110">ClickHouse URL.</p>
<p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p393765714189">Parameter format: <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b8767123117234">jdbc:clickhouse://</strong><em id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_i5537336152320">ClickHouseBalancer instance IP address</em><strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b188391841182314">:</strong><em id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_i2717348182317">HTTP port number for ClickHouseBalancer instances</em><strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b17295755102318">/</strong><em id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_i87442050202312">Database name</em></p>
<ul id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_ul15210101291220"><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li10428100111319">IP address of a ClickHouseBalancer instance:<p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p5718212134"><a name="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li10428100111319"></a><a name="en-us_topic_0000001196726101_en-us_topic_0000001191161595_li10428100111319"></a>Log in to the MRS management console, click a cluster name, and choose <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b16936183443418">Components</strong> &gt; <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b19936193414341">ClickHouse</strong> &gt; <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b1818515332519">Instance</strong> to obtain the service IP address of the ClickHouseBalancer instance.</p>
</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li34551059111218">HTTP port of a ClickHouseBalancer instance:<p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1394520221311"><a name="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li34551059111218"></a><a name="en-us_topic_0000001196726101_en-us_topic_0000001191161595_li34551059111218"></a>Log in to the MRS management console, click the target cluster name. On the displayed page, choose <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b893114481325">Components</strong> &gt; <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b1566181614340">ClickHouse</strong>. In the <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b1719118204341">Service Configuration</strong> tab, choose <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b111801116203516">ClickHouseBalancer</strong> from the <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b1014694916455">All Roles</strong> dropdown list and search for <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b18968318133510">lb_http_port</strong> to configure the parameter. The default value is <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b195153613358">21425</strong>.</p>
</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li11558457172813">The database name is the name of the database created for the ClickHouse cluster.</li></ul>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row1761802415461"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1092209122818">connector.table</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p149225917285">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p169222932814">Name of the ClickHouse table to be created</p>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row1261892474618"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p16922169172812">connector.driver</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1992213917286">No</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p196305763311">Driver required for connecting to the database</p>
<ul id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_ul18504403348"><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li1653817362342">If this parameter is not specified during table creation, the driver automatically extracts the value from the ClickHouse URL.</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li12455823512">If this parameter is specified during table creation, the value must be <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b15561196386">ru.yandex.clickhouse.ClickHouseDriver</strong>.</li></ul>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row15618102474612"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p179229932813">connector.username</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1922209182815">No</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1192217952818">Account for connecting the ClickHouse database</p>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row1561842464619"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p392219919280">connector.password</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p139222912811">No</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p692213915286">Password for accessing the ClickHouse database</p>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row16618102434612"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p209223952815">connector.write.flush.max-rows</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p69221095281">No</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p0922090288">Maximum number of rows to be updated when data is written. The default value is <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b12888192372719">5000</strong>.</p>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row126181924134616"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p189221590287">connector.write.flush.interval</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p3922499281">No</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p0922129152814">Interval for data update. The unit can be ms, milli, millisecond/s, sec, second/min or minute.</p>
</td>
</tr>
<tr id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_row967410521254"><td class="cellrowborder" valign="top" width="21.47214721472147%" headers="mcps1.3.5.2.2.4.1.1 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p19922199142815">connector.write.max-retries</p>
</td>
<td class="cellrowborder" valign="top" width="8.930893089308931%" headers="mcps1.3.5.2.2.4.1.2 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p49221913284">No</p>
</td>
<td class="cellrowborder" valign="top" width="69.5969596959696%" headers="mcps1.3.5.2.2.4.1.3 "><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p692210910280">Maximum number of attempts to write data if failed. The default value is <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b7942142874016">3</strong>.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_dli_08_0256_en-us_topic_0132788972_section19670175612466"><h4 class="sectiontitle">Example</h4><p id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_p1326131081119">Read data from a DIS table and insert the data into the <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b7427172214437">test</strong> table of ClickHouse database <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b1229813194439">flinktest</strong>.</p>
<ol id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_ol167912426230"><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li932651317259">Create a DIS source table <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b171373384417">disSource</strong>.<div class="codecoloring" codetype="Sql" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_screen1636174418236"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span>
<span class="normal">13</span>
<span class="normal">14</span>
<span class="normal">15</span>
<span class="normal">16</span>
<span class="normal">17</span>
<span class="normal">18</span>
<span class="normal">19</span>
<span class="normal">20</span>
<span class="normal">21</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="n">disSource</span><span class="p">(</span>
<span class="w"> </span><span class="n">attr0</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr1</span><span class="w"> </span><span class="n">TINYINT</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr2</span><span class="w"> </span><span class="nb">smallint</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr3</span><span class="w"> </span><span class="nb">int</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr4</span><span class="w"> </span><span class="nb">bigint</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr5</span><span class="w"> </span><span class="nb">float</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr6</span><span class="w"> </span><span class="n">double</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr7</span><span class="w"> </span><span class="n">String</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr8</span><span class="w"> </span><span class="n">string</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr9</span><span class="w"> </span><span class="k">timestamp</span><span class="p">(</span><span class="mi">3</span><span class="p">),</span>
<span class="w"> </span><span class="n">attr10</span><span class="w"> </span><span class="k">timestamp</span><span class="p">(</span><span class="mi">3</span><span class="p">),</span>
<span class="w"> </span><span class="n">attr11</span><span class="w"> </span><span class="nb">date</span><span class="p">,</span>
<span class="w"> </span><span class="n">attr12</span><span class="w"> </span><span class="nb">decimal</span><span class="p">(</span><span class="mi">38</span><span class="p">,</span><span class="w"> </span><span class="mi">18</span><span class="p">),</span>
<span class="w"> </span><span class="n">attr13</span><span class="w"> </span><span class="nb">decimal</span><span class="p">(</span><span class="mi">38</span><span class="p">,</span><span class="w"> </span><span class="mi">18</span><span class="p">)</span>
<span class="p">)</span><span class="w"> </span><span class="k">with</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="ss">&quot;connector.type&quot;</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="ss">&quot;dis&quot;</span><span class="p">,</span>
<span class="w"> </span><span class="ss">&quot;connector.region&quot;</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="ss">&quot;cn-xxxx-x&quot;</span><span class="p">,</span>
<span class="w"> </span><span class="ss">&quot;connector.channel&quot;</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="ss">&quot;xxxx&quot;</span><span class="p">,</span>
<span class="w"> </span><span class="ss">&quot;format.type&quot;</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'csv'</span>
<span class="p">);</span>
</pre></div></td></tr></table></div>
</div>
</li><li id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_li13644402317">Create ClickHouse result table <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b16934122154413">clickhouse</strong> and insert the data from the <strong id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_b3807123217444">disSource</strong> table to the result table.<pre class="screen" id="dli_08_0344__en-us_topic_0000001196726101_en-us_topic_0000001191161595_screen280645752319">create table clickhouse(
attr0 string,
attr1 TINYINT,
attr2 smallint,
attr3 int,
attr4 bigint,
attr5 float,
attr6 double,
attr7 String,
attr8 string,
attr9 timestamp(3),
attr10 timestamp(3),
attr11 date,
attr12 decimal(38, 18),
attr13 decimal(38, 18),
attr14 array &lt; int &gt;,
attr15 array &lt; bigint &gt;,
attr16 array &lt; float &gt;,
attr17 array &lt; double &gt;,
attr18 array &lt; varchar &gt;,
attr19 array &lt; String &gt;
) with (
'connector.type' = 'clickhouse',
'connector.url' = 'jdbc:clickhouse://xx.xx.xx.xx:xx/flinktest',
'connector.table' = 'test'
);
insert into
clickhouse
select
attr0,
attr1,
attr2,
attr3,
attr4,
attr5,
attr6,
attr7,
attr8,
attr9,
attr10,
attr11,
attr12,
attr13,
array [attr3, attr3+1],
array [cast(attr4 as bigint), cast(attr4+1 as bigint)],
array [cast(attr12 as float), cast(attr12+1 as float)],
array [cast(attr13 as double), cast(attr13+1 as double)],
array ['TEST1', 'TEST2'],
array [attr7, attr7]
from
disSource;
</pre>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_08_0307.html">Creating a Result Table</a></div>
</div>
</div>
View Git Blame Copy Permalink