forked from docs/doc-exports
Yang, Tong
48706b7552
Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
107 lines
10 KiB
HTML
107 lines
10 KiB
HTML
<a name="mrs_01_2315"></a><a name="mrs_01_2315"></a>
|
|
|
|
<h1 class="topictitle1">Before You Start</h1>
|
|
<div id="body32001227"><p id="mrs_01_2315__en-us_topic_0000001173789582_p18568122016437"><span id="mrs_01_2315__en-us_topic_0000001173789582_text1356812014317">HetuEngine</span> supports quick joint query of multiple data sources and GUI-based data source configuration and management. You can quickly add a data source on the HSConsole page.</p>
|
|
<p id="mrs_01_2315__en-us_topic_0000001173789582_p18639201819552"><a href="#mrs_01_2315__en-us_topic_0000001173789582_table667372634317">Table 1</a> lists the data sources supported by <span id="mrs_01_2315__en-us_topic_0000001173789582_text1132135822014">HetuEngine</span> of the current version.</p>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_2315__en-us_topic_0000001173789582_table667372634317"></a><a name="en-us_topic_0000001173789582_table667372634317"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_2315__en-us_topic_0000001173789582_table667372634317" frame="border" border="1" rules="all"><caption><b>Table 1 </b>List for connecting <span id="mrs_01_2315__en-us_topic_0000001173789582_text28494919714">HetuEngine</span> to data sources</caption><thead align="left"><tr id="mrs_01_2315__en-us_topic_0000001173789582_row196743264437"><th align="left" class="cellrowborder" valign="top" width="18.418158184181582%" id="mcps1.3.3.2.5.1.1"><p id="mrs_01_2315__en-us_topic_0000001173789582_p19732541913"><span id="mrs_01_2315__en-us_topic_0000001173789582_text1947474811316">HetuEngine</span> Mode</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="21.547845215478453%" id="mcps1.3.3.2.5.1.2"><p id="mrs_01_2315__en-us_topic_0000001173789582_p10391416396">Data Source</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="20.157984201579843%" id="mcps1.3.3.2.5.1.3"><p id="mrs_01_2315__en-us_topic_0000001173789582_p1719618571913">Data Source Mode</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="39.876012398760125%" id="mcps1.3.3.2.5.1.4"><p id="mrs_01_2315__en-us_topic_0000001173789582_p15674172613431">Supported Data Source Version</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_2315__en-us_topic_0000001173789582_row3674926144311"><td class="cellrowborder" rowspan="7" valign="top" width="18.418158184181582%" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p3732114515">Security mode</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.547845215478453%" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p123911493913">Hive</p>
|
|
</td>
|
|
<td class="cellrowborder" rowspan="7" valign="top" width="20.157984201579843%" headers="mcps1.3.3.2.5.1.3 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p1367121817211">Security mode</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.876012398760125%" headers="mcps1.3.3.2.5.1.4 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p267422613434">MRS 3.x, FusionInsight 6.5.1, and Hive in the current cluster</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row3674122684315"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p10948134494314">HBase</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p206861644105414">MRS 3.x and FusionInsight 6.5.1</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row967442684310"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p186592218448">Elasticsearch</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p655919581861">Elasticsearch of the current cluster</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row9368113744610"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p38400393313"><span id="mrs_01_2315__en-us_topic_0000001173789582_text1366111811327">HetuEngine</span></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p123681237174611">MRS 3.x</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row82781211569"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p172781918569">GaussDB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p227841145618">GaussDB 200 and GaussDB A 8.0.0</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row14635172835313"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p9636102805314">Hudi</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p8636128195316">MRS 3.1.2 or later</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row775605263119"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p157571052123116">ClickHouse</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p15757125217311">MRS 3.1.1 or later</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row867432654317"><td class="cellrowborder" rowspan="6" valign="top" width="18.418158184181582%" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p87324417115">Normal mode</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.547845215478453%" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p7948114484311">Hive</p>
|
|
</td>
|
|
<td class="cellrowborder" rowspan="5" valign="top" width="20.157984201579843%" headers="mcps1.3.3.2.5.1.3 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p367161817216">Normal mode</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.876012398760125%" headers="mcps1.3.3.2.5.1.4 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p1431312155550">MRS 3.x, FusionInsight 6.5.1, and Hive in the current cluster</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row15674202624310"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p294810444436">HBase</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p5313715105515">MRS 3.x and FusionInsight 6.5.1</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row18674182615435"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p199489442435">Elasticsearch</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p093115777">Elasticsearch of the current cluster</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row429063835310"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p6291163875318">Hudi</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p72911938195310">MRS 3.1.2 or later</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row18874184313322"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p20880154315328">ClickHouse</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p15880154333212">MRS 3.1.1 or later</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2315__en-us_topic_0000001173789582_row1985164410216"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p1498644412210">GaussDB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p19986114414212">Security mode</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.3 "><p id="mrs_01_2315__en-us_topic_0000001173789582_p38111558636">GaussDB 200 and GaussDB A 8.0.0</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<p id="mrs_01_2315__en-us_topic_0000001173789582_p1663341210417">Operations such as adding, configuring, and deleting a <span id="mrs_01_2315__en-us_topic_0000001173789582_text18194252192311">HetuEngine</span> data source takes effect dynamically without restarting the cluster.</p>
|
|
<p id="mrs_01_2315__en-us_topic_0000001173789582_p17134515312">A configured data source takes effect dynamically and you cannot disable this function. By default, the interval for a data source to dynamically take effect is 60 seconds. You can change the interval to a desired one by changing the value of <strong id="mrs_01_2315__en-us_topic_0000001173789582_b2739953248413">catalog.scanner-interval</strong> in <strong id="mrs_01_2315__en-us_topic_0000001173789582_b12268807878413">coordinator.config.properties</strong> and <strong id="mrs_01_2315__en-us_topic_0000001173789582_b18085136718413">worker.config.properties</strong> by referring to <a href="mrs_01_1731.html#mrs_01_1731__en-us_topic_0000001173631202_li135621231135216">3.e</a> in <a href="mrs_01_1731.html">Creating HetuEngine Compute Instances</a>. See the following example.</p>
|
|
<pre class="screen" id="mrs_01_2315__en-us_topic_0000001173789582_screen141385033">catalog.scanner-interval =120s</pre>
|
|
<div class="note" id="mrs_01_2315__en-us_topic_0000001173789582_note690575019613"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_2315__en-us_topic_0000001173789582_ul1071215716197"><li id="mrs_01_2315__en-us_topic_0000001173789582_li1712871196">The domain name of the data source cluster must be different from that of the <span id="mrs_01_2315__en-us_topic_0000001173789582_text06321706326">HetuEngine</span> cluster. In addition, two data sources with the same domain name cannot be connected to at the same time.</li><li id="mrs_01_2315__en-us_topic_0000001173789582_li1371219711915">The data source cluster and the <span id="mrs_01_2315__en-us_topic_0000001173789582_text15282374329">HetuEngine</span> cluster can communicate with each other.</li></ul>
|
|
</div></div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2314.html">Configuring Data Sources</a></div>
|
|
</div>
|
|
</div>
|
|
|