forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
82 lines
7.5 KiB
HTML
82 lines
7.5 KiB
HTML
<a name="mrs_01_1739"></a><a name="mrs_01_1739"></a>
|
|
|
|
<h1 class="topictitle1">Introduction to HetuEngine Cross-Source Function</h1>
|
|
<div id="body32001227"><p id="mrs_01_1739__en-us_topic_0000001173630760_p64516199548">Enterprises usually store massive data, such as from various databases and warehouses, for management and information collection. However, diversified data sources, hybrid dataset structures, and scattered data storage rise the development cost for cross-source query and prolong the cross-source query duration.</p>
|
|
<div class="p" id="mrs_01_1739__en-us_topic_0000001173630760_p14744212105614"><span id="mrs_01_1739__en-us_topic_0000001173630760_text105711461113">HetuEngine</span> provides unified standard SQL statements to implement cross-source collaborative analysis, simplifying cross-source analysis operations.<div class="fignone" id="mrs_01_1739__en-us_topic_0000001173630760_fig5851125715"><span class="figcap"><b>Figure 1 </b>HetuEngine cross-source function</span><br><span><img id="mrs_01_1739__en-us_topic_0000001173630760_image181311175714" src="en-us_image_0000001349059629.png"></span></div>
|
|
</div>
|
|
<div class="section" id="mrs_01_1739__en-us_topic_0000001173630760_section133604972910"><h4 class="sectiontitle">Key Technologies and Advantages of the HetuEngine Cross-Source Function</h4><ul id="mrs_01_1739__en-us_topic_0000001173630760_ul13890133217300"><li id="mrs_01_1739__en-us_topic_0000001173630760_li78906328306">Computing pushdown: When HetuEngine is used for cross-source collaborative analysis, HetuEngine enhances the computing pushdown capability from the dimensions listed in the following table to improve access efficiency.
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1739__en-us_topic_0000001173630760_table14465133816512" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Dimensions of HetuEngine computing pushdown</caption><thead align="left"><tr id="mrs_01_1739__en-us_topic_0000001173630760_row134651138752"><th align="left" class="cellrowborder" valign="top" width="38.49%" id="mcps1.3.3.2.1.1.2.3.1.1"><p id="mrs_01_1739__en-us_topic_0000001173630760_p10465138951">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="61.51%" id="mcps1.3.3.2.1.1.2.3.1.2"><p id="mrs_01_1739__en-us_topic_0000001173630760_p1346519384519">Content</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1739__en-us_topic_0000001173630760_row44651138153"><td class="cellrowborder" rowspan="4" valign="top" width="38.49%" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p146523817512">Basic Pushed Down</p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p1946533815517"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p10465438752"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p1146583810517"></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.51%" headers="mcps1.3.3.2.1.1.2.3.1.2 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p646593817511">Predicate</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row946517381158"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p346513380514">Projection</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row16465338551"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p5465438158">Sub-query</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row1746512382519"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p14465338258">Limit</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row1465183814510"><td class="cellrowborder" rowspan="6" valign="top" width="38.49%" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p84651380518">Aggregation Pushed Down</p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p9465143811517"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p64653381055"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p113964356712"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p7680143919711"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p1867503713"></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.51%" headers="mcps1.3.3.2.1.1.2.3.1.2 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p146583816512">Group by</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row14465173811511"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p14657383513">Order by</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row3465338158"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p174659384513">Count</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row193962357710"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p1839616351172">Sum</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row1567953918711"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p1768018391772">Min</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row8866501873"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p13868502714">Max</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row1261495412713"><td class="cellrowborder" rowspan="3" valign="top" width="38.49%" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p18614165415715">Operator Pushed Down</p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p2817958671"></p>
|
|
<p id="mrs_01_1739__en-us_topic_0000001173630760_p15382141282"></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.51%" headers="mcps1.3.3.2.1.1.2.3.1.2 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p1561495419715"><, ></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row178176581378"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p17817155819719">Like</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1739__en-us_topic_0000001173630760_row153821747818"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.1.1.2.3.1.1 "><p id="mrs_01_1739__en-us_topic_0000001173630760_p103821941816">Or</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<ul id="mrs_01_1739__en-us_topic_0000001173630760_ul18703102723812"><li id="mrs_01_1739__en-us_topic_0000001173630760_li4145136193817">Multi-source heterogeneous data: Collaborative analysis supports both structured data sources such as Hive and GaussDB and unstructured data sources such as HBase and Elasticsearch.</li><li id="mrs_01_1739__en-us_topic_0000001173630760_li940774211384">Global metadata: A mapping table is provided to map unstructured schemas to structured schemas, enabling HetuEngine to access HBase using SQL statements. Global management for data source information is provided.</li><li id="mrs_01_1739__en-us_topic_0000001173630760_li815212475382">Global permission control: Data source permissions can be opened to Ranger through HetuEngine for centralized management and control.</li></ul>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1738.html">Using the HetuEngine Cross-Source Function</a></div>
|
|
</div>
|
|
</div>
|
|
|