forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
69 lines
9.4 KiB
HTML
69 lines
9.4 KiB
HTML
<a name="mrs_01_24253"></a><a name="mrs_01_24253"></a>
|
|
|
|
<h1 class="topictitle1">Configuring a Co-deployed Hive Data Source</h1>
|
|
<div id="body8662426"><div class="section" id="mrs_01_24253__en-us_topic_0000001173470802_section2627184474517"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_24253__en-us_topic_0000001173470802_p2060416220463">This section describes how to add a Hive data source of the same Hadoop cluster as HetuEngine on HSConsole.</p>
|
|
<p id="mrs_01_24253__en-us_topic_0000001173470802_p527214713459">Currently, <span id="mrs_01_24253__en-us_topic_0000001173470802_text1169722613551">HetuEngine</span> supports data sources of the following traditional data formats: AVRO, TEXT, RCTEXT, Binary, ORC, Parquet, and SequenceFile.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_24253__en-us_topic_0000001173470802_section197211512297"><h4 class="sectiontitle">Prerequisites</h4><div class="p" id="mrs_01_24253__en-us_topic_0000001173470802_p0263135514339">A <span id="mrs_01_24253__en-us_topic_0000001173470802_text16432927192716">HetuEngine</span> compute instance has been created.<div class="note" id="mrs_01_24253__en-us_topic_0000001173470802_note76098465711"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_24253__en-us_topic_0000001173470802_p19609246577">The HetuEngine service is interconnected to its co-deployed Hive data source by default during its installation. The data source name is <strong id="mrs_01_24253__en-us_topic_0000001173470802_b26570227211">hive</strong> and cannot be deleted. Some default configurations cannot be modified. You need to restart the HetuEngine service to automatically synchronize these unmodifiable configurations once they are updated.</p>
|
|
</div></div>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="mrs_01_24253__en-us_topic_0000001173470802_section3432046131715"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_24253__en-us_topic_0000001173470802_ol9279643121916"><li id="mrs_01_24253__en-us_topic_0000001173470802_li75428581314"><span>Log in to FusionInsight Manager as a <span id="mrs_01_24253__en-us_topic_0000001173470802_text1764549214742">HetuEngine</span> administrator and choose <strong id="mrs_01_24253__en-us_topic_0000001173470802_b648710237742">Cluster</strong> > <strong id="mrs_01_24253__en-us_topic_0000001173470802_b1662974125742">Services</strong> > <strong id="mrs_01_24253__en-us_topic_0000001173470802_b1553928455742"><span id="mrs_01_24253__en-us_topic_0000001173470802_text1387214552742">HetuEngine</span></strong>.</span></li><li id="mrs_01_24253__en-us_topic_0000001173470802_li195421658414"><span>In the <strong id="mrs_01_24253__en-us_topic_0000001173470802_b815932630742">Basic Information</strong> area on the <strong id="mrs_01_24253__en-us_topic_0000001173470802_b306020915742">Dashboard</strong> page, click the link next to <strong id="mrs_01_24253__en-us_topic_0000001173470802_b403612990742">HSConsole WebUI</strong>.</span></li><li id="mrs_01_24253__en-us_topic_0000001173470802_li75426584114"><span>On HSConsole, choose <strong id="mrs_01_24253__en-us_topic_0000001173470802_b12697459392">Data Source</strong>. Locate the row that contains the target Hive data source, click <strong id="mrs_01_24253__en-us_topic_0000001173470802_b11756314191113">Edit</strong> in the <strong id="mrs_01_24253__en-us_topic_0000001173470802_b113242185115">Operation</strong> column, and modify the configurations. The following table describes data source configurations that can be modified.</span><p>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_24253__en-us_topic_0000001173470802_table18381204214544" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_24253__en-us_topic_0000001173470802_row1938144214549"><th align="left" class="cellrowborder" valign="top" width="24.312431243124312%" id="mcps1.3.3.2.3.2.1.1.4.1.1"><p id="mrs_01_24253__en-us_topic_0000001173470802_p4381144275411">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="49.86498649864986%" id="mcps1.3.3.2.3.2.1.1.4.1.2"><p id="mrs_01_24253__en-us_topic_0000001173470802_p1738117428546">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="25.82258225822582%" id="mcps1.3.3.2.3.2.1.1.4.1.3"><p id="mrs_01_24253__en-us_topic_0000001173470802_p17381842155414">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_24253__en-us_topic_0000001173470802_row888382112115"><td class="cellrowborder" valign="top" width="24.312431243124312%" headers="mcps1.3.3.2.3.2.1.1.4.1.1 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p11884102117115">Description</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.86498649864986%" headers="mcps1.3.3.2.3.2.1.1.4.1.2 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p17381194212547">Description of the data source.</p>
|
|
<p id="mrs_01_24253__en-us_topic_0000001173470802_p2045733013594">The value can contain only letters, digits, commas (,), periods (.), underscores (_), spaces, and line breaks.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.82258225822582%" headers="mcps1.3.3.2.3.2.1.1.4.1.3 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p888472112118">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24253__en-us_topic_0000001173470802_row8517340112217"><td class="cellrowborder" valign="top" width="24.312431243124312%" headers="mcps1.3.3.2.3.2.1.1.4.1.1 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p7531204215494">Enable Data Source Authentication</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.86498649864986%" headers="mcps1.3.3.2.3.2.1.1.4.1.2 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p87927161177">Whether to use the permission policy of the Hive data source for authentication.</p>
|
|
<p id="mrs_01_24253__en-us_topic_0000001173470802_p153113427498">If Ranger is disabled for the <span id="mrs_01_24253__en-us_topic_0000001173470802_text2013877463742">HetuEngine</span> service, select <strong id="mrs_01_24253__en-us_topic_0000001173470802_b1740858036742">Yes</strong>. If Ranger is enabled, select <strong id="mrs_01_24253__en-us_topic_0000001173470802_b405666544742">No</strong>.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.82258225822582%" headers="mcps1.3.3.2.3.2.1.1.4.1.3 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p1353114424498">No</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24253__en-us_topic_0000001173470802_row838294210547"><td class="cellrowborder" valign="top" width="24.312431243124312%" headers="mcps1.3.3.2.3.2.1.1.4.1.1 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p1438294211545">Metastore URL</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.86498649864986%" headers="mcps1.3.3.2.3.2.1.1.4.1.2 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p3685191015254">Value of <strong id="mrs_01_24253__en-us_topic_0000001173470802_b1858149151712">hive.metastore.uris</strong> in <strong id="mrs_01_24253__en-us_topic_0000001173470802_b635375371714">hive-site.xml</strong> on the data source client. When the Hive MetaStore instance changes, you need to manually update this value.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.82258225822582%" headers="mcps1.3.3.2.3.2.1.1.4.1.3 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p15136101452419">thrift://192.168.1.1:21088,thrift://192.168.1.2:21088</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24253__en-us_topic_0000001173470802_row620135915255"><td class="cellrowborder" valign="top" width="24.312431243124312%" headers="mcps1.3.3.2.3.2.1.1.4.1.1 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p175286509914">Enable Connection Pool</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.86498649864986%" headers="mcps1.3.3.2.3.2.1.1.4.1.2 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p052813501192">Whether to enable the connection pool when accessing Hive MetaStore. The default value is <strong id="mrs_01_24253__en-us_topic_0000001173470802_b1470091100742">Yes</strong></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.82258225822582%" headers="mcps1.3.3.2.3.2.1.1.4.1.3 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p1952817504916">Yes</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24253__en-us_topic_0000001173470802_row19827126102620"><td class="cellrowborder" valign="top" width="24.312431243124312%" headers="mcps1.3.3.2.3.2.1.1.4.1.1 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p5515554151213">Maximum Connections</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.86498649864986%" headers="mcps1.3.3.2.3.2.1.1.4.1.2 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p109571919102715">Maximum number of connections in the connection pool when accessing Hive MetaStore.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.82258225822582%" headers="mcps1.3.3.2.3.2.1.1.4.1.3 "><p id="mrs_01_24253__en-us_topic_0000001173470802_p1952817501896">50 (Value range: 0-200)</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</p></li><li id="mrs_01_24253__en-us_topic_0000001173470802_li466375174217"><span>(Optional) If you need to add <strong id="mrs_01_24253__en-us_topic_0000001173470802_b3978184312213">Custom Configuration</strong>, complete the configurations by referring to <a href="mrs_01_2348.html#mrs_01_2348__en-us_topic_0000001219351171_li1438274211549">6.g</a> and click <strong id="mrs_01_24253__en-us_topic_0000001173470802_b13991122414227">OK</strong> to save the configurations.</span></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_24174.html">Configuring a Hive Data Source</a></div>
|
|
</div>
|
|
</div>
|
|
|