forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
65 lines
8.2 KiB
HTML
65 lines
8.2 KiB
HTML
<a name="mrs_01_1746"></a><a name="mrs_01_1746"></a>
|
|
|
|
<h1 class="topictitle1">Adjusting Metadata Cache</h1>
|
|
<div id="body32001227"><div class="section" id="mrs_01_1746__en-us_topic_0000001173630766_section56435962313"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1746__en-us_topic_0000001173630766_p4596165111911">When <span id="mrs_01_1746__en-us_topic_0000001173630766_text155083494718">HetuEngine</span> accesses the Hive data source, it needs to access the Hive metastore to obtain the metadata information. <span id="mrs_01_1746__en-us_topic_0000001173630766_text106621021661">HetuEngine</span> provides the metadata cache function. When the database or table of the Hive data source is accessed for the first time, the metadata information (database name, table name, table field, partition information, and permission information) of the database or table is cached, the Hive metastore does not need to be accessed again during subsequent access. If the table data of the Hive data source does not change frequently, the query performance can be improved to some extent.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1746__en-us_topic_0000001173630766_section593032182013"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1746__en-us_topic_0000001173630766_ol92014168201"><li id="mrs_01_1746__en-us_topic_0000001173630766_li2020141613204"><span>Log in to FusionInsight Manager.</span></li><li id="mrs_01_1746__en-us_topic_0000001173630766_li8231162820207"><span>Choose <strong id="mrs_01_1746__en-us_topic_0000001173630766_b029118502210">Cluster</strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b7297185019211">Services</strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b1025675810252"><span id="mrs_01_1746__en-us_topic_0000001173630766_text189298424410">HetuEngine</span></strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b92971050122119">Configurations</strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b229725022116">All Configurations</strong> and adjust the metadata cache parameters by referring to <a href="#mrs_01_1746__en-us_topic_0000001173630766_table1201657173018">Table 1</a>.</span><p>
|
|
<div class="tablenoborder"><a name="mrs_01_1746__en-us_topic_0000001173630766_table1201657173018"></a><a name="en-us_topic_0000001173630766_table1201657173018"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1746__en-us_topic_0000001173630766_table1201657173018" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Metadata cache parameters</caption><thead align="left"><tr id="mrs_01_1746__en-us_topic_0000001173630766_row720113576306"><th align="left" class="cellrowborder" valign="top" width="30.826917308269174%" id="mcps1.3.2.2.2.2.1.2.5.1.1"><p id="mrs_01_1746__en-us_topic_0000001173630766_p122011257143017">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="30.826917308269174%" id="mcps1.3.2.2.2.2.1.2.5.1.2"><p id="mrs_01_1746__en-us_topic_0000001173630766_p320145723015">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="14.208579142085792%" id="mcps1.3.2.2.2.2.1.2.5.1.3"><p id="mrs_01_1746__en-us_topic_0000001173630766_p11201195712309">Default Value</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="24.137586241375864%" id="mcps1.3.2.2.2.2.1.2.5.1.4"><p id="mrs_01_1746__en-us_topic_0000001173630766_p43451923917">Parameter File</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1746__en-us_topic_0000001173630766_row1420113573309"><td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.1 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p132011257143010">hive.metastore-cache-ttl</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.2 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p220165715306">Cache duration of the metadata of the co-deployed Hive data source.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.208579142085792%" headers="mcps1.3.2.2.2.2.1.2.5.1.3 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p19201857163020">0s</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.137586241375864%" headers="mcps1.3.2.2.2.2.1.2.5.1.4 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p534518235110">hive.properties</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1746__en-us_topic_0000001173630766_row172015576307"><td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.1 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p10201155773016">hive.metastore-cache-maximum-size</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.2 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p620113573303">Maximum cache size of the metadata of the co-deployed Hive data source.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.208579142085792%" headers="mcps1.3.2.2.2.2.1.2.5.1.3 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p2020115713015">10000</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.137586241375864%" headers="mcps1.3.2.2.2.2.1.2.5.1.4 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p834517231115">hive.properties</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1746__en-us_topic_0000001173630766_row42011857163013"><td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.1 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p152011457183017">hive.metastore-refresh-interval</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.2 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p1020105716305">Interval for refreshing the metadata of the co-deployed Hive data source. </p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.208579142085792%" headers="mcps1.3.2.2.2.2.1.2.5.1.3 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p1201185716303">1s</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.137586241375864%" headers="mcps1.3.2.2.2.2.1.2.5.1.4 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p203455232112">hive.properties</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1746__en-us_topic_0000001173630766_row1720185703013"><td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.1 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p14201125710301">hive.per-transaction-metastore-cache-maximum-size</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="30.826917308269174%" headers="mcps1.3.2.2.2.2.1.2.5.1.2 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p102011557153018">Maximum cache size of the metadata for each transaction of the co-deployed Hive data source.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.208579142085792%" headers="mcps1.3.2.2.2.2.1.2.5.1.3 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p820118574302">1000</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="24.137586241375864%" headers="mcps1.3.2.2.2.2.1.2.5.1.4 "><p id="mrs_01_1746__en-us_topic_0000001173630766_p33451923110">hive.properties</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</p></li><li id="mrs_01_1746__en-us_topic_0000001173630766_li6919115618269"><span>Click <span class="uicontrol" id="mrs_01_1746__en-us_topic_0000001173630766_en-us_topic_0254454631_uicontrol15312340979"><b>Save</b></span>.</span></li><li id="mrs_01_1746__en-us_topic_0000001173630766_li186511130292"><span>Choose <strong id="mrs_01_1746__en-us_topic_0000001173630766_b183485613508">Cluster</strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b4354166135015">Services</strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b1635512645020"><span id="mrs_01_1746__en-us_topic_0000001173630766_text1135519613508">HetuEngine</span></strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b1335510620503">More</strong> > <strong id="mrs_01_1746__en-us_topic_0000001173630766_b335614610507">Restart Service</strong> to restart the <span id="mrs_01_1746__en-us_topic_0000001173630766_text83560619501">HetuEngine</span> service for the parameters to take effect.</span></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1745.html">HetuEngine Performance Tuning</a></div>
|
|
</div>
|
|
</div>
|
|
|