forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
38 lines
3.5 KiB
HTML
38 lines
3.5 KiB
HTML
<a name="mrs_01_1965"></a><a name="mrs_01_1965"></a>
|
|
|
|
<h1 class="topictitle1">Broaden Support for Hive Partition Pruning Predicate Pushdown</h1>
|
|
<div id="body1595920207455"><div class="section" id="mrs_01_1965__section10411113113617"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1965__p18750184218255">In earlier versions, the predicate for pruning Hive table partitions is pushed down. Only comparison expressions between column names and integers or character strings can be pushed down. In version 2.3, pushdown of the null, in, and, or expressions are supported.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1965__section10192121173713"><h4 class="sectiontitle">Parameters</h4><p id="mrs_01_1965__p18420142117236">Log in to FusionInsight Manager and choose <span id="mrs_01_1965__text177911258585"><strong id="mrs_01_1965__b9790145145819">Cluster</strong> > <em id="mrs_01_1965__i187915511580">Name of the desired cluster</em></span> > <strong id="mrs_01_1965__b127918545813">Services</strong> > <strong id="mrs_01_1965__b14792165115815">Spark2x</strong>. On the page that is displayed, click the <strong id="mrs_01_1965__b47922575815">Configurations</strong> tab then the <strong id="mrs_01_1965__b379212595815">All Configurations</strong> sub-tab, and search for the following parameters:</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1965__t18af5fbd3aeb4bda8d13de81ed31f812" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_1965__r74395b638f4442e3aab246ff89b4f414"><th align="left" class="cellrowborder" valign="top" width="25.25%" id="mcps1.3.2.3.1.5.1.1"><p id="mrs_01_1965__a1f516e63d9e642069c06eb1b4f809563"><strong id="mrs_01_1965__a744ab93a07754850a5f6c727a33e62e1">Parameter</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="39.04%" id="mcps1.3.2.3.1.5.1.2"><p id="mrs_01_1965__af9566f38e89e419f83b61605b532f7ad"><strong id="mrs_01_1965__a6645dddca1604ff3a7c65c302142e2da">Description</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="14.469999999999999%" id="mcps1.3.2.3.1.5.1.3"><p id="mrs_01_1965__ac817ca09e627493cb99f5b57d2943bd6"><strong id="mrs_01_1965__adff60dc7bdc24a8aaa6c1b5c6630331e">Default Value</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="21.240000000000002%" id="mcps1.3.2.3.1.5.1.4"><p id="mrs_01_1965__p194216554016"><strong id="mrs_01_1965__b165391436015">Value Range</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1965__rd52556c4569841b3a5e5a2ebdfcb3b56"><td class="cellrowborder" valign="top" width="25.25%" headers="mcps1.3.2.3.1.5.1.1 "><p id="mrs_01_1965__a8730576580684096ade68e478ed89676">spark.sql.hive.advancedPartitionPredicatePushdown.enabled</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.04%" headers="mcps1.3.2.3.1.5.1.2 "><p id="mrs_01_1965__p1950716810280">Specifies whether to broaden the support for Hive partition pruning predicate pushdown.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.469999999999999%" headers="mcps1.3.2.3.1.5.1.3 "><p id="mrs_01_1965__a127d9457c2354fe4a7bec8540121af54">true</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.240000000000002%" headers="mcps1.3.2.3.1.5.1.4 "><p id="mrs_01_1965__p183701959143911">[true,false]</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1941.html">Scenario-Specific Configuration</a></div>
|
|
</div>
|
|
</div>
|
|
|