forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
38 lines
4.0 KiB
HTML
38 lines
4.0 KiB
HTML
<a name="mrs_01_1966"></a><a name="mrs_01_1966"></a>
|
|
|
|
<h1 class="topictitle1">Hive Dynamic Partition Overwriting Syntax</h1>
|
|
<div id="body1595920207457"><div class="section" id="mrs_01_1966__section10411113113617"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1966__p78497146301">In earlier versions, when the <strong id="mrs_01_1966__b1953144922616">insert overwrite</strong> syntax is used to overwrite partition tables, only partitions with specified expressions are matched, and partitions without specified expressions are deleted. In Spark2.3, partitions without specified expressions are automatically matched. The syntax is the same as that of the dynamic partition matching syntax of Hive.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1966__section10192121173713"><h4 class="sectiontitle">Parameters</h4><p id="mrs_01_1966__p18420142117236">Log in to FusionInsight Manager, choose <span id="mrs_01_1966__text98370805315823"><strong id="mrs_01_1966__b188750575715823">Cluster</strong> > <em id="mrs_01_1966__i28886296815823">Name of the desired cluster</em></span> > <strong id="mrs_01_1966__b202350382615823">Services</strong> > <strong id="mrs_01_1966__b139418414115823">Spark2x</strong> > <strong id="mrs_01_1966__b73050395815823">Configurations</strong>, click <strong id="mrs_01_1966__b12624612515823">All Configurations</strong>, and search for the following parameter.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1966__t18af5fbd3aeb4bda8d13de81ed31f812" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_1966__r74395b638f4442e3aab246ff89b4f414"><th align="left" class="cellrowborder" valign="top" width="25.25%" id="mcps1.3.2.3.1.5.1.1"><p id="mrs_01_1966__a1f516e63d9e642069c06eb1b4f809563"><strong id="mrs_01_1966__a744ab93a07754850a5f6c727a33e62e1">Parameter</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="39.04%" id="mcps1.3.2.3.1.5.1.2"><p id="mrs_01_1966__af9566f38e89e419f83b61605b532f7ad"><strong id="mrs_01_1966__a6645dddca1604ff3a7c65c302142e2da">Description</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="14.469999999999999%" id="mcps1.3.2.3.1.5.1.3"><p id="mrs_01_1966__ac817ca09e627493cb99f5b57d2943bd6"><strong id="mrs_01_1966__adff60dc7bdc24a8aaa6c1b5c6630331e">Default Value</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="21.240000000000002%" id="mcps1.3.2.3.1.5.1.4"><p id="mrs_01_1966__p194216554016"><strong id="mrs_01_1966__b1634985784715">Value Range</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1966__rd52556c4569841b3a5e5a2ebdfcb3b56"><td class="cellrowborder" valign="top" width="25.25%" headers="mcps1.3.2.3.1.5.1.1 "><p id="mrs_01_1966__p182591534143017">spark.sql.sources.partitionOverwriteMode</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.04%" headers="mcps1.3.2.3.1.5.1.2 "><p id="mrs_01_1966__p932104920304">Specifies the mode for inserting data in partition tables by running the <strong id="mrs_01_1966__b111923492715823">insert overwrite</strong> command, which can be <strong id="mrs_01_1966__b4738059815823">STATIC</strong> or <strong id="mrs_01_1966__b196917240215823">DYNAMIC</strong>. When it is set to <strong id="mrs_01_1966__b17806255102614">STATIC</strong>, Spark deletes all partitions based on the matching conditions. When it is set to <strong id="mrs_01_1966__b149746465415823">DYNAMIC</strong>, Spark matches partitions based on matching conditions and dynamically matches partitions without specified conditions.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.469999999999999%" headers="mcps1.3.2.3.1.5.1.3 "><p id="mrs_01_1966__p1512655833011">STATIC</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.240000000000002%" headers="mcps1.3.2.3.1.5.1.4 "><p id="mrs_01_1966__p183701959143911">[STATIC,DYNAMIC]</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1941.html">Scenario-Specific Configuration</a></div>
|
|
</div>
|
|
</div>
|
|
|