forked from docs/doc-exports
Yang, Tong
48706b7552
Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
18 lines
2.0 KiB
HTML
18 lines
2.0 KiB
HTML
<a name="mrs_01_24496"></a><a name="mrs_01_24496"></a>
|
|
|
|
<h1 class="topictitle1">Enabling Schema Evolution</h1>
|
|
<div id="body0000001534674978"><div class="caution" id="mrs_01_24496__note1285617286115"><span class="cautiontitle"><img src="public_sys-resources/caution_3.0-en-us.png"> </span><div class="cautionbody"><p id="mrs_01_24496__p2285232121110">Schema evolution cannot be disabled once being enabled.</p>
|
|
</div></div>
|
|
<ul id="mrs_01_24496__ul10821103383318"><li id="mrs_01_24496__li0821233153317">To use spark-beeline, log in to FusionInsight Manager, choose <strong id="mrs_01_24496__b1318111575379">Cluster</strong> > <strong id="mrs_01_24496__b13307442385">Services</strong> > <strong id="mrs_01_24496__b5830177203818">Spark2x</strong>, and click the <strong id="mrs_01_24496__b1716391418381">Configurations</strong> tab then the <strong id="mrs_01_24496__b1423415415382">All Configurations</strong> sub-tab.<p id="mrs_01_24496__p1107122414406">Search for <strong id="mrs_01_24496__b840017485364">spark.sql.extensions</strong> in the search box and change its value of JDBCServer to <strong id="mrs_01_24496__b94031948143613">org.apache.spark.sql.hive.FISparkSessionExtension,org.apache.spark.sql.hudi.HoodieSparkSessionExtension,org.apache.spark.sql.hive.CarbonInternalExtensions</strong>.</p>
|
|
</li></ul>
|
|
<ul id="mrs_01_24496__ul1324131512223"><li id="mrs_01_24496__li139251911226">For SQL operations, run the following command before running any SQL statements:<pre class="screen" id="mrs_01_24496__screen443464918219">set hoodie.schema.evolution.enable=true</pre>
|
|
</li><li id="mrs_01_24496__li1890392218223">For API calls, specify the following parameter in DataFrame options:<pre class="screen" id="mrs_01_24496__screen1375945910219">hoodie.schema.evolution.enable -> true</pre>
|
|
</li></ul>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_24495.html">SparkSQL Schema Evolution and Syntax Description</a></div>
|
|
</div>
|
|
</div>
|
|
|