vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide-lts/mrs_01_1741.html
Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

229 lines
24 KiB
HTML
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

<a name="mrs_01_1741"></a><a name="mrs_01_1741"></a>
<h1 class="topictitle1">Adjusting Cluster Node Resource Configurations</h1>
<div id="body32001227"><div class="section" id="mrs_01_1741__en-us_topic_0000001173789314_section101881817152314"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1741__en-us_topic_0000001173789314_p65582053115513">The default memory size and disk overflow path of <span id="mrs_01_1741__en-us_topic_0000001173789314_text155083494718">HetuEngine</span> are not the best. You need to adjust node resources in the cluster based on the actual service and server configuration of the cluster to achieve the optimal performance.</p>
</div>
<div class="section" id="mrs_01_1741__en-us_topic_0000001173789314_section324421105615"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1741__en-us_topic_0000001173789314_ol239803165619"><li id="mrs_01_1741__en-us_topic_0000001173789314_li939963105614"><span>Log in to FusionInsight Manager.</span></li><li id="mrs_01_1741__en-us_topic_0000001173789314_li97988457566"><span>Choose <strong id="mrs_01_1741__en-us_topic_0000001173789314_b912075171614">Cluster</strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b2017295481612">Services</strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b14728203525718"><span id="mrs_01_1741__en-us_topic_0000001173789314_text7730173513473">HetuEngine</span></strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b15354115814163">Configurations</strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b717311281720">All Configurations</strong> and adjust the cluster node resource parameters by referring to <a href="#mrs_01_1741__en-us_topic_0000001173789314_table134641948145817">Table 1</a>.</span><p>
<div class="tablenoborder"><a name="mrs_01_1741__en-us_topic_0000001173789314_table134641948145817"></a><a name="en-us_topic_0000001173789314_table134641948145817"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1741__en-us_topic_0000001173789314_table134641948145817" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters for configuring cluster node resources</caption><thead align="left"><tr id="mrs_01_1741__en-us_topic_0000001173789314_row144659487581"><th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.2.2.2.2.1.2.6.1.1"><p id="mrs_01_1741__en-us_topic_0000001173789314_p54659489585">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.2.2.2.2.1.2.6.1.2"><p id="mrs_01_1741__en-us_topic_0000001173789314_p154654486580">Default Value</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.2.2.2.2.1.2.6.1.3"><p id="mrs_01_1741__en-us_topic_0000001173789314_p104651848145810">Recommended Value</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.97%" id="mcps1.3.2.2.2.2.1.2.6.1.4"><p id="mrs_01_1741__en-us_topic_0000001173789314_p8465144811582">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.03%" id="mcps1.3.2.2.2.2.1.2.6.1.5"><p id="mrs_01_1741__en-us_topic_0000001173789314_p19465114810588">Parameter File</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1741__en-us_topic_0000001173789314_row194651248145810"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p14465948175811">yarn.hetuserver.engine.coordinator.memory</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1046574895818">5120</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p14465648155810">At least 2 GB less than that of <span class="parmname" id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_parmname14597719145120"><b>yarn.scheduler.maximum-allocation-mb</b></span></p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p17465164817580">Memory size used by a Coordinator node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p3465184817582">application.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row4465448145812"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1346504805812">yarn.hetuserver.engine.coordinator.number-of-containers</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1846584819585">2</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p8465204895813">2</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p44651448175819">Number of Coordinator nodes</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1746514818587">application.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row3465204875815"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p10465184811581">yarn.hetuserver.engine.coordinator.number-of-cpus</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p446534865818">1</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p10465104820589">At least two vCores less than <span class="parmname" id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_parmname1377413318519"><b>yarn.scheduler.maximum-allocation-vcores</b></span></p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p8465748115813">CPU vCores used by a Coordinator node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p17465104820583">application.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row16465204865815"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1446518480582">yarn.hetuserver.engine.worker.memory</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1746554810580">10240</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1046524819582">At least 2 GB less than that of <span class="parmname" id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_parmname178254175110"><b>yarn.scheduler.maximum-allocation-mb</b></span></p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p346524895815">Memory size used by a worker node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p18465134811589">application.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row9465194810589"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1646514895820">yarn.hetuserver.engine.worker.number-of-containers</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p18465104818585">2</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1846514487587">Adjusted based on application requirements</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1646584855817">Number of worker nodes</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_p5433427143513">application.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row246517484582"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1846524814582">yarn.hetuserver.engine.worker.number-of-cpus</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p646513487588">1</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1846584815819">At least two vCores less than <span class="parmname" id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_parmname91539955210"><b>yarn.scheduler.maximum-allocation-vcores</b></span></p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1046524815589">CPU vCores used by a Worker node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p18465748155811">application.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row1465154875820"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p746512489580"><strong id="mrs_01_1741__en-us_topic_0000001173789314_b1063555141918">Xmx</strong> size in the <strong id="mrs_01_1741__en-us_topic_0000001173789314_b11681555181915">extraJavaOptions</strong> parameter</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p74651148105811">8GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p44651548105810">Max (<em id="mrs_01_1741__en-us_topic_0000001173789314_i16605105831913">Memory size used by a Worker node</em> – 30 GB, <em id="mrs_01_1741__en-us_topic_0000001173789314_i2606858121913">Memory size used by a Worker node</em> x 0.7)</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p12465124885811">Maximum available memory of the worker JVM process</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_p18537133033613">worker.jvm.config</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row2046511488585"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p14465848135820">query.max-memory-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p646514483586">5GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p174658481586">Worker JVM x 0.7</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p54651648145818">Maximum available memory of a Query node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1646534817589">worker.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row346544855813"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p11465154817582">query.max-total-memory-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p54654486588">5GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p194661248145817">Worker JVM x 0.7</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p9466248135814">Maximum available memory of a Query + System node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p146612482588">worker.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row446624818589"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p346684825811">memory.heap-headroom-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p0466154885814">3 GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p15466248135811">Worker JVM x 0.3</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p2046614815812">Maximum available memory of a system heap node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p7466248105815">worker.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row204661148175812"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p20466148175817"><strong id="mrs_01_1741__en-us_topic_0000001173789314_b268821572118">Xmx</strong> size in the <strong id="mrs_01_1741__en-us_topic_0000001173789314_b1269371519215">extraJavaOptions</strong> parameter</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p204661248155816">4GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1246684817580">Max (<em id="mrs_01_1741__en-us_topic_0000001173789314_i9448132014216">Memory size used by a Coordinator node</em> – 30 GB, <em id="mrs_01_1741__en-us_topic_0000001173789314_i944913201215">Memory size used by a Coordinator node</em> x 0.7)</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p16466164815818">Maximum available memory of the Coordinator JVM process</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p144665486580">coordinator.jvm.config</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row184661487586"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p54661948185816">query.max-memory-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1346674845816">3GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1646618487585">Coordinator JVM x 0.7</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p046654815810">Maximum memory that can be used for node query</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p246654818583">coordinator.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row104663486587"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p746684895810">query.max-total-memory-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1846619485581">3GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p846684835816">Coordinator JVM x 0.7</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p84661748185810">Maximum available memory of a Query + System node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1146618482582">coordinator.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row146684855820"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p34662048155816">memory.heap-headroom-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p646654819588">1GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p446644855819">Coordinator JVM x 0.3</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p8466204895813">Maximum available memory of a system heap node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p5466174811586">coordinator.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row84661481585"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p13466104814588">query.max-memory</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p3466184855813">7GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p54669486587">Sum(query.max-memory-per-node) x 0.7</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1146614483587">Maximum available memory of a Query cluster</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p346634855818">worker.config.properties/coordinator.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row1146634816588"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p184661948165810">experimental.spiller-spill-path</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p346644885818">CONTAINER_ROOT_PATH/tmp/hetuserver/hetuserver-sqlengine/</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p16466164811588">One or more independent SSDs</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p12466848135810">Disk output file path</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p1466104855811">worker.config.properties/coordinator.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row1146644817588"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p74661748205814">experimental.max-spill-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p3466114895816">10 GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p13466134812585">Sum(Available space of each node) x 50%</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p114664484586">Available disk space for storing output files of all queries on a node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p046644820582">worker.config.properties/coordinator.config.properties</p>
</td>
</tr>
<tr id="mrs_01_1741__en-us_topic_0000001173789314_row20466184815811"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.1 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p8466174814588">experimental.query-max-spill-per-node</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.2 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p174661648115818">10 GB</p>
</td>
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.2.2.1.2.6.1.3 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p18466164813589">80% of the available disk space on a node</p>
</td>
<td class="cellrowborder" valign="top" width="19.97%" headers="mcps1.3.2.2.2.2.1.2.6.1.4 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p64666481589">Available disk space for storing output files of a query on a node</p>
</td>
<td class="cellrowborder" valign="top" width="20.03%" headers="mcps1.3.2.2.2.2.1.2.6.1.5 "><p id="mrs_01_1741__en-us_topic_0000001173789314_p04661648195817">worker.config.properties/coordinator.config.properties</p>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="mrs_01_1741__en-us_topic_0000001173789314_li876623218577"><span>Click <span class="uicontrol" id="mrs_01_1741__en-us_topic_0000001173789314_en-us_topic_0254454631_uicontrol15312340979"><b>Save</b></span>.</span></li><li id="mrs_01_1741__en-us_topic_0000001173789314_li32631118112"><span>Choose <strong id="mrs_01_1741__en-us_topic_0000001173789314_b1883084262213">Cluster</strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b325124520221">Services</strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b4742168491"><span id="mrs_01_1741__en-us_topic_0000001173789314_text2827175113478">HetuEngine</span></strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b847817487224">More</strong> &gt; <strong id="mrs_01_1741__en-us_topic_0000001173789314_b09221850202218">Restart Service</strong> to restart the <span id="mrs_01_1741__en-us_topic_0000001173789314_text646995374712">HetuEngine</span> service for the parameters to take effect.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1745.html">HetuEngine Performance Tuning</a></div>
</div>
</div>
View Git Blame Copy Permalink