forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
35 lines
3.4 KiB
HTML
35 lines
3.4 KiB
HTML
<a name="mrs_01_0849"></a><a name="mrs_01_0849"></a>
|
|
|
|
<h1 class="topictitle1">Using Slow Start</h1>
|
|
<div id="body1590130630215"><div class="section" id="mrs_01_0849__se862d6d5b3ed406e97eac23949a38975"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_0849__a85e965232e9d44c096f7baff795c2a83">The Slow Start feature specifies the proportion of Map tasks to be completed before Reduce tasks are started. If the Reduce tasks are started too early, resources will be occupied, thereby reducing task running efficiency. However, if the Reduce tasks are started at an appropriate time, resource usage during shuffle and task running efficiency will be improved. For example, the MapReduce job includes 15 Map tasks and a cluster can start 10 Map tasks, there are 5 Map tasks remained after a round of Map tasks is completed and the cluster has available resources. In this case, you can configure the value of Slow Start to a value less than 1 (for example, 0.8), then the Reduce tasks can make use of the remaining cluster resources.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_0849__sa4452b10affd4e94b0926d242306273b"><h4 class="sectiontitle">Procedure</h4><p id="mrs_01_0849__a6a6b3cdcd8284af3b62e10546f25ab59">Parameter portal:</p>
|
|
<p id="mrs_01_0849__p139709455225">On the <strong id="mrs_01_0849__b11625195110409">All Configurations</strong> page of the MapReduce service, enter a parameter name in the search box. For details, see <a href="mrs_01_2125.html">Modifying Cluster Service Configuration Parameters</a>.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0849__t6c7f7cbf6b714d58baeaed2315522426" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_0849__r365f37f865454493b36f05addedb9892"><th align="left" class="cellrowborder" valign="top" width="32.45675432456754%" id="mcps1.3.2.4.1.4.1.1"><p id="mrs_01_0849__a317be48688fe446e8c58eab936cfa2b2"><strong id="mrs_01_0849__b2525178152216">Parameter</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="46.865313468653135%" id="mcps1.3.2.4.1.4.1.2"><p id="mrs_01_0849__ab86fe9361f634597b3c3800d26379377"><strong id="mrs_01_0849__b15370129142215">Description</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="20.677932206779325%" id="mcps1.3.2.4.1.4.1.3"><p id="mrs_01_0849__ad374b20e573c4691b6206427d1f806ae"><strong id="mrs_01_0849__b17135151082216">Default Value</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_0849__r1b2b0a94e91743aba29a8631414f6304"><td class="cellrowborder" valign="top" width="32.45675432456754%" headers="mcps1.3.2.4.1.4.1.1 "><p id="mrs_01_0849__a5c269ea11dcb42aaa43faa760eec0830">mapreduce.job.reduce.slowstart.completedmaps</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.865313468653135%" headers="mcps1.3.2.4.1.4.1.2 "><p id="mrs_01_0849__a990e2993ebde4232a8a20eb7c4be8410">Fraction of the number of Maps in the job which should be completed before Reduces are scheduled for the job. By default, the Reduce tasks start when all the Map tasks are completed.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20.677932206779325%" headers="mcps1.3.2.4.1.4.1.3 "><p id="mrs_01_0849__a1a19decc7413443e95e43a7f028dfddf">1.0</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0843.html">MapReduce Performance Tuning</a></div>
|
|
</div>
|
|
</div>
|
|
|