forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
19 lines
2.0 KiB
HTML
19 lines
2.0 KiB
HTML
<a name="mrs_01_1789"></a><a name="mrs_01_1789"></a>
|
|
|
|
<h1 class="topictitle1">Why Does It Take a Long Time to Run a Task Upon ResourceManager Active/Standby Switchover?</h1>
|
|
<div id="body1596092470012"><div class="section" id="mrs_01_1789__s1748b8be74c341b9ae23c5f8f1a54549"><h4 class="sectiontitle">Question</h4><p id="mrs_01_1789__acd7d6f7675fc4cb9aecb9c89e464cfc5">MapReduce job takes a very long time (more than 10minutes) when the ResourceManager switch while the job is running.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1789__s503bf8c2415f43c486b0f7e5bf700db2"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_1789__a0cb3305dc87442dfa6aeeadcf9050508">This is because, ResorceManager HA is enabled but the ResourceManager work preserving restart is not enabled.</p>
|
|
</div>
|
|
<p id="mrs_01_1789__a291474275aa94e09ab0d9061770564b6">If ResorceManager work preserving restart is not enabled, then ResorceManager switch containers are killed which causes the ResorceManager to timeout the ApplicationMaster. For ResorceManager work preserving restart feature details, see <a href="http://hadoop.apache.org/docs/r3.1.1/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html" target="_blank" rel="noopener noreferrer">http://hadoop.apache.org/docs/r3.1.1/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html</a>.</p>
|
|
<p id="mrs_01_1789__a14c268b946e44672ba1727bd2e640700">The following method can be used to solve the issue:</p>
|
|
<p id="mrs_01_1789__a44fb020139cd405e99c907e813ff4f46">Enable the ResorceManager work preserving restart feature by configuring the following parameter.</p>
|
|
<p id="mrs_01_1789__a4af94c173ad145549c68964e6eaadbec"><span class="parmname" id="mrs_01_1789__p76b0c35e05c04ad6b35b36e18b9eb832"><b>yarn.resourcemanager.work-preserving-recovery.enabled</b></span>=<span class="parmvalue" id="mrs_01_1789__p2f5e9a83318b45919729765f5bf0c09d"><b>true</b></span></p>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1788.html">Common Issues About MapReduce</a></div>
|
|
</div>
|
|
</div>
|
|
|