forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
17 lines
1.7 KiB
HTML
17 lines
1.7 KiB
HTML
<a name="mrs_01_24051"></a><a name="mrs_01_24051"></a>
|
|
|
|
<h1 class="topictitle1">Why Do Reduce Tasks Fail to Run in Some OSs After the Native Task Feature is Enabled?</h1>
|
|
<div id="body0000001137918979"><div class="section" id="mrs_01_24051__se3728c8fc4dc45509719164ffde19fbb"><h4 class="sectiontitle">Question</h4><p id="mrs_01_24051__a7d268a1ef60e421b81931cf2b1b6bb85">After the Native Task feature is enabled, Reduce tasks fail to run in some OSs.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_24051__section17158192110177"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_24051__a9791cab599fb4343aad1e5aec346bfd3">When <strong id="mrs_01_24051__b76182044144810">-Dmapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator</strong> is executed to enable the Native Task feature during the running of MapReduce tasks that contain Reduce tasks, the tasks fail to run in some OSs, and the error message "version 'GLIBCXX_3.4.20' not found" is displayed in logs. The cause is that the GLIBCXX version of the OSs is too early. As a result, the libnativetask.so.1.0.0 library on which the feature depends cannot be loaded, leading to task failures.</p>
|
|
<p id="mrs_01_24051__aa5d2cde0ff9644a6a2f74de56527aff3">Workaround:</p>
|
|
<p id="mrs_01_24051__a122a2b5fb9e940a89b3dd9d5eb9ef722">Set <strong id="mrs_01_24051__b1651411194536">mapreduce.job.map.output.collector.class</strong> to <strong id="mrs_01_24051__b19470524145315">org.apache.hadoop.mapred.MapTask$MapOutputBuffer</strong>.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2077.html">Common Issues About Yarn</a></div>
|
|
</div>
|
|
</div>
|
|
|