forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
15 lines
1.1 KiB
HTML
15 lines
1.1 KiB
HTML
<a name="mrs_01_1466"></a><a name="mrs_01_1466"></a>
|
|
|
|
<h1 class="topictitle1">Why Data loading Fails During off heap?</h1>
|
|
<div id="body1595920215970"><div class="section" id="mrs_01_1466__s5ee2a6d0593d4780a228481c19eb39dd"><h4 class="sectiontitle">Question</h4><p id="mrs_01_1466__a32c47d7b4dc04c878143ae72c5b3d9fd">Why Data Loading fails during off heap?</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1466__saa91ccb63ce24b46bb62bafbb02c219b"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_1466__aaa16586cc845430c873932f2c4102c20">YARN Resource Manager will consider (Java heap memory + <span class="parmname" id="mrs_01_1466__p018770ee3a244f1fb9a09ad7c00e95eb"><b>spark.yarn.am.memoryOverhead</b></span>) as memory limit, so during the off heap, the memory can exceed this limit. So you need to increase the memory by increasing the value of the parameter <span class="parmname" id="mrs_01_1466__p79da4cc4f6af4185b7898f6d520cdd8b"><b>spark.yarn.am.memoryOverhead</b></span>.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1457.html">CarbonData FAQ</a></div>
|
|
</div>
|
|
</div>
|
|
|