forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
15 lines
1.3 KiB
HTML
15 lines
1.3 KiB
HTML
<a name="mrs_01_1463"></a><a name="mrs_01_1463"></a>
|
|
|
|
<h1 class="topictitle1">Why Data Load Performance Decreases due to Bad Records?</h1>
|
|
<div id="body1595920215967"><div class="section" id="mrs_01_1463__s4ee1003fe14242d6b3e3cd6e85a5ffb4"><h4 class="sectiontitle">Question</h4><p id="mrs_01_1463__a38fa84bfd7ca4f31863b47db1b9792d3">Why data load performance decreases due to bad records?</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1463__se41e2f11086e4fdea2360e677c817362"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_1463__afd5e3b76d1c944aa96ea024b160cb9c9">If bad records are present in the data and <span class="parmname" id="mrs_01_1463__p15aa266a0aa34575adc87ffc91f2f702"><b>BAD_RECORDS_LOGGER_ENABLE</b></span> is <span class="parmvalue" id="mrs_01_1463__pbe14d4de73e3419d9522dd0beca8da19"><b>true</b></span> or <span class="parmname" id="mrs_01_1463__p7793a68499ff4289b61ae8e2a0ece9d8"><b>BAD_RECORDS_ACTION</b></span> is <span class="parmvalue" id="mrs_01_1463__pda4ea9e52c32493f8e719387bed0321d"><b>redirect</b></span> then load performance will decrease due to extra I/O for writing failure reason in log file or redirecting the records to raw CSV.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1457.html">CarbonData FAQ</a></div>
|
|
</div>
|
|
</div>
|
|
|