forked from docs/doc-exports
Lu, Huayi
e6fa411af0
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Lu, Huayi <luhuayi@huawei.com> Co-committed-by: Lu, Huayi <luhuayi@huawei.com>
34 lines
7.9 KiB
HTML
34 lines
7.9 KiB
HTML
<a name="EN-US_TOPIC_0000001188642160"></a><a name="EN-US_TOPIC_0000001188642160"></a>
|
|
|
|
<h1 class="topictitle1">Parallel Data Import</h1>
|
|
<div id="body8662426"><p id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_p43933257214"><span id="EN-US_TOPIC_0000001188642160__text521906563">GaussDB(DWS)</span> provides a parallel data import function that enables a large amount of data to be imported in a fast and efficient manner. This section describes parameters for importing data in parallel in <span id="EN-US_TOPIC_0000001188642160__text915019498">GaussDB(DWS)</span>.</p>
|
|
<div class="section" id="EN-US_TOPIC_0000001188642160__sd65ae1e8226f4611819e91ce8b6a35fb"><a name="EN-US_TOPIC_0000001188642160__sd65ae1e8226f4611819e91ce8b6a35fb"></a><a name="sd65ae1e8226f4611819e91ce8b6a35fb"></a><h4 class="sectiontitle">raise_errors_if_no_files</h4><p id="EN-US_TOPIC_0000001188642160__a0e7fcd9485f441ccb5a441b0d15086e7"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0085031717_en-us_topic_0059778176_en-us_topic_0058967645_b842352706141458_1">Parameter description</strong>: Specifies whether distinguish between the problems "the number of imported file records is empty" and "the imported file does not exist". If this parameter is set to <strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0085031717_b1890635111174818">true</strong> and the problem "the imported file does not exist" occurs, <span id="EN-US_TOPIC_0000001188642160__text1637145474">GaussDB(DWS)</span> will report the error message "file does not exist".</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__p19440346153516"><strong id="EN-US_TOPIC_0000001188642160__b13724172212119">Type</strong>: SUSET</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__aea5307db2fae47b19209f60faedb4ced"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_ad85dacdea1944c4497ff2efa2feec6fd">Value range</strong>: Boolean</p>
|
|
<ul id="EN-US_TOPIC_0000001188642160__ue4e6935b8e2448ec8effda351a630e5f"><li id="EN-US_TOPIC_0000001188642160__l86cb570ea3e6448395b0afccbdc293af"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b842352706141458_3">on</strong> indicates the messages of "the number of imported file records is empty" and "the imported file does not exist" are distinguished when files are imported.</li><li id="EN-US_TOPIC_0000001188642160__l06f96e2f02c9488f8ac9a3d95c3d7f68"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b842352706141458_5">off</strong> indicates the messages of "the number of imported file records is empty" and "the imported file does not exist" are not distinguished when files are imported.</li></ul>
|
|
<p id="EN-US_TOPIC_0000001188642160__a48325d2d88dc49bcbf6dc365aa936fdc"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b2827021">Default value</strong>: <strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b842352706113251">off</strong></p>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001188642160__s9d2ce4e6e9ea4f6a8a8df3e3a7ddadd8"><a name="EN-US_TOPIC_0000001188642160__s9d2ce4e6e9ea4f6a8a8df3e3a7ddadd8"></a><a name="s9d2ce4e6e9ea4f6a8a8df3e3a7ddadd8"></a><h4 class="sectiontitle">partition_mem_batch</h4><p id="EN-US_TOPIC_0000001188642160__a0a89b0dc20d54097807ec099f52b3cb9"><strong id="EN-US_TOPIC_0000001188642160__b106151928181813">Parameter description</strong>: To optimize the inserting of column-store partitioned tables in batches, data is cached during the inserting process and then written to the disk in batches. You can use <strong id="EN-US_TOPIC_0000001188642160__b5403163681817">partition_mem_batch</strong> to specify the number of buffers. If the value is too large, much memory will be consumed. If it is too small, the performance of inserting column-store partitioned tables in batches will deteriorate.</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__p18215142243619"><strong id="EN-US_TOPIC_0000001188642160__b0730122318219">Type</strong>: USERSET</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__a71d747ffa7ef43719ac9d36308cbc778"><strong id="EN-US_TOPIC_0000001188642160__b84235270612620">Value range</strong>: 1 to 65535</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__a571471fb5f344ec6bb5cc658848b65f8"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_a31255a9b28764f4998a4562fb745362f">Default value</strong>: <strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b84235270619416">256</strong></p>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001188642160__s004b2931955e4e549caeb98b2f2723af"><a name="EN-US_TOPIC_0000001188642160__s004b2931955e4e549caeb98b2f2723af"></a><a name="s004b2931955e4e549caeb98b2f2723af"></a><h4 class="sectiontitle">partition_max_cache_size</h4><p id="EN-US_TOPIC_0000001188642160__a89abd5b284a842828cd87eea5bc48ff0"><strong id="EN-US_TOPIC_0000001188642160__b9717944105610">Parameter description</strong>: To optimize the inserting of column-store partitioned tables in batches, data is cached during the inserting process and then written to the disk in batches. You can use <strong id="EN-US_TOPIC_0000001188642160__b870671513192">partition_max_cache_size</strong> to specify the size of the data buffer. If the value is too large, much memory will be consumed. If it is too small, the performance of inserting column-store partitioned tables in batches will deteriorate.</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__p1975429153716"><strong id="EN-US_TOPIC_0000001188642160__b321724142115">Type</strong>: USERSET</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__aff7b568c685d43a4b0d3b783e72ef526"><strong id="EN-US_TOPIC_0000001188642160__b3791111320572">Value range</strong>: 4096 to INT_MAX/2. The minimum unit is KB.</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__a0b351a451966436aa05adbc30342bd0f"><strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b573446154754">Default value</strong>: <strong id="EN-US_TOPIC_0000001188642160__en-us_topic_0059778176_en-us_topic_0058967645_b842352706194213">2 GB</strong></p>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001188642160__section443558135218"><h4 class="sectiontitle">gds_debug_mod</h4><p id="EN-US_TOPIC_0000001188642160__p84364819529"><strong id="EN-US_TOPIC_0000001188642160__b842352706121742">Parameter description</strong>: Specifies whether to enable the debug function of Gauss Data Service (GDS). This parameter is used to better locate and analyze GDS faults. After the debug function is enabled, types of packets received or sent by GDS, peer end of GDS during command interaction, and other interaction information about GDS are written into the logs of corresponding nodes. In this way, state switching on the GaussDB state machine and the current state are recorded. If this function is enabled, additional log I/O resources will be consumed, affecting log performance and validity. You are advised to enable this function only when locating GDS faults.</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__p109551819123711"><strong id="EN-US_TOPIC_0000001188642160__b114762240213">Type</strong>: USERSET</p>
|
|
<p id="EN-US_TOPIC_0000001188642160__p9437208155216"><strong id="EN-US_TOPIC_0000001188642160__b881116225910">Value range</strong>: Boolean</p>
|
|
<ul id="EN-US_TOPIC_0000001188642160__udd21f55ee1dc4f7fb357257d0d644323"><li id="EN-US_TOPIC_0000001188642160__l61c5e182b637411a98cb21bf5d5b5dab"><strong id="EN-US_TOPIC_0000001188642160__b51302555234322">on</strong> indicates that the GDS debug function is enabled.</li><li id="EN-US_TOPIC_0000001188642160__l0beb62455e6c4ece864702ddc4fe3300"><strong id="EN-US_TOPIC_0000001188642160__b198664191534322">off</strong> indicates that the GDS debug function is disabled.</li></ul>
|
|
<p id="EN-US_TOPIC_0000001188642160__p174394885212"><strong id="EN-US_TOPIC_0000001188642160__b1512505822">Default value</strong>: <strong id="EN-US_TOPIC_0000001188642160__b272619401">off</strong></p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_04_0883.html">GUC Parameters</a></div>
|
|
</div>
|
|
</div>
|
|
|