Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

60 lines
7.4 KiB
HTML

<a name="mrs_01_24256"></a><a name="mrs_01_24256"></a>
<h1 class="topictitle1">Deleting Residual Information About Flink Tasks</h1>
<div id="body32001227"><div class="section" id="mrs_01_24256__en-us_topic_0000001219029127_section76481868579"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_24256__en-us_topic_0000001219029127_p8060118">If a Flink task stops unexpectedly, some directories may reside in the ZooKeeper and HDFS services. To delete the residual directories, set <strong id="mrs_01_24256__en-us_topic_0000001219029127_b520801312017">ClearUpEnabled</strong> to <strong id="mrs_01_24256__en-us_topic_0000001219029127_b3418101692012">true</strong>.</p>
</div>
<div class="section" id="mrs_01_24256__en-us_topic_0000001219029127_section0906123113711"><h4 class="sectiontitle">Prerequisites</h4><p id="mrs_01_24256__en-us_topic_0000001219029127_p84391185373">A FlinkServer instance has been installed in a cluster and is running properly.</p>
</div>
<div class="section" id="mrs_01_24256__en-us_topic_0000001219029127_section762053013573"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_24256__en-us_topic_0000001219029127_ol1833245596"><li id="mrs_01_24256__en-us_topic_0000001219029127_li1176652129"><span>Log in to Manager.</span></li><li id="mrs_01_24256__en-us_topic_0000001219029127_li1780531094918"><span>Choose <strong id="mrs_01_24256__en-us_topic_0000001219029127_b56644916224">Cluster</strong> &gt; <strong id="mrs_01_24256__en-us_topic_0000001219029127_b16682611122217">Services</strong> &gt; <strong id="mrs_01_24256__en-us_topic_0000001219029127_b1371331992211">Flink</strong>. On the displayed page, click the <strong id="mrs_01_24256__en-us_topic_0000001219029127_b16208165082215">Configurations</strong> tab and then <strong id="mrs_01_24256__en-us_topic_0000001219029127_b10596201410251">All Configurations</strong>, search for parameter <strong id="mrs_01_24256__en-us_topic_0000001219029127_b1018761342615">ClearUpEnabled</strong>, and set it to <strong id="mrs_01_24256__en-us_topic_0000001219029127_b7650102982611">true</strong>. For details about related parameters, see <a href="#mrs_01_24256__en-us_topic_0000001219029127_table133021410550">Table 1</a>.</span><p>
<div class="tablenoborder"><a name="mrs_01_24256__en-us_topic_0000001219029127_table133021410550"></a><a name="en-us_topic_0000001219029127_table133021410550"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_24256__en-us_topic_0000001219029127_table133021410550" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters for deleting the residual directories</caption><thead align="left"><tr id="mrs_01_24256__en-us_topic_0000001219029127_row1030361016518"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.2.2.2.1.2.5.1.1"><p id="mrs_01_24256__en-us_topic_0000001219029127_p8760737758">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.2.2.2.1.2.5.1.2"><p id="mrs_01_24256__en-us_topic_0000001219029127_p10760103713519">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.2.2.2.1.2.5.1.3"><p id="mrs_01_24256__en-us_topic_0000001219029127_p107606371759">Default Value</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.3.2.2.2.1.2.5.1.4"><p id="mrs_01_24256__en-us_topic_0000001219029127_p117601837357">Value Range</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_24256__en-us_topic_0000001219029127_row16303710954"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.1 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p1441620301759">ClearUpEnabled</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.2 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p04164301251">Specifies whether to delete the residual directories. Set this parameter to <strong id="mrs_01_24256__en-us_topic_0000001219029127_b1951913093910">true</strong> if residual directories need to be deleted; set it to <strong id="mrs_01_24256__en-us_topic_0000001219029127_b6886228114112">false</strong> otherwise.</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.3 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p241615301652">true</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.4 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p241663017512">true and false</p>
</td>
</tr>
<tr id="mrs_01_24256__en-us_topic_0000001219029127_row123039102520"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.1 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p20416330756">ClearUpPeriod</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.2 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p941615301254">Specifies the period for deleting residual directories, in minutes.</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.3 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p1341663015515">1440</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.4 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p184161303515">1440~2147483647</p>
</td>
</tr>
<tr id="mrs_01_24256__en-us_topic_0000001219029127_row1330314101652"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.1 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p441611308518">TrashDirectoryRetentionPeriod</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.2 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p194165301511">Specifies the period for retaining residual directories, in minutes.</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.3 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p141683019514">10080</p>
</td>
<td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.3.2.2.2.1.2.5.1.4 "><p id="mrs_01_24256__en-us_topic_0000001219029127_p14416193017516">10080~2147483647</p>
</td>
</tr>
</tbody>
</table>
</div>
</p></li><li id="mrs_01_24256__en-us_topic_0000001219029127_li1711615319619"><span>Click <strong id="mrs_01_24256__en-us_topic_0000001219029127_b362916545422">Save</strong>.</span><p><div class="notice" id="mrs_01_24256__en-us_topic_0000001219029127_note68361156199"><span class="noticetitle"><img src="public_sys-resources/notice_3.0-en-us.png"> </span><div class="noticebody"><ul id="mrs_01_24256__en-us_topic_0000001219029127_ul05801820181917"><li id="mrs_01_24256__en-us_topic_0000001219029127_li05808202197">This function deletes only the residual directories in the <strong id="mrs_01_24256__en-us_topic_0000001219029127_b15238747204311">/flink_base</strong> directory of the ZooKeeper service and the <strong id="mrs_01_24256__en-us_topic_0000001219029127_b175243586431">/flink/recovery</strong> directory of the HDFS service. User-defined directories will not be deleted.</li><li id="mrs_01_24256__en-us_topic_0000001219029127_li115802208197">This function does not delete the <strong id="mrs_01_24256__en-us_topic_0000001219029127_b1158915115471">checkpoints</strong> directory of the HDFS service. You need to manually delete it.</li></ul>
</div></div>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0591.html">Using Flink</a></div>
</div>
</div>