Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

19 lines
4.3 KiB
HTML

<a name="mrs_01_1659"></a><a name="mrs_01_1659"></a>
<h1 class="topictitle1">What Can I Do When HBase Fails to Recover a Task and a Message Is Displayed Stating "Rollback recovery failed"?</h1>
<div id="body8662426"><div class="section" id="mrs_01_1659__en-us_topic_0000001219029769_s0d75574469bd460f87878b6f2e2d2866"><h4 class="sectiontitle">Question</h4><p id="mrs_01_1659__en-us_topic_0000001219029769_en-us_topic_0116216659_p291607620251">The system automatically rolls back data after an HBase recovery task fails. If "Rollback recovery failed" is displayed, the rollback fails. After the rollback fails, data stops being processed and the junk data may be generated. How can I resolve this problem?</p>
</div>
<div class="section" id="mrs_01_1659__en-us_topic_0000001219029769_s50e8c7a469d94a4d9cf53ead971b7881"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_1659__en-us_topic_0000001219029769_en-us_topic_0116216659_p196369182039">You need to manually clear the junk data before performing the backup or recovery task next time.</p>
<ol id="mrs_01_1659__en-us_topic_0000001219029769_o1b50f7dd7f534e74bfda83d4e960c9b7"><li id="mrs_01_1659__en-us_topic_0000001219029769_l57959cf11dc74b388d62a55b172f9fa6"><span>Install the cluster client in <strong id="mrs_01_1659__en-us_topic_0000001219029769_b861843416215">/opt/client</strong>.</span></li><li id="mrs_01_1659__en-us_topic_0000001219029769_l724fdfd393dc4ee4b8854fb07e114dff"><span>Run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b750463602117">source /opt/client/bigdata_env</strong> as the client installation user to configure the environment variable.</span></li><li id="mrs_01_1659__en-us_topic_0000001219029769_lc78ee31171b54bc988743bab2a08bbc9"><span>Run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b9323338162114">kinit admin</strong>.</span></li><li id="mrs_01_1659__en-us_topic_0000001219029769_l8104ce4be72e4d02a008b0b0f51bb46e"><span>Run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b0600104014217">zkCli.sh -server </strong><em id="mrs_01_1659__en-us_topic_0000001219029769_i1160144022112">business IP address of ZooKeeper</em><strong id="mrs_01_1659__en-us_topic_0000001219029769_b36011740162115">:2181</strong> to connect to the ZooKeeper.</span></li><li id="mrs_01_1659__en-us_topic_0000001219029769_la905b9f75fed447f8d3cd219202c3d44"><span>Run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b53211857192114">deleteall /recovering</strong> to delete the junk data. Run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b1555312593219">quit</strong> to disconnect ZooKeeper.</span><p><div class="note" id="mrs_01_1659__en-us_topic_0000001219029769_note77241126439"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1659__en-us_topic_0000001219029769_p37251025435">Running this command will cause data loss. Exercise caution.</p>
</div></div>
</p></li><li id="mrs_01_1659__en-us_topic_0000001219029769_ldd3e318f57974e6981a564f8a6dfc182"><span>Run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b55582182218">hdfs dfs -rm -f -r /user/hbase/backup</strong> to delete temporary data.</span></li><li id="mrs_01_1659__en-us_topic_0000001219029769_l7fa266df15b04958a674dcb4a5e2971d"><span>On Manager, view related snapshot name information from recovery task records.</span><p><pre class="screen" id="mrs_01_1659__en-us_topic_0000001219029769_s313bf24b12bc4ce2adc6ed0ea2701d26">Snapshot [ <em id="mrs_01_1659__en-us_topic_0000001219029769_a188f6fdf15204e39984db8e5348ef265">snapshot name</em> ] is created successfully before recovery.</pre>
</p></li><li id="mrs_01_1659__en-us_topic_0000001219029769_la9e10256a1a9487e9a0787f7c3c5a0d0"><span>Switch to the client, run <strong id="mrs_01_1659__en-us_topic_0000001219029769_b1340091252215">hbase shell</strong>, and then <strong id="mrs_01_1659__en-us_topic_0000001219029769_b1540521252215">delete_all_snapshot </strong>'<em id="mrs_01_1659__en-us_topic_0000001219029769_i24051312182213">snapshot name</em><strong id="mrs_01_1659__en-us_topic_0000001219029769_b204061512202213">.*'</strong> to delete the temporary snapshot.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1638.html">Common Issues About HBase</a></div>
</div>
</div>