vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide/mrs_01_0795.html
Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

700 lines
54 KiB
HTML
Raw Blame History

<a name="mrs_01_0795"></a><a name="mrs_01_0795"></a>
<h1 class="topictitle1">Overview of HDFS File System Directories</h1>
<div id="body1590130531391"><p id="mrs_01_0795__p205767210275">This section describes the directory structure in HDFS, as shown in the following table.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0795__table41323024102735" frame="border" border="1" rules="all"><caption><b>Table 1 </b>HDFS directory structure (applicable to versions earlier than MRS 3.x)</caption><thead align="left"><tr id="mrs_01_0795__row3454690102735"><th align="left" class="cellrowborder" valign="top" width="16.161616161616163%" id="mcps1.3.2.2.6.1.1"><p id="mrs_01_0795__p35441715102735">Path</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.181818181818183%" id="mcps1.3.2.2.6.1.2"><p id="mrs_01_0795__p52206665102735">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="32.323232323232325%" id="mcps1.3.2.2.6.1.3"><p id="mrs_01_0795__p881443102735">Function</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="14.141414141414144%" id="mcps1.3.2.2.6.1.4"><p id="mrs_01_0795__p4288041102735">Whether the Directory Can Be Deleted</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.191919191919194%" id="mcps1.3.2.2.6.1.5"><p id="mrs_01_0795__p11787077102735">Deletion Consequence</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0795__row5050198102735"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p5671353110361">/tmp/spark/sparkhive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p1516807110375">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p181452103835">Stores temporary files of metastore sessions in Spark JDBCServer.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p14697641103835">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p49658254103835">Failed to run the task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row45034927102735"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p510402410361">/tmp/sparkhive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p5167042810375">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p29189961103835">Stores temporary files of metastore session that are executed using Spark CLI.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p15576618103835">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p53746577103835">Failed to run the task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row60336645102735"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p1471132610361">/tmp/carbon/</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p4522846010375">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p23491339103835">Stores the abnormal data in this directory if abnormal CarbonData data exists during data import.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p23750292103835">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p44725498103835">Error data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row30631584102735"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p65239238102735">/tmp/Loader-${<em id="mrs_01_0795__i1760852101212">Job name</em>}_${<em id="mrs_01_0795__i1625210567126">MR job ID</em>}</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p49886896102735">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p41037636103848">Stores the region information about Loader HBase bulkload jobs. The data is automatically deleted after the job running is completed.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p35714225103848">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p7171131103848">Failed to run the Loader HBase Bulkload job.</p>
</td>
</tr>
<tr id="mrs_01_0795__row54094928103620"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p61717285103732">/tmp/logs</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p31788306103740">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p49154684103754">Stores the collected MR task logs.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p1211526510382">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p27213395103810">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row50749790103620"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p28962273103732">/tmp/archived</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p21117029103740">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p64740227103754">Archives the MR task logs on HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p4076754910382">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p41450520103810">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row58211485103626"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p41314235103732">/tmp/hadoop-yarn/staging</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p26384719103740">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p18094775103754">Stores the run logs, summary information, and configuration attributes of ApplicationMaster running jobs.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p5742545910382">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p18440759103810">Services are running improperly.</p>
</td>
</tr>
<tr id="mrs_01_0795__row51207185103626"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p53306244103732">/tmp/hadoop-yarn/staging/history/done_intermediate</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p41325242103740">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p37754258103754">Stores temporary files in the <strong id="mrs_01_0795__b51062835215">/tmp/hadoop-yarn/staging</strong> directory after all tasks are executed.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p5433786410382">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p21541116103810">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row42972389103626"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p4219928103732">/tmp/hadoop-yarn/staging/history/done</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p61330392103740">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p8220504103754">The periodic scanning thread periodically moves the <strong id="mrs_01_0795__b485802010523">done_intermediate</strong> log file to the <strong id="mrs_01_0795__b181691226115218">done</strong> directory.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p1807338210382">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p67108344103810">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row49513952103626"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p56429339103732">/tmp/mr-history</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p15353063103740">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p20058578103754">Stores the historical record files that are pre-loaded.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p2215827210382">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p66730184103810">Historical MR task log data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row12948313113620"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p112101192365">/tmp/hive</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p49481413183620">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p3948913103619">Stores Hive temporary files.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p13948613203612">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p1948131311364">Failed to run the Hive task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row22832861103628"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p5108687010398">/tmp/hive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p4439581910398">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p3929157210398">Stores temporary data (such as session information) generated during Hive running.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p2850076210398">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p2686035610398">Failed to run the current task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row47276227103628"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p23599951103921">/user/{user}/.sparkStaging</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p32547918103921">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p19135734103921">Stores temporary files of the SparkJDBCServer application.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p6490606103921">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p55977054103921">Failed to start the executor.</p>
</td>
</tr>
<tr id="mrs_01_0795__row43887845103631"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p34789567103921">/user/spark/jars</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p66491539103921">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p17105608103921">Stores running dependency packages of the Spark executor.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p43377030103921">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p23878516103921">Failed to start the executor.</p>
</td>
</tr>
<tr id="mrs_01_0795__row64528750103631"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p15111923103948">/user/loader</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p5608490310400">Fixed directory</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p55975284104041">Stores dirty data of Loader jobs and data of HBase jobs.</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p21189316104116">No</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p45701427104133">Failed to execute the HBase job. Or dirty data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row29539482103631"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p10738366103948">/user/loader/etl_dirty_data_dir</p>
</td>
</tr>
<tr id="mrs_01_0795__row15965651103632"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p43640636103948">/user/loader/etl_hbase_putlist_tmp</p>
</td>
</tr>
<tr id="mrs_01_0795__row16687042103632"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p4422827103948">/user/loader/etl_hbase_tmp</p>
</td>
</tr>
<tr id="mrs_01_0795__row8745562391"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p127468683912">/user/mapred</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p1746156163913">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p1074616183917">Stores Hadoop-related files.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p074617663915">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p8746761391">Failed to start Yarn.</p>
</td>
</tr>
<tr id="mrs_01_0795__row3798330103634"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p11777940104247">/user/hive</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p14489055104247">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p32762811104247">Stores Hive-related data by default, including the depended Spark lib package and default table data storage path.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p36542031104247">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p7114564104247">User data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row7878577103634"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p21440579104319">/user/omm-bulkload</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p58965333104319">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p11462655104319">Stores HBase batch import tools temporarily.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p56059882104319">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p44556606104319">Failed to import HBase tasks in batches.</p>
</td>
</tr>
<tr id="mrs_01_0795__row42859462104254"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p1075633104319">/user/hbase</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p20017457104319">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p10801301104319">Stores HBase batch import tools temporarily.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p2490182104319">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p378155104319">Failed to import HBase tasks in batches.</p>
</td>
</tr>
<tr id="mrs_01_0795__row6250852310432"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p48786357104332">/sparkJobHistory</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p59380849104332">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p45119461104332">Stores Spark event log data.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p30797754104332">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p11590168104332">The History Server service is unavailable, and the task fails to be executed.</p>
</td>
</tr>
<tr id="mrs_01_0795__row187645310434"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p35044075104343">/flume</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p19997788104343">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p9208126104343">Stores data collected by Flume from HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p7660728104343">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p16539251104343">Flume runs improperly.</p>
</td>
</tr>
<tr id="mrs_01_0795__row3003465610434"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p1957754104354">/mr-history/tmp</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p24360379104354">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p27033648104354">Stores logs generated by MapReduce jobs.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p42241857104354">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p66147288104354">Log information is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row783937710436"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p37208624104354">/mr-history/done</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p61108544104354">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p50845041104354">Stores logs managed by MR JobHistory Server.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p24807658104354">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p63263316104354">Log information is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row87104110436"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p15168401104354">/tenant</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p20680939104354">Created when a tenant is added.</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p64543345104354">Directory of a tenant in the HDFS. By default, the system automatically creates a folder in the <strong id="mrs_01_0795__b428011281764">/tenant</strong> directory based on the tenant name. For example, the default HDFS storage directory for <strong id="mrs_01_0795__b142441139865">ta1</strong> is <strong id="mrs_01_0795__b412812461067">tenant/ta1</strong>. When a tenant is created for the first time, the system creates the <strong id="mrs_01_0795__b7711855266">/tenant</strong> directory in the HDFS root directory. You can customize the storage path.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p60628493104354">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p11960868104354">The tenant account is unavailable.</p>
</td>
</tr>
<tr id="mrs_01_0795__row28481638104410"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p49789199104437">/apps{1~5}/</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p6393339104437">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p48098484104437">Stores the Hive package used by WebHCat.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p3663137104437">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p28278699104437">Failed to run the WebHCat tasks.</p>
</td>
</tr>
<tr id="mrs_01_0795__row151567104414"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p11170506104446">/hbase</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p32395806104446">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p6814593104446">Stores HBase data.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p15111198104446">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p16047515104446">HBase user data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row13115701162249"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p7020128162256">/hbaseFileStream</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p18556264162249">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p26662390162249">Stores HFS files.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p12169948162249">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p34496153162816">The HFS file is lost and cannot be restored.</p>
</td>
</tr>
<tr id="mrs_01_0795__row6719174024317"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p13720164016433">/ats/active</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p77201440184312">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p137205409437">HDFS path used to store the timeline data of running applications.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p372094024316">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p1072010407438">Failed to run the <strong id="mrs_01_0795__b213911125114">tez</strong> task after the directory deletion.</p>
</td>
</tr>
<tr id="mrs_01_0795__row1469018493436"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p26901449184311">/ats/done</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p869012492435">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p15690174974310">HDFS path used to store the timeline data of completed applications.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p12690449174319">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p136901449134310">Automatically created after the deletion.</p>
</td>
</tr>
<tr id="mrs_01_0795__row11860741203017"><td class="cellrowborder" valign="top" width="16.161616161616163%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__p28617412309">/flink</p>
</td>
<td class="cellrowborder" valign="top" width="18.181818181818183%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__p17861341153019">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="32.323232323232325%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__p1686264133014">Stores the checkpoint task data.</p>
</td>
<td class="cellrowborder" valign="top" width="14.141414141414144%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__p138621441163011">No</p>
</td>
<td class="cellrowborder" valign="top" width="19.191919191919194%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__p986213419300">Failed to run tasks after the deletion.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0795__table979635174419" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Directory structure of the HDFS file system (applicable to MRS 3.x or later)</caption><thead align="left"><tr id="mrs_01_0795__row13797256441"><th align="left" class="cellrowborder" valign="top" width="19%" id="mcps1.3.3.2.6.1.1"><p id="mrs_01_0795__p379713510443">Path</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="16%" id="mcps1.3.3.2.6.1.2"><p id="mrs_01_0795__p1279795124417">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="33%" id="mcps1.3.3.2.6.1.3"><p id="mrs_01_0795__p97973544414">Function</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="13%" id="mcps1.3.3.2.6.1.4"><p id="mrs_01_0795__p8797205184418">Whether the Directory Can Be Deleted</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19%" id="mcps1.3.3.2.6.1.5"><p id="mrs_01_0795__p1797855443">Deletion Consequence</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0795__row679711554413"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1179775114418">/tmp/spark2x/sparkhive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p47979517444">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p07978519448">Stores temporary files of metastore session in Spark2x JDBCServer.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p16797105134417">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p147971854447">Failed to run the task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row5797257447"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p879719511447">/tmp/sparkhive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p57976516442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p18797145114414">Stores temporary files of metastore sessions that are executed in CLI mode using Spark2x CLI.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p67971458445">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p47979554410">Failed to run the task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row34511355102735"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p2984634110361">/tmp/logs/</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p1966998110375">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p56786945103835">Stores container log files.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p36339809103835">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p57843426103835">Container log files cannot be viewed.</p>
</td>
</tr>
<tr id="mrs_01_0795__row57981251440"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p5798195194412">/tmp/carbon/</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p579845144417">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1379815544414">Stores the abnormal data in this directory if abnormal CarbonData data exists during data import.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p197987534410">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p779810594416">Error data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row679815510446"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1279812518449">/tmp/Loader-${<em id="mrs_01_0795__i76784821">Job name</em>}_${<em id="mrs_01_0795__i2066485714">MR job ID</em>}</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p179885174414">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p2079820520449">Stores the region information about Loader HBase bulkload jobs. The data is automatically deleted after the job running is completed.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1779819574419">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p127981952443">Failed to run the Loader HBase Bulkload job.</p>
</td>
</tr>
<tr id="mrs_01_0795__row2798115184410"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p87981353444">/tmp/hadoop-omm/yarn/system/rmstore</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p20798458441">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1798185164414">Stores the ResourceManager running information.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1479817512442">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p1479810564420">Status information is lost after ResourceManager is restarted.</p>
</td>
</tr>
<tr id="mrs_01_0795__row779865184413"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p19798159445">/tmp/archived</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p1798145164418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p379815574413">Archives the MR task logs on HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1879813519444">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p379810544411">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row7798195204411"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1079835144412">/tmp/hadoop-yarn/staging</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p679911574418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p37991459443">Stores the run logs, summary information, and configuration attributes of ApplicationMaster running jobs.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p177996518441">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p18799450444">Services are running improperly.</p>
</td>
</tr>
<tr id="mrs_01_0795__row1779995144417"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p5799195134410">/tmp/hadoop-yarn/staging/history/done_intermediate</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p1479919516446">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1779912544417">Stores temporary files in the <strong id="mrs_01_0795__b314728319">/tmp/hadoop-yarn/staging</strong> directory after all tasks are executed.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p14799135164411">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p1479916574415">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row97990564412"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p379915144415">/tmp/hadoop-yarn/staging/history/done</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p117997519442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p127994512442">The periodic scanning thread periodically moves the <strong id="mrs_01_0795__b1309851812">done_intermediate</strong> log file to the <strong id="mrs_01_0795__b834006484">done</strong> directory.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p4799853445">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p9799250449">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row879915584416"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p379913510448">/tmp/mr-history</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p1979912520446">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p19799155124416">Stores the historical record files that are pre-loaded.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p14799756441">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p2799175194414">Historical MR task log data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row18799165154418"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p198001754442">/tmp/hive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p16800454445">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p5800135134413">Stores temporary data (such as session information) generated during Hive running.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1580016512440">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p1780014512444">Failed to run the current task.</p>
</td>
</tr>
<tr id="mrs_01_0795__row12800553443"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p28002516443">/user/{user}/.sparkStaging</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p580017512443">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1480035114420">Stores temporary files of the SparkJDBCServer application.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p680012534416">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p7800135154420">Failed to start the executor.</p>
</td>
</tr>
<tr id="mrs_01_0795__row1280045124418"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p19800185184412">/user/spark2x/jars</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p9800115154410">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1880012511443">Stores running dependency packages of the Spark2x executor.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p280015514444">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p680011517448">Failed to start the executor.</p>
</td>
</tr>
<tr id="mrs_01_0795__row20800115154417"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p15800145184419">/user/loader</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p9800158445">Fixed directory</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1800156447">Stores dirty data of Loader jobs and data of HBase jobs.</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1180010544417">No</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p180015144411">Failed to execute the HBase job. Or dirty data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row58003564418"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p58001851445">/user/loader/etl_dirty_data_dir</p>
</td>
</tr>
<tr id="mrs_01_0795__row98013514442"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1780116534414">/user/loader/etl_hbase_putlist_tmp</p>
</td>
</tr>
<tr id="mrs_01_0795__row1480145174419"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p18011255447">/user/loader/etl_hbase_tmp</p>
</td>
</tr>
<tr id="mrs_01_0795__row1680135154419"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p8801155204413">/user/oozie</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p48016514442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1580116524412">Stores dependent libraries required for Oozie running, which needs to be manually uploaded.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p5801155154411">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p138013544418">Failed to schedule Oozie.</p>
</td>
</tr>
<tr id="mrs_01_0795__row39229331103634"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1924024710427">/user/mapred/hadoop-mapreduce-<em id="mrs_01_0795__i138483297534">3.1.1</em>.tar.gz</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p1495621310427">Fixed files</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p349375110427">Stores JAR files used by the distributed MR cache.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1455843810427">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p3838282510427">The MR distributed cache function is unavailable.</p>
</td>
</tr>
<tr id="mrs_01_0795__row1380117514410"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p88011955448">/user/hive</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p188018554418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p148015510449">Stores Hive-related data by default, including the depended Spark lib package and default table data storage path.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p14801155144415">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p19801135174417">User data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row19801145144410"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p980111544413">/user/omm-bulkload</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p680195144412">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p158021352449">Stores HBase batch import tools temporarily.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p9802559448">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p28021659443">Failed to import HBase tasks in batches.</p>
</td>
</tr>
<tr id="mrs_01_0795__row1280213544414"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1180225154410">/user/hbase</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p12802155144414">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p780215517442">Stores HBase batch import tools temporarily.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p78021544412">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p1080215512440">Failed to import HBase tasks in batches.</p>
</td>
</tr>
<tr id="mrs_01_0795__row680219511447"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p188021050446">/spark2xJobHistory2x</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p108028524414">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1080235104418">Stores Spark2x eventlog data.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p9802352445">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p138024554414">The History Server service is unavailable, and the task fails to be executed.</p>
</td>
</tr>
<tr id="mrs_01_0795__row1380275194411"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p5802157441">/flume</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p18023554414">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p138021357448">Stores data collected by Flume from HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p980245204413">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p58027544415">Flume runs improperly.</p>
</td>
</tr>
<tr id="mrs_01_0795__row4802554440"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p580265184413">/mr-history/tmp</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p2802135184417">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p1380312512440">Stores logs generated by MapReduce jobs.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p2080317518442">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p11803153443">Log information is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row88032519446"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p180312510448">/mr-history/done</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p88031154444">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p148032511444">Stores logs managed by MR JobHistory Server.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p68035511445">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p38037512449">Log information is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row980314594420"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p8803454443">/tenant</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p2803195184414">Created when a tenant is added.</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p580311512444">Directory of a tenant in the HDFS. By default, the system automatically creates a folder in the <strong id="mrs_01_0795__b587071165">/tenant</strong> directory based on the tenant name. For example, the default HDFS storage directory for <strong id="mrs_01_0795__b1350715364">ta1</strong> is <strong id="mrs_01_0795__b735249972">tenant/ta1</strong>. When a tenant is created for the first time, the system creates the <strong id="mrs_01_0795__b1608693843">/tenant</strong> directory in the HDFS root directory. You can customize the storage path.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p168039512446">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p188034520443">The tenant account is unavailable.</p>
</td>
</tr>
<tr id="mrs_01_0795__row7803185134418"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p380314513442">/apps{1~5}/</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p1180417544414">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p7804145194419">Stores the Hive package used by WebHCat.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p18047517448">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p5804145124412">Failed to run the WebHCat tasks.</p>
</td>
</tr>
<tr id="mrs_01_0795__row280485124411"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p2080445134420">/hbase</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p158041652442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p7804155114411">Stores HBase data.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p48043554414">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p3804175134415">HBase user data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__row158040514416"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.1 "><p id="mrs_01_0795__p1380417594413">/hbaseFileStream</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.3.2.6.1.2 "><p id="mrs_01_0795__p480445124418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.6.1.3 "><p id="mrs_01_0795__p180411504412">Stores HFS files.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.3.2.6.1.4 "><p id="mrs_01_0795__p1780445114414">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.3.2.6.1.5 "><p id="mrs_01_0795__p2804155194415">The HFS file is lost and cannot be restored.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0790.html">Using HDFS</a></div>
</div>
</div>
View Git Blame Copy Permalink