vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide-lts/mrs_01_0795.html
Yang, Tong 48706b7552 MRS COMP-LTS 320-lts.1 version 
Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2024-04-12 12:51:10 +00:00

345 lines
30 KiB
HTML
Raw Blame History

<a name="mrs_01_0795"></a><a name="mrs_01_0795"></a>
<h1 class="topictitle1">Overview of HDFS File System Directories</h1>
<div id="body8662426"><p id="mrs_01_0795__en-us_topic_0000001219029321_p205767210275">This section describes the directory structure in HDFS, as shown in the following table.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0795__en-us_topic_0000001219029321_table979635174419" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Directory structure of the HDFS file system</caption><thead align="left"><tr id="mrs_01_0795__en-us_topic_0000001219029321_row13797256441"><th align="left" class="cellrowborder" valign="top" width="19%" id="mcps1.3.2.2.6.1.1"><p id="mrs_01_0795__en-us_topic_0000001219029321_p379713510443">Path</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="16%" id="mcps1.3.2.2.6.1.2"><p id="mrs_01_0795__en-us_topic_0000001219029321_p1279795124417">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="33%" id="mcps1.3.2.2.6.1.3"><p id="mrs_01_0795__en-us_topic_0000001219029321_p97973544414">Function</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="13%" id="mcps1.3.2.2.6.1.4"><p id="mrs_01_0795__en-us_topic_0000001219029321_p8797205184418">Whether the Directory Can Be Deleted</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19%" id="mcps1.3.2.2.6.1.5"><p id="mrs_01_0795__en-us_topic_0000001219029321_p1797855443">Deletion Consequence</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0795__en-us_topic_0000001219029321_row679711554413"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1179775114418">/tmp/spark2x/sparkhive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p47979517444">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p07978519448">Stores temporary files of metastore session in Spark2x JDBCServer.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p16797105134417">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p147971854447">Failed to run the task.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row5797257447"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p879719511447">/tmp/sparkhive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p57976516442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p18797145114414">Stores temporary files of metastore sessions that are executed in CLI mode using Spark2x CLI.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p67971458445">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p47979554410">Failed to run the task.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row34511355102735"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2984634110361">/tmp/logs/</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1966998110375">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p56786945103835">Stores container log files.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p36339809103835">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p57843426103835">Container log files cannot be viewed.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row57981251440"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p5798195194412">/tmp/carbon/</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p579845144417">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1379815544414">Stores the abnormal data in this directory if abnormal CarbonData data exists during data import.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p197987534410">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p779810594416">Error data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row679815510446"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1279812518449">/tmp/Loader-${<em id="mrs_01_0795__en-us_topic_0000001219029321_i880222282">Job name</em>}_${<em id="mrs_01_0795__en-us_topic_0000001219029321_i1898880065">MR job ID</em>}</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p179885174414">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2079820520449">Stores the region information about Loader HBase bulkload jobs. The data is automatically deleted after the job running is completed.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1779819574419">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p127981952443">Failed to run the Loader HBase Bulkload job.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row2798115184410"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p87981353444">/tmp/hadoop-omm/yarn/system/rmstore</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p20798458441">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1798185164414">Stores the ResourceManager running information.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1479817512442">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1479810564420">Status information is lost after ResourceManager is restarted.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row779865184413"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p19798159445">/tmp/archived</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1798145164418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p379815574413">Archives the MR task logs on HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1879813519444">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p379810544411">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row7798195204411"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1079835144412">/tmp/hadoop-yarn/staging</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p679911574418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p37991459443">Stores the run logs, summary information, and configuration attributes of ApplicationMaster running jobs.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p177996518441">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p18799450444">Services are running improperly.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1779995144417"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p5799195134410">/tmp/hadoop-yarn/staging/history/done_intermediate</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1479919516446">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1779912544417">Stores temporary files in the <strong id="mrs_01_0795__en-us_topic_0000001219029321_b1127306987">/tmp/hadoop-yarn/staging</strong> directory after all tasks are executed.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p14799135164411">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1479916574415">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row97990564412"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p379915144415">/tmp/hadoop-yarn/staging/history/done</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p117997519442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p127994512442">The periodic scanning thread periodically moves the <strong id="mrs_01_0795__en-us_topic_0000001219029321_b1062443695">done_intermediate</strong> log file to the <strong id="mrs_01_0795__en-us_topic_0000001219029321_b1901518995">done</strong> directory.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p4799853445">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p9799250449">MR task logs are lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row879915584416"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p379913510448">/tmp/mr-history</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1979912520446">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p19799155124416">Stores the historical record files that are pre-loaded.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p14799756441">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2799175194414">Historical MR task log data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row18799165154418"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p198001754442">/tmp/hive-scratch</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p16800454445">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p5800135134413">Stores temporary data (such as session information) generated during Hive running.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1580016512440">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1780014512444">Failed to run the current task.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row12800553443"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p28002516443">/user/{user}/.sparkStaging</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p580017512443">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1480035114420">Stores temporary files of the SparkJDBCServer application.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p680012534416">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p7800135154420">Failed to start the executor.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1280045124418"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p19800185184412">/user/spark2x/jars</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p9800115154410">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1880012511443">Stores running dependency packages of the Spark2x executor.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p280015514444">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p680011517448">Failed to start the executor.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row20800115154417"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p15800145184419">/user/loader</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p9800158445">Fixed directory</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1800156447">Stores dirty data of Loader jobs and data of HBase jobs.</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1180010544417">No</p>
</td>
<td class="cellrowborder" rowspan="4" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p180015144411">Failed to execute the HBase job. Or dirty data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row58003564418"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p58001851445">/user/loader/etl_dirty_data_dir</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row98013514442"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1780116534414">/user/loader/etl_hbase_putlist_tmp</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1480145174419"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p18011255447">/user/loader/etl_hbase_tmp</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1680135154419"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p8801155204413">/user/oozie</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p48016514442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1580116524412">Stores dependent libraries required for Oozie running, which needs to be manually uploaded.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p5801155154411">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p138013544418">Failed to schedule Oozie.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row39229331103634"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1924024710427">/user/mapred/hadoop-mapreduce-<span id="mrs_01_0795__ph68010451698">xxx</span>.tar.gz</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1495621310427">Fixed files</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p349375110427">Stores JAR files used by the distributed MR cache.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1455843810427">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p3838282510427">The MR distributed cache function is unavailable.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1380117514410"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p88011955448">/user/hive</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p188018554418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p148015510449">Stores Hive-related data by default, including the depended Spark lib package and default table data storage path.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p14801155144415">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p19801135174417">User data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row19801145144410"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p980111544413">/user/omm-bulkload</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p680195144412">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p158021352449">Stores HBase batch import tools temporarily.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p9802559448">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p28021659443">Failed to import HBase tasks in batches.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1280213544414"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1180225154410">/user/hbase</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p12802155144414">Temporary directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p780215517442">Stores HBase batch import tools temporarily.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p78021544412">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1080215512440">Failed to import HBase tasks in batches.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row680219511447"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p188021050446">/spark2xJobHistory2x</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p108028524414">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1080235104418">Stores Spark2.x eventlog data.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p9802352445">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p138024554414">The History Server service is unavailable, and the task fails to be executed.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row1380275194411"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p5802157441">/flume</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p18023554414">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p138021357448">Stores data collected by Flume from HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p980245204413">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p58027544415">Flume runs improperly.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row4802554440"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p580265184413">/mr-history/tmp</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2802135184417">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1380312512440">Stores logs generated by MapReduce jobs.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2080317518442">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p11803153443">Log information is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row88032519446"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p180312510448">/mr-history/done</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p88031154444">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p148032511444">Stores logs managed by MR JobHistory Server.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p68035511445">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p38037512449">Log information is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row980314594420"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p8803454443">/tenant</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2803195184414">Created when a tenant is added.</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p580311512444">Directory of a tenant in the HDFS. By default, the system automatically creates a folder in the <strong id="mrs_01_0795__en-us_topic_0000001219029321_b1656213351">/tenant</strong> directory based on the tenant name. For example, the default HDFS storage directory for <strong id="mrs_01_0795__en-us_topic_0000001219029321_b1964367838">ta1</strong> is <strong id="mrs_01_0795__en-us_topic_0000001219029321_b1854283324">tenant/ta1</strong>. When a tenant is created for the first time, the system creates the <strong id="mrs_01_0795__en-us_topic_0000001219029321_b861601462">/tenant</strong> directory in the HDFS root directory. You can customize the storage path.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p168039512446">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p188034520443">The tenant account is unavailable.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row7803185134418"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p380314513442">/apps{1~5}/</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1180417544414">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p7804145194419">Stores the Hive package used by WebHCat.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p18047517448">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p5804145124412">Failed to run the WebHCat tasks.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row280485124411"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2080445134420">/hbase</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p158041652442">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p7804155114411">Stores HBase data.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p48043554414">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p3804175134415">HBase user data is lost.</p>
</td>
</tr>
<tr id="mrs_01_0795__en-us_topic_0000001219029321_row158040514416"><td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.1 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1380417594413">/hbaseFileStream</p>
</td>
<td class="cellrowborder" valign="top" width="16%" headers="mcps1.3.2.2.6.1.2 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p480445124418">Fixed directory</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.2.2.6.1.3 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p180411504412">Stores HFS files.</p>
</td>
<td class="cellrowborder" valign="top" width="13%" headers="mcps1.3.2.2.6.1.4 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p1780445114414">No</p>
</td>
<td class="cellrowborder" valign="top" width="19%" headers="mcps1.3.2.2.6.1.5 "><p id="mrs_01_0795__en-us_topic_0000001219029321_p2804155194415">The HFS file is lost and cannot be restored.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0790.html">Using HDFS</a></div>
</div>
</div>
View Git Blame Copy Permalink