vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide/mrs_01_0799.html
Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

171 lines
22 KiB
HTML
Raw Blame History

<a name="mrs_01_0799"></a><a name="mrs_01_0799"></a>
<h1 class="topictitle1">Planning HDFS Capacity</h1>
<div id="body1590130532716"><p id="mrs_01_0799__a78e45657376f44beac98b13790eb8a2b">In HDFS, DataNode stores user files and directories as blocks, and file objects are generated on the NameNode to map each file, directory, and block on the DataNode.</p>
<p id="mrs_01_0799__a61db6901e6434a23aa48cf39150410d6">The file objects on the NameNode require certain memory capacity. The memory consumption linearly increases as more file objects generated. The number of file objects on the NameNode increases and the objects consume more memory when the files and directories stored on the DataNode increase. In this case, the existing hardware may not meet the service requirement and the cluster is difficult to be scaled out.</p>
<p id="mrs_01_0799__a140bcb889722498da96aae84104a8262">Capacity planning of the HDFS that stores a large number of files is to plan the capacity specifications of the NameNode and DataNode and to set parameters according to the capacity plans.</p>
<div class="section" id="mrs_01_0799__sc8dd3ca1ae6f45308cc9d97f885c2305"><h4 class="sectiontitle">Capacity Specifications</h4><ul id="mrs_01_0799__uc120e2e811404bb7a971fc2ef26c5e1a"><li id="mrs_01_0799__laa4e290db8b646b98123a72f5b27de29">NameNode capacity specifications <p id="mrs_01_0799__aa2c95c9068d843cf993258a14513ff16"><a name="mrs_01_0799__laa4e290db8b646b98123a72f5b27de29"></a><a name="laa4e290db8b646b98123a72f5b27de29"></a>Each file object on the NameNode corresponds to a file, directory, or block on the DataNode.</p>
<p id="mrs_01_0799__ae8ce55e15b5741b586cd1a3ec3c657b6">A file uses at least one block. The default size of a block is <strong id="mrs_01_0799__b32131790369">134,217,728</strong>, that is, 128 MB, which can be set in the <strong id="mrs_01_0799__b14911929153618">dfs.blocksize</strong> parameter. By default, a file whose size is less than 128 MB occupies only one block. If the file size is greater than 128 MB, the number of occupied blocks is the file size divided by 128 MB (Number of occupied blocks = File size/128). The directories do not occupy any blocks.</p>
<div class="p" id="mrs_01_0799__aa323baf81d3742a689a3785caeb01850">Based on <strong id="mrs_01_0799__b7781154123710">dfs.blocksize</strong>, the number of file objects on the NameNode is calculated as follows:
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0799__t6d6b4dcfa0994313a4296d9d13123e63" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Number of NameNode file objects</caption><thead align="left"><tr id="mrs_01_0799__r93c37ac2a08b498fb04791718a003278"><th align="left" class="cellrowborder" valign="top" width="34.4%" id="mcps1.3.4.2.1.3.2.2.3.1.1"><p id="mrs_01_0799__ae949a160e11643bc9ac2ae4ff21d49ab">Size of a File</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="65.60000000000001%" id="mcps1.3.4.2.1.3.2.2.3.1.2"><p id="mrs_01_0799__ad4bbfa4fea744d2dba73d0a31188a640">Number of File Objects</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0799__r698a244c563942e0ad2f0e65cb47a6e0"><td class="cellrowborder" valign="top" width="34.4%" headers="mcps1.3.4.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__a9a1686a2309e4645a85d1c11080c1786">&lt; 128 MB</p>
</td>
<td class="cellrowborder" valign="top" width="65.60000000000001%" headers="mcps1.3.4.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__aef92d8f61dd244f184e7132504e3b4b4">1 (File) + 1 (Block) = 2</p>
</td>
</tr>
<tr id="mrs_01_0799__ra03418556ce84253a8e0c5b637222713"><td class="cellrowborder" valign="top" width="34.4%" headers="mcps1.3.4.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__a90b8603867b345509e71e2ada4d46b02">&gt; 128 MB (for example, 128 GB)</p>
</td>
<td class="cellrowborder" valign="top" width="65.60000000000001%" headers="mcps1.3.4.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__aba153afd061c4669817c4b4128d6686f">1 (File) + 1,024 (128 GB/128 MB = 1,024 blocks) = 1,025</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<p id="mrs_01_0799__abc4e19bbe9a847809a87405b45568ccd">The maximum number of file objects supported by the active and standby NameNodes is 300,000,000 (equivalent to 150,000,000 small files). <strong id="mrs_01_0799__b3437114184212">dfs.namenode.max.objects</strong> specifies the number of file objects that can be generated in the system. The default value is <strong id="mrs_01_0799__b819132620422">0</strong>, which indicates that the number of generated file objects is not limited.</p>
</li><li id="mrs_01_0799__l60d0c114f708418ab59a05117707358a">DataNode capacity specifications<p id="mrs_01_0799__a9bb2171e142e4dc6b41626cc817a1014"><a name="mrs_01_0799__l60d0c114f708418ab59a05117707358a"></a><a name="l60d0c114f708418ab59a05117707358a"></a>In HDFS, blocks are stored on the DataNode as copies. The default number of copies is <strong id="mrs_01_0799__b13345184438">3</strong>, which can be set in the <strong id="mrs_01_0799__b69840215437">dfs.replication</strong> parameter.</p>
<p id="mrs_01_0799__a141580b8bcf3494dbc83f0506ea51327">The number of blocks stored on all DataNode role instances in the cluster can be calculated based on the following formula: Number of HDFS blocks x 3 Average number of saved blocks = Number of HDFS blocks x 3/Number of DataNodes</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0799__t6c1c7dd6659a4d4581db9848e493b294" frame="border" border="1" rules="all"><caption><b>Table 2 </b>DataNode specifications</caption><thead align="left"><tr id="mrs_01_0799__r82190e2f5e5047aeb9c4f85961c8a8da"><th align="left" class="cellrowborder" valign="top" width="55.83%" id="mcps1.3.4.2.2.3.2.3.1.1"><p id="mrs_01_0799__a44e4aea58ff048d58885a5acf8ed5780">Item</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="44.17%" id="mcps1.3.4.2.2.3.2.3.1.2"><p id="mrs_01_0799__ab9b3fc6eba61415f9d557054527ca0be">Specifications</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0799__rb96dbf3acadd40e795c4164bea28f618"><td class="cellrowborder" valign="top" width="55.83%" headers="mcps1.3.4.2.2.3.2.3.1.1 "><p id="mrs_01_0799__a04be15a19b6d4bae96273ecd2662b2cc">Maximum number of blocks supported by a DataNode instance</p>
</td>
<td class="cellrowborder" valign="top" width="44.17%" headers="mcps1.3.4.2.2.3.2.3.1.2 "><p id="mrs_01_0799__ae119d9f0f2734c05be55f841315cd68c">5,000,000</p>
</td>
</tr>
<tr id="mrs_01_0799__rcf7a9b90196f454db3c9e5aa36cdb355"><td class="cellrowborder" valign="top" width="55.83%" headers="mcps1.3.4.2.2.3.2.3.1.1 "><p id="mrs_01_0799__a9ecf280e6b95479f84f16a94a7a6f0a1">Maximum number of blocks supported by a disk on a DataNode instance</p>
</td>
<td class="cellrowborder" valign="top" width="44.17%" headers="mcps1.3.4.2.2.3.2.3.1.2 "><p id="mrs_01_0799__aebdef039e6ed487bb896ceec7bf070c6">500,000</p>
</td>
</tr>
<tr id="mrs_01_0799__ra3071e1ebdf14847946c6dd914d891ad"><td class="cellrowborder" valign="top" width="55.83%" headers="mcps1.3.4.2.2.3.2.3.1.1 "><p id="mrs_01_0799__a3c5eb86fdbcc4efc9045a328472af6c6">Minimum number of disks required when the number of blocks supported by a DataNode instance reaches the maximum </p>
</td>
<td class="cellrowborder" valign="top" width="44.17%" headers="mcps1.3.4.2.2.3.2.3.1.2 "><p id="mrs_01_0799__a7903995fad6149c2a2049baea4e0cb3a">10</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0799__t51aa964d07d14712aa3cdb2d18fdc795" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Number of DataNodes</caption><thead align="left"><tr id="mrs_01_0799__r46e41d642df0422fac4d3015265865fc"><th align="left" class="cellrowborder" valign="top" width="43.419999999999995%" id="mcps1.3.4.2.2.4.2.3.1.1"><p id="mrs_01_0799__ab65896870b8d46138e1c999893232813">Number of HDFS Blocks</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="56.58%" id="mcps1.3.4.2.2.4.2.3.1.2"><p id="mrs_01_0799__a13e97ae6c9dc4f99a7288aac37c78075">Minimum Number of DataNode Roles</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0799__r3f9f48aaa5d44079a47c6fe0d3d20152"><td class="cellrowborder" valign="top" width="43.419999999999995%" headers="mcps1.3.4.2.2.4.2.3.1.1 "><p id="mrs_01_0799__a0050f94e528d45ee8b1c7ec5d6b7116a">10,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="56.58%" headers="mcps1.3.4.2.2.4.2.3.1.2 "><p id="mrs_01_0799__af0be30d7fc164b19bb12d0ce92dbfd34">10,000,000 *3/5,000,000 = 6</p>
</td>
</tr>
<tr id="mrs_01_0799__r948a4fc415b644d1b6cab329b73f1271"><td class="cellrowborder" valign="top" width="43.419999999999995%" headers="mcps1.3.4.2.2.4.2.3.1.1 "><p id="mrs_01_0799__a9fe5b361cc5342c496ef695befa3a07c">50,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="56.58%" headers="mcps1.3.4.2.2.4.2.3.1.2 "><p id="mrs_01_0799__a19215f386e2d4b9ebb8fa68ce3f1b0ea">50,000,000 *3/5,000,000 = 30</p>
</td>
</tr>
<tr id="mrs_01_0799__r9d2fe9c628934212914b443d0ce64143"><td class="cellrowborder" valign="top" width="43.419999999999995%" headers="mcps1.3.4.2.2.4.2.3.1.1 "><p id="mrs_01_0799__a1910c5132d64479990c2d846e4c15197">100,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="56.58%" headers="mcps1.3.4.2.2.4.2.3.1.2 "><p id="mrs_01_0799__a69b3685a42b347afbdd240ae259466c1">100,000,000 *3/5,000,000 = 60</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ul>
</div>
<div class="section" id="mrs_01_0799__scd3607ea70834b8496b1d35c7083a843"><h4 class="sectiontitle">Setting Memory Parameters</h4><ul id="mrs_01_0799__ub452b09592bc4afaa4d0097cb68e7733"><li id="mrs_01_0799__l11686bdef61d47668f9b5d70cbebb03b">Configuration rules of the NameNode JVM parameter<p id="mrs_01_0799__a912f7bc55bd44dc7af294ec1977d06db"><a name="mrs_01_0799__l11686bdef61d47668f9b5d70cbebb03b"></a><a name="l11686bdef61d47668f9b5d70cbebb03b"></a>Default value of the NameNode JVM parameter <strong id="mrs_01_0799__b86921419114814">GC_OPTS</strong>: </p>
<p id="mrs_01_0799__p1279145241818">-Xms2G -Xmx4G -XX:NewSize=128M -XX:MaxNewSize=256M -XX:MetaspaceSize=128M -XX:MaxMetaspaceSize=128M -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=65 -XX:+PrintGCDetails -Dsun.rmi.dgc.client.gcInterval=0x7FFFFFFFFFFFFFE -Dsun.rmi.dgc.server.gcInterval=0x7FFFFFFFFFFFFFE -XX:-OmitStackTraceInFastThrow -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -Djdk.tls.ephemeralDHKeySize=3072 -Djdk.tls.rejectClientInitiatedRenegotiation=true -Djava.io.tmpdir=${Bigdata_tmp_dir}</p>
<div class="p" id="mrs_01_0799__a2616701d47ea48779f0bc5a4f1d88df4">The number of NameNode files is proportional to the used memory size of the NameNode. When file objects change, you need to change <strong id="mrs_01_0799__b1571114574481">-Xms2G -Xmx4G -XX:NewSize=128M --XX:MaxNewSize=256M</strong> in the default value. The following table lists the reference values.
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0799__te26cc4df625545418ac6cc0a8f9f88f0" frame="border" border="1" rules="all"><caption><b>Table 4 </b>NameNode JVM configuration</caption><thead align="left"><tr id="mrs_01_0799__r12696e3d9eac47308ab8ceeeabaf9d60"><th align="left" class="cellrowborder" valign="top" width="28.01%" id="mcps1.3.5.2.1.3.2.2.3.1.1"><p id="mrs_01_0799__a1d09de0bdefa473fb5bbe44fa938dd42">Number of File Objects</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="71.99%" id="mcps1.3.5.2.1.3.2.2.3.1.2"><p id="mrs_01_0799__a3cda0d608a9342f1a59ffca91ccb43fb">Reference Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0799__rf83d3e2a613f4411b06455ba3d050a91"><td class="cellrowborder" valign="top" width="28.01%" headers="mcps1.3.5.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__a698a4c1bac0e47a39311c4d3eab22de6">10,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="71.99%" headers="mcps1.3.5.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__ae013dee8e5c249b589373d1f0d623955">-Xms6G -Xmx6G -XX:NewSize=512M -XX:MaxNewSize=512M</p>
</td>
</tr>
<tr id="mrs_01_0799__r71dd137d8340469b9d6cfa56bad12a4f"><td class="cellrowborder" valign="top" width="28.01%" headers="mcps1.3.5.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__a068a2ba0b8aa4d6d83a392de11a0c207">20,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="71.99%" headers="mcps1.3.5.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__a702b804579e84bd490aae5a79da4302f">-Xms12G -Xmx12G -XX:NewSize=1G -XX:MaxNewSize=1G</p>
</td>
</tr>
<tr id="mrs_01_0799__racee4c018a9f4a729de4be081d5da2c7"><td class="cellrowborder" valign="top" width="28.01%" headers="mcps1.3.5.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__afbb0ed490b2d406583d777e01adad1f0">50,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="71.99%" headers="mcps1.3.5.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__a9f14dacaf1354a21919d6791d891e970">-Xms32G -Xmx32G -XX:NewSize=3G -XX:MaxNewSize=3G</p>
</td>
</tr>
<tr id="mrs_01_0799__r39bfe2109be84e2bb1757f212f3c7361"><td class="cellrowborder" valign="top" width="28.01%" headers="mcps1.3.5.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__a03cfef126810415795047cb2bbc7b216">100,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="71.99%" headers="mcps1.3.5.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__a61d1ccadcb8a4b738f933413bd59a772">-Xms64G -Xmx64G -XX:NewSize=6G -XX:MaxNewSize=6G</p>
</td>
</tr>
<tr id="mrs_01_0799__r3ee104e2dbe84dd6b2aea0a70d6fb067"><td class="cellrowborder" valign="top" width="28.01%" headers="mcps1.3.5.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__a795cdaa74df54d38aeb6f1317a72d62a">200,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="71.99%" headers="mcps1.3.5.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__aeb30301f03f549c7b5f56ce86b23a410">-Xms96G -Xmx96G -XX:NewSize=9G -XX:MaxNewSize=9G</p>
</td>
</tr>
<tr id="mrs_01_0799__r439309a2fb8c4f19a60122d992e22e77"><td class="cellrowborder" valign="top" width="28.01%" headers="mcps1.3.5.2.1.3.2.2.3.1.1 "><p id="mrs_01_0799__ad0738c3e97f14db9a3a72023f45e6c59">300,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="71.99%" headers="mcps1.3.5.2.1.3.2.2.3.1.2 "><p id="mrs_01_0799__ab31506428f634ad58ac748c65df24232">-Xms164G -Xmx164G -XX:NewSize=12G -XX:MaxNewSize=12G</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</li></ul>
<ul id="mrs_01_0799__uc2d6eed069644d1586585cb49c07e7e8"><li id="mrs_01_0799__l124d264e571145f297a4819c47da23f9">Configuration rules of the DataNode JVM parameter<p id="mrs_01_0799__a37bf1ed1126f4e43a4894e2e5072886d"><a name="mrs_01_0799__l124d264e571145f297a4819c47da23f9"></a><a name="l124d264e571145f297a4819c47da23f9"></a>Default value of the DataNode JVM parameter <strong id="mrs_01_0799__b496261175110">GC_OPTS</strong>: </p>
<p id="mrs_01_0799__p172211247121910">-Xms2G -Xmx4G -XX:NewSize=128M -XX:MaxNewSize=256M -XX:MetaspaceSize=128M -XX:MaxMetaspaceSize=128M -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=65 -XX:+PrintGCDetails -Dsun.rmi.dgc.client.gcInterval=0x7FFFFFFFFFFFFFE -Dsun.rmi.dgc.server.gcInterval=0x7FFFFFFFFFFFFFE -XX:-OmitStackTraceInFastThrow -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -Djdk.tls.ephemeralDHKeySize=3072 -Djdk.tls.rejectClientInitiatedRenegotiation=true -Djava.io.tmpdir=${Bigdata_tmp_dir}</p>
<p id="mrs_01_0799__ae45046f416574593bab3e1e7c29b634a">The average number of blocks stored in each DataNode instance in the cluster is: Number of HDFS blocks x 3/Number of DataNodes. If the average number of blocks changes, you need to change <strong id="mrs_01_0799__b1499310301101">-Xms2G -Xmx4G -XX:NewSize=128M -XX:MaxNewSize=256M</strong> in the default value. The following table lists the reference values.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0799__td322224489704ac6a8d18c21146d6686" frame="border" border="1" rules="all"><caption><b>Table 5 </b>DataNode JVM configuration</caption><thead align="left"><tr id="mrs_01_0799__r5fc0d03f19d54d1082a536369f32ab95"><th align="left" class="cellrowborder" valign="top" width="42.29%" id="mcps1.3.5.3.1.4.2.3.1.1"><p id="mrs_01_0799__a55dc1e45920f45a4b1fadbcc65df9c71">Average Number of Blocks in a DataNode Instance</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="57.709999999999994%" id="mcps1.3.5.3.1.4.2.3.1.2"><p id="mrs_01_0799__a6dca2c4d47794c5eb0adffb5d0324682">Reference Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_0799__r00929d1b71584e8e8f30505a9e2872b3"><td class="cellrowborder" valign="top" width="42.29%" headers="mcps1.3.5.3.1.4.2.3.1.1 "><p id="mrs_01_0799__a416aecf87e5e458c996f243204ef02ff">2,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="57.709999999999994%" headers="mcps1.3.5.3.1.4.2.3.1.2 "><p id="mrs_01_0799__a3d30bc343740499aaaee64ad55b721e9">-Xms6G -Xmx6G -XX:NewSize=512M -XX:MaxNewSize=512M</p>
</td>
</tr>
<tr id="mrs_01_0799__r0e83ba2dd9ed4f1695730d71f1457c24"><td class="cellrowborder" valign="top" width="42.29%" headers="mcps1.3.5.3.1.4.2.3.1.1 "><p id="mrs_01_0799__a67fbb2a910984d69b4b8d77a94c40c8d">5,000,000</p>
</td>
<td class="cellrowborder" valign="top" width="57.709999999999994%" headers="mcps1.3.5.3.1.4.2.3.1.2 "><p id="mrs_01_0799__a692858cc5d8746d1b0136271ef662183">-Xms12G -Xmx12G -XX:NewSize=1G -XX:MaxNewSize=1G</p>
</td>
</tr>
</tbody>
</table>
</div>
<p id="mrs_01_0799__p2063804341310"><strong id="mrs_01_0799__b11482105425420">Xmx</strong> specifies memory which corresponds to the threshold of the number of DataNode blocks, and each GB memory supports a maximum of 500,000 DataNode blocks. Set the memory as required.</p>
</li></ul>
</div>
<div class="section" id="mrs_01_0799__s4846afdaaf204f25b444d5f5405ddca7"><h4 class="sectiontitle">Viewing the HDFS Capacity Status</h4><ul id="mrs_01_0799__ud9a87044a5f7470ca850f964f6893676"><li id="mrs_01_0799__lb11c7d3b1964405aaa3aa6139431c069">NameNode information<p id="mrs_01_0799__p1856245413499"><a name="mrs_01_0799__lb11c7d3b1964405aaa3aa6139431c069"></a><a name="lb11c7d3b1964405aaa3aa6139431c069"></a>For MRS 1.9.2 or earlier: Log in to MRS Manager and choose <strong id="mrs_01_0799__b8751551184616">Services</strong> &gt; <strong id="mrs_01_0799__b282151144610">HDFS</strong> &gt; <strong id="mrs_01_0799__b78313516462">NameNode (Active)</strong>. Click <strong id="mrs_01_0799__b984175164620">Overview</strong> and check the number of file objects, files, directories, or blocks in the HDFS in <strong id="mrs_01_0799__b148515164615">Summary</strong>.</p>
<p id="mrs_01_0799__p128504560114">For versions earlier than MRS 3.<em id="mrs_01_0799__i144711271441">x</em>: Log in to the MRS console, and choose <strong id="mrs_01_0799__b447717720441">Components</strong> &gt; <strong id="mrs_01_0799__b144782704412">HDFS</strong> &gt; <strong id="mrs_01_0799__b747847104416">NameNode (Active)</strong>. Click <strong id="mrs_01_0799__b184788714413">Overview</strong> and check the number of file objects, files, directories, or blocks in the HDFS in <strong id="mrs_01_0799__b1847897124414">Summary</strong>.</p>
<p id="mrs_01_0799__p785017561012">For MRS 3.<em id="mrs_01_0799__i1965527174411">x</em> or later: Log in to FusionInsight Manager, choose <strong id="mrs_01_0799__b1171172715449">Cluster</strong> &gt; <em id="mrs_01_0799__i17711327124412">Name of the desired cluster</em> &gt; <strong id="mrs_01_0799__b1672102744418">Services</strong> &gt; <strong id="mrs_01_0799__b972127174418">HDFS</strong> &gt; <strong id="mrs_01_0799__b2721627204420">NameNode(Active)</strong>, and click <strong id="mrs_01_0799__b12731427104417">Overview</strong> to view information like the number of file objects, files, directories, and blocks in HDFS in <strong id="mrs_01_0799__b10733279442">Summary</strong> area.</p>
</li><li id="mrs_01_0799__le25c009ed7d94bbf804791b935081090">DataNode information<p id="mrs_01_0799__p1128054017617"><a name="mrs_01_0799__le25c009ed7d94bbf804791b935081090"></a><a name="le25c009ed7d94bbf804791b935081090"></a>For MRS 1.9.2 or earlier: Log in to MRS Manager and choose <strong id="mrs_01_0799__b21517201353">Services</strong> &gt; <strong id="mrs_01_0799__b181592010351">HDFS</strong> &gt; <strong id="mrs_01_0799__b31602023519">NameNode (Active)</strong>. Click <strong id="mrs_01_0799__b416182018357">DataNodes</strong> and check the number of blocks of all DataNodes that report alarms.</p>
<p id="mrs_01_0799__a7b195bb3dde04aeb91ad50ef8c59c698">For versions earlier than MRS 3.<em id="mrs_01_0799__i1998534712447">x</em>: Log in to the MRS console and choose <strong id="mrs_01_0799__b17992204712444">Components</strong> &gt; <strong id="mrs_01_0799__b4992174774413">HDFS</strong> &gt; <strong id="mrs_01_0799__b1899364714416">NameNode (Active)</strong>. Click <strong id="mrs_01_0799__b1199354716448">DataNodes</strong> and check the number of blocks of all DataNodes that report alarms.</p>
<p id="mrs_01_0799__p893211211176">For MRS 3.<em id="mrs_01_0799__i576691419474">x </em> or later: Log in to FusionInsight Manager, choose <strong id="mrs_01_0799__b87762146473">Cluster</strong> &gt; <em id="mrs_01_0799__i8778121424718">Name of the desired cluster</em> &gt; <strong id="mrs_01_0799__b1780814164716">Services</strong> &gt; <strong id="mrs_01_0799__b77811414124719">HDFS</strong> &gt; <strong id="mrs_01_0799__b1878316144471">NameNode(Active)</strong>, and click <strong id="mrs_01_0799__b197851014164719">DataNodes</strong> to view the number of blocks on all DataNodes that report alarms.</p>
</li><li id="mrs_01_0799__laf5b2e54d44040e19e2ca4f8089b7217">Alarm information<p id="mrs_01_0799__a675c5eebcc244355b612896ca2a4d92d"><a name="mrs_01_0799__laf5b2e54d44040e19e2ca4f8089b7217"></a><a name="laf5b2e54d44040e19e2ca4f8089b7217"></a>Check whether the alarms whose IDs are 14007, 14008, and 14009 are generated and change the alarm thresholds as required.</p>
</li></ul>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0790.html">Using HDFS</a></div>
</div>
</div>
View Git Blame Copy Permalink