Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

454 lines
76 KiB
HTML

<a name="mrs_01_1070"></a><a name="mrs_01_1070"></a>
<h1 class="topictitle1">Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS</h1>
<div id="body1590374670670"><div class="section" id="mrs_01_1070__s63837e0d53604779abc044799e37cd14"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1070__ab511400a28cb40e2a18e7f020b3ee31d">This section describes how to use Flume to collect static logs from a local host and save them to the <span class="filepath" id="mrs_01_1070__filepath181311316115118"><b>/flume/test</b></span> directory on HDFS.</p>
<p id="mrs_01_1070__p19745357145219">This section applies to MRS 3.<em id="mrs_01_1070__i20891378568">x</em> or later clusters.</p>
</div>
<div class="section" id="mrs_01_1070__s3ba120c845504c72ba30e7f4e776d1cf"><h4 class="sectiontitle">Prerequisites</h4><ul id="mrs_01_1070__u50036eb082a546468c835cd54a786f31"><li id="mrs_01_1070__l103aca486d44440aad7c2592058762ce">The cluster, HDFS and Flume services, and Flume client have been installed.</li><li id="mrs_01_1070__l556f214d7ba24c9fa9365b2f60ea3af2">User <strong id="mrs_01_1070__a46d134db289548b88147f3c1dd18a89b">flume_hdfs</strong> has been created, and the HDFS directory and data used for log verification have been authorized to the user.</li></ul>
</div>
<div class="section" id="mrs_01_1070__s12ceb7b28cd146eea6c543d8e6390ddc"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1070__o1a2ac8ea01fd4293b287171bf924bcb7"><li id="mrs_01_1070__l83561ee811fd4abfa36d97ef09f7496e"><span>Generate the certificate trust lists of the server and client of the Flume role respectively.</span><p><ol type="a" id="mrs_01_1070__o00f39ab0e1664fb2bef2d7114a9e671c"><li id="mrs_01_1070__ld9e763f97ea143a6bca401d5e7e6cbe8">Log in to the node where the Flume server is located as user <strong id="mrs_01_1070__a597cadffc14e4a0892bd542c8a4692a4">omm</strong>. Go to the <strong id="mrs_01_1070__b988350040104951">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text2070459640104951">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/bin</strong> directory.<p class="litext" id="mrs_01_1070__a7626c8f5378a480a88a575dd8f6c66fa"><strong id="mrs_01_1070__b5910915214534">cd ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b274162114614"><span id="mrs_01_1070__text21372265301">8.1.0.1</span></strong><strong id="mrs_01_1070__b6222032714534">/install/FusionInsight-Flume-1.9.0/flume/bin</strong></p>
</li><li id="mrs_01_1070__l05708c139ecf4019b9273b04ed7302c5">Run the following command to generate and export the server and client certificates of the Flume role:<p id="mrs_01_1070__a4170d0e0c13441f6ab321221d4d74b70"><a name="mrs_01_1070__l05708c139ecf4019b9273b04ed7302c5"></a><a name="l05708c139ecf4019b9273b04ed7302c5"></a><strong id="mrs_01_1070__b1758382615413">sh geneJKS.sh -f </strong><em id="mrs_01_1070__i1585142611543">Password</em><strong id="mrs_01_1070__b6592144010549"> -g </strong><em id="mrs_01_1070__i159494020543">Password</em></p>
<p id="mrs_01_1070__a71a4acd8f1b9491ca367ba04310218fe">The generated certificate is saved in the <strong id="mrs_01_1070__b1635663672104951">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text1633720399304">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf</strong> path .</p>
<ul id="mrs_01_1070__ucb4c250beab64a379fc41d23cde87fde"><li id="mrs_01_1070__l0dd9e3ab0c6c4b23b57b1b5b9e91f67f"><strong id="mrs_01_1070__b785241608104951">flume_sChat.jks</strong> is the certificate library of the Flume role server. <strong id="mrs_01_1070__b531817215104951">flume_sChat.crt</strong> is the exported file of the <strong id="mrs_01_1070__b1627946617104951">flume_sChat.jks</strong> certificate. <strong id="mrs_01_1070__b766196190104951">-f</strong> indicates the password of the certificate and certificate library.</li><li id="mrs_01_1070__l5101bde602e849fc925132e4bb7baf21"><strong id="mrs_01_1070__b1208263910104951">flume_cChat.jks</strong> is the certificate library of the Flume role client. <strong id="mrs_01_1070__b561601091104951">flume_cChat.crt</strong> is the exported file of the <strong id="mrs_01_1070__b161735276104951">flume_cChat.jks</strong> certificate. <strong id="mrs_01_1070__b1512281083104951">-g</strong> indicates the password of the certificate and certificate library.</li><li id="mrs_01_1070__l8facc0e950d24ea6a0aee1b57032a98d"><strong id="mrs_01_1070__b1580316623104951">flume_sChatt.jks</strong> and <strong id="mrs_01_1070__b940441738104951">flume_cChatt.jks</strong> are the SSL certificate trust lists of the Flume server and client, respectively.</li></ul>
<div class="note" id="mrs_01_1070__n6a637ad04c984c9d9eafc68a9f79b835"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1070__p143613814388">All user-defined passwords involved in this section must meet the following requirements:</p>
<ul id="mrs_01_1070__u38ae135c213a40398fe2aa0c75cda2e7"><li id="mrs_01_1070__l2c306cb638b14e59ae26b9d31b0cb0b6">Contain at least four types of the following: uppercase letters, lowercase letters, digits, and special characters.</li><li id="mrs_01_1070__le3ba4aec0a93485c98dfbb1d8acafc76">Contain at least eight characters and a maximum of 64 characters.</li><li id="mrs_01_1070__lfdd03f0ab2c6463482cc41685862df9a">It is recommended that the user-defined passwords be changed periodically (for example, every three months), and certificates and trust lists be generated again to ensure security.</li></ul>
</div></div>
</li></ol>
</p></li><li id="mrs_01_1070__lca080467707b449c9a038280ad94e35a"><span>On FusionInsight Manager, choose <span class="menucascade" id="mrs_01_1070__menucascade1899812533104952"><b><span class="uicontrol" id="mrs_01_1070__uicontrol1094336722104952">System &gt; User</span></b></span> and choose <span class="menucascade" id="mrs_01_1070__menucascade1340641587104952"><b><span class="uicontrol" id="mrs_01_1070__uicontrol2054014999104952">More &gt; Download Authentication Credential</span></b></span> to download the Kerberos certificate file of user <strong id="mrs_01_1070__b1836265617104952">flume_hdfs</strong> and save it to the local host.</span></li><li id="mrs_01_1070__la4d7a7788ffa45648ad511339d0b3113"><span>Configure the server parameters of the Flume role and upload the configuration file to the cluster.</span><p><ol type="a" id="mrs_01_1070__odfe73296f8cf415592b3e5acae052bd3"><li id="mrs_01_1070__lf0e7614622d14ddcaf63501cd20f73e2">Log in to any node where the Flume role is located as user <strong id="mrs_01_1070__a44287c9b77c94d288e60185d24824ae9">omm</strong>. Run the following command to go to the ${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text188011847103013">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/bin directory:<p class="litext" id="mrs_01_1070__a8758b6bb2511436580005638606da434"><strong id="mrs_01_1070__b46603468145431">cd ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b13386138477"><span id="mrs_01_1070__text17623557143019">8.1.0.1</span></strong><strong id="mrs_01_1070__b16778036145431">/install/FusionInsight-Flume-1.9.0/flume/bin</strong></p>
</li><li id="mrs_01_1070__lf43fc3e7d9364ddb9e475908dc382fc9"><a name="mrs_01_1070__lf43fc3e7d9364ddb9e475908dc382fc9"></a><a name="lf43fc3e7d9364ddb9e475908dc382fc9"></a>Run the following command to generate and obtain Flume server keystore password, trust list password, and keystore-password encrypted private key information. Enter the password twice and confirm the password. It is the password of the <strong id="mrs_01_1070__b1574783214549">flume_sChat.jks</strong> certificate library.<p class="litext" id="mrs_01_1070__a0f09e07f4b3e4d26b6d27145a205f57b"><strong id="mrs_01_1070__af7ea78ea6d6b43bebd06f17d7f9b9cc7">./genPwFile.sh</strong></p>
<p class="litext" id="mrs_01_1070__a49e0d7494bb54d1898e40a3ba0bcfcbe"><strong id="mrs_01_1070__a6f8a62a3b3cb4a808e581fbfcd1e666e">cat password.property</strong></p>
</li><li id="mrs_01_1070__l24027020a88b4d629db99127218a9491">Use the Flume configuration tool on the FusionInsight Manager portal to configure the server parameters and generate the configuration file.<ol class="substepthirdol" id="mrs_01_1070__of5ab587718ff4266a75101e7aa787722"><li id="mrs_01_1070__lf460e069ca6c4dec94978b695408fda9">Log in to FusionInsight Manager and choose <strong id="mrs_01_1070__b1164124182104952">Cluster</strong> &gt; <em id="mrs_01_1070__i990046449104952">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b510931232104952">Services</strong> &gt; <strong id="mrs_01_1070__b1096450158104952">Flume</strong> &gt; <strong id="mrs_01_1070__b501578691104952">Configuration Tool</strong>.</li><li id="mrs_01_1070__lcae18c7361f24f2683b26142f90ccd76">Set <strong id="mrs_01_1070__b878980162104952">Agent Name</strong> to <strong id="mrs_01_1070__b792570175104952">server</strong>. Select the source, channel, and sink to be used, drag them to the GUI on the right, and connect them.<p id="mrs_01_1070__a0265a66da3db445b93844f745ba92937">For example, use SpoolDir Source, File Channel, and HDFS Sink.</p>
</li><li id="mrs_01_1070__ld82d2fef38be4871883b2bbe613af12f">Double-click the source, channel, and sink. Set corresponding configuration parameters by seeing <a href="#mrs_01_1070__t90702710f4c74f1ea2a89064a9507879">Table 1</a> based on the actual environment.<div class="note" id="mrs_01_1070__n8ed400ad4af048bcadf0344efcf57537"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_1070__ucecad4cb71794eb98c13fbc470758299"><li id="mrs_01_1070__lc7ef65e51daa4c1d8f63dd9057d0c179">If the server parameters of the Flume role have been configured, you can choose <strong id="mrs_01_1070__b15412052823">Cluster</strong> &gt; <em id="mrs_01_1070__i441725214211">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b3418105218212">Services</strong> &gt; <strong id="mrs_01_1070__b7418135219210">Flume</strong> &gt; <strong id="mrs_01_1070__b114186524210">Instance</strong> on FusionInsight Manager. Then select the corresponding Flume role instance and click the <strong id="mrs_01_1070__b17419165217213">Download</strong> button behind the <span class="parmname" id="mrs_01_1070__parmname341919521427"><b>flume.config.file</b></span> parameter on the <strong id="mrs_01_1070__b2041913521922">Instance Configurations</strong> page to obtain the existing server parameter configuration file. Choose <strong id="mrs_01_1070__b1045953305104952">Cluster</strong> &gt; <em id="mrs_01_1070__i702503371104952">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b111311495104952">Services</strong> &gt; <strong id="mrs_01_1070__b1069526376104952">Flume</strong> &gt; <strong id="mrs_01_1070__b1051793077104952">Configuration Tool</strong> &gt; <strong id="mrs_01_1070__b1836257705104952">Import</strong>, import the file, and modify the configuration items related to encrypted transmission.</li><li id="mrs_01_1070__l23ce9e15935244b2a6f7c1e01a853961">It is recommended that the numbers of Sources, Channels, and Sinks do not exceed 40 during configuration file import. Otherwise, the response time may be very long.</li><li id="mrs_01_1070__lb5fb23d31fcd4b0ab6affa5e1b4afab5">A unique checkpoint directory needs to be configured for each File Channel.</li></ul>
</div></div>
</li><li id="mrs_01_1070__l22e65a4a2681414692d4c1fdf1ec3021">Click <strong id="mrs_01_1070__b293674249104952">Export</strong> to save the <strong id="mrs_01_1070__b1933901249104952">properties.properties</strong> configuration file to the local.
<div class="tablenoborder"><a name="mrs_01_1070__t90702710f4c74f1ea2a89064a9507879"></a><a name="t90702710f4c74f1ea2a89064a9507879"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1070__t90702710f4c74f1ea2a89064a9507879" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters to be modified of the Flume role server</caption><thead align="left"><tr id="mrs_01_1070__rbec5666027594644b0e026d0dd3e42bc"><th align="left" class="cellrowborder" valign="top" width="23.232323232323232%" id="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1"><p id="mrs_01_1070__a03643503c1624f7b9051d053605bf65e">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="45.45454545454545%" id="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2"><p id="mrs_01_1070__a82395e0e53694244b935bc8e780c1f20">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="31.313131313131308%" id="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3"><p id="mrs_01_1070__a986c741cb330449998f974e639d443d9">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1070__r0444bbec47a04a6bb3b7d2e96aac6861"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a27785445600940a7b890bb44a6a5bc45">Name</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__ad7bf239b45a548fab6d47aa078335863">The value must be unique and cannot be left blank.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a90f111512a6349a3be995b5a5e18253a">test</p>
</td>
</tr>
<tr id="mrs_01_1070__ra4405a10590243c8ab77761a7f26c9ea"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a315127f3442040d396fcd6132d4a7f23">bind</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a46fb734df635475ea86a693cadd35554">Specifies the IP address to which Avro Source is bound. This parameter cannot be left blank. It must be configured as the IP address that the server configuration file will upload.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__ae06e2bb191fb436f8cdafa097f76b079">192.168.108.11</p>
</td>
</tr>
<tr id="mrs_01_1070__r0b01b4a178e44cceaf74f2beebd00828"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a974e464734414500a54d92b7fd6f0b08">port</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__en-us_topic_0060839710_p480995094046">Specifies the IP address to which Avro Source is bound. This parameter cannot be left blank. It must be configured as an unused port.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__af953959e3ce24f9da2df791536e6a5d1">21154</p>
</td>
</tr>
<tr id="mrs_01_1070__ref74df2737f04b52be0a774d2d69aa61"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a2ace248be08c44b0967993943a867776">ssl</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__ac9369e95b8e74ed2a82667cc1bc8b9c0">Indicates whether to enable the SSL authentication. (You are advised to enable this function to ensure security.)</p>
<p id="mrs_01_1070__ab5c9cc6bfd524a50b7d04ead87f7e33f">Only Sources of the Avro type have this configuration item.</p>
<ul id="mrs_01_1070__u1af6060595d54d8291a74a31318f1676"><li id="mrs_01_1070__l7f80b1248faa467a893d01eb89949fab"><strong id="mrs_01_1070__b1129724386104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l674721b6eda94688b6f6949d97d064ae"><strong id="mrs_01_1070__b1236310780104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__en-us_topic_0060839710_p931667094046">true</p>
</td>
</tr>
<tr id="mrs_01_1070__rad7b6eda06844d49862fdfbe6f023d7a"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a803e88fa3df748b2bad22fe01ed8910e">keystore</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a039156d97a784e9f91beb89f736292c4">Indicates the server certificate.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__en-us_topic_0060839710_p857749495638">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text07235611312">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/flume_sChat.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__rf88135c58d7d42648793a9b683a9eed1"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ae293f7b8b0574edfb8300ca8a9436986">keystore-password</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a2706b298df3c4168b99c847008d31c38">Specifies the password of the key library, which is the password required to obtain the keystore information.</p>
<p id="mrs_01_1070__ae0dca6b202a7497ca3c793c9c00f7cff">Enter the value of <strong id="mrs_01_1070__b17172171218314">password</strong> obtained in <a href="#mrs_01_1070__lf43fc3e7d9364ddb9e475908dc382fc9">3.b</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__ac79ed2a7f6e04d9997e864da3dbe9fd5">-</p>
</td>
</tr>
<tr id="mrs_01_1070__r05b18526050445108467c4e27d948219"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ab93ddd8ba4f34852902c10df13dbe878">truststore</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a15b1bf7d5a33483d9f75f8a0adda258a">Indicates the SSL certificate trust list of the server.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a588edc5affb248d18753e9685aa404f6">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text1010314157314">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/flume_sChatt.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__r5ff1d3ecfe9f481ebdb47bd8a7c0addc"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ad551236699e641d2a799a7cf921d2f0f">truststore-password</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a66085966187546eb849479fd9d3cb465">Specifies the trust list password, which is the password required to obtain the truststore information.</p>
<p id="mrs_01_1070__a63667d0cf91340dcaea8d56b8c825069">Enter the value of <strong id="mrs_01_1070__b931612158320">password</strong> obtained in <a href="#mrs_01_1070__lf43fc3e7d9364ddb9e475908dc382fc9">3.b</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a605fa1b8c56d471082a0a72d1ede0916">-</p>
</td>
</tr>
<tr id="mrs_01_1070__r79609bfef5a84543a70304911f757a7c"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a3f3f610f3edb45a5bc20997c1e9b183e">dataDirs</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a95d4466118d4438eb1088179015d1fa3">Specifies the directory for storing buffer data. The run directory is used by default. Configuring multiple directories on disks can improve transmission efficiency. Use commas (,) to separate multiple directories. If the directory is inside the cluster, the <strong id="mrs_01_1070__b229296064104952">/srv/BigData/hadoop/dataX/flume/data</strong> directory can be used. <strong id="mrs_01_1070__b487884345104952">dataX</strong> ranges from data1 to dataN. If the directory is outside the cluster, it needs to be independently planned.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a6cc522124cd04ce9816c2a2c7fcdb12a">/srv/BigData/hadoop/data1/flumeserver/data</p>
</td>
</tr>
<tr id="mrs_01_1070__r83ee2f2c314447d0b839a3316f4b4f07"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__afe3e8fc1fa0a49a2a9786de789c1a18d">checkpointDir</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a2fd38acd52644131af665e207b90249a">Specifies the directory for storing the checkpoint information, which is under the run directory by default. If the directory is inside the cluster, the <strong id="mrs_01_1070__b1574181203104952">/srv/BigData/hadoop/dataX/flume/checkpoint</strong> directory can be used. <strong id="mrs_01_1070__b2079906255104952">dataX</strong> ranges from data1 to dataN. If the directory is outside the cluster, it needs to be independently planned.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a57182d3d08d4483f90677f9b74bc2869">/srv/BigData/hadoop/data1/flumeserver/checkpoint</p>
</td>
</tr>
<tr id="mrs_01_1070__r38c53a9c0358492e896e8121fa3723d8"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__en-us_topic_0060839710_p556837117935">transactionCapacity</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__abf1de5444a694a5996c0f58d2e440c83">Specifies the transaction size, that is, the number of events in a transaction that can be processed by the current Channel. The size cannot be smaller than the batchSize of Source. Setting the same size as batchSize is recommended.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a37aa9fbbbc6742b6b9a912028d13d5f3">61200</p>
</td>
</tr>
<tr id="mrs_01_1070__rfa783464d1184afe9a1c5e794d5e7f76"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a779c7a5d073e4697a17d943af1884902">hdfs.path</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a3d9eca2b67ab4f879e45f9f89c151402">Specifies the HDFS data write directory. This parameter cannot be left blank.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a75c0bde2e9fd4905a80cb0e15ecd5040">hdfs://hacluster/flume/test</p>
</td>
</tr>
<tr id="mrs_01_1070__ra5ee5238b5d84f909040e2d91672d2ab"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__en-us_topic_0060839710_p524966649487">hdfs.inUsePrefix</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__en-us_topic_0060839710_p243713979487">Specifies the prefix of the file that is being written to HDFS.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__en-us_topic_0060839710_p279261599487">TMP_</p>
</td>
</tr>
<tr id="mrs_01_1070__r442817d372de4aaab26b131c300b6670"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a14cdf9f64a73430f9e6d0594ef367351">hdfs.batchSize</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a609b0d1ed1c04eaf82642d17bc2ad611">Specifies the maximum number of events that can be written to HDFS once.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__acdc1b379150041378905e993b54fb7c8">61200</p>
</td>
</tr>
<tr id="mrs_01_1070__r1562e66f4e224625a82045d3286caec6"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a3d333fadac5048d7aee0101115f8b9ef">hdfs.kerberosPrincipal</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a5fcec07332b14bf7bb1a6e71ebb49221">Specifies the Kerberos authentication user, which is mandatory in security versions. This configuration is required only in security clusters.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a8d746e16448245e6a26cc9e6a90b9886">flume_hdfs</p>
</td>
</tr>
<tr id="mrs_01_1070__r8f6ecc849e1f4b6ca4129f41316c6c2c"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ace4482be79a94dd8b87f2f2cf4a081dd">hdfs.kerberosKeytab</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a186efcff372a4df1b7ab5a9df2d318f0">Specifies the keytab file path for Kerberos authentication, which is mandatory in security versions. This configuration is required only in security clusters.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a8f5e842fa6c64a12987bf5bcfd8113b4">/opt/test/conf/user.keytab</p>
<div class="note" id="mrs_01_1070__nc6926a1d75834cbcbe55232423352a3e"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="mrs_01_1070__a48dc66e4a319407d9682532b5cd856b7">Obtain the <strong id="mrs_01_1070__b1807478240104952">user.keytab</strong> file from the Kerberos certificate file of the user <strong id="mrs_01_1070__b352547569104952">flume_hdfs</strong>. In addition, ensure that the user who installs and runs the Flume client has the read and write permissions on the <strong id="mrs_01_1070__b1608049667104952">user.keytab</strong> file.</p>
</div></div>
</td>
</tr>
<tr id="mrs_01_1070__re45efe9ce0e04456a8367098d16b9522"><td class="cellrowborder" valign="top" width="23.232323232323232%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a896023d904ea4f8a9671ca2a092d7a8f">hdfs.useLocalTimeStamp</p>
</td>
<td class="cellrowborder" valign="top" width="45.45454545454545%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a0ac7d0c23a814e28bf8a99d85fe12f94">Specifies whether to use the local time. Possible values are <strong id="mrs_01_1070__b968003533104952">true</strong> and <strong id="mrs_01_1070__b1739716312104952">false</strong>.</p>
</td>
<td class="cellrowborder" valign="top" width="31.313131313131308%" headers="mcps1.3.3.2.3.2.1.3.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a3c881fb89ccd43c3bd7985fe953dbd0d">true</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ol>
</li><li id="mrs_01_1070__l356732ad8b794c4fba8784b9b4bcf144">Log in to FusionInsight Manager and choose <strong id="mrs_01_1070__b951453130104952">Cluster</strong> &gt; <em id="mrs_01_1070__i1090063146104952">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b1949731304104952">Services</strong> &gt; <strong id="mrs_01_1070__b96750393104952">Flume</strong>. On the displayed page, click the <strong id="mrs_01_1070__b223643166104952">Flume</strong> role under <strong id="mrs_01_1070__b92044485104952">Role</strong>.</li><li id="mrs_01_1070__l3e9dc432a7dd41f3b8bd6871ea0aca24">Select the Flume role of the node where the configuration file is to be uploaded, choose <strong id="mrs_01_1070__b768572263104952">Instance Configurations</strong> &gt; <strong id="mrs_01_1070__b1666340232104952">Import</strong> beside the <span class="parmname" id="mrs_01_1070__parmname2036377222104952"><b>flume.config.file</b></span>, and select the <strong id="mrs_01_1070__b1296778312104952">properties.properties</strong> file.<div class="note" id="mrs_01_1070__nea8cee4324544e56a89bacadf451d751"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_1070__u572f2ae78e1a46f7863ae67265f5a9e3"><li class="text" id="mrs_01_1070__l969f1588c47f473cad05307ff4c713d4">An independent server configuration file can be uploaded to each Flume instance.</li><li class="text" id="mrs_01_1070__l726f005782df4c248bf124e42a99a70b">This step is required for updating the configuration file. Modifying the configuration file on the background is an improper operation because the modification will be overwritten after configuration synchronization.</li></ul>
</div></div>
</li><li id="mrs_01_1070__l783987fd571f4c5aaec7979eda517643">Click <strong id="mrs_01_1070__b65617157104952">Save</strong>, and then click <strong id="mrs_01_1070__b17684498104952">OK</strong>.</li><li id="mrs_01_1070__ld0c1b7a7ff414281960554ea82c46f51">Click <strong id="mrs_01_1070__b1360587764104952">Finish</strong>.</li></ol>
</p></li><li id="mrs_01_1070__l55405cfc77f54395bc7a39d79a1b11f1"><span>Configure the client parameters of the Flume role.</span><p><ol type="a" id="mrs_01_1070__o3c81eff66f954ca793e0b8f9d8047da7"><li id="mrs_01_1070__l32c83dcc7c984a8db53b0548e4921bee">Run the following commands to copy the generated client certificate (<strong id="mrs_01_1070__b3445133325512">flume_cChat.jks</strong>) and client trust list (<strong id="mrs_01_1070__b5451133318558">flume_cChatt.jks</strong>) to the client directory, for example, <strong id="mrs_01_1070__b545173325517">/opt/flume-client/fusionInsight-flume-1.9.0/conf/</strong>. (The Flume client must have been installed.) <strong id="mrs_01_1070__b194525330550">10.196.26.1</strong> is the service plane IP address of the node where the client resides.<p class="litext" id="mrs_01_1070__a2adb288ce73e4380a18e4b25be5ca34e"><strong id="mrs_01_1070__b43872971145457">scp ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b52322351812"><span id="mrs_01_1070__text724923223117">8.1.0.1</span></strong><strong id="mrs_01_1070__b59312427145457">/install/FusionInsight-Flume-1.9.0/flume/conf/flume_cChat.jks user@10.196.26.1:/opt/flume-client/fusionInsight-flume-1.9.0/conf/</strong></p>
<div class="litext" id="mrs_01_1070__ad5f1323eb22a4fa6861a364b2a3d831c"><strong id="mrs_01_1070__b4492439514556">scp ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b13644183718817"><span id="mrs_01_1070__text353024612319">8.1.0.1</span></strong><strong id="mrs_01_1070__b36879054145513">/install/FusionInsight-Flume-1.9.0/flume/conf/flume_cChatt.jks user@10.196.26.1:/opt/flume-client/fusionInsight-flume-1.9.0/conf/</strong><div class="note" id="mrs_01_1070__nc309832bf90b42289e8d5836d05b5d60"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p class="text" id="mrs_01_1070__en-us_topic_0060839710_p785106964">When copying the client certificate, you need to enter the password of user <strong id="mrs_01_1070__b564223024104952">user</strong> of the host (for example, <strong id="mrs_01_1070__b2022254028104952">10.196.26.1</strong>) where the client resides.</p>
</div></div>
</div>
</li><li id="mrs_01_1070__l57ccadce94dd45f0b47130297e1b0f28">Log in to the node where the Flume client is decompressed as user <strong id="mrs_01_1070__a448e63604ec6452eb0720f3eb260cc4c">user</strong>. Run the following command to go to the client directory <strong id="mrs_01_1070__b1613310363559">/opt/flume-client/fusionInsight-flume-1.9.0/bin</strong>.<p class="litext" id="mrs_01_1070__ac8084453e135409e8e3d7818ae842867"><strong id="mrs_01_1070__a345e2d5d5dd2468bb0130b2bf2678048">cd </strong>opt/flume-client/fusionInsight-flume-1.9.0/bin</p>
</li><li id="mrs_01_1070__lf5cdb5eca44842caac47a27a09a4e206"><a name="mrs_01_1070__lf5cdb5eca44842caac47a27a09a4e206"></a><a name="lf5cdb5eca44842caac47a27a09a4e206"></a>Run the following command to generate and obtain Flume client keystore password, trust list password, and keystore-password encrypted private key information. Enter the password twice and confirm the password. The password is the same as the password of the certificate whose alias is <em id="mrs_01_1070__i8627539105415">flumechatclient</em> and the password of the <em id="mrs_01_1070__i1363314398546">flume_cChat.jks</em> certificate library.<p class="litext" id="mrs_01_1070__a15fb654156d94c69901ac2ddef6717ef"><strong id="mrs_01_1070__ac01a94c1ba734b48b5273f168577b4d5">./genPwFile.sh</strong></p>
<p class="litext" id="mrs_01_1070__a3d00db8e264b466996c747693ec1763f"><strong id="mrs_01_1070__a5a87e1ece20f469789f54dabd836c4fb">cat password.property</strong></p>
<div class="note" id="mrs_01_1070__ne4d902c177744c4a90b45cda3a6560b1"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p class="text" id="mrs_01_1070__a2059043a83144e1b8a1e66b17eba03fa">If the following error message is displayed, run the export <strong id="mrs_01_1070__b974168206104952">JAVA_HOME=<em id="mrs_01_1070__i1264942505104952">JDK</em><em id="mrs_01_1070__i777764513104952">path</em></strong> command.</p>
<pre class="screen" id="mrs_01_1070__s8b22645265054232b427f1f4f4113dcd">JAVA_HOME is null in current user,please install the JDK and set the JAVA_HOME</pre>
</div></div>
</li><li id="mrs_01_1070__li1686593619549">Run the <strong id="mrs_01_1070__b18251759173018">echo $SCC_PROFILE_DIR</strong> command to check whether the <strong id="mrs_01_1070__b68252059143014">SCC_PROFILE_DIR</strong> environment variable is empty.<ul id="mrs_01_1070__ul6543127125720"><li id="mrs_01_1070__li125431627125712">If yes, run the <strong id="mrs_01_1070__b598614513317">source .sccfile</strong> command.</li><li id="mrs_01_1070__li1483204513576">If no, go to <a href="#mrs_01_1070__l5e1fd98241304e658764a6bdc63d7299">4.e</a>.</li></ul>
</li><li id="mrs_01_1070__l5e1fd98241304e658764a6bdc63d7299"><a name="mrs_01_1070__l5e1fd98241304e658764a6bdc63d7299"></a><a name="l5e1fd98241304e658764a6bdc63d7299"></a>Use the Flume configuration tool on FusionInsight Manager to configure the Flume role client parameters and generate a configuration file.<ol class="substepthirdol" id="mrs_01_1070__o6ea13f384eaa4b3f9771bc9f68bf30bc"><li id="mrs_01_1070__le47b78ecc342486694c389aa27f737c2">Log in to FusionInsight Manager and choose <strong id="mrs_01_1070__b656766594104952">Cluster</strong> &gt; <em id="mrs_01_1070__i1413592460104952">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b1734021559104952">Services</strong> &gt; <strong id="mrs_01_1070__b870443989104952">Flume</strong> &gt; <strong id="mrs_01_1070__b1065093709104952">Configuration Tool</strong>.</li><li id="mrs_01_1070__l3854778cbe2147ec8c6fb5199b5ae3c9">Set <strong id="mrs_01_1070__b176271091104952">Agent Name</strong> to <strong id="mrs_01_1070__b255175550104952">client</strong>. Select the source, channel, and sink to be used, drag them to the GUI on the right, and connect them.<p id="mrs_01_1070__a1ff6667c01b1401186e185ef92f3362c">Use SpoolDir Source, File Channel, and HDFS Sink.</p>
</li><li id="mrs_01_1070__l0c63e7971a9a4787870327bba82d518b">Double-click the source, channel, and sink. Set corresponding configuration parameters by seeing <a href="#mrs_01_1070__t4e49dd595a71448eb33a418332772306">Table 2</a> based on the actual environment.<div class="note" id="mrs_01_1070__n561af40ae0e84f7f9de02999ecf734d0"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_1070__ucdb817f7fcbe4312860d3bceb17472e2"><li id="mrs_01_1070__l60e988e84abe40ac9a48bec3d3f9c946">If the client parameters of the Flume role have been configured, you can obtain the existing client parameter configuration file from <em id="mrs_01_1070__i1185959806104952">client installation directory</em><strong id="mrs_01_1070__b2038139280104952">/fusioninsight-flume-1.9.0/conf/properties.properties</strong> to ensure that the configuration is in concordance with the previous. Log in to FusionInsight Manager, choose <strong id="mrs_01_1070__b866480613104952">Cluster</strong> &gt; <em id="mrs_01_1070__i1478176286104952">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b201569333104952">Services</strong> &gt; <strong id="mrs_01_1070__b1024007974104952">Flume</strong> &gt; <strong id="mrs_01_1070__b624651067104952">Configuration Tool</strong> &gt; <strong id="mrs_01_1070__b609344092104952">Import</strong>, import the file, and modify the configuration items related to encrypted transmission.</li><li id="mrs_01_1070__l896ac7100a754f8c9dfbfa019fb8db18">It is recommended that the numbers of Sources, Channels, and Sinks do not exceed 40 during configuration file import. Otherwise, the response time may be very long.</li></ul>
</div></div>
</li><li id="mrs_01_1070__l7434fe452c964ae7a4706d59d743d856">Click <strong id="mrs_01_1070__b1256693960104952">Export</strong> to save the <strong id="mrs_01_1070__b586313445104952">properties.properties</strong> configuration file to the local.
<div class="tablenoborder"><a name="mrs_01_1070__t4e49dd595a71448eb33a418332772306"></a><a name="t4e49dd595a71448eb33a418332772306"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1070__t4e49dd595a71448eb33a418332772306" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameters to be modified of the Flume role client</caption><thead align="left"><tr id="mrs_01_1070__ra28a1f500fce4420b6f628aaf828baae"><th align="left" class="cellrowborder" valign="top" width="33%" id="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1"><p id="mrs_01_1070__a57376fd48b134640a4ac225a8b9af4d3">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="33%" id="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2"><p id="mrs_01_1070__a0c92a872a5964d098ef820708b919758">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="34%" id="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3"><p id="mrs_01_1070__a3d7488d4377043ee8f997510d5f62b27">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1070__ra8d24df0fa464f7a979a0d4c7a232c0d"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ae112955790fc460a9fb913e108eb491d">Name</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a295a4df6f69645be876f9dc887fdf018">The value must be unique and cannot be left blank.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a00ed9e8b9b4d48c88decde172bd5fbd0">test</p>
</td>
</tr>
<tr id="mrs_01_1070__r30c402805da042d881d03efc82fad1ca"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a6bdd92a0b2f34f20be83e2e15e6ebdc0">spoolDir</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a25ad30888ff94f57bcd55a2e6d2c6a2c">Specifies the directory where the file to be collected resides. This parameter cannot be left blank. The directory needs to exist and have the write, read, and execute permissions on the flume running user.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a3038886b42c44c7b82dc3a8b247416d1">/srv/BigData/hadoop/data1/zb</p>
</td>
</tr>
<tr id="mrs_01_1070__rcaf7a4fb720849c59e6bbff978266a8a"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a0d82afe651be42819b548b057c2f381e">trackerDir</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__ac2048c9e834d4eadba77d003c77fe867">Specifies the path for storing the metadata of files collected by Flume.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__ab61ee34ea837420bb008c3cb559998d1">/srv/BigData/hadoop/data1/tracker</p>
</td>
</tr>
<tr id="mrs_01_1070__rb97f0d90585b4d54b1f2cbc58a04498c"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__en-us_topic_0060839710_p23544582637">batch-size</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a97c17f0dc4a34878b15baa39fbc53001">Specifies the number of events that Flume sends in a batch.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__en-us_topic_0060839710_p125642482637">61200</p>
</td>
</tr>
<tr id="mrs_01_1070__r28c7b7e33b62427f9e4dbfa6f113746b"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a298fcbcfcaed412bb76a5183444110b1">dataDirs</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__af9da3ddde2a5403ea81e3ec2d6b8fce9">Specifies the directory for storing buffer data. The run directory is used by default. Configuring multiple directories on disks can improve transmission efficiency. Use commas (,) to separate multiple directories. If the directory is inside the cluster, the <strong id="mrs_01_1070__b500535095104952">/srv/BigData/hadoop/dataX/flume/data</strong> directory can be used. <strong id="mrs_01_1070__b696512861104952">dataX</strong> ranges from data1 to dataN. If the directory is outside the cluster, it needs to be independently planned.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__acc63ce1a459a4554b5a6c10b4ebefe99">/srv/BigData/hadoop/data1/flume/data</p>
</td>
</tr>
<tr id="mrs_01_1070__r5431f7df1b6347b382a7d8c421f85040"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ad473217e4f804cb38108f503bf83c02f">checkpointDir</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a03b2be2b3628400798749f76ae345664">Specifies the directory for storing the checkpoint information, which is under the run directory by default. If the directory is inside the cluster, the <strong id="mrs_01_1070__b993365573104952">/srv/BigData/hadoop/dataX/flume/checkpoint</strong> directory can be used. <strong id="mrs_01_1070__b669929031104952">dataX</strong> ranges from data1 to dataN. If the directory is outside the cluster, it needs to be independently planned.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__ab1da401177c649ffafdbf75ee51a5fea">/srv/BigData/hadoop/data1/flume/checkpoint</p>
</td>
</tr>
<tr id="mrs_01_1070__r55696d02c3ac41f5a6b775ecd3da4653"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a4ebf96cced95489cb9bc03245d3b4a79">transactionCapacity</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a9b400bbb110742dd9e4639312724d51d">Specifies the transaction size, that is, the number of events in a transaction that can be processed by the current Channel. The size cannot be smaller than the batchSize of Source. Setting the same size as batchSize is recommended.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a9f48f99d3cd74201adb9a91a9d620cb9">61200</p>
<p id="mrs_01_1070__a7355d31838cf4430946b2521ac9ee897"></p>
</td>
</tr>
<tr id="mrs_01_1070__r7d536a21a0eb4894ac929cd1ef74978a"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a968d2db1a4ac4f238d33e5c44c133675">hostname</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a7797c894bc6a4586b264771cf05a8bf0">Specifies the name or IP address of the host whose data is to be sent. This parameter cannot be left blank. Name or IP address must be configured to be the name or IP address that the Avro source associated with it.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a095348482ca647f7937458dfb5e1a6f0">192.168.108.11</p>
</td>
</tr>
<tr id="mrs_01_1070__r077cbe171426476a8f0232ca7df4012d"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__addc892c437a347bfb210a8740195495c">port</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a5a9f7e14311a4ad8b089bc7fed512ec1">Specifies the IP address to which Avro Sink is bound. This parameter cannot be left blank. It must be consistent with the port that is monitored by the connected Avro Source.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a193a75180e1545089fa389349fbe557b">21154</p>
</td>
</tr>
<tr id="mrs_01_1070__r54903abfd44b4219862330364380c9a9"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ab26804d95c1349029dd555c3404780db">ssl</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__aef87becad47b49d5b85850cc021b679a">Specifies whether to enable the SSL authentication. (You are advised to enable this function to ensure security.)</p>
<p id="mrs_01_1070__aed966883fc4b4601aed036c2cc185f34">Only Sources of the Avro type have this configuration item.</p>
<ul id="mrs_01_1070__u2fa06bf475874e6a8df1ddbe1b353b99"><li id="mrs_01_1070__lfc268d5b4a6d41dbb07e99983edb7d88"><strong id="mrs_01_1070__b1161561457104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l0fd9d81d5e294a8db22467e0ebb3d83f"><strong id="mrs_01_1070__b1107609016104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a19a7d361a61d4d4ba39aac0a7396606c">true</p>
</td>
</tr>
<tr id="mrs_01_1070__r37115470a23d4318b262e919a5e9aa30"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__ab5a24284fcd6411aa9b282166c281855">keystore</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a5b90d19171a941ae82444376c10b2873">Specifies the <strong id="mrs_01_1070__b39531149115616">flume_cChat.jks</strong> certificate generated on the server.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__abae55908d8f747e9be16915274c16b84">/opt/flume-client/fusionInsight-flume-1.9.0/conf/flume_cChat.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__r7e3ac3293b144033b5db98437fd2a746"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a679ae72a0c7343a9993f3e670130ebea">keystore-password</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__aa0db62a87ea84e9ca62cc1f55114e004">Specifies the password of the key library, which is the password required to obtain the keystore information.</p>
<p id="mrs_01_1070__a49beaf5160fb4c638fc2d668a0323abc">Enter the value of <strong id="mrs_01_1070__b83681824141516">password</strong> obtained in <a href="#mrs_01_1070__lf5cdb5eca44842caac47a27a09a4e206">4.c</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a9a422e51f8164c388e70d1300f1c4a2a">-</p>
</td>
</tr>
<tr id="mrs_01_1070__r802c5265075a4d1087099569def34083"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__acc4a2194807e4e1aa9d2a07cae30db37">truststore</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__a6dac63edc6264dd480c0d8aade710691">Indicates the SSL certificate trust list of the server.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__a906711a25f6f4d5e8f84639a54c11e09">/opt/flume-client/fusionInsight-flume-1.9.0/conf/flume_cChatt.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__r2f84a52cb4034aa5962f361cbbf372c3"><td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.1 "><p id="mrs_01_1070__a3f5f19de93ce41f7a58f59b5241dbf87">truststore-password</p>
</td>
<td class="cellrowborder" valign="top" width="33%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.2 "><p id="mrs_01_1070__en-us_topic_0060839710_p228138101149">Specifies the trust list password, which is the password required to obtain the truststore information.</p>
<p id="mrs_01_1070__acf0fac7cb92d49d885769304ee2536dd">Enter the value of <strong id="mrs_01_1070__b144992030141518">password</strong> obtained in <a href="#mrs_01_1070__lf5cdb5eca44842caac47a27a09a4e206">4.c</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="34%" headers="mcps1.3.3.2.4.2.1.5.1.4.3.2.4.1.3 "><p id="mrs_01_1070__ad0f6df20d7e74dd7a550b02dfbfacac1">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ol>
</li><li id="mrs_01_1070__lbf205c7f289b4b1ea4a0cf316570c1ea">Upload the <strong id="mrs_01_1070__b1172311321154">properties.properties</strong> file to <strong id="mrs_01_1070__b19724193241515">flume/conf/</strong> under the installation directory of the Flume client.</li></ol>
</p></li><li id="mrs_01_1070__l0f65006f239a42dbb35cdddac6963031"><span>Generate the certificate and trust list of the server and client of the MonitorServer role respectively.</span><p><ol type="a" id="mrs_01_1070__o674a2c57577d401ba09fe20aca34c88b"><li id="mrs_01_1070__l7f37c5893c724b8b835e252c14f0cdc4">Log in to the host with the MonitorServer role assigned as user <strong id="mrs_01_1070__a1adf161139ac42a4a9ddebf61e911357">omm</strong>.<p id="mrs_01_1070__a634df154a1f54bf4870f549386a2ead8">Go to the <strong id="mrs_01_1070__b67151048161520">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text57151448131516">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/bin</strong> directory.</p>
<p class="litext" id="mrs_01_1070__a39dc79b2b1974da7a21807c1437443f2"><strong id="mrs_01_1070__b30152378145538">cd ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b10137131911914"><span id="mrs_01_1070__text1563411843319">8.1.0.1</span></strong><strong id="mrs_01_1070__b2935954145538">/install/FusionInsight-Flume-1.9.0/flume/bin</strong></p>
</li><li id="mrs_01_1070__ld2beb20e5e464a919398b52285b42152">Run the following command to generate and export the server and client certificates of the MonitorServer role:<p id="mrs_01_1070__a9894bb741bc44aefbdc45d4b16564f87"><a name="mrs_01_1070__ld2beb20e5e464a919398b52285b42152"></a><a name="ld2beb20e5e464a919398b52285b42152"></a><strong id="mrs_01_1070__b125768104587">sh geneJKS.sh -m </strong><em id="mrs_01_1070__i87518111582">Password</em><strong id="mrs_01_1070__b18293202110588"> -n </strong><em id="mrs_01_1070__i4295152185813">Password</em></p>
<p id="mrs_01_1070__ac767ca5bb42a4a2f96a7cd0c03b39402">The generated certificate is saved in the <strong id="mrs_01_1070__b834345251511">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text133819527150">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf</strong> path. Where:</p>
<ul id="mrs_01_1070__ue46d777eb0884d2696da5c7a152da402"><li id="mrs_01_1070__l7b82f97a1c9042ac9c95677897148d83"><strong id="mrs_01_1070__b11403354161510">ms_sChat.jks</strong> is the certificate library of the MonitorServer role server. <strong id="mrs_01_1070__b1040325481514">ms_sChat.crt</strong> is the exported file of the <strong id="mrs_01_1070__b6403195419159">ms_sChat.jks</strong> certificate. <strong id="mrs_01_1070__b15404145401514">-m</strong> indicates the password of the certificate and certificate library.</li><li id="mrs_01_1070__la438eb82813946039e6d9911fd1156a2"><strong id="mrs_01_1070__b1215515620152">ms_cChat.jks</strong> is the certificate library of the MonitorServer role client. <strong id="mrs_01_1070__b01552567155">ms_cChat.crt</strong> is the exported file of the <strong id="mrs_01_1070__b5156105601517">ms_cChat.jks</strong> certificate. <strong id="mrs_01_1070__b315675661517">-n</strong> indicates the password of the certificate and certificate library.</li><li id="mrs_01_1070__la2ef992015404aed8928b8a8ee4e6f43"><strong id="mrs_01_1070__b14339115821511">ms_sChatt.jks</strong> and <strong id="mrs_01_1070__b8339205818158">ms_cChatt.jks</strong> are the SSL certificate trust lists of the MonitorServer server and client, respectively.</li></ul>
</li></ol>
</p></li><li id="mrs_01_1070__l899932fdf8a740beab9ce05d2467697b"><span>Set the server parameters of the MonitorServer role.</span><p><ol type="a" id="mrs_01_1070__of6322b96099745218c8fb3f7ca14a322"><li id="mrs_01_1070__la6ea6d1571ea4b2a94b3c942a18144db"><a name="mrs_01_1070__la6ea6d1571ea4b2a94b3c942a18144db"></a><a name="la6ea6d1571ea4b2a94b3c942a18144db"></a>Run the following command to generate and obtain MonitorServer server keystore password, trust list password, and keystore-password encrypted private key information. Enter the password twice and confirm the password. The password is the same as the password of the certificate whose alias is <em id="mrs_01_1070__i576419422541">mschatserver</em> and the password of the <em id="mrs_01_1070__i11764142205420">ms_sChat.jks</em> certificate library.<p class="litext" id="mrs_01_1070__a10e052a7e2cd437f8231041d107af6e7"><strong id="mrs_01_1070__a013a76a9dbf04c37a1f872caa7c9990b">./genPwFile.sh</strong></p>
<p class="litext" id="mrs_01_1070__a91d3194985b24964bbfb4106c26b93be"><strong id="mrs_01_1070__a6e5b67fd4d9b4c16bbf7f99cb24ade92">cat password.property</strong></p>
</li><li id="mrs_01_1070__l8b4e493ad9744a61a09e79c5d58d18d2">Run the following command to open the ${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text15149163303312">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/service/application.properties file: Modify related parameters based on the description in <a href="#mrs_01_1070__tc32e0ef5ae504791afb953e98354efa7">Table 3</a>, save the modification, and exit.<p class="litext" id="mrs_01_1070__adb023539f6204424b78e5361f5a0f7f7"><strong id="mrs_01_1070__b5140511714564">vi ${BIGDATA_HOME}/FusionInsight_Porter_</strong><span id="mrs_01_1070__text2037614419339">8.1.0.1</span><strong id="mrs_01_1070__b5999287214564">/install/FusionInsight-Flume-1.9.0/flume/conf/service/application.properties</strong></p>
<div class="tablenoborder"><a name="mrs_01_1070__tc32e0ef5ae504791afb953e98354efa7"></a><a name="tc32e0ef5ae504791afb953e98354efa7"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1070__tc32e0ef5ae504791afb953e98354efa7" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Parameters to be modified of the MonitorServer role server</caption><thead align="left"><tr id="mrs_01_1070__re82c89438bf54f508afd3cabf271f931"><th align="left" class="cellrowborder" valign="top" width="22.447755224477554%" id="mcps1.3.3.2.6.2.1.2.4.2.4.1.1"><p id="mrs_01_1070__a603b408e78064907b380bfb7035df900">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="38.77612238776123%" id="mcps1.3.3.2.6.2.1.2.4.2.4.1.2"><p id="mrs_01_1070__a9dc86e7fe5b244c48a314dc16bb45b50">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="38.77612238776123%" id="mcps1.3.3.2.6.2.1.2.4.2.4.1.3"><p id="mrs_01_1070__af706bb65e50e4b2ea9ff238380c76c3d">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1070__r5b2ffcc1a57245eeb87309c3ffd9cdf2"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__aefd015a536b04b6381c5e53c44167bc4">ssl_need_kspasswd_decrypt_key</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__afd4653ac1e5e4e2dac490bb76e8511c8">Indicates whether to enable the user-defined key encryption and decryption function. (You are advised to enable this function to ensure security.)</p>
<ul id="mrs_01_1070__u76c2ad1195ae45c98896a28619652b19"><li id="mrs_01_1070__l2b115a18f77a4c668dfaa029a36ceda8"><strong id="mrs_01_1070__b1247717861104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l3f4c62b3942440afbc4c0de7ce4df757"><strong id="mrs_01_1070__b1945209252104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__a18876ca7c388454d88b43c48bf77e644">true</p>
</td>
</tr>
<tr id="mrs_01_1070__rbcc56b7a21214821abf7792a736b1d68"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__a1ae6fb062a36401fa8a6ecf240799e82">ssl_server_enable</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__a3212d9f2113c46a6b01c7ef3c91683be">Indicates whether to enable the SSL authentication. (You are advised to enable this function to ensure security.)</p>
<ul id="mrs_01_1070__u331bf3ac5c03487ca5f70db9ec0f5dfe"><li id="mrs_01_1070__l0dbc6bc5aa7641f2b35b6f59bee3a242"><strong id="mrs_01_1070__b785343601104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l4565675e34b64bd09605cd039f9f97d7"><strong id="mrs_01_1070__b267024270104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__a314bfda487284dcdaf55029e2c41170a">true</p>
</td>
</tr>
<tr id="mrs_01_1070__rb8869a549851426fb88c28468562bd31"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__a15a8b93875014c43aa3180267144deb2">ssl_server_key_store</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__a4837b667e2074f3ebbce0fbbdcf3d61e">Set this parameter based on the specific storage location.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__a44b4b383998044baa1a84403fad959d0">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text10738195017335">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/ms_sChat.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__r078e75688fdb43a8b048cf254e0bbcb4"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__a48a7263245ed4c55831867c1bec5a2ab">ssl_server_trust_key_store</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__a41bf4ffccb964d29a14a9a8e5c48149c">Set this parameter based on the specific storage location.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__aa51e05df19584524aabfe025928fa9b1">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text124722058133315">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/ms_sChatt.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__r2faecccbf21849e8999cb730d15aa1e1"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__a120ef63970214518b2d4df0f50b92435">ssl_server_key_store_password</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__aaebe28da69494058ab9522c3288a19ae">Indicates the client certificate password. Set this parameter based on the actual situation of certificate creation (the plaintext key used to generate the certificate).</p>
<p id="mrs_01_1070__a591fcaa7eaa54c25a241cfbf105ba0f0">Enter the value of <strong id="mrs_01_1070__b82273915513">password</strong> obtained in <a href="#mrs_01_1070__la6ea6d1571ea4b2a94b3c942a18144db">6.a</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__a5b80817c7f7144378c4d9cc831e83343">-</p>
</td>
</tr>
<tr id="mrs_01_1070__rb2310f5de2fc4bdd80117580a180a346"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__a7f31d8cabd6e40ac9d4284a3c8c57550">ssl_server_trust_key_store_password</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__a17110e34d0214284b86d9074a066e95b">Indicates the client trust list password. Set this parameter based on the actual situation of certificate creation (the plaintext key used to generate the trust list).</p>
<p id="mrs_01_1070__a025f00b22e7c40ca9f56b4ae31ea8792">Enter the value of <strong id="mrs_01_1070__b273171211511">password</strong> obtained in <a href="#mrs_01_1070__la6ea6d1571ea4b2a94b3c942a18144db">6.a</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__ae371e9e324bc493997d3ab1085779d08">-</p>
</td>
</tr>
<tr id="mrs_01_1070__r9e0d1750029c4ef7b4b8b7cc32e3abe7"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.1 "><p id="mrs_01_1070__aea7fffbe975e478c820b3a4d96956ce5">ssl_need_client_auth</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.2 "><p id="mrs_01_1070__ae2c74bc46f2a41caaa87cad6e8e9b9b8">Indicates whether to enable the client authentication. (You are advised to enable this function to ensure security.)</p>
<ul id="mrs_01_1070__u0487c5b166eb411caf58e0b500924775"><li id="mrs_01_1070__l5c92c046c2744911878b3f0d9476f313"><strong id="mrs_01_1070__b985087478104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l758e4c8c84e0497093aa18075a8fafdb"><strong id="mrs_01_1070__b1047642015104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.6.2.1.2.4.2.4.1.3 "><p id="mrs_01_1070__abd4fa243e99044028603bca162761a35">true</p>
</td>
</tr>
</tbody>
</table>
</div>
</li><li id="mrs_01_1070__la3707532484d49ac92e98c39399a9f8f">Restart the MonitorServer instance. Choose <strong id="mrs_01_1070__b1840865956104952">Cluster &gt; </strong><em id="mrs_01_1070__i1481729195104952">Name of the desired cluster</em><strong id="mrs_01_1070__b1492904927104952"> &gt; Services &gt; Flume &gt; Instance &gt; MonitorServer</strong>, select the configured MonitorServer instance, and choose <strong id="mrs_01_1070__b2129731110104952">More &gt; Restart Instance</strong>. Enter the <span id="mrs_01_1070__ph4382163112204">system </span>administrator password and click <strong id="mrs_01_1070__b18238822191711">OK</strong>. After the restart is complete, click <strong id="mrs_01_1070__b82441822131718">Finish</strong>.</li></ol>
</p></li><li id="mrs_01_1070__l19f65593655c4fd4880c6d84cf31b6b7"><span>Set the client parameters of the MonitorServer role.</span><p><ol type="a" id="mrs_01_1070__of6d61a3bba02484dbd600d32ec4c9447"><li id="mrs_01_1070__l6b98060caf0a47e987547bca68f9f33b">Run the following commands to copy the generated client certificate (<strong id="mrs_01_1070__b1632969831104952">ms_cChat.jks</strong>) and client trust list (<strong id="mrs_01_1070__b873302067104952">ms_cChatt.jks</strong>) to the <strong id="mrs_01_1070__b1836760642104952">/opt/flume-client/fusionInsight-flume-1.9.0/conf/</strong> client directory. <strong id="mrs_01_1070__b1641931916104952">10.196.26.1</strong> is the service plane IP address of the node where the client resides.<p class="litext" id="mrs_01_1070__ad98fd953f9494e89a498dd0b6916f4df"><strong id="mrs_01_1070__b38111446145645">scp ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b2811154991"><span id="mrs_01_1070__text534417810342">8.1.0.1</span></strong><strong id="mrs_01_1070__b7458702145645">/install/FusionInsight-Flume-1.9.0/flume/conf/ms_cChat.jks user@10.196.26.1:/opt/flume-client/fusionInsight-flume-1.9.0/conf/</strong></p>
<p class="litext" id="mrs_01_1070__a508c979b9fbc44c18ddb28c7c3635f19"><strong id="mrs_01_1070__b25097680145722">scp ${BIGDATA_HOME}/FusionInsight_Porter_</strong><strong id="mrs_01_1070__b383854395"><span id="mrs_01_1070__text543094612349">8.1.0.1</span></strong><strong id="mrs_01_1070__b24552533145722">/install/FusionInsight-Flume-1.9.0/flume/conf/ms_cChatt.jks user@10.196.26.1:/opt/flume-client/fusionInsight-flume-1.9.0/conf/</strong></p>
</li><li id="mrs_01_1070__l3e70e6c57e714dad8d39183fdde2d428">Log in to the node where the Flume client is located as user <strong id="mrs_01_1070__b69745287172">user</strong>. Run the following command to go to the client directory <strong id="mrs_01_1070__b239844125516">/opt/flume-client/fusionInsight-flume-1.9.0/bin</strong>.<p class="litext" id="mrs_01_1070__a29ec5e3de737405ba3e5fbce7af30276"><strong id="mrs_01_1070__ac565c8f418684b898eb08c34e3da4b00">cd </strong>/opt/flume-client/fusionInsight-flume-1.9.0/bin</p>
</li><li id="mrs_01_1070__l6c040d3a99c04a7d87c53e59bafe8394"><a name="mrs_01_1070__l6c040d3a99c04a7d87c53e59bafe8394"></a><a name="l6c040d3a99c04a7d87c53e59bafe8394"></a>Run the following command to generate and obtain MonitorServer client keystore password, trust list password, and keystore-password encrypted private key information. Enter the password twice and confirm the password. The password is the same as the password of the certificate whose alias is <em id="mrs_01_1070__i19391443546">mschatclient</em> and the password of the <em id="mrs_01_1070__i17939174415542">ms_cChat.jks</em> certificate library.<p class="litext" id="mrs_01_1070__aadcc5fc162e545d8a59d827a616c7fa7"><strong id="mrs_01_1070__en-us_topic_0060839710_b453368310244">./genPwFile.sh</strong></p>
<p class="litext" id="mrs_01_1070__aabf525e8f4334d9ba705f541e1713e43"><strong id="mrs_01_1070__abd3a02f7ae5a4cc6a7276a942fad3914">cat password.property</strong></p>
</li><li id="mrs_01_1070__l6aa418ceef8946b785cdec8aeba8fd97">Run the following command to open the <strong id="mrs_01_1070__b129194311552">/opt/flume-client/fusionInsight-flume-1.9.0/conf/service/application.properties</strong> file. (<strong id="mrs_01_1070__b429204312557">/opt/flume-client/fusionInsight-flume-1.9.0</strong> is the directory where the client is installed.) Modify related parameters based on the description in <a href="#mrs_01_1070__ta0130cca376a4aaf833fa310a2e59e9d">Table 4</a>, save the modification, and exit.<p id="mrs_01_1070__a2ca23409708546c1b487ea1c9a2a5cc1"><strong id="mrs_01_1070__a9d23ecf37a2942c0a6081cae37584f97">vi </strong><strong id="mrs_01_1070__a7cda6e6fe43742838bc0e4db0f30c5fb">/opt/flume-client/fusionInsight-flume-1.9.0/conf/service/application.properties</strong></p>
<div class="tablenoborder"><a name="mrs_01_1070__ta0130cca376a4aaf833fa310a2e59e9d"></a><a name="ta0130cca376a4aaf833fa310a2e59e9d"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1070__ta0130cca376a4aaf833fa310a2e59e9d" frame="border" border="1" rules="all"><caption><b>Table 4 </b>Parameters to be modified of the MonitorServer role client</caption><thead align="left"><tr id="mrs_01_1070__r6dfc637517dc41d19e7738b7bab3e2e0"><th align="left" class="cellrowborder" valign="top" width="22.447755224477554%" id="mcps1.3.3.2.7.2.1.4.5.2.4.1.1"><p id="mrs_01_1070__adddbfe2d86ee41e4b14bca1629ee4978">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="38.77612238776123%" id="mcps1.3.3.2.7.2.1.4.5.2.4.1.2"><p id="mrs_01_1070__a6cebeb4f97284ffb8205bb1bfef701d5">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="38.77612238776123%" id="mcps1.3.3.2.7.2.1.4.5.2.4.1.3"><p id="mrs_01_1070__addf295b2a8264fff8905146e798f167a">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1070__rb70a9b2c29704ea1be3b3fce666b67ba"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__a71f56a6b48a04ce88d78175ac5c9014b">ssl_need_kspasswd_decrypt_key</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__ad937b223d342465a8fab36846c13bca5">Indicates whether to enable the user-defined key encryption and decryption function. (You are advised to enable this function to ensure security.)</p>
<ul id="mrs_01_1070__u5340dd120efc49128942ef44e6825b8e"><li id="mrs_01_1070__l2017f621f5734639b580fb0d63e5e221"><strong id="mrs_01_1070__b1973086566104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__lfc627b00ae9644728d2431f67448d298"><strong id="mrs_01_1070__b1095462851104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__ab55ac790d8334086ae2651b9607e0abc">true</p>
</td>
</tr>
<tr id="mrs_01_1070__r152fb80db11a4565ab0fda9b54ca9b35"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__afba864f97cb94dac82ed64fd64c4354b">ssl_client_enable</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__a8bb1c54c12f24b3981a2288fe6834550">Indicates whether to enable the SSL authentication. (You are advised to enable this function to ensure security.)</p>
<ul id="mrs_01_1070__u0c2c3c5e49c84591ba5ac7e805232cf0"><li id="mrs_01_1070__lce9a5b26060c43c99688ef9584e552d8"><strong id="mrs_01_1070__b790509637104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l8251eb5300684d2d884bb3dfd6f68461"><strong id="mrs_01_1070__b365534410104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__en-us_topic_0060839710_p763480710244">true</p>
</td>
</tr>
<tr id="mrs_01_1070__r85c0d97b535f47bb97f723581a76271c"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__aa403dcb79a704454aa6534169f484986">ssl_client_key_store</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__aa2c3bd53f62e494aa19386628d734146">Set this parameter based on the specific storage location.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__a055371110f9246d1ac795235a87f4a97">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text13470557342">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/ms_cChat.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__rd899e9066a444f7d8c69d4ca106f3518"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__add33f1889759451d8c72b3add05f8d47">ssl_client_trust_key_store</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__a96498e0afbd14a93a9701290e6dfb52c">Set this parameter based on the specific storage location.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__a361c96fcc0a24750837d1da46d3eefe5">${BIGDATA_HOME}/FusionInsight_Porter_<span id="mrs_01_1070__text9751714359">8.1.0.1</span>/install/FusionInsight-Flume-1.9.0/flume/conf/ms_cChatt.jks</p>
</td>
</tr>
<tr id="mrs_01_1070__r8d00a92e3c89447c9007c5ca2994c9c3"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__en-us_topic_0060839710_p520838410244">ssl_client_key_store_password</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__a1124f26d4b784441a7437f57ff020470">Specifies the keystore password. Set this parameter based on the actual situation of certificate creation (the plaintext key used to generate the certificate).</p>
<p id="mrs_01_1070__afd727474b4854881bd8d726746ee2012">Enter the value of <strong id="mrs_01_1070__b967405103104952">password</strong> obtained in <a href="#mrs_01_1070__l6c040d3a99c04a7d87c53e59bafe8394">7.c</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__a77b7d318730d4d14918316fdd56a5118">-</p>
</td>
</tr>
<tr id="mrs_01_1070__r5244ce99deb0439caaf1890d4f79ae5e"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__ac1b0ca849be847f59a15fb655e0d3d94">ssl_client_trust_key_store_password</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__en-us_topic_0060839710_p770177010244">Specifies the trustkeystore password. Set this parameter based on the actual situation of certificate creation (the plaintext key used to generate the trust list).</p>
<p id="mrs_01_1070__en-us_topic_0060839710_p220707410244">Enter the value of <strong id="mrs_01_1070__b16388560179">password</strong> obtained in <a href="#mrs_01_1070__l6c040d3a99c04a7d87c53e59bafe8394">7.c</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__a4f3f189c913f406a807b0790b1946095">-</p>
</td>
</tr>
<tr id="mrs_01_1070__rdf3b81b6cfd14fc4bca24071c931ed27"><td class="cellrowborder" valign="top" width="22.447755224477554%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.1 "><p id="mrs_01_1070__en-us_topic_0060839710_p90628710244">ssl_need_client_auth</p>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.2 "><p id="mrs_01_1070__en-us_topic_0060839710_p630042310244">Indicates whether to enable the client authentication. (You are advised to enable this function to ensure security.)</p>
<ul id="mrs_01_1070__u88c3aeac08724c3ea424449fa132b0f7"><li id="mrs_01_1070__l75645e8eec834d2db2964926cff8da7d"><strong id="mrs_01_1070__b746339633104952">true</strong> indicates that the function is enabled.</li><li id="mrs_01_1070__l2abf2a0930cc41c2816ce0420054f750"><strong id="mrs_01_1070__b1836527190104952">false</strong> indicates that the client authentication function is not enabled.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="38.77612238776123%" headers="mcps1.3.3.2.7.2.1.4.5.2.4.1.3 "><p id="mrs_01_1070__aa15986c343f14bde806a6b7a48d053f2">true</p>
</td>
</tr>
</tbody>
</table>
</div>
</li></ol>
</p></li></ol><ol start="8" id="mrs_01_1070__o1393fc75fc8544849f7284b866c0a0ea"><li id="mrs_01_1070__lb11cce026dd74ec0ac87a5f6ec04d6c1"><span>Verify log transmission.</span><p><ol type="a" id="mrs_01_1070__od82843c3cf0942dd80e1fe937bb9901f"><li id="mrs_01_1070__l7e6c8d5fc4b24d85aa7c490dc77e7928">Log in to FusionInsight Manager as a user who has the management permission on HDFS. For details, see <a href="mrs_01_2124.html">Accessing FusionInsight Manager (MRS 3.x or Later)</a>. Choose <strong id="mrs_01_1070__b4762142119512">Cluster &gt; </strong><em id="mrs_01_1070__i137681521759">Name of the desired cluster</em> &gt; <strong id="mrs_01_1070__b876962116518">Services</strong> &gt; <strong id="mrs_01_1070__b1876913211458">HDFS</strong>, click the HDFS WebUI link to go to the HDFS WebUI, and choose <strong id="mrs_01_1070__b48404013412">Utilities</strong> &gt; <strong id="mrs_01_1070__b172129435347">Browse the file system</strong>.</li><li id="mrs_01_1070__l622578e9279e4f1f82d87b701f686ab7">Check whether the data is generated in the <strong id="mrs_01_1070__b1371251670104952">/flume/test</strong> directory on the HDFS.</li></ol>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1068.html">Encrypted Transmission</a></div>
</div>
</div>