forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
43 lines
5.0 KiB
HTML
43 lines
5.0 KiB
HTML
<a name="mrs_01_1598"></a><a name="mrs_01_1598"></a>
|
|
|
|
<h1 class="topictitle1">Common Issues About Flume</h1>
|
|
<div id="body1596098831033"><p id="mrs_01_1598__ada0e81aa03a04385825a62e865120d08">Flume logs are stored in <strong id="mrs_01_1598__b28193456525424">/var/log/Bigdata/flume/flume/flumeServer.log</strong>. Most data transmission exceptions and data transmission failures are recorded in logs. You can run the following command:</p>
|
|
<p id="mrs_01_1598__a99f4acfbee9b4570ad7c3ccb6e2f93c9"><strong id="mrs_01_1598__a25c6f4b2c5a04e95ad02ccff3c97414a">tailf /var/log/Bigdata/flume/flume/flumeServer.log</strong></p>
|
|
<ul id="mrs_01_1598__u31b4d0b7d23e43999868b7818958e418"><li id="mrs_01_1598__ld252f91c610d442997aa26f436a3f3fe">Problem: After the configuration file is uploaded, an exception occurs. After the configuration file is uploaded again, the scenario requirements are still not met, but no exception is recorded in the log.<p id="mrs_01_1598__af578631217a24dbab3ea512c9686746d"><a name="mrs_01_1598__ld252f91c610d442997aa26f436a3f3fe"></a><a name="ld252f91c610d442997aa26f436a3f3fe"></a>Solution: Restart the Flume process, run the <strong id="mrs_01_1598__a0c3f4c4844fc44209a0ae4112bd702c3">kill -9</strong> <em id="mrs_01_1598__ad84580338beb4e94aa93d6d7fdfafda0">Process code</em> to kill the process code, and view the logs.</p>
|
|
</li><li id="mrs_01_1598__l27ffb3814b434a07a1204ad31be269b7">Issue: <strong id="mrs_01_1598__b127719299325424">"java.lang.IllegalArgumentException: Keytab is not a readable file: /opt/test/conf/user.keytab"</strong> is displayed when HDFS is connected.<p id="mrs_01_1598__ab03955741cf74d97ac3e74009cac0e8b">Solution: Grant the read and write permissions to the Flume running user.</p>
|
|
</li><li id="mrs_01_1598__la61d30a35fc446248ad8e8df48b60098">Problem: The following error is reported when the Flume client is connected to Kafka:<pre class="screen" id="mrs_01_1598__s0efc263a5a4145ec84dd89757fd4efbb">Caused by: java.io.IOException: /opt/FlumeClient/fusioninsight-flume-1.9.0/cof//jaas.conf (No such file or directory)</pre>
|
|
<p id="mrs_01_1598__a56fe7618127f4be5a89b6df72207fd86">Solution: Add the <strong id="mrs_01_1598__b44128350025424">jaas.conf</strong> configuration file and save it to the <strong id="mrs_01_1598__b180048296425424">conf</strong> directory of the Flume client.</p>
|
|
<p id="mrs_01_1598__ade8446448ecf45939b70fc6b4bcba427"><strong id="mrs_01_1598__ab16fcf1e0f594674a45a6132c8620ac6">vi jaas.conf</strong></p>
|
|
<pre class="screen" id="mrs_01_1598__s3cc877cee9414a62b0aa9ea18e248e7b">KafkaClient {
|
|
com.sun.security.auth.module.Krb5LoginModule required
|
|
useKeyTab=true
|
|
keyTab="<strong id="mrs_01_1598__a97cbdb20c75d4a39beb96c842bb8ec74">/opt/test/conf/user.keytab</strong>"
|
|
principal="<strong id="mrs_01_1598__b19132524925424">flume_hdfs@</strong><em id="mrs_01_1598__i64895910025424"><System domain name></em>"
|
|
useTicketCache=false
|
|
storeKey=true
|
|
debug=true;
|
|
};</pre>
|
|
<p id="mrs_01_1598__a88f92b8ae5e647768386328f9a5ecf50">Values of <strong id="mrs_01_1598__b201228920725424">keyTab</strong> and <strong id="mrs_01_1598__b54564851225424">principal</strong> vary depending on the actual situation.</p>
|
|
</li><li id="mrs_01_1598__li94501224132510">Problem: The following error is reported when the Flume client is connected to HBase:<pre class="screen" id="mrs_01_1598__screen445042412259">Caused by: java.io.IOException: /opt/FlumeClient/fusioninsight-flume-1.9.0/cof//jaas.conf (No such file or directory)</pre>
|
|
<p id="mrs_01_1598__p945017245259">Solution: Add the <strong id="mrs_01_1598__b1544021319">jaas.conf</strong> configuration file and save it to the <strong id="mrs_01_1598__b2018460968">conf</strong> directory of the Flume client.</p>
|
|
<p id="mrs_01_1598__p12451192410251"><strong id="mrs_01_1598__b144512246259">vi jaas.conf</strong></p>
|
|
<pre class="screen" id="mrs_01_1598__screen16451224132517">Client {
|
|
com.sun.security.auth.module.Krb5LoginModule required
|
|
useKeyTab=true
|
|
keyTab="<strong id="mrs_01_1598__b16451122410255">/opt/test/conf/user.keytab</strong>"
|
|
principal="<strong id="mrs_01_1598__b203722128111">flume_hbase@</strong><em id="mrs_01_1598__i93777121117"><System domain name></em>"
|
|
useTicketCache=false
|
|
storeKey=true
|
|
debug=true;
|
|
};</pre>
|
|
<p id="mrs_01_1598__p114511024172518">Values of <strong id="mrs_01_1598__b982551646">keyTab</strong> and <strong id="mrs_01_1598__b304752958">principal</strong> vary depending on the actual situation.</p>
|
|
</li><li id="mrs_01_1598__l89b844d676814268b9a9ff24e1d28f4d">Question: After the configuration file is submitted, the Flume Agent occupies resources. How do I restore the Flume Agent to the state when the configuration file is not uploaded?<p id="mrs_01_1598__a3c6ec2c342a1492b97403287c50d0a3f"><a name="mrs_01_1598__l89b844d676814268b9a9ff24e1d28f4d"></a><a name="l89b844d676814268b9a9ff24e1d28f4d"></a>Solution: Submit an empty <strong id="mrs_01_1598__b158930643625424">properties.properties</strong> file.</p>
|
|
</li></ul>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0390.html">Using Flume</a></div>
|
|
</div>
|
|
</div>
|
|
|