Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

17 lines
1.3 KiB
HTML

<a name="mrs_01_1792"></a><a name="mrs_01_1792"></a>
<h1 class="topictitle1">Why Cannot HDFS_DELEGATION_TOKEN Be Found in the Cache?</h1>
<div id="body1596092470015"><div class="section" id="mrs_01_1792__s51f33678783145dc8e627e3bba82c224"><h4 class="sectiontitle">Question</h4><p id="mrs_01_1792__a4717e1a14f0249a280a246e6d8a15dd6">In security mode, why delegation token HDFS_DELEGATION_TOKEN is not found in the cache?</p>
</div>
<div class="section" id="mrs_01_1792__s18974b5f38cc4fda86991b7799dc7b8c"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_1792__ad4100498a97d4ea2bac063e735654a4a">In MapReduce, by default HDFS_DELEGATION_TOKEN will be canceled after the job completion. So if the token has to be re- used for the next job then the token will not be found in the cache.</p>
</div>
<p id="mrs_01_1792__a108f82309ec3476f94b173e018995fd9">To re-use the same token in subsequent job set the below parameter for the MR job configuration. When it is false the user can re-sue the same token.</p>
<pre class="screen" id="mrs_01_1792__s4529f926ff8449e2b78a06a7e3f014b2">jobConf.setBoolean("mapreduce.job.complete.cancel.delegation.tokens", false);</pre>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1788.html">Common Issues About MapReduce</a></div>
</div>
</div>