forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
41 lines
3.5 KiB
HTML
41 lines
3.5 KiB
HTML
<a name="mrs_01_1969"></a><a name="mrs_01_1969"></a>
|
|
|
|
<h1 class="topictitle1">Configuring Local Disk Cache for JobHistory</h1>
|
|
<div id="body1595920207462"><div class="section" id="mrs_01_1969__section9549105835311"><h4 class="sectiontitle">Scenarios</h4><p id="mrs_01_1969__p26101358135320">JobHistory can use local disks to cache the historical data of Spark applications to prevent the JobHistory memory from loading a large amount of application data, reducing the memory pressure. In addition, the cached data can be reused to improve the speed for subsequent application access.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1969__section45494581530"><h4 class="sectiontitle">Parameter Configuration</h4><p id="mrs_01_1969__p116101958135310">Log in to FusionInsight Manager, choose <strong id="mrs_01_1969__b7610165816535">Cluster</strong> > <em id="mrs_01_1969__i136101658205319">Name of the desired cluster</em> > <strong id="mrs_01_1969__b18610158165319">Service<span id="mrs_01_1969__ph024333783811">s </span></strong>> <strong id="mrs_01_1969__b46101858145312">Spark2x</strong> > <strong id="mrs_01_1969__b16109589535">Configuration<span id="mrs_01_1969__ph173083173812">s</span></strong>, click the <strong id="mrs_01_1969__b261085845315">All Configurations</strong> tab, and search for the following parameters:</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1969__table16550558145310" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_1969__row18610125825318"><th align="left" class="cellrowborder" valign="top" width="32.32323232323232%" id="mcps1.3.2.3.1.4.1.1"><p id="mrs_01_1969__p1761114587535">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="49.494949494949495%" id="mcps1.3.2.3.1.4.1.2"><p id="mrs_01_1969__p186111158175319">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="18.18181818181818%" id="mcps1.3.2.3.1.4.1.3"><p id="mrs_01_1969__p5611185835319">Default Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1969__row17611258195319"><td class="cellrowborder" valign="top" width="32.32323232323232%" headers="mcps1.3.2.3.1.4.1.1 "><p id="mrs_01_1969__p161118585539">spark.history.store.path</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.494949494949495%" headers="mcps1.3.2.3.1.4.1.2 "><p id="mrs_01_1969__p261195855311">Specifies the local directory for storing historical information for JobHistory. If this parameter is specified, JobHistory caches historical application data in the local disk instead of the memory.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.18181818181818%" headers="mcps1.3.2.3.1.4.1.3 "><p id="mrs_01_1969__p96116585534">${BIGDATA_HOME}/tmp/spark2x_JobHistory</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1969__row1361115812534"><td class="cellrowborder" valign="top" width="32.32323232323232%" headers="mcps1.3.2.3.1.4.1.1 "><p id="mrs_01_1969__p186111358115314">spark.history.store.maxDiskUsage</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="49.494949494949495%" headers="mcps1.3.2.3.1.4.1.2 "><p id="mrs_01_1969__p12611558155314">Specifies the maximum available space of the local disk cache.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.18181818181818%" headers="mcps1.3.2.3.1.4.1.3 "><p id="mrs_01_1969__p261125885316">10 GB</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1941.html">Scenario-Specific Configuration</a></div>
|
|
</div>
|
|
</div>
|
|
|