forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
85 lines
7.3 KiB
HTML
85 lines
7.3 KiB
HTML
<a name="mrs_01_1567"></a><a name="mrs_01_1567"></a>
|
|
|
|
<h1 class="topictitle1">Blob</h1>
|
|
<div id="body1596163871715"><div class="section" id="mrs_01_1567__s2907a8ef3b24408fa1726c426993c7ef"><h4 class="sectiontitle">Scenarios</h4><p id="mrs_01_1567__aee960e74b9f34d4ab06fd0d9a1c02cfc">The <span id="mrs_01_1567__ph3554933871084">Blob server</span> on the <span id="mrs_01_1567__ph4156709531084">JobManager</span> node is used to receive JAR files uploaded by users on the client, send <span id="mrs_01_1567__ph3134183881084">JAR files</span> to <span id="mrs_01_1567__ph7451928551084">TaskManager</span>, and transfer log files. Flink provides some items for configuring the Blob server. You can configure them in the <span class="filepath" id="mrs_01_1567__filepath9812393431084"><b>flink-conf.yaml</b></span> configuration file.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1567__s1dda55073bdf40e98843ebd36d00dbe1"><h4 class="sectiontitle">Configuration Description</h4><p id="mrs_01_1567__ad07a581e610a4f82bcaca1dd20c7fa7b">Users can configure the port, SSL, retry times, and concurrency.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1567__t8681d04030274ad1ac93e9e0a10e132c" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="mrs_01_1567__r7540ecc2d5a747e5a14b76145b9439f4"><th align="left" class="cellrowborder" valign="top" width="25%" id="mcps1.3.2.3.2.5.1.1"><p id="mrs_01_1567__a2f7bb0a3060e49e384857816a86673b7">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="37.28%" id="mcps1.3.2.3.2.5.1.2"><p id="mrs_01_1567__ab48dd49e62674d2890cf28f8caad6dcb">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="22.79%" id="mcps1.3.2.3.2.5.1.3"><p id="mrs_01_1567__a7a53e097d0e64736b9a2d2c4a6dde592">Default Value</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="14.93%" id="mcps1.3.2.3.2.5.1.4"><p id="mrs_01_1567__acf1a6b6ced9a4421ade24e44188b4e0a">Mandatory</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1567__r09d34cca8e9742859b079eb9ad05d644"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1567__a11b0d66f367642a08052e705611aa133">blob.server.port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="37.28%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1567__a18586dc1f072476f85a1340248e6bf12">Blob server port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.79%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1567__a3c89d1fd315e4f6b8894e89f10b53c6f">32456 to 32520</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.93%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1567__aa9823911a1234fb190aa631c86649d47">No</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1567__rd9cb29afd02c49d781fd71898581d498"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1567__a657e7bce4a164bc9be641554439af672">blob.service.ssl.enabled</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="37.28%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1567__a8559b08fed74435bbbc0c9dde5c55744">Indicates whether to enable the encryption for the blob transmission channel. This parameter is valid only when the global switch <strong id="mrs_01_1567__b7684847721084">security.ssl</strong> is enabled.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.79%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1567__a73c0dcb5566d4cb09c77c720613cf633">true</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.93%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1567__ac0ac1c4be13240179ca709d9efc6613d">Yes</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1567__rde69cfb0c6d84a1a8d570aeb01e25b8b"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1567__a0cca223e2537445ea291e0b4366d20f3">blob.fetch.retries</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="37.28%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1567__a32d72f9686274bcdbc154570b526750a">Number of times that TaskManager tries to download blob files from JobManager.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.79%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1567__a66ce81d10fa24e4aa7e3da719969bcef">50</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.93%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1567__a4d620b941650443485b5b1a4ca4a7c38">No</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1567__rccfdd6ea334c494c9a6ff9bfc8e6d42d"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1567__a8c2d3ad94baf4ddab17e204aee4dd193">blob.fetch.num-concurrent</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="37.28%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1567__a92da2aa4fb894110bf7c678edcc5757c">Number of concurrent tasks for downloading blob files supported by JobManager.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.79%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1567__a56c0042d3fb247079a9173319877f85c">50</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.93%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1567__a60dcca3fa3184c2c827d265be2af93a8">No</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1567__r100fb969b86f410680b1ee9b017b6694"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1567__a8c154b12c7c748b38efc31776cabee2b">blob.fetch.backlog</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="37.28%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1567__ae85937ea648a41a9bc698b79eb0ad85f">Number of blob files, such as <strong id="mrs_01_1567__b1549091382715">.jar</strong> files, to be downloaded in the queue supported by JobManager. The unit is count.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.79%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1567__a4f9f480e35374494bd2914cf1cc5aee7">1000</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.93%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1567__a765fe8d278114fc48961a017a045cfca">No</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1567__r78b87f82197a4d0c98d9365d0a629404"><td class="cellrowborder" valign="top" width="25%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1567__aa385d06fcffe4f2eaeedd368748fd793">library-cache-manager.cleanup.interval</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="37.28%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1567__ab87fe3ea483f4a5f9db4b68bb516348e">Interval at which JobManager deletes the JAR files stored on the HDFS when the user cancels the Flink job. The unit is second.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.79%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1567__ad2f2c835daf94681b43ff9bde723034c">3600</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.93%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1567__af25d72d56eb34c1caa3a03761e100726">No</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<div class="note" id="mrs_01_1567__note2495182912427"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1567__p134968291427">For versions earlier than MRS 3.x, <strong id="mrs_01_1567__b15618213291">library-cache-manager.cleanup.interval</strong> cannot be configured.</p>
|
|
</div></div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0592.html">Flink Configuration Management</a></div>
|
|
</div>
|
|
</div>
|
|
|