Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

66 lines
6.1 KiB
HTML

<a name="mrs_01_1578"></a><a name="mrs_01_1578"></a>
<h1 class="topictitle1">Pipeline</h1>
<div id="body1596163871769"><div class="section" id="mrs_01_1578__sc4e966a4c6c54ecd95d884994851137c"><h4 class="sectiontitle">Scenarios</h4><p id="mrs_01_1578__a6266c63352bb4306a6af0b968c6b1589">The Netty connection is used among multiple jobs to reduce latency. In this case, NettySink is used on the server and NettySource is used on the client for data transmission.</p>
<p id="mrs_01_1578__p1371095814434">This section applies to MRS 3.<em id="mrs_01_1578__i35701219105111">x</em> or later clusters.</p>
</div>
<div class="section" id="mrs_01_1578__s9651fe49bcda4dd7a6626cd58ac1c85b"><h4 class="sectiontitle">Configuration Description</h4><p id="mrs_01_1578__aaca465203b44492ca17a65cc36b4039c">Configuration items include NettySink information storing path, range of NettySink listening port, whether to enable SSL encryption, domain of the network used for NettySink monitoring.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1578__tb56995aaf5dc411694534e3d952dc60b" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="mrs_01_1578__r3bd929b035c14e938248ac140e247a6a"><th align="left" class="cellrowborder" valign="top" width="19.869999999999997%" id="mcps1.3.2.3.2.5.1.1"><p id="mrs_01_1578__a5347adf901224b1eaeeccc530907db13">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="38.45%" id="mcps1.3.2.3.2.5.1.2"><p id="mrs_01_1578__a9105ccd8df2d44fd8d210b98cc03319e">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.759999999999998%" id="mcps1.3.2.3.2.5.1.3"><p id="mrs_01_1578__a2ac844dda955457e86dd413c229996e0">Default Value</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.919999999999998%" id="mcps1.3.2.3.2.5.1.4"><p id="mrs_01_1578__ac6df3f452f804b968d59b0c90c79ff03">Mandatory</p>
</th>
</tr>
</thead>
<tbody><tr id="mrs_01_1578__r4ce4c76f0ad540adaff9a1e851696ede"><td class="cellrowborder" valign="top" width="19.869999999999997%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1578__ae645533711434921b9436b4af81713f3">nettyconnector.registerserver.topic.storage</p>
</td>
<td class="cellrowborder" valign="top" width="38.45%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1578__a3d213b5d1ddc4c09b307746546948c59">Path (on a third-party server) to information about IP address, port numbers, and concurrency of NettySink. ZooKeeper is recommended for storage.</p>
</td>
<td class="cellrowborder" valign="top" width="21.759999999999998%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1578__a3d19230e4cc34206a90d71e2a7f0e4d6">/flink/nettyconnector</p>
</td>
<td class="cellrowborder" valign="top" width="19.919999999999998%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1578__a0961f14d170942f3be6302da286cad22">No. However, if pipeline is enabled, the feature is mandatory.</p>
</td>
</tr>
<tr id="mrs_01_1578__rdc201b60f0df4dee9c0e78a1e9f0229c"><td class="cellrowborder" valign="top" width="19.869999999999997%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1578__a80d5a4d6917644d39582a210bbac974a">nettyconnector.sinkserver.port.range</p>
</td>
<td class="cellrowborder" valign="top" width="38.45%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1578__ad92984e5b1c04d3882cbc325925e22e3">Port range of NettySink.</p>
</td>
<td class="cellrowborder" valign="top" width="21.759999999999998%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1578__aa37db869d3944ecc8def6a74eee2d9fa">If <span id="mrs_01_1578__text117381601114">MRS</span> cluster is used, the default value is 28444-28843.</p>
</td>
<td class="cellrowborder" valign="top" width="19.919999999999998%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1578__af8fc1c4e9b6a493494f20c18be834417">No. However, if pipeline is enabled, the feature is mandatory.</p>
</td>
</tr>
<tr id="mrs_01_1578__rde03453b66c642d293d5a6d8cc9db289"><td class="cellrowborder" valign="top" width="19.869999999999997%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1578__aff0183dfde7f494babef18fa34575413">nettyconnector.ssl.enabled</p>
</td>
<td class="cellrowborder" valign="top" width="38.45%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1578__a6c25581cada64208824545a3b00a11fd">Whether SSL encryption for the communication between NettySink and NettySource is enabled. For details about the encryption key and protocol, see <a href="mrs_01_1569.html">SSL</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="21.759999999999998%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1578__a6c1af4bc20b944a2ab40dd948fedad1a">false</p>
</td>
<td class="cellrowborder" valign="top" width="19.919999999999998%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1578__ad6c6ae6174a740ed81f741f4453aa6b2">No. However, if pipeline is enabled, the feature is mandatory.</p>
</td>
</tr>
<tr id="mrs_01_1578__r40446f297843483d9b47dbbf64c42494"><td class="cellrowborder" valign="top" width="19.869999999999997%" headers="mcps1.3.2.3.2.5.1.1 "><p id="mrs_01_1578__a3a520ac614a044c8b7a54debcdb70b24">nettyconnector.message.delimiter</p>
</td>
<td class="cellrowborder" valign="top" width="38.45%" headers="mcps1.3.2.3.2.5.1.2 "><p id="mrs_01_1578__a3538d4d565cb4d5384464740f4bbb6fb">Delimiter used to configure the message sent by NettySink to the NettySource, which is 2-4 bytes long, and cannot contain <strong id="mrs_01_1578__b1812275972101035">\n</strong>, <strong id="mrs_01_1578__b1282617985101035">#</strong>, or space.</p>
</td>
<td class="cellrowborder" valign="top" width="21.759999999999998%" headers="mcps1.3.2.3.2.5.1.3 "><p id="mrs_01_1578__a7ff0a06b51534d65918f8772fa8b292d">The default value is <strong id="mrs_01_1578__b1151651624101035">$_</strong>.</p>
</td>
<td class="cellrowborder" valign="top" width="19.919999999999998%" headers="mcps1.3.2.3.2.5.1.4 "><p id="mrs_01_1578__a1e4112674a734fcd9f006470ef89e988">No. However, if pipeline is enabled, the feature is mandatory.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0592.html">Flink Configuration Management</a></div>
</div>
</div>