mikacur/MRS-operation-guide-lts
1
0
Fork 0
forked from docs/mapreduce-service
Code Pull Requests Activity
MRS-operation-guide-lts/doc/component-operation-guide/source/using_flink/flink_configuration_management/blob.rst
proposalbot 3ccfbdc0f0 Changes to mrs_operation-guide from docs/doc-exports#475 (MRS component operatio 
Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com>
Co-authored-by: proposalbot <proposalbot@otc-service.com>
Co-committed-by: proposalbot <proposalbot@otc-service.com>
2022-12-09 14:50:38 +00:00

4.1 KiB
Raw Blame History

original_name

mrs_01_1567.html

Blob

Scenarios

The Blob server on the JobManager node is used to receive JAR files uploaded by users on the client, send JAR files to TaskManager, and transfer log files. Flink provides some items for configuring the Blob server. You can configure them in the flink-conf.yaml configuration file.

Configuration Description

Users can configure the port, SSL, retry times, and concurrency.

Table 1 Parameters
Parameter Description Default Value Mandatory
blob.server.port Blob server port 32456 to 32520 No
blob.service.ssl.enabled Indicates whether to enable the encryption for the blob transmission channel. This parameter is valid only when the global switch security.ssl is enabled. true Yes
blob.fetch.retries Number of times that TaskManager tries to download blob files from JobManager. 50 No
blob.fetch.num-concurrent Number of concurrent tasks for downloading blob files supported by JobManager. 50 No
blob.fetch.backlog Number of blob files, such as .jar files, to be downloaded in the queue supported by JobManager. The unit is count. 1000 No
library-cache-manager.cleanup.interval Interval at which JobManager deletes the JAR files stored on the HDFS when the user cancels the Flink job. The unit is second. 3600 No

Note

For versions earlier than MRS 3.x, library-cache-manager.cleanup.interval cannot be configured.