forked from docs/doc-exports
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
151 lines
22 KiB
HTML
151 lines
22 KiB
HTML
<a name="mrs_01_24248"></a><a name="mrs_01_24248"></a>
|
|
|
|
<h1 class="topictitle1">Interconnecting FlinkServer with Kafka</h1>
|
|
<div id="body8662426"><div class="section" id="mrs_01_24248__en-us_topic_0000001173789820_section9850144683814"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_24248__en-us_topic_0000001173789820_p2074905315912">This section describes the data definition language (DDL) of Kafka as a source or sink table, as well as the WITH parameters and example code for creating a table, and provides guidance on how to perform operations on the FlinkServer job management page.</p>
|
|
<p id="mrs_01_24248__en-us_topic_0000001173789820_p151181633121217">If your Kafka cluster is in security mode, the following example SQL statements can be used.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_24248__en-us_topic_0000001173789820_section575285983811"><h4 class="sectiontitle">Prerequisites</h4><ul id="mrs_01_24248__ul429673133716"><li id="mrs_01_24248__li1929614318373">The HDFS, Yarn, Kafka, and Flink services have been installed in a cluster.</li><li id="mrs_01_24248__li52963393719">The client that contains the Kafka service has been installed, for example, in the <strong id="mrs_01_24248__en-us_topic_0000001173789820_b6795147659152">/opt/Bigdata/client</strong> directory.</li><li id="mrs_01_24248__li3296138379">You have created a user with <strong id="mrs_01_24248__en-us_topic_0000001173789820_b5336983859152">FlinkServer Admin Privilege</strong>, for example, <strong id="mrs_01_24248__en-us_topic_0000001173789820_b17358781359152">flink_admin</strong>, to access the Flink web UI. For details, see <a href="mrs_01_24049.html">Authentication Based on Users and Roles</a>.</li></ul>
|
|
</div>
|
|
<div class="section" id="mrs_01_24248__en-us_topic_0000001173789820_section101891343910"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_24248__en-us_topic_0000001173789820_ol17755531161917"><li id="mrs_01_24248__en-us_topic_0000001173789820_li12826131220399"><span>Log in to Manager as user <strong id="mrs_01_24248__en-us_topic_0000001173789820_b167673111056">flink_admin</strong> and choose <strong id="mrs_01_24248__en-us_topic_0000001173789820_b27731111156">Cluster</strong> > <strong id="mrs_01_24248__en-us_topic_0000001173789820_b677315111517">Services</strong> > <strong id="mrs_01_24248__en-us_topic_0000001173789820_b207743116515">Flink</strong>. In the <strong id="mrs_01_24248__en-us_topic_0000001173789820_b6775911354">Basic Information</strong> area, click the link on the right of <strong id="mrs_01_24248__en-us_topic_0000001173789820_b1877531110513">Flink WebUI</strong> to access the Flink web UI.</span></li><li id="mrs_01_24248__en-us_topic_0000001173789820_li182241012155712"><span>Create a Flink SQL job by referring to <a href="mrs_01_24024.html#mrs_01_24024__en-us_topic_0000001173470782_section1746418521537">Creating a Job</a>. On the job development page, configure the job parameters as follows and start the job.</span><p><div class="p" id="mrs_01_24248__en-us_topic_0000001173789820_p84191510575">Select <strong id="mrs_01_24248__en-us_topic_0000001173789820_b478319451519">Enable CheckPoint</strong> in <strong id="mrs_01_24248__en-us_topic_0000001173789820_b878310451958">Running Parameter</strong> and set <strong id="mrs_01_24248__en-us_topic_0000001173789820_b2078474512518">Time Interval (ms)</strong> to <strong id="mrs_01_24248__en-us_topic_0000001173789820_b127851945854">60000</strong>.<pre class="screen" id="mrs_01_24248__en-us_topic_0000001173789820_screen12969195311266">CREATE TABLE KafkaSource (
|
|
`user_id` VARCHAR,
|
|
`user_name` VARCHAR,
|
|
`age` INT
|
|
) WITH (
|
|
'connector' = 'kafka',
|
|
'topic' = 'test_source',
|
|
'properties.bootstrap.servers' = '<em id="mrs_01_24248__en-us_topic_0000001173789820_i430210494519">IP address of the Kafka broker instance</em>:<em id="mrs_01_24248__en-us_topic_0000001173789820_i1430354915513">Kafka port number</em>',
|
|
'properties.group.id' = 'testGroup',
|
|
'scan.startup.mode' = 'latest-offset',
|
|
'format' = 'csv',
|
|
'properties.sasl.kerberos.service.name' = 'kafka',
|
|
'properties.security.protocol' = 'SASL_PLAINTEXT',
|
|
'properties.kerberos.domain.name' = 'hadoop.<em id="mrs_01_24248__i1620672124713">System domain name</em>'
|
|
);
|
|
CREATE TABLE KafkaSink(
|
|
`user_id` VARCHAR,
|
|
`user_name` VARCHAR,
|
|
`age` INT
|
|
) WITH (
|
|
'connector' = 'kafka',
|
|
'topic' = 'test_sink',
|
|
'properties.bootstrap.servers' = '<em id="mrs_01_24248__en-us_topic_0000001173789820_i13173145413510">IP address of the Kafka broker instance</em>:<em id="mrs_01_24248__en-us_topic_0000001173789820_i2018015541354">Kafka port number</em>',
|
|
'scan.startup.mode' = 'latest-offset',
|
|
'value.format' = 'csv',
|
|
'properties.sasl.kerberos.service.name' = 'kafka',
|
|
'properties.security.protocol' = 'SASL_PLAINTEXT',
|
|
'properties.kerberos.domain.name' = 'hadoop.<em id="mrs_01_24248__i1210049175710">System domain name</em>'
|
|
);
|
|
Insert into
|
|
KafkaSink
|
|
select
|
|
*
|
|
from
|
|
KafkaSource;</pre>
|
|
<div class="note" id="mrs_01_24248__en-us_topic_0000001173789820_note7802524111016"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_p3718569187">Kafka port number</p>
|
|
<ul id="mrs_01_24248__en-us_topic_0000001252705552_ul330585217498"><li id="mrs_01_24248__en-us_topic_0000001252705552_li15431748164911">In security mode, the port number is the value of <strong id="mrs_01_24248__en-us_topic_0000001252705552_b673611250427">sasl.port</strong> (<strong id="mrs_01_24248__en-us_topic_0000001252705552_b17736325174216">21007</strong> by default).</li><li id="mrs_01_24248__en-us_topic_0000001252705552_li175451448174913">In non-security mode, the port is the value of <strong id="mrs_01_24248__en-us_topic_0000001252705552_b13650127124215">port</strong> (<strong id="mrs_01_24248__en-us_topic_0000001252705552_b196511527174212">9092</strong> by default). If the port number is set to <strong id="mrs_01_24248__en-us_topic_0000001252705552_b9801172914211">9092</strong>, set <strong id="mrs_01_24248__en-us_topic_0000001252705552_b188021729164219">allow.everyone.if.no.acl.found</strong> to <strong id="mrs_01_24248__en-us_topic_0000001252705552_b880212910426">true</strong>. The procedure is as follows:<p id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_p8835244171713">Log in to FusionInsight Manager and choose <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b1882175163611">Cluster</strong> > <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b88835515361">Services</strong> > <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b288415510368">Kafka</strong>. On the displayed page, click <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b18842583618">Configurations</strong> and then <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b18885145113618">All Configurations</strong>, search for <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b38856533618">allow.everyone.if.no.acl.found</strong>, set its value to <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b168865593615">true</strong>, and click <strong id="mrs_01_24248__en-us_topic_0000001252705552_en-us_topic_0000001219029313_b78871057363">Save</strong>.</p>
|
|
</li></ul>
|
|
</div></div>
|
|
</div>
|
|
</p></li><li id="mrs_01_24248__en-us_topic_0000001173789820_li53081658114019"><span>On the job management page, check whether the job status is <strong id="mrs_01_24248__en-us_topic_0000001173789820_b1328819521653">Running</strong>.</span></li><li id="mrs_01_24248__en-us_topic_0000001173789820_li20986165822912"><span>Execute the following commands to view the topic and write data to Kafka. For details, see <a href="mrs_01_0379.html">Managing Messages in Kafka Topics</a>.</span><p><p id="mrs_01_24248__en-us_topic_0000001173789820_p098645832911"><strong id="mrs_01_24248__en-us_topic_0000001173789820_b737314261614">./kafka-topics.sh --list --zookeeper </strong><em id="mrs_01_24248__en-us_topic_0000001173789820_i1838116264619">IP address of the ZooKeeper quorumpeer instance</em>:<em id="mrs_01_24248__en-us_topic_0000001173789820_i738214261264">ZooKeeper port number</em><strong id="mrs_01_24248__en-us_topic_0000001173789820_b1738210261367">/kafka</strong></p>
|
|
<p id="mrs_01_24248__en-us_topic_0000001173789820_p11986758102916"><strong id="mrs_01_24248__en-us_topic_0000001173789820_b1078011280617">sh kafka-console-producer.sh --broker-list</strong> <em id="mrs_01_24248__en-us_topic_0000001173789820_i57811828663">IP address of the node where the Kafka instance locates</em><em id="mrs_01_24248__en-us_topic_0000001173789820_i1378211282065">:Kafka port number</em><strong id="mrs_01_24248__en-us_topic_0000001173789820_b77821828560"> --topic</strong> <em id="mrs_01_24248__en-us_topic_0000001173789820_i1678216287610">Topic name</em> --<strong id="mrs_01_24248__en-us_topic_0000001173789820_b678342819611">producer.config</strong> <em id="mrs_01_24248__en-us_topic_0000001173789820_i278310282065">Client directory</em>/<strong id="mrs_01_24248__en-us_topic_0000001173789820_b157834281466">Kafka/kafka/config/producer.properties</strong></p>
|
|
<p id="mrs_01_24248__en-us_topic_0000001173789820_p19986258192916">For example, if the topic name is <strong id="mrs_01_24248__en-us_topic_0000001173789820_b8859758364">test_source</strong>, the script is <strong id="mrs_01_24248__en-us_topic_0000001173789820_b12859558162">sh kafka-console-producer.sh --broker-list</strong> <em id="mrs_01_24248__en-us_topic_0000001173789820_i28601658361">IP address of the node where the Kafka instance locates</em><em id="mrs_01_24248__en-us_topic_0000001173789820_i1386213581261">:Kafka port number</em> <strong id="mrs_01_24248__en-us_topic_0000001173789820_b0862758669">--topic test_source</strong> --<strong id="mrs_01_24248__en-us_topic_0000001173789820_b1539171283914">producer.config </strong><strong id="mrs_01_24248__en-us_topic_0000001173789820_b12411912183916"> <strong id="mrs_01_24248__en-us_topic_0000001173789820_b116651462134">/opt/</strong><strong id="mrs_01_24248__en-us_topic_0000001173789820_b56671068134">Bigdata/</strong><strong id="mrs_01_24248__en-us_topic_0000001173789820_b1668176201312">client</strong>/</strong><strong id="mrs_01_24248__en-us_topic_0000001173789820_b34416121397">Kafka/kafka/config/producer.properties</strong>.</p>
|
|
<div class="p" id="mrs_01_24248__en-us_topic_0000001173789820_p1498618582294">Enter the message content.<pre class="screen" id="mrs_01_24248__en-us_topic_0000001173789820_screen19986195822918">1,clw,33</pre>
|
|
</div>
|
|
<p id="mrs_01_24248__en-us_topic_0000001173789820_p1698685862916">Press <strong id="mrs_01_24248__en-us_topic_0000001173789820_b1687918214812">Enter</strong> to send the message.</p>
|
|
<div class="note" id="mrs_01_24248__en-us_topic_0000001173789820_note183961743134015"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_24248__en-us_topic_0000001173789820_ul4278192283814"><li id="mrs_01_24248__en-us_topic_0000001173789820_li024511411817">IP address of the ZooKeeper quorumpeer instance<p id="mrs_01_24248__en-us_topic_0000001173789820_p92456140814"><a name="mrs_01_24248__en-us_topic_0000001173789820_li024511411817"></a><a name="en-us_topic_0000001173789820_li024511411817"></a>To obtain IP addresses of all ZooKeeper quorumpeer instances, log in to FusionInsight Manager and choose <strong id="mrs_01_24248__en-us_topic_0000001173789820_b9504915982">Cluster</strong> > <strong id="mrs_01_24248__en-us_topic_0000001173789820_b195055151488">Services</strong> > <strong id="mrs_01_24248__en-us_topic_0000001173789820_b1750661511816">ZooKeeper</strong>. On the displayed page, click <strong id="mrs_01_24248__en-us_topic_0000001173789820_b2507181519819">Instance</strong> and view the IP addresses of all the hosts where the quorumpeer instances locate.</p>
|
|
</li><li id="mrs_01_24248__en-us_topic_0000001173789820_li624515142816">Port number of the ZooKeeper client<p id="mrs_01_24248__en-us_topic_0000001173789820_p1724512142082"><a name="mrs_01_24248__en-us_topic_0000001173789820_li624515142816"></a><a name="en-us_topic_0000001173789820_li624515142816"></a>Log in to FusionInsight Manager and choose <strong id="mrs_01_24248__en-us_topic_0000001173789820_b1948231986">Cluster</strong> > <strong id="mrs_01_24248__en-us_topic_0000001173789820_b159502311815">Service</strong> > <strong id="mrs_01_24248__en-us_topic_0000001173789820_b209672312815">ZooKeeper</strong>. On the displayed page, click <strong id="mrs_01_24248__en-us_topic_0000001173789820_b49712233818">Configurations</strong> and check the value of <strong id="mrs_01_24248__en-us_topic_0000001173789820_b149812312814">clientPort</strong>. The default value is <strong id="mrs_01_24248__en-us_topic_0000001173789820_b5624332982">24002</strong>.</p>
|
|
</li></ul>
|
|
</div></div>
|
|
</p></li><li id="mrs_01_24248__en-us_topic_0000001173789820_li6386217104817"><span>Run the following commands to check whether data is written from the Kafka topic to the sink table:</span><p><p id="mrs_01_24248__en-us_topic_0000001173789820_p181215378520"><strong id="mrs_01_24248__b1356371116303">sh kafka-console-consumer.sh --topic </strong><em id="mrs_01_24248__en-us_topic_0000001173470662_i23511392509">Topic name</em><strong id="mrs_01_24248__b756421183017"> --bootstrap-server </strong><em id="mrs_01_24248__en-us_topic_0000001173789820_i355514713102">IP address of the Kafka broker instance</em>:<strong id="mrs_01_24248__en-us_topic_0000001173789820_b258181441012">Kafka port number</strong> --<strong id="mrs_01_24248__en-us_topic_0000001173789820_b14981164114614">consumer.config <strong id="mrs_01_24248__en-us_topic_0000001173789820_b1133313125156">/opt/</strong><strong id="mrs_01_24248__en-us_topic_0000001173789820_b1633351210152">Bigdata/</strong><strong id="mrs_01_24248__en-us_topic_0000001173789820_b183331112151513">client</strong>/Kafka/kafka/config/consumer.properties</strong></p>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="mrs_01_24248__en-us_topic_0000001173789820_section93944128465"><h4 class="sectiontitle">WITH Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_24248__en-us_topic_0000001173789820_table13394512144617" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_24248__en-us_topic_0000001173789820_row5391912174620"><th align="left" class="cellrowborder" valign="top" width="18.48%" id="mcps1.3.4.2.1.5.1.1"><p id="mrs_01_24248__en-us_topic_0000001173789820_p2039117126461">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="22.95%" id="mcps1.3.4.2.1.5.1.2"><p id="mrs_01_24248__en-us_topic_0000001173789820_p143911122468">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="8.53%" id="mcps1.3.4.2.1.5.1.3"><p id="mrs_01_24248__en-us_topic_0000001173789820_p8391111294610">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50.03999999999999%" id="mcps1.3.4.2.1.5.1.4"><p id="mrs_01_24248__en-us_topic_0000001173789820_p2391812154611">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_24248__en-us_topic_0000001173789820_row19392101220466"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p1939117128462">connector</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p0391141219464">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p12391111234611">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p33921312184617">Connector to be used. <strong id="mrs_01_24248__en-us_topic_0000001173789820_b99995201102">kafka</strong> is used for Kafka.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24248__en-us_topic_0000001173789820_row113921212124610"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p103921127466">topic</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><ul id="mrs_01_24248__en-us_topic_0000001173789820_ul428211436259"><li id="mrs_01_24248__en-us_topic_0000001173789820_li1228394313251">Yes (Kafka functions as a sink table.)</li><li id="mrs_01_24248__en-us_topic_0000001173789820_li12126134613251">No (Kafka functions as a source table.)</li></ul>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p4392171212461">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p20340194783410">Topic name.</p>
|
|
<ul id="mrs_01_24248__en-us_topic_0000001173789820_ul49765613315"><li id="mrs_01_24248__en-us_topic_0000001173789820_li09763613317">When the Kafka is used as a source table, this parameter indicates the name of the topic from which data is read. Topic list is supported. Topics are separated by semicolons (;), for example, <strong id="mrs_01_24248__en-us_topic_0000001173789820_b132861884543">Topic-1; Topic-2</strong>.</li><li id="mrs_01_24248__en-us_topic_0000001173789820_li155132917330">When Kafka is used as a sink table, this parameter indicates the name of the topic to which data is written. Topic list is not supported for sinks.</li></ul>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24248__en-us_topic_0000001173789820_row839210128465"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p239251234614">topic-pattern</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p17392161212468">No (Kafka functions as a source table.)</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p9392141219460">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p168462818402">Topic pattern.</p>
|
|
<p id="mrs_01_24248__en-us_topic_0000001173789820_p826705616302">This parameter is available when Kafka is used as a source table. The topic name must be a regular expression.</p>
|
|
<div class="note" id="mrs_01_24248__en-us_topic_0000001173789820_note1981417920311"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="mrs_01_24248__en-us_topic_0000001173789820_p1481419917312"><strong id="mrs_01_24248__en-us_topic_0000001173789820_b59302021165714">topic-pattern</strong> and <strong id="mrs_01_24248__en-us_topic_0000001173789820_b2027117246579">topic</strong> cannot be set at the same time.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24248__en-us_topic_0000001173789820_row113931412204611"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p173921712114610">properties.bootstrap.servers</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p4392151211463">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p3393111254616">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p339371215461">List of Kafka brokers, which are separated by commas (,).</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24248__en-us_topic_0000001173789820_row5393171274611"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p15393191220461">properties.group.id</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p23931812124610">Yes (Kafka functions as a source table.)</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p1339381274612">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p239301211464">Kafka user group ID.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24248__en-us_topic_0000001173789820_row739318123466"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p1939321224611">format</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p139319121460">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p939351274618">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p1039361218463">Format of the value used for deserializing and serializing Kafka messages.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24248__en-us_topic_0000001173789820_row18394612164612"><td class="cellrowborder" valign="top" width="18.48%" headers="mcps1.3.4.2.1.5.1.1 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p11393141244618">properties.*</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="22.95%" headers="mcps1.3.4.2.1.5.1.2 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p123936122463">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="8.53%" headers="mcps1.3.4.2.1.5.1.3 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p2393812104613">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50.03999999999999%" headers="mcps1.3.4.2.1.5.1.4 "><p id="mrs_01_24248__en-us_topic_0000001173789820_p739431254611">Authentication-related parameters that need to be added in security mode.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_24226.html">Interconnecting FlinkServer with External Components</a></div>
|
|
</div>
|
|
</div>
|
|
|