forked from docs/doc-exports
Yang, Tong
3f5759eed2
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
114 lines
22 KiB
HTML
114 lines
22 KiB
HTML
<a name="mrs_01_24120"></a><a name="mrs_01_24120"></a>
|
|
|
|
<h1 class="topictitle1">Interconnecting FlinkServer with HBase</h1>
|
|
<div id="body32001227"><div class="section" id="mrs_01_24120__en-us_topic_0000001173471334_section73405216295"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_24120__en-us_topic_0000001173471334_p781110443138">FlinkServer can be interconnected with HBase. The details are as follows:</p>
|
|
<ul id="mrs_01_24120__en-us_topic_0000001173471334_ul1495846131413"><li id="mrs_01_24120__en-us_topic_0000001173471334_li1295876131410">It can be interconnected with dimension tables and sink tables.</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li395814618141">When HBase and Flink are in the same cluster or clusters with mutual trust, FlinkServer can be interconnected with HBase.</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li189581068141">If HBase and Flink are in different clusters without mutual trust, Flink in a normal cluster can be interconnected with HBase in a normal cluster.</li></ul>
|
|
</div>
|
|
<div class="section" id="mrs_01_24120__en-us_topic_0000001173471334_section05651927175112"><h4 class="sectiontitle">Prerequisites</h4><ul id="mrs_01_24120__en-us_topic_0000001173471334_ul184973415531"><li id="mrs_01_24120__en-us_topic_0000001173471334_li349713412536">The HDFS, Yarn, Flink, and HBase services have been installed in a cluster.</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li449716411539">The client that contains the HBase service has been installed, for example, in the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b637613618142">/opt/Bigdata/client</strong> directory.</li></ul>
|
|
</div>
|
|
<div class="section" id="mrs_01_24120__en-us_topic_0000001173471334_section0637165110515"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_24120__en-us_topic_0000001173471334_ol774114513169"><li id="mrs_01_24120__en-us_topic_0000001173471334_li197840151912"><a name="mrs_01_24120__en-us_topic_0000001173471334_li197840151912"></a><a name="en-us_topic_0000001173471334_li197840151912"></a><span>Log in to the node where the client is installed as the client installation user and copy all configuration files in the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b108301613102413">/opt/Bigdata/client/HBase/hbase/conf/</strong> directory of HBase to an empty directory of all nodes where FlinkServer is deployed, for example, <strong id="mrs_01_24120__en-us_topic_0000001173471334_b58311138244">/tmp/client/HBase/hbase/conf/</strong>.</span><p><p id="mrs_01_24120__en-us_topic_0000001173471334_p1033013222102">Change the owner of the configuration file directory and its upper-layer directory on the FlinkServer node to <strong id="mrs_01_24120__en-us_topic_0000001173471334_b11219843194518">omm</strong>.</p>
|
|
<div class="p" id="mrs_01_24120__en-us_topic_0000001173471334_p124771393176"><strong id="mrs_01_24120__en-us_topic_0000001173471334_b164429161719">chown omm: /tmp/client/HBase/hbase/conf/ -R</strong><div class="note" id="mrs_01_24120__en-us_topic_0000001173471334_note135351821101012"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_24120__en-us_topic_0000001173471334_ul1753510214106"><li id="mrs_01_24120__en-us_topic_0000001173471334_li1053519215105">FlinkServer nodes:<p id="mrs_01_24120__en-us_topic_0000001173471334_p1653572181011"><a name="mrs_01_24120__en-us_topic_0000001173471334_li1053519215105"></a><a name="en-us_topic_0000001173471334_li1053519215105"></a>Log in to Manager, choose <strong id="mrs_01_24120__en-us_topic_0000001173471334_b5568115891513">Cluster</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1089710071611">Services</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1034520317167">Flink</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b113131270165">Instance</strong>, and check the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1733880141713">Service IP Address</strong> of FlinkServer.</p>
|
|
</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li12535142131015">If the node where a FlinkServer instance is located is the node where the HBase client is installed, skip this step on this node.</li></ul>
|
|
</div></div>
|
|
</div>
|
|
</p></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li264201214285"><span>Log in to Manager, choose <strong id="mrs_01_24120__en-us_topic_0000001173471334_b9553194142612">Cluster</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b05535452616">Services</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b4553154112613">Flink</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b135531420265">Configurations</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b10553543261">All Configurations</strong>, search for the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b13554134192614">HBASE_CONF_DIR</strong> parameter, and enter the FlinkServer directory (for example, <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1555420472616">/tmp/client/HBase/hbase/conf/</strong>) to which the HBase configuration files are copied in <a href="#mrs_01_24120__en-us_topic_0000001173471334_li197840151912">1</a> in <strong id="mrs_01_24120__en-us_topic_0000001173471334_b955411419260">Value</strong>.</span><p><div class="note" id="mrs_01_24120__en-us_topic_0000001173471334_note1536141581015"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_24120__en-us_topic_0000001173471334_p8373156106">If the node where a FlinkServer instance is located is the node where the HBase client is installed, enter the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1883252123316">/opt/</strong><strong id="mrs_01_24120__en-us_topic_0000001173471334_b183262119335">Bigdata</strong><strong id="mrs_01_24120__en-us_topic_0000001173471334_b283282119338">/client/HBase/hbase/conf/</strong> directory of HBase in <strong id="mrs_01_24120__en-us_topic_0000001173471334_b4661952203217">Value</strong> of the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1034310133410">HBASE_CONF_DIR</strong> parameter.</p>
|
|
</div></div>
|
|
</p></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li1881017117349"><span>After the parameters are configured, click <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1399711212119">Save</strong>. After confirming the modification, click <strong id="mrs_01_24120__en-us_topic_0000001173471334_b191706294218">OK</strong>.</span></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li881575714357"><span>Click <strong id="mrs_01_24120__en-us_topic_0000001173471334_b11889742213">Instance</strong>, select all FlinkServer instances, choose <strong id="mrs_01_24120__en-us_topic_0000001173471334_b139861314172217">More</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b11492174220">Restart Instance</strong>, enter the password, and click <strong id="mrs_01_24120__en-us_topic_0000001173471334_b144356213227">OK</strong> to restart the instances.</span></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li12826131220399"><span>Log in to Manager and choose <strong id="mrs_01_24120__en-us_topic_0000001173471334_b190501466273421">Cluster</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b38302828673421">Services</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b11093379573421">Flink</strong>. In the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b385718305018">Basic Information</strong> area, click the link on the right of <strong id="mrs_01_24120__en-us_topic_0000001173471334_b172632515273421">Flink WebUI</strong> to access the Flink web UI.</span></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li2023444020"><span>Create a Flink SQL job and set Task Type to Stream job. For details, see <a href="mrs_01_24024.html#mrs_01_24024__en-us_topic_0000001173470782_section1746418521537">Creating a Job</a>. On the job development page, configure the job parameters as follows and start the job.</span><p><p id="mrs_01_24120__en-us_topic_0000001173471334_p55620611815">Select <strong id="mrs_01_24120__en-us_topic_0000001173471334_b9944154612472">Enable CheckPoint</strong> in <strong id="mrs_01_24120__en-us_topic_0000001173471334_b159451046134711">Running Parameter</strong> and set <strong id="mrs_01_24120__en-us_topic_0000001173471334_b199452046154718">Time Interval (ms)</strong> to <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1494610460477">60000</strong>.</p>
|
|
<div class="p" id="mrs_01_24120__en-us_topic_0000001173471334_p3935161412815">The following example shows how to create a Flink SQL job:<pre class="screen" id="mrs_01_24120__en-us_topic_0000001173471334_screen1024520148819">CREATE TABLE ksource1 (
|
|
user_id STRING,
|
|
item_id STRING,
|
|
proctime as PROCTIME()
|
|
) WITH (
|
|
'connector' = 'kafka',
|
|
'topic' = 'ksource1',
|
|
'properties.group.id' = 'group1',
|
|
'properties.bootstrap.servers' = '<em id="mrs_01_24120__en-us_topic_0000001173471334_i18245161412816">IP address of the Kafka broker instance 1</em>:<em id="mrs_01_24120__en-us_topic_0000001173471334_i16245161414811">Kafka port number</em>,<em id="mrs_01_24120__en-us_topic_0000001173471334_i142451214985">IP address of the Kafka broker instance 2</em>:<em id="mrs_01_24120__en-us_topic_0000001173471334_i1424514141815">Kafka port number</em>',
|
|
'format' = 'json',
|
|
'properties.sasl.kerberos.service.name' = 'kafka'
|
|
);
|
|
|
|
CREATE TABLE hsink1 (
|
|
rowkey STRING,
|
|
f1 ROW < item_id STRING >,
|
|
PRIMARY KEY (rowkey) NOT ENFORCED
|
|
) WITH (
|
|
'connector' = 'hbase-2.2',
|
|
'table-name' = 'dim_province',
|
|
'zookeeper.quorum' = '<em id="mrs_01_24120__en-us_topic_0000001173471334_i1024513149811">IP address of the ZooKeeper quorumpeer instance 1</em>:<em id="mrs_01_24120__en-us_topic_0000001173471334_i02452014685">ZooKeeper port number</em>'<em id="mrs_01_24120__en-us_topic_0000001173471334_i12451014289">IP address of the ZooKeeper quorumpeer instance 2</em>:<em id="mrs_01_24120__en-us_topic_0000001173471334_i82457145816">ZooKeeper port number</em>'
|
|
);
|
|
|
|
INSERT INTO
|
|
hsink1
|
|
SELECT
|
|
user_id as rowkey,
|
|
ROW(item_id) as f1
|
|
FROM
|
|
ksource1;</pre>
|
|
<div class="note" id="mrs_01_24120__en-us_topic_0000001173471334_note10245201413811"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_24120__en-us_topic_0000001173471334_ul92451147817"><li id="mrs_01_24120__en-us_topic_0000001173471334_li324518141783">Kafka port number<ul id="mrs_01_24120__en-us_topic_0000001299465345_ul330585217498"><li id="mrs_01_24120__en-us_topic_0000001299465345_li15431748164911">In security mode, the port number is the value of <strong id="mrs_01_24120__en-us_topic_0000001299465345_b205881224151610">sasl.port</strong> (<strong id="mrs_01_24120__en-us_topic_0000001299465345_b9304934101615">21007</strong> by default).</li><li id="mrs_01_24120__en-us_topic_0000001299465345_li175451448174913">In non-security mode, the port is the value of <strong id="mrs_01_24120__en-us_topic_0000001299465345_b149745622017">port</strong> (<strong id="mrs_01_24120__en-us_topic_0000001299465345_b1099613013203">9092</strong> by default). If the port number is set to <strong id="mrs_01_24120__en-us_topic_0000001299465345_b73621643112310">9092</strong>, set <strong id="mrs_01_24120__en-us_topic_0000001299465345_b340128102113">allow.everyone.if.no.acl.found</strong> to <strong id="mrs_01_24120__en-us_topic_0000001299465345_b841628162113">true</strong>. The procedure is as follows:<p id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_p36273255618">Log in to FusionInsight Manager and choose <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b14557164243019">Cluster</strong> > <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b2122445113010">Services</strong> > <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b1936517491306">Kafka</strong>. On the displayed page, click <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b1266911423116">Configurations</strong> and then <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b13479112213314">All Configurations</strong>, search for <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b12988123313112">allow.everyone.if.no.acl.found</strong>, set its value to <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b12582105613113">true</strong>, and click <strong id="mrs_01_24120__en-us_topic_0000001299465345_en-us_topic_0000001173630650_b4318185014366">Save</strong>.</p>
|
|
</li></ul>
|
|
</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li024511411817">IP address of the ZooKeeper quorumpeer instance<p id="mrs_01_24120__en-us_topic_0000001173471334_p92456140814"><a name="mrs_01_24120__en-us_topic_0000001173471334_li024511411817"></a><a name="en-us_topic_0000001173471334_li024511411817"></a>To obtain IP addresses of all ZooKeeper quorumpeer instances, log in to FusionInsight Manager and choose <strong id="mrs_01_24120__en-us_topic_0000001173471334_b80042848785841">Cluster</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b149369809485841">Services</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b101545398685841">ZooKeeper</strong>. On the displayed page, click <strong id="mrs_01_24120__en-us_topic_0000001173471334_b208916749085841">Instance</strong> and view the IP addresses of all the hosts where the quorumpeer instances locate.</p>
|
|
</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li624515142816">Port number of the ZooKeeper client<p id="mrs_01_24120__en-us_topic_0000001173471334_p1724512142082"><a name="mrs_01_24120__en-us_topic_0000001173471334_li624515142816"></a><a name="en-us_topic_0000001173471334_li624515142816"></a>Log in to FusionInsight Manager and choose <strong id="mrs_01_24120__en-us_topic_0000001173471334_b163442366985841">Cluster</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b26883978285841">Service</strong> > <strong id="mrs_01_24120__en-us_topic_0000001173471334_b67506316185841">ZooKeeper</strong>. On the displayed page, click <strong id="mrs_01_24120__en-us_topic_0000001173471334_b16912362385841">Configurations</strong> and check the value of <strong id="mrs_01_24120__en-us_topic_0000001173471334_b10799438151912">clientPort</strong>. The default value is <strong id="mrs_01_24120__en-us_topic_0000001173471334_b207709388285841">24002</strong>.</p>
|
|
</li></ul>
|
|
</div></div>
|
|
</div>
|
|
</p></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li15985194854015"><span>On the job management page, check whether the job status is <strong id="mrs_01_24120__en-us_topic_0000001173471334_b36235729573421">Running</strong>.</span></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li5414141215307"><span>Execute the following script to write data to Kafka. For details, see <a href="mrs_01_0379.html">Managing Messages in Kafka Topics</a>.</span><p><p id="mrs_01_24120__en-us_topic_0000001173471334_p19743153203810"><strong id="mrs_01_24120__en-us_topic_0000001173471334_b17204135052211">sh kafka-console-producer.sh --broker-list</strong> <em id="mrs_01_24120__en-us_topic_0000001173471334_i12212850182217">IP address of the node where the Kafka instance locates</em><em id="mrs_01_24120__en-us_topic_0000001173471334_i221945082211">:Kafka port number</em><strong id="mrs_01_24120__en-us_topic_0000001173471334_b5207050121511"> --topic</strong> <em id="mrs_01_24120__en-us_topic_0000001173471334_i14224135062217"><strong id="mrs_01_24120__en-us_topic_0000001173471334_b12216501228">Topic name</strong></em></p>
|
|
<p id="mrs_01_24120__en-us_topic_0000001173471334_p174351156414">For example, if the topic name is <strong id="mrs_01_24120__en-us_topic_0000001173471334_b139228285565">ksource1</strong>, the script is <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1868584319427">sh kafka-console-producer.sh --broker-list</strong> <em id="mrs_01_24120__en-us_topic_0000001173471334_i9144137134213">IP address of the node where the Kafka instance locates</em>:<em id="mrs_01_24120__en-us_topic_0000001173471334_i2635184311618">Kafka port number</em> <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1449134754211">--topic ksource1</strong>.</p>
|
|
<div class="p" id="mrs_01_24120__en-us_topic_0000001173471334_p835285214424">Enter the message content.<pre class="screen" id="mrs_01_24120__en-us_topic_0000001173471334_screen1869616424319">{"user_id": "3","item_id":"333333"},
|
|
{"user_id": "4","item_id":"44444444"}</pre>
|
|
</div>
|
|
<p id="mrs_01_24120__en-us_topic_0000001173471334_adbfec31492e84dec85245866152e21be">Press <strong id="mrs_01_24120__en-us_topic_0000001173471334_b15215156248">Enter</strong> to send the message.</p>
|
|
</p></li><li id="mrs_01_24120__en-us_topic_0000001173471334_li14137133878"><span>Log in to the HBase client and view the table data. For details, see <a href="mrs_01_24041.html">Using an HBase Client</a>.</span><p><p id="mrs_01_24120__en-us_topic_0000001173471334_p56041452077"><strong id="mrs_01_24120__en-us_topic_0000001173471334_b828219552718">hbase shel</strong></p>
|
|
<p id="mrs_01_24120__en-us_topic_0000001173471334_p19679849374"><strong id="mrs_01_24120__en-us_topic_0000001173471334_b029945515715">scan 'dim_province'</strong></p>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="mrs_01_24120__en-us_topic_0000001173471334_section058434920520"><h4 class="sectiontitle">Submitting a Job Using the Application</h4><ul id="mrs_01_24120__en-us_topic_0000001173471334_ul1182817645315"><li id="mrs_01_24120__en-us_topic_0000001173471334_li158288645316">If the Flink run mode is used, you are advised to use the <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1740915238319">export HBASE_CONF_DIR=</strong> <em id="mrs_01_24120__en-us_topic_0000001173471334_i18281111964614">HBase configuration directory</em>, for example, <strong id="mrs_01_24120__en-us_topic_0000001173471334_b1239410331314">export HBASE_CONF_DIR=/opt/hbaseconf</strong>.</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li121843488539">If the Flink run-application mode is used, you can use either of the following methods to submit jobs:<ul id="mrs_01_24120__en-us_topic_0000001173471334_ul410220271548"><li id="mrs_01_24120__en-us_topic_0000001173471334_li474310110571">(Recommended) Add the following configurations to a table creation statement.
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_24120__en-us_topic_0000001173471334_table179246615591" frame="border" border="1" rules="all"><thead align="left"><tr id="mrs_01_24120__en-us_topic_0000001173471334_row6925206165915"><th align="left" class="cellrowborder" valign="top" width="46.46%" id="mcps1.3.4.2.2.1.1.1.1.3.1.1"><p id="mrs_01_24120__en-us_topic_0000001173471334_p1392517635916">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="53.54%" id="mcps1.3.4.2.2.1.1.1.1.3.1.2"><p id="mrs_01_24120__en-us_topic_0000001173471334_p1692520619599">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_24120__en-us_topic_0000001173471334_row69251645918"><td class="cellrowborder" valign="top" width="46.46%" headers="mcps1.3.4.2.2.1.1.1.1.3.1.1 "><p id="mrs_01_24120__en-us_topic_0000001173471334_p692510614590">'properties.hbase.rpc.protection' = 'authentication'</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="53.54%" headers="mcps1.3.4.2.2.1.1.1.1.3.1.2 "><p id="mrs_01_24120__en-us_topic_0000001173471334_p1492511675912">This parameter must be consistent with that on the HBase server.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24120__en-us_topic_0000001173471334_row9925664592"><td class="cellrowborder" valign="top" width="46.46%" headers="mcps1.3.4.2.2.1.1.1.1.3.1.1 "><p id="mrs_01_24120__en-us_topic_0000001173471334_p6925769593">'properties.hbase.security.authorization' = 'true'</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="53.54%" headers="mcps1.3.4.2.2.1.1.1.1.3.1.2 "><p id="mrs_01_24120__en-us_topic_0000001173471334_p209258613590">Authentication is enabled.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_24120__en-us_topic_0000001173471334_row17925156195910"><td class="cellrowborder" valign="top" width="46.46%" headers="mcps1.3.4.2.2.1.1.1.1.3.1.1 "><p id="mrs_01_24120__en-us_topic_0000001173471334_p199252635915">'properties.hbase.security.authentication' = 'kerberos'</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="53.54%" headers="mcps1.3.4.2.2.1.1.1.1.3.1.2 "><p id="mrs_01_24120__en-us_topic_0000001173471334_p149251464599">Kerberos authentication is enabled.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<div class="p" id="mrs_01_24120__en-us_topic_0000001173471334_p1450161710579">Example:<pre class="screen" id="mrs_01_24120__en-us_topic_0000001173471334_screen1744014428572">CREATE TABLE hsink1 (
|
|
rowkey STRING,
|
|
f1 ROW < q1 STRING >,
|
|
PRIMARY KEY (rowkey) NOT ENFORCED
|
|
) WITH (
|
|
'connector' = 'hbase-2.2',
|
|
'table-name' = 'cc',
|
|
'zookeeper.quorum' = 'x.x.x.x:24002',
|
|
'properties.hbase.rpc.protection' = 'authentication',
|
|
'properties.zookeeper.znode.parent' = '/hbase',
|
|
'properties.hbase.security.authorization' = 'true',
|
|
'properties.hbase.security.authentication' = 'kerberos'
|
|
);</pre>
|
|
</div>
|
|
</li><li id="mrs_01_24120__en-us_topic_0000001173471334_li13415461752">Add the HBase configuration to YarnShip.<p id="mrs_01_24120__en-us_topic_0000001173471334_p124511472519"><a name="mrs_01_24120__en-us_topic_0000001173471334_li13415461752"></a><a name="en-us_topic_0000001173471334_li13415461752"></a>Example: Dyarn.ship-files=/opt/hbaseconf</p>
|
|
</li></ul>
|
|
</li></ul>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_24226.html">Interconnecting FlinkServer with External Components</a></div>
|
|
</div>
|
|
</div>
|
|
|