Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

49 lines
3.6 KiB
HTML

<a name="mrs_01_0588"></a><a name="mrs_01_0588"></a>
<h1 class="topictitle1">Modifying the Default Configuration Data</h1>
<div id="body1589421621263"><p id="mrs_01_0588__p1731231115318">By default, OpenTSDB connects to the local TSD process of the node where the Spark executor resides. In MRS, use the default configuration.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_0588__table13240911145315" frame="border" border="1" rules="all"><caption><b>Table 1 </b>OpenTSDB data source configuration</caption><tbody><tr id="mrs_01_0588__row33121811195313"><td class="cellrowborder" valign="top" width="39.53%"><p id="mrs_01_0588__p33121119534">Parameter</p>
</td>
<td class="cellrowborder" valign="top" width="32.25%"><p id="mrs_01_0588__p33131911135319">Description</p>
</td>
<td class="cellrowborder" valign="top" width="28.22%"><p id="mrs_01_0588__p143131911105315">Example Value</p>
</td>
</tr>
<tr id="mrs_01_0588__row9313171145320"><td class="cellrowborder" valign="top" width="39.53%"><p id="mrs_01_0588__p183132011145313">spark.sql.datasource.opentsdb.host</p>
</td>
<td class="cellrowborder" valign="top" width="32.25%"><p id="mrs_01_0588__p2313161111538">Indicates the IP address of the connected TSD process.</p>
</td>
<td class="cellrowborder" valign="top" width="28.22%"><p id="mrs_01_0588__p3313811165314">Null (default value)</p>
<p id="mrs_01_0588__p613845811342"><strong id="mrs_01_0588__b12597122514812">xx.xx.xx.xx</strong> indicates the IP address. Separate multiple IP addresses with commas (,).</p>
</td>
</tr>
<tr id="mrs_01_0588__row93131311145311"><td class="cellrowborder" valign="top" width="39.53%"><p id="mrs_01_0588__p13313111155314">spark.sql.datasource.opentsdb.port</p>
</td>
<td class="cellrowborder" valign="top" width="32.25%"><p id="mrs_01_0588__p153131911155317">Indicates the port number of the TSD process.</p>
</td>
<td class="cellrowborder" valign="top" width="28.22%"><p id="mrs_01_0588__p63131611105311">4242 (default value)</p>
</td>
</tr>
<tr id="mrs_01_0588__row0313191155314"><td class="cellrowborder" valign="top" width="39.53%"><p id="mrs_01_0588__p93131511105317">spark.sql.datasource.opentsdb.randomSeed</p>
</td>
<td class="cellrowborder" valign="top" width="32.25%"><p id="mrs_01_0588__p531341114537">Indicates whether to use the random seed when the <strong id="mrs_01_0588__b1979212411788">spark.sql.datasource.opentsdb.host</strong> is set to multiple addresses. If this parameter is set to <strong id="mrs_01_0588__b588819520810">false</strong>, all executors on the same node are connected to the same host. In this way, <strong id="mrs_01_0588__b2089318526819">spark.blacklist.enabled=true</strong> can be used to implement task fault tolerance.</p>
</td>
<td class="cellrowborder" valign="top" width="28.22%"><p id="mrs_01_0588__p1131371113534">false (default value)</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="section" id="mrs_01_0588__section17239141145318"><h4 class="sectiontitle">Example</h4><p id="mrs_01_0588__p2313141125311">Run the <strong id="mrs_01_0588__b5897164218918">set</strong> statement in <strong id="mrs_01_0588__b3902124214915">spark-sql</strong> and <strong id="mrs_01_0588__b169030421593">spark-beeline</strong>, and then run other SQL statements.</p>
<pre class="screen" id="mrs_01_0588__screen6571148551">set spark.sql.datasource.opentsdb.host = 192.168.2.143,192.168.2.158;
SELECT * FROM opentsdb_table ;</pre>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0584.html">Interconnecting Spark with OpenTSDB</a></div>
</div>
</div>