forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
19 lines
3.3 KiB
HTML
19 lines
3.3 KiB
HTML
<a name="mrs_01_1183"></a><a name="mrs_01_1183"></a>
|
|
|
|
<h1 class="topictitle1">Using the Spark Client</h1>
|
|
<div id="body1590995733628"><p id="mrs_01_1183__p19542134143214">After an MRS cluster is created, you can create and submit jobs on the client. The client can be installed on nodes inside or outside the cluster.</p>
|
|
<ul id="mrs_01_1183__ul16756144563213"><li id="mrs_01_1183__li19756184593214">Nodes inside the cluster: After an MRS cluster is created, the client has been installed on the master and core nodes in the cluster by default. For details, see <span id="mrs_01_1183__ph7215514163313"><a href="https://docs.otc.t-systems.com/usermanual/mrs/mrs_01_0090.html" target="_blank" rel="noopener noreferrer">Using an MRS Client on Nodes Inside a Cluster</a>. Then, log in to the node where the MRS client is installed.</span>.</li><li id="mrs_01_1183__li1572012314354">Nodes outside the cluster: You can install the client on nodes outside a cluster. <span id="mrs_01_1183__ph2088172916308">For details about how to install a client, see <a href="https://docs.otc.t-systems.com/usermanual/mrs/mrs_01_0091.html" target="_blank" rel="noopener noreferrer">Using an MRS Client on Nodes Outside a Cluster</a>, and log in to the node where the MRS client is installed.</span>.</li></ul>
|
|
<div class="section" id="mrs_01_1183__section13206075175"><h4 class="sectiontitle">Using the Spark Client</h4><ol id="mrs_01_1183__o65a723c3f0644a5ca5bc95b50051ef8f"><li id="mrs_01_1183__li12507175635615"><span><span id="mrs_01_1183__ph243295392411">Based on the client location, log in to the node where the client is installed. For details, see <a href="https://docs.otc.t-systems.com/usermanual/mrs/mrs_01_0090.html" target="_blank" rel="noopener noreferrer">Using an MRS Client on Nodes Inside a Cluster</a>, or <a href="https://docs.otc.t-systems.com/usermanual/mrs/mrs_01_0091.html" target="_blank" rel="noopener noreferrer">Using an MRS Client on Nodes Outside a Cluster</a>.</span></span></li><li id="mrs_01_1183__l918962d747ac488fae8d369a02cf0b01"><span>Run the following command to go to the client installation directory:</span><p><p id="mrs_01_1183__ae6fabba0d23e4ae4bc35c6ef79cff605"><strong id="mrs_01_1183__a5a32ca4aacc5401ca0e8e8a12040e570">cd /opt/client</strong></p>
|
|
</p></li><li id="mrs_01_1183__lf110d935709c4ac48ee0ad1420665c2e"><span>Run the following command to configure environment variables:</span><p><p id="mrs_01_1183__acfff651122a74259a5e01741838c29e9"><strong id="mrs_01_1183__a468a1a99aae541fbab02686dddf0e45a">source bigdata_env</strong></p>
|
|
</p></li><li id="mrs_01_1183__lc24dad0c1fb34eec930f24087726a7fd"><span>If the cluster is in security mode, run the following command to authenticate the user. In normal mode, user authentication is not required.</span><p><p id="mrs_01_1183__a2a7d2557b3594004a61ea1dc86fb7d75"><strong id="mrs_01_1183__b1259311118179">kinit</strong> <em id="mrs_01_1183__i660141110175">Component service user</em></p>
|
|
</p></li><li id="mrs_01_1183__li6626247810502"><span>Run the Spark shell command. The following provides an example:</span><p><p id="mrs_01_1183__p15071440163915"><strong id="mrs_01_1183__b167772124113">spark-beeline</strong></p>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0589.html">Using Spark</a></div>
|
|
</div>
|
|
</div>
|
|
|