forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
29 lines
6.7 KiB
HTML
29 lines
6.7 KiB
HTML
<a name="mrs_01_0767"></a><a name="mrs_01_0767"></a>
|
|
|
|
<h1 class="topictitle1">Accessing the Spark Web UI</h1>
|
|
<div id="body1589421621257"><p id="mrs_01_0767__p874644582511">The Spark web UI is used to view the running status of Spark applications. Google Chrome is recommended for better user experience.</p>
|
|
<p id="mrs_01_0767__en-us_topic_0036027307_p27469644195138">Spark has two web UIs.</p>
|
|
<ul id="mrs_01_0767__en-us_topic_0036027307_ul24825544195145"><li id="mrs_01_0767__en-us_topic_0036027307_li22103310195145">Spark UI: used to display the status of running applications.<p id="mrs_01_0767__en-us_topic_0036027307_p64712065195145"><a name="mrs_01_0767__en-us_topic_0036027307_li22103310195145"></a><a name="en-us_topic_0036027307_li22103310195145"></a>The UI includes the following parts: Jobs, Stages, Storage, Environment, Executors, SQL, and JDBC/ODBC Server. The Streaming application has the Streaming tab in addition to the preceding parts.</p>
|
|
</li><li id="mrs_01_0767__en-us_topic_0036027307_li45426535145217">History Server UI: used to display the status of Spark applications that are complete or incomplete.<p id="mrs_01_0767__p640713711254"><a name="mrs_01_0767__en-us_topic_0036027307_li45426535145217"></a><a name="en-us_topic_0036027307_li45426535145217"></a>The UI includes the application ID, application name, start time, end time, execution time, and owner information.</p>
|
|
</li></ul>
|
|
<div class="section" id="mrs_01_0767__section15116141312243"><h4 class="sectiontitle">Spark UI</h4><ol id="mrs_01_0767__ol43101650122618"><li id="mrs_01_0767__li1450385018333"><span>Access the component management page.</span><p><ul id="mrs_01_0767__ul48008460573"><li id="mrs_01_0767__li1827754692810">For versions earlier than MRS 1.9.2, log in to MRS Manager and choose <strong id="mrs_01_0767__b193741413197">Services</strong>.</li><li id="mrs_01_0767__li1080074618576">For versions earlier than MRS 3.<em id="mrs_01_0767__i514875318195">x</em>, click the cluster name to go to the cluster details page and choose <strong id="mrs_01_0767__b8807164413193">Components</strong>.<div class="note" id="mrs_01_0767__note1280014616574"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_0767__p158007468574">If the <strong id="mrs_01_0767__b109675213012">Components</strong> tab is unavailable, complete IAM user synchronization first. (On the <strong id="mrs_01_0767__b159619527013">Dashboard</strong> page, click <strong id="mrs_01_0767__b49665211017">Synchronize</strong> on the right side of <span class="parmname" id="mrs_01_0767__parmname199795218010"><b>IAM User Sync</b></span> to synchronize IAM users.)</p>
|
|
</div></div>
|
|
</li><li id="mrs_01_0767__li78001046145717">For MRS 3.<em id="mrs_01_0767__i1124719585192">x</em> or later, log in to FusionInsight Manager. For details, see <a href="mrs_01_2124.html">Accessing FusionInsight Manager (MRS 3.x or Later)</a>. Choose <strong id="mrs_01_0767__b138941259161918">Cluster</strong> > <em id="mrs_01_0767__i1789515921915">Name of the desired cluster</em> > <strong id="mrs_01_0767__b389695941917">Services</strong>.</li></ul>
|
|
</p></li><li id="mrs_01_0767__li1636202311390"><span>Select <strong id="mrs_01_0767__b5967105310527">Yarn</strong>. In the <span class="parmname" id="mrs_01_0767__parmname13969165325212"><b>Yarn Summary</b></span> area, click <strong id="mrs_01_0767__b39701535528">ResourceManager</strong> in <strong id="mrs_01_0767__b1971185315523">ResourceManager Web UI</strong> to access the web UI.</span></li><li id="mrs_01_0767__li13948151714114"><span>Locate the Spark application. Click <span class="parmname" id="mrs_01_0767__parmname19604945104114"><b>ApplicationMaster</b></span> in the last column of the application information. The Spark UI is displayed.</span><p><div class="fignone" id="mrs_01_0767__fig1725412257614"><span class="figcap"><b>Figure 1 </b>ApplicationMaster</span><br><span><img id="mrs_01_0767__image191716151469" src="en-us_image_0000001388045030.png"></span></div>
|
|
<div class="fignone" id="mrs_01_0767__fig941314811449"><span class="figcap"><b>Figure 2 </b>Spark UI</span><br><span><img id="mrs_01_0767__image118131017351" src="en-us_image_0000001295770828.png"></span></div>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="mrs_01_0767__section203881712162610"><h4 class="sectiontitle">History Server</h4><ol id="mrs_01_0767__ol68231358451"><li id="mrs_01_0767__li1064515408350"><span>Access the component management page.</span><p><ul id="mrs_01_0767__ul1164594019358"><li id="mrs_01_0767__li964519403355">For versions earlier than MRS 1.9.2, log in to MRS Manager and choose <strong id="mrs_01_0767__b61881814202">Services</strong>.</li><li id="mrs_01_0767__li364518408351">For versions earlier than MRS 3.<em id="mrs_01_0767__i12902141142016">x</em>, click the cluster name to go to the cluster details page and choose <strong id="mrs_01_0767__b149091911182020">Components</strong>.<div class="note" id="mrs_01_0767__note18645204016358"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_0767__p1041917874419">If the <strong id="mrs_01_0767__b14114541704">Components</strong> tab is unavailable, complete IAM user synchronization first. (On the <strong id="mrs_01_0767__b6119541208">Dashboard</strong> page, click <strong id="mrs_01_0767__b1511954606">Synchronize</strong> on the right side of <span class="parmname" id="mrs_01_0767__parmname613541011"><b>IAM User Sync</b></span> to synchronize IAM users.)</p>
|
|
</div></div>
|
|
</li><li id="mrs_01_0767__li126451340133519">For MRS 3.<em id="mrs_01_0767__i71381516172012">x</em> or later, log in to FusionInsight Manager. For details, see <a href="mrs_01_2124.html">Accessing FusionInsight Manager (MRS 3.x or Later)</a>. Choose <strong id="mrs_01_0767__b13920171711207">Cluster</strong> > <em id="mrs_01_0767__i17922111713202">Name of the desired cluster</em> > <strong id="mrs_01_0767__b1092301712011">Services</strong>.</li></ul>
|
|
</p></li><li id="mrs_01_0767__li882415519456"><span>Select <strong id="mrs_01_0767__b1414512128544">Spark</strong>. In the <span class="parmname" id="mrs_01_0767__parmname19147612165418"><b>Spark Summary</b></span> area, click <strong id="mrs_01_0767__b21481512155417">JobHistory</strong> corresponding to <span class="parmname" id="mrs_01_0767__parmname201504124542"><b>Spark Web UI</b></span> to access the web UI.</span><p><div class="fignone" id="mrs_01_0767__fig44392311151"><span class="figcap"><b>Figure 3 </b>Spark History Server</span><br><span><img id="mrs_01_0767__image12925174831418" src="en-us_image_0000001439698689.png"></span></div>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0589.html">Using Spark</a></div>
|
|
</div>
|
|
</div>
|
|
|