forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
15 lines
1.6 KiB
HTML
15 lines
1.6 KiB
HTML
<a name="mrs_01_2006"></a><a name="mrs_01_2006"></a>
|
|
|
|
<h1 class="topictitle1">Why Cannot Exit the Driver Process?</h1>
|
|
<div id="body1595920219443"><div class="section" id="mrs_01_2006__s5f17e25af107456baf9e0c9db6162415"><h4 class="sectiontitle">Question</h4><p id="mrs_01_2006__acada1fb0f82c418f87715878af308296">Why cannot exit the Driver process after running the <b><span class="cmdname" id="mrs_01_2006__cmdname188734207300">yarn application -kill applicationID</span></b> command to stop the Spark Streaming application?</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_2006__sa47108ab544f481694a6df1efcad87db"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_2006__a18a2d9b2a8634cdcb55b7bae8fa54b53">Running the <b><span class="cmdname" id="mrs_01_2006__cmdname8420182403016">yarn application -kill applicationID</span></b> command can only stop the SparkContext corresponding to Spark Streaming application, but cannot exit the current Driver process. If there are other permanent threads in the Driver process (for example, the spark shell is continually checking command input or Spark Streaming is continually reading data form data source), the Driver process will not be killed when the SparkContext is stopped. To exit the Driver process, you are advised to run the <b><span class="cmdname" id="mrs_01_2006__cmdname288142733015">kill -9 pid</span></b><strong id="mrs_01_2006__a8c1005d2d7cf40dfa7f769d59fd13426"> </strong>command to kill the current Driver process by hand.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2003.html">Spark Core</a></div>
|
|
</div>
|
|
</div>
|
|
|