forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
19 lines
4.6 KiB
HTML
19 lines
4.6 KiB
HTML
<a name="mrs_01_1828"></a><a name="mrs_01_1828"></a>
|
|
|
|
<h1 class="topictitle1">Submitting a Streaming Job</h1>
|
|
<div id="body1591347174953"><div class="section" id="mrs_01_1828__s2ca823757878477e86d837e309fe5681"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1828__afedc443758c6427cb9d13f3a2ed92ae0">This section describes how to submit an Oozie job of the Streaming type on the Hue web UI.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1828__sa56ee812d87d4ebf9591237384a4302c"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1828__o9911278fc241427c9b4769cfa62d9ee8"><li id="mrs_01_1828__l628d22ad1ce546c0b862eff3887cd298"><span>Create a workflow. For details, see <a href="mrs_01_1818.html">Creating a Workflow</a>.</span></li><li id="mrs_01_1828__l1a86f7da433945bb8a5eb7d4f03c0565"><span>On the workflow editing page, select <span><img id="mrs_01_1828__ibffa3671c5034ec6a6c7120b8f9dfbf7" src="en-us_image_0000001348770305.jpg"></span> next to <strong id="mrs_01_1828__b79221241289">Streaming</strong> and drag it to the operation area.</span></li><li id="mrs_01_1828__l04058bf98cd64ce3917c7e67330ee32e"><span>In the <strong id="mrs_01_1828__b3544121682810">Streaming</strong> window that is displayed, set <span class="parmname" id="mrs_01_1828__parmname02962219268"><b>Mapper</b></span>, for example, to <strong id="mrs_01_1828__b11550116162819">/bin/cat</strong>. Set <span class="parmname" id="mrs_01_1828__parmname12519161192616"><b>Reducer</b></span>, for example, to <strong id="mrs_01_1828__b682718193288">/usr/bin/wc</strong>. Click <strong id="mrs_01_1828__b26807221284">Add</strong>.</span></li><li id="mrs_01_1828__l2d8c9611f31c484b8c7148971f71d393"><span>Click <strong id="mrs_01_1828__b71531241143611">FILE+</strong> to add the files required for running.</span><p><p id="mrs_01_1828__a6798092a2aae46da9af42c682165f85d">for example, <strong id="mrs_01_1828__b127561357281">/user/oozie/share/lib/mapreduce-streaming/hadoop-streaming-3.1.1.jar</strong> and <strong id="mrs_01_1828__b1756153514284">/user/oozie/share/lib/mapreduce-streaming/oozie-sharelib-streaming-5.1.0.jar</strong>.</p>
|
|
</p></li><li id="mrs_01_1828__leacfe3a6b1ef4339babb695d0a270c33"><span>Click the configuration button <span><img id="mrs_01_1828__i3392bba734764f4ca5379c782212cbea" src="en-us_image_0000001296249924.jpg"></span> in the upper right corner. On the configuration page that is displayed, click <span class="uicontrol" id="mrs_01_1828__uicontrol4605642332"><b>Delete+</b></span> to delete a directory, for example, <strong id="mrs_01_1828__b176059419332">/user/admin/examples/output-data/streaming_workflow</strong>.</span></li><li id="mrs_01_1828__l6f9ab73a6c494216bc9cd5523d27e209"><span>Click <strong id="mrs_01_1828__b1876311519335">PROPERTIES+</strong> to add the following properties:</span><p><ul id="mrs_01_1828__ud351867ca8ec45d88758ada078cf1b02"><li id="mrs_01_1828__l74e0a07209c14368b571b79e99efb529">Enter the property name <span class="parmname" id="mrs_01_1828__parmname47127152811"><b>mapred.input.dir</b></span> in the left box and enter the property value <strong id="mrs_01_1828__b14418128298">/user/admin/examples/input-data/text</strong> in the right box.</li><li id="mrs_01_1828__l7b837f59a5da4950946aa9a6e0245936">Enter the property name <span class="parmname" id="mrs_01_1828__parmname1186144813287"><b>mapred.output.dir</b></span> in the left box and enter the attribute value <strong id="mrs_01_1828__b135693256292">/user/admin/examples/output-data/streaming_workflow</strong> in the right box.</li></ul>
|
|
</p></li><li id="mrs_01_1828__l98a18787d4a946828343b461c8d105ba"><span>Click <span><img id="mrs_01_1828__image1236335111194" src="en-us_image_0000001296090268.png"></span> in the upper right corner of the Oozie editor.</span><p><p id="mrs_01_1828__adfaa4fcd35194c1a924c2f81ffd76abf">If you need to modify the job name before saving the job (default value: <span class="parmname" id="mrs_01_1828__parmname235311403338"><b>My Workflow</b></span>), click the name directly for modification, for example, <strong id="mrs_01_1828__b535884014332">Streaming-Workflow</strong>.</p>
|
|
</p></li><li id="mrs_01_1828__l0303ca4abfb6498fa9791726fe1e1b22"><span>After the configuration is saved, click <span><img id="mrs_01_1828__i45d0511af0314cd99716eb579ba2864d" src="en-us_image_0000001295930444.jpg"></span>, and submit the job.</span><p><p id="mrs_01_1828__a6ca82e95d3c8452b8490d22c0592889b">After the job is submitted, you can view the related contents of the job, such as the detailed information, logs, and processes, on Hue.</p>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1819.html">Submitting a Workflow Job</a></div>
|
|
</div>
|
|
</div>
|
|
|