forked from docs/doc-exports
DIS UMN 20230915 version
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com> Co-committed-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
This commit is contained in:
parent
09841dde95
commit
b33a41468c
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -52,5 +52,4 @@
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div></div>
|
||||
|
||||
|
||||
@ -5,7 +5,7 @@
|
||||
</div>
|
||||
<div class="section" id="dis_01_0045__section44362682195133"><h4 class="sectiontitle">Prerequisites</h4><p id="dis_01_0045__p62570614195753">An IAM agency has been created by following the procedure in <a href="dis_01_0605.html">Creating an IAM Agency</a>. This IAM agency entrusts DIS to access your OBS resources.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0045__section15729224195053"><h4 class="sectiontitle">Data Dumping</h4><p id="dis_01_0045__p1208054610731">You can set <strong id="dis_01_0045__b175052719475">Dump Bucket</strong> when <a href="dis_01_0047.html">Creating a Dump Task</a>. If Dump Destination is set to <strong id="dis_01_0045__b2701716145632">OBS</strong>, DIS periodically imports data from DIS streams to OBS.</p>
|
||||
<div class="section" id="dis_01_0045__section15729224195053"><h4 class="sectiontitle">Data Dumping</h4><p id="dis_01_0045__p1208054610731">You can set <strong id="dis_01_0045__b13796243584">Dump Bucket</strong> when <a href="dis_01_0047.html">Creating a Dump Task</a>. If Dump Destination is set to <strong id="dis_01_0045__b2701716145632">OBS</strong>, DIS periodically imports data from DIS streams to OBS.</p>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
|
||||
15
docs/dis/umn/dis_01_0051.html
Normal file
15
docs/dis/umn/dis_01_0051.html
Normal file
@ -0,0 +1,15 @@
|
||||
<a name="dis_01_0051"></a><a name="dis_01_0051"></a>
|
||||
|
||||
<h1 class="topictitle1">Notifying Events</h1>
|
||||
<div id="body8662426"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0052.html">Event Notification Overview</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0053.html">Setting Notification</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0054.html">Viewing Events</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
||||
107
docs/dis/umn/dis_01_0052.html
Normal file
107
docs/dis/umn/dis_01_0052.html
Normal file
File diff suppressed because it is too large
Load Diff
64
docs/dis/umn/dis_01_0053.html
Normal file
64
docs/dis/umn/dis_01_0053.html
Normal file
@ -0,0 +1,64 @@
|
||||
<a name="dis_01_0053"></a><a name="dis_01_0053"></a>
|
||||
|
||||
<h1 class="topictitle1">Setting Notification</h1>
|
||||
<div id="body8662426"><p id="dis_01_0053__en-us_topic_0107811181_p1637252785818">After enabling Notification for subscribed events, you will receive notifications by email or SMS when management, monitoring, or security events occur in a specific cluster or dump task.</p>
|
||||
<div class="section" id="dis_01_0053__en-us_topic_0107811181_section29431612141618"><h4 class="sectiontitle">Creating a Subscription</h4><ol id="dis_01_0053__en-us_topic_0107811181_ol618381192220"><li id="dis_01_0053__li15698020121516"><span>Use the account to log in to the DIS console.</span></li><li id="dis_01_0053__en-us_topic_0107811181_li5247206216936"><span>Click <span class="uicontrol" id="dis_01_0053__en-us_topic_0107811181_uicontrol23094277794450"><b>Event Management</b></span>.</span></li><li id="dis_01_0053__en-us_topic_0107811181_li3444153313462"><span>On the <span class="wintitle" id="dis_01_0053__en-us_topic_0107811181_wintitle14277202589453"><b>Event Management</b></span> page, choose <span class="uicontrol" id="dis_01_0053__en-us_topic_0107811181_uicontrol2309427779466"><b>Subscriptions</b></span> > <span class="uicontrol" id="dis_01_0053__en-us_topic_0107811181_uicontrol23094277794615"><b>Create Subscription</b></span>.</span></li><li id="dis_01_0053__en-us_topic_0107811181_li18772435125416"><a name="dis_01_0053__en-us_topic_0107811181_li18772435125416"></a><a name="en-us_topic_0107811181_li18772435125416"></a><span>In the <span class="wintitle" id="dis_01_0053__en-us_topic_0107811181_wintitle72665175195812"><b>Subscription Settings</b></span> area, set basic subscription information and event filtering.</span><p><div class="p" id="dis_01_0053__en-us_topic_0107811181_p39911636205410">The <span class="wintitle" id="dis_01_0053__wintitle1399118312373"><b>Events</b></span> area displays the events filtered by the system based on the subscription settings.
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0053__en-us_topic_0107811181_table197058275115" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Subscription parameters</caption><thead align="left"><tr id="dis_01_0053__en-us_topic_0107811181_row4704172711114"><th align="left" class="cellrowborder" valign="top" width="26%" id="mcps1.3.2.2.4.2.1.2.2.3.1.1"><p id="dis_01_0053__en-us_topic_0107811181_p1270452717114"><strong id="dis_01_0053__en-us_topic_0107811181_b7617970162543">Parameter</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="74%" id="mcps1.3.2.2.4.2.1.2.2.3.1.2"><p id="dis_01_0053__en-us_topic_0107811181_p9704132751119"><strong id="dis_01_0053__en-us_topic_0107811181_b842352706181449">Description</strong></p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0053__en-us_topic_0107811181_row127045270117"><td class="cellrowborder" valign="top" width="26%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.1 "><p id="dis_01_0053__en-us_topic_0107811181_p970452716119">Notification</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="74%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.2 "><p id="dis_01_0053__en-us_topic_0107811181_p1370413271118">Enable or disable event subscription.</p>
|
||||
<p id="dis_01_0053__en-us_topic_0107811181_p2704172741117"><span><img id="dis_01_0053__image490616816420" src="en-us_image_0000001274606310.png"></span> indicates that notification is enabled and <span><img id="dis_01_0053__image438211191742" src="en-us_image_0000001325286261.png"></span> indicates that notification is disabled. By default, notification is disabled. After notification is disabled, the system stops sending notifications of subscribed events but does not delete the subscription.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0053__en-us_topic_0107811181_row137055276114"><td class="cellrowborder" valign="top" width="26%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.1 "><p id="dis_01_0053__en-us_topic_0107811181_p137043275113">Subscription Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="74%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.2 "><p id="dis_01_0053__en-us_topic_0107811181_p1370582710116">Enter the name of a subscription.</p>
|
||||
<ul id="dis_01_0053__en-us_topic_0107811181_ul386613493427"><li id="dis_01_0053__en-us_topic_0107811181_li148661492425">The name can contain letters (upper or lower case), digits, hyphens (-), and underscores (_) and must start with a letter or digit.</li><li id="dis_01_0053__en-us_topic_0107811181_li350575316421">The name contains 1 to 64 characters.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0053__row18587316418"><td class="cellrowborder" valign="top" width="26%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.1 "><p id="dis_01_0053__p18591131945">Subscription Stream</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="74%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.2 "><p id="dis_01_0053__p132585531659">Specifies whether to enable subscription to alarms of a specified stream.</p>
|
||||
<p id="dis_01_0053__p1050319321711"><span><img id="dis_01_0053__image14807152718411" src="en-us_image_0000001325622881.png"></span> indicates that subscription to alarms of a specified stream is enabled. <span><img id="dis_01_0053__image144990307410" src="en-us_image_0000001274783064.png"></span> indicates that subscription to alarms of a specified channel is disabled. By default, the function is disabled.</p>
|
||||
<p id="dis_01_0053__p78591633415">After this function is enabled, the alarms sent from your specified stream are received, and sent from other streams will not be received.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0053__row070562921120"><td class="cellrowborder" valign="top" width="26%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.1 "><p id="dis_01_0053__p27061293119">Subscription Type</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="74%" headers="mcps1.3.2.2.4.2.1.2.2.3.1.2 "><p id="dis_01_0053__p15706132912119">Two subscription types are supported: SMN and DIS.</p>
|
||||
<div class="note" id="dis_01_0053__note127718961512"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dis_01_0053__ul1327572511618"><li id="dis_01_0053__li227542571620">If <strong id="dis_01_0053__b34687156125">Subscription Type</strong> is set to <span class="parmvalue" id="dis_01_0053__parmvalue344610292174"><b>SMN</b></span>, go to <a href="#dis_01_0053__en-us_topic_0107811181_li89041225162317">Step 5</a>.</li><li id="dis_01_0053__li16228127171613">If <strong id="dis_01_0053__b9274834104510">Subscription Type</strong> is set to <span class="parmvalue" id="dis_01_0053__parmvalue627463454512"><b>DIS</b></span>, go to <a href="#dis_01_0053__en-us_topic_0107811181_li89041225162317">5</a> to select a stream.</li></ul>
|
||||
</div></div>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
</p></li><li id="dis_01_0053__en-us_topic_0107811181_li89041225162317"><a name="dis_01_0053__en-us_topic_0107811181_li89041225162317"></a><a name="en-us_topic_0107811181_li89041225162317"></a><span>Select a message notification topic from the <span class="wintitle" id="dis_01_0053__en-us_topic_0107811181_wintitle12706132719118"><b>SMN Topic</b></span> drop-down list.</span><p><p id="dis_01_0053__en-us_topic_0107811181_p284811241395">You can perform the following operations to create a message notification topic as required.</p>
|
||||
<ol type="a" id="dis_01_0053__en-us_topic_0107811181_ol1655184572010"><li id="dis_01_0053__en-us_topic_0107811181_li1665514522016">Click <span class="uicontrol" id="dis_01_0053__uicontrol1460926357172730"><b>Create SMN Topic</b></span>. The <span class="wintitle" id="dis_01_0053__wintitle1378990280172813"><b>Topics</b></span> page of SMN is displayed. You can click <span class="uicontrol" id="dis_01_0053__uicontrol85555059172836"><b>Create Topic</b></span> in the upper right corner to create a topic. For details, see section <span class="parmname" id="dis_01_0053__parmname031112583189"><b>Creating a Topic</b></span> in the <i><cite id="dis_01_0053__citeacde73f3b0844fde9d801e7dcea237fb110026">Simple Message Notification User Guide</cite></i>.</li><li id="dis_01_0053__li320117463158">In the <strong id="dis_01_0053__b17711219182">Operation</strong> column of a topic, choose <span class="menucascade" id="dis_01_0053__menucascade93421259201712"><b><span class="uicontrol" id="dis_01_0053__uicontrol1934215971710">More</span></b> > <b><span class="uicontrol" id="dis_01_0053__uicontrol1724819451819">Configure Topic Policy</span></b></span> and select <span class="parmvalue" id="dis_01_0053__parmvalue55512574417356"><b>DIS</b></span> under <span class="wintitle" id="dis_01_0053__wintitle1275871301173616"><b>Services that can publish messages to this topic</b></span> to enable SMN to publish DIS topics.</li><li id="dis_01_0053__li131576912108">In the row containing the created topic, click <span class="uicontrol" id="dis_01_0053__uicontrol55211142316"><b>Add Subscription</b></span> to add a subscription to the topic. For details, see <span class="parmname" id="dis_01_0053__parmname118017159249"><b>Adding a Subscription</b></span> in the <i><cite id="dis_01_0053__cite74379e47ad704b73a5d486173e647969110026">Simple Message Notification User Guide</cite></i>.</li></ol>
|
||||
</p></li><li id="dis_01_0053__en-us_topic_0107811181_li164751612342"><a name="dis_01_0053__en-us_topic_0107811181_li164751612342"></a><a name="en-us_topic_0107811181_li164751612342"></a><span>Click <span class="uicontrol" id="dis_01_0053__uicontrol149811448153710"><b>OK</b></span>.</span></li></ol>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0053__en-us_topic_0107811181_section15897267154"><h4 class="sectiontitle">Modifying the Subscription</h4><ol id="dis_01_0053__en-us_topic_0107811181_ol4552459114519"><li id="dis_01_0053__en-us_topic_0107811181_li3436434464"><span>Choose <span class="wintitle" id="dis_01_0053__wintitle1377172043"><b>Event Management</b></span> > <span class="uicontrol" id="dis_01_0053__uicontrol1134926495"><b>Subscriptions</b></span>.</span></li><li id="dis_01_0053__en-us_topic_0107811181_li54051130134914"><span>In the <span class="parmname" id="dis_01_0053__parmname23619295260"><b>Operation</b></span> column of a specified subscription name, choose <span class="menucascade" id="dis_01_0053__menucascade86614543143"><b><span class="uicontrol" id="dis_01_0053__uicontrol156611554171411">More</span></b> > <b><span class="uicontrol" id="dis_01_0053__uicontrol895855714141">Modify</span></b></span>.</span></li><li id="dis_01_0053__en-us_topic_0107811181_li5520759174712"><span>On the <span class="wintitle" id="dis_01_0053__wintitle387655375174654"><b>Subscription Settings</b></span> page, set the parameters that you want to modify. For details, see <a href="#dis_01_0053__en-us_topic_0107811181_li18772435125416">Step 4</a> to <a href="#dis_01_0053__en-us_topic_0107811181_li164751612342">Step 6</a> in section <strong id="dis_01_0053__b1492013615286">Creating a Subscription</strong>.</span></li></ol>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0053__en-us_topic_0107811181_section158093716157"><h4 class="sectiontitle">Deleting the Subscription</h4><ol id="dis_01_0053__en-us_topic_0107811181_ol817247135518"><li id="dis_01_0053__en-us_topic_0107811181_li18174371552"><span>Choose <span class="wintitle" id="dis_01_0053__wintitle7262479472"><b>Event Management</b></span> > <span class="uicontrol" id="dis_01_0053__uicontrol1026847114718"><b>Subscriptions</b></span>.</span></li><li id="dis_01_0053__en-us_topic_0107811181_li18933111906"><span>In the <span class="parmname" id="dis_01_0053__parmname720744518287"><b>Operation</b></span> column of a specified subscription name, choose <span class="menucascade" id="dis_01_0053__menucascade1674151671611"><b><span class="uicontrol" id="dis_01_0053__uicontrol187441681614">More</span></b> > <b><span class="uicontrol" id="dis_01_0053__uicontrol13222154431612">Delete</span></b></span>. The <strong id="dis_01_0053__b1125331143413">Delete Subscription</strong> dialog box is displayed.</span><p><div class="fignone" id="dis_01_0053__en-us_topic_0107811181_fig69271911204"><span class="figcap"><b>Figure 1 </b>Confirming deletion</span><br><span><img id="dis_01_0053__en-us_topic_0107811181_image11928121403" src="en-us_image_0130822560.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
</p></li><li id="dis_01_0053__en-us_topic_0107811181_li131841171559"><span>Click <span class="uicontrol" id="dis_01_0053__en-us_topic_0107811181_uicontrol23094277717518"><b>OK</b></span>.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0051.html">Notifying Events</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
13
docs/dis/umn/dis_01_0054.html
Normal file
13
docs/dis/umn/dis_01_0054.html
Normal file
@ -0,0 +1,13 @@
|
||||
<a name="dis_01_0054"></a><a name="dis_01_0054"></a>
|
||||
|
||||
<h1 class="topictitle1">Viewing Events</h1>
|
||||
<div id="body8662426"><p id="dis_01_0054__en-us_topic_0107811182_p11837182817245">This section describes how to search for events that occur in a stream or dump task.</p>
|
||||
<ol id="dis_01_0054__en-us_topic_0107811182_ol19571141018257"><li id="dis_01_0054__en-us_topic_0107811182_li4319134042615"><span>In the navigation tree, choose <span class="wintitle" id="dis_01_0054__wintitle1572994000175635"><b>Event Management</b></span> > <span class="uicontrol" id="dis_01_0054__uicontrol406011821175655"><b>Events</b></span>. All events are displayed by default.</span></li><li id="dis_01_0054__en-us_topic_0107811182_li76511612202514"><span>Select different filter criteria from the drop-down list in the upper right corner of the event list to search for events. Events can be filtered based on the event level or event source.</span><p><ul id="dis_01_0054__en-us_topic_0107811182_ul315410468018"><li id="dis_01_0054__li18818183116593">In the <span class="wintitle" id="dis_01_0054__wintitle1634313919251"><b>Event Levels</b></span> drop-down list, select <span class="wintitle" id="dis_01_0054__wintitle181813111591"><b>All</b></span>, <span class="parmvalue" id="dis_01_0054__parmvalue14818231105913"><b>Normal</b></span>, or <span class="uicontrol" id="dis_01_0054__uicontrol118181031115913"><b>Warning</b></span></li><li id="dis_01_0054__en-us_topic_0107811182_li1115415462010">In the <span class="wintitle" id="dis_01_0054__wintitle1913212267269"><b>Event source</b></span> drop-down list, select <span class="wintitle" id="dis_01_0054__wintitle213907821112919"><b>Event source</b></span>. In the search box, enter a stream name or a dump task name, for example, <span class="parmvalue" id="dis_01_0054__parmvalue2083136391113056"><b>demo</b></span>.</li></ul>
|
||||
</p></li><li id="dis_01_0054__en-us_topic_0107811182_li146391212579"><span>Click <span><img id="dis_01_0054__image80908220918139" src="en-us_image_0109727712.png"></span>. The filtered event query results are displayed.</span></li><li id="dis_01_0054__li17286201113820"><span>Click <span><img id="dis_01_0054__image137424299399" src="en-us_image_0130854869.jpg"></span> on the right of <strong id="dis_01_0054__b1916638164316">Event</strong> and select an event name, for example, <span class="parmvalue" id="dis_01_0054__parmvalue111691355457"><b>Dump task restored</b></span> to filter the corresponding events.</span></li></ol>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0051.html">Notifying Events</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -70,7 +70,7 @@
|
||||
<tr id="dis_01_0601__row4185757122618"><td class="cellrowborder" valign="top" width="17.169999999999998%" headers="mcps1.3.2.2.3.2.1.2.4.1.1 "><p id="dis_01_0601__p151858575262">Configure</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.14000000000001%" headers="mcps1.3.2.2.3.2.1.2.4.1.2 "><p id="dis_01_0601__p10185257162613">Click <span class="uicontrol" id="dis_01_0601__uicontrol13125894985841"><b>Configure now</b></span>. The <strong id="dis_01_0601__b18203402375841">Tag</strong> parameter is displayed.</p>
|
||||
<p id="dis_01_0601__p121853571268">For details about how to add a tag, see <a href="dis_01_0050.html">Managing Stream Tags</a>.</p>
|
||||
<p id="dis_01_0601__p121853571268">For details about how to add tags, see <a href="dis_01_0050.html">Managing Stream Tags</a>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.689999999999998%" headers="mcps1.3.2.2.3.2.1.2.4.1.3 "><p id="dis_01_0601__p20185105772617">-</p>
|
||||
</td>
|
||||
|
||||
@ -12,7 +12,7 @@
|
||||
</li><li id="dis_01_0602__li6851708153416"><a name="dis_01_0602__li6851708153416"></a><a name="li6851708153416"></a>Configure the basic information about JDK and click <strong id="dis_01_0602__b18713475215">Finish</strong>.<ul id="dis_01_0602__ul58229260153416"><li id="dis_01_0602__li18117474153416">JRE home: JDK installation path.</li><li id="dis_01_0602__li28839539153416">Default VM arguments: JDK running parameters.</li></ul>
|
||||
</li></ol>
|
||||
</li></ol>
|
||||
</p></li><li id="dis_01_0602__li17211251113218"><span>Download resource packages.</span><p><p id="dis_01_0602__p17175858123216">Download the DIS SDK from <a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip</a> and its integrity check file from <a href="https://dis.obs.eu-de.otctest.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otctest.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum</a>.</p>
|
||||
</p></li><li id="dis_01_0602__li17211251113218"><span>Download resource packages.</span><p><p id="dis_01_0602__p17175858123216">Download the DIS SDK from <a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip</a> and its integrity check file from <a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum</a>.</p>
|
||||
</p></li><li id="dis_01_0602__le2a3cf8a367549798404bbcf1cf7ea15"><span>Import the Eclipse project.</span><p><ol type="a" id="dis_01_0602__o09dc93a9c5694e4eabe12ca18cb2d199"><li id="dis_01_0602__l99736f2e4f434b36b4feef5a96d43f1b">Start Eclipse. Choose <strong id="dis_01_0602__b21218030">File</strong> > <strong id="dis_01_0602__b1252556736">Import</strong>. The <strong id="dis_01_0602__b532006888">Import</strong> dialog box is displayed.</li></ol><ol type="a" start="2" id="dis_01_0602__o48f7ccdb3db1480cb52aa4bd47e2ec9c"><li id="dis_01_0602__l1403bea7f19048d382c18d734e6261d7">Choose <strong id="dis_01_0602__b195501321134219">General</strong> > <strong id="dis_01_0602__b17174202713422">Existing Projects into Workspace</strong> and click <strong id="dis_01_0602__b132021032124216">Next</strong>. The <strong id="dis_01_0602__b13676163924212">Import</strong> dialog box is displayed.</li><li id="dis_01_0602__l02019edd289d44c19d4d3ad62eec78f9">Click <span class="uicontrol" id="dis_01_0602__uicontrol118319817246"><b>Browse</b></span> and select a save location for the <strong id="dis_01_0602__b151834812243">dis-sdk-demo</strong> sample project. In the <strong id="dis_01_0602__b10185118182412">Projects</strong> area, select a sample project.<div class="fignone" id="dis_01_0602__f23cd224614d04888bfa7c759107662f3"><span class="figcap"><b>Figure 5 </b>Importing a project</span><br><span><img id="dis_01_0602__idcec954a169d4bc2b6122678f2dd46e0" src="en-us_image_0151034370.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
</li><li id="dis_01_0602__l2452f0057dc54df6ab09179f6d33c01b">Click <strong id="dis_01_0602__b669649622">Finish</strong>.</li></ol>
|
||||
</p></li><li id="dis_01_0602__li52111729235"><span>Configure the demo project.</span><p><ol type="a" id="dis_01_0602__ol10242182182315"><li id="dis_01_0602__li32426216234">Set the project code to <strong id="dis_01_0602__b98121317162514">UTF-8</strong>.<ol class="substepthirdol" id="dis_01_0602__ol424202152314"><li id="dis_01_0602__li224214212314">In the navigation tree, right-click the required project under <strong id="dis_01_0602__b3902835192620">Project Explorer</strong> and choose <strong id="dis_01_0602__b7922174162616">Properties</strong> from the shortcut menu. The <strong id="dis_01_0602__b202905720214337">Properties for dis-sdk-demo</strong> dialog box is displayed.</li><li id="dis_01_0602__li12242102102318">In the navigation tree, choose <strong id="dis_01_0602__b1455116372279">Resource</strong>. The <strong id="dis_01_0602__b187018520143311">Resource</strong> page is displayed in the right pane.</li><li id="dis_01_0602__li1724211212236">In the <strong id="dis_01_0602__b39781423192817">Other</strong> drop-down list, select <strong id="dis_01_0602__b164681354162911">UTF-8</strong>.</li><li id="dis_01_0602__li9242162112312">Click <strong id="dis_01_0602__b544011192304">Apply and Close</strong>.</li></ol>
|
||||
|
||||
@ -2,7 +2,7 @@
|
||||
|
||||
<h1 class="topictitle1">Step 3: Sending Data to DIS</h1>
|
||||
<div id="body1493022272990"><div class="section" id="dis_01_0603__section1815156"><h4 class="sectiontitle">Function</h4><p id="dis_01_0603__p29755367">Local data is continuously uploaded to DIS.</p>
|
||||
<div class="note" id="dis_01_0603__note66471715"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0603__p1288810025716">Data can be stored in DIS, OBS, and DLI. For details about how to configure a storage location, see <a href="dis_01_0047.html">Creating a Dump Task</a>.</p>
|
||||
<div class="note" id="dis_01_0603__note66471715"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0603__p1288810025716">Data can be stored in DIS, OBS, and DLI. For how to configure a storage location, see <a href="dis_01_0047.html">Creating a Dump Task</a>.</p>
|
||||
<p id="dis_01_0603__p3847202715366">The maximum number of days for DIS to preserve data cannot exceed <span class="parmname" id="dis_01_0603__parmname13280431062"><b>Data Retention (days)</b></span>.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
|
||||
14
docs/dis/umn/dis_faq_0001.html
Normal file
14
docs/dis/umn/dis_faq_0001.html
Normal file
@ -0,0 +1,14 @@
|
||||
<a name="dis_faq_0001"></a><a name="dis_faq_0001"></a>
|
||||
|
||||
<h1 class="topictitle1">What Is DIS?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0001__en-us_topic_0065509535_p19515494">Data Ingestion Service (DIS) addresses the challenge of transmitting data from outside the cloud to inside the cloud. DIS builds data intake streams for custom applications capable of processing or analyzing streaming data. DIS continuously captures, transmits, and stores terabytes of data from hundreds of thousands of sources every hour, such as logs, Internet of Things (IoT) data, social media feeds, website clickstreams, and location-tracking events.</p>
|
||||
<div class="section" id="dis_faq_0001__en-us_topic_0065509535_section9271204118275"><h4 class="sectiontitle">Data Flows</h4><ul id="dis_faq_0001__en-us_topic_0065509535_ul440019496274"><li id="dis_faq_0001__en-us_topic_0065509535_li040014912711">DIS collects data from multiple data sources in real time.</li><li id="dis_faq_0001__en-us_topic_0065509535_li151661328202813">DIS transforms data continuously to OBS for computing, analysis, and storage.</li></ul>
|
||||
</div>
|
||||
<div class="fignone" id="dis_faq_0001__en-us_topic_0065509535_fig1266142217172"><span class="figcap"><b>Figure 1 </b>Data flows</span><br><span><img id="dis_faq_0001__en-us_topic_0065509535_image15267132214178" src="en-us_image_0000001199305476.png"></span></div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
13
docs/dis/umn/dis_faq_0002.html
Normal file
13
docs/dis/umn/dis_faq_0002.html
Normal file
@ -0,0 +1,13 @@
|
||||
<a name="dis_faq_0002"></a><a name="dis_faq_0002"></a>
|
||||
|
||||
<h1 class="topictitle1">What Is a Partition?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0002__en-us_topic_0065509539_p8060118">Partitions are the base throughput unit of a DIS stream. When creating a DIS stream, you are expected to specify the number of partitions needed within your stream.</p>
|
||||
<p id="dis_faq_0002__en-us_topic_0065509539_p56284918112335">By default, each tenant has 1 to 50 partitions. Tenants can configure the number of partitions as required.</p>
|
||||
<p id="dis_faq_0002__en-us_topic_0065509539_p102631521171710">To increase the quota, submit a service ticket. The upper limit is calculated based on the actual load of the cluster.</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
15
docs/dis/umn/dis_faq_0003.html
Normal file
15
docs/dis/umn/dis_faq_0003.html
Normal file
@ -0,0 +1,15 @@
|
||||
<a name="dis_faq_0003"></a><a name="dis_faq_0003"></a>
|
||||
|
||||
<h1 class="topictitle1">How Do I Send and Retrieve Data Using DIS?</h1>
|
||||
<div id="body32001227"><ol id="dis_faq_0003__en-us_topic_0065509536_ol21136050134547"><li id="dis_faq_0003__en-us_topic_0065509536_li38122810134547"><span>Create a DIS stream. Obtain your Access Key ID/Secret Access Key (AK/SK) pair from the Identity and Access Management (IAM) service.</span></li><li id="dis_faq_0003__en-us_topic_0065509536_li63208749164812"><span>Download and decompress the DIS SDK software package.</span><p><p id="dis_faq_0003__en-us_topic_0065509536_en-us_topic_0068150545_p8069994191654">Verify integrity of the DIS SDK software package by following the procedure in <a href="dis_faq_0009.html#dis_faq_0009">How Do I Check Software Package Integrity?</a></p>
|
||||
<ul id="dis_faq_0003__en-us_topic_0065509536_ul33503956191511"><li id="dis_faq_0003__en-us_topic_0065509536_li4389469693021">Download link of the DIS SDK software package:<p id="dis_faq_0003__en-us_topic_0065509536_p48749197163443"><a name="dis_faq_0003__en-us_topic_0065509536_li4389469693021"></a><a name="en-us_topic_0065509536_li4389469693021"></a><a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip</a></p>
|
||||
</li><li id="dis_faq_0003__en-us_topic_0065509536_li5512316493059">Download link of the package integrity verification file:<p id="dis_faq_0003__en-us_topic_0065509536_p2634642893059"><a name="dis_faq_0003__en-us_topic_0065509536_li5512316493059"></a><a name="en-us_topic_0065509536_li5512316493059"></a><a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum</a></p>
|
||||
</li></ul>
|
||||
</p></li><li id="dis_faq_0003__en-us_topic_0065509536_li60838957134547"><span>Create a producer project and configure the user AK/SK, endpoint, project ID, region, stream name, and the number of partitions.</span></li><li id="dis_faq_0003__en-us_topic_0065509536_li7886503134547"><span>Run the producer application to send data.</span></li><li id="dis_faq_0003__en-us_topic_0065509536_li21749985134547"><span>Create a consumer project and configure the user AK/SK, endpoint, project, region, stream name, partition ID, and startingSequenceNumber.</span></li><li id="dis_faq_0003__en-us_topic_0065509536_li52543238134547"><span>Run the consumer application to retrieve data.</span></li></ol>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
12
docs/dis/umn/dis_faq_0004.html
Normal file
12
docs/dis/umn/dis_faq_0004.html
Normal file
@ -0,0 +1,12 @@
|
||||
<a name="dis_faq_0004"></a><a name="dis_faq_0004"></a>
|
||||
|
||||
<h1 class="topictitle1">What Can I Do with DIS?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0004__en-us_topic_0065509537_p8060118">You can use DIS for rapid data intake from producers and continuous data processing. The following are typical scenarios for using DIS:</p>
|
||||
<ul id="dis_faq_0004__en-us_topic_0065509537_ul37006058143838"><li id="dis_faq_0004__en-us_topic_0065509537_en-us_topic_0068150561_li3141828217234">Accelerated log or data transmission: Users do not need to wait for batch data processing. Data is put into a DIS stream immediately after it is generated by a data producer, preventing data loss in case of faults in the data producer. For example, system and application logs can be continuously put into a stream and processed within seconds.</li><li id="dis_faq_0004__en-us_topic_0065509537_en-us_topic_0068150561_li6537937518448">Real-time metrics and reporting: You can retrieve data from DIS streams for simple data analysis and reporting in real time. For example, your DIS applications can work on metrics and reporting for system and application logs as streaming data is being pushed to DIS streams using application programming interfaces (APIs), rather than wait to receive batches of data.</li><li id="dis_faq_0004__en-us_topic_0065509537_en-us_topic_0068150561_li6747202165836">Real-time data analysis: DIS combines the power of parallel processing with the value of real-time data. For example, you can transform data into valuable information and business intelligence by simply putting data into a DIS stream. This can be done in minutes instead of hours or days.</li><li id="dis_faq_0004__en-us_topic_0065509537_en-us_topic_0068150561_li6123801418448">Complex stream processing: You can create Directed Acyclic Graphs (DAGs) of DIS applications and streams. This typically involves putting data from one or multiple DIS applications into another stream for downstream processing by a different DIS application.</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
11
docs/dis/umn/dis_faq_0005.html
Normal file
11
docs/dis/umn/dis_faq_0005.html
Normal file
@ -0,0 +1,11 @@
|
||||
<a name="dis_faq_0005"></a><a name="dis_faq_0005"></a>
|
||||
|
||||
<h1 class="topictitle1">What Advantages Does DIS Have?</h1>
|
||||
<div id="body32001227"><ul id="dis_faq_0005__en-us_topic_0065509534_ul2328638695846"><li id="dis_faq_0005__en-us_topic_0065509534_en-us_topic_0068150558_li31638772">Scalable: A DIS stream can seamlessly scale its data throughput from megabytes to terabytes per hour, and from thousands to millions of PUT records per second.</li><li id="dis_faq_0005__en-us_topic_0065509534_en-us_topic_0068150558_li16313497">Easy to use: You can create a DIS stream within seconds. It is easy to put data into a stream, and build a data processing application.</li><li id="dis_faq_0005__en-us_topic_0065509534_en-us_topic_0068150558_li12603749">Low cost: DIS has no upfront cost and you only pay for the resources you use.</li><li id="dis_faq_0005__en-us_topic_0065509534_en-us_topic_0068150558_li46324881">Parallel processing: DIS allows you to have multiple DIS applications processing the same stream concurrently. For example, you can have one application running real-time analytics and another sending data to OBS from the same stream.</li><li id="dis_faq_0005__en-us_topic_0065509534_en-us_topic_0068150558_li14270750">DIS preserves data for <em id="dis_faq_0005__en-us_topic_0065509534_i860618010319">N</em>*24 hours, reducing the probability of data loss in case of application failures, individual machine failures, or facility failures. The value of <em id="dis_faq_0005__en-us_topic_0065509534_i19201754191016">N</em> is an integer from 1 to 7.</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
15
docs/dis/umn/dis_faq_0008.html
Normal file
15
docs/dis/umn/dis_faq_0008.html
Normal file
@ -0,0 +1,15 @@
|
||||
<a name="dis_faq_0008"></a><a name="dis_faq_0008"></a>
|
||||
|
||||
<h1 class="topictitle1">Which Modules Do DIS Have?</h1>
|
||||
<div id="body32001227"><ul id="dis_faq_0008__en-us_topic_0065509538_ul14499083104210"><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li13531531">Service control<ul id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_ul54674917"><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li22312206">Creates, deletes, and configures DIS streams; synchronizes user information to the data plane</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li66592127">Allocates resources on the data plane and automatically deploys DIS</li></ul>
|
||||
</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li62458233">Data processing<ul id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_ul25253189"><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li25952117">Receives user requests; receives and stores authenticated data</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li32242465">Receives data read requests and returns the requested data to authorized users</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li21746729">Removes old data from DIS streams according to data aging policies</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li61502840">Stores user data into Object Storage Service (OBS) according to user options</li></ul>
|
||||
</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li16654654">Service maintenance<ul id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_ul15674164"><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li6849756">Installs and upgrades DIS</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li61647805">Performs configuration, preventive maintenance, monitoring, and log collection and analysis for DIS</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li17959338">Processes service orders</li></ul>
|
||||
</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li27416314">User SDK<ul id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_ul45420240"><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li6128980">Provides Java APIs for users to push and pull data</li><li id="dis_faq_0008__en-us_topic_0065509538_en-us_topic_0068150558_li55160823">Encrypts data</li></ul>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
22
docs/dis/umn/dis_faq_0009.html
Normal file
22
docs/dis/umn/dis_faq_0009.html
Normal file
@ -0,0 +1,22 @@
|
||||
<a name="dis_faq_0009"></a><a name="dis_faq_0009"></a>
|
||||
|
||||
<h1 class="topictitle1">How Do I Check Software Package Integrity?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0009__en-us_topic_0092879628_p52695385172315">This section describes how to verify integrity of the DIS SDK software package on a Linux system by using a verification file.</p>
|
||||
<div class="section" id="dis_faq_0009__en-us_topic_0092879628_section1642659717546"><h4 class="sectiontitle">Prerequisites</h4><ul id="dis_faq_0009__en-us_topic_0092879628_ul66773388182344"><li id="dis_faq_0009__en-us_topic_0092879628_li35612134182344">The PuTTY tool is available.</li><li id="dis_faq_0009__en-us_topic_0092879628_li50027668193829">The WinSCP tool is available.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dis_faq_0009__en-us_topic_0092879628_section36530325191914"><h4 class="sectiontitle">Procedure</h4><ol id="dis_faq_0009__en-us_topic_0092879628_ol8729525191853"><li id="dis_faq_0009__en-us_topic_0092879628_li1701159418202"><span>Upload the DIS SDK software package <strong id="dis_faq_0009__en-us_topic_0092879628_b165141110511">sdk-dis-x.x.x1.2.3.zip</strong> to any directory on the Linux system by using WinSCP.</span><p><div class="note" id="dis_faq_0009__en-us_topic_0092879628_note46531065194639"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_faq_0009__en-us_topic_0092879628_p16126403194639">In <strong id="dis_faq_0009__en-us_topic_0092879628_b4773114015519">sdk-dis-x.x.x.zip</strong>, <strong id="dis_faq_0009__en-us_topic_0092879628_b103184417512">x.x.x</strong> indicates the version number of the DIS SDK software package.</p>
|
||||
</div></div>
|
||||
</p></li><li id="dis_faq_0009__en-us_topic_0092879628_li64010939193335"><span>Log in to the Linux system by using PuTTY. In the directory in which <strong id="dis_faq_0009__en-us_topic_0092879628_b14211181417437">sdk-dis-x.x.x1.2.3.zip</strong> is stored, run the following command to obtain the verification code of the DIS SDK software package</span><p><p id="dis_faq_0009__en-us_topic_0092879628_p22735951193224"><b><span class="cmdname" id="dis_faq_0009__en-us_topic_0092879628_cmdname1998855320409">sha256sum sdk-dis-x.x.x.zip</span></b></p>
|
||||
<p id="dis_faq_0009__en-us_topic_0092879628_p3296972193224">Example verification code:</p>
|
||||
<pre class="screen" id="dis_faq_0009__en-us_topic_0092879628_screen39886296193535"># sha256sum dis-sdk-x.x.x.zip
|
||||
8be2c937e8d78b1a9b99777cee4e7131f8bf231de3f839cf214e7c5b5ba3c088 cloud-sdk-dis-x.x.x.zip</pre>
|
||||
</p></li><li id="dis_faq_0009__en-us_topic_0092879628_li44096020193747"><span>Open the DIS SDK verification file <strong id="dis_faq_0009__en-us_topic_0092879628_b07142033134413">sdk-dis-x.x.x1.2.3.zip.sha256sum</strong> and compare it with the verification code obtained in <strong id="dis_faq_0009__en-us_topic_0092879628_b42403539911">Step 2</strong>.</span><p><ul id="dis_faq_0009__en-us_topic_0092879628_ul29949464194038"><li id="dis_faq_0009__en-us_topic_0092879628_li23964573194038">If they are consistent, the DIS-SDK compression package has not been tampered with.</li><li id="dis_faq_0009__en-us_topic_0092879628_li62607668194038">If they are inconsistent, the DIS SDK software package is tampered with and you need to obtain it again.</li></ul>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0011.html">General Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
28
docs/dis/umn/dis_faq_0011.html
Normal file
28
docs/dis/umn/dis_faq_0011.html
Normal file
@ -0,0 +1,28 @@
|
||||
<a name="dis_faq_0011"></a><a name="dis_faq_0011"></a>
|
||||
|
||||
<h1 class="topictitle1">General Questions</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0011__en-us_topic_0191022838_p8060118"></p>
|
||||
</div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0001.html">What Is DIS?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0002.html">What Is a Partition?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0004.html">What Can I Do with DIS?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0005.html">What Advantages Does DIS Have?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0008.html">Which Modules Do DIS Have?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0009.html">How Do I Check Software Package Integrity?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0003.html">How Do I Send and Retrieve Data Using DIS?</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="en-us_topic_0124374673.html">FAQs</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
19
docs/dis/umn/dis_faq_0012.html
Normal file
19
docs/dis/umn/dis_faq_0012.html
Normal file
@ -0,0 +1,19 @@
|
||||
<a name="dis_faq_0012"></a><a name="dis_faq_0012"></a>
|
||||
|
||||
<h1 class="topictitle1">Dump Questions</h1>
|
||||
<div id="body32001227"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0017.html">How Does a Schema Support Default Fields or NULL Fields?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0019.html">How Do I Distinguish Different Types of Data When Accessing Data in Streams?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0025.html">How Can I Configure Recursive Listening for Directories on DIS Agent?</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="en-us_topic_0124374673.html">FAQs</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
19
docs/dis/umn/dis_faq_0013.html
Normal file
19
docs/dis/umn/dis_faq_0013.html
Normal file
@ -0,0 +1,19 @@
|
||||
<a name="dis_faq_0013"></a><a name="dis_faq_0013"></a>
|
||||
|
||||
<h1 class="topictitle1">DIS Agent Questions</h1>
|
||||
<div id="body32001227"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0014.html">How Can I Configure Agent to Listen To Multiple Directories or Files?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0015.html">How Can I Configure Recursive Listening for Directories on DIS Agent?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0021.html">How Do I Use Agent to Encrypt AK/SK?</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="en-us_topic_0124374673.html">FAQs</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
27
docs/dis/umn/dis_faq_0014.html
Normal file
27
docs/dis/umn/dis_faq_0014.html
Normal file
@ -0,0 +1,27 @@
|
||||
<a name="dis_faq_0014"></a><a name="dis_faq_0014"></a>
|
||||
|
||||
<h1 class="topictitle1">How Can I Configure Agent to Listen To Multiple Directories or Files?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0014__en-us_topic_0195488470_p8060118">DIS Agent can listen to multiple directories or files. For example, to collect logs of the <strong id="dis_faq_0014__en-us_topic_0195488470_b36624755120">/home/folder1/file1</strong> and <strong id="dis_faq_0014__en-us_topic_0195488470_b1841181412515">/home/folder2/file2</strong> files, configure multiple DIS streams.</p>
|
||||
<pre class="screen" id="dis_faq_0014__en-us_topic_0195488470_screen125511431624">---
|
||||
region: REGION
|
||||
ak: YOUR_AK
|
||||
sk: YOUR_SK
|
||||
projectId: YOUR_PROJECTID
|
||||
endpoint: ENDPOINT
|
||||
flows:
|
||||
- DISStream: YOUR_STREAM
|
||||
filePattern: /home/folder1/file1
|
||||
initialPosition: START_OF_FILE
|
||||
maxBufferAgeMillis: 5000
|
||||
|
||||
- DISStream: YOUR_STREAM
|
||||
filePattern: /home/folder2/file2
|
||||
initialPosition: START_OF_FILE
|
||||
maxBufferAgeMillis: 5000</pre>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0013.html">DIS Agent Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
23
docs/dis/umn/dis_faq_0015.html
Normal file
23
docs/dis/umn/dis_faq_0015.html
Normal file
@ -0,0 +1,23 @@
|
||||
<a name="dis_faq_0015"></a><a name="dis_faq_0015"></a>
|
||||
|
||||
<h1 class="topictitle1">How Can I Configure Recursive Listening for Directories on DIS Agent?</h1>
|
||||
<div id="body8662426"><p id="dis_faq_0015__en-us_topic_0195516409_p8060118">On DIS Agent, set <strong id="dis_faq_0015__en-us_topic_0195516409_b968210352000">directoryRecursionEnabled</strong> to <strong id="dis_faq_0015__en-us_topic_0195516409_b182662471012">true</strong>. For example, the following configuration can match <strong id="dis_faq_0015__en-us_topic_0195516409_b13759164713110">/home/one.log</strong>, <strong id="dis_faq_0015__en-us_topic_0195516409_b142195316117">/home/child/two.log</strong>, and <strong id="dis_faq_0015__en-us_topic_0195516409_b646916013212">/home/child/child/three.log</strong>:</p>
|
||||
<pre class="screen" id="dis_faq_0015__en-us_topic_0195516409_screen125511431624">---
|
||||
region: REGION
|
||||
ak: YOUR_AK
|
||||
sk: YOUR_SK
|
||||
projectId: YOUR_PROJECTID
|
||||
endpoint: ENDPOINT
|
||||
flows:
|
||||
- DISStream: YOUR_STREAM
|
||||
filePattern: /home/*.log
|
||||
directoryRecursionEnabled: true
|
||||
initialPosition: START_OF_FILE
|
||||
maxBufferAgeMillis: 5000</pre>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0013.html">DIS Agent Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
23
docs/dis/umn/dis_faq_0017.html
Normal file
23
docs/dis/umn/dis_faq_0017.html
Normal file
@ -0,0 +1,23 @@
|
||||
<a name="dis_faq_0017"></a><a name="dis_faq_0017"></a>
|
||||
|
||||
<h1 class="topictitle1">How Does a Schema Support Default Fields or NULL Fields?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0017__en-us_topic_0197275340_p8060118">A source data schema is a user's JSON data sample used to describe the JSON data format. DIS can generate the Avro schema based on the JSON data sample. By default, the default field or NULL is not supported, as shown in <a href="#dis_faq_0017__en-us_topic_0197275340_fig12811073373">Figure 1</a>.</p>
|
||||
<div class="fignone" id="dis_faq_0017__en-us_topic_0197275340_fig12811073373"><a name="dis_faq_0017__en-us_topic_0197275340_fig12811073373"></a><a name="en-us_topic_0197275340_fig12811073373"></a><span class="figcap"><b>Figure 1 </b>Example of not supporting the default field</span><br><span><img id="dis_faq_0017__en-us_topic_0197275340_image32819773719" src="en-us_image_0200877126.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
<p id="dis_faq_0017__en-us_topic_0197275340_p1318912222156">The type of the <strong id="dis_faq_0017__en-us_topic_0197275340_b1618952231512">key1</strong> field is <strong id="dis_faq_0017__en-us_topic_0197275340_b384011502421">String</strong> (<strong id="dis_faq_0017__en-us_topic_0197275340_b1839133454318">type</strong>: <strong id="dis_faq_0017__en-us_topic_0197275340_b38448366438">string</strong> in Avro Schema). If the <strong id="dis_faq_0017__en-us_topic_0197275340_b1568821064310">key1</strong> field in the source data is not transferred or the transferred value is null, the dump task reports an error.</p>
|
||||
<p id="dis_faq_0017__en-us_topic_0197275340_p730411313221">To enable the schema generated based on the JSON data sample supports the default value or null, select the <strong id="dis_faq_0017__en-us_topic_0197275340_b1342205514443">Convert and Move</strong> and click <strong id="dis_faq_0017__en-us_topic_0197275340_b17117167114810">Convert Source Data Sample</strong>, as shown in <a href="#dis_faq_0017__en-us_topic_0197275340_fig2624141717523">Figure 2</a>.</p>
|
||||
<div class="fignone" id="dis_faq_0017__en-us_topic_0197275340_fig2624141717523"><a name="dis_faq_0017__en-us_topic_0197275340_fig2624141717523"></a><a name="en-us_topic_0197275340_fig2624141717523"></a><span class="figcap"><b>Figure 2 </b>Example of supporting the default field</span><br><span><img id="dis_faq_0017__en-us_topic_0197275340_image6624181717526" src="en-us_image_0200879188.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
<p id="dis_faq_0017__en-us_topic_0197275340_p874093517497">In this case, the type of the <strong id="dis_faq_0017__en-us_topic_0197275340_b25098371481">key1</strong> field is <strong id="dis_faq_0017__en-us_topic_0197275340_b16707114194814">Union</strong> (<strong id="dis_faq_0017__en-us_topic_0197275340_b429334644820">type</strong>: <strong id="dis_faq_0017__en-us_topic_0197275340_b1318618144912">[null, string]</strong> in Avro Schema). If the <strong id="dis_faq_0017__en-us_topic_0197275340_b8577101510499">key1</strong> field in the source data is not transferred or the transferred value is null, null is automatically filled as the default value. The dump task can properly convert the format.</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0012.html">Dump Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
11
docs/dis/umn/dis_faq_0019.html
Normal file
11
docs/dis/umn/dis_faq_0019.html
Normal file
@ -0,0 +1,11 @@
|
||||
<a name="dis_faq_0019"></a><a name="dis_faq_0019"></a>
|
||||
|
||||
<h1 class="topictitle1">How Do I Distinguish Different Types of Data When Accessing Data in Streams?</h1>
|
||||
<div id="body32001227"><ul id="dis_faq_0019__en-us_topic_0255052426_ul224772810215"><li id="dis_faq_0019__en-us_topic_0255052426_li14247142820212">By stream: Different types of data use different streams and can be distinguished by stream.</li><li id="dis_faq_0019__en-us_topic_0255052426_li915114198207">By partition: Different types of data use different partitions on one stream. Each partition is assigned one partition key. Different types of data can be distinguished by partition key of each partition.</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0012.html">Dump Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
14
docs/dis/umn/dis_faq_0021.html
Normal file
14
docs/dis/umn/dis_faq_0021.html
Normal file
@ -0,0 +1,14 @@
|
||||
<a name="dis_faq_0021"></a><a name="dis_faq_0021"></a>
|
||||
|
||||
<h1 class="topictitle1">How Do I Use Agent to Encrypt AK/SK?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0021__en-us_topic_0221962118_p8060118">Secret Access Key (SK) is sensitive information. To encrypt the SK, perform the following steps:</p>
|
||||
<ol id="dis_faq_0021__en-us_topic_0221962118_ol2359845173816"><li id="dis_faq_0021__en-us_topic_0221962118_li1535917454386"><span>Go to the <strong id="dis_faq_0021__en-us_topic_0221962118_b412184775914">bin/</strong> directory.</span><p><p id="dis_faq_0021__en-us_topic_0221962118_p1229913916125"><b><span class="cmdname" id="dis_faq_0021__en-us_topic_0221962118_cmdname2475202191419">cd /opt/dis-agent-X.X.X/bin</span></b></p>
|
||||
</p></li><li id="dis_faq_0021__en-us_topic_0221962118_li193163440568"><span>Run the encryption script, enter the password, and press <strong id="dis_faq_0021__en-us_topic_0221962118_b58331845202311">Enter</strong>.</span><p><p id="dis_faq_0021__en-us_topic_0221962118_p1394511322141"><b><span class="cmdname" id="dis_faq_0021__en-us_topic_0221962118_cmdname695722611193">bash dis-encrypt.sh</span></b></p>
|
||||
</p></li><li id="dis_faq_0021__en-us_topic_0221962118_li15618161117574"><span>View the encryption result. The character string following "Encrypt result:" displayed on the console is the encryption result. Use this method to encrypt the MySQL password and SK, respectively and record the ciphertext in the configuration file.</span></li></ol>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0013.html">DIS Agent Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
23
docs/dis/umn/dis_faq_0025.html
Normal file
23
docs/dis/umn/dis_faq_0025.html
Normal file
@ -0,0 +1,23 @@
|
||||
<a name="dis_faq_0025"></a><a name="dis_faq_0025"></a>
|
||||
|
||||
<h1 class="topictitle1">How Can I Configure Recursive Listening for Directories on DIS Agent?</h1>
|
||||
<div id="body32001227"><p id="dis_faq_0025__en-us_topic_0195516409_p8060118">On DIS Agent, set <strong id="dis_faq_0025__en-us_topic_0195516409_b968210352000">directoryRecursionEnabled</strong> to <strong id="dis_faq_0025__en-us_topic_0195516409_b182662471012">true</strong>. For example, the following configuration can match <strong id="dis_faq_0025__en-us_topic_0195516409_b13759164713110">/home/one.log</strong>, <strong id="dis_faq_0025__en-us_topic_0195516409_b142195316117">/home/child/two.log</strong>, and <strong id="dis_faq_0025__en-us_topic_0195516409_b646916013212">/home/child/child/three.log</strong>:</p>
|
||||
<pre class="screen" id="dis_faq_0025__en-us_topic_0195516409_screen125511431624">---
|
||||
region: REGION
|
||||
ak: YOUR_AK
|
||||
sk: YOUR_SK
|
||||
projectId: YOUR_PROJECTID
|
||||
endpoint: ENDPOINT
|
||||
flows:
|
||||
- DISStream: YOUR_STREAM
|
||||
filePattern: /home/*.log
|
||||
directoryRecursionEnabled: true
|
||||
initialPosition: START_OF_FILE
|
||||
maxBufferAgeMillis: 5000</pre>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_faq_0012.html">Dump Questions</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
BIN
docs/dis/umn/en-us_image_0000001199305476.png
Normal file
BIN
docs/dis/umn/en-us_image_0000001199305476.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 7.5 KiB |
BIN
docs/dis/umn/en-us_image_0000001274606310.png
Normal file
BIN
docs/dis/umn/en-us_image_0000001274606310.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 513 B |
BIN
docs/dis/umn/en-us_image_0000001274783064.png
Normal file
BIN
docs/dis/umn/en-us_image_0000001274783064.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 492 B |
BIN
docs/dis/umn/en-us_image_0000001325286261.png
Normal file
BIN
docs/dis/umn/en-us_image_0000001325286261.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 492 B |
BIN
docs/dis/umn/en-us_image_0000001325622881.png
Normal file
BIN
docs/dis/umn/en-us_image_0000001325622881.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 513 B |
BIN
docs/dis/umn/en-us_image_0109727712.png
Normal file
BIN
docs/dis/umn/en-us_image_0109727712.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 222 B |
BIN
docs/dis/umn/en-us_image_0130822560.png
Normal file
BIN
docs/dis/umn/en-us_image_0130822560.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 18 KiB |
BIN
docs/dis/umn/en-us_image_0130854869.jpg
Normal file
BIN
docs/dis/umn/en-us_image_0130854869.jpg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 827 B |
BIN
docs/dis/umn/en-us_image_0200877126.png
Normal file
BIN
docs/dis/umn/en-us_image_0200877126.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 31 KiB |
BIN
docs/dis/umn/en-us_image_0200879188.png
Normal file
BIN
docs/dis/umn/en-us_image_0200879188.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 27 KiB |
@ -1,5 +1,15 @@
|
||||
<a name="EN-US_TOPIC_0124374673"></a><a name="EN-US_TOPIC_0124374673"></a>
|
||||
|
||||
<h1 class="topictitle1">FAQs</h1>
|
||||
<div id="body1533089621280"><p>This chapter describes some FAQs.</p></div>
|
||||
<div id="body1533089621280"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0011.html">General Questions</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0012.html">Dump Questions</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_faq_0013.html">DIS Agent Questions</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user