forked from docs/doc-exports
DIS UMN test2 version
Reviewed-by: gtema <artem.goncharov@gmail.com> Co-authored-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com> Co-committed-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
This commit is contained in:
parent
5f383cf200
commit
1a4b9e91b7
622
docs/dis/umn/ALL_META.TXT.json
Normal file
622
docs/dis/umn/ALL_META.TXT.json
Normal file
File diff suppressed because it is too large
Load Diff
560
docs/dis/umn/CLASS.TXT.json
Normal file
560
docs/dis/umn/CLASS.TXT.json
Normal file
File diff suppressed because it is too large
Load Diff
3
docs/dis/umn/PARAMETERS.txt
Normal file
3
docs/dis/umn/PARAMETERS.txt
Normal file
@ -0,0 +1,3 @@
|
||||
version=""
|
||||
language="en-us"
|
||||
type=""
|
7
docs/dis/umn/dis_01_0000.html
Normal file
7
docs/dis/umn/dis_01_0000.html
Normal file
@ -0,0 +1,7 @@
|
||||
<a name="dis_01_0000"></a><a name="dis_01_0000"></a>
|
||||
|
||||
<h1 class="topictitle1">Glossary</h1>
|
||||
<div id="body1514354835591"><p id="dis_01_0000__p8060118">For details, see <a href="https://docs.otc.t-systems.com/en-us/glossary/index.html" target="_blank" rel="noopener noreferrer">Glossary</a>.</p>
|
||||
</div>
|
||||
<div></div>
|
||||
|
17
docs/dis/umn/dis_01_0001.html
Normal file
17
docs/dis/umn/dis_01_0001.html
Normal file
@ -0,0 +1,17 @@
|
||||
<a name="dis_01_0001"></a><a name="dis_01_0001"></a>
|
||||
|
||||
<h1 class="topictitle1">What Is DIS?</h1>
|
||||
<div id="body1493022272989"><p id="dis_01_0001__p5708645417727">Data Ingestion Service (DIS) addresses the challenge of transmitting data from outside the cloud to inside the cloud. DIS builds data intake streams for custom applications capable of processing or analyzing streaming data. DIS continuously captures, transmits, and stores terabytes of data from hundreds of thousands of sources every hour, such as logs, social media feeds, website clickstreams, and location-tracking events.</p>
|
||||
<div class="section" id="dis_01_0001__section9933162516532"><h4 class="sectiontitle">Data Flows</h4><p id="dis_01_0001__p1548222913560">If you set the dump destination to Object Storage Service (OBS), the streaming data will be dumped to OBS.</p>
|
||||
<div class="fignone" id="dis_01_0001__fig783851416507"><span class="figcap"><b>Figure 1 </b>Data flow-1</span><br><span><img class="vsd" id="dis_01_0001__image1583813145505" src="en-us_image_0000001222097314.png"></span></div>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0001__section63248778"><h4 class="sectiontitle">Basic Concepts</h4><ul id="dis_01_0001__ul38841670"><li id="dis_01_0001__li14030717">Stream: A DIS stream is an ordered sequence of data records. Streams are distinguished from each other by the stream names assigned during DIS stream creation. When reading or writing streaming data, you need to specify the name of DIS stream from or to which data will be read or written.</li><li id="dis_01_0001__li1533132951112">Partition: Data records in DIS streams are distributed into partitions. A partition is a base throughput unit of a DIS stream. When creating a DIS stream, you are expected to specify the number of partitions needed within your stream.</li><li id="dis_01_0001__li62746268">Record: A record is a unit of data stored in a DIS stream. A record consists of a serial number, partition key, and data block. Data blocks are important data that your data producer adds to the data stream. The maximum size of a data block (data payload before base64 encoding) is 1 MB.</li><li id="dis_01_0001__li6617653310337">Sequence number: Each data record has a sequence number that is unique within its partition. The sequence number is assigned by DIS when a data producer calls PutRecords to add data to a DIS stream.<p id="dis_01_0001__p3562570110338"><a name="dis_01_0001__li6617653310337"></a><a name="li6617653310337"></a>Sequence numbers for the same partition key generally increase over time; the longer the time period between write requests (PutRecords requests), the larger the sequence numbers become.</p>
|
||||
</li><li id="dis_01_0001__li3882215410531">DIS application: DIS applications write, read, and process data in DIS streams. You can develop DIS applications using the client library software development kit (SDK).</li><li id="dis_01_0001__li604878981068">SDK: SDK is a Java-based client library. With SDK, you can build DIS applications easily to write, read, and process data in DIS streams.</li><li id="dis_01_0001__li1594842311426">Project: Projects are used to group and isolate OpenStack resources (computing resources, storage resources, and network resources). A project can be a department or a project team. Multiple projects can be created for one tenant account. A region has multiple projects, but one project is related to one region. DIS streams in different projects cannot communicate with each other.</li><li id="dis_01_0001__li2367344406">Checkpoint: When an application consumes data, the latest serial number of the consumed data is recorded as a checkpoint. When the data is reconsumed, the consumption can be continued based on this checkpoint.</li><li id="dis_01_0001__li6731144794017">Application: When multiple applications consume data in the same stream, an APP is used as an identifier to distinguish consumption checkpoints of different applications.</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0600.html">Overview</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
16
docs/dis/umn/dis_01_0002.html
Normal file
16
docs/dis/umn/dis_01_0002.html
Normal file
@ -0,0 +1,16 @@
|
||||
<a name="dis_01_0002"></a><a name="dis_01_0002"></a>
|
||||
|
||||
<h1 class="topictitle1">What Can I Do with DIS?</h1>
|
||||
<div id="body1493022272989"><p id="dis_01_0002__p11139022173023">You can use DIS for rapid data intake from producers and continuous data processing. The following are typical scenarios for using DIS:</p>
|
||||
<ul id="dis_01_0002__ul25486322172259"><li id="dis_01_0002__li32991673101717">Accelerated log and data feed intake<p id="dis_01_0002__p39436037101722"><a name="dis_01_0002__li32991673101717"></a><a name="li32991673101717"></a>You do not need to batch data on servers before you submit it for intake. Instead, you can have producers push data into streams immediately after data is produced.</p>
|
||||
<p id="dis_01_0002__p486584101717">For example, system and application logs are pushed as they are streaming in and they will be available for processing in seconds. This prevents the data from being lost if the data producer fails.</p>
|
||||
</li><li id="dis_01_0002__li53676637101920">Real-time metrics and reporting<p id="dis_01_0002__p59996760101921"><a name="dis_01_0002__li53676637101920"></a><a name="li53676637101920"></a>You can retrieve data from DIS streams for simple data analysis and reporting in real time. For example, your DIS applications can work on metrics and reporting for system and application logs as streaming data is being pushed to DIS streams using application programming interfaces (APIs), rather than wait to receive batches of data.</p>
|
||||
</li><li id="dis_01_0002__li6747202165836">Real-time data analysis: DIS can be used to analyze real-time data. For example, you can transform data into valuable information and business intelligence by simply putting data into a DIS stream. This can be done in minutes instead of hours or days.</li><li id="dis_01_0002__li23684437102419">Complex stream processing<p id="dis_01_0002__p2915948102420"><a name="dis_01_0002__li23684437102419"></a><a name="li23684437102419"></a>You can create Directed Acyclic Graphs (DAGs) of DIS applications and streams. This typically involves putting data from one or multiple DIS applications into another stream for downstream processing by a different DIS application.</p>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0600.html">Overview</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
20
docs/dis/umn/dis_01_0003.html
Normal file
20
docs/dis/umn/dis_01_0003.html
Normal file
@ -0,0 +1,20 @@
|
||||
<a name="dis_01_0003"></a><a name="dis_01_0003"></a>
|
||||
|
||||
<h1 class="topictitle1">Functions</h1>
|
||||
<div id="body1493022272989"><p id="dis_01_0003__p393891131705">DIS manages the infrastructure, storage, networking, and configuration needed to stream your data. You do not have to worry about provisioning, deployment, and constant maintenance of hardware. In addition, DIS synchronously replicates data across availability zones, providing high availability and data durability.</p>
|
||||
<div class="section" id="dis_01_0003__section43072214172543"><h4 class="sectiontitle">Key Modules</h4><p id="dis_01_0003__p3491997617263">DIS consists of the following four functional modules:</p>
|
||||
<ul id="dis_01_0003__ul1503503"><li id="dis_01_0003__li13531531">Service control<ul id="dis_01_0003__ul54674917"><li id="dis_01_0003__li22312206">Creates, deletes, and configures DIS streams; synchronizes user information to the data plane.</li><li id="dis_01_0003__li66592127">Allocates resources and automatically deploys DIS on the data plane.</li></ul>
|
||||
</li><li id="dis_01_0003__li62458233">Data processing<ul id="dis_01_0003__ul25253189"><li id="dis_01_0003__li25952117">Receives user requests, and receives and stores authenticated data.</li><li id="dis_01_0003__li32242465">Receives data read requests and returns the requested data to authorized users.</li><li id="dis_01_0003__li21746729">Removes old data from DIS streams according to data aging policies.</li><li id="dis_01_0003__li61502840">Stores user data into OBS.</li></ul>
|
||||
</li><li id="dis_01_0003__li16654654">Service maintenance<ul id="dis_01_0003__ul15674164"><li id="dis_01_0003__li6849756">Installs and upgrades DIS.</li><li id="dis_01_0003__li61647805">Performs configuration, preventive maintenance, monitoring, and log collection and analysis for DIS.</li><li id="dis_01_0003__li17959338">Processes service orders.</li></ul>
|
||||
</li><li id="dis_01_0003__li27416314">User SDK<ul id="dis_01_0003__ul45420240"><li id="dis_01_0003__li6128980">Provides Java APIs for users to push and pull data.</li><li id="dis_01_0003__li55160823">Encrypts data.</li></ul>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0003__section24807479"><h4 class="sectiontitle">Key Capabilities</h4><ul id="dis_01_0003__ul57557412"><li id="dis_01_0003__li31638772">Scalable: A DIS stream can seamlessly scale its data throughput from megabytes to terabytes per hour, and from thousands to millions of PUT records per second.</li><li id="dis_01_0003__li16313497">Easy to use: You can create a DIS stream within seconds. It is easy to put data into a stream, and build a data processing application.</li><li id="dis_01_0003__li12603749">Low cost: DIS has no upfront cost and you only pay for the resources you use.</li><li id="dis_01_0003__li46324881">Parallel processing: DIS allows you to have multiple DIS applications processing the same stream concurrently. For example, you can have one application running real-time analytics and another sending data to OBS from the same stream.</li><li id="dis_01_0003__li14270750">Secure and reliable: DIS can retain data for 24 to 72 hours to prevent data loss in case of application faults, individual machine faults, or facility faults.</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0600.html">Overview</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
15
docs/dis/umn/dis_01_0004.html
Normal file
15
docs/dis/umn/dis_01_0004.html
Normal file
@ -0,0 +1,15 @@
|
||||
<a name="dis_01_0004"></a><a name="dis_01_0004"></a>
|
||||
|
||||
<h1 class="topictitle1">Related Services</h1>
|
||||
<div id="body1493022272989"><div class="p" id="dis_01_0004__p31381273152228">DIS works with the following services:<ul id="dis_01_0004__ul454488889439"><li id="dis_01_0004__li475696069439">Object Storage Service (OBS)<p id="dis_01_0004__p77011192850"><a name="dis_01_0004__li475696069439"></a><a name="li475696069439"></a>If you set <strong id="dis_01_0004__b7226484115">Dump Destination</strong> to OBS, the uploaded data will be stored to OBS.</p>
|
||||
</li><li id="dis_01_0004__li603932459439">Identity and Access Management (IAM)<p id="dis_01_0004__p66682949439"><a name="dis_01_0004__li603932459439"></a><a name="li603932459439"></a>IAM provides user authentication for DIS.</p>
|
||||
</li><li id="dis_01_0004__li15731237191812">Cloud Trace Service (CTS)<p id="dis_01_0004__p20127162771812"><a name="dis_01_0004__li15731237191812"></a><a name="li15731237191812"></a>CTS is used to record the operations you have performed on DIS for later querying, auditing, or backtracking. For details, see the <em id="dis_01_0004__i842352697174855">Cloud Trace Service User Guide</em>.</p>
|
||||
</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0600.html">Overview</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
59
docs/dis/umn/dis_01_0005.html
Normal file
59
docs/dis/umn/dis_01_0005.html
Normal file
@ -0,0 +1,59 @@
|
||||
<a name="dis_01_0005"></a><a name="dis_01_0005"></a>
|
||||
|
||||
<h1 class="topictitle1">Permissions</h1>
|
||||
<div id="body1493022272990"><p id="dis_01_0005__p11319170191220">You need an account on the management console to create, query, and delete DIS streams, and need an Access Key ID/Secret Access Key (AK/SK) file to push, pull, and dump data.</p>
|
||||
<p id="dis_01_0005__p5437657151527">For details about how to perform operations on IAM, see <i><cite id="dis_01_0005__cite360058896154332">IAM User Guide</cite></i>.</p>
|
||||
<div class="p" id="dis_01_0005__p1671980692955">For details about DIS permissions, see <a href="#dis_01_0005__table55585464113541">Table 1</a> and <a href="https://docs.otc.t-systems.com/en-us/permissions/index.html" target="_blank" rel="noopener noreferrer">Permissions</a>.
|
||||
<div class="tablenoborder"><a name="dis_01_0005__table55585464113541"></a><a name="table55585464113541"></a><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0005__table55585464113541" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Permission list</caption><thead align="left"><tr id="dis_01_0005__row45371081113541"><th align="left" class="cellrowborder" valign="top" width="13.048695130486951%" id="mcps1.3.3.3.2.6.1.1"><p id="dis_01_0005__p13899358113555">Node Name</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="11.918808119188082%" id="mcps1.3.3.3.2.6.1.2"><p id="dis_01_0005__p52106194113555">Permission Name</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="13.048695130486951%" id="mcps1.3.3.3.2.6.1.3"><p id="dis_01_0005__p59852179113555">Managed Cloud Resource</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="17.738226177382263%" id="mcps1.3.3.3.2.6.1.4"><p id="dis_01_0005__p16188296113555">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="44.24557544245575%" id="mcps1.3.3.3.2.6.1.5"><p id="dis_01_0005__p36183577113555">How to Assign Permissions</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0005__row37379105113541"><td class="cellrowborder" valign="top" width="13.048695130486951%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dis_01_0005__p36402482113555">Base</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="11.918808119188082%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dis_01_0005__p33286409113555">Tenant Administrator</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.048695130486951%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dis_01_0005__p11844610113555">All services</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="17.738226177382263%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dis_01_0005__p19889388113555">Users have permission to operate all cloud resources owned by an enterprise.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="44.24557544245575%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dis_01_0005__p427759113555">Permission parameter settings:</p>
|
||||
<p id="dis_01_0005__p3849833113555"><strong id="dis_01_0005__b2350590232224">Region</strong>: set to the region to which your cloud resources belong. <strong id="dis_01_0005__b17214290292717">Project</strong>: set to the project to which your cloud resources belong. <strong id="dis_01_0005__b174057153592721">Policy</strong>: set to <strong id="dis_01_0005__b206618248692721">Tenant Administrator</strong>.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0005__row28310851113541"><td class="cellrowborder" valign="top" width="13.048695130486951%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dis_01_0005__p55064925113555">DIS</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="11.918808119188082%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dis_01_0005__p31073945113555">DIS Administrator</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.048695130486951%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dis_01_0005__p37219068113555">DIS</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="17.738226177382263%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dis_01_0005__p61954552113555">Users have permissions to perform the following operations:</p>
|
||||
<ul id="dis_01_0005__ul20720064113555"><li id="dis_01_0005__li52262849113555">Create, delete, modify, and query DIS streams</li><li id="dis_01_0005__li1471814103282">Create, delete, modify, and query dump tasks</li><li id="dis_01_0005__li40312979113643">Upload and download data through a stream</li><li id="dis_01_0005__li41942429113649">Query stream monitoring metrics</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="44.24557544245575%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dis_01_0005__p43730058113555">Permission parameter settings:</p>
|
||||
<ul id="dis_01_0005__ul64599346103556"><li id="dis_01_0005__li170829810361"><strong id="dis_01_0005__b3739007810361">Region</strong>: set to the region to which DIS streams belong.</li><li id="dis_01_0005__li5450619210363"><strong id="dis_01_0005__b656707310363">Project</strong>: set to the project to which DIS streams belong.</li><li id="dis_01_0005__li5660476103556"><strong id="dis_01_0005__b6597054103556">Policy</strong>: set to <strong id="dis_01_0005__b59373488103556">DIS Administrator</strong>.</li></ul>
|
||||
<div class="p" id="dis_01_0005__p47101587113831">Assign different permissions based on the destination to which data of DIS streams will be dumped.<ul id="dis_01_0005__ul21261106113831"><li class="textintable" id="dis_01_0005__li48129038103938">To create DIS streams capable of dumping data to OBS and ensure that the users have permissions to use both DIS and OBS. </li><li class="textintable" id="dis_01_0005__li57132227113831">Parameter settings required for using OBS:<p id="dis_01_0005__p4825762103940"><a name="dis_01_0005__li57132227113831"></a><a name="li57132227113831"></a><strong id="dis_01_0005__b53552933103940">Region</strong>: set to <strong id="dis_01_0005__b12214356103940">Global service</strong>.</p>
|
||||
<p id="dis_01_0005__p66027931103943"><strong id="dis_01_0005__b21538696103943">Project</strong>: set to <strong id="dis_01_0005__b59630539103943">OBS</strong>.</p>
|
||||
<p id="dis_01_0005__p44428001113831"><strong id="dis_01_0005__b16209065149406">Policy</strong>: set to <strong id="dis_01_0005__b13673228949406">Tenant Administrator</strong>.</p>
|
||||
</li></ul>
|
||||
</div>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0600.html">Overview</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
14
docs/dis/umn/dis_01_0006.html
Normal file
14
docs/dis/umn/dis_01_0006.html
Normal file
@ -0,0 +1,14 @@
|
||||
<a name="dis_01_0006"></a><a name="dis_01_0006"></a>
|
||||
|
||||
<h1 class="topictitle1">Precautions</h1>
|
||||
<div id="body1493022272990"><div class="p" id="dis_01_0006__p2089614694412">Read the following precautions before using DIS:<ul id="dis_01_0006__ul5384759394412"><li id="dis_01_0006__li1486628994412">Recommended browser to access the DIS console<ul id="dis_01_0006__ul6668774094412"><li id="dis_01_0006__li6331875694412">Google Chrome: 48.0 or later</li><li id="dis_01_0006__li3299789794412">Mozilla FireFox: 43.0 or later</li><li id="dis_01_0006__li2854562094412">Internet Explorer: 9.0 or later<p id="dis_01_0006__p6686114393137"><a name="dis_01_0006__li2854562094412"></a><a name="li2854562094412"></a>If you cannot log in to the DIS console using Internet Explorer 9.0, run the browser as the Administrator user or re-install the browser as the Administrator user (by default, the Administrator user is disabled in certain Windows systems, such as Windows 7 Ultimate. That is, users other than the Administrator user are selected by default to install Internet Explorer.) Reinstall Internet Explorer 9.0 or later (recommended) or run Internet Explorer 9.0 as user <strong id="dis_01_0006__b9787183314116">Administrator</strong>.</p>
|
||||
</li></ul>
|
||||
</li><li id="dis_01_0006__li214794219322">Sensitive data must be encrypted using DIS SDK or another encryption tools before being put into DIS streams.</li><li id="dis_01_0006__li5856316182214">When a user uploads data using a DIS stream, the total size of records in a single request cannot exceed 5 MB.</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0600.html">Overview</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
25
docs/dis/umn/dis_01_0008.html
Normal file
25
docs/dis/umn/dis_01_0008.html
Normal file
@ -0,0 +1,25 @@
|
||||
<a name="dis_01_0008"></a><a name="dis_01_0008"></a>
|
||||
|
||||
<h1 class="topictitle1">Getting Started</h1>
|
||||
<div id="body1493022272990"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0009.html">General Procedure</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0601.html">Step 1: Creating a DIS Stream</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0602.html">Step 2: Preparing a DIS Application Development Environment</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0603.html">Step 3: Sending Data to DIS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0604.html">Step 4: Obtaining Data from DIS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0043.html">Obtaining Authentication Information</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0045.html">Interconnecting with OBS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0605.html">Creating an IAM Agency</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
19
docs/dis/umn/dis_01_0009.html
Normal file
19
docs/dis/umn/dis_01_0009.html
Normal file
@ -0,0 +1,19 @@
|
||||
<a name="dis_01_0009"></a><a name="dis_01_0009"></a>
|
||||
|
||||
<h1 class="topictitle1">General Procedure</h1>
|
||||
<div id="body1493022272990"><p id="dis_01_0009__p31764686">The following is the general procedure for using DIS:</p>
|
||||
<p id="dis_01_0009__p9681163662813"><a href="dis_01_0601.html">Step 1: Creating a DIS Stream</a></p>
|
||||
<p class="litext" id="dis_01_0009__p23562574">You need to create a stream before using DIS.</p>
|
||||
<p id="dis_01_0009__p19772164822814"><a href="dis_01_0602.html">Step 2: Preparing a DIS Application Development Environment</a></p>
|
||||
<p class="litext" id="dis_01_0009__p64356400">Before developing a DIS application, install an application development tool, and import your SDK package and sample project into the development environment.</p>
|
||||
<p id="dis_01_0009__p1394411002916"><a href="dis_01_0603.html">Step 3: Sending Data to DIS</a></p>
|
||||
<p class="litext" id="dis_01_0009__p60482217">Write a producer application and run it to send data to the cloud. The DIS stream information can be viewed on the DIS console.</p>
|
||||
<p id="dis_01_0009__p17673181322914"><a href="dis_01_0604.html">Step 4: Obtaining Data from DIS</a></p>
|
||||
<p id="dis_01_0009__p1012626">Write a consumer application and run it to retrieve data from the cloud.</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
17
docs/dis/umn/dis_01_0010.html
Normal file
17
docs/dis/umn/dis_01_0010.html
Normal file
@ -0,0 +1,17 @@
|
||||
<a name="dis_01_0010"></a><a name="dis_01_0010"></a>
|
||||
|
||||
<h1 class="topictitle1">Managing DIS Streams</h1>
|
||||
<div id="body1493022272990"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0011.html">Listing DIS Streams</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0012.html">Viewing Stream Monitoring Metrics</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0050.html">Managing Stream Tags</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0013.html">Deleting a Stream</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
14
docs/dis/umn/dis_01_0011.html
Normal file
14
docs/dis/umn/dis_01_0011.html
Normal file
@ -0,0 +1,14 @@
|
||||
<a name="dis_01_0011"></a><a name="dis_01_0011"></a>
|
||||
|
||||
<h1 class="topictitle1">Listing DIS Streams</h1>
|
||||
<div id="body1493022272990"><p id="dis_01_0011__p46736664121012">The <strong id="dis_01_0011__b2068322215377">Stream Management</strong> page displays all DIS streams created. After clicking a stream, you can view the following information about this stream:</p>
|
||||
<div class="fignone" id="dis_01_0011__fig1657418112911"><span class="figcap"><b>Figure 1 </b>Stream Management</span><br><span><img id="dis_01_0011__image457412110916" src="en-us_image_0000001222097286.jpg"></span></div>
|
||||
<ul id="dis_01_0011__ul31495006113939"><li id="dis_01_0011__lf419419f6a094720981fd7e28332154e"><strong id="dis_01_0011__b7522958141418">Name/ID</strong>: Unique name of the DIS stream to be created. A stream name is 1 to 64 characters long. Only letters, digits, hyphens (-), and underscores (_) are allowed.</li><li id="dis_01_0011__li60941563175422"><strong id="dis_01_0011__b27460177153911">Status</strong>: Stream status.</li><li id="dis_01_0011__li6614401195218"><strong id="dis_01_0011__b59292158153920">Stream Type</strong>: <strong id="dis_01_0011__b37935460153920">Common</strong> and <strong id="dis_01_0011__b52873419153920">Advanced</strong>.<ul id="dis_01_0011__u2b3f8278e59e49da94989a4c963e9a13"><li id="dis_01_0011__lafdd26e566fe4d7fb0ab1db0bdbcbebc"><strong id="dis_01_0011__b1988943501820">Common</strong>: Each partition supports a maximum read speed of 2 MB/s and a maximum write speed of 1 MB/s or 1,000 records/s.</li><li id="dis_01_0011__l9df050c26351412ba117351b3761c052"><strong id="dis_01_0011__b5734961911">Advanced</strong>: Each partition supports a maximum read speed of 10 MB/s and a maximum write speed of 5 MB/s or 2,000 records/s.</li></ul>
|
||||
</li><li id="dis_01_0011__li2737457515395"><strong id="dis_01_0011__b1488461672311">Partitions</strong>: The number of partitions into which data records in the newly created DIS stream will be distributed. Multiple partitions of a stream can concurrently transmit data to improve efficiency.</li><li id="dis_01_0011__li4148713110517"><strong id="dis_01_0011__b18144118142818">Data Retention (hours)</strong>: The maximum number of hours for DIS to preserve data. Data will be deleted when the retention period expires. Value range: an integer ranging from 24 to 72. Unit: hour</li><li id="dis_01_0011__li33906238175544"><strong id="dis_01_0011__b62919478154123">Created</strong>: Time at which the DIS stream is created. The creation time is in the <em id="dis_01_0011__i10988722174412">yyyy/MM/dd HH:mm:ss</em> <strong id="dis_01_0011__b3207112814442">GMT</strong> format. For example, 2017/05/09 08:00:00 GMT+08:00.</li><li id="dis_01_0011__li65182377175740"><strong id="dis_01_0011__b125444211658">Operation</strong>: Supported operations include <strong id="dis_01_0011__b176104012479">Delete</strong>, and <strong id="dis_01_0011__b31815119500">View Dump Task</strong>. </li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0010.html">Managing DIS Streams</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
76
docs/dis/umn/dis_01_0012.html
Normal file
76
docs/dis/umn/dis_01_0012.html
Normal file
@ -0,0 +1,76 @@
|
||||
<a name="dis_01_0012"></a><a name="dis_01_0012"></a>
|
||||
|
||||
<h1 class="topictitle1">Viewing Stream Monitoring Metrics</h1>
|
||||
<div id="body1493022272990"><p id="dis_01_0012__p465711711267">You can view stream monitoring information on the console and monitor the data consumed by applications in the stream.</p>
|
||||
<ol id="dis_01_0012__ol12431334121516"><li id="dis_01_0012__li15698020121516"><span>Use the account to log in to the DIS console.</span></li><li id="dis_01_0012__li820627292052"><span>Click <span><img id="dis_01_0012__image01970275396" src="en-us_image_0000001266777397.png"></span> in the upper left corner and select a region and a project.</span></li><li id="dis_01_0012__li15493172951416"><span>In the navigation tree on the left, choose <span class="parmvalue" id="dis_01_0012__parmvalue68691459184519"><b>Stream Management</b></span>.</span></li><li id="dis_01_0012__li3041782121655"><span>In the stream list, click the name of the DIS stream whose monitoring metrics will be viewed. The monitoring page is displayed.</span><p><div class="fignone" id="dis_01_0012__fig20331141119419"><span class="figcap"><b>Figure 1 </b>Monitoring page</span><br><span><img id="dis_01_0012__image23311111124117" src="en-us_image_0000001266897429.jpg"></span></div>
|
||||
</p></li><li id="dis_01_0012__li41810086164916"><span>On the <span class="wintitle" id="dis_01_0012__wintitle17741204819219"><b>Monitoring</b></span> page, click the <strong id="dis_01_0012__b311911732212">Streams</strong> or <strong id="dis_01_0012__b830213092218">Partitions</strong> tab to view stream or partition monitoring metrics. <a href="#dis_01_0012__table2942144318834">Table 1</a> describes the monitoring parameters. For details about basic stream information, see <a href="dis_01_0601.html#dis_01_0601__li23032735111458">3</a>.</span><p>
|
||||
<div class="tablenoborder"><a name="dis_01_0012__table2942144318834"></a><a name="table2942144318834"></a><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0012__table2942144318834" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DIS monitoring information</caption><thead align="left"><tr id="dis_01_0012__row6686704018834"><th align="left" class="cellrowborder" valign="top" width="30%" id="mcps1.3.2.5.2.1.2.3.1.1"><p id="dis_01_0012__p4752119818834">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="70%" id="mcps1.3.2.5.2.1.2.3.1.2"><p id="dis_01_0012__p2401184018834">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0012__row5291185918834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p5800220418834">Time Range</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><ul id="dis_01_0012__ul210231152417"><li id="dis_01_0012__li1101031122413">Monitoring time range.<p id="dis_01_0012__p502247718834"><a name="dis_01_0012__li1101031122413"></a><a name="li1101031122413"></a>Values:</p>
|
||||
<ul id="dis_01_0012__ul4520229418834"><li id="dis_01_0012__li416746518834">1h</li><li id="dis_01_0012__li3750719218834">2h</li><li id="dis_01_0012__li202041018834">3h</li></ul>
|
||||
</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row1818369818834"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.5.2.1.2.3.1.1 mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p6359345318834"><strong id="dis_01_0012__b55711300181416">Partitions</strong></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row5079608118834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p2084186018834">Partition ID</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p1046913718834">ID of the partition. It starts from 0 by default. Select any of the following values from the <strong id="dis_01_0012__b15659981181416">Partition ID</strong> drop-down.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row4437627918834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p3770887818834">Data Rate (KB/s)</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p3452024018834">Rates at which data is sent to and retrieved from the chosen partition within the specified time range. Unit: KB/s</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row4467607118834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p6199202718834">Records Per Second</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p5529829118834">The number of records sent to and retrieved from the chosen partition within the specified time range. </p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row4997660018834"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.5.2.1.2.3.1.1 mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p2157278518834"><strong id="dis_01_0012__b12291253161026">Streams</strong></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row256515918834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p645129718834">Data Rate (KB/s)</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p5279303118834">Rates at which data is sent to and retrieved from the chosen DIS stream within the specified time range. Unit: KB/s</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row4837715518834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p2623545018834">Records Per Second</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p4469672618834">The number of records sent to and retrieved from the chosen DIS stream within the specified time range. </p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row6366508718834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p5659842818834">Successful Requests Per Second</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p2106997418834">The number of PutRecords and GetRecords requests successfully fulfilled within the specified time range. </p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row2894632418834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p6295091118834">Throttled Requests Per Second</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p6585900618834">The number of PutRecords and GetRecords requests rejected within the specified time range due to flow control. </p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0012__row3297925818834"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.5.2.1.2.3.1.1 "><p id="dis_01_0012__p5407420218834">Average Request Processing Time (ms)</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.5.2.1.2.3.1.2 "><p id="dis_01_0012__p1793421418834">The average amount of time spent in processing a PutRecords or GetRecords request. </p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0010.html">Managing DIS Streams</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
15
docs/dis/umn/dis_01_0013.html
Normal file
15
docs/dis/umn/dis_01_0013.html
Normal file
@ -0,0 +1,15 @@
|
||||
<a name="dis_01_0013"></a><a name="dis_01_0013"></a>
|
||||
|
||||
<h1 class="topictitle1">Deleting a Stream</h1>
|
||||
<div id="body1493022272990"><div class="note" id="dis_01_0013__note1891164345819"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0013__p1893674685816">A deleted stream will not be charged and cannot be restored. Exercise caution when performing this operation.</p>
|
||||
</div></div>
|
||||
<ol id="dis_01_0013__ol12431334121516"><li id="dis_01_0013__li11931210353"><span>Use the account to log in to the DIS console.</span></li><li id="dis_01_0013__li5720339992121"><span>Click <span><img id="dis_01_0013__image11686217981" src="en-us_image_0000001266777397.png"></span> in the upper left corner of the page and select a region and project.</span></li><li id="dis_01_0013__li17808203718103"><span>In the navigation tree on the left, choose <span class="parmvalue" id="dis_01_0013__parmvalue12880911195711"><b>Stream Management</b></span>.</span><p><div class="fignone" id="dis_01_0013__fig175341921174517"><span class="figcap"><b>Figure 1 </b>Managing DIS streams</span><br><span><img id="dis_01_0013__image14534162115457" src="en-us_image_0000001222417238.jpg"></span></div>
|
||||
</p></li><li id="dis_01_0013__li3041782121655"><span>Click <strong id="dis_01_0013__b67061953152815">Delete</strong> in the <strong id="dis_01_0013__b1523515414299">Operation</strong> column of the stream that you want to delete. The <span class="wintitle" id="dis_01_0013__wintitle137401525153110"><b>Delete Stream</b></span> dialog box is displayed.</span><p><div class="fignone" id="dis_01_0013__fig9378152944611"><span class="figcap"><b>Figure 2 </b>Deleting a stream</span><br><span><img id="dis_01_0013__image147171011143810" src="en-us_image_0000001222257278.jpg"></span></div>
|
||||
</p></li><li id="dis_01_0013__li14467764121924"><span>Click <span class="uicontrol" id="dis_01_0013__uicontrol59221846133114"><b>OK</b></span> to delete the selected stream.</span></li></ol>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0010.html">Managing DIS Streams</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
57
docs/dis/umn/dis_01_0014.html
Normal file
57
docs/dis/umn/dis_01_0014.html
Normal file
@ -0,0 +1,57 @@
|
||||
<a name="dis_01_0014"></a><a name="dis_01_0014"></a>
|
||||
|
||||
<h1 class="topictitle1">Change History</h1>
|
||||
<div id="body1495502447489">
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0014__table59270894183840" frame="border" border="1" rules="all"><thead align="left"><tr id="dis_01_0014__row25560278183840"><th align="left" class="cellrowborder" valign="top" width="36.480000000000004%" id="mcps1.3.1.1.3.1.1"><p id="dis_01_0014__p57116615183840"><strong id="dis_01_0014__b35908811171853">Release Date</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="63.519999999999996%" id="mcps1.3.1.1.3.1.2"><p id="dis_01_0014__p30517294183840"><strong id="dis_01_0014__b15229322195154">What's New</strong></p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0014__row631535004212"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p8315155015424">2022-06-15</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p69161328134711">Modified the following section:</p>
|
||||
<p id="dis_01_0014__p64141230134717"><a href="dis_01_0001.html">What Is DIS?</a></p>
|
||||
<p id="dis_01_0014__p1340182075717">Added the following sections:</p>
|
||||
<p id="dis_01_0014__p8581839105111"><a href="dis_01_0222.html">CDR Specification</a></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0014__row1642194724215"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p1242215476427">2020-01-03</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p13249122614717">Modified the following section:</p>
|
||||
<p id="dis_01_0014__p042214711427"><a href="dis_01_0012.html">Viewing Stream Monitoring Metrics</a></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0014__row1944985841711"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p144501558101718">2019-06-12</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p164509581178">Modified the following section:</p>
|
||||
<p id="dis_01_0014__p2851131017184"><a href="dis_01_0004.html">Related Services</a></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0014__row82251316112912"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p322711168298">2019-05-15</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p3227816122912">Modified the following section:</p>
|
||||
<p id="dis_01_0014__p21448284293"><a href="dis_01_0001.html">What Is DIS?</a></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0014__row354910447368"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p1054984414367">2019-01-29</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p2054912441368">Modified the following section:</p>
|
||||
<p id="dis_01_0014__p83841353113912"><a href="dis_01_0602.html">Step 2: Preparing a DIS Application Development Environment</a></p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0014__row269164174118"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p1869741154116">2018-11-09</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p3512445291836">Accepted in OTC 3.2.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0014__row11073867183840"><td class="cellrowborder" valign="top" width="36.480000000000004%" headers="mcps1.3.1.1.3.1.1 "><p id="dis_01_0014__p43790301183919">2018-03-16</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.519999999999996%" headers="mcps1.3.1.1.3.1.2 "><p id="dis_01_0014__p43850756183840">This is the first official release.</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
|
16
docs/dis/umn/dis_01_0043.html
Normal file
16
docs/dis/umn/dis_01_0043.html
Normal file
@ -0,0 +1,16 @@
|
||||
<a name="dis_01_0043"></a><a name="dis_01_0043"></a>
|
||||
|
||||
<h1 class="topictitle1">Obtaining Authentication Information</h1>
|
||||
<div id="body1510226874205"><div class="section" id="dis_01_0043__section216794169119"><h4 class="sectiontitle">Obtaining AK/SK</h4><p id="dis_01_0043__p1588473591117">Access Key ID/Secret Access Key (AK/SK) is created on Identity and Access Management (IAM) to authenticate calls to application programming interfaces (APIs) on the public cloud. To obtain AK/SK, choose <span class="menucascade" id="dis_01_0043__menucascade563544363218"><b><span class="uicontrol" id="dis_01_0043__uicontrol4635114319324">My Credential</span></b> > <b><span class="uicontrol" id="dis_01_0043__uicontrol483641219499">Access Keys</span></b></span>.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0043__section41152976192830"><h4 class="sectiontitle">Obtaining Project ID</h4><p id="dis_01_0043__en-us_topic_0080205343_p491327619141">A project is a group of tenant resources. To view the project IDs of different regions, choose <span class="menucascade" id="dis_01_0043__menucascade182341323319"><b><span class="uicontrol" id="dis_01_0043__uicontrol52311353319">My Credential</span></b> > <b><span class="uicontrol" id="dis_01_0043__uicontrol18433421135012">Projects</span></b></span>.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0043__section13974512192848"><h4 class="sectiontitle">Obtaining Region Information and Endpoint Information</h4><p id="dis_01_0043__a0e4a70a0b3304e37bb510a69a7316193">For details about regions and endpoints, see <a href="https://docs.otc.t-systems.com/en-us/endpoint/index.html" target="_blank" rel="noopener noreferrer">Regions and Endpoints</a>.</p>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
16
docs/dis/umn/dis_01_0045.html
Normal file
16
docs/dis/umn/dis_01_0045.html
Normal file
@ -0,0 +1,16 @@
|
||||
<a name="dis_01_0045"></a><a name="dis_01_0045"></a>
|
||||
|
||||
<h1 class="topictitle1">Interconnecting with OBS</h1>
|
||||
<div id="body1510228289296"><div class="section" id="dis_01_0045__section54689666195031"><h4 class="sectiontitle">Introduction</h4><p id="dis_01_0045__p50054392195614">DIS can upload data to Object Storage Service (OBS).</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0045__section44362682195133"><h4 class="sectiontitle">Prerequisites</h4><p id="dis_01_0045__p62570614195753">An IAM agency has been created by following the procedure in <a href="dis_01_0605.html">Creating an IAM Agency</a>. This IAM agency entrusts DIS to access your OBS resources.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0045__section15729224195053"><h4 class="sectiontitle">Data Dumping</h4><p id="dis_01_0045__p1208054610731">In section <a href="dis_01_0047.html">Creating a Dump Task</a>, you can select a location to which data from DIS streams will be dumped. If Dump Destination is set to <strong id="dis_01_0045__b2701716145632">OBS</strong>, DIS periodically imports data from DIS streams to OBS.</p>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
154
docs/dis/umn/dis_01_0047.html
Normal file
154
docs/dis/umn/dis_01_0047.html
Normal file
File diff suppressed because it is too large
Load Diff
64
docs/dis/umn/dis_01_0050.html
Normal file
64
docs/dis/umn/dis_01_0050.html
Normal file
@ -0,0 +1,64 @@
|
||||
<a name="dis_01_0050"></a><a name="dis_01_0050"></a>
|
||||
|
||||
<h1 class="topictitle1">Managing Stream Tags</h1>
|
||||
<div id="body1536205383367"><p id="dis_01_0050__en-us_topic_0110219762_p4117414171914">A tag is an identifier of a stream. Adding tags to streams can help you identify and manage your stream resources.</p>
|
||||
<p id="dis_01_0050__en-us_topic_0110219762_p3118161461919">You can add a maximum of 10 tags to a stream when creating the stream or add them on the details page of the created stream.</p>
|
||||
<p id="dis_01_0050__en-us_topic_0110219762_p85391682013">A tag consists of a tag key and a tag value. <a href="#dis_01_0050__en-us_topic_0110219762_table16316649132010">Table 1</a> describes the rules for naming the tag key and value.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dis_01_0050__en-us_topic_0110219762_table16316649132010"></a><a name="en-us_topic_0110219762_table16316649132010"></a><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0050__en-us_topic_0110219762_table16316649132010" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Naming rules for a tag key and value</caption><thead align="left"><tr id="dis_01_0050__en-us_topic_0110219762_row63177491201"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.4.2.4.1.1"><p id="dis_01_0050__en-us_topic_0110219762_p231714491209">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.4.2.4.1.2"><p id="dis_01_0050__en-us_topic_0110219762_p163171849152013">Rule</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.4.2.4.1.3"><p id="dis_01_0050__en-us_topic_0110219762_p11317249122016">Example</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0050__en-us_topic_0110219762_row93171449162013"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.4.2.4.1.1 "><p id="dis_01_0050__en-us_topic_0110219762_p931774942019">Key</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.4.2.4.1.2 "><p id="dis_01_0050__en-us_topic_0110219762_p5771249122112">A tag key cannot be left blank.</p>
|
||||
<p id="dis_01_0050__en-us_topic_0110219762_p26351751142112">A tag key must be unique for a stream.</p>
|
||||
<p id="dis_01_0050__en-us_topic_0110219762_p93113330223">A tag key contains a maximum of 36 characters.</p>
|
||||
<p id="dis_01_0050__p1225516520470">A tag value cannot contain special characters =*<>\,|/ or start or end with a space.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.4.2.4.1.3 "><p id="dis_01_0050__en-us_topic_0110219762_p2317144913209">Organization</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0050__en-us_topic_0110219762_row193176495203"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.4.2.4.1.1 "><p id="dis_01_0050__en-us_topic_0110219762_p931714916209">Tag value</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.4.2.4.1.2 "><p id="dis_01_0050__en-us_topic_0110219762_p14986938142211">A tag value contains a maximum of 43 characters.</p>
|
||||
<p id="dis_01_0050__p1111264194711">A tag value cannot contain special characters =*<>\,|/ or start or end with a space. This parameter can be left blank.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.4.2.4.1.3 "><p id="dis_01_0050__en-us_topic_0110219762_p431704919201">Apache</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0050__section93865701015"><h4 class="sectiontitle">Adding a Tag to a Stream</h4><div class="p" id="dis_01_0050__p14599152581020">You can add a tag to a stream on the <strong id="dis_01_0050__b1028620819307">Buy Stream</strong> page.<ol id="dis_01_0050__en-us_topic_0110219762_ol10572152813122"><li id="dis_01_0050__en-us_topic_0110219762_li3572428141214">Log in to the management console.</li><li id="dis_01_0050__en-us_topic_0110219762_li17582182216126">Choose <strong id="dis_01_0050__b1268673193012">Enterprise Intelligence</strong> > <strong id="dis_01_0050__b12848233153012">Data Ingestion Service</strong>.</li><li id="dis_01_0050__en-us_topic_0110219762_li166733366125">On the DIS management console, click <span class="uicontrol" id="dis_01_0050__en-us_topic_0110219762_uicontrol52521849192511"><b>Buy Stream</b></span>.</li><li id="dis_01_0050__en-us_topic_0110219762_li166145220256">On the <strong id="dis_01_0050__b842352706153759">Advanced Settings</strong> tab page, select <strong id="dis_01_0050__b84235270615381">Configure</strong>.<p id="dis_01_0050__en-us_topic_0110219762_p1725317418302">Enter the key and value of a tag to be added.</p>
|
||||
<p id="dis_01_0050__p17658618159">You can add a maximum of 10 tags to the stream and use intersections of tags to search for the target stream.</p>
|
||||
<div class="note" id="dis_01_0050__note3908125316394"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0050__p19908125314394">You can also add tags to existing streams. For details, see <a href="#dis_01_0050__section188067265123">Managing Tags</a>.</p>
|
||||
</div></div>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0050__section9673161212119"><h4 class="sectiontitle">Searching for a Target Stream</h4><div class="p" id="dis_01_0050__p084314691217">You can search for a target stream by tag on the <strong id="dis_01_0050__b172313517507">Stream Management</strong> page.<ol id="dis_01_0050__en-us_topic_0110219762_ol9758135332313"><li id="dis_01_0050__en-us_topic_0110219762_li1075895372319">Log in to the management console.</li><li id="dis_01_0050__en-us_topic_0110219762_li11758195318238">Choose <strong id="dis_01_0050__b1268673193012_1">EI Enterprise Intelligent</strong> > <strong id="dis_01_0050__b12848233153012_1">Data Ingestion Service</strong>.</li><li id="dis_01_0050__en-us_topic_0110219762_li8758165392315">In the navigation tree, choose <strong id="dis_01_0050__b102471824135113">Ingestion Management</strong> > <strong id="dis_01_0050__b1924722495117">Stream Management</strong>. In the upper right corner of the page, click <strong id="dis_01_0050__b19247172425119">Search by Tag</strong>.</li><li id="dis_01_0050__en-us_topic_0110219762_li11758125372313">Enter the tag key and value of the stream you are searching for.<p id="dis_01_0050__en-us_topic_0110219762_p17581853192317"><a name="dis_01_0050__en-us_topic_0110219762_li11758125372313"></a><a name="en-us_topic_0110219762_li11758125372313"></a>You can select a tag key or tag value from its drop-down list. When the tag key or tag value is exactly matched, the system can automatically locate the target stream. If you enter multiple tags, their intersections are used to search for the stream.</p>
|
||||
</li><li id="dis_01_0050__en-us_topic_0110219762_li7759115315237">Click <strong id="dis_01_0050__b842352706144140">Search</strong>.<p id="dis_01_0050__en-us_topic_0110219762_p1475965312313">The system searches for the target stream by tag key or value.</p>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0050__section188067265123"><a name="dis_01_0050__section188067265123"></a><a name="section188067265123"></a><h4 class="sectiontitle">Managing Tags</h4><div class="p" id="dis_01_0050__p149941032171218">You can add, delete, modify, and view tags on the <strong id="dis_01_0050__b84235270616811">Tags</strong> tab page of a stream.<ol id="dis_01_0050__en-us_topic_0110219762_ol1531818513377"><li id="dis_01_0050__en-us_topic_0110219762_li113174583717">Log in to the management console.</li><li id="dis_01_0050__en-us_topic_0110219762_li3653202053718">Choose <strong id="dis_01_0050__b1268673193012_2">EI Enterprise Intelligent</strong> > <strong id="dis_01_0050__b12848233153012_2">Data Ingestion Service</strong>.</li><li id="dis_01_0050__en-us_topic_0110219762_li8653192013716">In the navigation tree, choose <strong id="dis_01_0050__b56831741183316">Ingestion Management</strong> > <strong id="dis_01_0050__b1668424111339">Stream Management</strong>. Click a stream to which the tags to be managed belong to.<p id="dis_01_0050__en-us_topic_0110219762_p4653102012377">The stream details page is displayed.</p>
|
||||
</li><li id="dis_01_0050__en-us_topic_0110219762_li16653620163720">Click the <strong id="dis_01_0050__b842352706161759">Tags</strong> tab and add, deleted, modify, and view tags.<ul id="dis_01_0050__en-us_topic_0110219762_ul56533208376"><li id="dis_01_0050__en-us_topic_0110219762_li5653620103717">View<p id="dis_01_0050__en-us_topic_0110219762_p11653120113714"><a name="dis_01_0050__en-us_topic_0110219762_li5653620103717"></a><a name="en-us_topic_0110219762_li5653620103717"></a>On the <strong id="dis_01_0050__b842352706161835">Tags</strong> tab page, you can view details about tags of the stream, including the number of tags and the key and value of each tag.</p>
|
||||
</li><li id="dis_01_0050__en-us_topic_0110219762_li16531206374">Add<p id="dis_01_0050__en-us_topic_0110219762_p56531820183717"><a name="dis_01_0050__en-us_topic_0110219762_li16531206374"></a><a name="en-us_topic_0110219762_li16531206374"></a>Click <strong id="dis_01_0050__b84235270616191">Add Tag</strong> in the upper left corner. In the displayed <strong id="dis_01_0050__b84235270616196">Add Tag</strong> dialog box, enter the key and value of the tag to be added, and click <strong id="dis_01_0050__b842352706161914">OK</strong>.</p>
|
||||
</li><li id="dis_01_0050__en-us_topic_0110219762_li10653132043717">Modify<p id="dis_01_0050__en-us_topic_0110219762_p186541020163719"><a name="dis_01_0050__en-us_topic_0110219762_li10653132043717"></a><a name="en-us_topic_0110219762_li10653132043717"></a>In the <strong id="dis_01_0050__b842352706161943">Operation</strong> column of a tag, click <strong id="dis_01_0050__b842352706161947">Edit</strong>. In the displayed <strong id="dis_01_0050__b842352706161951">Edit Tag</strong> page, enter a new tag key and value and click <strong id="dis_01_0050__b842352706161957">OK</strong>.</p>
|
||||
</li><li id="dis_01_0050__en-us_topic_0110219762_li0654112016373">Delete<p id="dis_01_0050__en-us_topic_0110219762_p865452013719"><a name="dis_01_0050__en-us_topic_0110219762_li0654112016373"></a><a name="en-us_topic_0110219762_li0654112016373"></a>In the <strong id="dis_01_0050__b842352706162133">Operation</strong> column of the tag, click <strong id="dis_01_0050__b842352706162136">Delete</strong>. After confirmation, click <strong id="dis_01_0050__b842352706162140">OK</strong> on the displayed <strong id="dis_01_0050__b842352706162145">Delete Tag</strong> page.</p>
|
||||
</li></ul>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0010.html">Managing DIS Streams</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
11
docs/dis/umn/dis_01_0115.html
Normal file
11
docs/dis/umn/dis_01_0115.html
Normal file
@ -0,0 +1,11 @@
|
||||
<a name="dis_01_0115"></a><a name="dis_01_0115"></a>
|
||||
|
||||
<h1 class="topictitle1">Managing a Dump Task</h1>
|
||||
<div id="body1559024954795"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0047.html">Creating a Dump Task</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
15
docs/dis/umn/dis_01_0130.html
Normal file
15
docs/dis/umn/dis_01_0130.html
Normal file
@ -0,0 +1,15 @@
|
||||
<a name="dis_01_0130"></a><a name="dis_01_0130"></a>
|
||||
|
||||
<h1 class="topictitle1">Monitoring</h1>
|
||||
<div id="body1576045825848"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0131.html">Supported Metrics</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0132.html">Setting Alarm Rules</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0134.html">Querying Metrics</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
168
docs/dis/umn/dis_01_0131.html
Normal file
168
docs/dis/umn/dis_01_0131.html
Normal file
File diff suppressed because it is too large
Load Diff
17
docs/dis/umn/dis_01_0132.html
Normal file
17
docs/dis/umn/dis_01_0132.html
Normal file
@ -0,0 +1,17 @@
|
||||
<a name="dis_01_0132"></a><a name="dis_01_0132"></a>
|
||||
|
||||
<h1 class="topictitle1">Setting Alarm Rules</h1>
|
||||
<div id="body1576045825853"><div class="section" id="dis_01_0132__section38299792222911"><h4 class="sectiontitle">Scenario</h4><p id="dis_01_0132__p40311482223529">You can customize the monitored objects and notification policies by setting alarm rules to learn DIS running status in a timely manner.</p>
|
||||
<p id="dis_01_0132__p22430771222915">A DIS alarm rule includes the alarm rule name, monitored object, metric, threshold, monitoring interval, and whether to send a notification. This section describes how to set DIS alarm rules.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0132__section7969360222918"><h4 class="sectiontitle">Procedure</h4><ol id="dis_01_0132__ol3603449165213"><li id="dis_01_0132__li10856553142411"><span>Log in to the management console.</span></li><li id="dis_01_0132__li14932517254"><span>Choose <strong id="dis_01_0132__b84235270614643">All Services</strong> > <strong id="dis_01_0132__b28969008102457">Management & Deployment</strong> > <strong id="dis_01_0132__b5886337910251">Cloud Eye</strong>.</span></li><li id="dis_01_0132__li8603849115211"><span>In the left navigation pane, choose <span class="menucascade" id="dis_01_0132__menucascade3534841202513"><b><span class="uicontrol" id="dis_01_0132__uicontrol12532134118258">Alarm Management</span></b> > <b><span class="uicontrol" id="dis_01_0132__uicontrol5533141182510">Alarm Rules</span></b> > <b><span class="uicontrol" id="dis_01_0132__uicontrol135341441102513">Create Alarm Rule</span></b></span>.</span></li><li id="dis_01_0132__li2060313497522"><span>Set alarm rules for the DIS stream as prompted. Currently, only custom alarm rules are supported.</span></li><li id="dis_01_0132__li37012233370"><span>After the setting is complete, click <strong id="dis_01_0132__b273781232616">Create</strong>. When an alarm that meets the rule is generated, the system automatically sends a notification.</span><p><div class="note" id="dis_01_0132__note14719132383713"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0132__p1493015251373">For more information about DIS alarm rules, see the <em id="dis_01_0132__i2454123353119">Cloud Eye User Guide</em>.</p>
|
||||
</div></div>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0130.html">Monitoring</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
21
docs/dis/umn/dis_01_0134.html
Normal file
21
docs/dis/umn/dis_01_0134.html
Normal file
@ -0,0 +1,21 @@
|
||||
<a name="dis_01_0134"></a><a name="dis_01_0134"></a>
|
||||
|
||||
<h1 class="topictitle1">Querying Metrics</h1>
|
||||
<div id="body8662426"><div class="section" id="dis_01_0134__en-us_topic_0108275429_section11121260224613"><h4 class="sectiontitle">Scenario</h4><p id="dis_01_0134__en-us_topic_0108275429_p5347899515186">Cloud Eye monitors the running status of the DIS stream. You can obtain the monitoring metrics of CDM on the Cloud Eye management console.</p>
|
||||
<p id="dis_01_0134__en-us_topic_0108275429_p35583124151225">Monitored data requires a period of time for transmission and display. The status of CDM displayed on the Cloud Eye page is the status obtained 5 to 10 minutes before. You can view the monitored data of a newly created DIS stream 5 to 10 minutes later.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0134__en-us_topic_0108275429_section8439794224022"><h4 class="sectiontitle">Prerequisites</h4><ul id="dis_01_0134__en-us_topic_0108275429_ul3164004322451"><li id="dis_01_0134__en-us_topic_0108275429_li7011943212653">The DIS stream is running properly.<div class="note" id="dis_01_0134__note18237568289"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0134__p16231056192810">Cloud Eye will delete a deleted stream from the monitoring list and will not monitor it any more. However, you need to manually clear its alarm rules.</p>
|
||||
</div></div>
|
||||
</li><li id="dis_01_0134__en-us_topic_0108275429_li57051036213210">Alarm rules have been configured on the Cloud Eye page. For details, see <a href="dis_01_0132.html">Setting Alarm Rules</a>.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0134__en-us_topic_0108275429_section44667294224513"><h4 class="sectiontitle">Procedure</h4><ol id="dis_01_0134__en-us_topic_0108275429_ol128078161538"><li id="dis_01_0134__li15698020121516"><span>Use the account to log in to the DIS console.</span></li><li id="dis_01_0134__li820627292052"><span>Click <span><img id="dis_01_0134__image1815211616394" src="en-us_image_0000001222577290.png"></span> in the upper left corner of the page and select a region and project.</span></li><li id="dis_01_0134__li15493172951416"><span>In the navigation tree on the left, choose <span class="uicontrol" id="dis_01_0134__uicontrol1055134515481"><b>Stream Management</b></span>.</span></li><li id="dis_01_0134__li3041782121655"><span>In the stream list, click the name of the DIS stream whose monitoring metrics will be viewed. The monitoring page is displayed.</span></li><li id="dis_01_0134__li1839535818515"><span>On the <span class="parmname" id="dis_01_0134__parmname10645163914499"><b>Streams</b></span> tab page, click <span class="uicontrol" id="dis_01_0134__uicontrol16405133465110"><b>View details</b></span> to switch to the Cloud Eye console.</span></li><li id="dis_01_0134__en-us_topic_0108275429_li1807716137"><span>On the DIS monitoring page, you can view the graphs of all monitoring metrics.</span><p><div class="fignone" id="dis_01_0134__fig1448022451614"><span class="figcap"><b>Figure 1 </b>Viewing DIS monitoring metrics</span><br><span><img id="dis_01_0134__image19619551189" src="en-us_image_0000001222417338.png"></span></div>
|
||||
</p></li><li id="dis_01_0134__en-us_topic_0108275429_li3809101614316"><span>Click <span><img id="dis_01_0134__en-us_topic_0108275429_image1550615955112" src="en-us_image_0000001222097374.png"></span> in the upper right corner of the graphs to zoom out the graphs.</span><p><p id="dis_01_0134__p17702182242214">You can view the raw monitoring data curves of different metrics in the last 1 hour, 3 hours, and 12 hours. You can determine whether to enable <strong id="dis_01_0134__b4911188105316">Auto Refresh</strong>. Cloud Eye provides an automatic refresh interval of 60 seconds.</p>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0130.html">Monitoring</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
19
docs/dis/umn/dis_01_0222.html
Normal file
19
docs/dis/umn/dis_01_0222.html
Normal file
@ -0,0 +1,19 @@
|
||||
<a name="dis_01_0222"></a><a name="dis_01_0222"></a>
|
||||
|
||||
|
||||
<h1 class="topictitle1">CDR Specification</h1>
|
||||
|
||||
<div id="body0000001205888444"><p id="dis_01_0222__p8060118"></p>
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0223.html">Billing Model</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0224.html">CDR Folder and File Name</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0228.html">CDR Specification</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
30
docs/dis/umn/dis_01_0223.html
Normal file
30
docs/dis/umn/dis_01_0223.html
Normal file
@ -0,0 +1,30 @@
|
||||
<a name="dis_01_0223"></a><a name="dis_01_0223"></a>
|
||||
|
||||
<h1 class="topictitle1">Billing Model</h1>
|
||||
<div id="body0000001250089797"><p id="dis_01_0223__p1661014503918">Data Ingestion Service (DIS) is charged for resource usage, there are three main billing factors: the duration of Partition and PUT Payload Unit number.</p>
|
||||
<ul id="dis_01_0223__ul106101503919"><li id="dis_01_0223__li8704120141112">General partition contains duration, PUT Payload Unit number, Data storage size billing factor. Advanced partition contains duration billing factor.</li><li id="dis_01_0223__li443915619103">The duration of Partition: Partition is the base capacity unit of DIS. There are two types of partition: General partition and advanced partition. The general partition provides a capacity of 1MB/sec data input , 2MB/sec data outputand support up to 1000 records put per second. The advanced partition provides a capacity of 5MB/sec data input ,10MB/sec data output and support up to 2000 records put per second .You specify the number of partitions when create the stream based on the throughput requirements. You are charged for each partition at an hourly rate.</li><li id="dis_01_0223__li9610050396">PUT Payload Unit number: A record is the data that your data producer adds to DIS stream. A PUT Payload Unit is counted in 25KB payload "chunks" that comprise a record. For example, a 5KB record contains one PUT Payload Unit, a 45KB record contains two PUT Payload Units, and a 1000KB record contains 40 PUT Payload Units. PUT Payload Unit is charged with a per million PUT Payload Units rate.</li><li id="dis_01_0223__li26111050592">Data storage size: the data storage size in DIS input from the partition. The Customer can specify stream data storage time: from One day to Seven days when create the stream. If the data storage time exceeds the specified time, the data will be automatically aged. In general, the data storage one day is free, it means that 84GB of storage space for each partition is free to use. Of course, the final free space size can be specified according to the actual situation.</li></ul>
|
||||
<p id="dis_01_0223__p387483571019">DIS is charged for resource usage as follow:</p>
|
||||
<ul id="dis_01_0223__ul1161515269430"><li id="dis_01_0223__li166152026134320">One Partition Costs = partition time * partition rate + Payload Unit Num * Payload Unit Rate + Data storage size * storage size rate</li><li id="dis_01_0223__li1561562654317">Total Costs per stream = Partition 1 Cost + Partition 2 Cost + … + Partition n Cost</li></ul>
|
||||
<p id="dis_01_0223__p1917124664313">Both resources will be charged at the same time. Each charged will be listed separately. There will be 3 CDR records for each stream in the billing interval.</p>
|
||||
<p id="dis_01_0223__p9172194617438">The data will be cached for some time in the service, and default cache time is 24 hours. If the user want dump the data to OBS, the operation in OBS will be charged separately.</p>
|
||||
<p id="dis_01_0223__p773845944514">Example:</p>
|
||||
<p id="dis_01_0223__p1584071224616">Let us assume that our data producers put 50 records per second in aggregate, and each record is 35KB. In this case, the total data input rate is 1.7MB/sec (50 records/sec*35KB/record). For simplicity, we assume that the throughput and data size of each record are stable and constant throughout the day.</p>
|
||||
<p id="dis_01_0223__p3840712104614">We first calculate the number of partitions needed for our stream to achieve the required throughput. As one partition provides a capacity of 1MB/sec data input and supports 1000 records/sec, two partitions provide a capacity of 2MB/sec data input and support 2000 records/sec. So a stream with two partitions satisfies our required throughput of 1.7MB/sec at 50 records/sec.</p>
|
||||
<p id="dis_01_0223__p18840131220468">We then calculate our costs using DIS pricing:</p>
|
||||
<ul id="dis_01_0223__ul780723134615"><li id="dis_01_0223__li148012344614">Partition Hour: One Partition costs $X per hour. Our stream has two partitions so that it costs $2X per hour.</li><li id="dis_01_0223__li11804235468">PUT Payload Unit (25KB): The 1 million Payload Unit costs $Y. As our record is 35KB, each record contains two PUT Payload Units. Our data producers put 50 records or 100 PUT Payload Units per second in aggregate. That is 180000 records or 360000 PUT Payload Units per hour.so it costs 0.36*Y per hour.</li></ul>
|
||||
<p id="dis_01_0223__p844633720467">If the data in the DIS stored 1 day, the Data storage size is always less than 84GB, so the total cost per hour is :$(2X + Y)</p>
|
||||
<p id="dis_01_0223__p144461037174620">Optionally, we can choose to increase the data retention period of our stream from 24 hours to up to 7 days. In this example, if the throughput is stable, the data storage size is 514.08GB per partition(0.85MB/sec * 3600sec * 24hour * 7day).We assume that the data storage rate is $Z per GB*Hour, the cost is $860.16*Z( the detail is (514.08-84)GB * 2 partitions * Z). The total cost should $(2*X + Y + 860.16*Z).</p>
|
||||
<p id="dis_01_0223__p4446337204611"><strong id="dis_01_0223__b5446123754620">Shard Hour</strong></p>
|
||||
<p id="dis_01_0223__p174461937174610">Shard is the base throughput unit of an Amazon Kinesis stream. One shard provides a capacity of 1MB/sec data input and 2MB/sec data output. One shard can support up to 1000 records per second. You specify the number of shards needed within your stream based on your throughput requirements. You are charged for each shard at an hourly rate.</p>
|
||||
<p id="dis_01_0223__p11446183744619"><strong id="dis_01_0223__b2044693711469">PUT Payload Unit (25KB)</strong></p>
|
||||
<p id="dis_01_0223__p14461737134616">A record is the data that your data producer adds to your Amazon Kinesis stream. A PUT Payload Unit is counted in 25KB payload "chunks" that comprise a record. For example, a 5KB record contains one PUT Payload Unit, a 45KB record contains two PUT Payload Units, and a 1MB record contains 40 PUT Payload Units. PUT Payload Unit is charged with a per million PUT Payload Units rate.</p>
|
||||
<p id="dis_01_0223__p174461337104612"><strong id="dis_01_0223__b164469373468">Extended Data Retention (Up to 7 days)</strong></p>
|
||||
<p id="dis_01_0223__p24461237194610">Amazon Kinesis stores your data for 24 hours by default. You can choose to increase the data retention period of your stream to up to 7 days. You are charged for an additional rate on each shard hour incurred by your stream once you enable extended data retention.</p>
|
||||
<ul id="dis_01_0223__ul0564134424616"><li id="dis_01_0223__li13564104418464">Getting records from Amazon Kinesis stream is free.</li><li id="dis_01_0223__li17564134404613">Data transfer is free. AWS does not charge for data transfer from your data producers to Amazon Kinesis Streams, or from Amazon Kinesis Streams to your Amazon Kinesis Applications.</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0222.html">CDR Specification</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
19
docs/dis/umn/dis_01_0224.html
Normal file
19
docs/dis/umn/dis_01_0224.html
Normal file
@ -0,0 +1,19 @@
|
||||
<a name="dis_01_0224"></a><a name="dis_01_0224"></a>
|
||||
|
||||
<h1 class="topictitle1">CDR Folder and File Name</h1>
|
||||
<div id="body0000001205569852"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0225.html">Overview</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0226.html">CDR Folder</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0227.html">Service CDR File Name</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0222.html">CDR Specification</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
12
docs/dis/umn/dis_01_0225.html
Normal file
12
docs/dis/umn/dis_01_0225.html
Normal file
@ -0,0 +1,12 @@
|
||||
<a name="dis_01_0225"></a><a name="dis_01_0225"></a>
|
||||
|
||||
<h1 class="topictitle1">Overview</h1>
|
||||
<div id="body0000001249929843"><p id="dis_01_0225__p737033812472">Similar to other cloud services , CDR files for DIS will be generated, containing DIS usage information, OTC billing system will fetch these files from certain directory on Common CDR SFTP via public key to complete the charging of DIS.</p>
|
||||
<p id="dis_01_0225__p1037053810477">The file compression agonization, MD5 verification, error file handling are totally same as the CDR files of other cloud services.for details, please refer to document of"OTC CDR File Specifications".</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0224.html">CDR Folder and File Name</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
35
docs/dis/umn/dis_01_0226.html
Normal file
35
docs/dis/umn/dis_01_0226.html
Normal file
@ -0,0 +1,35 @@
|
||||
<a name="dis_01_0226"></a><a name="dis_01_0226"></a>
|
||||
|
||||
<h1 class="topictitle1">CDR Folder</h1>
|
||||
<div id="body0000001250369843">
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0226__table21412498476" frame="border" border="1" rules="all"><thead align="left"><tr id="dis_01_0226__row9182104911474"><th align="left" class="cellrowborder" valign="top" width="36.97%" id="mcps1.3.1.1.3.1.1"><p id="dis_01_0226__p191825495471">Export Directory</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="63.029999999999994%" id="mcps1.3.1.1.3.1.2"><p id="dis_01_0226__p91821249204720">Backup Directory</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0226__row121821349104718"><td class="cellrowborder" valign="top" width="36.97%" headers="mcps1.3.1.1.3.1.1 "><ul id="dis_01_0226__ul718254964715"><li id="dis_01_0226__li191821649124714">/opt/meterfiles/uploads/dispartition</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.029999999999994%" headers="mcps1.3.1.1.3.1.2 "><ul id="dis_01_0226__ul201821249184718"><li id="dis_01_0226__li1518284911472">/opt/meterfiles/backup/dispartition</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0226__row318264920471"><td class="cellrowborder" valign="top" width="36.97%" headers="mcps1.3.1.1.3.1.1 "><ul id="dis_01_0226__ul121821649134712"><li id="dis_01_0226__li17182174914719">/opt/meterfiles/uploads/dispayloadunit</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.029999999999994%" headers="mcps1.3.1.1.3.1.2 "><ul id="dis_01_0226__ul171820490472"><li id="dis_01_0226__li2018210490479">/opt/meterfiles/backup/dispayloadunit</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0226__row11182144994718"><td class="cellrowborder" valign="top" width="36.97%" headers="mcps1.3.1.1.3.1.1 "><ul id="dis_01_0226__ul5182134984718"><li id="dis_01_0226__li518294913471">/opt/meterfiles/uploads/disdatasize</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="63.029999999999994%" headers="mcps1.3.1.1.3.1.2 "><ul id="dis_01_0226__ul13182149174720"><li id="dis_01_0226__li131828499479">/opt/meterfiles/backup/disdatasize</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0224.html">CDR Folder and File Name</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
18
docs/dis/umn/dis_01_0227.html
Normal file
18
docs/dis/umn/dis_01_0227.html
Normal file
@ -0,0 +1,18 @@
|
||||
<a name="dis_01_0227"></a><a name="dis_01_0227"></a>
|
||||
|
||||
<h1 class="topictitle1">Service CDR File Name</h1>
|
||||
<div id="body0000001205729812"><p id="dis_01_0227__p25011419104917">OTC_{region_code}_dispart_YYYYMMDDHHMMSS_YYYYMMDDHHMMSS_{az_code}_{serial_number}.csv/zip</p>
|
||||
<p id="dis_01_0227__p6501121918491">OTC_{region_code}_dispayunit_YYYYMMDDHHMMSS_YYYYMMDDHHMMSS_{az_code}_{serial_number}.csv/zip</p>
|
||||
<p id="dis_01_0227__p350115195496">OTC_{region_code}_dissize_YYYYMMDDHHMMSS_YYYYMMDDHHMMSS_{az_code}_{serial_number}.csv/zip</p>
|
||||
<p id="dis_01_0227__p2501161915491">The {az_code} is not used by dis, the value is set the AZ01 number by default.</p>
|
||||
<p id="dis_01_0227__p135015194491"><strong id="dis_01_0227__b17776132944920">For example:</strong></p>
|
||||
<p id="dis_01_0227__p135011199496">OTC_eu-de_dispart_20170427100000_20170427105959_eu-de-01_0001.csv/zip</p>
|
||||
<p id="dis_01_0227__p11501171917494">OTC_eu-de_dispayunit_20170427100000_20170427105959_eu-de-01_0001.csv/zip</p>
|
||||
<p id="dis_01_0227__p10501141914496">OTC_eu-de_dissize<strong id="dis_01_0227__b950151964912">_20170427100000_20170427105959_ eu-de-01 _0001.csv/zip</strong></p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0224.html">CDR Folder and File Name</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
21
docs/dis/umn/dis_01_0228.html
Normal file
21
docs/dis/umn/dis_01_0228.html
Normal file
@ -0,0 +1,21 @@
|
||||
<a name="dis_01_0228"></a><a name="dis_01_0228"></a>
|
||||
|
||||
<h1 class="topictitle1">CDR Specification</h1>
|
||||
<div id="body0000001205889802"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0229.html">The CDR Specification</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0230.html">The Partition CDR Content</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0231.html">The PUT Payload Unit CDR Content</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0232.html">The Data Store Size CDR Content</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0222.html">CDR Specification</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
75
docs/dis/umn/dis_01_0229.html
Normal file
75
docs/dis/umn/dis_01_0229.html
Normal file
@ -0,0 +1,75 @@
|
||||
<a name="dis_01_0229"></a><a name="dis_01_0229"></a>
|
||||
|
||||
<h1 class="topictitle1">The CDR Specification</h1>
|
||||
<div id="body0000001205409858"><p id="dis_01_0229__p769615221648">Charging requirement: Charging starts from the time when the DIS instance is created and stops when the DIS instance is deleted.</p>
|
||||
<p id="dis_01_0229__p1769618227416">CDR record cycle: The minimum granularity is minute, and the current cycle is 60 minutes. The interval for uploading offline CDR files is one hour.</p>
|
||||
<p id="dis_01_0229__p13696122145">There are three types of Product ID corresponding to three billing factors in DIS. The detail information of the product ID looks like below:</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0229__table3947101718552" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DIS Product ID</caption><thead align="left"><tr id="dis_01_0229__row810201810553"><th align="left" class="cellrowborder" valign="top" width="20.31%" id="mcps1.3.4.2.5.1.1"><p id="dis_01_0229__p3105186552">ResourceTypeCode</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="21.27%" id="mcps1.3.4.2.5.1.2"><p id="dis_01_0229__p101016181557">ID Commercial Product</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="44.42%" id="mcps1.3.4.2.5.1.3"><p id="dis_01_0229__p1810318165516">Describe of Commercial Product EN</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="14.000000000000002%" id="mcps1.3.4.2.5.1.4"><p id="dis_01_0229__p310131816554">Unit of Measure</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0229__row5101518115511"><td class="cellrowborder" rowspan="2" valign="top" width="20.31%" headers="mcps1.3.4.2.5.1.1 "><p id="dis_01_0229__p1910318125513"><em id="dis_01_0229__i18843016141013">otc</em>.resource.type.dispart</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.27%" headers="mcps1.3.4.2.5.1.2 "><p id="dis_01_0229__p2010181815555">OTC_DIS_GEN_TIME</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="44.42%" headers="mcps1.3.4.2.5.1.3 "><p id="dis_01_0229__p101011895515">The length of time the user is using the general partition</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="14.000000000000002%" headers="mcps1.3.4.2.5.1.4 "><p id="dis_01_0229__p1010101811554">second</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0229__row310141817557"><td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.1 "><p id="dis_01_0229__p31051818552">OTC_DIS_ADV_TIME</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.2 "><p id="dis_01_0229__p2010161885510">The length of time the user is using the advanced partition</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.3 "><p id="dis_01_0229__p1410111819555">second</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0229__row21018189553"><td class="cellrowborder" rowspan="2" valign="top" width="20.31%" headers="mcps1.3.4.2.5.1.1 "><p id="dis_01_0229__p110818155512"><em id="dis_01_0229__i0241230155118">otc</em>.resource.type.dispayunit</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.27%" headers="mcps1.3.4.2.5.1.2 "><p id="dis_01_0229__p18104181557">OTC_DIS_GEN_UNIT</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="44.42%" headers="mcps1.3.4.2.5.1.3 "><p id="dis_01_0229__p01041845518">The number of the PUT Payload Unit for general partition</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="14.000000000000002%" headers="mcps1.3.4.2.5.1.4 "><p id="dis_01_0229__p01012182553">number</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0229__row14101018195514"><td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.1 "><p id="dis_01_0229__p111017182558">OTC_DIS_ADV_UNIT</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.2 "><p id="dis_01_0229__p310118125513">The number of the PUT Payload Unit for advanced partition</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.3 "><p id="dis_01_0229__p4101718165511">number</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0229__row310818105510"><td class="cellrowborder" rowspan="2" valign="top" width="20.31%" headers="mcps1.3.4.2.5.1.1 "><p id="dis_01_0229__p610131865513"><em id="dis_01_0229__i1347013356516">otc</em>.resource.type.dissize</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.27%" headers="mcps1.3.4.2.5.1.2 "><p id="dis_01_0229__p3101818205519">OTC_DIS_GEN_STORE</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="44.42%" headers="mcps1.3.4.2.5.1.3 "><p id="dis_01_0229__p41071813554">The data storage size in general partition.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="14.000000000000002%" headers="mcps1.3.4.2.5.1.4 "><p id="dis_01_0229__p911131820550">byte</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0229__row81131835518"><td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.1 "><p id="dis_01_0229__p131111186554">OTC_DIS_ADV_STORE</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.2 "><p id="dis_01_0229__p1611181835518">The data storage size in advanced partition.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.4.2.5.1.3 "><p id="dis_01_0229__p191111819559">byte</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0228.html">CDR Specification</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
248
docs/dis/umn/dis_01_0230.html
Normal file
248
docs/dis/umn/dis_01_0230.html
Normal file
File diff suppressed because it is too large
Load Diff
251
docs/dis/umn/dis_01_0231.html
Normal file
251
docs/dis/umn/dis_01_0231.html
Normal file
File diff suppressed because it is too large
Load Diff
264
docs/dis/umn/dis_01_0232.html
Normal file
264
docs/dis/umn/dis_01_0232.html
Normal file
File diff suppressed because it is too large
Load Diff
21
docs/dis/umn/dis_01_0600.html
Normal file
21
docs/dis/umn/dis_01_0600.html
Normal file
@ -0,0 +1,21 @@
|
||||
<a name="dis_01_0600"></a><a name="dis_01_0600"></a>
|
||||
|
||||
<h1 class="topictitle1">Overview</h1>
|
||||
<div id="body4570028"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0001.html">What Is DIS?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0002.html">What Can I Do with DIS?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0003.html">Functions</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0004.html">Related Services</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0005.html">Permissions</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_01_0006.html">Precautions</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
104
docs/dis/umn/dis_01_0601.html
Normal file
104
docs/dis/umn/dis_01_0601.html
Normal file
File diff suppressed because it is too large
Load Diff
31
docs/dis/umn/dis_01_0602.html
Normal file
31
docs/dis/umn/dis_01_0602.html
Normal file
@ -0,0 +1,31 @@
|
||||
<a name="dis_01_0602"></a><a name="dis_01_0602"></a>
|
||||
|
||||
<h1 class="topictitle1">Step 2: Preparing a DIS Application Development Environment</h1>
|
||||
<div id="body1493022272990"><p class="MsoNormal" id="dis_01_0602__p18389930">Before developing DIS applications, prepare an application development environment, and then obtain a software development kit (SDK) and sample project and import them to the development environment.</p>
|
||||
<div class="section" id="dis_01_0602__section31291646"><h4 class="sectiontitle">Prerequisites</h4><ul id="dis_01_0602__ul20084682"><li id="dis_01_0602__li46544415">JDK 1.8 or later has been installed.</li><li id="dis_01_0602__li16246551">Eclipse has been installed.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0602__section13189358"><h4 class="sectiontitle">Procedure</h4><ol id="dis_01_0602__ol32576140"><li id="dis_01_0602__li24749807"><span>Configure a JDK using Eclipse.</span><p><ol type="a" id="dis_01_0602__ol21421675"><li id="dis_01_0602__li58577354">Start Eclipse and choose <strong id="dis_01_0602__b08791630173311">Window</strong> > <strong id="dis_01_0602__b08801530133314">Preferences</strong>. The <span class="wintitle" id="dis_01_0602__wintitle58800305331"><b>Preferences</b></span> dialog box is displayed.</li><li id="dis_01_0602__li57434139">In the navigation tree, choose <strong id="dis_01_0602__b1974610293311">Java</strong>. On the <strong id="dis_01_0602__b759864163510">Java</strong> page, configure general settings for Java development and then click <strong id="dis_01_0602__b282715546358">OK</strong>. <div class="fignone" id="dis_01_0602__fig37124028152333"><span class="figcap"><b>Figure 1 </b>Preferences</span><br><span><img id="dis_01_0602__image9119245" src="en-us_image_0000001266697405.png"></span></div>
|
||||
</li><li id="dis_01_0602__li461342">In the navigation tree, choose <strong id="dis_01_0602__b179742143386">Java</strong> > <strong id="dis_01_0602__b143362188380">Installed JREs</strong>.<ul id="dis_01_0602__ul4124816117435"><li id="dis_01_0602__li5866768117435">Ensure that configured JDK environmental variables are displayed on the <span class="wintitle" id="dis_01_0602__wintitle1670319381142746"><b>Installed JREs</b></span> page. Then go to <a href="#dis_01_0602__li12377149194529">1.c.i</a>.</li><li id="dis_01_0602__li2039334417435">To configure different variables for different versions of JDK, perform <a href="#dis_01_0602__li40268681153416">1.c.ii</a> to <a href="#dis_01_0602__li6851708153416">1.c.iv</a>.</li></ul>
|
||||
<div class="fignone" id="dis_01_0602__fig6650071152523"><span class="figcap"><b>Figure 2 </b>Installed JREs</span><br><span><img id="dis_01_0602__image16468652" src="en-us_image_0000001266777405.png"></span></div>
|
||||
<ol class="substepthirdol" id="dis_01_0602__ol21299447194534"><li id="dis_01_0602__li12377149194529"><a name="dis_01_0602__li12377149194529"></a><a name="li12377149194529"></a>Select the installed JDK and click <strong id="dis_01_0602__b121191011162011">OK</strong>.</li><li id="dis_01_0602__li40268681153416"><a name="dis_01_0602__li40268681153416"></a><a name="li40268681153416"></a>Click <strong id="dis_01_0602__b842352706101132">Add</strong>. The <span class="wintitle" id="dis_01_0602__wintitle947219353202"><b>Add JRE</b></span> dialog box is displayed. <div class="fignone" id="dis_01_0602__fig2154153153416"><span class="figcap"><b>Figure 3 </b>JRE Type</span><br><span><img id="dis_01_0602__image22608971153416" src="en-us_image_0000001222257286.png"></span></div>
|
||||
</li><li id="dis_01_0602__li15674381153416">Select a JRE type and click <strong id="dis_01_0602__b153821111217">Next</strong>.<div class="fignone" id="dis_01_0602__fig62331347153416"><span class="figcap"><b>Figure 4 </b>JRE Definition</span><br><span><img id="dis_01_0602__image29295326153416" src="en-us_image_0000001266897385.png"></span></div>
|
||||
</li><li id="dis_01_0602__li6851708153416"><a name="dis_01_0602__li6851708153416"></a><a name="li6851708153416"></a>Configure the basic information about JDK and click <strong id="dis_01_0602__b18713475215">Finish</strong>.<ul id="dis_01_0602__ul58229260153416"><li id="dis_01_0602__li18117474153416">JRE home: JDK installation path.</li><li id="dis_01_0602__li28839539153416">Default VM arguments: JDK running parameters.</li></ul>
|
||||
</li></ol>
|
||||
</li></ol>
|
||||
</p></li><li id="dis_01_0602__li17211251113218"><span>Download resource packages.</span><p><p id="dis_01_0602__p17175858123216">Download the DIS SDK from <a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip</a> and its integrity check file from <a href="https://dis.obs.eu-de.otctest.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otctest.t-systems.com/dis/download/dis-sdk-1.2.3.zip.sha256sum</a>.</p>
|
||||
</p></li><li id="dis_01_0602__le2a3cf8a367549798404bbcf1cf7ea15"><span>Import the Eclipse project.</span><p><ol type="a" id="dis_01_0602__o09dc93a9c5694e4eabe12ca18cb2d199"><li id="dis_01_0602__l99736f2e4f434b36b4feef5a96d43f1b">Start Eclipse. Choose <strong id="dis_01_0602__b1444157724">File</strong> > <strong id="dis_01_0602__b270631392">Import</strong>. The <strong id="dis_01_0602__b1465747853">Import</strong> dialog box is displayed.</li></ol><ol type="a" start="2" id="dis_01_0602__o48f7ccdb3db1480cb52aa4bd47e2ec9c"><li id="dis_01_0602__l1403bea7f19048d382c18d734e6261d7">Choose <strong id="dis_01_0602__b195501321134219">General</strong> > <strong id="dis_01_0602__b17174202713422">Existing Projects into Workspace</strong> and click <strong id="dis_01_0602__b132021032124216">Next</strong>. The <strong id="dis_01_0602__b13676163924212">Import</strong> dialog box is displayed.</li><li id="dis_01_0602__l02019edd289d44c19d4d3ad62eec78f9">Click <span class="uicontrol" id="dis_01_0602__uicontrol118319817246"><b>Browse</b></span> and select a save location for the <strong id="dis_01_0602__b151834812243">dis-sdk-demo</strong> sample project. In the <strong id="dis_01_0602__b10185118182412">Projects</strong> area, select a sample project.<div class="fignone" id="dis_01_0602__f23cd224614d04888bfa7c759107662f3"><span class="figcap"><b>Figure 5 </b>Importing a project</span><br><span><img id="dis_01_0602__idcec954a169d4bc2b6122678f2dd46e0" src="en-us_image_0000001222417242.png"></span></div>
|
||||
</li><li id="dis_01_0602__l2452f0057dc54df6ab09179f6d33c01b">Click <strong id="dis_01_0602__b895558220">Finish</strong>.</li></ol>
|
||||
</p></li><li id="dis_01_0602__li52111729235"><span>Configure the demo project.</span><p><ol type="a" id="dis_01_0602__ol10242182182315"><li id="dis_01_0602__li32426216234">Set the project code to <strong id="dis_01_0602__b98121317162514">UTF-8</strong>.<ol class="substepthirdol" id="dis_01_0602__ol424202152314"><li id="dis_01_0602__li224214212314">In the navigation tree, right-click the required project under <strong id="dis_01_0602__b3902835192620">Project Explorer</strong> and choose <strong id="dis_01_0602__b7922174162616">Properties</strong> from the shortcut menu. The <strong id="dis_01_0602__b202905720214337">Properties for dis-sdk-demo</strong> dialog box is displayed.</li><li id="dis_01_0602__li12242102102318">In the navigation tree, choose <strong id="dis_01_0602__b1455116372279">Resource</strong>. The <strong id="dis_01_0602__b187018520143311">Resource</strong> page is displayed in the right pane.</li><li id="dis_01_0602__li1724211212236">In the <strong id="dis_01_0602__b39781423192817">Other</strong> drop-down list, select <strong id="dis_01_0602__b164681354162911">UTF-8</strong>.</li><li id="dis_01_0602__li9242162112312">Click <strong id="dis_01_0602__b544011192304">Apply and Close</strong>.</li></ol>
|
||||
</li><li id="dis_01_0602__li192421242310">Import a dependency package.<ol class="substepthirdol" id="dis_01_0602__ol1824217220233"><li id="dis_01_0602__li1624210214238">In the navigation pane, choose <strong id="dis_01_0602__en-us_topic_0068150545_b61466687193828">Project Explorer</strong>. Right-click the chosen project and choose <strong id="dis_01_0602__en-us_topic_0068150545_b42534505151423">Properties</strong> from the shortcut menu.</li><li id="dis_01_0602__li102428216239">In the navigation tree, choose <strong id="dis_01_0602__b168952101312">Java Build Path</strong>. The <strong id="dis_01_0602__b1728104238143337">Java Build Path</strong> page is displayed in the right pane.</li><li id="dis_01_0602__li7242225231">Click the <strong id="dis_01_0602__b05221756183114">Libraries</strong> tab, and then click <strong id="dis_01_0602__b1225074163219">Add External JARs</strong>. The <strong id="dis_01_0602__b1075049741143353">JAR Selection</strong> dialog box is displayed.</li><li id="dis_01_0602__li82427252318">Select the directory where the <strong id="dis_01_0602__b39182511010">dis-sdk</strong> folder is located and click <strong id="dis_01_0602__b443918415592">Open</strong>.</li><li id="dis_01_0602__li024215242312">On the <strong id="dis_01_0602__b203175307331">Properties for dis-sdk-demo</strong> page, click <strong id="dis_01_0602__b14259113416338">Apply and Close</strong> to import all the <strong id="dis_01_0602__b13250175014335">.jar</strong> files in the current path and the <strong id="dis_01_0602__b659481173413">third_lib</strong> folder to the project.</li></ol>
|
||||
<div class="fignone" id="dis_01_0602__fig1824213232316"><span class="figcap"><b>Figure 6 </b>Java Build Path</span><br><span><img id="dis_01_0602__image12421292312" src="en-us_image_0000001222097282.png"></span></div>
|
||||
</li><li id="dis_01_0602__li72427272316">Add the JDK.<ol class="substepthirdol" id="dis_01_0602__ol1242152192318"><li id="dis_01_0602__li92427282316">In the navigation pane, choose <strong id="dis_01_0602__en-us_topic_0068150545_b61466687193828_1">Project Explorer</strong>. Right-click the chosen project and choose <strong id="dis_01_0602__en-us_topic_0068150545_b42534505151423_1">Properties</strong> from the shortcut menu.</li><li id="dis_01_0602__li324210232311">In the navigation tree, choose <strong id="dis_01_0602__b878664280">Java Build Path</strong>. The <strong id="dis_01_0602__b838950758">Java Build Path</strong> page is displayed in the right pane.</li><li id="dis_01_0602__li1424219292320">Click the <strong id="dis_01_0602__b60591108143444">Libraries</strong> tab, and then click <strong id="dis_01_0602__b495451434143444">Add Library</strong>. The <strong id="dis_01_0602__b1983410870143450">Add Library</strong> dialog box is displayed.</li><li id="dis_01_0602__li1224210219233">Select <strong id="dis_01_0602__b101415163714">JRE System Library</strong> and click <strong id="dis_01_0602__b10442182263714">Next</strong>. Verify that the version of <strong id="dis_01_0602__b75988889414350">Workspace default JRE</strong> is <strong id="dis_01_0602__b112955499714350">jdk1.8</strong> or later.</li><li id="dis_01_0602__li524210262320">Click <strong id="dis_01_0602__b774210223815">Finish</strong> to exit the <strong id="dis_01_0602__b9362378383">Add Library</strong> dialog box.</li><li id="dis_01_0602__li42423232310">Click <strong id="dis_01_0602__b12638516153810">Apply and Close</strong>.</li></ol>
|
||||
</li></ol>
|
||||
</p></li><li id="dis_01_0602__li29083993"><span>Initialize a DIS client sample. For details about <span class="parmname" id="dis_01_0602__parmname4156049214369"><b>endpoint</b></span>, <span class="parmname" id="dis_01_0602__parmname3850011514369"><b>ak</b></span>, <span class="parmname" id="dis_01_0602__parmname1095672314369"><b>sk</b></span>, <span class="parmname" id="dis_01_0602__parmname3150164314369"><b>region</b></span>, and <span class="parmname" id="dis_01_0602__parmname1507933314369"><b>projectId</b></span>, see <a href="dis_01_0043.html">Obtaining Authentication Information</a>.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
31
docs/dis/umn/dis_01_0603.html
Normal file
31
docs/dis/umn/dis_01_0603.html
Normal file
@ -0,0 +1,31 @@
|
||||
<a name="dis_01_0603"></a><a name="dis_01_0603"></a>
|
||||
|
||||
<h1 class="topictitle1">Step 3: Sending Data to DIS</h1>
|
||||
<div id="body1493022272990"><div class="section" id="dis_01_0603__section1815156"><h4 class="sectiontitle">Function</h4><p id="dis_01_0603__p29755367">Local data is continuously uploaded to DIS.</p>
|
||||
<div class="note" id="dis_01_0603__note66471715"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dis_01_0603__p1288810025716">Data can be stored in DIS, OBS, and DLI. For details about how to configure a storage location, see <a href="dis_01_0047.html">Creating a Dump Task</a>.</p>
|
||||
<p id="dis_01_0603__p3847202715366">The maximum number of days for DIS to preserve data cannot exceed <span class="parmname" id="dis_01_0603__parmname13280431062"><b>Data Retention (days)</b></span>.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0603__section16336406"><h4 class="sectiontitle">Sample Code</h4><p id="dis_01_0603__p26355502007">The example code file is the <strong id="dis_01_0603__b1686019255111">ProducerDemo.java</strong> file in the <span class="filepath" id="dis_01_0603__filepath42186216193820"><b>\dis-sdk-demo\src\main\java\com\bigdata\dis\sdk\demo</b></span> directory decompressed from the <strong id="dis_01_0603__b18695210114216">dis-sdk-1.2.3.zip</strong> package. The compression package is downloaded in <a href="dis_01_0602.html">Step 2: Preparing a DIS Application Development Environment</a>.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0603__section12809933"><h4 class="sectiontitle">Running the Producer Program</h4><div class="p" id="dis_01_0603__p52065338141422">Right-click the producer application and choose <strong id="dis_01_0603__b12905184720139">Run As</strong> > <strong id="dis_01_0603__b828113516131">1 Java Application</strong> from the shortcut menu.<div class="fignone" id="dis_01_0603__fig15069943162017"><span class="figcap"><b>Figure 1 </b>Running a producer application</span><br><span><img id="dis_01_0603__image31665688" src="en-us_image_0000001266977421.png"></span></div>
|
||||
</div>
|
||||
<p id="dis_01_0603__p6393081511391"></p>
|
||||
<div class="litext" id="dis_01_0603__p14783937">While data is being sent to DIS, the DIS console displays DIS stream information. If information similar to the following is displayed, the data has been successfully sent to DIS:<pre class="screen" id="dis_01_0603__screen14890832202548">14:40:20.090 [main] INFOcom.bigdata.dis.sdk.DISConfig - get from classLoader
|
||||
14:40:20.093 [main] INFODEMOT - ========== BEGIN PUT ============
|
||||
14:40:21.186 [main] INFOcom.bigdata.dis.sdk.util.config.ConfigurationUtils - get from classLoader
|
||||
14:40:21.187 [main] INFOcom.bigdata.dis.sdk.util.config.ConfigurationUtils - propertyMapFromFile size : 2
|
||||
14:40:22.092 [main] INFOcom.bigdata.dis.sdk.demo.ProducerDemo - Put 3 records[3 successful / 0 failed].
|
||||
14:40:22.092 [main] INFOcom.bigdata.dis.sdk.demo.ProducerDemo - [hello world.] put success, partitionId [shardId-0000000000], partitionKey [964885], sequenceNumber [0]
|
||||
14:40:22.092 [main] INFOcom.bigdata.dis.sdk.demo.ProducerDemo - [hello world.] put success, partitionId [shardId-0000000000], partitionKey [910960], sequenceNumber [1]
|
||||
14:40:22.092 [main] INFOcom.bigdata.dis.sdk.demo.ProducerDemo - [hello world.] put success, partitionId [shardId-0000000000], partitionKey [528377], sequenceNumber [2]
|
||||
14:40:22.092 [main] INFOcom.bigdata.dis.sdk.demo.ProducerDemo - ========== PUT OVER ============</pre>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
23
docs/dis/umn/dis_01_0604.html
Normal file
23
docs/dis/umn/dis_01_0604.html
Normal file
@ -0,0 +1,23 @@
|
||||
<a name="dis_01_0604"></a><a name="dis_01_0604"></a>
|
||||
|
||||
<h1 class="topictitle1">Step 4: Obtaining Data from DIS</h1>
|
||||
<div id="body1493022272990"><div class="section" id="dis_01_0604__section33008913"><h4 class="sectiontitle">Function</h4><p id="dis_01_0604__p25879650">You can retrieve data from DIS when needed.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0604__section28644761"><h4 class="sectiontitle">Sample Code</h4><p id="dis_01_0604__p6601245320226">The example code file is the <strong id="dis_01_0604__b814132119529">ConsumerDemo.java</strong> file in the <span class="filepath" id="dis_01_0604__filepath615162135214"><b>\dis-sdk-demo\src\main\java\com\bigdata\dis\sdk\demo</b></span> directory decompressed from the <strong id="dis_01_0604__b342545404412">dis-sdk-XXX.zip</strong> package. The compression package is downloaded in <a href="dis_01_0602.html">Step 2: Preparing a DIS Application Development Environment</a>.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0604__section56476259"><h4 class="sectiontitle">Running the Consumer Application</h4><p class="litext" id="dis_01_0604__p40311937">If information similar to the following appears, data has been successfully retrieved from DIS:</p>
|
||||
<pre class="screen" id="dis_01_0604__screen27263117">14:55:42.954 [main] INFOcom.bigdata.dis.sdk.DISConfig - get from classLoader
|
||||
14:55:44.103 [main] INFOcom.bigdata.dis.sdk.util.config.ConfigurationUtils - get from classLoader
|
||||
14:55:44.105 [main] INFOcom.bigdata.dis.sdk.util.config.ConfigurationUtils - propertyMapFromFile size : 2
|
||||
14:55:45.235 [main] INFOcom.bigdata.dis.sdk.demo.ConsumerDemo - Get stream streamName[partitionId=0] cursor success : eyJnZXRJdGVyYXRvclBhcmFtIjp7InN0cmVhbS1uYW1lIjoiZGlzLTEzbW9uZXkiLCJwYXJ0aXRpb24taWQiOiIwIiwiY3Vyc29yLXR5cGUiOiJBVF9TRVFVRU5DRV9OVU1CRVIiLCJzdGFydGluZy1zZXF1ZW5jZS1udW1iZXIiOiIxMDY4OTcyIn0sImdlbmVyYXRlVGltZXN0YW1wIjoxNTEzNjY2NjMxMTYxfQ
|
||||
14:55:45.305 [main] INFOcom.bigdata.dis.sdk.demo.ConsumerDemo - Get Record [hello world.], partitionKey [964885], sequenceNumber [0].
|
||||
14:55:45.305 [main] INFOcom.bigdata.dis.sdk.demo.ConsumerDemo - Get Record [hello world.], partitionKey [910960], sequenceNumber [1].
|
||||
14:55:46.359 [main] INFOcom.bigdata.dis.sdk.demo.ConsumerDemo - Get Record [hello world.], partitionKey [528377], sequenceNumber [2]. </pre>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
63
docs/dis/umn/dis_01_0605.html
Normal file
63
docs/dis/umn/dis_01_0605.html
Normal file
@ -0,0 +1,63 @@
|
||||
<a name="dis_01_0605"></a><a name="dis_01_0605"></a>
|
||||
|
||||
<h1 class="topictitle1">Creating an IAM Agency</h1>
|
||||
<div id="body1512182647019"><div class="section" id="dis_01_0605__section15746595104641"><h4 class="sectiontitle">Introduction</h4><p id="dis_01_0605__p18776011348">If you choose to dump data from DIS to OBS, create an IAM agency that grants DIS permissions to access OBS.</p>
|
||||
</div>
|
||||
<div class="section" id="dis_01_0605__section25838076111910"><h4 class="sectiontitle">Creating an IAM Agency</h4><ol id="dis_01_0605__ol12509378111910"><li id="dis_01_0605__li45475542111910"><span>Log in to the management console.</span></li><li id="dis_01_0605__li6626697111910"><span>Click <strong id="dis_01_0605__b5195173919553">Service List</strong>. Under <strong id="dis_01_0605__b6771174445512">Management & Deployment</strong>, select <strong id="dis_01_0605__b71631010135616">Identify and Access Management</strong>.</span></li><li id="dis_01_0605__li59640276111910"><span>Select <strong id="dis_01_0605__b10828326165718">Agencies</strong> in the navigation tree pane, and click <strong id="dis_01_0605__b11631174675715">Create Agency</strong>.</span><p><div class="fignone" id="dis_01_0605__fig165014586333"><span class="figcap"><b>Figure 1 </b>Creating an IAM agency</span><br><span><img id="dis_01_0605__image20650195823316" src="en-us_image_0000001266897473.jpg"></span></div>
|
||||
</p></li><li id="dis_01_0605__li67000440111910"><span>Configure agency parameters and click <strong id="dis_01_0605__b33037246584">OK</strong>. </span><p><div class="fignone" id="dis_01_0605__fig1498012571344"><span class="figcap"><b>Figure 2 </b>Configuring agency parameters</span><br><span><img id="dis_01_0605__image18980165717341" src="en-us_image_0000001266777501.jpg"></span></div>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dis_01_0605__table66133055111910" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Agency parameters</caption><thead align="left"><tr id="dis_01_0605__row32490906111910"><th align="left" class="cellrowborder" valign="top" width="30%" id="mcps1.3.2.2.4.2.2.2.3.1.1"><p id="dis_01_0605__p14517702111910">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="70%" id="mcps1.3.2.2.4.2.2.2.3.1.2"><p id="dis_01_0605__p35083239111910">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_01_0605__row23170149111910"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.2.4.2.2.2.3.1.1 "><p id="dis_01_0605__p64842791111910">Agency Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.2.4.2.2.2.3.1.2 "><p id="dis_01_0605__p17774742111910">Name of the agency to be created. The value of this parameter is 1 to 64 characters long and cannot be left unspecified.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0605__row25754953111910"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.2.4.2.2.2.3.1.1 "><p id="dis_01_0605__p5776486111910">Agency Type</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.2.4.2.2.2.3.1.2 "><p id="dis_01_0605__p65242211111910">Type of the agency to be created. This parameter must be set to <strong id="dis_01_0605__b147241335189">Cloud service</strong>.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0605__row50308989111910"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.2.4.2.2.2.3.1.1 "><p id="dis_01_0605__p48496302111910">Cloud Service</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.2.4.2.2.2.3.1.2 "><p id="dis_01_0605__p35886355111910">Click <strong id="dis_01_0605__b10448144191416">Select</strong> next to <strong id="dis_01_0605__b194031287144">Cloud Service</strong>. In the <strong id="dis_01_0605__b1195624117142">Select Cloud Service</strong> dialog box, select <strong id="dis_01_0605__b17685194915144">DIS</strong> and click <strong id="dis_01_0605__b13767105151419">OK</strong>.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0605__row54541740111910"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.2.4.2.2.2.3.1.1 "><p id="dis_01_0605__p55804859111910">Validity Period</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.2.4.2.2.2.3.1.2 "><p id="dis_01_0605__p23899763111910">Select <strong id="dis_01_0605__b113861320101513">Unlimited</strong>.</p>
|
||||
<div class="note" id="dis_01_0605__note47354677104651"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dis_01_0605__p23538910104651">Currently, this parameter must be set to <strong id="dis_01_0605__b133691353153">Unlimited</strong>. Using another value may result in authorization failures.</p>
|
||||
</div></div>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0605__row13771277111910"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.2.4.2.2.2.3.1.1 "><p id="dis_01_0605__p41731668111910">Description</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.2.4.2.2.2.3.1.2 "><p id="dis_01_0605__p24821976111910">Agency description. The entered description cannot exceed 255 characters.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_01_0605__row22071196111910"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.2.2.4.2.2.2.3.1.1 "><p id="dis_01_0605__p238213123015">Permissions</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.2.2.4.2.2.2.3.1.2 "><p id="dis_01_0605__p9543077171349">If <strong id="dis_01_0605__b1547196153414">Dump Destination</strong> is <strong id="dis_01_0605__b119971512143416">OBS</strong>, policy settings are as follows: <span id="dis_01_0605__text13276113293412">Region: Global service
|
||||
Project: OBS
|
||||
Policy: Tenant Administrator</span></p>
|
||||
<p id="dis_01_0605__p46724365101249">To modify agency policies, click <strong id="dis_01_0605__b5521810203614">Modify</strong> in the <strong id="dis_01_0605__b37780128367">Operation</strong> column. In the <strong id="dis_01_0605__b1322185853711">Available Policies</strong> area, select your required policy and click <strong id="dis_01_0605__b4977111643810">OK</strong>.</p>
|
||||
<div class="note" id="dis_01_0605__note58012428112512"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dis_01_0605__p65485460112517">After an agency is created, its policies cannot be modified.</p>
|
||||
</div></div>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_01_0008.html">Getting Started</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
12
docs/dis/umn/dis_06_0005.html
Normal file
12
docs/dis/umn/dis_06_0005.html
Normal file
@ -0,0 +1,12 @@
|
||||
<a name="dis_06_0005"></a><a name="dis_06_0005"></a>
|
||||
|
||||
<h1 class="topictitle1">Downloading SDKs</h1>
|
||||
<div id="body8662426"><p id="dis_06_0005__p1715696617299">Data Ingestion Service Software Development Kit (DIS SDK) is the encapsulation of RESTful APIs provided by DIS to simplify development. You can use DIS by calling API functions provided by DIS SDK.</p>
|
||||
<p id="dis_06_0005__a35b4f2812c5948cfac8e3932be94a90b">Download the package from <a href="https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip" target="_blank" rel="noopener noreferrer">https://dis.obs.eu-de.otc.t-systems.com/dis/download/dis-sdk-1.2.3.zip</a>.</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_06_0011.html">DIS SDK Usage Guide</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
37
docs/dis/umn/dis_06_0011.html
Normal file
37
docs/dis/umn/dis_06_0011.html
Normal file
@ -0,0 +1,37 @@
|
||||
<a name="dis_06_0011"></a><a name="dis_06_0011"></a>
|
||||
|
||||
<h1 class="topictitle1">DIS SDK Usage Guide</h1>
|
||||
<div id="body8662426"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0005.html">Downloading SDKs</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0012.html">Preparing the Environment</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0020.html">Connecting to kafka consumer</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0013.html">Configuring Sample Projects</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0014.html">Importing Third-party Dependency Packages</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0015.html">Initializing a DIS Client</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0501.html">Creating a Stream</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0502.html">Deleting a Stream</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0503.html">Querying a Stream List</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0504.html">Querying Stream Details</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0016.html">Uploading Streaming Data</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0017.html">Downloading Streaming Data</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0022.html">Uploading Real-Time Files</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dis_06_0505.html">Obtaining the Data Cursor</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
11
docs/dis/umn/dis_06_0012.html
Normal file
11
docs/dis/umn/dis_06_0012.html
Normal file
@ -0,0 +1,11 @@
|
||||
<a name="dis_06_0012"></a><a name="dis_06_0012"></a>
|
||||
|
||||
<h1 class="topictitle1">Preparing the Environment</h1>
|
||||
<div id="body32001227"><ul id="dis_06_0012__en-us_topic_0080205339_ul53048087"><li id="dis_06_0012__ld6c753520fe841298378461c9d5018b8">Download JDK1.8 or a later version from the <a href="http://www.oracle.com/technetwork/java/archive-139210.html" target="_blank" rel="noopener noreferrer">Oracle official website</a> and install it, and configure Java environment variables.</li><li id="dis_06_0012__le6cc4c40a0844318bdb6272419b794ae">Download Eclipse IDE for Java Developers of the latest version from the <a href="http://www.eclipse.org/downloads/eclipse-packages/" target="_blank" rel="noopener noreferrer">Eclipse's official website</a>, and install it.</li><li id="dis_06_0012__l5024ecdf9b3f4bf383daf1adef18f4d5">Configure the JDK in Eclipse.</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_06_0011.html">DIS SDK Usage Guide</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
41
docs/dis/umn/dis_06_0013.html
Normal file
41
docs/dis/umn/dis_06_0013.html
Normal file
@ -0,0 +1,41 @@
|
||||
<a name="dis_06_0013"></a><a name="dis_06_0013"></a>
|
||||
|
||||
<h1 class="topictitle1">Configuring Sample Projects</h1>
|
||||
<div id="body1533030007809"><p id="dis_06_0013__en-us_topic_0080238915_p6757235">The <strong id="dis_06_0013__b188188261385">dis-sdk-</strong><em id="dis_06_0013__abadbdd5c3e1246bfa28611798b088f03">1.2.3</em><strong id="dis_06_0013__b11852324133812">.zip</strong> package of the latest version in <a href="dis_06_0005.html">Downloading SDKs</a> provides a sample project. You can use a development tool (such as Eclipse) on the local server to compile and run the sample project. You can also develop your applications based on the sample project. The sample project code is available in the <span class="filepath" id="dis_06_0013__fe2dfd19312124bebb9eff06863312db3"><b>\dis-sdk-demo\src\com\bigdata\dis\sdk\demo</b></span> directory.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dis_06_0013__tc215b03c95f74cd6bfc9dc15d92828db" frame="border" border="1" rules="all"><thead align="left"><tr id="dis_06_0013__rd69774e99a0f4466b942650611b35a7a"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.2.1.3.1.1"><p id="dis_06_0013__a7fea6931ea244a01a963af05b7c5832a"><strong id="dis_06_0013__b480915117257">Sample Code</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.2.1.3.1.2"><p id="dis_06_0013__a94a96709800f4a659c57d943c83ff0e6"><strong id="dis_06_0013__b1749918494010">Description</strong></p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dis_06_0013__r9fea4f182bc9413b971f13eff2e84367"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.1.3.1.1 "><p id="dis_06_0013__af3abf661d87947a0a69e2371d86eaefc">ConsumerDemo.java</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.1.3.1.2 "><p id="dis_06_0013__a6bc62aedf8004fc7aeb305e51e9b4c62">How to download data</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dis_06_0013__rbbeaf36949aa47c291e3f9ea771b87e4"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.1.3.1.1 "><p id="dis_06_0013__a4d0b60f96b1640b6b2c90d849b0ba608">ProducerDemo.java</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.1.3.1.2 "><p id="dis_06_0013__a1eeda7cfe01d41ef85024790f2ff966d">How to upload data</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
<div class="section" id="dis_06_0013__sbb9f4576db8d4e1cb6cbf4fd29fb30a7"><h4 class="sectiontitle">Procedure</h4><ol id="dis_06_0013__of0ef33fca1364e25bf3f68554e31701a"><li id="dis_06_0013__l4f362a9793b148558a5248e75d41d5fc"><span>Decompress the <strong id="dis_06_0013__b71001737114116">dis-sdk-</strong><em id="dis_06_0013__a0dde6294829f4249830ee03b768290c5">1.2.3</em><strong id="dis_06_0013__b160193910412">.zip</strong> package obtained in <a href="dis_06_0005.html">Downloading SDKs</a> to obtain the <strong id="dis_06_0013__b1365455219417">dis-sdk-demo</strong> package and sample project.</span></li><li id="dis_06_0013__le2a3cf8a367549798404bbcf1cf7ea15"><span>Import the Eclipse project.</span><p><ol type="a" id="dis_06_0013__o09dc93a9c5694e4eabe12ca18cb2d199"><li id="dis_06_0013__l99736f2e4f434b36b4feef5a96d43f1b">Start Eclipse and choose <strong id="dis_06_0013__b134591907424">File</strong> > <strong id="dis_06_0013__b64651034215">Import</strong>. The <strong id="dis_06_0013__b8465506421">Import</strong> dialog box is displayed.</li></ol><ol type="a" start="2" id="dis_06_0013__o48f7ccdb3db1480cb52aa4bd47e2ec9c"><li id="dis_06_0013__l1403bea7f19048d382c18d734e6261d7">Choose <strong id="dis_06_0013__b7844104174210">General</strong> > <strong id="dis_06_0013__b4844164184219">Existing Projects into Workspace</strong> and click <strong id="dis_06_0013__b1384474154211">Next</strong>. The <strong id="dis_06_0013__b68450410428">Import</strong> dialog box is displayed.</li><li id="dis_06_0013__l02019edd289d44c19d4d3ad62eec78f9">Click <span class="uicontrol" id="dis_06_0013__uicontrol752541712421"><b>Browse</b></span> and select a save location for the <strong id="dis_06_0013__b135261517164218">dis-sdk-demo</strong> sample project. In the <strong id="dis_06_0013__b16526717114216">Projects</strong> area, select a sample project, as shown in <a href="#dis_06_0013__f23cd224614d04888bfa7c759107662f3">Figure 1</a>.<div class="fignone" id="dis_06_0013__f23cd224614d04888bfa7c759107662f3"><a name="dis_06_0013__f23cd224614d04888bfa7c759107662f3"></a><a name="f23cd224614d04888bfa7c759107662f3"></a><span class="figcap"><b>Figure 1 </b>Import Projects</span><br><span><img id="dis_06_0013__idcec954a169d4bc2b6122678f2dd46e0" src="en-us_image_0000001222097302.png"></span></div>
|
||||
</li><li id="dis_06_0013__l2452f0057dc54df6ab09179f6d33c01b">Click <strong id="dis_06_0013__b1175155154212">Finish</strong> to import the project.</li></ol>
|
||||
</p></li><li id="dis_06_0013__l59c758db48dd4a3cb6ae4acc45da3770"><span>Configure the demo project.</span><p><ol type="a" id="dis_06_0013__o690ca3a7313041e7ac9364d180eb4e68"><li id="dis_06_0013__leebd401f88184556aeac13f4de339086">Set the project code to <strong id="dis_06_0013__b33851959184212">UTF-8</strong>.<ol class="substepthirdol" id="dis_06_0013__oe565dab314c64a62bba83b43375f925e"><li id="dis_06_0013__l1da3f5d4c7284c818888cfb8743a57f2">In the navigation tree, right-click the required project under <strong id="dis_06_0013__b1442119214316">Project Explorer</strong> and choose <strong id="dis_06_0013__b2421823438">Properties</strong> from the shortcut menu. The <strong id="dis_06_0013__b15422162184315">Properties for dis-sdk-demo</strong> dialog box is displayed.</li><li id="dis_06_0013__l6ad81700d1614c72aeb9aa84bbbd821b">In the navigation tree, choose <strong id="dis_06_0013__b18760191512433">Resource</strong>. The <strong id="dis_06_0013__b1176017158436">Resource</strong> page is displayed in the right pane.</li><li id="dis_06_0013__ld347bd9dffe64958a6370c219b0aa3f8">In the <strong id="dis_06_0013__b2547152017434">Other</strong> drop-down list, select <strong id="dis_06_0013__b1454732014313">UTF-8</strong>.</li><li id="dis_06_0013__l2d93bba0cc824838bd989f487364cd6f">Click <strong id="dis_06_0013__b169671148134312">Apply and Close</strong>.</li></ol>
|
||||
<div class="fignone" id="dis_06_0013__f900a3f9eeb6f455da8d7c3617005e7d9"><span class="figcap"><b>Figure 2 </b>Resource</span><br><span><img id="dis_06_0013__i1ea882cef40049bd872f5f521b970e06" src="en-us_image_0000001222417262.png"></span></div>
|
||||
</li><li id="dis_06_0013__l0da9975510bb46fb8024586216620c5c">Import a JAR dependency package.<ol class="substepthirdol" id="dis_06_0013__o98f88d53513f409383ec59929ce96f2e"><li id="dis_06_0013__lca9255883ebf4a04b18f1620ce52d232">In the navigation tree, right-click the required project under <strong id="dis_06_0013__b1528565604313">Project Explorer</strong> and choose <strong id="dis_06_0013__b6285256174320">Properties</strong> from the shortcut menu. The <strong id="dis_06_0013__b1528520569436">Properties for dis-sdk-demo</strong> dialog box is displayed.</li><li id="dis_06_0013__l9cf749517c754ef29f974cbdcbe6ee68">In the navigation tree, choose <strong id="dis_06_0013__b1558164214440">Java Build Path</strong>. The <strong id="dis_06_0013__b159142204412">Java Build Path</strong> page is displayed in the right pane.</li><li id="dis_06_0013__lbe48b3536a8c4cdaa37d46ccb5a5062b">Click the <strong id="dis_06_0013__b4997204644416">Libraries</strong> tab, and then click <strong id="dis_06_0013__b199981146164415">Add External JARs</strong>. The <strong id="dis_06_0013__b299813468449">JAR Selection</strong> dialog box is displayed.</li><li id="dis_06_0013__lb48357d93a5d45be900bc45a9e874828">Select the location of the <strong id="dis_06_0013__b1383717463453">dis-sdk</strong> folder in the decompressed <strong id="dis_06_0013__b18260195724613">dis-sdk-</strong>1.2.3 file, and then click <strong id="dis_06_0013__b291302426">Open</strong>.</li><li id="dis_06_0013__l0562f612da5243d6afb2c7ae14062351">On the <strong id="dis_06_0013__b571412218483">Properties for dis-sdk-demo</strong> page, click <strong id="dis_06_0013__b1671515219481">Apply and Close</strong> to import all the <strong id="dis_06_0013__b67151921104818">.jar</strong> files in the current path and the <strong id="dis_06_0013__b6715122144810">third_lib</strong> folder to the project.</li></ol>
|
||||
<div class="fignone" id="dis_06_0013__fb9bf6f68bf7f4d468460fc75ad58f1ba"><span class="figcap"><b>Figure 3 </b>Java Build Path</span><br><span><img id="dis_06_0013__i1d3be345287f4533acbc54fa0a41de7e" src="en-us_image_0000001266977433.png"></span></div>
|
||||
</li><li id="dis_06_0013__ld8e9296c9cec4bf4b1a31d519baf385f">Add the JDK.<ol class="substepthirdol" id="dis_06_0013__o850b95f683de483581a8385615530ba7"><li id="dis_06_0013__lb7a3b8b4f0b64c5b9d99f7f1f36f7cff">In the navigation tree, right-click the required project under <strong id="dis_06_0013__b1242775244216">Project Explorer</strong> and choose <strong id="dis_06_0013__b1342818521424">Properties</strong> from the shortcut menu. The <strong id="dis_06_0013__b1442875294216">Properties for dis-sdk-demo</strong> dialog box is displayed.</li><li id="dis_06_0013__l9c3b23c514b5401e8b3cd819a9232040">In the navigation tree, choose <strong id="dis_06_0013__b14455267436">Java Build Path</strong>. The <strong id="dis_06_0013__b18445826114311">Java Build Path</strong> page is displayed in the right pane.</li><li id="dis_06_0013__l65a13e90989746d1bb5114bc0df3c62a">Click the <strong id="dis_06_0013__b15184203210431">Libraries</strong> tab, and then click <strong id="dis_06_0013__b518473218439">Add Library</strong>. The <strong id="dis_06_0013__b1618433216439">Add Library</strong> dialog box is displayed.</li><li id="dis_06_0013__la78f0887cb8843b28abdc306690db449">Select <strong id="dis_06_0013__b13889104813434">JRE System Library</strong> and click <strong id="dis_06_0013__b58892048114315">Next</strong>. Verify that the version of <strong id="dis_06_0013__b1488914814314">Workspace default JRE</strong> is <strong id="dis_06_0013__b1688914844319">jdk1.8</strong> or later.</li><li id="dis_06_0013__l01c831cda40241afab85e53398794841">Click <strong id="dis_06_0013__b110145812436">Finish</strong> to exit the <strong id="dis_06_0013__b15015824310">Add Library</strong> dialog box.</li><li id="dis_06_0013__led4a60bda1154e9a8192c87f6117321a">Click <strong id="dis_06_0013__b13711684419">Apply and Close</strong>.</li></ol>
|
||||
</li></ol>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_06_0011.html">DIS SDK Usage Guide</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
11
docs/dis/umn/dis_06_0014.html
Normal file
11
docs/dis/umn/dis_06_0014.html
Normal file
@ -0,0 +1,11 @@
|
||||
<a name="dis_06_0014"></a><a name="dis_06_0014"></a>
|
||||
|
||||
<h1 class="topictitle1">Importing Third-party Dependency Packages</h1>
|
||||
<div id="body32001227"><ol id="dis_06_0014__ob739fd891a5242cbb706c773a8fbc57b"><li id="dis_06_0014__ld8c7c446907a4f749896e5c02ce08c68"><span>In the navigation tree, click <strong id="dis_06_0014__abd7e6b6b85dd4e0abed68a7f87d6f764">Project Explorer</strong>, right-click a project and choose <span class="menucascade" id="dis_06_0014__m5cb62093880c40dd87fd2ce4983d833c"><b><span class="uicontrol" id="dis_06_0014__ub623a94c1d464cac924d6b6161225e4c">Properties > Java Build Path > Add External JARs</span></b></span>.</span></li><li id="dis_06_0014__lb9782d52bd0a4f6d9a846c6d26d1caaa"><span>Locate the directory containing the decompressed <span class="filepath" id="dis_06_0014__fee5939a75785420a885ec38ff403c4e3"><b>dis-sdk</b></span> folder, and import all the files with the extension <span class="filepath" id="dis_06_0014__f1f7cf08e45da446fa0b7d8405924f901"><b>JAR</b></span> in the current directory and the <span class="filepath" id="dis_06_0014__ff0be71efefa34b4bbaf1f20b675396cd"><b>third_party</b></span> folder to the project.</span></li></ol>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_06_0011.html">DIS SDK Usage Guide</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
24
docs/dis/umn/dis_06_0015.html
Normal file
24
docs/dis/umn/dis_06_0015.html
Normal file
@ -0,0 +1,24 @@
|
||||
<a name="dis_06_0015"></a><a name="dis_06_0015"></a>
|
||||
|
||||
<h1 class="topictitle1">Initializing a DIS Client</h1>
|
||||
<div id="body8662426"><p id="dis_06_0015__en-us_topic_0080205348_p57883273">You can use either of the following methods to initialize a DIS SDK client instance: For details about <span class="parmname" id="dis_06_0015__p97019598fa824fa49141bef73318807a"><b>endpoint</b></span>, <span class="parmname" id="dis_06_0015__p15e1898061ba4ec2bc7d6a30b0e61bb3"><b>ak</b></span>, <span class="parmname" id="dis_06_0015__pffc7f35e9b764386968c6e2f36d7317e"><b>sk</b></span>, <span class="parmname" id="dis_06_0015__p7dd0b1b5052f4de3adda15788503af70"><b>region</b></span>, and <span class="parmname" id="dis_06_0015__p55dca01b58c74a9a957e8cc8d5f76f98"><b>projectId</b></span>, see <a href="dis_01_0043.html">Obtaining Authentication Information</a>.</p>
|
||||
<ul id="dis_06_0015__en-us_topic_0080205348_ul51187411"><li id="dis_06_0015__l7333cc3fbe8f49218b78959d419ee743">Use the code to initialize the DIS SDK client instance. For details about the code example, see the <strong id="dis_06_0015__b280184717470">ProducerDemo.java</strong> file.<pre class="screen" id="dis_06_0015__s9fa84e380a974633bd911badbadb57e8">//Create a DIS client instance.
|
||||
DIS dic = DISClientBuilder.standard()
|
||||
.withEndpoint("https://ip:port")
|
||||
.withAk("xxxx")
|
||||
.withSk("xxxx")
|
||||
.withProjectId("xxxxxxx")
|
||||
.withRegion("xxxx")
|
||||
.build();</pre>
|
||||
</li><li id="dis_06_0015__l785645dd4f7a42cc8eda3e212992bfeb">Use the configuration file to initialize a DIS SDK client instance.<p id="dis_06_0015__a8b598691dec6481e88a54a5c27517ac6"><a name="dis_06_0015__l785645dd4f7a42cc8eda3e212992bfeb"></a><a name="l785645dd4f7a42cc8eda3e212992bfeb"></a>Add the following configuration items to the <span class="filepath" id="dis_06_0015__fa7fa10a7f68949ad8c7920caf5c6e85a"><b>dis.propertites</b></span> file in the <span class="filepath" id="dis_06_0015__f3d269e5089cd4e269e4612bd487f6558"><b>dis-sdk-demo\resources</b></span> directory:</p>
|
||||
<ul id="dis_06_0015__u2c34e84d7f2b47b88e59fc4c1e4f2448"><li id="dis_06_0015__l46c233ae67af4ce0a9ddb8e5d194768a">ak/sk: AK/SK created on the IAM</li><li id="dis_06_0015__l7248bd0f1d9b4b1da6cb146fd80ab30d">region: region of the stream</li><li id="dis_06_0015__l227664f9721c40b7988f46cf8b38c002">endpoint: access address of the DIS</li><li id="dis_06_0015__l9dd4bd17847c4c0aad1cda1b006d919c">projectId: project ID of the stream</li></ul>
|
||||
<pre class="screen" id="dis_06_0015__sc765b479965d478e943f91b260baf21d">//Create a DIS client instance.
|
||||
DIS dic = DISClientBuilder.standard().build();</pre>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_06_0011.html">DIS SDK Usage Guide</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
84
docs/dis/umn/dis_06_0016.html
Normal file
84
docs/dis/umn/dis_06_0016.html
Normal file
@ -0,0 +1,84 @@
|
||||
<a name="dis_06_0016"></a><a name="dis_06_0016"></a>
|
||||
|
||||
<h1 class="topictitle1">Uploading Streaming Data</h1>
|
||||
<div id="body8662426"><div class="section" id="dis_06_0016__s7792fc76b19d45eb80c7f9d0ece504b8"><h4 class="sectiontitle">Sample Code</h4><p id="dis_06_0016__a4400cb5ad1e645c29bb99e363e7c8fac">Use the initialized client instance to upload your streaming data to DIS. The sample code is available in the <strong id="dis_06_0016__en-us_topic_0080205350_b842352706171151">ProducerDemo.java</strong> file in the <strong id="dis_06_0016__en-us_topic_0080205350_b84235270617122">dis-sdk-demo\src\com\bigdata\dis\sdk\demo</strong> directory.</p>
|
||||
<p id="dis_06_0016__abcd9644a0a3b4a71ab9d389896792862">The value of <strong id="dis_06_0016__en-us_topic_0080205351_b842352706192057">streamName</strong> must be the same as that of <strong id="dis_06_0016__en-us_topic_0080205351_b84235270619213">Stream Name</strong> configured in <a href="dis_01_0601.html">Step 1: Creating a DIS Stream</a>.</p>
|
||||
<p id="dis_06_0016__ab6c382d824c04825a1218f4640071d48">The code for uploading streaming data is as follows:</p>
|
||||
</div>
|
||||
<pre class="screen" id="dis_06_0016__sf42e65413beb4ac7b06f80b0932b7ce1">//Initialize an asynchronous sending client.
|
||||
DISConfig disConfig = new DISConfig().setAK("xxxx").setSK("xxxx").setProjectId("xxxx").setRegion("xxxx").setEndpoint("xxxx");
|
||||
DISProducer producer = new DISProducer(disConfig);
|
||||
|
||||
//Configure the stream name.
|
||||
String streamName = "streamName";
|
||||
//Configure the data to be uploaded.
|
||||
String message = "hello world.";
|
||||
ByteBuffer buffer = ByteBuffer.wrap(message.getBytes());
|
||||
PutRecordsRequestEntry putRecordsRequestEntry = new PutRecordsRequestEntry();
|
||||
putRecordsRequestEntry.setData(buffer);
|
||||
putRecordsRequestEntry.setPartitionKey(String.valueOf(ThreadLocalRandom.current().nextInt(1000000)));
|
||||
log.info("========== BEGIN PUT ============");
|
||||
|
||||
int count = 10;
|
||||
CountDownLatch cd = new CountDownLatch(count);
|
||||
for (int i = 0; i < count; i++)
|
||||
{
|
||||
putRecordsRequestEntry.setPartitionKey(String.valueOf(ThreadLocalRandom.current().nextInt(1000000)));
|
||||
try
|
||||
{
|
||||
producer.putRecordAsync(streamName, putRecordsRequestEntry, new AsyncHandler<PutRecordsResultEntry>()
|
||||
{
|
||||
@Override
|
||||
public void onSuccess(PutRecordsResultEntry result)
|
||||
{
|
||||
log.info(result.toString());
|
||||
cd.countDown();
|
||||
}
|
||||
|
||||
@Override
|
||||
public void onError(Exception exception)
|
||||
{
|
||||
log.error(exception.getMessage(), exception);
|
||||
cd.countDown();
|
||||
}
|
||||
});
|
||||
}
|
||||
catch (Exception e)
|
||||
{
|
||||
log.error(e.getMessage(), e);
|
||||
cd.countDown();
|
||||
}
|
||||
}
|
||||
|
||||
cd.await();
|
||||
log.info("========== PUT OVER ============");
|
||||
producer.close();</pre>
|
||||
<div class="section" id="dis_06_0016__s62b2b73553da4b2c8f2d1888945fedc4"><h4 class="sectiontitle">Running the Program</h4><p id="dis_06_0016__aad4d600c027c47d9a9717e193e6ce4dd">Right-click the program and choose <span class="menucascade" id="dis_06_0016__en-us_topic_0080205350_menucascade957019998191737"><b><span class="uicontrol" id="dis_06_0016__uicontrol1588603209191737">Run As > 1 Java Application</span></b></span> from the shortcut menu. If the program runs successfully, the information similar to the following is displayed on the console:</p>
|
||||
</div>
|
||||
<pre class="screen" id="dis_06_0016__screen12775709174237">17:27:49.130 [main] INFO com.bigdata.dis.sdk.DISConfig - get from classLoader
|
||||
17:27:49.142 [Sender Thread] DEBUG com.bigdata.dis.sdk.producer.internals.Sender - Starting Kafka producer I/O thread.
|
||||
17:27:49.145 [main] INFO DISProducerDemo - ========== BEGIN PUT ============
|
||||
17:27:49.202 [Sender Thread] DEBUG com.bigdata.dis.sdk.producer.internals.Sender - begin to send : 1
|
||||
17:27:49.203 [Sender Thread] DEBUG com.bigdata.dis.sdk.producer.internals.Sender - batch size: 10, 120
|
||||
17:27:50.197 [pool-2-thread-1] INFO com.bigdata.dis.sdk.util.config.ConfigurationUtils - get from classLoader
|
||||
17:27:50.197 [pool-2-thread-1] INFO com.bigdata.dis.sdk.util.config.ConfigurationUtils - propertyMapFromFile size : 2
|
||||
17:27:51.531 [pool-2-thread-1] DEBUG com.bigdata.dis.sdk.producer.internals.Sender - batches success. dis-alAR-nb, 10
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.532 [pool-2-thread-1] INFO DISProducerDemo - PutRecordsResultEntry [partitionId=shardId-0000000000, sequenceNumber=76, errorCode=null, errorMessage=null]
|
||||
17:27:51.533 [main] INFO DISProducerDemo - ========== PUT OVER ============
|
||||
17:27:51.571 [Sender Thread] DEBUG com.bigdata.dis.sdk.producer.internals.Sender - Beginning shutdown of Kafka producer I/O thread, sending remaining records.</pre>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dis_06_0011.html">DIS SDK Usage Guide</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
Some files were not shown because too many files have changed in this diff Show More
Loading…
x
Reference in New Issue
Block a user