vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity

DataArts UMN 20230329 version

Browse Source 
Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com>
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
Co-committed-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
This commit is contained in:
Xiong, Chen Xiao 2023-05-11 17:09:25 +00:00 committed by zuul
parent eebf6cb7fa
commit f3ee29a3dd
698 changed files with 34048 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3382
docs/dataartsstudio/umn/ALL_META.TXT.json Normal file
View File

File diff suppressed because it is too large Load Diff

3044
docs/dataartsstudio/umn/CLASS.TXT.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
docs/dataartsstudio/umn/PARAMETERS.txt Normal file
View File

@ -0,0 +1,3 @@
version=""
language="en-us"
type=""

13
docs/dataartsstudio/umn/dataartsstudio_01_0003.html Normal file
View File

@ -0,0 +1,13 @@
<a name="dataartsstudio_01_0003"></a><a name="dataartsstudio_01_0003"></a>
<h1 class="topictitle1">Preparations</h1>
<div id="body8662426"><p id="dataartsstudio_01_0003__en-us_topic_0197575849_p9356115916393">To use <span id="dataartsstudio_01_0003__text14567613773">DataArts Studio</span>, <span id="dataartsstudio_01_0003__text162431854104718">create</span> a <span id="dataartsstudio_01_0003__text4243354134712">cloud platform account</span>, <span id="dataartsstudio_01_0003__text20243454184711">create</span> a <span id="dataartsstudio_01_0003__text142445549472">DataArts Studio</span> instance, and authorize a user to use <span id="dataartsstudio_01_0003__text4732134194813">DataArts Studio</span>.</p>
<p id="dataartsstudio_01_0003__en-us_topic_0197575849_p0579429102216">For details about the preparations and operations, see later sections.</p>
<div class="fignone" id="dataartsstudio_01_0003__fig143423102457"><span class="figcap"><b>Figure 1 </b><span id="dataartsstudio_01_0003__text6142101435818">DataArts Studio</span> preparation process</span><br><span><img id="dataartsstudio_01_0003__image635310133914" src="en-us_image_0000001322408448.png"></span></div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0002.html">Preparations</a></div>
</div>
</div>

21
docs/dataartsstudio/umn/dataartsstudio_01_0004.html Normal file
View File

@ -0,0 +1,21 @@
<a name="dataartsstudio_01_0004"></a><a name="dataartsstudio_01_0004"></a>
<h1 class="topictitle1">Creating an IAM User and Assigning <span id="text13250174381611">DataArts Studio</span> Permissions</h1>
<div id="body8662426"><div class="p" id="dataartsstudio_01_0004__en-us_topic_0223009156_p988518487488">Identity and Access Management (IAM) can be used for fine-grained permissions management on your <span id="dataartsstudio_01_0004__text189401823191311">DataArts Studio</span> resources. With IAM, you can:<ul id="dataartsstudio_01_0004__ul20307133063417"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li588684820486">Create IAM users for employees based on your enterprise's organizational structure. Each IAM user will have their own security credentials for accessing <span id="dataartsstudio_01_0004__text2090111011530">DataArts Studio</span> resources.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li38863484487">Assign users only the permissions required to perform a task.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li17886174824816">Entrust a <span id="dataartsstudio_01_0004__text458111419359">cloud platform account</span> or cloud service to perform efficient O&amp;M on your <span id="dataartsstudio_01_0004__text66291413531">DataArts Studio</span> resources.</li></ul>
</div>
<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p7886148114812">If you do not require individual IAM users for permissions management, skip this section.</p>
<div class="section" id="dataartsstudio_01_0004__en-us_topic_0223009156_section149106163317"><h4 class="sectiontitle">Background</h4><ul id="dataartsstudio_01_0004__en-us_topic_0223009156_ul4345266339"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li19891163562811">Before assigning permissions to a user group, familiarize yourself with the <span id="dataartsstudio_01_0004__text99095165312">DataArts Studio</span> workspace role permissions that can be added to the user group and select permissions based on actual requirements. </li></ul>
</div>
<div class="section" id="dataartsstudio_01_0004__en-us_topic_0223009156_section9135134520119"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0004__en-us_topic_0223009156_ol11830932152014"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li1983016328204"><a name="dataartsstudio_01_0004__en-us_topic_0223009156_li1983016328204"></a><a name="en-us_topic_0223009156_li1983016328204"></a>Create a user group and assign permissions to it. Log in to the IAM console using a <span id="dataartsstudio_01_0004__text16645549163611">cloud platform account</span>, create a user group, and grant permissions of a common user (for example, <span class="parmname" id="dataartsstudio_01_0004__parmname126501549203610"><b>DAYU User</b></span>) to the group.<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p108313320205">For details, see "User Groups and Authorization" &gt; "Creating a User Group and Assigning Permissions" in <em id="dataartsstudio_01_0004__i169381550757">Identity and Access Management User Guide</em>.</p>
<div class="note" id="dataartsstudio_01_0004__en-us_topic_0223009156_note52501597263"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0004__en-us_topic_0223009156_ul114668532278"><li id="dataartsstudio_01_0004__li1834013912412">When configuring <span id="dataartsstudio_01_0004__text16819177115812">DataArts Studio</span> permissions for a user group, enter <strong id="dataartsstudio_01_0004__b445894134519">DAYU</strong> in the search box to search for the permissions and select the permissions to be granted to the user group, for example, <strong id="dataartsstudio_01_0004__b0458174124513">DAYU User</strong>.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li147098562278">If an IAM user wants to create a workspace, you must assign the IAM user the <span class="parmname" id="dataartsstudio_01_0004__en-us_topic_0223009156_parmname1529101483514"><b>DAYU Administrator</b></span> policy. Users with the <span class="parmname" id="dataartsstudio_01_0004__en-us_topic_0223009156_parmname1549314196359"><b>DAYU Administrator</b></span> policy can perform all operations on <span id="dataartsstudio_01_0004__text1610641412533">DataArts Studio</span>.</li><li id="dataartsstudio_01_0004__li2866162654415"><span id="dataartsstudio_01_0004__text129123284613">DataArts Studio</span> is a project-level service deployed in specific physical regions. If you select <strong id="dataartsstudio_01_0004__b827913464817">All resources</strong> for <strong id="dataartsstudio_01_0004__b350973420578">Scope</strong>, the permission takes effect in all projects of all regions. If you select <strong id="dataartsstudio_01_0004__b1819632815583">Region-specific projects</strong> for <strong id="dataartsstudio_01_0004__b16349103655811">Scope</strong>, the permission takes effect only for a specified project. When accessing <span id="dataartsstudio_01_0004__text5352191557">DataArts Studio</span>, the IAM user must switch to the region where they have been assigned the required permissions.</li></ul>
</div></div>
</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li12832632132013">Create a user and add the user to the user group. Create a user on the IAM console and add the user to the group created in <a href="#dataartsstudio_01_0004__en-us_topic_0223009156_li1983016328204">1</a>.<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p1683243212202">For details, see "IAM Users" &gt; "Creating an IAM User" in <em id="dataartsstudio_01_0004__i016714061014">Identity and Access Management User Guide</em>.</p>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0118_0.html">Authorizing Users to Use DataArts Studio</a></div>
</div>
</div>

171
docs/dataartsstudio/umn/dataartsstudio_01_0005.html Normal file
View File

File diff suppressed because it is too large Load Diff

29
docs/dataartsstudio/umn/dataartsstudio_01_0006.html Normal file
View File

@ -0,0 +1,29 @@
<a name="dataartsstudio_01_0006"></a><a name="dataartsstudio_01_0006"></a>
<h1 class="topictitle1">(Optional) Obtaining Authentication Information</h1>
<div id="body8662426"><p id="dataartsstudio_01_0006__p9577341160">When creating OBS links, making API calls, or locating issues, you may need to obtain information such as access keys, project IDs, and endpoints. This section describes how to obtain such information.</p>
<div class="section" id="dataartsstudio_01_0006__en-us_topic_0183643042_en-us_topic_0183643042_section6679105711399"><h4 class="sectiontitle">Obtaining an Access Key</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_p157171154134613">To obtain an access key, perform the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088556.png"></span></div>
</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_note4554158201"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0006__en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
</div></div>
</li></ol>
</div>
</div>
<div class="section" id="dataartsstudio_01_0006__section134096463399"><a name="dataartsstudio_01_0006__section134096463399"></a><a name="section134096463399"></a><h4 class="sectiontitle">Obtaining a Project ID and Account ID</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001129537317_en-us_topic_0183643042_en-us_topic_0080205343_p491327619141">You can obtain the project ID and account ID by performing the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0006__en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0006__en-us_topic_0000001129537317_b196637155315">My Credentials</strong> page, obtain the account name and account ID, and obtain the project ID from the project list.</li></ol>
</div>
</div>
<div class="section" id="dataartsstudio_01_0006__section7883936162812"><h4 class="sectiontitle">Obtaining a <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text1341912581632">DataArts Studio</span> Instance ID and Workspace ID</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0183643042_en-us_topic_0080205343_p491327619141">To obtain a <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text13579131185313">DataArts Studio</span> instance ID and workspace ID, perform the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001150701582_ol6260200121819"><li id="dataartsstudio_01_0006__en-us_topic_0000001150701582_li19260803185">On the <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0187412481_text88021121155819">DataArts Studio</span> console, locate a workspace and click any module, such as <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b7656317547">Management Center</strong>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig11331320153513"><span class="figcap"><b>Figure 2 </b>Management Center</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0187412481_image6872534135313" src="en-us_image_0000001322408464.png"></span></div>
</li><li id="dataartsstudio_01_0006__en-us_topic_0000001150701582_li142601019186">On the <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b3771191016556">Management Center</strong> page, obtain the values of <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b896222919557">instanceId</strong> and <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b179506356556">workspace</strong> in the browser address bar, which are the instance ID and workspace ID, respectively.<div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_p187071943102319">As shown in <a href="#dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237">Figure 3</a>, the instance ID is <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b19386135392710">6b88…2688</strong>, and the workspace ID is <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b112256223275">1dd3bc…d93f0</strong>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237"><a name="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237"></a><a name="en-us_topic_0000001150701582_fig394214118237"></a><span class="figcap"><b>Figure 3 </b>Obtaining the instance ID and workspace ID</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001150701582_image446717368265" src="en-us_image_0000001322408456.png"></span></div>
</div>
</li></ol>
</div>
</div>
<div class="section" id="dataartsstudio_01_0006__section16737727193510"><h4 class="sectiontitle">Obtaining an Endpoint</h4><p id="dataartsstudio_01_0006__en-us_topic_0000001089114743_p15821453115417">An endpoint is the <strong id="dataartsstudio_01_0006__en-us_topic_0000001089114743_b3336611193312">request address</strong> for calling an API. Endpoints vary depending on services and regions.</p>
<p id="dataartsstudio_01_0006__en-us_topic_0000001089114743_p27115277328">You can obtain endpoints from <a href="https://docs.otc.t-systems.com/en-us/endpoint/index.html" target="_blank" rel="noopener noreferrer">Regions and Endpoints</a>.</p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0002.html">Preparations</a></div>
</div>
</div>

22
docs/dataartsstudio/umn/dataartsstudio_01_0008.html Normal file
View File

@ -0,0 +1,22 @@
<a name="dataartsstudio_01_0008"></a><a name="dataartsstudio_01_0008"></a>
<h1 class="topictitle1">Management Center</h1>
<div id="body1563878562399"><p id="dataartsstudio_01_0008__p93896421204"><span id="dataartsstudio_01_0008__text13876931108">DataArts Studio</span> Management Center provides a unified configuration and management entry for data connections and resource migration. Personalized entries and showcases can be customized as needed.</p>
</div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0005.html">Data Sources</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0009.html">Creating Data Connections</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0010.html">Migrating Resources</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0350.html">Tutorials</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0004.html">User Guide</a></div>
</div>
</div>

850
docs/dataartsstudio/umn/dataartsstudio_01_0009.html Normal file
View File

File diff suppressed because it is too large Load Diff

32
docs/dataartsstudio/umn/dataartsstudio_01_0010.html Normal file
View File

@ -0,0 +1,32 @@
<a name="dataartsstudio_01_0010"></a><a name="dataartsstudio_01_0010"></a>
<h1 class="topictitle1">Migrating Resources</h1>
<div id="body1564469667050"><p id="dataartsstudio_01_0010__p118481119122413">To migrate resources in one workspace to another, you can use the resource migration function provided by <span id="dataartsstudio_01_0010__text1084871952418">DataArts Studio</span>.</p>
<p id="dataartsstudio_01_0010__p1418713612214">The resources that can be migrated include the data connections created in Management Center.</p>
<div class="section" id="dataartsstudio_01_0010__section13321703214"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0010__ul1468814513610"><li id="dataartsstudio_01_0010__li1871417481229">Resource import and export depend on the OBS service.</li><li id="dataartsstudio_01_0010__li18688165861">There are resources that can be migrated. For details on how to create data connections, see <a href="dataartsstudio_01_0009.html">Creating Data Connections</a>.</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0010__section197713411677"><h4 class="sectiontitle">Constraints</h4><ul id="dataartsstudio_01_0010__ul8306105215815"><li id="dataartsstudio_01_0010__li29038123813">Imported and exported resources are stored in JSON format.</li><li id="dataartsstudio_01_0010__li138111155474">For security concerns, passwords of connections are not exported when the connections are exported. You need to enter the passwords when importing the connections.</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0010__section84691754394"><h4 class="sectiontitle">Exporting a Resource</h4><ol id="dataartsstudio_01_0010__ol1974812164274"><li class="msonormal" id="dataartsstudio_01_0010__li119271017161716">On the <span id="dataartsstudio_01_0010__en-us_topic_0187412481_text108883915434">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0010__en-us_topic_0187412481_b1993143916438">Management Center</strong>.<div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0187412481_fig11331320153513"><span class="figcap"><b>Figure 1 </b>Management Center</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0187412481_image6872534135313" src="en-us_image_0000001373087833.png"></span></div>
</li><li id="dataartsstudio_01_0010__li124671650203219">In the navigation pane, choose <strong id="dataartsstudio_01_0010__b89281489484">Migrate Resources</strong>.<div class="fignone" id="dataartsstudio_01_0010__fig112561281915"><span class="figcap"><b>Figure 2 </b>Migrating Resources</span><br><span><img id="dataartsstudio_01_0010__image1671344623510" src="en-us_image_0000001321928704.png"></span></div>
</li><li id="dataartsstudio_01_0010__li7215285277"><a name="dataartsstudio_01_0010__li7215285277"></a><a name="li7215285277"></a>Click <span class="wintitle" id="dataartsstudio_01_0010__wintitle8675185312140"><b>Create Export Task</b></span> to configure the file name and the OBS path for saving the file. If OBS is unavailable, you only need to set the file name.<div class="fignone" id="dataartsstudio_01_0010__fig173183613715"><span class="figcap"><b>Figure 3 </b>Export Task</span><br><span><img id="dataartsstudio_01_0010__image1360771419536" src="en-us_image_0000001322248296.png"></span></div>
</li><li id="dataartsstudio_01_0010__li143694518119">Click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol1886329111215"><b>Next</b></span> and select the resource to export.</li><li id="dataartsstudio_01_0010__li257513113410">Click <strong id="dataartsstudio_01_0010__b4361355191719">Next</strong> and wait until the export is complete. The resource package is exported to the OBS path set in <a href="#dataartsstudio_01_0010__li7215285277">3</a>. If OBS is unavailable, you can click <strong id="dataartsstudio_01_0010__b93891133182016">Download</strong> in the row of the corresponding migration task to download the exported resource package.<div class="fignone" id="dataartsstudio_01_0010__fig115243158274"><span class="figcap"><b>Figure 4 </b>Export completed</span><br><span><img id="dataartsstudio_01_0010__image726804155317" src="en-us_image_0000001373408421.png"></span></div>
<p id="dataartsstudio_01_0010__p4442736153913">If no result is displayed in 1 minute, the export fails. Try again. If the failure persists, contact <span id="dataartsstudio_01_0010__en-us_topic_0000001160798913_text1059016393531">the customer service or technical support</span>.</p>
</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0010__section3797132414396"><h4 class="sectiontitle">Importing a Resource</h4><ol id="dataartsstudio_01_0010__ol1932193713140"><li class="msonormal" id="dataartsstudio_01_0010__li19402146161414">On the <span id="dataartsstudio_01_0010__en-us_topic_0187412481_text108883915434_1">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0010__en-us_topic_0187412481_b1993143916438_1">Management Center</strong>.<div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0187412481_fig11331320153513_1"><span class="figcap"><b>Figure 5 </b>Management Center</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0187412481_image6872534135313_1" src="en-us_image_0000001373087833.png"></span></div>
</li></ol><ol start="2" id="dataartsstudio_01_0010__ol728918554018"><li id="dataartsstudio_01_0010__li16598101284011">In the navigation pane, choose <strong id="dataartsstudio_01_0010__en-us_topic_0182554812_b89281489484">Migrate Resources</strong>.<div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0182554812_fig112561281915"><span class="figcap"><b>Figure 6 </b>Migrating Resources</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0182554812_image1671344623510" src="en-us_image_0000001321928704.png"></span></div>
</li></ol><ol start="3" id="dataartsstudio_01_0010__ol1838411555525"><li id="dataartsstudio_01_0010__li193859550520">Click <span class="wintitle" id="dataartsstudio_01_0010__wintitle1597504811188"><b>Create Import Task</b></span> and configure the path for saving the resources to import. If no OBS bucket is available, select the resource package to be uploaded from a local path.<div class="fignone" id="dataartsstudio_01_0010__fig96755416444"><span class="figcap"><b>Figure 7 </b>Configuring the path for saving the resources to import</span><br><span><img id="dataartsstudio_01_0010__image364221285412" src="en-us_image_0000001373169033.png"></span></div>
</li><li id="dataartsstudio_01_0010__li538575513528">Click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol1930404651516"><b>Next</b></span> and select the resource to import.<div class="fignone" id="dataartsstudio_01_0010__fig887221622918"><span class="figcap"><b>Figure 8 </b>Selecting the resource to import</span><br><span><img id="dataartsstudio_01_0010__image18703304422" src="en-us_image_0000001373288737.png"></span></div>
</li><li id="dataartsstudio_01_0010__li184698455281">If you select <strong id="dataartsstudio_01_0010__b1151742615270">DataSource</strong>, click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol2080213318373"><b>Next</b></span> to configure a data connection. The number of data connections required is determined by the number of data sources. Each data connection requires a password.<div class="fignone" id="dataartsstudio_01_0010__fig13935181811416"><span class="figcap"><b>Figure 9 </b>Configuring a data connection</span><br><span><img id="dataartsstudio_01_0010__image135113918593" src="en-us_image_0000001322408284.png"></span></div>
</li><li id="dataartsstudio_01_0010__li7385155516525">Click <strong id="dataartsstudio_01_0010__b1421713356345">Next</strong> and wait until the import is complete.<div class="fignone" id="dataartsstudio_01_0010__fig1353193313612"><span class="figcap"><b>Figure 10 </b>Import completed</span><br><span><img id="dataartsstudio_01_0010__image20126135711015" src="en-us_image_0000001322088392.png"></span></div>
<p id="dataartsstudio_01_0010__p280162144815">If no result is displayed in 1 minute, the import fails. Try again. If the failure persists, contact <span id="dataartsstudio_01_0010__text788511384279">the customer service or technical support</span>.</p>
</li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0008.html">Management Center</a></div>
</div>
</div>

17
docs/dataartsstudio/umn/dataartsstudio_01_0011.html Normal file
View File

@ -0,0 +1,17 @@
<a name="dataartsstudio_01_0011"></a><a name="dataartsstudio_01_0011"></a>
<h1 class="topictitle1">Managing a Workspace</h1>
<div id="body0000001147533075"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0116_0.html">Creating and Managing a Workspace</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0530.html">(Optional) Changing the Job Log Storage Path</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0002.html">Preparations</a></div>
</div>
</div>

31
docs/dataartsstudio/umn/dataartsstudio_01_0012.html Normal file
View File

@ -0,0 +1,31 @@
<a name="dataartsstudio_01_0012"></a><a name="dataartsstudio_01_0012"></a>
<h1 class="topictitle1">DataArts Migration</h1>
<div id="body1563878452040"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0013.html">Overview</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0015.html">Constraints</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0014.html">Supported Data Sources</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0017.html">Managing Clusters</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0023.html">Managing Links</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0081.html">Managing Jobs</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0125.html">Auditing</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0086.html">Tutorials</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0110.html">Advanced Operations</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0004.html">User Guide</a></div>
</div>
</div>

31
docs/dataartsstudio/umn/dataartsstudio_01_0013.html Normal file
View File

@ -0,0 +1,31 @@
<a name="dataartsstudio_01_0013"></a><a name="dataartsstudio_01_0013"></a>
<h1 class="topictitle1">Overview</h1>
<div id="body1563878452040"><p id="dataartsstudio_01_0013__p4422519145022">DataArts Migration is an efficient and easy-to-use data integration service. Based on the big data migration to the cloud and intelligent data lake solutions, CDM provides easy-to-use migration capabilities and can integrate various types of data sources into the data lake, which simplifies data source migration and integration and improves efficiency for you.</p>
<p id="dataartsstudio_01_0013__p1159813425254">In this document, DataArts Migration refers to Cloud Data Migration (CDM).</p>
<p id="dataartsstudio_01_0013__p18432117154313">You can access the CDM console using either of the following methods:</p>
<ul id="dataartsstudio_01_0013__ul4673162874320"><li id="dataartsstudio_01_0013__li1767317284431">Log in to the CDM console and choose <strong id="dataartsstudio_01_0013__b149541440191516">Cluster Management</strong> in the navigation pane.</li><li id="dataartsstudio_01_0013__en-us_topic_0181028490_li586523263418">Log in to the <span id="dataartsstudio_01_0013__text14467155364413">DataArts Studio</span> console. Locate a workspace and click <strong id="dataartsstudio_01_0013__b10481157171519">DataArts Migration</strong>.<div class="fignone" id="dataartsstudio_01_0013__fig746051541519"><span class="figcap"><b>Figure 1 </b>DataArts Migration</span><br><span><img id="dataartsstudio_01_0013__image1841805814533" src="en-us_image_0000001373087921.png"></span></div>
</li></ul>
<div class="section" id="dataartsstudio_01_0013__en-us_topic_0108275398_section69302054123512"><h4 class="sectiontitle">Introduction to CDM</h4><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p52164437151344">CDM uses a distributed compute framework and concurrent processing techniques to help you migrate enterprise data in batches without any downtime and rapidly build desired data structures.</p>
<div class="fignone" id="dataartsstudio_01_0013__fig168071431636"><span class="figcap"><b>Figure 2 </b>CDM</span><br><span><img id="dataartsstudio_01_0013__image345113512419" src="en-us_image_0000001322407976.png"></span></div>
</div>
<div class="section" id="dataartsstudio_01_0013__en-us_topic_0108275398_section8948312133415"><h4 class="sectiontitle">Functions</h4><ul id="dataartsstudio_01_0013__en-us_topic_0108275398_ul20174521145718"><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li51745219571"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b13757734033">Table/file/entire DB migration</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p3767173325717">Tables or files can be migrated in batches. An entire database can be migrated between homogeneous and heterogeneous databases. A job can migrate hundreds of tables.</p>
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li123531673310"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b13373124715415">Incremental data migration</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p666246937">CDM supports incremental migration of files, relational databases, and HBase/CloudTable, as well as with WHERE clauses and macro variables of date and time.</p>
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li18121153121410"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b146831313172">Migration in transaction mode</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p1196391814157">When a CDM job fails to be executed, CDM rolls back the data to the state before the job starts and automatically deletes data from the destination table.</p>
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li7819113613719"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b137791531376">Field conversion</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p15186527581">CDM supports field conversion functions, such as anonymization, character string operations, and date operations.</p>
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li18055051710"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b167741619184818">File encryption</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p153840451179">When files are migrated to a file system, CDM can encrypt the files written to the cloud.</p>
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li163581165201"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b128166521987">MD5 verification</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p9320173318207">MD5 verification is supported to check the file consistency from end to end and output verification result.</p>
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li184661212911"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b4296182111012">Dirty data archiving</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p694465019919">CDM can archive the data that fails to be processed during migration, has been filtered out, or is not compliant with conversion or cleaning rules to dirty data logs. The threshold for dirty data ratio can be set to determine whether a task is successful.</p>
</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0013__section102647379456"><h4 class="sectiontitle">Migration Principles</h4><p class="msonormal" id="dataartsstudio_01_0013__en-us_topic_0163295208_p22430675">When a tenant uses CDM, the CDM system provisions a fully-managed CDM instance in the tenant's VPC. The instance allows only console and RESTful API access. Therefore the tenant cannot access the instance through other interfaces (such as SSH). This ensures data isolation between CDM tenants, prevents data leakage, and ensures transmission security during data migration between different cloud services in a VPC. Tenants can also use the VPN to migrate data from the on-premises data center to cloud services to ensure migration security.</p>
<p id="dataartsstudio_01_0013__en-us_topic_0163295208_p1908150154719">CDM works in push-pull mode. CDM pulls data from the migration source and pushes the data to the migration destination. Data access operations are initiated by CDM. SSL will be used if the data source (such as RDS) supports it. During the migration, the usernames and passwords of the migration source and destination are required. Such information is stored in the database of the CDM instance. Protecting such information is critical to ensure CDM security.</p>
<div class="fignone" id="dataartsstudio_01_0013__en-us_topic_0163295208_fig913012503618"><span class="figcap"><b>Figure 3 </b>Migration principles</span><br><span><img id="dataartsstudio_01_0013__en-us_topic_0163295208_image9828541123015" src="en-us_image_0000001322247992.png"></span></div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0012.html">DataArts Migration</a></div>
</div>
</div>

1710
docs/dataartsstudio/umn/dataartsstudio_01_0014.html Normal file
View File

File diff suppressed because it is too large Load Diff

72
docs/dataartsstudio/umn/dataartsstudio_01_0015.html Normal file
View File

@ -0,0 +1,72 @@
<a name="dataartsstudio_01_0015"></a><a name="dataartsstudio_01_0015"></a>
<h1 class="topictitle1">Constraints</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section41741324807"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1491912352113">CDM System Constraints</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol387012301638"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1687013307318">You cannot modify the flavor of an existing cluster. If you require a higher flavor, create a cluster with your desired flavor.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li348111171418">Arm CDM clusters do not support agents. The CDM cluster version (Arm or x86) is determined by the architecture of underlying resources.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li15870183017315">CDM does not support the function of controlling the data migration speed. Therefore, do not perform data migration during peak hours. </li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li114851637462">The baseline and maximum bandwidths of the NIC of the cdm.large CDM instance is 0.8 Gbit/s and 3 Gbit/s, respectively. The theoretical maximum volume of data that can be transmitted per instance per day is about 8 TB. Similarly, the baseline and maximum bandwidths of the NIC of the cdm.xlarge instance are 4 Gbit/s and 10 Gbit/s, respectively, and the theoretical maximum volume of data that can be transmitted per instance per day is about 40 TB. The baseline and maximum bandwidths of the NIC of the cdm.4xlarge instance is 36 Gbit/s and 40 Gbit/s, respectively, and the theoretical maximum volume of data that can be transmitted per instance per day is about 360 TB. You can use multiple CDM instances if you want faster data transfer.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_en-us_topic_0108275404_p1551615411466"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li114851637462"></a><a name="en-us_topic_0108275404_li114851637462"></a>The actual amount of data that can be migrated in a day depends on the data source type, the read and write performance of the source and destination, and the actual available bandwidth. Typically you can migrate as much as 8 TB per day (large file migration to OBS) using the cdm.large instance. It is recommended that you test the speed with a small amount of data before migration.</p>
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li758482013815">CDM supports incremental file migration (by skipping repeated files), but does not support resumable transfer.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p53495242813"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li758482013815"></a><a name="en-us_topic_0108275404_li758482013815"></a>For example, if three files are to be migrated and the second file fails to be migrated due to the network fault. When the migration task is started again, the first file is skipped. The second file, however, cannot be migrated from the point where the fault occurs, but can only be migrated again.</p>
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li195974311420">During file migration, a single task supports millions of files. If there are too many files in the directory to be migrated, you are advised to split the files into different directories and create multiple tasks.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li10481165219410">You can export links and jobs configured on CDM to a local directory. To ensure password security, CDM does not export the link password of the corresponding data source. Therefore, before importing job configurations to CDM, you need to manually input the password in the exported JSON file or configure the password in the import dialog box.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li374145718417">The cluster cannot automatically upgrade to a new version. You need to use the job export and import functions to upgrade the cluster to the new version.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li448111114516">If OBS is unavailable, CDM does not automatically back up users' job configurations. You need to export and back up configuration data using the export function.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li11946809112"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph207651219381">If VPC peering connection is configured, the peer VPC subnet may overlap with the CDM management network. As a result, data sources in the peer VPC cannot be accessed. You are advised to use the public network for cross-VPC data migration, or contact the administrator to add specific routes to the VPC peering connection in the CDM background.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li193610315569">If the destination of a CDM job is a DWS or NewSQL database, constraints of the source end, such as the primary key and unique index, cannot be migrated together.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li9139811175311">When performing a CDM job, ensure that the JSON file formats of the two clusters are the same so that jobs can be imported from the source cluster to the destination cluster.</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section18141628181814"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b129314716715">General Constraints on Database Migration</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol12131857191813"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li31317570181">CDM is mainly used for batch migration. It supports only limited incremental migration but does not support real-time incremental migration. </li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li192216218208">The entire DB migration of CDM supports only data table migration but not migration of database objects such as stored procedures, triggers, functions, and views.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p867452492013"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li192216218208"></a><a name="en-us_topic_0108275404_li192216218208"></a>CDM applies only to scenarios where databases are migrated to the cloud at a time, including homogeneous and heterogeneous database migrations. CDM is not applicable to data synchronization, for example, disaster recovery and real-time synchronization.</p>
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1431291119575">If CDM fails to migrate an entire database or table, the data that has been imported to the target table will not be rolled back automatically. If you want to perform migration in transaction mode, configure the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b925962425814">Import to Staging Table</strong> parameter to enable a rollback upon a migration failure.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p187345158577">In extreme cases, the created stage table or temporary table cannot be automatically deleted. You need to manually clear the table (the table name of the stage table ends with <span class="uicontrol" id="dataartsstudio_01_0015__en-us_topic_0108275404_uicontrol3737124419572"><b>_cdm_stage</b></span>), for example, <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b117791013173914">cdmtet_cdm_stage</strong>).</p>
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li6930205232919">If CDM needs to access data sources in the on-premises data center (for example, the on-premises MySQL database), the data sources must support Internet access and the CDM instances must be bound with elastic IP addresses. In this case, the security practice is to configure the firewall or security policies to allow only the EIPs of the CDM instances to access the local data sources.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li15135574183">Only common data types are supported, including character strings, digits, and dates. Object types are limited. If objects are too large, migration cannot be performed.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li18131570188">Only the GBK and UTF-8 character sets are supported.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1534605245718">A field name cannot contain &amp; and %.</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section77841851112219"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b3791114111588">Permissions Configuration for Relational Database Migration</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p114842486258">Common minimum permissions required by relational database migration:</p>
<ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul18115262318"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1281185216232">MySQL: You need to have the read permission on the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b128551223564">INFORMATION_SCHEMA</strong> database and data tables.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1082195262313">Oracle: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b58704595620">resource</strong> role and have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b2870185105610">select </strong>permissions on the data table in the tablespace.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1382195213239">Dameng: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1860684562">select any table</strong> permission in the schema.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li6821252102312">DWS: You need to have the<strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b11707172592910"> schema usage</strong> permission and the query permission on the data tables.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li2034017536810">SQL Server: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b37110560567">sysadmin</strong> permission.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li11341753586">PostgreSQL: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b109020145715">select</strong> permission on schema tables in the database.</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section1443661143314"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b88331756193">Constraints on FusionInsight HD and Apache Hadoop</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p102661957113315">If the FusionInsight HD and Apache Hadoop data sources are deployed in the on-premises data center, CDM must access all nodes in the cluster for reading and writing the Hadoop files. Therefore, the network access must be enabled for each node.</p>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section10533131115352"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b626717411286">Constraints on DWS and FusionInsight LibrA</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol123656567357"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1036535610357"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph896020457565">If the DWS primary key or table contains only one field, the field type must be a common character string, value, or date. When data is migrated from another database to DWS, if automatic table creation is selected, the primary key must be of the following types. If no primary key is set, at least one of the following fields must be set. Otherwise, the table cannot be created and the CDM job fails.</span><ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul19587148144414"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li178061658447">INTEGER TYPES: TINYINT, SMALLINT, INT, BIGINT, NUMERIC/DECIMAL</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li13513127191516">CHARACTER TYPES: CHAR, BPCHAR, VARCHAR, VARCHAR2, NVARCHAR2, TEXT</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li17722183661616">DATA/TIME TYPES: DATE, TIME, TIMETZ, TIMESTAMP, TIMESTAMPTZ, INTERVAL, SMALLDATETIME</li></ul>
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1987905110177">In DWS, the character string <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b4284165153511">''</strong> is null. A null character string cannot be inserted into a field with non-null constraints. This is inconsistent with the MySQL behavior. MySQL does not consider that <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b9349145113618">''</strong> is null. Migration from MySQL to DWS may fail due to the preceding reason.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1270919093612">When the Gauss Data Service (GDS) mode is used to quickly import data to DWS, you need to configure a security group or firewall policy to allow DataNodes of DWS or FusionInsight LibrA to access port 25000 of the CDM IP address.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li18441396234">When data is imported to DWS in GDS mode, CDM automatically creates a foreign table for data import. The table name ends with a universally unique identifier (UUID), for example, <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1738395918464">cdmtest_aecf3f8n0z73dsl72d0d1dk4lcir8cd</strong>. If a job fails, it will be automatically deleted. In extreme cases, you may need to manually delete it.</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section131751236114113"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1247420243517">Constraints on OBS</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol176601786429"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1466017814424">During file migration, the system automatically transfers the files concurrently. In this case, <span class="parmname" id="dataartsstudio_01_0015__en-us_topic_0108275404_parmname947762785413"><b>Concurrent Extractors</b></span> in the task configuration is invalid.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li156608874212">Resumable transfer is not supported. If CDM fails to transfer files, OBS fragments are generated. You need to clear fragments on the OBS console to prevent space occupation.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1523372310451">CDM does not support the versioning control function of OBS.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li13634124513265">During incremental migration, the number of files or objects in the source directory of a single job depends on the CDM cluster flavor. A cdm.large cluster supports a maximum of 300,000 files; a cdm.medium cluster supports a maximum of 200,000 files; and a cdm.small cluster supports a maximum of 100,000 files.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p640449202611"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li13634124513265"></a><a name="en-us_topic_0108275404_li13634124513265"></a>If the number of files or objects in a single directory exceeds the upper limit, split the files or objects into multiple migration jobs based on subdirectories.</p>
</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section15854191754519"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b43946117137">Constraints on Oracle</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p82495121013">Real-time incremental data synchronization is not supported for Oracle databases.</p>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section66348560505"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b192601931173213">Constraints on DCS and Redis</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol0306417135117"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li193061517145115"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph27081439382">Because DCS restricts the commands for obtaining keys, it cannot serve as the migration source but can be the migration destination. The Redis service of the third-party cloud cannot serve as the migration source. However, the Redis set up in the on-premises data center or on the ECS can be the migration source and destination.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li730631785115">Only the hash and string data formats are supported.</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section15580101719556"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b163681082391">Constraints on DDS and MongoDB</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p64431955112453">When you migrate MongoDB or DDS data, CDM reads the first row of the collection as an example of the field list. If the first row of data does not contain all fields of the collection, you need to manually add fields.</p>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section025745712566"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b147847012593">Constraints on CSS and Elasticsearch</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol14851131810571"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li98511118165718"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph242542775916">CDM supports automatic creation of indexes and field types. The index and field type names can contain only lowercase letters.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li182501926095">You cannot modify the field type under an index after it is created, but only create another field.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p59433218916"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li182501926095"></a><a name="en-us_topic_0108275404_li182501926095"></a>If you need to modify the field type, you need to create an index or run the Elasticsearch command on Kibana to delete the existing index and create another index (the data is also deleted).</p>
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1631018351974">When the field type of the index created by CDM is date, the data format must be <em id="dataartsstudio_01_0015__en-us_topic_0108275404_i62199366527">yyyy-MM-dd HH:mm:ss.SSS Z</em>. For example, <span class="parmvalue" id="dataartsstudio_01_0015__en-us_topic_0108275404_parmvalue13548164914523"><b>2018-08-08 08:08:08.888 +08:00</b></span>.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p11165161042018">During data migration to CSS, if the original data of the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b16976103125311">date</strong> field does not meet the format requirements, you can use the expression conversion function of CDM to convert the data to the preceding format.</p>
</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section797519552109"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b550619462313">Constraints on Kafka</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol841312442116"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li2041334471114"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph28693044211">The data in the message body is a record in CSV format that supports multiple delimiters. Messages cannot be parsed in binary or other formats.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section19323131416133"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b7886141961015">Constraints on CloudTable and HBase</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol196986359136"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li469815359134">When you migrate data from CloudTable or HBase, CDM reads the first row of the table as an example of the field list. If the first row of data does not contain all fields of the table, you need to manually add fields.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li156983351133">Because HBase is schema-less, CDM cannot obtain the data types. If the data is stored in binary format, CDM cannot parse the data.</li></ol>
</div>
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section1557962192010"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b118512401114">Constraints on Hive</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p18581321182015"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph11446155313540">When Hive serves as the migration destination, if the storage format is TEXTFILE, delimiters must be explicitly specified in the statement for creating Hive tables. The following gives an example:</span></p>
<pre class="screen" id="dataartsstudio_01_0015__en-us_topic_0108275404_screen371715213715">CREATE TABLE csv_tbl(
smallint_value smallint,
tinyint_value tinyint,
int_value int,
bigint_value bigint,
float_value float,
double_value double,
decimal_value decimal(9, 7),
timestmamp_value timestamp,
date_value date,
varchar_value varchar(100),
string_value string,
char_value char(20),
boolean_value boolean,
binary_value binary,
varchar_null varchar(100),
string_null string,
char_null char(20),
int_null int
)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
WITH SERDEPROPERTIES (
"separatorChar" = "\t",
"quoteChar" = "'",
"escapeChar" = "\\"
)
STORED AS TEXTFILE;</pre>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0012.html">DataArts Migration</a></div>
</div>
</div>

27
docs/dataartsstudio/umn/dataartsstudio_01_0017.html Normal file
View File

@ -0,0 +1,27 @@
<a name="dataartsstudio_01_0017"></a><a name="dataartsstudio_01_0017"></a>
<h1 class="topictitle1">Managing Clusters</h1>
<div id="body8662426"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0576.html">Creating a CDM Cluster</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0020.html">Binding or Unbinding an EIP</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0578.html">Restarting a Cluster</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0579.html">Deleting a Cluster</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0022.html">Downloading Cluster Logs</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0021.html">Viewing Basic Cluster Information and Modifying Cluster Configurations</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0121.html">Viewing Metrics</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0012.html">DataArts Migration</a></div>
</div>
</div>

23
docs/dataartsstudio/umn/dataartsstudio_01_0020.html Normal file
View File

@ -0,0 +1,23 @@
<a name="dataartsstudio_01_0020"></a><a name="dataartsstudio_01_0020"></a>
<h1 class="topictitle1">Binding or Unbinding an EIP</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0020__en-us_topic_0108275471_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0020__en-us_topic_0108275471_p742920411259">After creating a CDM cluster, you can bind an EIP to or unbind an EIP from the cluster. </p>
<ul id="dataartsstudio_01_0020__en-us_topic_0108275471_ul4655334132618"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li176555345263">If CDM needs to access a local or Internet data source, or a cloud service in another VPC, bind an EIP to the CDM cluster or use a NAT gateway to enable the CDM cluster to share the EIP with ECSs to access the Internet..</li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li397235713214">To create an EIP exception notification, choose <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b34407229500">Authorize EIP Check</strong> &gt; <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b199901434155016">Create Agency</strong> on the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b197769479515">Cluster Management</strong> page. The EIP exception notification takes effect only after the VPC policy agency of the corresponding region is created on the IAM management console.</li></ul>
<div class="note" id="dataartsstudio_01_0020__en-us_topic_0108275471_note13181556123416"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0020__en-us_topic_0108275471_en-us_topic_0108275298_p1693084519332">If SSL encryption is configured for the access channel of a local data source, CDM cannot connect to the data source using the EIP.</p>
</div></div>
</div>
<div class="section" id="dataartsstudio_01_0020__en-us_topic_0108275471_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0020__en-us_topic_0108275471_ul3448175015190"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li2479787415190">You have created a CDM cluster.</li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li3269623515192">Your EIP quota is sufficient.</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0020__en-us_topic_0108275471_section1674818115330"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0020__en-us_topic_0108275471_ol4602013152046"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li418244016821"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol136837859815540"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0020__en-us_topic_0108275471_fig4803125133011"><span class="figcap"><b>Figure 1 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0020__en-us_topic_0108275471_image1746819721017" src="en-us_image_0000001322088024.png"></span></div>
<div class="note" id="dataartsstudio_01_0020__en-us_topic_0108275471_note5185181692417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0020__en-us_topic_0108275471_p1186131612417">The <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b1623437165310">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b6281837165318">DataArts Migration</strong> page from the DataArts Studio console.</p>
</div></div>
</p></li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li0189204285419"><span>Bind an EIP to or unbind an EIP from a cluster.</span><p><ul id="dataartsstudio_01_0020__en-us_topic_0108275471_ul10803195193010"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li13803175193019">Binding an EIP: In the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b2015317258420">Operation</strong> column, click <span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol1415352524218"><b>Bind EIP</b></span>. The <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b10153182516423">Bind EIP</strong> dialog box is displayed.</li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li241312592392">Unbinding an EIP: In the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b298793728141839">Operation</strong> column, choose <span class="menucascade" id="dataartsstudio_01_0020__en-us_topic_0108275471_menucascade323504945141742"><b><span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol2130511470141742">More</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol2037634173141742">Unbind EIP</span></b></span>.</li></ul>
</p></li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li33887024151727"><span>Click <span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol917090064153628"><b>Yes</b></span>.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
</div>
</div>

34
docs/dataartsstudio/umn/dataartsstudio_01_0021.html Normal file
View File

@ -0,0 +1,34 @@
<a name="dataartsstudio_01_0021"></a><a name="dataartsstudio_01_0021"></a>
<h1 class="topictitle1">Viewing Basic Cluster Information and Modifying Cluster Configurations</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0021__en-us_topic_0108275372_p13184211124520">After creating a CDM cluster, you can view its basic information and modify its configurations.</p>
<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul19578141918455"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1177617222457">You can view the following basic cluster information:<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul34505418485"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li49551248144815">Cluster information: cluster version, creation time, project ID, instance ID, and cluster ID</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li13938113919488">Instance configuration: cluster flavor, CPU, and memory</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1691813454916">Network configuration</li></ul>
</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li357841917454">You can modify the following cluster configurations:<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul12517341719"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li65133411112">Notification: If a CDM migration job (only table/file migration) fails or the EIP is abnormal, CDM sends an SMS or email notification to the user. </li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1451163419115">User isolation: determines whether other users can operate the migration jobs or links in the cluster.<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul185117349120"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1751534315">If this function is enabled, migration jobs and links in the cluster are isolated. Other IAM users of the <span id="dataartsstudio_01_0021__en-us_topic_0108275372_text145133410115">cloud platform account</span> cannot operate the jobs and links.</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li55114348115">If this function is disabled, migration jobs and links in the cluster can be shared by users. All IAM users with the required permission in the <span id="dataartsstudio_01_0021__en-us_topic_0108275372_text1943484611425">cloud platform account</span> can view and perform operations on the jobs and links in the cluster.<p id="dataartsstudio_01_0021__en-us_topic_0108275372_p1651153414114">After disabling <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b996710202447">User Isolation</strong>, restart the cluster VM for the settings to take effect.</p>
</li></ul>
</li></ul>
</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><p id="dataartsstudio_01_0021__en-us_topic_0108275372_p33513853111130">You have created a CDM cluster.</p>
</div>
<div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section1674818115330"><h4 class="sectiontitle">Viewing Basic Cluster Information</h4><ol id="dataartsstudio_01_0021__en-us_topic_0108275372_ol4602013152046"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li35890017143134"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_uicontrol136837859815540"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_fig4803125133011"><span class="figcap"><b>Figure 1 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_image1746819721017" src="en-us_image_0000001322088024.png"></span></div>
<div class="note" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_note5185181692417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_p1186131612417">The <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b1623437165310">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b6281837165318">DataArts Migration</strong> page from the DataArts Studio console.</p>
</div></div>
</p></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li16142765310"><span>Click the cluster name to view its basic information.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_fig32088426113643"><span class="figcap"><b>Figure 2 </b>Basic cluster information</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_image1392813198346" src="en-us_image_0000001321929596.png"></span></div>
<p id="dataartsstudio_01_0021__en-us_topic_0108275372_p1988954512340"></p>
</p></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section8304145665316"><h4 class="sectiontitle">Modifying Cluster Configurations</h4><ol id="dataartsstudio_01_0021__en-us_topic_0108275372_ol1999165225516"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li16425756115512"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_uicontrol136837859815540_1"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_fig4803125133011_1"><span class="figcap"><b>Figure 3 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_image1746819721017_1" src="en-us_image_0000001322088024.png"></span></div>
<div class="note" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_note5185181692417_1"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_p1186131612417_1">The <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b1623437165310_1">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b6281837165318_1">DataArts Migration</strong> page from the DataArts Studio console.</p>
</div></div>
</p></li></ol><ol start="2" id="dataartsstudio_01_0021__en-us_topic_0108275372_ol893465814539"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li2934258175315"><span>Click the name of a cluster and click the <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol2402161110415"><b>Cluster Configuration</b></span> tab to modify <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b186144359423">Notification</strong> and <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b20647429104215">User Isolation</strong> configuration.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_fig149343582538"><span class="figcap"><b>Figure 4 </b>Modifying cluster configurations</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_image826463916352" src="en-us_image_0000001373409313.png"></span></div>
</p></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li16934258135318"><span>Click <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol191388974921518"><b>Save</b></span>. The <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b148848311621518">Cluster Management</strong> page is displayed.</span></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li12934195818537"><span>If <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b119183067121518">User Isolation</strong> is disabled, choose <span class="menucascade" id="dataartsstudio_01_0021__en-us_topic_0108275372_menucascade54419951821518"><b><span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol82627482221518">More</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol11172047021518">Restart</span></b></span> in the <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b23573550421518">Operation</strong> column to restart the cluster VM for the settings to take effect.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_fig159341758205317"><span class="figcap"><b>Figure 5 </b>Restarting a cluster</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_image139341458125315" src="en-us_image_0000001373087905.png"></span></div>
<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul293411589531"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li199341458205313"><strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b664218019278">Restart CDM service process</strong>: Only the CDM service process is restarted. The cluster VM will not be restarted.</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li49341958125318"><strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b84235270615490">VM restart</strong>: The service process will be interrupted and VMs in the cluster will be restarted.</li></ul>
</p></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1093410587539"><span>Select <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol1876751918166"><b>VM restart</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol1010382481610"><b>Yes</b></span>.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
</div>
</div>

20
docs/dataartsstudio/umn/dataartsstudio_01_0022.html Normal file
View File

@ -0,0 +1,20 @@
<a name="dataartsstudio_01_0022"></a><a name="dataartsstudio_01_0022"></a>
<h1 class="topictitle1">Downloading Cluster Logs</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0022__en-us_topic_0108275415_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0022__en-us_topic_0108275415_p533529515256">This section describes how to obtain cluster logs to view the job running history and locate job failure causes.</p>
</div>
<div class="section" id="dataartsstudio_01_0022__en-us_topic_0108275415_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><p id="dataartsstudio_01_0022__en-us_topic_0108275415_p33513853111130">You have created a CDM cluster.</p>
</div>
<div class="section" id="dataartsstudio_01_0022__en-us_topic_0108275415_section1674818115330"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0022__en-us_topic_0108275415_ol6681758181820"><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li35890017143134"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_uicontrol136837859815540"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_fig4803125133011"><span class="figcap"><b>Figure 1 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_image1746819721017" src="en-us_image_0000001322088024.png"></span></div>
<div class="note" id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_note5185181692417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_p1186131612417">The <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_b1623437165310">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_b6281837165318">DataArts Migration</strong> page from the DataArts Studio console.</p>
</div></div>
</p></li></ol><ol start="2" id="dataartsstudio_01_0022__en-us_topic_0108275415_ol4602013152046"><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li4368748394623"><span>Locate the row that contains a cluster, click <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b1674594319426">More</strong> in the <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b715115534425">Operation</strong> column, and select <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b1425998431">Download Log</strong> from the drop-down list.</span><p><div class="fignone" id="dataartsstudio_01_0022__en-us_topic_0108275415_fig159341758205317"><span class="figcap"><b>Figure 2 </b>Download Log</span><br><span><img id="dataartsstudio_01_0022__en-us_topic_0108275415_image1359985320200" src="en-us_image_0000001322088076.png"></span></div>
</p></li><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li209131722132014"><span>In the displayed dialog box, click <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b01985196448">OK</strong> to download logs to a local PC.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
</div>
</div>

59
docs/dataartsstudio/umn/dataartsstudio_01_0023.html Normal file
View File

@ -0,0 +1,59 @@
<a name="dataartsstudio_01_0023"></a><a name="dataartsstudio_01_0023"></a>
<h1 class="topictitle1">Managing Links</h1>
<div id="body8662426"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0024.html">Creating Links</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0132.html">Managing Drivers</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0128.html">Managing Agents</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1096.html">Managing Cluster Configurations</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0044.html">Link to a Common Relational Database</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1214.html">Link to a Database Shard</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1211.html">Link to a MySQL Database</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1212.html">Link to an Oracle Database</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0036.html">Link to DLI</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0026.html">Link to Hive</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0039.html">Link to HBase</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0040.html">Link to HDFS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0045.html">Link to OBS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0028.html">Link to an FTP or SFTP Server</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0032.html">Link to Redis/DCS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0031.html">Link to DDS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0027.html">Link to CloudTable</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0037.html">Link to CloudTable OpenTSDB</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0030.html">Link to MongoDB</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_004501.html">Link to Cassandra</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0033.html">Link to Kafka</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0038.html">Link to DMS Kafka</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0035.html">Link to Elasticsearch/CSS</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0012.html">DataArts Migration</a></div>
</div>
</div>

138
docs/dataartsstudio/umn/dataartsstudio_01_0024.html Normal file
View File

File diff suppressed because it is too large Load Diff

323
docs/dataartsstudio/umn/dataartsstudio_01_0026.html Normal file
View File

File diff suppressed because it is too large Load Diff

84
docs/dataartsstudio/umn/dataartsstudio_01_0027.html Normal file
View File

@ -0,0 +1,84 @@
<a name="dataartsstudio_01_0027"></a><a name="dataartsstudio_01_0027"></a>
<h1 class="topictitle1">Link to CloudTable</h1>
<div id="body8662426"><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p59722913113957">When connecting CDM to CloudTable, configure the parameters as described in <a href="#dataartsstudio_01_0027__en-us_topic_0108275355_table34037531171418">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0027__en-us_topic_0108275355_table34037531171418"></a><a name="en-us_topic_0108275355_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0027__en-us_topic_0108275355_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="17.5%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p23659124171418">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.650000000000006%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p37340867171418">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.849999999999998%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p4711375171418">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row46077055171418"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p41253947171418">Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p42147213114142">cloudtable_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row19710159171418"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p62657656114131">ZK Link</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p31524870114139">Obtain this parameter value from the cluster management page of CloudTable.</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p4536548114142">cloudtable-cdm-zk1.cloudtable.com:2181,cloudtable-cdm-zk2.cloudtable.com:2181</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row7494172615386"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p14496102663811">IAM Authentication</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1712015325114">If IAM authentication is enabled for the CloudTable cluster to be connected, set this parameter to <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_b1498603518145">Yes</strong>. Otherwise, set this to <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_b81834411413">No</strong>.</p>
<p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1849619268381">If you select <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_b69911404304">Yes</strong>, enter the username, AK, and SK.</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p12496926183816">No</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row1795014420394"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p14952184416394">Username</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p13952124417392">Username used for accessing the CloudTable cluster</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p6952644143912">admin</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row35276451399"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1552720455396">AK</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p8527134543910">AK for accessing the CloudTable cluster.</p>
<p id="dataartsstudio_01_0027__en-us_topic_0108275355_p2396698815212">You need to create an access key for the current account and obtain an AK/SK pair.</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1152794519391">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row16131546183916"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p41344611390">SK</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p813194633919">SK for accessing the CloudTable cluster.</p>
<p id="dataartsstudio_01_0027__en-us_topic_0108275355_p01204209218">You need to create an access key for the current account and obtain an AK/SK pair.</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p21316464393">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row1474555371514"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1386613414718">Use Cluster Config</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p188661341078">You can use the cluster configuration to simplify parameter settings for the Hadoop connection.</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p986610420717">No</p>
</td>
</tr>
<tr id="dataartsstudio_01_0027__en-us_topic_0108275355_row3953125531519"><td class="cellrowborder" valign="top" width="17.5%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p20866946711">Cluster Config Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.650000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p15866341979">This parameter is valid only when <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_en-us_topic_0108618545_b762945800105248">Use Cluster Config</strong> is set to <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_en-us_topic_0108618545_b1557791163105248">Yes</strong>. Select a cluster configuration that has been created.</p>
<p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1786610418710">For details, see <a href="dataartsstudio_01_1096.html">Managing Cluster Configurations</a>.</p>
</td>
<td class="cellrowborder" valign="top" width="20.849999999999998%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0027__en-us_topic_0108275355_p1210410291174">hadoop_01</p>
</td>
</tr>
</tbody>
</table>
</div>
<p id="dataartsstudio_01_0027__en-us_topic_0108275355_p8119146192913">Click <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_en-us_topic_0108618545_b141941925616">Show Advanced Attributes</strong>, and then click <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_en-us_topic_0108618545_b7127311869">Add</strong> to add configuration attributes of other clients. The name and value of each attribute must be configured. You can click <strong id="dataartsstudio_01_0027__en-us_topic_0108275355_en-us_topic_0108618545_b83443253616">Delete</strong> to delete no longer used attributes.</p>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

61
docs/dataartsstudio/umn/dataartsstudio_01_0028.html Normal file
View File

@ -0,0 +1,61 @@
<a name="dataartsstudio_01_0028"></a><a name="dataartsstudio_01_0028"></a>
<h1 class="topictitle1">Link to an FTP or SFTP Server</h1>
<div id="body8662426"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p1616721175217">The FTP/SFTP link is used to migrate files from the on-premises file server or ECS to database.</p>
<div class="note" id="dataartsstudio_01_0028__en-us_topic_0108275400_note193108573515"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p183106578514">Only FTP servers running Linux are supported.</p>
</div></div>
<div class="p" id="dataartsstudio_01_0028__en-us_topic_0108275400_p404591711373">When connecting CDM to an FTP or SFTP server, configure the parameters as described in <a href="#dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418">Table 1</a>.
<div class="tablenoborder"><a name="dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418"></a><a name="en-us_topic_0108275400_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.060000000000002%" id="mcps1.3.3.2.2.4.1.1"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p23659124171418">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.31999999999999%" id="mcps1.3.3.2.2.4.1.2"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p37340867171418">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.62%" id="mcps1.3.3.2.2.4.1.3"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p4711375171418">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row9394134114537"><td class="cellrowborder" valign="top" width="18.060000000000002%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p4394104110532">Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p739484115530">ftp_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row46077055171418"><td class="cellrowborder" valign="top" width="18.060000000000002%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p41253947171418">Host Name/IP Address</p>
</td>
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p53235436171418">Host name or IP address of the FTP or SFTP server</p>
</td>
<td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p17103098171418">ftp.apache.org</p>
</td>
</tr>
<tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row19710159171418"><td class="cellrowborder" valign="top" width="18.060000000000002%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p53019059171418">Port</p>
</td>
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p66685350171418">Port number of the FTP or SFTP server, which is 21 by default</p>
</td>
<td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p32804307171418">21</p>
</td>
</tr>
<tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row26803310171418"><td class="cellrowborder" valign="top" width="18.060000000000002%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p23584482171418">Username</p>
</td>
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p31294883171418">Username used for logging in to the FTP or SFTP server</p>
</td>
<td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p39712809171418">cdm</p>
</td>
</tr>
<tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row21870968171418"><td class="cellrowborder" valign="top" width="18.060000000000002%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p26718016171418">Password</p>
</td>
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p16675672171418">Password used for logging in to the FTP or SFTP server</p>
</td>
<td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p8552168171418">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

59
docs/dataartsstudio/umn/dataartsstudio_01_0030.html Normal file
View File

@ -0,0 +1,59 @@
<a name="dataartsstudio_01_0030"></a><a name="dataartsstudio_01_0030"></a>
<h1 class="topictitle1">Link to MongoDB</h1>
<div id="body8662426"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p868619161103">This link is used to transfer data from a third-party cloud MongoDB service or MongoDB created in the on-premises data center or ECS to a big data platform.</p>
<p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1471816353573">When connecting CDM to an on-premises MongoDB database, configure the parameters as described in <a href="#dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418"></a><a name="en-us_topic_0108275382_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p23659124171418">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="60.540000000000006%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p37340867171418">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.28%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p4711375171418">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row148131718155810"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1081471865814">Name</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1981416180585">mongodb_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row19710159171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p62657656114131">Server List</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p733031416592">List of MongoDB server addresses. Enter each address in the format of <em id="dataartsstudio_01_0030__en-us_topic_0108275382_i1991794965716">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0030__en-us_topic_0108275382_i392284911579">port number</em>, and separate the entered addresses with semicolons (;).</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
</td>
</tr>
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row11588738102344"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p66272570102344">Database Name</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p66477930102344">Name of the MongoDB database to be connected</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p16003259102344">DB_mongodb</p>
</td>
</tr>
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row35421096102350"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p50536504102350">Username</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p5438008102436">Username for logging in to MongoDB</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p52218594102350">cdm</p>
</td>
</tr>
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row21870968171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p26718016171418">Password</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p5950554015418">Password for logging in to MongoDB</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p38901992114142">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

59
docs/dataartsstudio/umn/dataartsstudio_01_0031.html Normal file
View File

@ -0,0 +1,59 @@
<a name="dataartsstudio_01_0031"></a><a name="dataartsstudio_01_0031"></a>
<h1 class="topictitle1">Link to DDS</h1>
<div id="body8662426"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p175011321165416">The DDS link is used to synchronize data from Document Database Service (DDS) on <span id="dataartsstudio_01_0031__en-us_topic_0173586864_text1085374545910">cloud</span> to a big data platform.</p>
<p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1471816353573">When connecting CDM to DDS, configure the parameters as described in <a href="#dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418"></a><a name="en-us_topic_0173586864_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DDS link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.509999999999998%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p23659124171418">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.309999999999995%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p37340867171418">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.18%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p4711375171418">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row148131718155810"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1081471865814">Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1981416180585">dds_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row19710159171418"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p62657656114131">Server List</p>
</td>
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p733031416592">List of server addresses. Enter each address in the format of <em id="dataartsstudio_01_0031__en-us_topic_0173586864_i7949144516352">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0031__en-us_topic_0173586864_i14949345193515">port number</em>, and separate the entered addresses with semicolons (;).</p>
</td>
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
</td>
</tr>
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row11588738102344"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p66272570102344">Database Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p66477930102344">Name of the DDS database to be connected</p>
</td>
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p16003259102344">DB_dds</p>
</td>
</tr>
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row35421096102350"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p50536504102350">Username</p>
</td>
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p5438008102436">Username used for logging in to DDS</p>
</td>
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p52218594102350">cdm</p>
</td>
</tr>
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row21870968171418"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p26718016171418">Password</p>
</td>
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p5950554015418">Password used for logging in to DDS</p>
</td>
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p38901992114142">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

62
docs/dataartsstudio/umn/dataartsstudio_01_0032.html Normal file
View File

@ -0,0 +1,62 @@
<a name="dataartsstudio_01_0032"></a><a name="dataartsstudio_01_0032"></a>
<h1 class="topictitle1">Link to Redis/DCS</h1>
<div id="body8662426"><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p1746173925518">The Redis link is applicable to data migration of Redis created in the local data center or ECS. It is used to load data in the database or files to Redis.</p>
<p id="dataartsstudio_01_0032__en-us_topic_0108275391_p109904012553">The DCS link is used to load data from databases or files to Distributed Cache Service (DCS) on <span id="dataartsstudio_01_0032__en-us_topic_0108275391_text1751614213014">cloud</span>. You are advised to use backup and restoration to migrate data from the third-party cloud Redis services to DCS.</p>
<p id="dataartsstudio_01_0032__en-us_topic_0108275391_p840683413016">When connecting CDM to an on-premises Redis database or DCS, configure the parameters as described in <a href="#dataartsstudio_01_0032__en-us_topic_0108275391_table34037531171418">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0032__en-us_topic_0108275391_table34037531171418"></a><a name="en-us_topic_0108275391_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0032__en-us_topic_0108275391_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0032__en-us_topic_0108275391_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.62%" id="mcps1.3.4.2.4.1.1"><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p23659124171418">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.53999999999999%" id="mcps1.3.4.2.4.1.2"><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p37340867171418">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.84%" id="mcps1.3.4.2.4.1.3"><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p4711375171418">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0032__en-us_topic_0108275391_row197082015910"><td class="cellrowborder" valign="top" width="18.62%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p1670891512118">Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.53999999999999%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p370819159116">redis_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0032__en-us_topic_0108275391_row42099350112430"><td class="cellrowborder" valign="top" width="18.62%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p54604217112430">Redis Deployment Method</p>
</td>
<td class="cellrowborder" valign="top" width="61.53999999999999%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p45863417112646">Two deployment methods are available:</p>
<ul id="dataartsstudio_01_0032__en-us_topic_0108275391_ul54257378112542"><li id="dataartsstudio_01_0032__en-us_topic_0108275391_li40111052112546"><strong id="dataartsstudio_01_0032__en-us_topic_0108275391_b842352706174911">Single</strong>: installation on a single-node system</li><li id="dataartsstudio_01_0032__en-us_topic_0108275391_li16350282112542"><strong id="dataartsstudio_01_0032__en-us_topic_0108275391_b842352706174957">Cluster</strong>: installation on a cluster</li><li id="dataartsstudio_01_0032__en-us_topic_0108275391_li133115440368"><strong id="dataartsstudio_01_0032__en-us_topic_0108275391_b433310256565">Proxy</strong>: installation using a proxy</li></ul>
</td>
<td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p31153255112430">Single</p>
</td>
</tr>
<tr id="dataartsstudio_01_0032__en-us_topic_0108275391_row19710159171418"><td class="cellrowborder" valign="top" width="18.62%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p62657656114131">Redis Server List</p>
</td>
<td class="cellrowborder" valign="top" width="61.53999999999999%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p3224914515418">List of MongoDB server addresses. Enter each address in the format of <em id="dataartsstudio_01_0032__en-us_topic_0108275391_en-us_topic_0108275382_i1991794965716">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0032__en-us_topic_0108275391_en-us_topic_0108275382_i392284911579">port number</em>, and separate the entered addresses with semicolons (;).</p>
</td>
<td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
</td>
</tr>
<tr id="dataartsstudio_01_0032__en-us_topic_0108275391_row21870968171418"><td class="cellrowborder" valign="top" width="18.62%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p26718016171418">Password</p>
</td>
<td class="cellrowborder" valign="top" width="61.53999999999999%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p5950554015418">Password used for logging in to Redis</p>
</td>
<td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p38901992114142">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0032__en-us_topic_0108275391_row46725475164948"><td class="cellrowborder" valign="top" width="18.62%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p26667143164948">Redis Database Index</p>
</td>
<td class="cellrowborder" valign="top" width="61.53999999999999%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p12554938164948">Index ID of a Redis database</p>
<p id="dataartsstudio_01_0032__en-us_topic_0108275391_p382084353413">A Redis database is similar to a relational database. The total number of Redis databases can be set in the Redis configuration file. By default, there are 16 Redis databases. The database names are integers ranging from 0 to 15 instead of character strings.</p>
</td>
<td class="cellrowborder" valign="top" width="19.84%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0032__en-us_topic_0108275391_p10317095164948">0</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

94
docs/dataartsstudio/umn/dataartsstudio_01_0033.html Normal file
View File

@ -0,0 +1,94 @@
<a name="dataartsstudio_01_0033"></a><a name="dataartsstudio_01_0033"></a>
<h1 class="topictitle1">Link to Kafka</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0033__en-us_topic_0108275385_section8886729122818"><h4 class="sectiontitle">MRS Kafka</h4><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1822602317293">When connecting CDM to Kafka of MRS, configure the parameters as described in <a href="#dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020"></a><a name="en-us_topic_0108275385_table3104110173020"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020" frame="border" border="1" rules="all"><caption><b>Table 1 </b>MRS Kafka link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row9104908308"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.1.3.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5104190113020">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.1.3.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p181045015309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b842352706191716">Description</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.1.3.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p810450163019"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b842352706173959">Example Value</strong></p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110420173014"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1510415063017">Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p116413181186">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p91041304307">kafka_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row11045013017"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p121041208302">Manager IP</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p6104305303">Floating IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_uicontrol578864992012"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_b2078834920203">Manager IP</strong> text box to select an MRS cluster. CDM automatically fills in the authentication information.</p>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1210414014308">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110417013011"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p16104120163017">Username</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p141051706305">Username used for logging in to MRS Manager</p>
<div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p194519141759">To create a data connection for an MRS security cluster, do not use user <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b554524219105248">admin</strong>. The <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b123106598105248">admin</strong> user is the default management page user and cannot be used as the authentication user of the security cluster. You can create an MRS user and set <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname3468191262313"><b>Username</b></span> and <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname64683124231"><b>Password</b></span> to the username and password of the created MRS user when creating an MRS data connection.<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_note15451659151217"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_ul17715141011134"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li8715121031318">If the CDM cluster version is 2.9.0 or later and the MRS cluster version is 3.1.0 or later, the created user must have the permissions of the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b11836193312371">Manager_viewer</strong> role to create links on CDM. To perform operations on databases, tables, and data of a component, you also need to add the user group permissions of the component to the user.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li5415103511136">If the CDM cluster version is earlier than 2.9.0 or the MRS cluster version is earlier than 3.1.0, the created user must have the permissions of <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1088016562338">Manager_administrator</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1288695693319">System_administrator</strong> to create links on CDM.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li1733135017192">A user with only the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b6765133911341">Manager_tenant</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1377216393342">Manager_auditor</strong> permission cannot create connections.</li></ul>
</div></div>
</div>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p710517023010">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row3105201309"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p18105507306">Password</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p71054011307">Password used for logging in to MRS Manager</p>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191051703302">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row177699297305"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p310410043015">Authentication Method</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p171048073013">Authentication method used for accessing MRS<ul id="dataartsstudio_01_0033__en-us_topic_0108275385_ul17104806309"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li151041006308"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b84235270611123">SIMPLE</strong>: for non-security mode</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li11104108309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b193121128127">KERBEROS</strong>: for security mode</li></ul>
</div>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191042018308">Yes</p>
</td>
</tr>
</tbody>
</table>
</div>
<p id="dataartsstudio_01_0033__en-us_topic_0108275385_p9243914122">Click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b141941925616">Show Advanced Attributes</strong>, and then click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b7127311869">Add</strong> to add configuration attributes of other clients. The name and value of each attribute must be configured. You can click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b83443253616">Delete</strong> to delete no longer used attributes.</p>
</div>
<div class="section" id="dataartsstudio_01_0033__en-us_topic_0108275385_section13645174115297"><h4 class="sectiontitle">Apache Kafka</h4><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p17584131395814">The Apache Kafka link is applicable to data migration of the third-party Hadoop in the local data center or ECS. You must use Direct Connect to connect to Hadoop in the local data center.</p>
<p id="dataartsstudio_01_0033__en-us_topic_0108275385_p2116754152029">When connecting CDM to Kafka of Apache Hadoop, configure the parameters as described in <a href="#dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212">Table 2</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212"></a><a name="en-us_topic_0108275385_table1990636915212"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row4257242215212"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.2.4.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p3100089215212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b84235270692541">Parameter</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.2.4.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p2804435515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1340701018">Description</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.2.4.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5700024515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1996756275">Example Value</strong></p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row845118401045"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p645116401542">Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p7451104018412">kafka_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row4324016315212"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1279229115212">Kafka broker</p>
</td>
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p36793163165241">IP address and port number of the Kafka broker</p>
</td>
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p7230798165241">192.168.1.1:9092</p>
</td>
</tr>
</tbody>
</table>
</div>
<p id="dataartsstudio_01_0033__en-us_topic_0108275385_p8119146192913">Click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b141941925616_1">Show Advanced Attributes</strong>, and then click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b7127311869_1">Add</strong> to add configuration attributes of other clients. The name and value of each attribute must be configured. You can click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b83443253616_1">Delete</strong> to delete no longer used attributes.</p>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

99
docs/dataartsstudio/umn/dataartsstudio_01_0035.html Normal file
View File

@ -0,0 +1,99 @@
<a name="dataartsstudio_01_0035"></a><a name="dataartsstudio_01_0035"></a>
<h1 class="topictitle1">Link to Elasticsearch/CSS</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0035__en-us_topic_0108275341_section72131053165214"><h4 class="sectiontitle">Elasticsearch</h4><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1258317586525">The Elasticsearch link is applicable to data migration of Elasticsearch services and Elasticsearch created in the local data center or ECS.</p>
<div class="note" id="dataartsstudio_01_0035__en-us_topic_0108275341_note173408273419"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p16340132712418">The Elasticsearch connector supports only the non-security mode.</p>
</div></div>
</div>
<p id="dataartsstudio_01_0035__en-us_topic_0108275341_p493133413817">When connecting CDM to Elasticsearch, configure the parameters as described in <a href="#dataartsstudio_01_0035__en-us_topic_0108275341_table22075105144748">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0035__en-us_topic_0108275341_table22075105144748"></a><a name="en-us_topic_0108275341_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0035__en-us_topic_0108275341_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="21.85%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1727937144748">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="55.17999999999999%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p5745174144748">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.97%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p62705927144748">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row11298866916"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p15298176296">Name</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p19298156493">css_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row46015358144748"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p31612872145433">Elasticsearch Server List</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p10505843145433">IP addresses or domain names (including the port numbers) of one or more Elasticsearch servers. The format is <em id="dataartsstudio_01_0035__en-us_topic_0108275341_i18463145116420">ip:port</em>. Use semicolons (;) to separate multiple IP addresses.</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p5195678145433">192.168.0.1:9200;192.168.0.2:9200</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="section" id="dataartsstudio_01_0035__en-us_topic_0108275341_section13755123284814"><h4 class="sectiontitle">CSS</h4><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p7878103811487">The Cloud Search Service (CSS) link is used to migrate log files or database records to the Elasticsearch engine for search and analysis.</p>
<p id="dataartsstudio_01_0035__en-us_topic_0108275341_p146852604917">When connecting CDM to CSS, configure the parameters as described in <a href="#dataartsstudio_01_0035__en-us_topic_0108275341_table1714082724917">Table 2</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0035__en-us_topic_0108275341_table1714082724917"></a><a name="en-us_topic_0108275341_table1714082724917"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0035__en-us_topic_0108275341_table1714082724917" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row15140927124910"><th align="left" class="cellrowborder" valign="top" width="21.85%" id="mcps1.3.4.4.2.4.1.1"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p17140122718493">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="55.17999999999999%" id="mcps1.3.4.4.2.4.1.2"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1014062724920">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.97%" id="mcps1.3.4.4.2.4.1.3"><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p01404275496">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row414013271491"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.4.4.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p514062710494">Name</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.4.4.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1616123511816">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.4.4.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p914042717492">css_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row12140727174912"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.4.4.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1514017277496">Elasticsearch Server List</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.4.4.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1140122719498">IP addresses or domain names (including the port numbers) of one or more Elasticsearch servers. The format is <em id="dataartsstudio_01_0035__en-us_topic_0108275341_i13476163918533">ip:port</em>. Use semicolons (;) to separate multiple IP addresses.</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.4.4.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p181411027144911">192.168.0.1:9200;192.168.0.2:9200</p>
</td>
</tr>
<tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row7141112784917"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.4.4.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p11415277496">Security Mode Authentication</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.4.4.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p3141202734910">Whether to enable security mode.</p>
<p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1712015325114">If <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b7417101420177">Security Mode</strong> has been enabled for the CSS cluster to be connected, set this parameter to <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b9957170191510">Yes</strong>. Otherwise, set this to <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b12962202155">No</strong>.</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.4.4.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p61413275497">Yes</p>
</td>
</tr>
<tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row61411427124915"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.4.4.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p181416274499">Username</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.4.4.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p814182718498">This parameter is displayed when <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b64095512169">Security Mode Authentication</strong> is set to <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b198271282160">Yes</strong>. It indicates the username used for connecting to CSS.</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.4.4.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p10141327194913">admin</p>
</td>
</tr>
<tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row414122716499"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.4.4.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p11141202744912">Password</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.4.4.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p1376018356512">This parameter is displayed when <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b865981319193">Security Mode Authentication</strong> is set to <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b1966416137192">Yes</strong>. It indicates the password used for connecting to CSS.</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.4.4.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p6141427104919">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0035__en-us_topic_0108275341_row83091712451"><td class="cellrowborder" valign="top" width="21.85%" headers="mcps1.3.4.4.2.4.1.1 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p591311246511">HTTPS Access</p>
</td>
<td class="cellrowborder" valign="top" width="55.17999999999999%" headers="mcps1.3.4.4.2.4.1.2 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p663711151553">This parameter is displayed when <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b668777913">Security Mode Authentication</strong> is set to <strong id="dataartsstudio_01_0035__en-us_topic_0108275341_b1698281070">Yes</strong>. This parameter specifies whether to enable HTTPS access. HTTPS access is more secure than HTTP access.</p>
</td>
<td class="cellrowborder" valign="top" width="22.97%" headers="mcps1.3.4.4.2.4.1.3 "><p id="dataartsstudio_01_0035__en-us_topic_0108275341_p86372015554">Yes</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

56
docs/dataartsstudio/umn/dataartsstudio_01_0036.html Normal file
View File

@ -0,0 +1,56 @@
<a name="dataartsstudio_01_0036"></a><a name="dataartsstudio_01_0036"></a>
<h1 class="topictitle1">Link to DLI</h1>
<div id="body8662426"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p493133413817">When connecting CDM to DLI, configure the parameters as described in <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748"></a><a name="en-us_topic_0108275410_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="19.509999999999998%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1727937144748">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="58.75%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5745174144748">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.740000000000002%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p62705927144748">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row11298866916"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p15298176296">Name</p>
</td>
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p19298156493">dli_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row46015358144748"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p31612872145433">AK</p>
</td>
<td class="cellrowborder" rowspan="2" valign="top" width="58.75%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p181471423104">AK/SK required for authentication during access to the DLI database.</p>
<p id="dataartsstudio_01_0036__en-us_topic_0108275410_p2087724103311">You need to create an access key for the current account and obtain an AK/SK pair.</p>
<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_ol1361418377715"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088088.png"></span></div>
</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
</div></div>
</li></ol>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5195678145433">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row23643456144748"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p29552890145433">SK</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p32797946145433">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row12160822504"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1016019285015">Project ID</p>
</td>
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1637616424613">Project ID in the region where DLI resides</p>
<div class="p" id="dataartsstudio_01_0036__en-us_topic_0108275410_p1668482916813">You can obtain the project ID and account ID by performing the following steps:<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_b196637155315">My Credentials</strong> page, obtain the account name and account ID, and obtain the project ID from the project list.</li></ol>
</div>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p11608245019">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

78
docs/dataartsstudio/umn/dataartsstudio_01_0037.html Normal file
View File

@ -0,0 +1,78 @@
<a name="dataartsstudio_01_0037"></a><a name="dataartsstudio_01_0037"></a>
<h1 class="topictitle1">Link to CloudTable OpenTSDB</h1>
<div id="body8662426"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p493133413817">When connecting CDM to CloudTable OpenTSDB, configure the parameters as described in <a href="#dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748"></a><a name="en-us_topic_0133463138_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.07%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1727937144748">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="58.19%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p5745174144748">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.740000000000002%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p62705927144748">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row11298866916"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p15298176296">Name</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p19298156493">TSDB_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row87539715534"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1375357165315">OpenTSDB Link</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p147692714538">ZK link of OpenTSDB</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p2076910795316">opentsdb-sp8afz7bgbps5ur.cloudtable.com:4242</p>
</td>
</tr>
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row1634161118531"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p134191195311">Security Mode</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p73481116533">Security or non-security mode</p>
<p id="dataartsstudio_01_0037__en-us_topic_0133463138_p10479147165612">If you select <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_b131221232238">Security</strong>, enter the project ID, username, and AK/SK.</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1674519527376">Nonsecurity</p>
</td>
</tr>
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row1392892065413"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1016019285015">Project ID</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1637616424613">Project ID in the region where CloudTable resides</p>
<div class="p" id="dataartsstudio_01_0037__en-us_topic_0133463138_p1668482916813">You can obtain the project ID and account ID by performing the following steps:<ol id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_b196637155315">My Credentials</strong> page, obtain the account name and account ID, and obtain the project ID from the project list.</li></ol>
</div>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p11608245019">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row4287224185416"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p9287524205412">Username</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p12287142410545">Username for accessing CloudTable</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p428782415548">admin</p>
</td>
</tr>
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row46015358144748"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p31612872145433">AK</p>
</td>
<td class="cellrowborder" rowspan="2" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p181471423104">AK and SK for accessing CloudTable.</p>
<p id="dataartsstudio_01_0037__en-us_topic_0133463138_p2396698815212">You need to create an access key for the current account and obtain an AK/SK pair.</p>
<ol id="dataartsstudio_01_0037__en-us_topic_0133463138_ol1361418377715"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088088.png"></span></div>
</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
</div></div>
</li></ol>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p5195678145433">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row23643456144748"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p29552890145433">SK</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p32797946145433">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

66
docs/dataartsstudio/umn/dataartsstudio_01_0038.html Normal file
View File

@ -0,0 +1,66 @@
<a name="dataartsstudio_01_0038"></a><a name="dataartsstudio_01_0038"></a>
<h1 class="topictitle1">Link to DMS Kafka</h1>
<div id="body8662426"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p493133413817">When connecting CDM to DMS Kafka, configure the parameters as described in <a href="#dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748"></a><a name="en-us_topic_0143085538_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.62%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1727937144748">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="58.19%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p5745174144748">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.19%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p62705927144748">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row11298866916"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p15298176296">Name</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p19298156493">dms_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row87539715534"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1375357165315">Service Type</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p147692714538">DMS Kafka edition. Currently, only the Platinum edition is available.</p>
</td>
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p2076910795316">Platinum</p>
</td>
</tr>
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1351774015574"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p132674594583">Kafka Broker</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p55181140195712">Address of a Kafka premium instance. The format is host:port.</p>
</td>
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p17518440165713">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row4239164445710"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p082419415916">Kafka SASL_SSL</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p112168292347">Whether to enable SSL authentication when a client connects to a Kafka premium instance.</p>
<p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1563192753418">If Kafka SASL_SSL is enabled, data will be encrypted before transmission for higher security, but performance will suffer.</p>
</td>
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p42402440579">Yes</p>
</td>
</tr>
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1521465119"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p181416274499">Username</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p814182718498">Username for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b9583164417318">Kafka SASL_SSL</strong> is enabled.</p>
</td>
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1522641120">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1831717229110"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p11141202744912">Password</p>
</td>
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1376018356512">Password for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b724513571337">Kafka SASL_SSL</strong> is enabled.</p>
</td>
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p4317522121118">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

288
docs/dataartsstudio/umn/dataartsstudio_01_0039.html Normal file
View File

File diff suppressed because it is too large Load Diff

289
docs/dataartsstudio/umn/dataartsstudio_01_0040.html Normal file
View File

File diff suppressed because it is too large Load Diff

125
docs/dataartsstudio/umn/dataartsstudio_01_0044.html Normal file
View File

File diff suppressed because it is too large Load Diff

72
docs/dataartsstudio/umn/dataartsstudio_01_0045.html Normal file
View File

@ -0,0 +1,72 @@
<a name="dataartsstudio_01_0045"></a><a name="dataartsstudio_01_0045"></a>
<h1 class="topictitle1">Link to OBS</h1>
<div id="body8662426"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p10847147142919">When connecting CDM to the destination OBS bucket, you need to add the read and write permissions to the destination OBS bucket, and file authentication is not required.</p>
<div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p5749387015151">When connecting CDM to OBS, configure the parameters as described in <a href="#dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843">Table 1</a>.
<div class="tablenoborder"><a name="dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843"></a><a name="en-us_topic_0108275368_table56513226152843"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row51765490152843"><th align="left" class="cellrowborder" valign="top" width="16.5%" id="mcps1.3.2.2.2.4.1.1"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25915791152843"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0065840554_b84235270692541">Parameter</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="62.870000000000005%" id="mcps1.3.2.2.2.4.1.2"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p38360350165510"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0065840554_b842352706191716">Description</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.630000000000003%" id="mcps1.3.2.2.2.4.1.3"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p64999942163911"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b842352706173959">Example Value</strong></p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row172676953014"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p426714916301">Name</p>
</td>
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p1826719919305">obs_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row58346992152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25657651152843">OBS Endpoint</p>
</td>
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p11141143515423">You can obtain the endpoint by either of the following means:<ul id="dataartsstudio_01_0045__en-us_topic_0108275368_ul36191496587"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_li2239658154217">To obtain the endpoint of an OBS bucket, go to the OBS console and click the bucket name to go to its details page.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_li19581153518113">An endpoint is the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b542311569437">request address</strong> for calling an API. Endpoints vary depending on services and regions. You can obtain endpoints from <a href="https://docs.otc.t-systems.com/en-us/endpoint/index.html" target="_blank" rel="noopener noreferrer">Regions and Endpoints</a>.</li></ul>
</div>
<p id="dataartsstudio_01_0045__en-us_topic_0108275368_p138036103816">You can enter a bucket-level domain name, for example, <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b37380815468">test.<em id="dataartsstudio_01_0045__en-us_topic_0108275368_i108746140463">xx</em>.com</strong>. In this case, you can query only the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b14738198114610">test</strong> bucket.</p>
</td>
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p89819474596">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row55420632152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p18947563152843">Port</p>
</td>
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p60445924165510">Data transmission port. The HTTPS port number is 443 and the HTTP port number is 80.</p>
</td>
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25723188163911">443</p>
</td>
</tr>
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row4804240203017"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p158041427194014">OBS Bucket Type</p>
</td>
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p6804122764019">Select a value from the drop-down list, generally, <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b76332430487">Object Storage</strong>.</p>
</td>
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p208045273406">Object Storage</p>
</td>
</tr>
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row55275051152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p3311745152843">AK</p>
</td>
<td class="cellrowborder" rowspan="2" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_p41664200165510">AK and SK are used to log in to the OBS server.</p>
<p id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_p1660302262810">You need to create an access key for the current account and obtain an AK/SK pair.</p>
<div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p13152215453">To obtain an access key, perform the following steps:<ol id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088088.png"></span></div>
</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
</div></div>
</li></ol>
</div>
</td>
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p28831327163911">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row3886299152843"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p63749320152843">SK</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p12963499163911">-</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

73
docs/dataartsstudio/umn/dataartsstudio_01_004501.html Normal file
View File

@ -0,0 +1,73 @@
<a name="dataartsstudio_01_004501"></a><a name="dataartsstudio_01_004501"></a>
<h1 class="topictitle1">Link to Cassandra</h1>
<div id="body8662426">
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_004501__en-us_topic_0000001086742916_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.1.2.4.1.1"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p23659124171418">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="60.540000000000006%" id="mcps1.3.1.2.4.1.2"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p37340867171418">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.28%" id="mcps1.3.1.2.4.1.3"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p4711375171418">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row148131718155810"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1081471865814">Name</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1981416180585">mongodb_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row19710159171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1560893315570">Service node</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1963014245571">An address of one node or addresses of multiple nodes. Separate addresses with semicolons (;). You are advised to configure multiple nodes at a time.</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p639334617571">192.168.0.1;192.168.0.2</p>
</td>
</tr>
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row11588738102344"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p94244579576">Port</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p66477930102344">Port number of the Cassandra node to be connected.</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p31421021155810">9042</p>
</td>
</tr>
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row35421096102350"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p50536504102350">Username</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p5438008102436">User name for connecting to Cassandra.</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p52218594102350">cdm</p>
</td>
</tr>
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row21870968171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p26718016171418">Password</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p5950554015418">Password for connecting to Cassandra.</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p38901992114142">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row12724184313582"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p10725543105813">Connection timeout duration</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1786004019351">(Optional) Displayed when you click <strong id="dataartsstudio_01_004501__en-us_topic_0000001086742916_b171971123155817">Show Advanced Attributes</strong>.</p>
<p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p37255439586">Connection timeout interval, in seconds.</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1272534355820">5</p>
</td>
</tr>
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row14629948175817"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p18629134835818">Read timeout duration</p>
</td>
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p04959434352">(Optional) Displayed when you click <strong id="dataartsstudio_01_004501__en-us_topic_0000001086742916_b6721037105812">Show Advanced Attributes</strong>.</p>
<p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1662944815810">Read timeout interval, in seconds. If the value is less than or equal to 0, no timeout occurs.</p>
</td>
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1662974817581">12</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0023.html">Managing Links</a></div>
</div>
</div>

315
docs/dataartsstudio/umn/dataartsstudio_01_0046.html Normal file
View File

File diff suppressed because it is too large Load Diff

45
docs/dataartsstudio/umn/dataartsstudio_01_0047.html Normal file
View File

@ -0,0 +1,45 @@
<a name="dataartsstudio_01_0047"></a><a name="dataartsstudio_01_0047"></a>
<h1 class="topictitle1">Source Job Parameters</h1>
<div id="body8662426"></div>
<div>
<ul class="ullinks">
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0048.html">From OBS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0049.html">From HDFS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0050.html">From HBase/CloudTable</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0051.html">From Hive</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0120.html">From DLI</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0052.html">From FTP/SFTP</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0053.html">From HTTP</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0054.html">From a Common Relational Database</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1254.html">From MySQL</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1255.html">From Oracle</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1256.html">From a Database Shard</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0055.html">From MongoDB/DDS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0056.html">From Redis</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0058.html">From Kafka/DMS Kafka</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0059.html">From Elasticsearch or CSS</a></strong><br>
</li>
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0060.html">From OpenTSDB</a></strong><br>
</li>
</ul>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0081.html">Managing Jobs</a></div>
</div>
</div>

288
docs/dataartsstudio/umn/dataartsstudio_01_0048.html Normal file
View File

File diff suppressed because it is too large Load Diff

205
docs/dataartsstudio/umn/dataartsstudio_01_0049.html Normal file
View File

File diff suppressed because it is too large Load Diff

70
docs/dataartsstudio/umn/dataartsstudio_01_0050.html Normal file
View File

@ -0,0 +1,70 @@
<a name="dataartsstudio_01_0050"></a><a name="dataartsstudio_01_0050"></a>
<h1 class="topictitle1">From HBase/CloudTable</h1>
<div id="body8662426"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p516813286351">When the source link of a job is the <a href="dataartsstudio_01_0039.html">Link to HBase</a> or <a href="dataartsstudio_01_0027.html">Link to CloudTable</a>, that is, when data is exported from MRS HBase, FusionInsight HBase, CloudTable, or Apache HBase, configure the source job parameters based on <a href="#dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165">Table 1</a>.</p>
<div class="note" id="dataartsstudio_01_0050__en-us_topic_0108275276_note18976163112245"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ol id="dataartsstudio_01_0050__en-us_topic_0108275276_ol12963193284516"><li id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275404_li469815359134">When you migrate data from CloudTable or HBase, CDM reads the first row of the table as an example of the field list. If the first row of data does not contain all fields of the table, you need to manually add fields.</li><li id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275404_li156983351133">Because HBase is schema-less, CDM cannot obtain the data types. If the data is stored in binary format, CDM cannot parse the data.</li></ol><ol start="3" id="dataartsstudio_01_0050__en-us_topic_0108275276_ol196211215464"><li id="dataartsstudio_01_0050__en-us_topic_0108275276_li116210284615">When data is exported from HBase or CloudTable, because HBase/CloudTable is schema-less storage systems, CDM requires that the source numeric fields be stored in regular decimal format rather than in binary format. For example, the value 100 needs to be stored as <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue18659236162419"><b>100</b></span> rather than <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue19660113615246"><b>01100100</b></span>.</li></ol>
</div></div>
<div class="tablenoborder"><a name="dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165"></a><a name="en-us_topic_0108275276_table5046103815165"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row585315215165"><th align="left" class="cellrowborder" valign="top" width="16.05%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1626397215165">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.89%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p4231334915165">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.06%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p482921015165">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row4012116315165"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p2858877215165">Table Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3398923015165">Name of the HBase table that data will be exported from</p>
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1210244910548">This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. </p>
</td>
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p166427315165">TBL_2</p>
</td>
</tr>
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row2085795312515"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p9857953135118">Column Families</p>
</td>
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p168572535513">(Optional) Column families to which the exported data belongs</p>
</td>
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p11857175335116">CF1&amp;CF2</p>
</td>
</tr>
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row68131455163415"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p198131455173412">Split Rowkey</p>
</td>
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p14813655143413">(Optional) Whether to split a rowkey. The default value is <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue164898924418270"><b>No</b></span>.</p>
</td>
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p881355511346">Yes</p>
</td>
</tr>
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row1431725743415"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3317457133416">Rowkey Delimiter</p>
</td>
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1631810574340">(Optional) Delimiter used to split a rowkey. If this parameter is left empty, the rowkey will not be split.</p>
</td>
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p15318175714341">|</p>
</td>
</tr>
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row667043895219"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1967023835217">Start Time</p>
</td>
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p091005834018">(Optional) <span id="dataartsstudio_01_0050__en-us_topic_0108275276_ph5654161619427">Start time (including the value) for extracting data. The format is <em id="dataartsstudio_01_0050__en-us_topic_0108275276_i38211611191413">yyyy-MM-dd HH:mm:ss</em>. Only the data generated at the specified time and later is extracted.</span></p>
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p116711580415">This parameter can be set to a macro variable of date and time. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. </p>
</td>
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p17670173812526">2019-01-01 20:00:00</p>
</td>
</tr>
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row6700144113522"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1970004165215">End Time</p>
</td>
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p2700041145210">(Optional) <span id="dataartsstudio_01_0050__en-us_topic_0108275276_ph5201142410429">End time (excluding the value) for extracting data. The format is <em id="dataartsstudio_01_0050__en-us_topic_0108275276_i1268214522145">yyyy-MM-dd HH:mm:ss</em>. Only the data generated before the time point is extracted.</span></p>
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p92671211101710">This parameter can be set to a macro variable of date and time. </p>
</td>
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p17007416523">2019-02-01 20:00:00</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0047.html">Source Job Parameters</a></div>
</div>
</div>

67
docs/dataartsstudio/umn/dataartsstudio_01_0051.html Normal file
View File

@ -0,0 +1,67 @@
<a name="dataartsstudio_01_0051"></a><a name="dataartsstudio_01_0051"></a>
<h1 class="topictitle1">From Hive</h1>
<div id="body8662426"><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p6222841216210">If the source link of a job is the <a href="dataartsstudio_01_0026.html">Link to Hive</a>, configure the source job parameters based on <a href="#dataartsstudio_01_0051__en-us_topic_0108275424_table31823995163953">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0051__en-us_topic_0108275424_table31823995163953"></a><a name="en-us_topic_0108275424_table31823995163953"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0051__en-us_topic_0108275424_table31823995163953" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0051__en-us_topic_0108275424_row18653487163953"><th align="left" class="cellrowborder" valign="top" width="17.169999999999998%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p15314298163953">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="61.870000000000005%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p32498630163953">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="20.96%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p15143370163953">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0051__en-us_topic_0108275424_row1928353163953"><td class="cellrowborder" valign="top" width="17.169999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p28108739161524">Database Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.870000000000005%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p17702619155928">Database name. Click the icon next to the text box. The dialog box for selecting the database is displayed.</p>
</td>
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p64647157163953">default</p>
</td>
</tr>
<tr id="dataartsstudio_01_0051__en-us_topic_0108275424_row11687830163953"><td class="cellrowborder" valign="top" width="17.169999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p23518636161524">Table Name</p>
</td>
<td class="cellrowborder" valign="top" width="61.870000000000005%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p17984995155931">Hive table name. Click the icon next to the text box. The dialog box for selecting the table is displayed.</p>
<p id="dataartsstudio_01_0051__en-us_topic_0108275424_p1210244910548">This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. </p>
</td>
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p50683068163953">TBL_E</p>
</td>
</tr>
<tr id="dataartsstudio_01_0051__en-us_topic_0108275424_row962165734014"><td class="cellrowborder" valign="top" width="17.169999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p96355710402">Read Mode</p>
</td>
<td class="cellrowborder" valign="top" width="61.870000000000005%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p1656393534412">Two read modes are available: HDFS and JDBC. By default, the HDFS mode is used. If you do not need to use the WHERE condition to filter data or add new fields on the field mapping page, select the HDFS mode.</p>
<ul id="dataartsstudio_01_0051__en-us_topic_0108275424_ul169421201417"><li id="dataartsstudio_01_0051__en-us_topic_0108275424_li3378113716448">The HDFS mode shows good performance, but in this mode, you cannot use the WHERE condition to filter data or add new fields on the field mapping page.</li><li id="dataartsstudio_01_0051__en-us_topic_0108275424_li13942122018412">The HDFS mode allows you to use the WHERE condition to filter data or add new fields on the field mapping page.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p2631557154010">HDFS</p>
</td>
</tr>
<tr id="dataartsstudio_01_0051__en-us_topic_0108275424_row4203135418142"><td class="cellrowborder" valign="top" width="17.169999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p7203154151410">Partition Filter Criteria</p>
</td>
<td class="cellrowborder" valign="top" width="61.870000000000005%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p1219435334515">This parameter is displayed when you select the HDFS read mode and click <strong id="dataartsstudio_01_0051__en-us_topic_0108275424_b1454933863319">Show Advanced Attributes</strong>.</p>
<p id="dataartsstudio_01_0051__en-us_topic_0108275424_p1020335414148">You can configure multiple values (separated by spaces) or a field value range. The time macro function is supported. </p>
</td>
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.2.2.4.1.3 "><ul id="dataartsstudio_01_0051__en-us_topic_0108275424_ul16185646318"><li id="dataartsstudio_01_0051__en-us_topic_0108275424_li187594277316">Single/Multi-value filtering:<p id="dataartsstudio_01_0051__en-us_topic_0108275424_p88421435130"><a name="dataartsstudio_01_0051__en-us_topic_0108275424_li187594277316"></a><a name="en-us_topic_0108275424_li187594277316"></a>"${dateformat(yyyyMMdd, -1, DAY)} ${dateformat(yyyyMMdd)}"</p>
</li><li id="dataartsstudio_01_0051__en-us_topic_0108275424_li1458674019314">Filter by range:<p id="dataartsstudio_01_0051__en-us_topic_0108275424_p22875441038"><a name="dataartsstudio_01_0051__en-us_topic_0108275424_li1458674019314"></a><a name="en-us_topic_0108275424_li1458674019314"></a>"${value} &gt;= ${dateformat(yyyyMMdd, -7, DAY)} &amp;&amp; ${value} &lt; ${dateformat(yyyyMMdd)}"</p>
</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_0051__en-us_topic_0108275424_row131351318184611"><td class="cellrowborder" valign="top" width="17.169999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p54171024164616">WHERE Clause</p>
</td>
<td class="cellrowborder" valign="top" width="61.870000000000005%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p1213520181469">This parameter is displayed when you select the JDBC read mode and click <strong id="dataartsstudio_01_0051__en-us_topic_0108275424_b1066165863415">Show Advanced Attributes</strong>.</p>
<p id="dataartsstudio_01_0051__en-us_topic_0108275424_p976143054712">This parameter indicates the WHERE clause to be extracted. If this parameter is not set, the entire table is extracted. If the table to be migrated does not contain the fields specified by the WHERE clause, the migration will fail.</p>
<p id="dataartsstudio_01_0051__en-us_topic_0108275424_p18740131613716">You can set a date macro variable to extract data generated on a specific date. </p>
</td>
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p8135518144617">age &gt; 18 and age &lt;= 60</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="note" id="dataartsstudio_01_0051__en-us_topic_0108275424_note57157885143833"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0051__en-us_topic_0108275424_p23221388113028">If the data source is Hive, CDM will automatically partition data using the Hive data partitioning file.</p>
</div></div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0047.html">Source Job Parameters</a></div>
</div>
</div>

244
docs/dataartsstudio/umn/dataartsstudio_01_0052.html Normal file
View File

File diff suppressed because it is too large Load Diff

131
docs/dataartsstudio/umn/dataartsstudio_01_0053.html Normal file
View File

File diff suppressed because it is too large Load Diff

128
docs/dataartsstudio/umn/dataartsstudio_01_0054.html Normal file
View File

File diff suppressed because it is too large Load Diff

48
docs/dataartsstudio/umn/dataartsstudio_01_0055.html Normal file
View File

@ -0,0 +1,48 @@
<a name="dataartsstudio_01_0055"></a><a name="dataartsstudio_01_0055"></a>
<h1 class="topictitle1">From MongoDB/DDS</h1>
<div id="body8662426"><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p1284319256319">When you migrate MongoDB or DDS data, CDM reads the first row of the collection as an example of the field list. If the first row of data does not contain all fields of the collection, you need to manually add fields.</p>
<div class="p" id="dataartsstudio_01_0055__en-us_topic_0108275308_p6222841216210">When the source link of a job is the <a href="dataartsstudio_01_0030.html">Link to MongoDB</a>, that is, when data is exported from an on-premises MongoDB or DDS, configure the source job parameters based on <a href="#dataartsstudio_01_0055__en-us_topic_0108275308_table31823995163953">Table 1</a>.
<div class="tablenoborder"><a name="dataartsstudio_01_0055__en-us_topic_0108275308_table31823995163953"></a><a name="en-us_topic_0108275308_table31823995163953"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0055__en-us_topic_0108275308_table31823995163953" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0055__en-us_topic_0108275308_row18653487163953"><th align="left" class="cellrowborder" valign="top" width="15.61%" id="mcps1.3.2.3.2.4.1.1"><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p15314298163953">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="64.88000000000001%" id="mcps1.3.2.3.2.4.1.2"><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p32498630163953">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.509999999999998%" id="mcps1.3.2.3.2.4.1.3"><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p15143370163953">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0055__en-us_topic_0108275308_row2052684816261"><td class="cellrowborder" valign="top" width="15.61%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p175265482261">Database Name</p>
</td>
<td class="cellrowborder" valign="top" width="64.88000000000001%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p145261848192619">Name of the database from which data will be migrated</p>
</td>
<td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p452664812616">mongodb</p>
</td>
</tr>
<tr id="dataartsstudio_01_0055__en-us_topic_0108275308_row34313000163953"><td class="cellrowborder" valign="top" width="15.61%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p46804376161524">Collection Name</p>
</td>
<td class="cellrowborder" valign="top" width="64.88000000000001%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p6187019816562">Collection name, similar to the table name of a relational database. Click the icon next to the text box to go to the page for selecting the collection or directly enter a collection name.</p>
<p id="dataartsstudio_01_0055__en-us_topic_0108275308_p49990086164128">If the desired table is not displayed, check whether the table exists or whether the login account has the permission to query metadata.</p>
</td>
<td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p41020337163953">COLLECTION</p>
</td>
</tr>
<tr id="dataartsstudio_01_0055__en-us_topic_0108275308_row13417032753"><td class="cellrowborder" valign="top" width="15.61%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p16417163215510">Filter Condition</p>
</td>
<td class="cellrowborder" valign="top" width="64.88000000000001%" headers="mcps1.3.2.3.2.4.1.2 "><div class="p" id="dataartsstudio_01_0055__en-us_topic_0108275308_p241710321259">Conditions for filtering documents. CDM migrates only the data that meets the filter conditions. The examples are as follows:<ol id="dataartsstudio_01_0055__en-us_topic_0108275308_ol6793125415558"><li id="dataartsstudio_01_0055__en-us_topic_0108275308_li3793145420559">Filter by expression: <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b154602013234">{'last_name': 'Smith'}</strong> indicates that all files whose <span class="parmname" id="dataartsstudio_01_0055__en-us_topic_0108275308_parmname19476140182313"><b>last_name</b></span> value is <span class="parmvalue" id="dataartsstudio_01_0055__en-us_topic_0108275308_parmvalue184765082318"><b>Smith</b></span> are queried.</li><li id="dataartsstudio_01_0055__en-us_topic_0108275308_li1068119241604">Filter by parameter: <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b1052351015233">{ x : "john" }, { z : 1 }</strong> indicates that all <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b8538310132319">z</strong> fields whose <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b953814106239">x</strong> is <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b13538110152311">john</strong> are queried.</li><li id="dataartsstudio_01_0055__en-us_topic_0108275308_li192512481730">Filter by condition: <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b14366812132310">{ "field" : { $gt: 5 } }</strong> indicates that the <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b03661812172315">field</strong> values greater than 5 are queried.</li><li id="dataartsstudio_01_0055__en-us_topic_0108275308_li10803310153216">Filter by time macro: <p id="dataartsstudio_01_0055__en-us_topic_0108275308_p1011414116580"><a name="dataartsstudio_01_0055__en-us_topic_0108275308_li10803310153216"></a><a name="en-us_topic_0108275308_li10803310153216"></a>{"ts":{$gte:ISODate("${dateformat(yyyy-MM-dd'T'HH:mm:ss.SSS'Z',-1,HOUR)}")}} indicates that the values greater than those after time macro conversion in the <strong id="dataartsstudio_01_0055__en-us_topic_0108275308_b1071861217201">ts</strong> field are queried.</p>
</li></ol>
</div>
</td>
<td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0055__en-us_topic_0108275308_p18417203211519">{'last_name': 'Smith'}</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0047.html">Source Job Parameters</a></div>
</div>
</div>

61
docs/dataartsstudio/umn/dataartsstudio_01_0056.html Normal file
View File

@ -0,0 +1,61 @@
<a name="dataartsstudio_01_0056"></a><a name="dataartsstudio_01_0056"></a>
<h1 class="topictitle1">From Redis</h1>
<div id="body8662426"><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p868085818382"><span id="dataartsstudio_01_0056__en-us_topic_0108275313_ph675017393913">Because DCS restricts the commands for obtaining keys, it cannot serve as the migration source but can be the migration destination. The Redis service of the third-party cloud cannot serve as the migration source. However, the Redis set up in the on-premises data center or on the ECS can be the migration source and destination.</span></p>
<p id="dataartsstudio_01_0056__en-us_topic_0108275313_p6222841216210">When data is exported from an on-premises Redis, configure source job parameters as described in <a href="#dataartsstudio_01_0056__en-us_topic_0108275313_table31823995163953">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0056__en-us_topic_0108275313_table31823995163953"></a><a name="en-us_topic_0108275313_table31823995163953"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0056__en-us_topic_0108275313_table31823995163953" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0056__en-us_topic_0108275313_row18653487163953"><th align="left" class="cellrowborder" valign="top" width="15.379999999999999%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p15314298163953">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="65.44%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p32498630163953">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p15143370163953">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0056__en-us_topic_0108275313_row34313000163953"><td class="cellrowborder" valign="top" width="15.379999999999999%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p17037287203413">Redis Key Prefix</p>
</td>
<td class="cellrowborder" valign="top" width="65.44%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p46074171163953">Key prefix, which is similar to the table name of a relational database</p>
</td>
<td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p41020337163953">TABLE</p>
</td>
</tr>
<tr id="dataartsstudio_01_0056__en-us_topic_0108275313_row1928353163953"><td class="cellrowborder" valign="top" width="15.379999999999999%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p5690285203418">Value Storage Type</p>
</td>
<td class="cellrowborder" valign="top" width="65.44%" headers="mcps1.3.3.2.4.1.2 "><div class="p" id="dataartsstudio_01_0056__en-us_topic_0108275313_p152812281737">The options are as follows:<ul id="dataartsstudio_01_0056__en-us_topic_0108275313_ul2053492417310"><li id="dataartsstudio_01_0056__en-us_topic_0108275313_li3240979417312"><strong id="dataartsstudio_01_0056__en-us_topic_0108275313_b842352706165229">String</strong>: without column name, such as <span class="uicontrol" id="dataartsstudio_01_0056__en-us_topic_0108275313_uicontrol1537531006165254"><b>value1,value2</b></span></li><li id="dataartsstudio_01_0056__en-us_topic_0108275313_li322087817310"><strong id="dataartsstudio_01_0056__en-us_topic_0108275313_b84235270616534">Hash</strong>: with column name, such as <span class="uicontrol" id="dataartsstudio_01_0056__en-us_topic_0108275313_uicontrol695539828165321"><b>column1=value1,column2=value2</b></span></li></ul>
</div>
</td>
<td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p64647157163953">String</p>
</td>
</tr>
<tr id="dataartsstudio_01_0056__en-us_topic_0108275313_row11687830163953"><td class="cellrowborder" valign="top" width="15.379999999999999%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p63014384203424">Key Delimiter</p>
</td>
<td class="cellrowborder" valign="top" width="65.44%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p63592058163953">Character used to separate table names and column names of a relational database</p>
</td>
<td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p50683068163953">_</p>
</td>
</tr>
<tr id="dataartsstudio_01_0056__en-us_topic_0108275313_row43070736163953"><td class="cellrowborder" valign="top" width="15.379999999999999%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p31419000203428">Value Delimiter</p>
</td>
<td class="cellrowborder" valign="top" width="65.44%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p64711742163953">Character used to separate columns when the storage type is string</p>
</td>
<td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p7159773163953">;</p>
</td>
</tr>
<tr id="dataartsstudio_01_0056__en-us_topic_0108275313_row1730917444432"><td class="cellrowborder" valign="top" width="15.379999999999999%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p37989497431">Same Field</p>
</td>
<td class="cellrowborder" valign="top" width="65.44%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p20577941164418">This parameter is displayed when <strong id="dataartsstudio_01_0056__en-us_topic_0108275313_b2711431049">Value Storage Type</strong> is set to <strong id="dataartsstudio_01_0056__en-us_topic_0108275313_b374675713410">Hash</strong>.</p>
<p id="dataartsstudio_01_0056__en-us_topic_0108275313_p1075812614441">The hash key contains the same field.</p>
</td>
<td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0056__en-us_topic_0108275313_p1231024444316">Yes</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0047.html">Source Job Parameters</a></div>
</div>
</div>

83
docs/dataartsstudio/umn/dataartsstudio_01_0058.html Normal file
View File

@ -0,0 +1,83 @@
<a name="dataartsstudio_01_0058"></a><a name="dataartsstudio_01_0058"></a>
<h1 class="topictitle1">From Kafka/DMS Kafka</h1>
<div id="body8662426"><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p54220973115328"></p>
<p id="dataartsstudio_01_0058__en-us_topic_0108275337_p46135468113529">If the source link of a job is the <a href="dataartsstudio_01_0033.html">Link to Kafka</a> or <a href="dataartsstudio_01_0038.html">Link to DMS Kafka</a>, configure the source job parameters based on <a href="#dataartsstudio_01_0058__en-us_topic_0108275337_table45985388113529">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0058__en-us_topic_0108275337_table45985388113529"></a><a name="en-us_topic_0108275337_table45985388113529"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0058__en-us_topic_0108275337_table45985388113529" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row1499348113529"><th align="left" class="cellrowborder" valign="top" width="15.72%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p54338376113529"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b842352706103559">Parameter</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="65.3%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p39332299113529"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b842352706193020">Description</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.98%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p31799688113529"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b84235270611522">Example Value</strong></p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row29414735113529"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p33783328113529">Topics</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p52095013113529">One or more topics can be entered.</p>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p58946502113529">est1,est2</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row60756477113529"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p22327637113529">Offset</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p63708157113529">Initial offset parameter</p>
<ul id="dataartsstudio_01_0058__en-us_topic_0108275337_ul36502502113529"><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li60087069113529"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b84235270616244">Latest</strong>: Maximum offset, indicating that the latest data will be extracted.</li><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li35214430113529"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b842352706162735">Earliest</strong>: Minimum offset, indicating that the earliest data will be extracted.</li><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li14236153105416"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b83802560536">Submitted</strong>: data that has been submitted</li><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li10217596524"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b258692419541">Time Range</strong>: data within a specified time range</li></ul>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p33796583113529">Latest</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row35733799113529"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p8756592113529">Permanent Running</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p38195350113529">Whether a job runs permanently.</p>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p6815616113529">Yes</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row15194006113529"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p22755010113529">Consumer Group ID</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p1638011885013">Consumer group ID</p>
<p id="dataartsstudio_01_0058__en-us_topic_0108275337_p1114017325017">If you export data from DMS Kafka, enter any value for Kafka Platinum but a valid consumer group ID for Kafka Basic.</p>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p45507701113529">sumer-group</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row9228163115910"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p72289311596">Data Format</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p111321138622">Format used for parsing data. The options are as follows:</p>
<ul id="dataartsstudio_01_0058__en-us_topic_0108275337_ul59573391929"><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li169571839927"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b177561537113415">Binary</strong>: Data is transferred directly. It is not converted to another format. This setting is suitable for file migration.</li><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li1085014450210"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b694354212345">CSV</strong>: Source data will be migrated after being converted in CSV format.</li><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li1691575895019"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b1282873945419">JSON</strong>: Source data will be migrated after being converted in JSON format.</li><li id="dataartsstudio_01_0058__en-us_topic_0108275337_li989620424512"><strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b1393311436549">CDC (DRS_JSON)</strong>: Source data will be migrated after being converted in DRS_JSON format.</li></ul>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p182286311598">Binary</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row62245198113529"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p8696283113529">Field Delimiter</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p9802957173352">The default value is space. To set the <strong id="dataartsstudio_01_0058__en-us_topic_0108275337_b842352706113647">Tab</strong> key as the delimiter, set this parameter to <span class="parmvalue" id="dataartsstudio_01_0058__en-us_topic_0108275337_parmvalue1470440010114039"><b>\t</b></span>.</p>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p56938959113529">,</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row48652991113529"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p48578216113529">Max. Poll Records</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p42521393113529">(Optional) Maximum number of records per poll</p>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p21680770113529">100</p>
</td>
</tr>
<tr id="dataartsstudio_01_0058__en-us_topic_0108275337_row6670289111413"><td class="cellrowborder" valign="top" width="15.72%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p3422508911413">Max. Poll Interval</p>
</td>
<td class="cellrowborder" valign="top" width="65.3%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p2076879511413">(Optional) Maximum interval between polls (seconds)</p>
</td>
<td class="cellrowborder" valign="top" width="18.98%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0058__en-us_topic_0108275337_p455081711413">100</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0047.html">Source Job Parameters</a></div>
</div>
</div>

66
docs/dataartsstudio/umn/dataartsstudio_01_0059.html Normal file
View File

@ -0,0 +1,66 @@
<a name="dataartsstudio_01_0059"></a><a name="dataartsstudio_01_0059"></a>
<h1 class="topictitle1">From Elasticsearch or CSS</h1>
<div id="body8662426"><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p32842430161426">If the source link of a job is the <a href="dataartsstudio_01_0035.html">Link to Elasticsearch/CSS</a>, configure the source job parameters based on <a href="#dataartsstudio_01_0059__en-us_topic_0108275408_table5046103815165">Table 1</a>.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0059__en-us_topic_0108275408_table5046103815165"></a><a name="en-us_topic_0108275408_table5046103815165"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0059__en-us_topic_0108275408_table5046103815165" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Job parameters when Elasticsearch or CSS is the source</caption><thead align="left"><tr id="dataartsstudio_01_0059__en-us_topic_0108275408_row585315215165"><th align="left" class="cellrowborder" valign="top" width="17.948205179482052%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p1626397215165">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="63.313668633136686%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p4231334915165">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.738126187381262%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p482921015165">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0059__en-us_topic_0108275408_row4012116315165"><td class="cellrowborder" valign="top" width="17.948205179482052%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p2858877215165">Index</p>
</td>
<td class="cellrowborder" valign="top" width="63.313668633136686%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p15492661577">Elasticsearch index, which is similar to the name of a relational database. The index name can contain only lowercase letters.</p>
</td>
<td class="cellrowborder" valign="top" width="18.738126187381262%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p166427315165">index</p>
</td>
</tr>
<tr id="dataartsstudio_01_0059__en-us_topic_0108275408_row1497845915165"><td class="cellrowborder" valign="top" width="17.948205179482052%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p529563715165">Type</p>
</td>
<td class="cellrowborder" valign="top" width="63.313668633136686%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p527763715824">Elasticsearch type, which is similar to the table name of a relational database. The type name can contain only lowercase letters.</p>
</td>
<td class="cellrowborder" valign="top" width="18.738126187381262%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p3753014815165">type</p>
</td>
</tr>
<tr id="dataartsstudio_01_0059__en-us_topic_0108275408_row15286142463917"><td class="cellrowborder" valign="top" width="17.948205179482052%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p142861324163913">Split Nested Field</p>
</td>
<td class="cellrowborder" valign="top" width="63.313668633136686%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p9286172411394">(Optional) Whether to split the JSON content of the nested fields. For example, <span class="uicontrol" id="dataartsstudio_01_0059__en-us_topic_0108275408_uicontrol1089212913485"><b>a:{ b:{ c:1, d:{ e:2, f:3 } } }</b></span> can be split into <span class="uicontrol" id="dataartsstudio_01_0059__en-us_topic_0108275408_uicontrol6892592485"><b>a.b.c</b></span>, <span class="uicontrol" id="dataartsstudio_01_0059__en-us_topic_0108275408_uicontrol19892996483"><b>a.b.d.e</b></span>, and <span class="uicontrol" id="dataartsstudio_01_0059__en-us_topic_0108275408_uicontrol28924914813"><b>a.b.d.f</b></span>.</p>
</td>
<td class="cellrowborder" valign="top" width="18.738126187381262%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p728616244391">No</p>
</td>
</tr>
<tr id="dataartsstudio_01_0059__en-us_topic_0108275408_row4983279398"><td class="cellrowborder" valign="top" width="17.948205179482052%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p169822715398">Filter Conditions</p>
</td>
<td class="cellrowborder" valign="top" width="63.313668633136686%" headers="mcps1.3.2.2.4.1.2 "><div class="p" id="dataartsstudio_01_0059__en-us_topic_0108275408_p1375811413509">(Optional) CDM migrates only the data that meets the filter conditions.<ul id="dataartsstudio_01_0059__en-us_topic_0108275408_ul195507460502"><li id="dataartsstudio_01_0059__en-us_topic_0108275408_li185501469506">Currently, only the query string (q syntax) of Elasticsearch can be used to filter source data. The q syntax is used in the following way:<ul id="dataartsstudio_01_0059__en-us_topic_0108275408_ul0206183811545"><li id="dataartsstudio_01_0059__en-us_topic_0108275408_li1069253812819">In exact match, the <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b106920386811"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i1869217381689">column</em>:<em id="dataartsstudio_01_0059__en-us_topic_0108275408_i16921138987">data</em></strong> format is used to match and filter data. <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b218517418451"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i266113944510">column</em></strong> indicates the field name, and <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b4552453144516"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i98661352184518">data</em></strong> indicates the query condition, for example, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b560464611">last_name:Smith</strong>.<p id="dataartsstudio_01_0059__en-us_topic_0108275408_p1652817287102">In addition, if <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b84313315548"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i101886218548">data</em></strong> is a string containing spaces, it must be enclosed in double quotation marks. If <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b59531838105314"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i148141436145315">column</em></strong> is not specified, all fields will be matched by <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1946341620546"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i11156131611547">data</em></strong>.</p>
</li><li id="dataartsstudio_01_0059__en-us_topic_0108275408_li885413832917">Multiple query conditions can be combined with connection words. The format is <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1186083819291"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i58606386294">column</em><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i88601838142912">1</em>:<em id="dataartsstudio_01_0059__en-us_topic_0108275408_i158605382292">data</em></strong><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i10860338192914"><strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1286019386295">1 </strong></em><strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b128601538112915">AND</strong> <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b3860113802920"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i78608388293">column2</em>:<em id="dataartsstudio_01_0059__en-us_topic_0108275408_i19860193817297">data2</em></strong>. The connection words can be <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b17842105220572">AND</strong>, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b17986195412573">OR</strong>, or <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b17845195720579">NOT</strong>. They must be in uppercase, and there must be a space before and after each connection word.<p id="dataartsstudio_01_0059__en-us_topic_0108275408_p65831139152916">Example: <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1011775135817">last_name:Smith AND last_name:John</strong></p>
</li><li id="dataartsstudio_01_0059__en-us_topic_0108275408_li12314536162917">In range matching, you can directly use a condition expression to filter data. The expression is in <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1131623672916"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i4316103611293">column</em>:&gt;<em id="dataartsstudio_01_0059__en-us_topic_0108275408_i19316133619297">data</em></strong> format. The operator can be <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b171618810014">&gt;</strong>, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b68101911609">&gt;=</strong>, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b11795713303">&lt;</strong>, or <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1075081619014">&lt;=</strong>.<p id="dataartsstudio_01_0059__en-us_topic_0108275408_p6811233163817">An example is <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b7376441807">time:&gt;=1636905600000 AND time:&lt;1637078400000</strong>. It can also be used together with a macro variable of date and time, for example, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b154530308212">createTime:&gt;=${timestamp(dateformat(yyyyMMdd,-1,DAY))} AND createTime:&lt; ${timestamp(dateformat(yyyyMMdd))}</strong>.</p>
</li><li id="dataartsstudio_01_0059__en-us_topic_0108275408_li7995191751512">In range matching, you can also use the range syntax to filter data. The format is <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b182012442813"><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i14201324142816">column</em>:{<em id="dataartsstudio_01_0059__en-us_topic_0108275408_i0203249284">data</em><em id="dataartsstudio_01_0059__en-us_topic_0108275408_i18201224142810">1</em> TO <em id="dataartsstudio_01_0059__en-us_topic_0108275408_i19201242287">data2</em></strong><strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b3647710131718">}</strong>. <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b565219162417">{</strong> and <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b2293152014411">}</strong> indicate that a value is not included. <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1262306411">[</strong> and <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1592103316415">]</strong> indicate that a value is included. <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b8737139516">TO</strong> must be capitalized, and there must be a space before and after it. <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b16508123115515">*</strong> indicates all data.<p id="dataartsstudio_01_0059__en-us_topic_0108275408_p2734852152918">For example, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b1145415590519">time:{1636992000000 TO *]</strong> filters out all the data greater than 1636992000000 in the <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b36272331712">time</strong> field. It can also be used together with a macro variable of date and time, for example, <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b138691339275">createTime:[${timestamp(dateformat(yyyyMMdd,-1,DAY))} TO ${timestamp(dateformat(yyyyMMdd))}}</strong>.</p>
</li></ul>
</li><li id="dataartsstudio_01_0059__en-us_topic_0108275408_li1023905521910">Source data cannot be filtered using the query domain-specific language (DSL) of Elasticsearch.</li></ul>
</div>
</td>
<td class="cellrowborder" valign="top" width="18.738126187381262%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p398627133918">last_name:Smith</p>
</td>
</tr>
<tr id="dataartsstudio_01_0059__en-us_topic_0108275408_row1969518119321"><td class="cellrowborder" valign="top" width="17.948205179482052%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p413919913217">Extract Meta-field</p>
</td>
<td class="cellrowborder" valign="top" width="63.313668633136686%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p4695171163214">Whether to extract index meta-fields. For example, _index, _type, _id, and _score.</p>
</td>
<td class="cellrowborder" valign="top" width="18.738126187381262%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0059__en-us_topic_0108275408_p1269612110329">Yes</p>
</td>
</tr>
</tbody>
</table>
</div>
<p id="dataartsstudio_01_0059__en-us_topic_0108275408_p197482027201916">On the <strong id="dataartsstudio_01_0059__en-us_topic_0108275408_b191147353575">Map Field</strong> page, you can set custom fields for the source and destination.</p>
<div class="fignone" id="dataartsstudio_01_0059__en-us_topic_0108275408_fig19191631162510"><span class="figcap"><b>Figure 1 </b>Setting custom fields</span><br><span><img id="dataartsstudio_01_0059__en-us_topic_0108275408_image19678151315257" src="en-us_image_0000001373168725.png"></span></div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0047.html">Source Job Parameters</a></div>
</div>
</div>

Some files were not shown because too many files have changed in this diff Show More