forked from docs/doc-exports
Lu, Huayi
ef0ada5a59
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Lu, Huayi <luhuayi@huawei.com> Co-committed-by: Lu, Huayi <luhuayi@huawei.com>
21 lines
5.1 KiB
HTML
21 lines
5.1 KiB
HTML
<a name="EN-US_TOPIC_0000001717256744"></a><a name="EN-US_TOPIC_0000001717256744"></a>
|
|
|
|
<h1 class="topictitle1">Overview</h1>
|
|
<div id="body8662426"><p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_p7807105913718">MRS is a big data cluster running based on the open-source Hadoop ecosystem. It provides the industry's latest cutting-edge storage and analytical capabilities of massive volumes of data, satisfying your data storage and processing requirements. For details, see the <span id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_ph2740729133515"><i><cite id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0135554668_cite245375118115">MapReduce Service User Guide</cite></i><em id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_i13654203215310"></em><em id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_i188061438139"></em></span>.</p>
|
|
<p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_p56178650111411">You can use Hive/Spark (analysis cluster of MRS) to store massive volumes of service data. Hive/Spark data files are stored on HDFS. On <span id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_ph1692512422530">GaussDB(DWS)</span>, you can connect a <span id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_ph111997429518">GaussDB(DWS)</span> cluster to an MRS cluster, read data from HDFS files, and write the data to <span id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_ph33147185110">GaussDB(DWS)</span> when the clusters are on the same network.</p>
|
|
<div class="notice" id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_note1775105323310"><span class="noticetitle"><img src="public_sys-resources/notice_3.0-en-us.png"> </span><div class="noticebody"><p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_p177511536337">Ensure that MRS can communicate with DWS:</p>
|
|
<p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_p122834109344">Scenario 1: If MRS and DWS are in the same region and VPC, they can communicate with each other by default.</p>
|
|
<p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_p13939142613348">Scenario 2: If MRS and GaussDB(DWS) are in the same region but in different VPCs, you need to create a VPC peering connection. For details, see "VPC Peering Connection Overview" in <em id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_i0526163863219">Virtual Private Cloud User Guide</em>.</p>
|
|
<p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_p594017456346">Scenario 3: If MRS and GaussDB(DWS) are not in the same region, you need to use Cloud Connect (CC) to create network connections. For details, see the user guide of the corresponding service.</p>
|
|
<p id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_p11875339174014">Scenario 4: If MRS is deployed on-premises, you need to use Direct Connect (DC) or Virtual Private Network (VPN) to connect the network. For details, see the User Guide of the corresponding service.</p>
|
|
</div></div>
|
|
<div class="section" id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_section1298319298101"><h4 class="sectiontitle">Importing Data from MRS to a GaussDB(DWS) Cluster</h4><ol id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_ol1725018516137"><li id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_li524814581319"><a href="dws_04_0212.html#EN-US_TOPIC_0000001717097320">Preparing Data in an MRS Cluster</a></li><li id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_li424812561318">(Optional) <a href="dws_04_0213.html#EN-US_TOPIC_0000001764817381">Manually Creating a Foreign Server</a></li><li id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_li1324910521314"><a href="dws_04_0214.html#EN-US_TOPIC_0000001764896609">Creating a Foreign Table</a></li><li id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_li6249258138"><a href="dws_04_0215.html#EN-US_TOPIC_0000001717256748">Importing Data</a></li><li id="EN-US_TOPIC_0000001717256744__en-us_topic_0000001233563291_en-us_topic_0000001082926693_en-us_topic_0109259514_en-us_topic_0101455468_li42491154139"><a href="dws_04_0216.html#EN-US_TOPIC_0000001717097324">Deleting Resources</a></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_04_0210.html">Importing Data from MRS to a Cluster</a></div>
|
|
</div>
|
|
</div>
|
|
|