forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
17 lines
1.5 KiB
HTML
17 lines
1.5 KiB
HTML
<a name="mrs_01_24103"></a><a name="mrs_01_24103"></a>
|
|
|
|
<h1 class="topictitle1">Hudi Table Schema</h1>
|
|
<div id="body0000001151689653"><p id="mrs_01_24103__p9737153715472">When writing data, Hudi generates a Hudi table based on attributes such as the storage path, table name, and partition structure.</p>
|
|
<p id="mrs_01_24103__p959999165715">Hudi table data files can be stored in the OS file system or distributed file system such as HDFS. To ensure analysis performance and data reliability, HDFS is generally used for storage. Using HDFS as an example, Hudi table storage files are classified into two types.</p>
|
|
<ul id="mrs_01_24103__ul1075141520579"><li id="mrs_01_24103__li1375151518570">The <strong id="mrs_01_24103__b9860171315512">.hoodie</strong> folder stores the log files related to file merging.<p id="mrs_01_24103__p64365554166"><span><img id="mrs_01_24103__image9726256111614" src="en-us_image_0000001439498673.png"></span></p>
|
|
</li><li id="mrs_01_24103__li6456164718589">The path containing <strong id="mrs_01_24103__b123981242120">_partition_key</strong> stores actual data files and metadata by partition.<p id="mrs_01_24103__p8060118">Hudi data files of are stored in Parquet base files and Avro log files.</p>
|
|
<p id="mrs_01_24103__p1725884713176"><span><img id="mrs_01_24103__image125116487171" src="en-us_image_0000001439380285.png"></span></p>
|
|
</li></ul>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_24062.html">Basic Operations</a></div>
|
|
</div>
|
|
</div>
|
|
|