doc-exports/docs/dms/umn/kafka-faq-200426025.html
Chen, Junjie dd8a3a658b DMS UMN Initial Version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Chen, Junjie <chenjunjie@huawei.com>
Co-committed-by: Chen, Junjie <chenjunjie@huawei.com>
2022-12-08 00:33:11 +00:00

91 lines
8.1 KiB
HTML

<a name="kafka-faq-200426025"></a><a name="kafka-faq-200426025"></a>
<h1 class="topictitle1">Why Is Partition Quantity Limited?</h1>
<div id="body1587865451575"><p id="kafka-faq-200426025__p11227976415">Kafka manages messages by partition. If there are too many partitions, message creation, storage, and retrieval will be fragmented, affecting the performance and stability. If the total number of partitions of topics reaches the upper limit, you cannot create more topics.</p>
<p id="kafka-faq-200426025__p1211614225486">The partition limit varies depending on the flavor, as shown in the following table.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426025__table144291318135519" frame="border" border="1" rules="all"><caption><b>Table 1 </b>TPS and the maximum number of partitions supported by different instance specifications and I/O types</caption><thead align="left"><tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row887661474817"><th align="left" class="cellrowborder" valign="top" width="16.91169116911691%" id="mcps1.3.3.2.6.1.1"><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p187611474813">Bandwidth</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.79197919791979%" id="mcps1.3.3.2.6.1.2"><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p087601415481">I/O Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="23.54235423542354%" id="mcps1.3.3.2.6.1.3"><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p7876121417484">TPS (High-Throughput)</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.53215321532153%" id="mcps1.3.3.2.6.1.4"><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p2876514144817">TPS (Synchronous Replication)</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="18.22182218221822%" id="mcps1.3.3.2.6.1.5"><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p473420062316">Maximum Partitions</p>
</th>
</tr>
</thead>
<tbody><tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row14876161419486"><td class="cellrowborder" rowspan="2" valign="top" width="16.91169116911691%" headers="mcps1.3.3.2.6.1.1 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p887611420481">100 MB/s</p>
</td>
<td class="cellrowborder" valign="top" width="19.79197919791979%" headers="mcps1.3.3.2.6.1.2 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p587641494812">High I/O</p>
</td>
<td class="cellrowborder" valign="top" width="23.54235423542354%" headers="mcps1.3.3.2.6.1.3 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p6876191454812">100,000</p>
</td>
<td class="cellrowborder" valign="top" width="21.53215321532153%" headers="mcps1.3.3.2.6.1.4 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p13876214144813">60,000</p>
</td>
<td class="cellrowborder" valign="top" width="18.22182218221822%" headers="mcps1.3.3.2.6.1.5 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1973490132315">300</p>
</td>
</tr>
<tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row987671494818"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.1 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p14877191414814">Ultra-high I/O</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.2 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p38771414124820">100,000</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.3 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1787711464810">80,000</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.4 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p177341503239">300</p>
</td>
</tr>
<tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row1987731414488"><td class="cellrowborder" rowspan="2" valign="top" width="16.91169116911691%" headers="mcps1.3.3.2.6.1.1 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p158771145486">300 MB/s</p>
</td>
<td class="cellrowborder" valign="top" width="19.79197919791979%" headers="mcps1.3.3.2.6.1.2 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p81946616198">High I/O</p>
</td>
<td class="cellrowborder" valign="top" width="23.54235423542354%" headers="mcps1.3.3.2.6.1.3 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1219412617194">300,000</p>
</td>
<td class="cellrowborder" valign="top" width="21.53215321532153%" headers="mcps1.3.3.2.6.1.4 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p19194186201918">150,000</p>
</td>
<td class="cellrowborder" valign="top" width="18.22182218221822%" headers="mcps1.3.3.2.6.1.5 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p19734170132314">900</p>
</td>
</tr>
<tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row1987711149481"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.1 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p919618691910">Ultra-high I/O</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.2 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p8196186121912">300,000</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.3 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p141960610191">200,000</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.6.1.4 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p373400192312">900</p>
</td>
</tr>
<tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row10877414124815"><td class="cellrowborder" valign="top" width="16.91169116911691%" headers="mcps1.3.3.2.6.1.1 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p19877111424819">600 MB/s</p>
</td>
<td class="cellrowborder" valign="top" width="19.79197919791979%" headers="mcps1.3.3.2.6.1.2 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p6887132015">Ultra-high I/O</p>
</td>
<td class="cellrowborder" valign="top" width="23.54235423542354%" headers="mcps1.3.3.2.6.1.3 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1088181172014">600,000</p>
</td>
<td class="cellrowborder" valign="top" width="21.53215321532153%" headers="mcps1.3.3.2.6.1.4 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1088417205">300,000</p>
</td>
<td class="cellrowborder" valign="top" width="18.22182218221822%" headers="mcps1.3.3.2.6.1.5 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1973450182313">1800</p>
</td>
</tr>
<tr id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_row1020392861910"><td class="cellrowborder" valign="top" width="16.91169116911691%" headers="mcps1.3.3.2.6.1.1 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1320352841912">1200 MB/s</p>
</td>
<td class="cellrowborder" valign="top" width="19.79197919791979%" headers="mcps1.3.3.2.6.1.2 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p1841726206">Ultra-high I/O</p>
</td>
<td class="cellrowborder" valign="top" width="23.54235423542354%" headers="mcps1.3.3.2.6.1.3 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p6842252018">1,200,000</p>
</td>
<td class="cellrowborder" valign="top" width="21.53215321532153%" headers="mcps1.3.3.2.6.1.4 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p98420232017">400,000</p>
</td>
<td class="cellrowborder" valign="top" width="18.22182218221822%" headers="mcps1.3.3.2.6.1.5 "><p id="kafka-faq-200426025__kafka-specification_en-us_topic_0159429488_p187342062312">1800</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="kafka-faq-191030003.html">Topics and Partitions</a></div>
</div>
</div>