Wuwan, Qi 050b395397 CSS UMN 23.2.1 20230926

Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com>
Co-authored-by: Wuwan, Qi <wuwanqi1@noreply.gitea.eco.tsi-dev.otc-service.com>
Co-committed-by: Wuwan, Qi <wuwanqi1@noreply.gitea.eco.tsi-dev.otc-service.com>

2024-01-10 14:23:15 +00:00

2.9 KiB

Raw Blame History

Context

Feature Description

CSS provides enhanced data import function. It optimizes bulk route, and speeds up processing through indexes and word segmentation, improving import performance and reduces bulk rejection. This function applies to clusters that contain a large number of index shards and text indexes, and have high import throughput.

Constraints

Currently, only Elasticsearch clusters of version 7.10.2 support the import performance enhancement.

Prerequisites

An Elasticsearch cluster of version 7.10.2 has been created on the CSS console.

Precautions

After the local shard preferential bulk routing optimization and bulk routing optimization are enabled, data writing is not routed based on IDs, and routing-related functions are restricted. For example, ID-based GET requests may fail. The optimization of local shard preferential bulk routing depends on the random distribution of client bulk requests and the balanced distribution of primary shards.
If index.native_speed_up (the text index acceleration function) is enabled, index_sorting is not supported.
Prerequisites for enabling index.native_analyzer:
1. The index.native_speed_up function has been enabled.

Parent topic: Enhanced Import Performance

2.9 KiB Raw Blame History