Xiong, Chen Xiao f3ee29a3dd DataArts UMN 20230329 version

Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com>
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
Co-committed-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>

2023-05-11 17:09:25 +00:00

9.4 KiB

Raw Permalink Blame History

From Kafka/DMS Kafka

If the source link of a job is the Link to Kafka or Link to DMS Kafka, configure the source job parameters based on Table 1.

**Table 1** Parameter description
Parameter	Description	Example Value
Topics	One or more topics can be entered.	est1,est2
Offset	Initial offset parameter Latest: Maximum offset, indicating that the latest data will be extracted. Earliest: Minimum offset, indicating that the earliest data will be extracted. Submitted: data that has been submitted Time Range: data within a specified time range	Latest
Permanent Running	Whether a job runs permanently.	Yes
Consumer Group ID	Consumer group ID If you export data from DMS Kafka, enter any value for Kafka Platinum but a valid consumer group ID for Kafka Basic.	sumer-group
Data Format	Format used for parsing data. The options are as follows: Binary: Data is transferred directly. It is not converted to another format. This setting is suitable for file migration. CSV: Source data will be migrated after being converted in CSV format. JSON: Source data will be migrated after being converted in JSON format. CDC (DRS_JSON): Source data will be migrated after being converted in DRS_JSON format.	Binary
Field Delimiter	The default value is space. To set the Tab key as the delimiter, set this parameter to \t.	,
Max. Poll Records	(Optional) Maximum number of records per poll	100
Max. Poll Interval	(Optional) Maximum interval between polls (seconds)	100

Parent topic: Source Job Parameters

9.4 KiB Raw Permalink Blame History

From Kafka/DMS Kafka

9.4 KiB

Raw Permalink Blame History