vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_0055.html
Xiong, Chen Xiao f3ee29a3dd DataArts UMN 20230329 version 
Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com>
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
Co-committed-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
2023-05-11 17:09:25 +00:00

6.4 KiB
Raw Permalink Blame History

From MongoDB/DDS

When you migrate MongoDB or DDS data, CDM reads the first row of the collection as an example of the field list. If the first row of data does not contain all fields of the collection, you need to manually add fields.

When the source link of a job is the Link to MongoDB, that is, when data is exported from an on-premises MongoDB or DDS, configure the source job parameters based on Table 1.
Table 1 Parameter description

Parameter

Description

Example Value

Database Name

Name of the database from which data will be migrated

mongodb

Collection Name

Collection name, similar to the table name of a relational database. Click the icon next to the text box to go to the page for selecting the collection or directly enter a collection name.

If the desired table is not displayed, check whether the table exists or whether the login account has the permission to query metadata.

COLLECTION

Filter Condition
Conditions for filtering documents. CDM migrates only the data that meets the filter conditions. The examples are as follows:
  1. Filter by expression: {'last_name': 'Smith'} indicates that all files whose last_name value is Smith are queried.
  2. Filter by parameter: { x : "john" }, { z : 1 } indicates that all z fields whose x is john are queried.
  3. Filter by condition: { "field" : { $gt: 5 } } indicates that the field values greater than 5 are queried.
  4. Filter by time macro:

    {"ts":{$gte:ISODate("${dateformat(yyyy-MM-dd'T'HH:mm:ss.SSS'Z',-1,HOUR)}")}} indicates that the values greater than those after time macro conversion in the ts field are queried.

{'last_name': 'Smith'}
Parent topic: Source Job Parameters