Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com> Co-committed-by: Xiong, Chen Xiao <chenxiaoxiong@huawei.com>
11 KiB
From HTTP/HTTPS
Sample JSON File
"from-config-values": { "configs": [ { "inputs": [ { "name": "fromJobConfig.inputDirectory", "value": "http://10.114.196.186:8080/httpfrom/symbol.txt" }, { "name": "fromJobConfig.inputFormat", "value": "BINARY_FILE" }, { "name": "fromJobConfig.fromCompression", "value": "TARGZ" }, { "name": "fromJobConfig.compressedFileSuffix", "value": "*" }, { "name": "fromJobConfig.fileSeparator", "value": "|" } ], "name": "fromJobConfig" } ] }
Parameter Description
Parameter |
Mandatory |
Type |
Description |
---|---|---|---|
fromJobConfig.inputDirectory |
Yes |
String |
URL of the file to be extracted These connectors are used to read files with an HTTP/HTTPS URL, such as reading public files on the third-party object storage system and web disks. |
fromJobConfig.inputFormat |
Yes |
Enumeration |
File format required for data transmission. Currently, only the binary format is supported. |
fromJobConfig.fromCompression |
No |
Enumeration |
Compression format of the source files. The options are as follows:
|
fromJobConfig.compressedFileSuffix |
No |
String |
Extension of the files to be decompressed. The decompression operation is performed only when the file name extension is used in a batch of files. Otherwise, files are transferred in the original format. If you enter * or leave the parameter blank, all files are decompressed. |
fromJobConfig.fileSeparator |
No |
String |
File separator. When multiple files are transferred, CDM uses the file separator to separate files. The default value is |. |
fromJobConfig.useQuery |
No |
Boolean |
|
fromJobConfig.md5FileSuffix |
No |
String |
Check whether the files extracted by CDM are consistent with those in the migration source. |