Result files are created when tasks are running. Flink enables you to configure parameters for file creation.
Configuration items include overwriting policy and directory creation.
Parameter |
Description |
Default Value |
Mandatory |
---|---|---|---|
fs.overwrite-files |
Whether to overwrite the existing file by default when the file is written. |
false |
No |
fs.output.always-create-directory |
When the degree of parallelism (DOP) of file writing programs is greater than 1, a directory is created under the output file path and different result files (one for each parallel writing program) are stored in the directory.
|
false |
No |