forked from docs/mapreduce-service
Compare commits
1 Commits
main
...
propose-mr
Author | SHA1 | Date | |
---|---|---|---|
20d4b1be3f |
@ -32,9 +32,9 @@ Request
|
|||||||
|
|
||||||
.. table:: **Table 2** Request parameter description
|
.. table:: **Table 2** Request parameter description
|
||||||
|
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| Parameter | Mandatory | Type | Description |
|
| Parameter | Mandatory | Type | Description |
|
||||||
+==================+=================+=================+=============================================================================================================================================================================================================================================================================================================================================================================+
|
+==================+=================+=================+=================================================================================================================================================================================================================================================================================================================================================================================+
|
||||||
| job_type | Yes | Integer | Job type code |
|
| job_type | Yes | Integer | Job type code |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | - 1: MapReduce |
|
| | | | - 1: MapReduce |
|
||||||
@ -48,7 +48,7 @@ Request
|
|||||||
| | | | .. note:: |
|
| | | | .. note:: |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | Spark and Hive jobs can be added to only clusters that include Spark and Hive components. |
|
| | | | Spark and Hive jobs can be added to only clusters that include Spark and Hive components. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| job_name | Yes | String | Job name |
|
| job_name | Yes | String | Job name |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | Contains only 1 to 64 letters, digits, hyphens (-), and underscores (_). |
|
| | | | Contains only 1 to 64 letters, digits, hyphens (-), and underscores (_). |
|
||||||
@ -56,9 +56,9 @@ Request
|
|||||||
| | | | .. note:: |
|
| | | | .. note:: |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | Identical job names are allowed but not recommended. |
|
| | | | Identical job names are allowed but not recommended. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| cluster_id | Yes | String | Cluster ID |
|
| cluster_id | Yes | String | Cluster ID |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| jar_path | Yes | String | Path of the JAR or SQL file for program execution |
|
| jar_path | Yes | String | Path of the JAR or SQL file for program execution |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | The parameter must meet the following requirements: |
|
| | | | The parameter must meet the following requirements: |
|
||||||
@ -66,29 +66,29 @@ Request
|
|||||||
| | | | - Contains a maximum of 1,023 characters, excluding special characters such as ``;|&><'$.`` The address cannot be empty or full of spaces. |
|
| | | | - Contains a maximum of 1,023 characters, excluding special characters such as ``;|&><'$.`` The address cannot be empty or full of spaces. |
|
||||||
| | | | - Starts with **/** or **s3a://**. The OBS path does not support files or programs encrypted by KMS. |
|
| | | | - Starts with **/** or **s3a://**. The OBS path does not support files or programs encrypted by KMS. |
|
||||||
| | | | - Spark Script must end with **.sql** while MapReduce and Spark Jar must end with **.jar**.\ **sql** and **jar** are case-insensitive. |
|
| | | | - Spark Script must end with **.sql** while MapReduce and Spark Jar must end with **.jar**.\ **sql** and **jar** are case-insensitive. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| arguments | No | String | Key parameter for program execution. The parameter is specified by the function of the user's program. MRS is only responsible for loading the parameter. |
|
| arguments | No | String | Key parameter for program execution. The parameter is specified by the function of the user's program. MRS is only responsible for loading the parameter. |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | The parameter contains a maximum of 2,047 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
| | | | The parameter contains a maximum of 2,047 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | .. note:: |
|
| | | | .. note:: |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | When entering a parameter containing sensitive information (for example, login password), you can add an at sign (@) before the parameter name to encrypt the parameter value. This prevents the sensitive information from being persisted in plaintext. Therefore, when you view job information on the MRS, sensitive information will be displayed as asterisks (*). |
|
| | | | When entering a parameter containing sensitive information (for example, login password), you can add an at sign (@) before the parameter name to encrypt the parameter value. This prevents the sensitive information from being persisted in plaintext. Therefore, when you view job information on the MRS, sensitive information will be displayed as asterisks (``*``). |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | For example, username=admin @password=admin_123. |
|
| | | | For example, username=admin @password=admin_123. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| input | No | String | Path for inputting data, which must start with **/** or **s3a://**. Set this parameter to a correct OBS path. The OBS path does not support files or programs encrypted by KMS. |
|
| input | No | String | Path for inputting data, which must start with **/** or **s3a://**. Set this parameter to a correct OBS path. The OBS path does not support files or programs encrypted by KMS. |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | The parameter contains a maximum of 1,023 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
| | | | The parameter contains a maximum of 1,023 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| output | No | String | Path for outputting data, which must start with **/** or **s3a://**. A correct OBS path is required. If the path does not exist, the system automatically creates it. |
|
| output | No | String | Path for outputting data, which must start with **/** or **s3a://**. A correct OBS path is required. If the path does not exist, the system automatically creates it. |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | The parameter contains a maximum of 1,023 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
| | | | The parameter contains a maximum of 1,023 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| job_log | No | String | Path for storing job logs that record job running status. The path must start with **/** or **s3a://**. A correct OBS path is required. |
|
| job_log | No | String | Path for storing job logs that record job running status. The path must start with **/** or **s3a://**. A correct OBS path is required. |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | The parameter contains a maximum of 1,023 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
| | | | The parameter contains a maximum of 1,023 characters, excluding special characters such as ``;|&>'<$,`` and can be left blank. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
| hive_script_path | Yes | String | SQL program path |
|
| hive_script_path | Yes | String | SQL program path |
|
||||||
| | | | |
|
| | | | |
|
||||||
| | | | This parameter is needed by Spark Script and Hive Script jobs only, and must meet the following requirements: |
|
| | | | This parameter is needed by Spark Script and Hive Script jobs only, and must meet the following requirements: |
|
||||||
@ -96,7 +96,7 @@ Request
|
|||||||
| | | | - Contains a maximum of 1,023 characters, excluding special characters such as ``;|&><'$.`` The address cannot be empty or full of spaces. |
|
| | | | - Contains a maximum of 1,023 characters, excluding special characters such as ``;|&><'$.`` The address cannot be empty or full of spaces. |
|
||||||
| | | | - The path must start with **/** or **s3a://**. The OBS path does not support files or programs encrypted by KMS. |
|
| | | | - The path must start with **/** or **s3a://**. The OBS path does not support files or programs encrypted by KMS. |
|
||||||
| | | | - The path must end with **.sql**.\ **sql** is case-insensitive. |
|
| | | | - The path must end with **.sql**.\ **sql** is case-insensitive. |
|
||||||
+------------------+-----------------+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
+------------------+-----------------+-----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|
||||||
|
|
||||||
.. _mrs_02_0040__table3863810010324:
|
.. _mrs_02_0040__table3863810010324:
|
||||||
|
|
||||||
|
Loading…
x
Reference in New Issue
Block a user