matreche/modelarts-umn
1
0
Fork 0
forked from docs/modelarts
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update content

Browse Source
This commit is contained in:
OpenTelekomCloud Proposal Bot 2022-11-08 13:22:42 +00:00
parent dba9a7336f
commit db4e8b22c6
5 changed files with 20 additions and 20 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
umn/source/data_management/importing_data/specifications_for_importing_the_manifest_file.rst
View File

@ -25,7 +25,7 @@ The manifest file that contains information about the original file and labeling
In the preceding example, the manifest file contains multiple lines of JSON object. In the preceding example, the manifest file contains multiple lines of JSON object.
- The manifest file can be generated by users, third-party tools, or ModelArts Data Labeling. The file name can be any valid file name. To facilitate the internal use of the ModelArts system, the file name generated by the ModelArts Data Labeling function consists of the following character strings: *DatasetName*-*VersionName*\ **.manifest**. For example, **animal-v201901231130304123.manifest**. - The manifest file can be generated by users, third-party tools, or ModelArts Data Labeling. The file name can be any valid file name. To facilitate the internal use of the ModelArts system, the file name generated by the ModelArts Data Labeling function consists of the following character strings: *DatasetName*\ ``-``\ *VersionName*\ **.manifest**. For example, **animal-v201901231130304123.manifest**.
.. _modelarts_23_0009__en-us_topic_0170886817_section260132417144: .. _modelarts_23_0009__en-us_topic_0170886817_section260132417144:

14
umn/source/data_management/introduction_to_data_management.rst
View File

@ -97,17 +97,17 @@ Different types of datasets support different functions. For details, see :ref:`
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Object detection | Supported | Supported | Supported | Supported | Supported | Supported | | Object detection | Supported | Supported | Supported | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Sound classification | Supported | Supported | - | Supported | Supported | Supported | | Sound classification | Supported | Supported | ``-`` | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Speech labeling | Supported | Supported | - | Supported | Supported | Supported | | Speech labeling | Supported | Supported | ``-`` | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Speech paragraph labeling | Supported | Supported | - | Supported | Supported | Supported | | Speech paragraph labeling | Supported | Supported | ``-`` | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Text classification | Supported | Supported | - | Supported | Supported | Supported | | Text classification | Supported | Supported | ``-`` | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Named entity recognition | Supported | Supported | - | Supported | Supported | Supported | | Named entity recognition | Supported | Supported | ``-`` | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Text triplet | Supported | Supported | - | Supported | Supported | Supported | | Text triplet | Supported | Supported | ``-`` | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+
| Free format | Supported | - | Supported | Supported | Supported | Supported | | Free format | Supported | ``-`` | Supported | Supported | Supported | Supported |
+---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+ +---------------------------+--------------------+----------------+----------------+----------------------+---------------------+---------------------------+

8
umn/source/training_management/creating_a_training_job/using_built-in_algorithms_to_train_models.rst
View File

@ -53,7 +53,7 @@ Creating a Training Job
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | Sub-Parameter | Description | | Parameter | Sub-Parameter | Description |
+=========================+=======================+====================================================================================================================================================================================================================================================================================================================================================+ +=========================+=======================+====================================================================================================================================================================================================================================================================================================================================================+
| One-Click Configuration | - | If you have saved job parameter configurations in ModelArts, click **One-Click Configuration** and select an existing job parameter configuration as prompted to quickly complete parameter setting for the job. | | One-Click Configuration | ``-`` | If you have saved job parameter configurations in ModelArts, click **One-Click Configuration** and select an existing job parameter configuration as prompted to quickly complete parameter setting for the job. |
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Algorithm Source | Built-in | Select a built-in algorithm in ModelArts. For details, see :ref:`Introduction to Built-in Algorithms <modelarts_23_0045>`. | | Algorithm Source | Built-in | Select a built-in algorithm in ModelArts. For details, see :ref:`Introduction to Built-in Algorithms <modelarts_23_0045>`. |
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
@ -66,17 +66,17 @@ Creating a Training Job
| | | | | | | |
| | | The dataset must meet the requirements of different types of built-in algorithms. For details, see :ref:`Requirements on Datasets <modelarts_23_0157>`. | | | | The dataset must meet the requirements of different types of built-in algorithms. For details, see :ref:`Requirements on Datasets <modelarts_23_0157>`. |
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Running Parameter | - | After you select a built-in algorithm, the running parameters that are set by default are displayed based on the selected algorithm. | | Running Parameter | ``-`` | After you select a built-in algorithm, the running parameters that are set by default are displayed based on the selected algorithm. |
| | | | | | | |
| | | You can modify the parameters based on the actual requirements. For details about the running parameters of different algorithms, see :ref:`Algorithms and Their Running Parameters <modelarts_23_0158>`. You can also use the default values to create a training job. If the training result is unsatisfactory, you can optimize the parameters. | | | | You can modify the parameters based on the actual requirements. For details about the running parameters of different algorithms, see :ref:`Algorithms and Their Running Parameters <modelarts_23_0158>`. You can also use the default values to create a training job. If the training result is unsatisfactory, you can optimize the parameters. |
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Training Output Path | - | Storage path of the training result | | Training Output Path | ``-`` | Storage path of the training result |
| | | | | | | |
| | | .. note:: | | | | .. note:: |
| | | | | | | |
| | | To minimize errors, select an empty directory for **Training Output Path**. Do not select the directory used for storing the dataset for **Training Output Path**. | | | | To minimize errors, select an empty directory for **Training Output Path**. Do not select the directory used for storing the dataset for **Training Output Path**. |
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Job Log Path | - | Select a path for storing log files generated during job running. | | Job Log Path | ``-`` | Select a path for storing log files generated during job running. |
+-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
c. Select resources for the training job. c. Select resources for the training job.

8
umn/source/training_management/creating_a_training_job/using_custom_images_to_train_models.rst
View File

@ -57,7 +57,7 @@ Creating a Training Job
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | Sub-Parameter | Description | | Parameter | Sub-Parameter | Description |
+=========================+=======================+=========================================================================================================================================================================================================================================================================================================+ +=========================+=======================+=========================================================================================================================================================================================================================================================================================================+
| One-Click Configuration | - | If you have saved job parameter configurations in ModelArts, click **One-Click Configuration** and select an existing job parameter configuration as prompted to quickly complete parameter setting for the job. | | One-Click Configuration | ``-`` | If you have saved job parameter configurations in ModelArts, click **One-Click Configuration** and select an existing job parameter configuration as prompted to quickly complete parameter setting for the job. |
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Algorithm Source | Custom | For details about custom image specifications, see :ref:`Specifications for Custom Images Used for Training Jobs <modelarts_23_0217>`. | | Algorithm Source | Custom | For details about custom image specifications, see :ref:`Specifications for Custom Images Used for Training Jobs <modelarts_23_0217>`. |
| | | | | | | |
@ -72,15 +72,15 @@ Creating a Training Job
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| | Data path | Select the training data from your OBS bucket. On the right of the **Data path** text box, click **Select**. In the dialog box that is displayed, select an OBS folder for storing data. | | | Data path | Select the training data from your OBS bucket. On the right of the **Data path** text box, click **Select**. In the dialog box that is displayed, select an OBS folder for storing data. |
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Training Output Path | - | Storage path of the training result | | Training Output Path | ``-`` | Storage path of the training result |
| | | | | | | |
| | | .. note:: | | | | .. note:: |
| | | | | | | |
| | | To minimize errors, select an empty directory for **Training Output Path**. Do not select the directory used for storing the dataset for **Training Output Path**. | | | | To minimize errors, select an empty directory for **Training Output Path**. Do not select the directory used for storing the dataset for **Training Output Path**. |
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Environment Variable | - | Add environment variables based on your image file. This parameter is optional. You can click **Add Environment Variable** to add multiple variable parameters. | | Environment Variable | ``-`` | Add environment variables based on your image file. This parameter is optional. You can click **Add Environment Variable** to add multiple variable parameters. |
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Job Log Path | - | Select a path for storing log files generated during job running. | | Job Log Path | ``-`` | Select a path for storing log files generated during job running. |
+-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
c. Select resources for the training job. c. Select resources for the training job.

8
umn/source/training_management/creating_a_training_job/using_frequently-used_frameworks_to_train_models.rst
View File

@ -87,7 +87,7 @@ Creating a Training Job
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | Sub-Parameter | Description | | Parameter | Sub-Parameter | Description |
+=========================+=======================+=================================================================================================================================================================================================================================================================================================================+ +=========================+=======================+=================================================================================================================================================================================================================================================================================================================+
| One-Click Configuration | - | If you have saved job parameter configurations in ModelArts, click **One-Click Configuration** and select an existing job parameter configuration as prompted to quickly complete parameter setting for the job. | | One-Click Configuration | ``-`` | If you have saved job parameter configurations in ModelArts, click **One-Click Configuration** and select an existing job parameter configuration as prompted to quickly complete parameter setting for the job. |
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Algorithm Source | Frequently-used | Select an AI engine and its version and specify **Code Directory** and **Boot File**. The framework selected for the AI engine must be the same as the one you select when compiling training code. For example, if TensorFlow is used in your training code, select TensorFlow when you create a training job. | | Algorithm Source | Frequently-used | Select an AI engine and its version and specify **Code Directory** and **Boot File**. The framework selected for the AI engine must be the same as the one you select when compiling training code. For example, if TensorFlow is used in your training code, select TensorFlow when you create a training job. |
| | | | | | | |
@ -100,17 +100,17 @@ Creating a Training Job
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| | Data path | Select the training data from your OBS bucket. On the right of the **Data path** text box, click **Select**. In the dialog box that is displayed, select an OBS folder for storing data. | | | Data path | Select the training data from your OBS bucket. On the right of the **Data path** text box, click **Select**. In the dialog box that is displayed, select an OBS folder for storing data. |
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Training Output Path | - | Select a path for storing the training result. | | Training Output Path | ``-`` | Select a path for storing the training result. |
| | | | | | | |
| | | .. note:: | | | | .. note:: |
| | | | | | | |
| | | To minimize errors, select an empty directory for **Training Output Path**. Do not select the directory used for storing the dataset for **Training Output Path**. | | | | To minimize errors, select an empty directory for **Training Output Path**. Do not select the directory used for storing the dataset for **Training Output Path**. |
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Running Parameter | - | Set the command line parameters in the code based on the algorithm code logic. Make sure that the parameter names are the same as those in the code. | | Running Parameter | ``-`` | Set the command line parameters in the code based on the algorithm code logic. Make sure that the parameter names are the same as those in the code. |
| | | | | | | |
| | | For example, **train_steps = 10000**, where **train_steps** is a passing parameter in code. | | | | For example, **train_steps = 10000**, where **train_steps** is a passing parameter in code. |
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Job Log Path | - | Select a path for storing log files generated during job running. | | Job Log Path | ``-`` | Select a path for storing log files generated during job running. |
+-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-------------------------+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
c. Select resources for the training job. c. Select resources for the training job.