vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/modelarts/sdk-ref/modelarts_04_0168.html
Lai, Weijian eda19245f1 modelarts sdk-ref version 21.430 update 
Reviewed-by: Jiang, Beibei <beibei.jiang@t-systems.com>
Reviewed-by: Rechenburg, Matthias <matthias.rechenburg@t-systems.com>
Co-authored-by: Lai, Weijian <laiweijian4@huawei.com>
Co-committed-by: Lai, Weijian <laiweijian4@huawei.com>
2023-03-20 09:32:27 +00:00

362 lines
43 KiB
HTML
Raw Blame History

<a name="modelarts_04_0168"></a><a name="modelarts_04_0168"></a>
<h1 class="topictitle1">Creating a Training Job Version</h1>
<div id="body8662426"><p id="modelarts_04_0168__en-us_topic_0180094062_p1425244711510">A training job must exist before you create a version for it. You can create a training job version based on <a href="modelarts_04_0131.html">Creating a Training Job</a> or <strong id="modelarts_04_0168__en-us_topic_0180094062_b172312519564">job_id</strong> and <strong id="modelarts_04_0168__en-us_topic_0180094062_b1421802819566">version_id</strong> of the object returned by <a href="modelarts_04_0169.html">Querying the List of Training Job Versions</a>.</p>
<div class="section" id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_section20261580353"><h4 class="sectiontitle">Sample Code</h4><p id="modelarts_04_0168__en-us_topic_0180094062_p394185815312">In the ModelArts notebook instance, you do not need to enter authentication parameters for session authentication. For details about session authentication of other development environments, see <a href="modelarts_04_0123.html">Session Authentication</a>.</p>
<ul id="modelarts_04_0168__en-us_topic_0180094062_ul82041984716"><li id="modelarts_04_0168__en-us_topic_0180094062_li520510914710">Example 1: Create a training job version using the data stored on OBS.<div class="codecoloring" codetype="Python" id="modelarts_04_0168__en-us_topic_0180094062_screen528153434719"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span>
<span class="normal">13</span>
<span class="normal">14</span>
<span class="normal">15</span>
<span class="normal">16</span>
<span class="normal">17</span>
<span class="normal">18</span>
<span class="normal">19</span>
<span class="normal">20</span></pre></div></td><td class="code"><div><pre><span></span><span class="kn">from</span> <span class="nn">modelarts.session</span> <span class="kn">import</span> <span class="n">Session</span>
<span class="kn">from</span> <span class="nn">modelarts.estimator</span> <span class="kn">import</span> <span class="n">Estimator</span>
<span class="n">session</span> <span class="o">=</span> <span class="n">Session</span><span class="p">()</span>
<span class="n">estimator</span> <span class="o">=</span> <span class="n">Estimator</span><span class="p">(</span>
<span class="n">modelarts_session</span><span class="o">=</span><span class="n">session</span><span class="p">,</span>
<span class="n">framework_type</span><span class="o">=</span><span class="s1">'PyTorch'</span><span class="p">,</span> <span class="c1"># AI engine name</span>
<span class="n">framework_version</span><span class="o">=</span><span class="s1">'PyTorch-1.0.0-python3.6'</span><span class="p">,</span> <span class="c1"># AI engine version</span>
<span class="n">code_dir</span><span class="o">=</span><span class="s1">'/bucket/src/'</span><span class="p">,</span> <span class="c1"># Training script directory</span>
<span class="n">boot_file</span><span class="o">=</span><span class="s1">'/bucket/src/pytorch_sentiment.py'</span><span class="p">,</span> <span class="c1"># Training boot script directory</span>
<span class="n">log_url</span><span class="o">=</span><span class="s1">'/bucket/log/'</span><span class="p">,</span> <span class="c1"># Training log directory</span>
<span class="n">hyperparameters</span><span class="o">=</span><span class="p">[</span>
<span class="p">{</span><span class="s2">&quot;label&quot;</span><span class="p">:</span><span class="s2">&quot;classes&quot;</span><span class="p">,</span>
<span class="s2">&quot;value&quot;</span><span class="p">:</span> <span class="s2">&quot;10&quot;</span><span class="p">},</span>
<span class="p">{</span><span class="s2">&quot;label&quot;</span><span class="p">:</span><span class="s2">&quot;lr&quot;</span><span class="p">,</span>
<span class="s2">&quot;value&quot;</span><span class="p">:</span> <span class="s2">&quot;0.001&quot;</span><span class="p">}</span>
<span class="p">],</span>
<span class="n">output_path</span><span class="o">=</span><span class="s1">'/bucket/output/'</span><span class="p">,</span> <span class="c1"># Training output directory</span>
<span class="n">train_instance_type</span><span class="o">=</span><span class="s1">'modelarts.vm.gpu.p100'</span><span class="p">,</span> <span class="c1"># Training environment flavor</span>
<span class="n">train_instance_count</span><span class="o">=</span><span class="mi">1</span><span class="p">)</span>
<span class="n">job_version_instance</span> <span class="o">=</span> <span class="n">estimator</span><span class="o">.</span><span class="n">create_job_version</span><span class="p">(</span><span class="n">job_id</span><span class="o">=</span><span class="s1">'182626'</span><span class="p">,</span> <span class="n">pre_version_id</span><span class="o">=</span><span class="mi">278813</span><span class="p">,</span> <span class="n">inputs</span><span class="o">=</span><span class="s1">'/bucket/data/train/'</span><span class="p">,</span> <span class="n">wait</span><span class="o">=</span><span class="kc">False</span><span class="p">,</span> <span class="n">job_desc</span><span class="o">=</span><span class="s1">'create a job version'</span><span class="p">)</span>
</pre></div></td></tr></table></div>
</div>
</li></ul>
<ul id="modelarts_04_0168__en-us_topic_0180094062_ul655191274710"><li id="modelarts_04_0168__en-us_topic_0180094062_li65541213474">Example 2: Create a training job version using a dataset.<div class="codecoloring" codetype="Python" id="modelarts_04_0168__en-us_topic_0180094062_screen16697154213471"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span>
<span class="normal">13</span>
<span class="normal">14</span>
<span class="normal">15</span>
<span class="normal">16</span>
<span class="normal">17</span>
<span class="normal">18</span>
<span class="normal">19</span>
<span class="normal">20</span>
<span class="normal">21</span></pre></div></td><td class="code"><div><pre><span></span><span class="kn">from</span> <span class="nn">modelarts.session</span> <span class="kn">import</span> <span class="n">Session</span>
<span class="kn">from</span> <span class="nn">modelarts.estimator</span> <span class="kn">import</span> <span class="n">Estimator</span>
<span class="n">session</span> <span class="o">=</span> <span class="n">Session</span><span class="p">()</span>
<span class="n">estimator</span> <span class="o">=</span> <span class="n">Estimator</span><span class="p">(</span>
<span class="n">modelarts_session</span><span class="o">=</span><span class="n">session</span><span class="p">,</span>
<span class="n">framework_type</span><span class="o">=</span><span class="s1">'PyTorch'</span><span class="p">,</span> <span class="c1"># AI engine name</span>
<span class="n">framework_version</span><span class="o">=</span><span class="s1">'PyTorch-1.0.0-python3.6'</span><span class="p">,</span> <span class="c1"># AI engine version</span>
<span class="n">code_dir</span><span class="o">=</span><span class="s1">'/bucket/src/'</span><span class="p">,</span> <span class="c1"># Training script directory</span>
<span class="n">boot_file</span><span class="o">=</span><span class="s1">'/bucket/src/pytorch_sentiment.py'</span><span class="p">,</span> <span class="c1"># Training boot script directory</span>
<span class="n">log_url</span><span class="o">=</span><span class="s1">'/bucket/log/'</span><span class="p">,</span> <span class="c1"># Training log directory</span>
<span class="n">hyperparameters</span><span class="o">=</span><span class="p">[</span>
<span class="p">{</span><span class="s2">&quot;label&quot;</span><span class="p">:</span><span class="s2">&quot;classes&quot;</span><span class="p">,</span>
<span class="s2">&quot;value&quot;</span><span class="p">:</span> <span class="s2">&quot;10&quot;</span><span class="p">},</span>
<span class="p">{</span><span class="s2">&quot;label&quot;</span><span class="p">:</span><span class="s2">&quot;lr&quot;</span><span class="p">,</span>
<span class="s2">&quot;value&quot;</span><span class="p">:</span> <span class="s2">&quot;0.001&quot;</span><span class="p">}</span>
<span class="p">],</span>
<span class="n">output_path</span><span class="o">=</span><span class="s1">'/bucket/output/'</span><span class="p">,</span> <span class="c1"># Training output directory</span>
<span class="n">train_instance_type</span><span class="o">=</span><span class="s1">'modelarts.vm.gpu.p100'</span><span class="p">,</span> <span class="c1"># Training environment flavor</span>
<span class="n">train_instance_count</span><span class="o">=</span><span class="mi">1</span><span class="p">,</span> <span class="c1"># Number of training nodes</span>
<span class="n">job_description</span><span class="o">=</span><span class="s1">'pytorch-sentiment with ModelArts SDK'</span><span class="p">)</span> <span class="c1"># Training job description</span>
<span class="n">job_version_instance</span> <span class="o">=</span> <span class="n">estimator</span><span class="o">.</span><span class="n">create_job_version</span><span class="p">(</span><span class="n">job_id</span><span class="o">=</span><span class="s1">'182626'</span><span class="p">,</span> <span class="n">pre_version_id</span><span class="o">=</span><span class="mi">278813</span><span class="p">,</span> <span class="n">inputs</span><span class="o">=</span><span class="s1">'/bucket/data/train/'</span><span class="p">,</span> <span class="n">wait</span><span class="o">=</span><span class="kc">False</span><span class="p">,</span> <span class="n">job_desc</span><span class="o">=</span><span class="s1">'create a job version'</span><span class="p">)</span>
</pre></div></td></tr></table></div>
</div>
</li></ul>
<ul id="modelarts_04_0168__en-us_topic_0180094062_ul125931722194716"><li id="modelarts_04_0168__en-us_topic_0180094062_li1232603135">Example 3: Create a training job version using a custom image.<div class="codecoloring" codetype="Python" id="modelarts_04_0168__en-us_topic_0180094062_screen2394102811481"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span>
<span class="normal">13</span>
<span class="normal">14</span>
<span class="normal">15</span>
<span class="normal">16</span>
<span class="normal">17</span>
<span class="normal">18</span>
<span class="normal">19</span></pre></div></td><td class="code"><div><pre><span></span><span class="kn">from</span> <span class="nn">modelarts.session</span> <span class="kn">import</span> <span class="n">Session</span>
<span class="kn">from</span> <span class="nn">modelarts.estimator</span> <span class="kn">import</span> <span class="n">Estimator</span>
<span class="n">session</span> <span class="o">=</span> <span class="n">Session</span><span class="p">()</span>
<span class="n">estimator</span> <span class="o">=</span> <span class="n">Estimator</span><span class="p">(</span>
<span class="n">modelarts_session</span><span class="o">=</span><span class="n">session</span><span class="p">,</span>
<span class="n">log_url</span><span class="o">=</span><span class="s1">'/bucket/log/'</span><span class="p">,</span> <span class="c1"># Training log directory</span>
<span class="n">hyperparameters</span><span class="o">=</span><span class="p">[</span>
<span class="p">{</span><span class="s2">&quot;label&quot;</span><span class="p">:</span><span class="s2">&quot;classes&quot;</span><span class="p">,</span>
<span class="s2">&quot;value&quot;</span><span class="p">:</span> <span class="s2">&quot;10&quot;</span><span class="p">},</span>
<span class="p">{</span><span class="s2">&quot;label&quot;</span><span class="p">:</span><span class="s2">&quot;lr&quot;</span><span class="p">,</span>
<span class="s2">&quot;value&quot;</span><span class="p">:</span> <span class="s2">&quot;0.001&quot;</span><span class="p">}</span>
<span class="p">],</span>
<span class="n">output_path</span><span class="o">=</span><span class="s1">'/bucket/output/'</span><span class="p">,</span> <span class="c1"># Training output directory</span>
<span class="n">train_instance_type</span><span class="o">=</span><span class="s1">'modelarts.vm.gpu.p100'</span><span class="p">,</span> <span class="c1"># Training environment flavor</span>
<span class="n">train_instance_count</span><span class="o">=</span><span class="mi">1</span><span class="p">,</span> <span class="c1"># Number of training nodes</span>
<span class="n">user_command</span><span class="o">=</span><span class="s1">'bash -x /home/work/run_train.sh python /home/work/user-job-dir/app/mnist/mnist_softmax.py --data_url /home/work/user-job-dir/app/mnist_data'</span><span class="p">,</span> <span class="c1"># Boot command of the custom image</span>
<span class="n">user_image_url</span><span class="o">=</span><span class="s1">'100.125.5.235:20202/jobmng/cpu-base:1.0'</span><span class="p">,</span> <span class="c1"># Address for downloading the custom image</span>
<span class="n">job_description</span><span class="o">=</span><span class="s1">'pytorch-sentiment with ModelArts SDK'</span><span class="p">)</span> <span class="c1"># Training job description</span>
<span class="n">job_version_instance</span> <span class="o">=</span> <span class="n">estimator</span><span class="o">.</span><span class="n">create_job_version</span><span class="p">(</span><span class="n">job_id</span><span class="o">=</span><span class="s1">'182626'</span><span class="p">,</span> <span class="n">pre_version_id</span><span class="o">=</span><span class="mi">278813</span><span class="p">,</span> <span class="n">inputs</span><span class="o">=</span><span class="s1">'/bucket/data/train/'</span><span class="p">,</span> <span class="n">wait</span><span class="o">=</span><span class="kc">False</span><span class="p">,</span> <span class="n">job_desc</span><span class="o">=</span><span class="s1">'create a job version'</span><span class="p">)</span>
</pre></div></td></tr></table></div>
</div>
</li></ul>
</div>
<div class="section" id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_section4735195219416"><h4 class="sectiontitle">Parameter Description</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_table155461191218" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Estimator request parameters</caption><thead align="left"><tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row254817912212"><th align="left" class="cellrowborder" valign="top" width="22.75%" id="mcps1.3.3.2.2.5.1.1"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p12549899214">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="9.879999999999999%" id="mcps1.3.3.2.2.5.1.2"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p3552101193813">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="13.320000000000002%" id="mcps1.3.3.2.2.5.1.3"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1755169172118">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="54.05%" id="mcps1.3.3.2.2.5.1.4"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p55521998211">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row8893215413"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p6891421842">modelarts_session</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p68972047">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p158912219419">Object</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1689152543">Session object. For details about the initialization method, see <a href="modelarts_04_0123.html">Session Authentication</a>.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row197933582219"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p25545912114">train_instance_count</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p955361173817">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p55561095217">Long</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p25573982112">Number of workers in a training job</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row105532902114"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p115007506428">code_dir</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p4553121118384">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1750655034220">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p750985094216">Code directory of a training job, for example, <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath128081531842"><b>/bucket/src/</b></span>. Leave this parameter blank when <strong id="modelarts_04_0168__en-us_topic_0180094062_b195511633344">model_name</strong> is set.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row164861109396"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p35209501423">boot_file</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1955318112388">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p552245012421">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1052817508427">Boot file of a training job, which needs to be stored in the code directory. For example, <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath1615417318812"><b>/bucket/src/boot.py</b></span>. Leave this parameter blank when <strong id="modelarts_04_0168__en-us_topic_0180094062_b275116924114">model_name</strong> is set.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row1390105335719"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p7801836172112">output_path</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p95531511163817">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p12801133632113">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p880183622110">Output path of a training job</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row3799183612114"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p13562119132119">hyperparameters</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p655755054219">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1756418919215">JSON Array</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1956514920216">Running parameters of a training job. It is a collection of label-value pairs of the string type. This parameter is a container environment variable when a job uses a custom image.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row83521247152016"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p106881050154220">log_url</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p17806757142413">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1369555013425">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p9699950194211">OBS URL of the logs of a training job. By default, this parameter is left blank. Example value: <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath25039504817"><b>/usr/log/</b></span></p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row1912536142111"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p109129363215">train_instance_type</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p555331113819">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p291283612219">Long</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p199131536192118">Resource flavor selected for a training job. If you choose to train on the training platform, obtain the value by calling the API described in <a href="modelarts_04_0191.html">Querying the List of Resource Flavors</a>.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row13142103743519"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p2014213371353">framework_type</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p16553201143810">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1014217373359">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p565095012422">Engine selected for a training job. Obtain the value by calling the API described in <a href="modelarts_04_0192.html">Querying the List of Engine Types</a>. Leave this parameter blank when <strong id="modelarts_04_0168__en-us_topic_0180094062_b15538148192">model_name</strong> is set.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row192212012216"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1822211112118">framework_version</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1722201162119">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p142221612219">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p6270941135920">Engine version selected for a training job. Obtain the value by calling the API described in <a href="modelarts_04_0192.html">Querying the List of Engine Types</a>. Leave this parameter blank when <strong id="modelarts_04_0168__en-us_topic_0180094062_b2917333202318">model_name</strong> is set.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row49082484413"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p255514164311">user_image_url</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p5555144113435">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p5555841114318">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p755554118434">SWR URL of the custom image used by a training job. Example value: <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath48811339112318"><b>100.125.5.235:20202/jobmng/custom-cpu-base:1.0</b></span></p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row19129155110419"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.2.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p46411034174620">user_command</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.2.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p11641434154610">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.2.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1364113434619">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.2.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p17641113410465">Boot command used to start the container of the custom image of a training job. The format is <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath2357174482316"><b>bash /home/work/run_train.sh python /home/work/user-job-dir/app/train.py {python_file_parameter}</b></span>.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_table11829123812299" frame="border" border="1" rules="all"><caption><b>Table 2 </b><strong id="modelarts_04_0168__en-us_topic_0180094062_b45562056112318">create_job_version</strong> request parameters</caption><thead align="left"><tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row5829438162918"><th align="left" class="cellrowborder" valign="top" width="22.75%" id="mcps1.3.3.3.2.5.1.1"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p14829203813293">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="9.879999999999999%" id="mcps1.3.3.3.2.5.1.2"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p3829938172912">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="13.320000000000002%" id="mcps1.3.3.3.2.5.1.3"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p18829638162919">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="54.05%" id="mcps1.3.3.3.2.5.1.4"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p4830113882911">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row25749306327"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p10361105925611">job_id</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p196751771039">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p8675972311">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p354118145165">ID of a training job. You can query <strong id="modelarts_04_0168__en-us_topic_0180094062_b1844341317465">job_id</strong> using the training job object generated in <a href="modelarts_04_0131.html">Creating a Training Job</a>, for example, <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath1644418136463"><b>job_instance.job_id</b></span>, or from the response obtained in <a href="modelarts_04_0160.html">Obtaining Training Jobs</a>.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row2025193383220"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p360523618346">pre_version_id</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p458851118521">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p76051136123415">Long</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p2605153619349">ID of the previous version of a training job. You can query <strong id="modelarts_04_0168__en-us_topic_0180094062_b1206151115814">pre_version_id</strong> using the training job object generated in <a href="modelarts_04_0131.html">Creating a Training Job</a>, for example, <span class="filepath" id="modelarts_04_0168__en-us_topic_0180094062_filepath22071011185817"><b>job_instance.version_id</b></span>, or from the response obtained in <a href="modelarts_04_0160.html">Obtaining Training Jobs</a>.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row4830133814295"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p108301438172914">inputs</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1283053812918">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p2083043872910">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p6830133892916">Data storage location of a training job. <strong id="modelarts_04_0168__en-us_topic_0180094062_b5151165252512">inputs</strong> cannot be used with <strong id="modelarts_04_0168__en-us_topic_0180094062_b415355212257">dataset_id</strong> and <strong id="modelarts_04_0168__en-us_topic_0180094062_b4153952172519">dataset_version_id</strong>, or with <strong id="modelarts_04_0168__en-us_topic_0180094062_b515445215259">data_source</strong> at the same time. However, one of the parameters must exist. Only this parameter is supported in local training.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row1458104910441"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1857315014211">dataset_id</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p455341112382">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p6578165015427">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p9583950184210">Dataset ID of a training job. This parameter must be used together with <strong id="modelarts_04_0168__en-us_topic_0180094062_b69628402249">dataset_version_id</strong>, but cannot be used together with <strong id="modelarts_04_0168__en-us_topic_0180094062_b19631840132416">inputs</strong>. To obtain the dataset ID, <a href="https://docs.otc.t-systems.com/modelarts/umn/data_management/managing_dataset_versions.html" target="_blank" rel="noopener noreferrer">view basic information about the dataset</a>.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row26141951154417"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p18589165044211">dataset_version_id</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p1755351183816">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p16592155011420">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p205997508422">Dataset version ID of a training job. This parameter must be used together with <strong id="modelarts_04_0168__en-us_topic_0180094062_b16799105118246">dataset_id</strong>, but cannot be used together with <strong id="modelarts_04_0168__en-us_topic_0180094062_b3800165120247">inputs</strong>. To obtain the dataset version ID, <a href="https://docs.otc.t-systems.com/modelarts/umn/data_management/managing_dataset_versions.html" target="_blank" rel="noopener noreferrer">view basic information about the dataset</a>.</p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row683014385293"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p383017383297">wait</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p38304380290">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p68308381297">Boolean</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p12830183822918">Whether to wait for the completion of creating a training job version. Default value: <strong id="modelarts_04_0168__en-us_topic_0180094062_b465615592415">False</strong></p>
</td>
</tr>
<tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_row8831153852917"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.5.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p188712617344">job_desc</p>
</td>
<td class="cellrowborder" valign="top" width="9.879999999999999%" headers="mcps1.3.3.3.2.5.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p13831143813291">No</p>
</td>
<td class="cellrowborder" valign="top" width="13.320000000000002%" headers="mcps1.3.3.3.2.5.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p13831338132919">String</p>
</td>
<td class="cellrowborder" valign="top" width="54.05%" headers="mcps1.3.3.3.2.5.1.4 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0179315308_p18311738132912">Description of a training job</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_table973120224596" frame="border" border="1" rules="all"><caption><b>Table 3 </b><strong id="modelarts_04_0168__en-us_topic_0180094062_b13354114610257">create_job_version</strong> response parameters</caption><thead align="left"><tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_row2731522195910"><th align="left" class="cellrowborder" valign="top" width="24.91249124912491%" id="mcps1.3.3.4.2.4.1.1"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_p57306225598">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="24.21242124212421%" id="mcps1.3.3.4.2.4.1.2"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_p117308225593">Type</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="50.87508750875088%" id="mcps1.3.3.4.2.4.1.3"><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_p2730132255915">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_row1873172215912"><td class="cellrowborder" valign="top" width="24.91249124912491%" headers="mcps1.3.3.4.2.4.1.1 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_p4731322145919">TrainingJob</p>
</td>
<td class="cellrowborder" valign="top" width="24.21242124212421%" headers="mcps1.3.3.4.2.4.1.2 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_p117311922115916">Object</p>
</td>
<td class="cellrowborder" valign="top" width="50.87508750875088%" headers="mcps1.3.3.4.2.4.1.3 "><p id="modelarts_04_0168__en-us_topic_0180094062_en-us_topic_0160436006_p6731182225914">Training object. This object contains attributes such as <strong id="modelarts_04_0168__en-us_topic_0180094062_b76648181266">job_id</strong> and <strong id="modelarts_04_0168__en-us_topic_0180094062_b1966441815267">version_id</strong>, and operations on a training job, such as querying, modifying, or deleting the training job. For example, you can use <strong id="modelarts_04_0168__en-us_topic_0180094062_b1439912217286">job_version_instance.job_id</strong> to obtain the ID of a training job.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="modelarts_04_0167.html">Training Job Versions</a></div>
</div>
</div>
View Git Blame Copy Permalink