forked from docs/doc-exports
Lai, Weijian
6aa966a79a
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Lai, Weijian <laiweijian4@huawei.com> Co-committed-by: Lai, Weijian <laiweijian4@huawei.com>
29 lines
7.6 KiB
HTML
29 lines
7.6 KiB
HTML
<a name="EN-US_TOPIC_0000002079182969"></a><a name="EN-US_TOPIC_0000002079182969"></a>
|
|
|
|
<h1 class="topictitle1">Importing a Manifest File</h1>
|
|
<div id="body0000001197146307"><div class="section" id="EN-US_TOPIC_0000002079182969__section113381459132217"><h4 class="sectiontitle">Prerequisites</h4><ul id="EN-US_TOPIC_0000002079182969__ul738713422317"><li id="EN-US_TOPIC_0000002079182969__li1338844142312">You have created a dataset.</li><li id="EN-US_TOPIC_0000002079182969__li105086910238">You have stored the data to be imported in OBS. You have stored the manifest file in OBS.</li><li id="EN-US_TOPIC_0000002079182969__li9197102013471">The OBS bucket and ModelArts are in the same region and you can operate the bucket.</li></ul>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000002079182969__section1288119261761"><h4 class="sectiontitle">Importing File Data from a Manifest File</h4><p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p11231455182714">The parameters on the GUI for data import vary according to the dataset type. The following uses an image dataset as an example.</p>
|
|
<ol id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_ol1523185522719"><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li1123117558275">Log in to the ModelArts management console. In the navigation pane on the left, choose <strong id="EN-US_TOPIC_0000002079182969__b74280057092745">Data Management</strong> > <span class="parmname" id="EN-US_TOPIC_0000002079182969__parmname150418249892745"><b>Datasets</b></span>.</li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li4231115520273">Locate the target dataset and click <strong id="EN-US_TOPIC_0000002079182969__b197537797292745">Import</strong> in the <strong id="EN-US_TOPIC_0000002079182969__b214573966392745">Operation</strong> column. Alternatively, you can click the dataset name to go to the <span class="wintitle" id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_wintitle811414187191"><b>Dashboard</b></span> tab of the dataset, and click <span class="uicontrol" id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_uicontrol131141018111911"><b>Import</b></span> in the upper right corner.</li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li182311553275">In the <strong id="EN-US_TOPIC_0000002079182969__b42136555492745">Import</strong> dialog box, set the parameters as follows and click <strong id="EN-US_TOPIC_0000002079182969__b33024351792745">OK</strong>.<ul id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_ul1659581713428"><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li115959170427"><strong id="EN-US_TOPIC_0000002079182969__b181058285492745">Data Source</strong>: <strong id="EN-US_TOPIC_0000002079182969__b207318502792745">OBS</strong></li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li459521734216"><strong id="EN-US_TOPIC_0000002079182969__b14572609792745">Import Mode</strong>: <strong id="EN-US_TOPIC_0000002079182969__b173676718992745">manifest</strong></li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li15595181716423"><strong id="EN-US_TOPIC_0000002079182969__b147722831392745">Manifest File</strong>: OBS path for storing the manifest file</li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li059531710424"><strong id="EN-US_TOPIC_0000002079182969__b51844390292745">Labeling Status</strong>: <strong id="EN-US_TOPIC_0000002079182969__b96330125492745">Labeled</strong></li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li18595917164215"><strong id="EN-US_TOPIC_0000002079182969__b96226165992745">Advanced Feature Settings</strong>: disabled by default<p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p1595181710424"><strong id="EN-US_TOPIC_0000002079182969__b130576814192745">Import by Tag</strong> The system automatically obtains the labels of the dataset. You can click <strong id="EN-US_TOPIC_0000002079182969__b159437312492745">Add Label</strong> to add a label. This parameter is optional. If <strong id="EN-US_TOPIC_0000002079182969__b120126097992745">Import by Tag</strong> is disabled, you can add or delete labels for imported data when labeling data.</p>
|
|
<p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p20382243184310"><span class="parmname" id="EN-US_TOPIC_0000002079182969__parmname8523963892745"><b>Import Only Hard Examples</b></span>: If this parameter is selected, only the <strong id="EN-US_TOPIC_0000002079182969__b144014940492745">hard</strong> attribute data of the manifest file is imported.</p>
|
|
</li></ul>
|
|
<p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p19321191910116">After the data is imported, it will be automatically synchronized to the dataset. On the <strong id="EN-US_TOPIC_0000002079182969__b48267552192745">Datasets</strong> page, click the dataset name to view its details and create a labeling job to label the data.</p>
|
|
</li></ol>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000002079182969__section6618144201717"><h4 class="sectiontitle">Labeling Status of File Data</h4><p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p12618944121711">The labeling status can be <strong id="EN-US_TOPIC_0000002079182969__b2056101684217">Unlabeled</strong> or <strong id="EN-US_TOPIC_0000002079182969__b19561616184212">Labeled</strong>.</p>
|
|
<ul id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_ul461824471720"><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li19618134401716"><strong id="EN-US_TOPIC_0000002079182969__b175367178428">Unlabeled</strong>: Only the labeling object (such as unlabeled images or texts) is imported.</li><li id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_li090691254610"><strong id="EN-US_TOPIC_0000002079182969__b894518459124">Labeled</strong>: Both the labeling object and content are imported. Labeling content importing is not supported for datasets in free format.<p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p17599193014615">To ensure that the labeling content can be correctly read, you must store data in strict accordance with the specifications.</p>
|
|
<p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p54911015164618">If <strong id="EN-US_TOPIC_0000002079182969__b962011485427">Import Mode</strong> is set to <strong id="EN-US_TOPIC_0000002079182969__b123131750104213">Path</strong>, store the data to be imported according to the labeling file specifications. </p>
|
|
<p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p2966917143217">If <strong id="EN-US_TOPIC_0000002079182969__b691513234432">Import Mode</strong> is set to <strong id="EN-US_TOPIC_0000002079182969__b135490258438">manifest</strong>, the manifest file specifications must be met. For details, see <a href="dataprepare-modelarts-0015.html">Specifications for Importing a Manifest File</a>.</p>
|
|
<div class="note" id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_note9813353123716"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="EN-US_TOPIC_0000002079182969__en-us_topic_0000001193972801_p168131537376">If the labeling status is set to <strong id="EN-US_TOPIC_0000002079182969__b0577547445">Labeled</strong>, ensure that the folder or manifest file complies with the format specifications. Otherwise, the import may fail.</p>
|
|
</div></div>
|
|
</li></ul>
|
|
</div>
|
|
<p id="EN-US_TOPIC_0000002079182969__p2091954018288"></p>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataprepare-modelarts-0010.html">Importing Data from OBS</a></div>
|
|
</div>
|
|
</div>
|
|
|