1
0
forked from docs/doc-exports
doc-exports/docs/modelarts/umn/dataprepare-modelarts-0008.html
Lai, Weijian 4e4b2d5f6d ModelArts UMN 23.3.0 Version.
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Lai, Weijian <laiweijian4@huawei.com>
Co-committed-by: Lai, Weijian <laiweijian4@huawei.com>
2024-06-26 07:03:02 +00:00

3.8 KiB

Introduction to Data Importing

After a dataset is created, you can import more data. ModelArts allows you to import data from different data sources.

ModelArts AI Gallery provides a large number of built-in datasets, including file and table datasets. You can download and use the built-in datasets from AI Gallery. You can also import your data to ModelArts.

File Data Sources

You can import data by downloading built-in datasets from AI Gallery, or from OBS or a local file. After the import, the data from the import path is automatically synchronized to the data source path of the dataset.

  • OBS: Import data from an OBS path or a manifest file.
  • Local file: Import local data that has been uploaded to an OBS path.

Table Data Sources

You can import data by downloading built-in datasets from AI Gallery, or from OBS, DWS, DLI, MRS, and local files.

Import Mode

There are five modes for importing data to a dataset.

  • When you create a dataset, select an import path. The data is automatically synchronized from the import path.
  • After a dataset is created, click Import in the Operation column on the dataset list page.
  • On the dataset list page, click a dataset. On the dataset details page, choose Import > Import.
  • On the dataset list page, click a dataset. On the dataset details page, click Synchronize Data Source to synchronize data from OBS.
  • Add data on the labeling job details page.