Specifications for Custom Images Used for Training Jobs

Specifications

• Custom images cannot contain malicious code.
• Part of content in the basic images cannot be changed, including all the files in /bin, /sbin, /usr, and /lib(64), some important configuration files in /etc, and the ModelArts tools in $HOME.
• A file cannot be added whose owner is root and has permission setuid or setgid.
• The size of a custom image cannot exceed 9.5 GB.

• To ensure that the log content can be displayed normally, the logs must be standard output.
• The default user of a custom image must be the user whose UID is 1101.
• Custom images can be developed based on basic ModelArts images. For details about the supported basic images, see Overview of a Basic Image Package.

Overview of a Basic Image Package

To facilitate code download, training log output, and log file upload to OBS, ModelArts provides basic image packages for creating custom images. The basic images provided by ModelArts have the following features:

• Some necessary tools are available in the basic image. You need to create a custom image based on the basic images provided by ModelArts.
• ModelArts continuously updates the basic image versions. For compatible updates, after the basic images are updated, you can still use the old images. For incompatible updates, the custom images created based on the old version cannot run on ModelArts, but the approved custom images can still be used.
• If a custom image fails to be approved and the audit log contains an error message indicating that the basic image does not match, you need to use a new basic image to create an image.

Run the following command to obtain a ModelArts image:

docker pull <Address for obtaining a basic image>

After customizing an image, upload it to SWR. Make sure that you have created an organization and obtained the password for logging in to SWR. For details, see .

docker push  swr.<region>.xxx.com/<Organization to which the target image belongs>/<Image name>

Obtain basic images based on chip requirements:

CPU-based Basic Images

Address for obtaining a basic image

swr.<region>.xxx.com/modelarts-job-dev-image/custom-cpu-base:1.3

Table 2 and Table 3 list the components and tools used by basic images.

GPU-based Basic Images

• Image of the CUDA 10.0, 10.1, or 10.2 version, using Ubuntu 18.04 as the basic image and with MoXing pre-installed by default

  swr.<region>.xxx.com/modelarts-job-dev-image/custom-base-<cuda version>-<python version>-<os>-<arch>:<image tag>

• Image of the CUDA 8, 9, or 92 version, with MoXing pre-installed by default

  swr.<region>.xxx.com/modelarts-job-dev-image/custom-gpu-<cuda version>-inner-moxing-<python version>:<image tag>

• Image of the CUDA 8, 9, or 92 version

  swr.<region>.xxx.com/modelarts-job-dev-image/custom-gpu-<cuda version>-base:<image tag>

  Table 4 Optional parameters

  Parameter	Possible Value	Description
  <region>	eu-de	Region where the image resides.
  <cuda version>	cuda92 cuda9 cuda8 cuda10.0 cuda10.1 cuda10.2	CUDA version installed in the image NOTE: Check the CUDA version. After the version is specified, it cannot be changed. Otherwise, the training will fail.
  <image tag>	1.1 1.3	Image version Version 1.3 available for CUDA 8, 9, or 92 version Version 1.1 available for CUDA 10.0, 10.1, or 10.2 version
  python version	cp27 cp36	Python environment
  os	ubuntu18.04	Operating system
  arch	x86	Architecture

Table 2 and Table 3 list the components and tools used by basic images.