Can I Add Multiple Labeling Boxes to an Object Detection Dataset Image?

Yes.

For an object detection dataset, you can add multiple labeling boxes and labels to an image during labeling. Note that the labeling boxes cannot extend beyond the image boundary.