How do I create a Image Segmentation Dataset

You have to have a DatasetDict Format with image/pixel_values and label, alternatively you can also create like this,

 |     |-image
 |          |-img_id.jpg
 |    |-mask
 |          |-mask_id.jpg

Using this you can create a dataset class and read and create a dataset dict, this format worked for me along with the model.

Yes, the guide is here: transformers/examples/pytorch/semantic-segmentation at main · huggingface/transformers · GitHub