No performance decrease in layoutlm v2 when using blank image instead of original image

Model I am using is LayoutLM V2 and while inferencing i have observed that there is no performance decrease when i just pass a blank image instead of the original image. Does that mean image has no contribution towards prediction.

Has anyone else experimented with blank image and what might be the reason we aren’t seeing any performance dip when image is switched.