Thanks Zach! I’d put this issue on the backburner for a while but am glad to see this progress.
Seems that some colleagues of mine are able to use accelerate on High VRAM instances, but they aren’t using the notebook environment. (This is important because I do need to be able to run on High VRAM, so just “don’t do it” wasn’t going to help me. LOL).
EDIT: BTW, I’d been seeing this error on an AWS A100 too, not just Colab.