Im get this error , but I already installed torch version 2.
ValueError: --optim adamw_torch_fused with --fp16 requires PyTorch>2.0
Notice that it says > and not >= 
You need a source install as they just fixed a bug between Mixed precision training and fused adamw.
2.0.0 is not > 2.0.0. It is equal to it.
I think there is only 2 version of pytorch release not > 2. 
Which is why I also said:
You need a source install as they just fixed a bug between Mixed precision training and fused adamw.
It mean that, there is not solution. 