ValueError: --optim adamw_torch_fused with --fp16 requires PyTorch>2.0

Im get this error , but I already installed torch version 2.

ValueError: --optim adamw_torch_fused with --fp16 requires PyTorch>2.0

Notice that it says > and not >= :wink:
You need a source install as they just fixed a bug between Mixed precision training and fused adamw.


You can see the pytorch version are 2.0.0

2.0.0 is not > 2.0.0. It is equal to it.

I think there is only 2 version of pytorch release not > 2. :face_with_head_bandage:

Which is why I also said:
You need a source install as they just fixed a bug between Mixed precision training and fused adamw.

It mean that, there is not solution. :sweat_smile: