GRPO Trainer for VLM?

Wonder HuggingFace has any plan to support GRPO Trainer or DPO Trainer for VLM?

It would be a huge contribution to the community.

2 Likes

sorry I just saw VLM part :slight_smile:

1 Like

Seems ongoing issue (request).

1 Like

any updates on this?

1 Like

Welcome first time posters @SabaPivot and @Cherran

1 Like

Someone wrote the code, but it doesn’t seem to have been committed yet.