I guess a lot of people will be asking this in the next weeks. When can we expect support for fine-tuning the SAM models of HF on own our datasets? There are some resources online on this (e.g. How To Fine-Tune Segment Anything) and it would be cool to have it also on HF.
1 Like
Hello there, any updates on this? Thank you guys for the great and very fast work being done to have these new SOTA models available on the hub, it’s really appreciated 
.
Hi @alzaia
@nielsr just posted a tutorial for this! https://twitter.com/NielsRogge/status/1655631771742920716?s=20 please find it here to try it out! Thanks again!
1 Like
Yes I saw it yesterday. Thanks a lot for the amazing work, guys! The notebook focuses on using bounding boxes from the masks as prompts for the fine-tuning. I am wondering if the same process can be done directly by feeding the masks as prompts instead (the input_labels arg. of the SAM model)?
1 Like