Hello,
What are the best models for comparing objects on two images? Both images will have one primary object, for example a bike. So imagine having two images of the same bike, but taken with different backgrounds, different angles, different lighting etc.
So the model should try to ignore everything else than the main object, and then compare them and give a similarity score of 0-100%.
Thanks in advance for your inputs 
Image similarity task?
I have played around with multiple of those. The issue is that they compare the whole image.
Imagine having two images, both having the same solid color on the left half..
On the right half the first image has a bike. On the right hand of the second image there’s a dragon.
This should be 0% match. But all those I tried, would give at least 50% match, because the left half are identical on both images.
I want it to be recognise the main object on both images and only do a comparison between those.
Is the only way around it to handle it in multiple steps? Like, removing the backgrounds, reading objects, identify which one I want and then compare those? I feel like there’s already someone who built something to handle those use cases.
Hmm, I agree that separating the processing would be more reliable. It depends on which object to designate as the main object. If you want to use a single model, I think the CLIP model would be the closest approach, but it would be difficult to obtain a score using this method.