SAM2 detecting multiple objects with a single prediction

Hi,
Are there certain parameters which need to be set or a certain initialization of the model in order to find several objects in a single prediction with multiple points as a prompt? When I try to use several points as an input I get around 3 masks even though I use more than 3 separate points as an input. The reason I want to use a single prediction is to save time.

Thank you in advance