In diffusers, do i need many venvs to get around version conflicts?

I see that the various requirements.txt files in the example folders can be very different and conflicting. Do I need to make a new venv for each directory?

For example, clip-retrieval requires a version of wandb that requires a version of protobuf that breaks clip-retrieval and xformers requires, and xformers installs torch-2.1.0 which breaks clip-retrieval and torchvision, etc., etc., There are a number of these conflicts.