Running Mistral-7B-Instruct-v0.2 on multiple GPUs

Worked like a dream! Thanks. I didn’t have to do anything else, just install an extra package.

Sadly, can’t do anything with more than 5 beams and 110 tokens, fairly short texts. I may still want to upgrade the gears. Also, every text is exactly the same, even though the seeds are different!
If you have any idea as to why I’ll be so grateful, so many thanks!