Resource requirement to run DeepSeek R1 7B

Models
1

Hi Team,

I am currently working on a project to run multiple instances of Deepseek R1 7B for various projects. This will serve as a testing environment for my teams working on different use cases. I am seeking expert advice on the estimated resources required to run one Deepseek R1 7B on H100. I have one server with 8 GPU cards on-premises.

Your expertise and guidance will be invaluable for the success of this initiative.

Thank you.

1 Like
2

If it’s a large-scale deployment, I think it’s a good idea to rely on expert support.