Hi Team,
I am currently working on a project to run multiple instances of Deepseek R1 7B for various projects. This will serve as a testing environment for my teams working on different use cases. I am seeking expert advice on the estimated resources required to run one Deepseek R1 7B on H100. I have one server with 8 GPU cards on-premises.
Your expertise and guidance will be invaluable for the success of this initiative.
Thank you.