Whisper medium finetuning RTX 4090 mostly stays idle

Beginners
4

Sorry for the late reply. I’m guessing: You look at general “utilization”.

  1. Win 11 Task Manager does not show CUDA usage by default.
  2. AFAIK the “utilization” does not take CUDA usage into account
  3. By default it gives summary view

So that we are speaking of the same measure:

  1. Disable summary view: Right click GPU on the left.

  2. Disable HW acceleration

image
image1029×456 20.3 KB

  1. Now you can select CUDA to see actual utilization. IIRC stuff usually happens in cuda, copy 1 and copy 2, so select them from top left.

image
image233×126 1.06 KB

A better tool is nvidia-smi of course…

3 Likes