Whisper Inference RuntimeError: The expanded size of the tensor (3000) must match the existing size (3392) at non-singleton dimension 1. Target sizes: [80, 3000]. Tensor sizes: [80, 3392]

I have trained a fine-tuned whisper model for an ultra low resource Malasar language.

While doing inference to evaluate the performance on a test set using the code, It performs decoding for few entries in data_test and then produces the error given in the title.

from tqdm import tqdm
from transformers.pipelines.pt_utils import KeyDataset

all_predictions = []

# run streamed inference
for prediction in tqdm(
        KeyDataset(data_test, "audio_path"),
        generate_kwargs={"task": "transcribe"},

What does that error indicate, and what could be the possible solutions?