The Whisper model, has the possibility of a prompt or adding the previous text to the current transcription task. This helps in case of transcribing long file chunk after chunk. During training it should “mask out the training loss over the previous context text, and train the model to predict all…

Adding prompt / context to Whisper with Huggingface Transformers

andercorral March 24, 2023, 7:29pm 5

Great! Thanks! That’s what I will end up doing

Topic		Replies	Views
Is prompt properly implemented in the whisper model? 🤗Transformers	1	1596	September 19, 2024
Finetuning Whisper with prompts 🤗Transformers	3	4149	January 16, 2024
Issues with Whisper Encoder: Positional Encoding 🤗Transformers	4	1587	November 16, 2022
Is it possible to set initial_prompt and condition_on_previous_text with a whisper_pipeline? 🤗Transformers	4	2121	February 8, 2024
Performing Whisper's "transcribe" with Transformer pipelines Beginners	2	2712	December 19, 2023