Finetuning whisper attention mask not set and canot be inferred

huangruizhe
Sat, 20 Jul 2024 18:52:14 +0000

I ran into the same error message when running this basic HF Whisper inference codes:
https://huggingface.co/docs/transformers/en/model_doc/whisper#inference

Does anyone know how to fix it? It seems to me in Whisper’s default config: pad_token_id = 50256, eos_token_id = 50256. How can I make them not equal?