Finetuning whisper attention mask not set and canot be inferred

subhajyotisaha01
Wed, 04 Feb 2026 19:15:43 +0000

We should not change the default token id of pad and eos tokens of the tokenizer, which was used during training or pretraining the model. However, if we pass the attention mask, generated by the processor, while processing the audio, to the seq2seq model via the data collator or any other set up, the warning will be solved.