Finetuning whisper attention mask not set and canot be inferred

ruimaia
Mon, 15 Jul 2024 17:03:48 +0000

I was following @sanchit-gandhi 's tutorial (https://huggingface.co/blog/fine-tune-whisper) but I got the following warning “The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input’s attention_mask to obtain reliable results.”.

This warning was introduced in a recent transformers release and I was trying to understand if it can affect the finetuning process. If so, how can we avoid it?