ELECTRA training reimplementation and discussion

peggy
Wed, 23 Sep 2020 17:26:54 +0000

Hi! Good job!
Can you please explain the use of gumbel-softmax for sampling a little bit? I want to be able to use it for sampling with other transformers(T5 for example) and I don’t know how to start.