Hello, I recall that there was a model that supports multiple masks by introducing several special mask tokens eg , but I can’t remember now and cannot find it.
Does anyone know which model is it? Thanks.
Oh nvm turns out that it is T5.
During training it masks multiple tokens, but not during inference.
Are there models that support multiple masks? Is the current best method to feed one mask at a time?