Does anyone know where exactly in the code T5 calculates the positional encodings according to the formula given in the original paper?
Does it actually calculate or does it simply inherit?
Please help, thanks.
Does anyone know where exactly in the code T5 calculates the positional encodings according to the formula given in the original paper?
Does it actually calculate or does it simply inherit?
Please help, thanks.