T5 Temperature-scaled mixing

For multi-task learning T5 uses temperature scaled mixing. Does this uses 100% examples of all tasks and we will have some duplicates examples?