RoutingTransformer in HF

Hi,

Are there any plans to add RoutingTransformer to HF? Phil Wang has public RT implementation at GitHub - lucidrains/routing-transformer: Fully featured implementation of Routing Transformer

Cheers,
Vladimir

2 Likes