Is there a pre-training dialogue model whose inference fast than DialogGPT-small?

I use CPU only in my computer, is there a pre-training dialogue model whose inference fast than DialogGPT-small or some way to make DialogGPT infer fast?