Smallest pretrained model?

Models
#1

What is the smallest English pre-trained model (not distilled)?

#2

BERT-tiny is pretty, uh, tiny (around 16MB).

1 Like