Thanks so much @julien-c , I followed the code in your colab and it works! Very happy about my first model (now living here) and I’ll add a model card with a proper description, metrics etc soon 
Just FYI: I think that the error fatal: cannot exec '.git/hooks/pre-push': Permission denied comes up when I put the model in a folder in my google drive, other than the default “/content” folder. When I don’t change the directory and just upload my model in the default “/content” folder (as you did), I don’t get the error. But when I try to upload it from another folder within colab, the error comes up. Here is a colab with your code slightly altered that produces the error and this is probably the problematic line of code:
from google.colab import drive
drive.mount('/content/drive')
%cd /content/drive/My\ Drive/Colab\ Notebooks/results/
The issue is a bit inconvenient, but I know that’s not an issue with Transformers (might be useful to know for other people who try to change directory).