Hi, everyone!
I made a small project: fine-tuned a GPT model on my own telegram chat.
To to be precise, I have used Grossmend’s model which is ruDialoGPT3 - a DialoGPT for Russian language (trained on forums). The page provided enough info for me to fine-tune that model!
I exported my own telegram chat (in Russian) and fine-tuned the model on it (for 3 epochs on 30mb of dialogues). After that I uploaded and created a model on
Hub as it is described in the videos.
Even though it is in Russian I believe you can still check it out and take some inspiration:
It works great! It uses phrases that are highly specific to my style of writing and that’s cool!