I’m trying to determine the 4-digit occupation code from a job posting’s title & description, and wondering which pre-trained model/transformer I should start off with. What format should I pre-process my data into as well, I was thinking of having 3 columns with the occupation code, title, and description. I’ve fine-tuned models according to the documentation but nothing from my own data.
Thank you for your help!