Model fine-tuning and inference of Bloom 560M

Hi all,

I’m the Co-founder of and

How do I simply fine-tune Bloom 560M and make inferences, post? I’ve followed the steps Finetune BLOOM (Token Classification) | Kaggle but that seems to be only for Named Entity Recognition. Correct, me if I’m wrong.

Essentially, I’m trying to do text generation, and predict the following sequence of characters.