Script to Fine-Tune FLAN UL2

🤗Transformers
1

Hi - Does anyone know of any open source code to fine-tune FLAN UL2 on a custom dataset?

I’m looking for something that will work on consumer grade GPUs (24GB). Likely 8-bit quantized or bf16.

Thanks,
Griffin

2

Hi @griffin , I am looking for the same. Were you able to find something?