How to calculate tokens per second while fine-tuning llm?

mitanshudodia July 22, 2023, 5:46am 1

Hi, I am trying to fine-tune an seq2seq LLM and I want to calculate the tokens per second, so how can I achieve this ?

Topic		Replies	Views
Token merging for fast LLM inference Research	0	155	April 17, 2024
Can you fine tune a CausalLM model (GPT2) to seq2seq, redefining the architecture or do I need to retrain the model from scratch? 🤗Transformers	0	129	February 28, 2024
What is precisely happening during LLM fine-tuning with autoTrain? 🤗AutoTrain	1	540	October 27, 2023
Fine-tuning a language model on domain specific embeddings 🤗Transformers	1	927	November 21, 2023
Text generation, LLMs and fine-tuning Beginners	0	1437	December 8, 2022