I am looking to understand the math behind how max steps is calculated when left alone, I’ve tried to work backwards from making changes to epoch, batch, and micro-batch to see if I could figure out the formula but I haven’t had any luck. I have also looked at the documentation for the transformers …

How do you calculate max steps

jasicarose75 July 28, 2023, 7:22pm 3

I need to try

Topic		Replies	Views
Explicitly set number of training steps using Trainer 🤗Transformers	5	9469	September 16, 2020
How does `max_steps` affect the number of samples the model "sees"? Beginners	4	3980	January 19, 2024
Regarding max steps, streaming in language modeling 🤗Optimum	3	242	April 13, 2024
TrainingArguments class - max_steps formula when using streaming dataset 🤗Transformers	1	3714	September 14, 2023
Why are there only 3 steps per epoch when the dataset has 2500 rows and batch_size is 1 Beginners	0	168	March 19, 2024