Whilst the primary purpose of Pytorch’s Torchscript & JIT compilation is for export & inference, it does seem to support training too, e.g.: [image] Speeding up model training with PyTorch JIT PyTorch JIT can be used to enable 2x-3x speedups on custom module code. …

Torch JIT Training

sbsky March 7, 2022, 10:05am 1

Whilst the primary purpose of Pytorch’s Torchscript & JIT compilation is for export & inference, it does seem to support training too, e.g.:

Curious to hear if anyone has tried it with Transformers & HF Trainer?

Topic		Replies	Views
Pytorch like loop for finetuning whisper Intermediate	0	218	July 6, 2023
Early stop with Trainer API under Pytorch Beginners	0	313	July 16, 2021
Getting completely different performance when trying to write a custom model Intermediate	1	654	June 9, 2022
How to train mnist with trainer? 🤗Transformers	1	172	December 7, 2023
Infrastructure for pretraining and finetuning via accelerate 🤗Accelerate	0	278	March 13, 2023