Hi there,
Pipeline object (transformer’s library) does three stages:
- Preprocessing (e.g., tokenization)
- Forward pass through model
- Postprocessing (e.g., convert logits to probabilities)
I need help in understanding how to compute time for each stage.
Thanks!