while using pipeline with TPU, how can we check whether the device pipeline is using is TPU if we set device_map to “auto”?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
What is the behaviour of pipeline's `device_map="auto"`? | 1 | 67 | January 18, 2025 | |
Could I use the device map for pipelines parallel training? | 0 | 242 | April 3, 2023 | |
Constrain device map to GPUs | 0 | 1268 | February 24, 2023 | |
Anywhere where I can read more about the `device_map` kwarg in `from_pretrained`? | 2 | 12233 | January 5, 2024 | |
How to free pipeline memory for new model in TPU | 0 | 133 | April 17, 2024 |