while using pipeline with TPU, how can we check whether the device pipeline is using is TPU if we set device_map to “auto”?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
What is the behaviour of pipeline's `device_map="auto"`? | 1 | 36 | January 18, 2025 | |
Could I use the device map for pipelines parallel training? | 0 | 240 | April 3, 2023 | |
Constrain device map to GPUs | 0 | 1263 | February 24, 2023 | |
Anywhere where I can read more about the `device_map` kwarg in `from_pretrained`? | 2 | 10789 | January 5, 2024 | |
How to free pipeline memory for new model in TPU | 0 | 130 | April 17, 2024 |