How to shard a model

sd3ntato July 11, 2023, 1:55pm 1

Is there an easy way to obtain the sharded-fp16 version of a model after having loaded it with from_pretrained?

1 Like

Topic		Replies	Views
Transformers Trainer + Accelerate FSDP: How do I load my model from a checkpoint? 🤗Accelerate	2	2245	January 17, 2024
How does this work? (Downloading multi-part models) Beginners	0	764	May 20, 2023
How can I load specific checkpoint of trained model 🤗Transformers	0	513	April 28, 2022
Is it possible to use a from_pretrained() method to respawn model and tokenizer from my own s3 bucket? Beginners	4	4174	July 7, 2023
Saving model trouble Beginners	2	110	February 21, 2024