is changing the structure of an embedding layer in a quantized model dangerous? when saving they tell me to make safe_serialization false
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Change Positional Embedding in T5 from Relative to Absolute | 0 | 671 | May 25, 2022 | |
Change embedding layer in a model | 2 | 1523 | July 18, 2024 | |
Embedding layer or last hidden_hidden_state | 0 | 207 | November 1, 2023 | |
ValueError: The model is quantized with QuantizationMethod.QUANTO and is not serializable | 1 | 297 | May 20, 2024 | |
Not a language model - remove word embedding weights from model for lighter cuda util | 1 | 622 | October 6, 2022 |