Error: The model weights are not tied. Please use the `tie_weights` method before using the `infer_auto_device` function, even after adding model.tie_weights()

Beginners
8

@abhibha
If you are sure that the warning was triggered by the presence of model.tie_weights(), and the warning disappears when that line is removed, then it’s likely that the warning is related to the usage of model.tie_weights() in your specific context.

Without knowing the specific code and the warning message you received, it’s challenging to determine the exact cause of the warning and whether it is safe to ignore. However, I can provide some general guidance:

  1. Understand the purpose of model.tie_weights():
  2. Check the documentation and version compatibility:
    Make sure to refer to the documentation of the library or framework you are using for model.tie_weights().
  3. Consider the impact on your specific use case:
    Depending on your specific use case, tying weights may or may not be necessary. If you are achieving the desired results without using model.tie_weights(), and the warning disappears after removing it, it might be acceptable to leave it out. However, it’s crucial to consider the implications on your model’s performance and training process.
  4. Test and validate your results:
    If you decide to proceed without using model.tie_weights(), thoroughly test your model and validate the results to ensure that it performs as expected and achieves the desired outcomes.
1 Like