Thank you for taking the time to answer @John6666 – Not really sure it applies to my situation tho.
I am interested in weight initialization for training, and specifically on what are the defaults on the Trainer API when it comes down to initialize the weights (I mean, what distributions or is it just a fallback to Pytorch default init)