I am trying to use pretrained buffalo_l model for insightface and i am able to run it in CPU but i wanted to Run it using CUDA and i am getting below error
2024-02-22 16:38:41.819222612 [E:onnxruntime:Default, provider_bridge_ort.cc:1546 TryGetProviderInfo_CUDA] /onnxruntime_src/onnxruntime/core/session/provider_bridge_ort.cc:1209 onnxruntime::Provider& onnxruntime::ProviderLibrary::Get() [ONNXRuntimeError] : 1 : FAIL : Failed to load library libonnxruntime_providers_cuda.so with error: libcublasLt.so.11: cannot open shared object file: No such file or directory
I have Nvidia RTX GeForce 3060 TI
can any one guild me how to install the right version of CUDA for this model,
Can I run the above model in CUDA 12.3 the latest Version available
Thanks and regards,