Text-embeddings-inference docker image fails to run

🤗Hub
1

I am unable to docker run text-embeddings-inference docker images (I have tried several) in my local Docker environment.

  • Running H-100 GPUs,
  • Ubuntu host,
  • recent docker engine install, CUDA 12.4,
  • verified “LD_LIBRARY_PATH” exists and that it contains the proper directory,
  • verified directory is on PATH,
  • checked symbolic link libcuda.so.1 was created and linked to current version libcuda.so.550.127.05.
  • Symbolic ink and file confirmed to exist in proper directory (/usr/lib/x86_64-linux-gnu).
  • Able to access the file through the symbolic link with a non-elevated account.
  • Permissions on libcuda.so.550.127.05 are 644.
  • Used text-embeddings-inference:89-1.2 and 1.5 (and others).

Error received: “error while loading shared libraries: libcuda.so.1 : cannot open shared object file.”

1 Like