when i try deploy docker template chat ui it gives error the log is
/opt/conda/lib/python3.9/site-packages/bitsandbytes/cextension.py:33: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
The argument trust_remote_code is to be used with Auto classes. It has no effect here and is ignored.
A new version of the following files was downloaded from https://huggingface.co/OpenAssistant/falcon-7b-sft-top1-696:
-
configuration_RW.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
A new version of the following files was downloaded from https://huggingface.co/OpenAssistant/falcon-7b-sft-top1-696: -
modelling_RW.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision. rank=0
2023-08-29T01:32:41.091612Z ERROR shard-manager: text_generation_launcher: Shard process was signaled to shutdown with signal 9 rank=0
2023-08-29T01:32:41.174622Z ERROR text_generation_launcher: Shard 0 failed to start
2023-08-29T01:32:41.174647Z INFO text_generation_launcher: Shutting down shards
Error: ShardCannotStart0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 39
Warning: retries left.0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 38
Warning: retries left.
please fix this