Hi, I’m getting an error while creating a space for chatUI, please provide some suggestion to solve this, or solution.and I’m using docker with chat UI template for space
===== Application Startup at 2023-10-19 07:41:05 =====
2023-10-19T07:44:17.356365Z INFO text_generation_launcher: Args { model_id: “ravivishwakarmauzio/trainedModelwithAlpaca”, revision: None, validation_workers: 2, sharded: None, num_shard: Some(1), quantize: None, dtype: None, trust_remote_code: true, max_concurrent_requests: 128, max_best_of: 2, max_stop_sequences: 4, max_top_n_tokens: 5, max_input_length: 1024, max_total_tokens: 2048, waiting_served_ratio: 1.2, max_batch_prefill_tokens: 4096, max_batch_total_tokens: None, max_waiting_tokens: 20, hostname: “s-ravivishwakarmauzio-chatiuiforuzio-6b605-6cfc5c75cc-tkft8”, port: 8080, shard_uds_path: “/tmp/text-generation-server”, master_addr: “localhost”, master_port: 29500, huggingface_hub_cache: Some(“/data”), weights_cache_override: None, disable_custom_kernels: false, cuda_memory_fraction: 1.0, rope_scaling: None, rope_factor: None, json_output: false, otlp_endpoint: None, cors_allow_origin: , watermark_gamma: None, watermark_delta: None, ngrok: false, ngrok_authtoken: None, ngrok_edge: None, env: false }
2023-10-19T07:44:17.356410Z WARN text_generation_launcher: trust_remote_code is set. Trusting that model ravivishwakarmauzio/trainedModelwithAlpaca do not contain malicious code.
2023-10-19T07:44:17.356487Z INFO download: text_generation_launcher: Starting download process.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 60
Warning: retries left.
{“t”:{“$date”:“2023-10-19T09:44:17.374+02:00”},“s”:“I”, “c”:“NETWORK”, “id”:4915701, “ctx”:“-”,“msg”:“Initialized wire specification”,“attr”:{“spec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:17},“outgoing”:{“minWireVersion”:6,“maxWireVersion”:17},“isInternalClient”:true}}}
{“t”:{“$date”:“2023-10-19T09:44:17.375+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:23285, “ctx”:“-”,“msg”:“Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols ‘none’”}
{“t”:{“$date”:“2023-10-19T09:44:17.375+02:00”},“s”:“I”, “c”:“NETWORK”, “id”:4648601, “ctx”:“main”,“msg”:“Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.”}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationDonorService”,“namespace”:“config.tenantMigrationDonors”}}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationRecipientService”,“namespace”:“config.tenantMigrationRecipients”}}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“ShardSplitDonorService”,“namespace”:“config.tenantSplitDonors”}}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:5945603, “ctx”:“main”,“msg”:“Multi threading initialized”}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:4615611, “ctx”:“initandlisten”,“msg”:“MongoDB starting”,“attr”:{“pid”:6,“port”:27017,“dbPath”:“/data/db”,“architecture”:“64-bit”,“host”:“s-ravivishwakarmauzio-chatiuiforuzio-6b605-6cfc5c75cc-tkft8”}}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“W”, “c”:“CONTROL”, “id”:20720, “ctx”:“initandlisten”,“msg”:“Memory available to mongo process is less than total system memory”,“attr”:{“availableMemSizeMB”:14336,“systemMemSizeMB”:15823}}
{“t”:{“$date”:“2023-10-19T09:44:17.376+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:23403, “ctx”:“initandlisten”,“msg”:“Build Info”,“attr”:{“buildInfo”:{“version”:“6.0.11”,“gitVersion”:“f797f841eaf1759c770271ae00c88b92b2766eed”,“openSSLVersion”:“OpenSSL 1.1.1f 31 Mar 2020”,“modules”:,“allocator”:“tcmalloc”,“environment”:{“distmod”:“ubuntu2004”,“distarch”:“x86_64”,“target_arch”:“x86_64”}}}}
{“t”:{“$date”:“2023-10-19T09:44:17.377+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:51765, “ctx”:“initandlisten”,“msg”:“Operating System”,“attr”:{“os”:{“name”:“Ubuntu”,“version”:“20.04”}}}
{“t”:{“$date”:“2023-10-19T09:44:17.377+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:21951, “ctx”:“initandlisten”,“msg”:“Options set by command line”,“attr”:{“options”:{}}}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“E”, “c”:“CONTROL”, “id”:20557, “ctx”:“initandlisten”,“msg”:“DBException in initAndListen, terminating”,“attr”:{“error”:“NonExistentPath: Data directory /data/db not found. Create the missing directory or specify another path using (1) the --dbpath command line option, or (2) by adding the ‘storage.dbPath’ option in the configuration file.”}}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“REPL”, “id”:4784900, “ctx”:“initandlisten”,“msg”:“Stepping down the ReplicationCoordinator for shutdown”,“attr”:{“waitTimeMillis”:15000}}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“REPL”, “id”:4794602, “ctx”:“initandlisten”,“msg”:“Attempting to enter quiesce mode”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“-”, “id”:6371601, “ctx”:“initandlisten”,“msg”:“Shutting down the FLE Crud thread pool”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“COMMAND”, “id”:4784901, “ctx”:“initandlisten”,“msg”:“Shutting down the MirrorMaestro”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“SHARDING”, “id”:4784902, “ctx”:“initandlisten”,“msg”:“Shutting down the WaitForMajorityService”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“NETWORK”, “id”:20562, “ctx”:“initandlisten”,“msg”:“Shutdown: going to close listening sockets”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“NETWORK”, “id”:4784905, “ctx”:“initandlisten”,“msg”:“Shutting down the global connection pool”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784906, “ctx”:“initandlisten”,“msg”:“Shutting down the FlowControlTicketholder”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“-”, “id”:20520, “ctx”:“initandlisten”,“msg”:“Stopping further Flow Control ticket acquisitions.”}
{“t”:{“$date”:“2023-10-19T09:44:17.378+02:00”},“s”:“I”, “c”:“NETWORK”, “id”:4784918, “ctx”:“initandlisten”,“msg”:“Shutting down the ReplicaSetMonitor”}
{“t”:{“$date”:“2023-10-19T09:44:17.379+02:00”},“s”:“I”, “c”:“SHARDING”, “id”:4784921, “ctx”:“initandlisten”,“msg”:“Shutting down the MigrationUtilExecutor”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“ASIO”, “id”:22582, “ctx”:“MigrationUtil-TaskExecutor”,“msg”:“Killing all outstanding egress activity.”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“COMMAND”, “id”:4784923, “ctx”:“initandlisten”,“msg”:“Shutting down the ServiceEntryPoint”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784928, “ctx”:“initandlisten”,“msg”:“Shutting down the TTL monitor”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:6278511, “ctx”:“initandlisten”,“msg”:“Shutting down the Change Stream Expired Pre-images Remover”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:4784929, “ctx”:“initandlisten”,“msg”:“Acquiring the global lock for shutdown”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“-”, “id”:4784931, “ctx”:“initandlisten”,“msg”:“Dropping the scope cache for shutdown”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:20565, “ctx”:“initandlisten”,“msg”:“Now exiting”}
{“t”:{“$date”:“2023-10-19T09:44:17.382+02:00”},“s”:“I”, “c”:“CONTROL”, “id”:23138, “ctx”:“initandlisten”,“msg”:“Shutting down”,“attr”:{“exitCode”:100}}
2023-10-19T07:44:19.997664Z INFO text_generation_launcher: Peft model detected.
2023-10-19T07:44:19.997730Z INFO text_generation_launcher: Loading the model it might take a while without feedback
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 59
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 58
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 57
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 56
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 55
Warning: retries left.
2023-10-19T07:45:17.018846Z INFO text_generation_launcher: Loaded.
2023-10-19T07:45:17.018904Z INFO text_generation_launcher: Merging the lora weights.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 54
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 53
Warning: retries left.
Error: DownloadError
2023-10-19T07:45:31.701740Z ERROR download: text_generation_launcher: Download encountered an error:
Downloading shards: 0%| | 0/2 [00:00<?, ?it/s]
Downloading shards: 50%|█████ | 1/2 [00:26<00:26, 26.61s/it]
Downloading shards: 100%|██████████| 2/2 [00:36<00:00, 16.91s/it]
Downloading shards: 100%|██████████| 2/2 [00:36<00:00, 18.36s/it]
Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards: 50%|█████ | 1/2 [00:04<00:04, 4.79s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00, 3.02s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00, 3.28s/it]
Traceback (most recent call last):
File “/opt/conda/bin/text-generation-server”, line 8, in
sys.exit(app())
File “/opt/conda/lib/python3.9/site-packages/text_generation_server/cli.py”, line 131, in download_weights
utils.download_and_unload_peft(
File “/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/peft.py”, line 38, in download_and_unload_peft
os.makedirs(model_id, exist_ok=True)
File “/opt/conda/lib/python3.9/os.py”, line 215, in makedirs
makedirs(head, exist_ok=exist_ok)
File “/opt/conda/lib/python3.9/os.py”, line 225, in makedirs
mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: ‘ravivishwakarmauzio’
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 52
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 51
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 50
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 49
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 48
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 47
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 46
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 45
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 44
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 43
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 42
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 41
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 40
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 39
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 38
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will retry in 10 seconds. 37
Warning: retries left.
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
0 0 0 0 0 0 0 0 --:–:-- --:–:-- --:–:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080: Connection refused
Warning: Transient problem: connection refused Will r