Space won't start - logs not found

Here’s the error I’m seeing for Container logs:

Error: Failed to load logs: Not Found. Logs are persisted for 30 days after the Space stops running.

1 Like

hi @155elkhorn could you please share more details? do you have a public Space link to share? thanks

The space isn’t public, but here’s the link to the space: https://huggingface.co/spaces/PikeAndVine/SD-Inpaint-POC

I went ahead and made it public for now in case that helps.

thanks for sharing, I duplicate your Space for testing purposes and it build and run normally


Could you please try a Factory Reboot?

Another tip is, if you’re using the persistent data you set set HF_HOME to /data/.huggingface So you won’t need to re-download models every new build

I’ve done at least 5 factory reboots. I tried another one and here’s the error I’m getting:

Build error

Build failed with exit code: 1

Build logs:

===== Build Queued at 2023-09-08 23:07:41 / Commit SHA: fd2693c =====

--> FROM docker.io/nvidia/cuda:11.3.1-cudnn8-devel-ubuntu18.04@sha256:69cd988555eabe116f76acc754b363eee75f37674c23adb2b523f5fa32543984
DONE 29.1s

--> RUN apt-get update && apt-get install -y         git         make build-essential libssl-dev zlib1g-dev         libbz2-dev libreadline-dev libsqlite3-dev wget curl llvm         libncursesw5-dev xz-utils tk-dev libxml2-dev libxmlsec1-dev libffi-dev liblzma-dev git-lfs      	ffmpeg libsm6 libxext6 cmake libgl1-mesa-glx 		&& rm -rf /var/lib/apt/lists/*     	&& git lfs install

--> ERROR: failed commit on ref "layer-sha256:c89166c8ea49f8e433445b622e665a321cf96442e5a4b86ca0d3d2b2812a8b6d": unexpected commit digest sha256:0f494b781dd9bb64e7fff4a96d5be6526ca5b57377c14a5c2c572edbc3d8f6a4, expected sha256:c89166c8ea49f8e433445b622e665a321cf96442e5a4b86ca0d3d2b2812a8b6d: failed precondition

Sorry, that’s very odd. Did you just duplicated it and got that error? Are you using persistent storage?

I just made a copy like you did and it actually started, yay!

Yes, I have persistent storage turned on and I added that HF_HOME variable like you suggested.

1 Like

Sorry, for the issues, next week we could have @chris-rannou to have a look on the infra side thanks

I have quite a few scripts pointed at this space via API, so would really prefer to get it running versus moving over to the copy.

1 Like

I am getting the same Log error and build failure. Chat with PDF • OpenAI - a Hugging Face Space by wholewhale

Apologies, we had some internal issues on our infra, could you please try rebooting/factory rebooting now?

Getting: " 500

Internal Error - We’re working hard to fix this as soon as possible!"

(TY for the quick reply)

Apologies, we’re in recovery mode, I’ll ping when things are back

8 Likes

Apologies for the interruption, it should be back to normal now.

1 Like

@radames any idea by when it will be back to normal? I’m still facing the error

Spaces would not start for me this morning, but after factory resets they are running.

1 Like

I have the same situation right now! ZeroGPU just freeze in ‘Running’

stuck in last commit Sapiens Demo - a Hugging Face Space by joselobenitezg

@julien-c any idea?