ConnectionError: Couldn't reach https://huggingface.co/datasets/segments/sidewalk-semantic/resolve/main/dataset_infos.json (error 403)

seand0101 · November 25, 2024, 4:22am

@John6666 Dear John and other community members,

Do you know why and how to solve this error? I have reset my token several times and it seems doesn’t help the connections at all.

Best regards,
Sean

John6666 · November 25, 2024, 4:30am

To be honest, I’m not sure, but I think your case is similar to the second link?

github.com/huggingface/datasets

Connection error of the HuggingFace's dataset Hub due to SSLError with proxy

opened 06:56AM - 07 Nov 22 UTC

leemgs

### Describe the bug It's weird. I could not normally connect the dataset H…ub of HuggingFace due to a SSLError in my office. Even when I try to connect using my company's proxy address (e.g., http_proxy and https_proxy), I'm getting the SSLError issue. What should I do to download the datanet stored in HuggingFace normally? I welcome any comments. I think those comments will be helpful to me. * Dataset address - https://huggingface.co/datasets/moyix/debian_csrc/viewer/moyix--debian_csrc * Log message ``` ............ OMISSION .............. Traceback (most recent call last): File "/data/home/geunsik-lim/qtlab/./transformers/examples/pytorch/language-modeling/run_clm.py", line 587, in <module> main() File "/data/home/geunsik-lim/qtlab/./transformers/examples/pytorch/language-modeling/run_clm.py", line 278, in main raw_datasets = load_dataset( File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1719, in load_dataset builder_instance = load_dataset_builder( File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1497, in load_dataset_builder dataset_module = dataset_module_factory( File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1222, in dataset_module_factory raise e1 from None File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1179, in dataset_module_factory raise ConnectionError(f"Couldn't reach '{path}' on the Hub ({type(e).__name__})") ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError) [2022-11-07 15:23:38,476] [INFO] [launch.py:318:sigkill_handler] Killing subprocess 6760 [2022-11-07 15:23:38,476] [ERROR] [launch.py:324:sigkill_handler] ['/home/geunsik-lim/anaconda3/envs/deepspeed/bin/python', '-u', './transformers/examples/pytorch/language-modeling/run_clm.py', '--local_rank=0', '--model_name_or_path=Salesforce/codegen-350M-multi', '--per_device_train_batch_size=1', '--learning_rate', '2e-5', '--num_train_epochs', '1', '--output_dir=./codegen-350M-finetuned', '--overwrite_output_dir', '--dataset_name', 'moyix/debian_csrc', '--cache_dir', '/data/home/geunsik-lim/.cache', '--tokenizer_name', 'Salesforce/codegen-350M-multi', '--block_size', '2048', '--gradient_accumulation_steps', '32', '--do_train', '--fp16', '--deepspeed', 'ds_config_zero2.json'] exits with return code = 1 real 0m7.742s user 0m4.930s ``` ### Steps to reproduce the bug Steps to reproduce this behavior. ``` (deepspeed) geunsik-lim@ai02:~/qtlab$ ./test_debian_csrc_dataset.py Traceback (most recent call last): File "/data/home/geunsik-lim/qtlab/./test_debian_csrc_dataset.py", line 6, in <module> dataset = load_dataset("moyix/debian_csrc") File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1719, in load_dataset builder_instance = load_dataset_builder( File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1497, in load_dataset_builder dataset_module = dataset_module_factory( File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1222, in dataset_module_factory raise e1 from None File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1179, in dataset_module_factory raise ConnectionError(f"Couldn't reach '{path}' on the Hub ({type(e).__name__})") ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError) (deepspeed) geunsik-lim@ai02:~/qtlab$ (deepspeed) geunsik-lim@ai02:~/qtlab$ (deepspeed) geunsik-lim@ai02:~/qtlab$ (deepspeed) geunsik-lim@ai02:~/qtlab$ cat ./test_debian_csrc_dataset.py #!/usr/bin/env python from datasets import load_dataset dataset = load_dataset("moyix/debian_csrc") ``` 1. Adde proxy address of a company in /etc/profile 2. Download dataset with load_dataset() function of datasets package that is provided by HuggingFace. 3. In this case, the address would be "moyix--debian_csrc". 4. I get the "`ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError`)" error message. ### Expected behavior * error message: ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError) ### Environment info * software version information: ``` (deepspeed) geunsik-lim@ai02:~$ (deepspeed) geunsik-lim@ai02:~$ conda list -f pytorch # packages in environment at /home/geunsik-lim/anaconda3/envs/deepspeed: # # Name Version Build Channel pytorch 1.13.0 py3.10_cuda11.7_cudnn8.5.0_0 pytorch (deepspeed) geunsik-lim@ai02:~$ conda list -f python # packages in environment at /home/geunsik-lim/anaconda3/envs/deepspeed: # # Name Version Build Channel python 3.10.6 haa1d7c7_1 (deepspeed) geunsik-lim@ai02:~$ conda list -f datasets # packages in environment at /home/geunsik-lim/anaconda3/envs/deepspeed: # # Name Version Build Channel datasets 2.6.1 py_0 huggingface (deepspeed) geunsik-lim@ai02:~$ uname -a Linux ai02 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux (deepspeed) geunsik-lim@ai02:~$ cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=20.04 DISTRIB_CODENAME=focal DISTRIB_DESCRIPTION="Ubuntu 20.04.5 LTS" ```

github.com/huggingface/transformers

SSLError: HTTPSConnectionPool(host='huggingface.co', port=443)

opened 03:46PM - 08 Jun 22 UTC

closed 03:02PM - 15 Aug 22 UTC

alexsomoza

I'm trying in python: from sentence_transformers import SentenceTransformer …sbert_model = SentenceTransformer('all-MiniLM-L6-v2') and I get this error: SSLError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/sentence-transformers/all-MiniLM-L6-v2 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1091)'))) I have no proxy, just getting direct to internet !!!

John6666 · November 25, 2024, 4:32am

By the way, that model is a gated model, so you can’t use it without permission, but did you get permission?

seand0101 · November 25, 2024, 4:43am

Who would’ve thought a tutorial would use a gated dataset, pardon my dumb question. Thanks for helping me out

John6666 · November 25, 2024, 4:46am

Who would’ve thought a tutorial would use a gated dataset,

What? The model specified in the tutorial was a gated model?
If that wasn’t explained in the tutorial, it’s almost a bug!
Give me the link. I’ll just report the bug…

seand0101 · November 25, 2024, 4:48am

It’s a github tutorial that uses huggingface so I don’t know if it counts as huggingface faults… but thanks…

Here’s the link, I hope I didn’t shame myself by not reading it properly

github.com

huggingface/notebooks/blob/main/examples/semantic_segmentation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "CL089-JvFAXe"
   },
   "source": [
    "# Fine-tuning for Semantic Segmentation with 🤗 Transformers\n",
    "\n",
    "In this notebook, you'll learn how to fine-tune a pretrained vision model for Semantic Segmentation on a custom dataset in PyTorch. The idea is to add a randomly initialized segmentation head on top of a pre-trained encoder, and fine-tune the model altogether on a labeled dataset. You can find an accompanying blog post [here](https://huggingface.co/blog/fine-tune-segformer). "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "2UEtIWt0sGkR"
   },
   "source": [
    "## Model\n",

This file has been truncated. show original

John6666 · November 25, 2024, 4:51am

It’s a github tutorial that uses huggingface so I don’t know if it counts as huggingface faults…

Thank you. That’s the github account managed by HF, so it’s HF’s fault.

John6666 · November 25, 2024, 5:09am

I raised an issue.

github.com/huggingface/notebooks

A dataset used in the tutorial is a gated problem

opened 05:08AM - 25 Nov 24 UTC

John6666cat

The dataset used in one of the tutorials seems to be a gated model, as the title… suggests. As there is no explanation of this in the tutorial, it seems that it was not gated at the time the tutorial was written. I noticed this after someone pointed it out in the forum. ### Code https://github.com/huggingface/notebooks/blob/0454d7dbc7d0b1acbe78fd38e979a30729947026/examples/semantic_segmentation.ipynb#L150 ### Gated dataset https://huggingface.co/datasets/segments/sidewalk-semantic ### Reference https://discuss.huggingface.co/t/connectionerror-couldnt-reach-https-huggingface-co-datasets-segments-sidewalk-semantic-resolve-main-dataset-infos-json-error-403/127549

seand0101 · November 25, 2024, 8:40am

Thank you very much, will watch over that issue

system · November 25, 2024, 8:41pm

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Connection Error when Accessing Dataset URL on Hugging Face 🤗Datasets	5	4702	February 2, 2024
Cannot login in to hugging face and cannot access the dataset 🤗Hub	2	2643	September 11, 2024
ConnectionError: Couldn't reach https://huggingface.co/datasets/mozilla-foundation/common_voice_13_0/resolve/main/common_voice_13_0.py 🤗Datasets	1	491	July 12, 2024
Which URLs should be reachable to work with Huggingface hub 🤗Datasets	2	1812	January 26, 2022
Not able to upload or download custom datasets 🤗Datasets	3	175	October 6, 2024

ConnectionError: Couldn't reach https://huggingface.co/datasets/segments/sidewalk-semantic/resolve/main/dataset_infos.json (error 403)

Related topics