Hi, dear community. I am new member here and I got stuck with the inference with HF model. Here is what I’m trying to do: there is a pre-trained HF model deployed as Sagemaker endpoint (code below, #1) I am trying to access this endpoint from outside Sagemaker - first from Lambda, then from Colab …

Deployed HF model from the hub and got an error: 'numpy.ndarray' object has no attribute 'pop'

philschmid September 15, 2021, 10:49am 6

Glad I could help you.

BTW. you said you are using Serverless Framework for deployment? It is pretty to add additional python dependencies with it.

Topic		Replies	Views
Inference failed for FLAN-UL2(20B) on SageMaker Amazon SageMaker	6	2166	April 4, 2023
How to make an inference for HuggingFaceModel of type 'image-to-text' Amazon SageMaker	0	511	January 27, 2024
Deploying Open AI's whisper on Sagemaker Amazon SageMaker	54	16200	April 12, 2024
Deploying T5-style models via Sagemaker Endpoint: 'T5LayerFF' object has no attribute 'config' Amazon SageMaker	5	1465	November 7, 2022
Deploying TheBloke/Luna-AI-Llama2-Uncensored-GGML Amazon SageMaker	0	844	September 11, 2023