Hi, dear community. I am new member here and I got stuck with the inference with HF model. Here is what I’m trying to do: there is a pre-trained HF model deployed as Sagemaker endpoint (code below, #1) I am trying to access this endpoint from outside Sagemaker - first from Lambda, then from Colab …

Deployed HF model from the hub and got an error: 'numpy.ndarray' object has no attribute 'pop'

pavel-nesterov September 15, 2021, 7:23am 3

Thank you, Philipp! @philschmid
I will try it right now!

P.S. And additional thanks for the tutorials you made, they are one of the main sources for me to progress.

Topic		Replies	Views
Inference failed for FLAN-UL2(20B) on SageMaker Amazon SageMaker	6	2166	April 4, 2023
How to make an inference for HuggingFaceModel of type 'image-to-text' Amazon SageMaker	0	511	January 27, 2024
Deploying Open AI's whisper on Sagemaker Amazon SageMaker	54	16200	April 12, 2024
Deploying T5-style models via Sagemaker Endpoint: 'T5LayerFF' object has no attribute 'config' Amazon SageMaker	5	1465	November 7, 2022
Deploying TheBloke/Luna-AI-Llama2-Uncensored-GGML Amazon SageMaker	0	844	September 11, 2023