TypeError: model_fn() takes 1 positional argument but 2 were given

akshat-kumar-akight · April 2, 2024, 2:19pm

This code is executed for inference. You can see lines 277 to 281 where they have defined functions load_fn, predict_fn etc. These functions are like user defined proxies to load, predict and other huggingface functions. Just one constraint that these user proxy functions should take the arguments passed by respective huggingface defined functions.

github.com

aws/sagemaker-huggingface-inference-toolkit/blob/main/src/sagemaker_huggingface_inference_toolkit/handler_service.py

# Copyright 2021 The HuggingFace Team, Amazon.com, Inc. or its affiliates. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

import importlib
import logging
import os
import sys
import time
from abc import ABC

This file has been truncated. show original

Topic		Replies	Views
ModelError when I run predict after deploying wizardcoder for text-generation Amazon SageMaker	1	916	September 25, 2023
Custom Inference.py script for Vision Transformer Amazon SageMaker	2	1553	December 9, 2022
ModelError when deploying google/flan-t5-xl Amazon SageMaker	1	448	July 31, 2023
Inference error for FLAN-UL2 on AWS SageMaker Amazon SageMaker	1	957	April 3, 2023
Modelerror when deploying openchat3.5 Amazon SageMaker	0	222	April 2, 2024

TypeError: model_fn() takes 1 positional argument but 2 were given

Related topics