Hi there,
We faced an issued that when we call an Accelerated API of conversational task in the hub, the parameter temperature doesn’t work. We expect that if the temperature is set to 80.0, the AI response will be somehow random. But the fact is that the AI response is always fixed for an input, whether the temperature is set to 0.0 or 100.0 We can be sure that this is not a spelling error, because if we set the temperature to 800.0, the API returns an error stating that the temperature range is 0.0 to 100.0
We can be sure that this is not a spelling error, because if we set the temperature to 800.0, the API returns an error stating that the temperature range should be 0.0 to 100.0
model used: microsoft/DialoGPT-medium · Hugging Face
payload for calling the api:
{
"inputs": {
"text": "are you ok?",
},
"parameters": {
"min_length": 5,
"max_length": 280,
"top_k": 10,
"top_p": 0.95,
"temperature": 80.0,
"repetition_penalty": 50.0,
"max_time": 5.0
},
"options":{
"use_gpu": False,
"use_cache": False,
"wait_for_model": True,
}
}