It’s strange: if I send only one sentence as input, it works:
So this is my request:
{
“inputs”: “Nowadays, many users would like to upgrade old hard drive to SSD with Windows installed, or reinstall Windows 10 on SSD afterward.”,
“parameters”: {
“return_full_text”: false,
“max_new_tokens”: 100,
“temperature”: 0.8
},
“options”: {
“use_cache”: false
}
}
And I get back this:
HTTP/1.1 200 OK
date: Wed, 29 Sep 2021 07:06:20 GMT,Wed, 29 Sep 2021 07:06:29 GMT
server: istio-envoy
x-compute-time: 2.1995999999999998
x-compute-type: gpu
access-control-expose-headers: x-compute-type, x-compute-time
x-compute-characters: 130
content-length: 130
content-type: application/json
x-envoy-upstream-service-time: 2244
[{“generated_text”:" In this way, they can enjoy the performance of SSD and the convenience of Windows. In the first place, the"}]
To me, it looks like there is some sort of a limit on the input tokens