Loving this model, and if we can use the API we’re happy to do so. Using Pegasus summarization for some testing.
human-centered-summarization/financial-summarization-pegasus · Hugging Face
However, there seem to be no options to pass via POST to determine a minimum and maximum length, which renders this endpoint useless.
Am I missing something here? Thanks, happy to be a new subscriber.
Hi @induveca ,
Why would you say the endpoint is useless without being able to specify min_length and max_length ? Models are conditioned to summarize, so the output should work.
Anyway, you can still specify min_length and max_length even if these arguments are not documented (they are not documented which means behavior is subject to change in the future). They are specified in tokens length, which is really hard to gauge if you are only handling text.
If you are using those, expect that the output might be cut mid sentence as you are basically forcing the model to stop outputting tokens even if it had still tokens to say.
Cheers,
Nicolas
It has a maximum length of 32 tokens for a financial model. When inputting an earnings call that will never be enough.
So it is useless for any financial document without that ability to tweak.
Are there other parameters we can use other than min_length and max_length? Thanks for the help.
Any ideas here? I can just download and host it myself, but I do love the api-inference. Not seeing any parameter options on the api-inference demo. Assume this is a mistake, as it’s your profit driver and happy to pay/upgrade to a much larger plan if I can get it working correctly via api-inference. 
Thanks much for the awesome resource/community.