What detailed parameters can be used while calling EleutherAI/gpt-neo-x models from Inference API?

Beginners
1

Hi,

Where can I find more details on what detailed parameters can be used while calling EleutherAI/gpt-neo-x models from Inference API?

I haven’t found any details on these links beyond a basic example.

This page from Inference Docs also doesn’t cover these models.

thanks,

2

you wont find in the documentation because they didnt write it…

the only additional parameter that I was able to use was max_length

3

We are slowly adding some.

end_sequence = “###” is coming very soon.

Cheers,
Nicolas

4

thanks @Narsil, Looking forward to it.