Hi All. I started a 7 day trial for the startup plan. I need to use GPT-J through HF inference API. I pinned it in on org account to work on GPU and, after sending a request, all I get back is a single generated word. The max token param is set to 100. Could you please let me know how should I mak…

How does the GPT-J inference API work?

nielsr September 28, 2021, 7:46am 2

Hi,

Normally it should become available. I’ll ask the team and get back to you.

1 Like