I am working on an Accelerated Inference project with Javascript. The model I am most interested in is EleutherAI/gpt-j.
I am trying to find the parameters to pass to the model to control things like the temperature and the length of the reply. For some reason I cannot seem to set these varaibles.
I am looking at this page. It talks about gpt2.
Does the info on this page apply to gpt-j? Does it apply to Javascript?