I have tried model.generate(**inputs, return_dict_in_generate=True, output_scores=True) but it only gives the scores for generated tokens. For my application, it would be convenient if there’s a similar parameter to echo in the OpenAI GPT-3 API that let’s us access prompt scores/logprobs. Any help is appreciated!
1 Like