What is Temperature for Mistral-small

Beginners
1

Hi guys
In Mistral-Small-3.1-24B-Instruct-250 Usage section it is mentioned some recommended temperature value.

From the examples same page bellow I can assume it is nothing about cpu or something environment requirements but more like some model parameter or something?

So where it really comes from? Is it something

  • model specific
  • some mentioned vllm settings
    or what is it in fact. Where’s some docs or info related to this temperature could be read.

Thank you

1 Like
2

You can think of temperature as a common parameter that is used in all LLM. To be more precise, it might be more accurate to say that it is a programming strategy used when generating…

1 Like
3

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.