Temperature is an important setting in GPT-3 that has a significant impact on the output of the system. It controls the amount of randomness in the output, and can be adjusted to achieve different results.
At lower temperatures, GPT-3 will tend to choose words with a higher probability of occurrence, which can be useful when you want the system to complete a sentence or phrase with a single correct answer.
On the other hand, higher temperatures can be used to generate ideas or tell stories, as they will produce a greater variety of responses.
It’s important to note that while some people refer to temperature as a creativity setting, official documentation does not recommend this label. Creativity is a more complex concept than simply increasing the level of randomness in the output. To get the most out of GPT-3, it’s important to understand how temperature works and how to adjust it to achieve your desired results. So, it’s worth spending some time understanding and adjusting the temperature setting to get the most out of GPT-3.
OpenAI generally recommends altering this or top_p but not both.
It is difficult to assign specific temperature values to specific types of content, as the appropriate temperature setting will depend on a variety of factors, including the specific task and the desired output. In general, lower temperature values will tend to produce responses that are more predictable and straightforward, while higher temperature values will produce responses that are more varied and creative. Here are a few general guidelines for how temperature values may be used in different contexts:
- Low temperature values (e.g., below 0.5): These values may be appropriate for tasks where you want GPT-3 to complete a sentence or phrase with a single correct answer, or for tasks where you want the output to be more predictable and straightforward.
- Medium temperature values (e.g., between 0.5 and 0.9): These values may be suitable for tasks where you want GPT-3 to generate ideas or content that is somewhat varied and creative, but still relatively grounded in reality.
- High temperature values (e.g., above 0.9): These values may be appropriate for tasks where you want GPT-3 to produce more creative and varied responses, or for tasks where you want the output to be more unpredictable and open-ended.
Let’s have a look at an example:
My prompt is: Write an article about hair loss. My temperature = 0.
As you can see in below response, it just started repeating itself.
And this time, i set my temperature = 1.
It is important to keep in mind that these are general guidelines, and the appropriate temperature setting will depend on the specific task and the desired output. It may be helpful to experiment with different temperature values to find the one that works best for your needs.
