Advanced settings

This section covers the advanced settings for fine-tuning the AI model's output. These parameters allow you to customize the behavior of the AI to better suit your specific use cases without requiring coding knowledge.

Temperature

Purpose: Controls the randomness in the AI's responses. Range: 0.0 to 1.0 Default: 1.0

• Lower values (0.0 - 0.5): Produce more consistent and deterministic responses. Suitable for fact-based or analytical tasks.

• Higher values (0.6 - 1.0): Generate more diverse and creative outputs. Ideal for brainstorming or creative writing tasks.

Note: Even at 0.0, responses may not be entirely deterministic due to the nature of language models.

Max Tokens

Purpose: Limits the length of the AI's response. Input: Positive integer or null Default: Not specified (uses model's maximum)

• Represents the maximum number of tokens (word pieces) in the AI's response.

• Helps control the length and detail of generated text.

Important: The total of input tokens and generated tokens must not exceed the model's context length.

Verbosity

Verbosity determines the length and detail of the AI’s responses. Adjusting this setting allows you to tailor output to your specific needs:

• High verbosity: Recommended for comprehensive document explanations or extensive code refactoring, where detailed output is required.

• Medium verbosity (default): Provides a balanced level of detail, suitable for most standard tasks.

• Low verbosity: Ideal for concise answers or simple code generation, such as brief SQL queries.

In GPT-5, verbosity can be set to high, medium, or low. Higher verbosity produces more thorough and structured responses, often including inline explanations. Lower verbosity generates shorter, more direct outputs with minimal commentary.

Select the verbosity level that best matches your use case for optimal results.

Adjusting Settings

1. Start with default values and make incremental adjustments.

2. Test the output after each adjustment to gauge the impact.

3. Consider your specific use case when modifying these parameters.

4. Document successful configurations for future reference.

Remember that optimal settings may vary depending on your specific application and desired output. Experimentation within safe ranges is encouraged to find the best configuration for your needs.