Text Tools
Generate Text
Text Tools
Generate Text
The Generate Text step lets you prompt AI models. You can use any of the models we have available on Respell, with most of their settings available.
Options
| Name | Type | Description |
|---|---|---|
| Model | Dropdown | Choose the AI model you want a response from. |
| Prompt | Plain Text | The prompt (instruction) to send to the AI. This could be a question or a task you give the AI to complete. |
| Advanced Mode | Boolean | Enable the advanced options for this step. The options below are hidden unless this is enabled. |
| Temperature | Decimal between 0-2 | How creative the AI should be in its response. Higher temperatures will make the AI more creative, but it may not follow the prompt entirely. Set temperature low for tasks where you want consistent responses. |
| Max Tokens | Integer between 0-4096 | Maximum number of tokens to generate. The allowed values will be different depending on the selected model. |
| JSON Mode | Boolean | Whether the output should be returned in JSON format. |
| System Instruction | Plain Text | Define how the model should behave when writing responses. This is where you tell the model how it should sound, who to roleplay as, or other instructions that dictates its identity. |
Outputs
| Name | Type | Description |
|---|---|---|
| Response | Plain Text | The response from the AI model. |
Tips
- We have curated steps (such as Summarize Text) with pre-built prompts for common steps. Try those steps before writing your own prompt!
- Try different models with your prompt to see how it performs. Different models are good at some tasks, but may struggle with others.
- Set temperature to 1 to start while you’re experimenting.
- A lower Max Tokens setting will make the model run faster.
- When writing your own prompt, you’ll need to move between editing the prompt and testing a lot. We’re working on an experience to help with this! 🤫