Creating a New Runbook
1
Navigate to Runbooks
Go to Build → Runbooks in your dashboard.
2
Click Create Runbook
Click Create Runbook to open the editor.
3
Name Your Runbook
Give it a clear, descriptive name:
- Good: “Password Reset Procedure”, “Refund Request Handler”
- Avoid: “Runbook 1”, “Support”
4
Write Your Instructions
Use the editor to write your runbook content.
5
Save
Click Save to save your runbook.
Writing Effective Instructions
Start with an Objective
Begin with a clear statement of what the runbook should accomplish:Write Clear Steps
Use numbered steps for the main procedure:- Use action verbs: “Ask”, “Check”, “Use”, “Explain”
- Be specific but not over-prescriptive
- Include what information to gather
Add Conditional Guidance
Handle different scenarios:Reference Tools
Embed tool references when the agent should take action:Include Snippets
Insert reusable snippets for common procedures:Define Escalation Criteria
Be explicit about when to escalate:Runbook Template
Use this structure as a starting point:Testing Your Runbook
Before assigning to an agent, test it:1
Create a Test Agent
Create an agent using this runbook (or update an existing one).
2
Open Playground
Go to Test → Playground and select the agent.
3
Run Test Scenarios
Try different conversation paths:
- Happy path (everything works)
- Error cases (account not found, etc.)
- Edge cases (unusual requests)
- Escalation triggers
4
Review Execution
Check the execution steps to see how the agent interpreted your instructions.
5
Iterate
Update the runbook based on what you observe.
Best Practices
Do
- Be specific about goals — Clear objectives help the agent make good decisions
- Use natural language — Write like you’re training a human teammate
- Cover edge cases — Think about what could go wrong
- Include examples — Show what good responses look like
- Test thoroughly — Try many scenarios before deploying
Don’t
- Don’t over-prescribe — Leave room for the AI to adapt
- Don’t assume context — Be explicit about what information to gather
- Don’t forget escalation — Always define when to hand off
- Don’t skip testing — Real conversations will surprise you