Creating a New Runbook
Name Your Runbook
Give it a clear, descriptive name:
- Good: “Password Reset Procedure”, “Refund Request Handler”
- Avoid: “Runbook 1”, “Support”
Writing Effective Instructions
Start with an Objective
Begin with a clear statement of what the runbook should accomplish:Write Clear Steps
Use numbered steps for the main procedure:- Use action verbs: “Ask”, “Check”, “Use”, “Explain”
- Be specific but not over-prescriptive
- Include what information to gather
Add Conditional Guidance
Handle different scenarios:Reference Tools
Embed tool references when the agent should take action:Include Snippets
Insert reusable snippets for common procedures:Define Escalation Criteria
Be explicit about when to escalate:Runbook Template
Use this structure as a starting point:Testing Your Runbook
Before assigning to an agent, test it:Run Test Scenarios
Try different conversation paths:
- Happy path (everything works)
- Error cases (account not found, etc.)
- Edge cases (unusual requests)
- Escalation triggers
Best Practices
Do
- Be specific about goals — Clear objectives help the agent make good decisions
- Use natural language — Write like you’re training a human teammate
- Cover edge cases — Think about what could go wrong
- Include examples — Show what good responses look like
- Test thoroughly — Try many scenarios before deploying
Don’t
- Don’t over-prescribe — Leave room for the AI to adapt
- Don’t assume context — Be explicit about what information to gather
- Don’t forget escalation — Always define when to hand off
- Don’t skip testing — Real conversations will surprise you