Using the Playground
Viewing Execution Details
The execution panel shows everything that happened:Steps Executed
See the sequence of actions:- Message received
- Guardrails checked
- Knowledge searched
- Runbook/workflow executed
- Response generated
Knowledge Retrieved
See what the agent found:- Which articles matched
- Relevance scores
- Content used in response
Tool Calls
See what actions were taken:- Tool name
- Input parameters
- Output/result
- Success or failure
Reasoning
Understand why the agent made decisions:- How it interpreted the question
- Why it chose certain knowledge
- How it formulated the response
Testing Scenarios
Happy Path Testing
Test common questions with clear answers:Edge Case Testing
Test unusual or difficult scenarios:Guardrail Testing
Test messages that should trigger escalation:Knowledge Testing
Test for knowledge gaps:Saving Tests
Convert useful playground conversations to batch tests:Rating Responses
Provide feedback on response quality:- π Good response
- π Needs improvement
- Add comments for context
Starting a New Conversation
To start fresh:- Click New Conversation or the refresh icon
- Previous conversation is cleared
- Context is reset
Tips for Effective Testing
Test Like a Customer
Write messages the way customers actually write:- Incomplete sentences
- Typos and informal language
- Multiple questions at once
- Vague descriptions
Test Conversation Flow
Donβt just test single messages β test multi-turn conversations:- Customer asks question
- Agent responds
- Customer asks follow-up
- Agent maintains context
Document Issues
When you find problems:- Note what you asked
- Note what the agent did wrong
- Check execution details for root cause
- Update configuration to fix
Test After Changes
After updating agent configuration:- Re-test affected scenarios
- Verify the fix works
- Check for regressions
Playground vs Production
| Aspect | Playground | Production |
|---|---|---|
| Messages | You send manually | Real customers |
| Context | Fresh each conversation | Full history |
| Actions | May be simulated | Real execution |
| Visibility | Only you | Customers see |
Playground is for validation. Always follow up with shadow mode on real traffic before going live.