What It Does
The reporting and feedback function:- Posts a daily triage summary to a stakeholder channel
- Tracks ticket volume, intent mix, route distribution, SLA risk, and automation health
- Surfaces low-confidence classifications, reroutes, and tool failures
- Reviews human tag and routing corrections
- Proposes improvements to categories, attributes, workflows, guidelines, tools, and classifier instructions
- Measures whether updates improve future runs
Recommended Components
| Need | Duckie component |
|---|---|
| Recurring report | Scheduler deployment |
| Reporting logic | Duckie Assistant reporting agent |
| Inspect Duckie runs | Duckie Assistant MCP or Runs API |
| Destination | Slack app tools |
| Feedback review | Duckie Assistant feedback agent |
| Track changes | Issue tracker or support operations queue |
Reporting Flow
Feedback Flow
Report Contents
Include:- New ticket volume by channel
- Intent and product-area breakdown
- Route and queue distribution
- Tickets at SLA risk
- Priority customer or high-risk tickets
- Classification confidence distribution
- Low-confidence escalations sent and resolved
- Missing context patterns
- Helpdesk writeback failures
- Reroutes after Duckie assignment
- Top recommended improvements
Example Digest Shape
Improvement Actions
Common improvements include:- Rename or merge confusing tags
- Add a new category for a repeated customer intent
- Change the classifier confidence threshold
- Add a routing rule for a customer segment or product area
- Add a missing context lookup tool
- Update the handoff note format
- Add a guardrail for sensitive tickets
- Update the daily report to show a metric the team actually uses
Related Docs
Scheduled Deployments
Run the daily report on a schedule.
Duckie Assistant Agents
Build reporting and feedback agents for Duckie system improvement.
Analytics
Monitor performance and trends.
Replay Testing
Test triage changes against historical tickets.