Basics

Monitoring and Analytics

Use Monitoring and Analytics to understand how your AI agent performs in real-world conversations.
Dashboards and reports help you track performance, detect issues early, and continuously improve your conversational experience.

---

Real-Time Monitoring

Keep track of what’s happening right now.

• Active Sessions – See all ongoing conversations in real time.
• Response Time – Measure how fast your agent replies to users.
• Error Alerts – Get instant notifications about technical or logical errors.
• Conversation Volume – Monitor message traffic and identify usage peaks.

Tip: Use real-time dashboards during deployments or updates to confirm your agent is performing as expected.

Performance Metrics

Track key indicators that show how well your agent is working.

Metric	Description	Why It Matters
Average Response Time	Time between user message and agent reply	Indicates responsiveness
Session Duration	Typical length of a conversation	Helps spot overly long or stuck sessions
Resolution Rate	Percentage of conversations successfully completed	Reflects effectiveness
User Satisfaction	Inferred from sentiment and feedback	Measures perceived quality
Escalation Rate	How often sessions are handed to humans	Helps balance automation and support

Conversation Quality Insights

Understand what users feel and where your agent can improve.

• Sentiment Analysis – Detect positive, neutral, or negative tones.
• Goal Completion – Track if conversations meet defined objectives.
• Common Issues – Identify repeating user problems or agent misunderstandings.
• Agent Comparison – Compare results across agent versions or configurations.

Reporting and Dashboards

Analyze trends and share insights with your team.

• Conversation Reports – Export detailed conversation logs.
• Result Extraction – Download structured data from completed sessions.
• Trend Charts – Identify performance changes over time.
• Performance Dashboards – Visualize KPIs for your organization.

Use reports to support quarterly reviews or model retraining cycles.

Integration with Other Platform Features

Monitoring connects naturally with other parts of the Flametree platform.

Knowledge Base Analytics

• Search Trends – See which topics users ask about most.
• Content Gaps – Identify missing or unclear information.
• Usage Patterns – Track which FAQ articles drive successful answers.

Workflow Optimization

• State Flow Analysis – Visualize how users move between conversation states.
• Bottleneck Detection – Find points where conversations often stop.
• Flow Adjustments – Use insights to simplify transitions and improve flow logic.

Agent Configuration Improvement

• Behavior Analysis – Refine tone, empathy, or style based on user reactions.
• Response Tuning – Update prompts or templates that lead to weak results.
• Performance Calibration – Adjust parameters to reduce latency or escalation.

Best Practices

Regular Monitoring

Frequency	Focus
Daily	Check live sessions and critical alerts
Weekly	Review performance metrics and error rates
Monthly	Evaluate trends and identify workflow improvements
Quarterly	Perform full configuration and strategy review

Quality Assurance

• Review random conversation samples for accuracy and tone.
• Analyze errors to find training or setup issues.
• Collect and act on user feedback regularly.

Data Management

• Define data retention policies for compliance.
• Ensure access control to sensitive conversation logs.
• Maintain secure data backups to prevent loss.

Continuous Optimization

• Monitor response times and error rates closely.
• Use session logs to find weak spots in agent logic.
• Update the knowledge base when the agent frequently escalates to humans.
• Apply data-driven improvements for training and configuration.