Reports (draft)

Overview

Generate comprehensive text-based reports for individual agents using conversational AI. Simply describe what you want to analyze about a specific agent, and our intelligent system will gather the data and provide detailed insights.

How It Works

1. Select an Agent: Choose which agent to analyze
2. Ask Your Question: Describe what you want to know in natural language
3. Get Text Report: Receive a detailed text-based analysis (no graphs or visualizations)
4. Follow-up: Ask additional questions to refine your analysis

Example Queries

"From the runs in the last week, analyze which conversations didn't go well and what are the reasons why they didn't go so well?"

"Search for all runs in the last month with response times over 5 seconds. What's causing the delays?"

"Review runs with sentiment scores below 0.5 from this week. What common issues can you identify?"

"Compare this agent's performance between this month and last month. What changed?"

Report Features

• Text-Based Analysis: Detailed written insights and recommendations
• Ongoing Generation: Run queries like "search for all runs in the last week and analyze X"
• Agent-Specific: All analysis scoped to the selected agent
• Follow-up Questions: Refine your analysis with additional queries

Smart Suggestions

When you start, our AI assistant provides suggested report instructions based on your agent's data patterns. You can:

• Use Suggestions: Accept pre-generated report prompts
• Modify Prompts: Edit suggestions to fit your needs
• Create Custom: Write your own analysis instructions

Available Data

The system can analyze:

• Runs: Individual executions with inputs/outputs
• Costs: Spending by model and time period
• Quality Metrics: Sentiment scores and performance data
• Usage Patterns: Request volumes and response times

Getting Started

1. Navigate to Reports in your dashboard
2. Select the agent to analyze
3. Choose a suggested report or write your own instruction
4. Review the generated text report
5. Ask follow-up questions as needed

Stay tuned as we add more sophisticated analysis capabilities.