Dashboard

The Dashboard provides a centralized view of your test suite’s health, performance, and AI usage. Use it to monitor trends, identify issues, and make data-driven decisions about your testing strategy.

​

Video overview

The dashboard is organized into two main tabs designed for different workflows:

​

Overview Tab

Use the Overview tab for quick health checks and high-level monitoring. It displays essential metrics, trend analysis, and AI usage statistics at a glance.

​

Key Metrics

The top of the Overview tab shows four essential metrics that summarize your test suite’s current state: Use these metrics to spot drift quickly. A declining pass rate or rising average duration usually indicates issues to investigate.

​

Test Status Trend

The Test Status Trend chart shows how your test results change over time as a stacked area chart.

• Green area = Passed tests
• Red area = Failed tests
• Gradient fills for visual clarity
• Hover for exact counts and dates

Sudden spikes in failures often align with a deployment, data change, or environment issue.

​

Health Score

The Health Score radar chart provides a comprehensive view of your test suite’s health across five dimensions: The overall health score is calculated as the average of these five metrics. Hover over any metric to see its detailed description. Focus on improving the metric with the lowest score to maximize overall health.

​

AI Statistics

The AI Statistics panel provides comprehensive insights into AI-powered test steps: Success Rate Ring Gauge

• Large, visual percentage display
• Gradient glow effect for modern aesthetics

Performance Metrics

• Avg Time - Average execution time for AI steps
• Credits Used - Total AI credits consumed
• Top Feature - Most used AI feature

Credit Distribution

• Stacked bar chart showing credit usage by feature
• Interactive legend with hover effects
• Color-coded by AI feature type

Top Usage List

• Ranked list of AI features by credit consumption
• Visual indicators with color-coded borders
• Hover interactions for detailed insights

Use this data to optimize AI feature usage and manage credit costs effectively.

​

Test Plans

The Test Plans section displays the health of your scheduled test plans: This section helps you monitor automated test runs and ensure your scheduled tests are running as expected.

​

Health & Issues Tab

Use the Health & Issues tab for detailed failure analysis and troubleshooting. It provides deep insights into test failures, flaky tests, and areas requiring immediate attention.

​

Failure Breakdown

The Failure Breakdown chart categorizes all test failures to help you identify patterns: Interactive Features:

• Hover over pie slices to expand and highlight legend items
• Click legend items to highlight corresponding pie slices
• Each category shows count and percentage
• Color-coded for quick identification

Focusing on the most common failure category yields the highest impact fixes.

​

Pass Rate Trend

The Pass Rate Trend chart tracks your overall pass rate (0-100%) over time. This helps you:

• Identify gradual degradation in test stability
• Correlate pass rate changes with deployments or code changes
• Set benchmarks for acceptable pass rates

The chart features a green gradient fill with hover tooltips showing date and pass rate details.

​

Tests Needing Attention

A prominent banner shows the total count of tests that need your attention, combining failed tests and high-flakiness tests into a single prioritized list. Click the banner to open a detailed modal with:

• Filter tabs: All, Failed, Flaky
• Table showing Test Name, Type, Status, and Last Run
• Click any test to navigate directly to its details

This helps you focus on the most critical issues first.

​

Recent Failures

The Recent Failures list shows the most recent test failures. Each entry includes:

• Test title (clickable link to test details)
• Occurrence count badge for repeated failures
• Failed step type and error message
• Failure category badge (color-coded)
• Relative time (e.g., “2h ago”)

Hover over any failure to see:

• Full error trace
• Detailed error message
• Complete logs

Use this to quickly identify and investigate new failures.

​

Snoozed Tests

The Snoozed Tests section displays tests that have been temporarily suppressed from failure notifications. Each entry shows:

• Test title (clickable link to test details)
• Snooze duration (e.g., “Until Feb 15” or “Indefinite”)
• Time remaining countdown

This helps you track temporarily suppressed tests and unsnooze them when ready to address the underlying issues.

​

Flaky Tests

The Flaky Tests section lists tests with inconsistent results. Each entry shows:

• Test title (clickable link to test details)
• Flakiness badge: Critical (red), High (orange), Medium (yellow), Low (blue)
• Pass/fail counts and total runs

Flaky tests erode confidence in your test suite. Prioritize fixing tests with “Critical” or “High” flakiness labels. Common causes of flakiness:

• Race conditions and timing issues
• Dynamic content that changes between runs
• Network latency variations
• Shared test data conflicts
• Environment differences

​

Slowest Tests

The Slowest Tests section identifies performance bottlenecks. Each entry shows:

• Test title (clickable link to test details)
• Run count for statistical significance
• Average duration in yellow text

Optimizing slow tests improves overall suite execution time and reduces CI/CD costs.

​

Filters and Date Range

The dashboard supports several filters to focus your analysis: If the charts show no data, try widening the date range or changing the environment filter.

​

Best Practices

​

Troubleshooting

​

Related Pages