Skip to main content

Dashboard Guide

The Teckel AI dashboard is your central hub for monitoring and improving the quality of your AI systems. This guide will walk you through the main sections of the dashboard and how to use them.

Dashboard​

The Dashboard provides a comprehensive overview of the queries being sent to your AI system and their corresponding audit scores. This is a great way to monitor the overall health of your document base to understand how the chatbot is generally performing.

Audit History​

The Audit History page provides a comprehensive log of all the traces that have been sent to Teckel AI. For each trace, you can see:

  • The user's query and the AI's response.
  • The overall quality score, as well as the individual scores for faithfulness, context precision, response relevancy, and document freshness.
  • A detailed claims analysis showing which factual statements were supported by your source documents.
  • Document quality insights identifying which sources contribute to high-quality responses.
  • Qualitative feedback and issue tags identified by the Teckel Judge.
  • The source documents that were used to generate the response.

Trace Details​

By clicking on a trace in the Audit History, you can view a more detailed analysis of the interaction. This enhanced view includes:

  • Claims Breakdown: See every factual claim extracted from the AI's response and which source documents support each claim
  • Document Quality Analysis: Understand which documents contributed to high-quality responses and which may need improvement
  • Document Health Impact: View how this trace affects the overall health score of referenced documents
  • Knowledge Base Insights: Identify patterns in document usage and effectiveness
  • Improvement Recommendations: Get specific, actionable feedback on how to enhance your knowledge base

This comprehensive analysis helps you understand not just response quality, but exactly which documents need attention to improve future AI performance.

Documents Analytics​

The Documents section provides powerful insights into the health and performance of your knowledge base:

  • Document Health Scores: View aggregated performance metrics for each document based on all traces that reference it
  • Precision Tracking: See how often chunks from each document actually support factual claims in AI responses
  • Freshness Monitoring: Track which documents may be becoming stale based on their last updated timestamps
  • Usage Analytics: Understand which documents are most frequently referenced and how they're performing
  • Problem Identification: Quickly identify documents that consistently lead to unsupported claims or poor response quality

This document-level analytics helps you prioritize which parts of your knowledge base need attention for maximum impact on AI quality.

Query Insights​

The Query Insights page shows trends in user questions based on semantic understanding, accomplished by vector embedding the trace data received. Enhanced with our claims-based analysis, this section now provides:

  • Topic Clustering: Group similar queries to identify common user needs
  • Knowledge Gap Detection: Spot areas where users frequently ask questions that your AI struggles to answer well
  • Document Coverage Analysis: See which topics are well-covered by your documentation and which need expansion
  • Claims Support Analysis: Understand what types of factual claims your AI makes most often and which documents provide the best support
  • Document Performance by Topic: Identify which documents perform best for different question categories

This helps you understand not just what users are asking, but which documents in your knowledge base need attention for maximum impact on AI quality.

Administrative Controls​

For users with admin privileges, the dashboard provides a set of administrative controls for managing your organization's settings:

  • API Keys: Generate and manage API keys for your different environments.
  • User Management: Invite new users to your organization, assign roles, and manage team memberships (coming soon).
  • Billing: Review your usage-based billing and company plan.
  • Settings: Configure notifications, set quality score thresholds, and customize other preferences for your organization.