Documentation Index Fetch the complete documentation index at: https://ai-kb.automationanywhere.com/llms.txt
Use this file to discover all available pages before exploring further.
The Analytics page gives you visibility into how your project is being used. It is organized into three tabs: Overview , Feedback , and LLM Metrics . You can filter data by date range and user email across all tabs.
The Overview tab provides a high-level summary of project activity and usage patterns across the selected date range. Filtering
Use the Filter by user email field and select Apply to scope analytics to a specific user.
Use the date range picker in the upper right to adjust the time window.
Summary Stats Stat Description Total Messages Total number of messages sent in the project. Unique Users Number of distinct users who have interacted with the project. Total Queries Total number of queries submitted. Average Response Time Average time taken to generate a response. Images Generated Total number of images generated by the agent.
Charts Chart Description Number of Queries Per Day Line chart showing daily query volume over the selected date range. Conversation Per User Donut chart showing the distribution of conversations across users. Unique Users Per Feature Bar chart showing distinct users triggering events by feature (e.g. Chat, File Addition, Create Project). Queries Per Feature Pie chart showing document usage split across features. Use the All Features dropdown to filter by a specific feature. User vs Query Activity Grouped bar chart comparing user count and query count per feature. Feedback Chart tracking correct answers, incorrect answers, and incorrect source URLs over time.
Exporting Overview Data Use the Export button to download the current Overview data in your preferred format: Format Description Export as CSV Excel-compatible format. Export as XLSX Preserves formatting.
The Feedback tab shows message-level feedback submitted by users, organized by sentiment. Use the date range picker in the upper right to filter feedback by time window.
Message Feedback A table of all feedback submitted within the selected date range: Column Description Users The user who submitted the feedback. Questions The question that prompted the response. Feedback Count Number of feedback submissions for that entry. Created Date and time the feedback was submitted. Actions View Feedback(s) opens the detailed feedback for that entry. View in Chat navigates to the corresponding chat window to review the full conversation.
Exporting Feedback The Message Feedback table supports selective or full export. Use the checkboxes to select individual rows, then choose which export to use: Option Description All → Export Exports all records in the Message Feedback table. Selected → Export Exports only the rows you have checked.
Both options support Export as CSV (Excel-compatible) and Export as XLSX (preserves formatting). Liked Messages A table of responses that received a thumbs-up from users, with columns for User , Question , Response , and Created . Disliked Messages A table of responses that received a thumbs-down from users, with columns for User , Question , Response , and Created . The LLM Metrics tab provides detailed performance data for tool calls made by the agent within the selected date range. Use the From Date and To Date fields to set the time window. Stat Description Tool Calls Total number of tool calls made. Tool Call Responses Total number of responses returned from tool calls. Successful Calls Number of tool calls that completed successfully. Failed Calls Number of tool calls that failed.
Stat Description Total Tokens Combined input and output tokens consumed across all calls. Input Tokens Total tokens sent to the model. Output Tokens Total tokens returned by the model. Success Rate Percentage of tool calls that completed successfully.
Charts Chart Description Tool Usage by Name Bar chart showing the most used tools, with successful and failed calls distinguished by color. Tool Usage Over Time Line chart showing the daily tool success and failure rate over the selected date range.
A searchable table listing per-tool performance metrics. Use the Search tools… field to filter by tool name. Column Description Tool Name The name of the tool called. Total Calls Total number of times the tool was called. Successful Calls Number of calls that completed successfully. Failed Calls Number of calls that failed. Success Rate Percentage of successful calls, displayed as a progress bar.
