How to track the volumen and usage of a custom chat agent

Q&A
,
1

Hi QuickSight Community,

I’m the creator of two QuickSight Q chat agents deployed in our organization, and I need to access usage and performance metrics for these agents to measure adoption, optimize performance, and justify org-wide expansion.

Current Situation:

  • Deployed 2 Q chat agents currently shared with 12+ users
  • Planning org-wide expansion but need metrics first
  • As the agent creator, I have no visibility into usage data

What I Need Access To:

  1. Usage volume (total queries, queries per day/week/month, unique active users)
  2. User engagement (query frequency, session duration, repeat usage)
  3. Performance metrics (response time, success rate)
  4. Quality feedback (thumbs up/down ratings, user satisfaction)
  5. Adoption tracking (active users over time, feature utilization)

My Questions:

  1. Is there a QuickSight:QuickUsageMetrics permission that can be granted to chat agent creators to access usage metrics? If so, how do I request this permission?

  2. Is there a dashboard or reporting tool where I can view usage metrics for my Q chat agents? If so, where can I find it?

  3. If neither option is available, what is the recommended process to regularly access usage data for Q chat agents? (API, data export, support ticket, etc.)

  4. Are there any plans to provide self-service analytics/metrics for Q chat agent creators in the future?

Thanks in advance to anyone who can help clarify these doubts.

2

Hello Ecguille,

First of all Welcome to the Quick Community.

Currently, If i am not mistaken only IAM administrators have access to the analytics dashboard in Amazon Quick.

This means that as a chat agent creator, you don’t have direct self-service access to usage metrics for your deployed agents.

Available Analytics Dashboard Features

When accessed by administrators, the Quick analytics dashboard provides comprehensive metrics including :

Conversation Analytics:

  • Total conversations and queries

  • Average queries per user and per conversation

  • Active users (daily, weekly, monthly)

  • Trends over time with monthly granularity

User Engagement:

  • Usage patterns and growth trends

  • Feature adoption metrics

  • User feedback analytics (satisfaction tracking)

Agent-Specific Filtering:

  • Ability to filter by “All Agents” or specific agents

  • Date range selection for trend analysis

For reference see - Using the Amazon Quick Suite analytics dashboard - Amazon Quick Suite

you may have to reach out to your IAM Admin to get those details.

Hope this helps.

Cheers,

Deep