How to track the volumen and usage of a custom chat agent

Q&A
,
1

Hi QuickSight Community,

I’m the creator of two QuickSight Q chat agents deployed in our organization, and I need to access usage and performance metrics for these agents to measure adoption, optimize performance, and justify org-wide expansion.

Current Situation:

  • Deployed 2 Q chat agents currently shared with 12+ users
  • Planning org-wide expansion but need metrics first
  • As the agent creator, I have no visibility into usage data

What I Need Access To:

  1. Usage volume (total queries, queries per day/week/month, unique active users)
  2. User engagement (query frequency, session duration, repeat usage)
  3. Performance metrics (response time, success rate)
  4. Quality feedback (thumbs up/down ratings, user satisfaction)
  5. Adoption tracking (active users over time, feature utilization)

My Questions:

  1. Is there a QuickSight:QuickSuiteUsageMetrics permission that can be granted to chat agent creators to access usage metrics? If so, how do I request this permission?

  2. Is there a dashboard or reporting tool where I can view usage metrics for my Q chat agents? If so, where can I find it?

  3. If neither option is available, what is the recommended process to regularly access usage data for Q chat agents? (API, data export, support ticket, etc.)

  4. Are there any plans to provide self-service analytics/metrics for Q chat agent creators in the future?

Thanks in advance to anyone who can help clarify these doubts.