Scale test Quicksight Dashboards Load Time

Hello all,

IHAC who would like to scale test Quicksight Dashboards to simulate up to 50 concurrent users as the expected number of concurrent users during the peak time > 100. The customer has just migrated from Oracle/Qlik. Currently, Quicksight Dashboards are configured in Direct Query to Amazon Redshift, retrieving Billions of rows.

1/ How to invoke the Quicksight dashboards programmatically to scale test the dashboards and simulate concurrent users ?
2/ How the caching in Quicksight Direct Query with Amazon Redshift works, if any ?
3/ I do not see all the data points of CloudWatch DashboardViewLoadTime when opening the Dashboards in parallel containerized sessions in my browser. Is it expected ?
4/ Is there any reference customer using both Quicksight and Redshift at scale with the number of users, the size of Amazon Redshift cluster and data volume/number of rows ?

Any help is much appreciated.

Many thanks!

@hriahi Hopefully this gives some direction to you. QuickSight auto scales on the website layer so 100 concurrent users is quite small a load.
1/QuickSight doesn’t have a mechanism where you can set up a load test. If you do build your own programmatic mechanism, do realize that there is throttling that can kick in based on the rate of calls.
2. When using RedShift with direct query, caching is really happening at the RedShift layer. You would need to configure RedShift and enable cache there (Performance - Amazon Redshift)
3. That is not expected - do you not see them in near real time or historically too?
4. If you don’t get help from rest of the community, I would suggest to work with your QuickSight account contacts to seek help on the set up based on your particular usecase

Can you embed your dashboard and do your load testing by accessing the dashboard through your web application?

Many thanks @Shekhar and @David_Wong for your support!

@Shekhar for 3/, I do not see them neither in real-time nor historically. Maybe it does count only for individual users ? In my case, I am using the same user in containerized parallel sessions in my web browser. I reported the issue here as well If it does count only for individual users, then in my case I need to create 100 individual users in QuickSight.

@David_Wong I can try to setup a web application and embed the dashboard into it. As I do not have experience with the embedding, will the dashboard load automatically by loading the main web page where the dashboard is embedded ?

Many thanks!

@hriahi Yes, your embedded dashboard will load automatically when the web page loads.

Thank you @David_Wong ! I am giving it a try.

@hriahi @David_Wong

I am so glad that this article existed. We are trying to solve something similar. Team has successfully embedded the dashboard onto a webpage. We are trying to learn and understand ways to do performance testing of the dashboard. If you have any information then please share

You can take a look at DashboardViewLoadTime and VisualLoadTime on this page:

You can use CloudWatch to see how long your dashboards and visuals take to load.