Time limit on Refreshing of dataset

Question & Answer
, , ,
1

Hi Team,
I am having 6 datasets in my report which consists of each ( 10 million, 2 M, 6 M, 3 M, 1M, 2 M) and using SPICE mode + getting data from S3

Visual are loading slowly, it is very slow while shift the sheets.

I need help on this. Moreover, is the any time limit or benchmark limit to load data.

What is the time limit to load data of 1 Millions records in SPICE and Direct Query Mode.

On what factors The performance and Refreshing of Data in Quicksight depends on.

2

Hi @Venkat.Metadata

SPICE Refresh Times: SPICE typically handles 1M records within seconds to a couple of minutes, depending on dataset size and complexity. There is no hard time limit for SPICE refreshes, but larger datasets (10M+ records) may take longer, especially if transformations are applied.
[Update from QuickSight team - SPICE refreshes are allowed to run up to 10 hours which is more than sufficient for most customer use cases. ]

Direct Query Performance: Direct Query retrieves data in real-time but can be slower if the source system has latency or the queries are complex. It’s recommended to use Direct Query only for datasets requiring real-time data.

Performance Factors:

  • Dataset size: Break large datasets into smaller, focused datasets.
  • Complex calculations: Move calculations to the dataset or source level.
  • Number of visuals: Reduce visuals on a single sheet and spread them across tabs or dashboards.

You can checkout this post replies too for some more insights - How to investigate Quicksight Dashboard Load time spikes

Let me know if you need more help on this - I would recommend raising a support ticket to schedule a Chime call with the AWS Support team. This will allow them to review your data and provide insights into what might be happening.

Thank you,
Shravya

2 Likes
3

Hi @Venkat.Metadata - If you are taking the data from SPICE in your visual, then it should be fast unless you have lots of calculated field, possibly you need to push them in data preparation stage so that calculation will happen first and then SPICE can be populated. It depends upon your usecase. If you can give more details on the transformation and calculation logics, then we can guide you. In parallel, as @shravya suggested, raised a ticket to AWS team and get their recommendations as well.

Regards,
Sanjeeb

2 Likes
4

Added an update to Shravya’s response and marking it as solution.

Regards,
Arun Santhosh
Pr QuickSight SA

1 Like