Dataset refreshes not starting on time

Question & Answer
1

We are using Quicksight for a big deployment to external customers.

We have everything created, and we all of our dataset refreshes scheduled at 8 AM. The issue is, I notice that our jobs don’t actually start at 8 AM. It seems like they start in series and Quicksight doesn’t refresh more than one data set at a time.

We spin up a larger snowflake warehouse during our daily refresh period to get these items done ASAP, but when we look at the logs in Snowflake, they are not coming in at 8 AM, there will be like 1 that come in at 8 AM, and a minute later (presumably after one is done) the next one comes in, then the next, etc.

As a result our daily loads aren’t completing until 8:30-8:45, but with the size of our snowflake warehouse we could handle pretty much evertyhing in the first 10 minutes of the hour.

Is there a setting that limits how many refreshes QS will try to to run concurrently or something like that?

2

Hi @TRube - Thanks for posting the question. For your problem statement, it will be good if you can raise a ticket to AWS Customer support team so that they can review your application set up and configuration and advise the solution. Ideally you can refresh data sets in parallel. To raise a request, please follow the link -

Hi @Max @David_Wong - Any expert advise on this.

Regards - Sanjeeb

1 Like