Incremental Refresh Fail

Question & Answer
, , ,
1

Hello,

I was thinking about using incremental refresh to get the data from my redshift cluster. I thought of an issue and can’t think of a solution for it. So let’s say the redshift cluster went down, now all the request that quicksight will trigger to get the data from redshift will fail. After some time the cluster is live again let’s say it was down for 45 minutes. My SPICE dataset won’t have the data for those 45 minutes and data accuracy is a critical aspect for my project. Is there a way we can ingest the missing data into SPICE without doing a full refresh of the dataset.

Regards,
Harshvardhan

2

Hello @hsurolia,

The incremental refresh is based on a timestamp column in the table you are ingesting. The incremental refresh will fail while your cluster is down, but when your cluster is up, the SPICE refresh will pick up from where it left off.

Hope this helps!

1 Like