I have some tables whose records can be static for months, and change after a while. If I use incremental refresh, it only inserts me when an “update” type field has changed, but it doesn’t delete the previous record.
For example, if I have a record with update field 2022-01-01 and update it in my database, doing incremental refresh in Quicksight will insert the record but not delete the old one. Is there a way to do an updated - insert for example via code?
Hi @KLIKIN, Based on your use case or business need, you can tweak the look back window within incremental refresh along with period full refresh to keep your data updated. Below QuickSight learning series video dives a little deep into the concept of incremental refresh and how we can use look back window and full refresh to control data update within SPICE.
@Karthik_Tharmarajan Unfortunately I think with your examples doesn’t work for our data source, because It has to have a look back window too huge.
Also I was thing in use two datasets, the first one with the data until 2022, that it’s not necessary to update and the second one with the data of 2023 (and I’ll do a full update), the problem is to join these two datasets and don’t have any repeated name field.