My use case is to keep the most recent 30 days of CUR data cached in SPICE, and deleting anything older from my SPICE “cache”- I was wondering whether this is a possibility with QuickSight or not.
For example: 1 Jan - 31st Jan CUR Data is in SPICE as soon as it turns 1st February, my SPICE removes the old 1st Jan data to make space for the new 1st Feb data (this is an over simplified example) instead of having to full-refresh or increase my SPICE capacity.
Does anything like this exist in SPICE for us to do this automatically (removing old cache data to make space for new data) with the goal of optimising my cost with SPICE for specifically lower-period and highly cyclical data?
Here is a link to a similar question asked in 2022, where the answer was “no”, I was wondering if there had been any updates to this or a work around that’s possible: Delete old data from spice - #2 by Ramon_Lopez
You would need to handle this at your end, there is no out of the box solution in QuickSight.
Based on the volume of CUR data that you have :
1/ I had responded previously with a possible workaround : Setting data retention period on incremental refresh dataset? - #6 by Giang_Nguyen
2/ Create a table in your backend which holds the required data , setup a full refresh schedule into SPICE . Here you have the flexibility to control the logic of how many days/months data will be made available for reporting.
Hi @QSightEnthusiast,
It’s been awhile since we last heard from you, did you have any additional questions or did one of the suggestions listed above work for your case?
If we do not hear back within the next 3 business days, I’ll close out this topic.
Hi @QSightEnthusiast,
Since we have not heard back, I’ll go ahead and close out this topic. However, if you have any additional questions, feel free to create a new post in the community and link this discussion for relevant information if needed.