How to use SPICE is dataset size is more than 1 TB or have more than 1 billion rows.
What if after using spice the refreshed data is more than spice capacity ?
I have a case where, I use spice dataset to save 1 year of data, however I have a calculated field which utilize the last two years of data.
How to use spice in this case
Hi @yogendrasgautam - Thanks for posting the question. I believe SPICE can hold up to 250M or 500GB data. Please see the link below.
Amazon QuickSight doubles SPICE capacity limit to 500m row
If it exceeded, it should fail, but a POC is require never tried from my side.
Hi @SD_QS @Koushik_Muthanna @David_Wong @emilyzhu - Any expert advise on the Spice usage.
Regards - Sanjeeb
As mentioned by the OP, for Enterprise edition, the limits are 1 billion rows or 1 TB for each dataset. Please refer: https://docs.aws.amazon.com/quicksight/latest/user/data-source-limits.html
@yogendrasgautam if I understand correctly, you’re are running into the limits because you have to keep 2 years of data because of the calculated field, otherwise you could have 1 year of data… if thats the case, you might want to preprocess the data to include the calculated field as part of your data pipeline before ingesting into QuickSight SPICE
Thanks @SD_QS for correcting me and share the updated document link
I believe we can mark this suggestion as solution.
Regards - Sanjeeb