Quick Sight Data Preparation

Q&A
, ,
1

Hello,
Good Morning !

We are planning to do Data Preparation in Quick Sight , But we have 2 major fact tables one of size 10 TB and another is of size 200 GB.

  1. how can we able to accommodate ~10 TB size table in one data set as it needs join with some other dimension tables.?
  2. As there are no set operations (union ,intersect,minus) between the data sets, how can we able to combine our data sets into a single data set .Assuming that we have created ~ 10 partitioned data sets each of size 1 TB?
  3. We would like to know approximately How much time that it would take to refresh the SPICE storage which is of size ~15 TB.

Best Wishes,
Madhu K.

2

@MadhuK ,

Following is the possibility for each SPICE dataset Data source quotas - Amazon QuickSight

  • For Enterprise edition, 1 billion (1,000,000,000) rows or 1 TB for each dataset

For use-case , if you need all of the 10TB and combine it with 200GB , this needs to happen outside of Quick Sight . The dataset will be in direct query and not in SPICE.

Kind regards,
Koushik

3

Thank you Koushik for your quick response.