I have a pretty large SPICE dataset that is a conglomeration of multiple tables joined together in Quick Sight. This large dataset should have about at least 100 million rows, but for some reason, only about 1.3 million rows are imported. I have turned all joins into full joins too. Do I need to purchase more storage? I believe that’s an automatic process if my data requires more storage.
Hello @zijingxu
Welcome to Quicksight Community and thank you for posting your question.
Could you please check if Auto-purchase capacity is turned on in your account ?
Manage Account → SPICE capacity
Data source quotas - Data source quotas - Amazon QuickSight
Please let me know if that helps
Thank you,
Shravya
Hi @zijingxu
Your join looks like a cartesian join bringing all data from all tables. Is that what you really want?
Regards,
Giri
I tried sticking with left joins, but data was also missing when I was doing that. I can try reverting them back to see if it fixes the issue, but I doubt it – the scale of missing data is very big.
Hi @zijingxu
You can probably debug by starting a dataset with your transaction table which has all your rows and see whether that brings in all rows.
Then bring in each additional table one at a time to see where things break.
Regards,
Giri
Hi @zijingxu,
It’s been awhile since last communication took place on this thread, did you have any additional questions or were you able to find a work around for this case?
If we do not hear back within the next 3 business days, I’ll close out this topic.
Thank you!
Hi @zijingxu,
Since we have not heard back, I’ll go ahead and close out this topic. However, if you have any additional questions, feel free to create a new post in the community and link this discussion for relevant information if needed.
Thank you!