I have a pretty large SPICE dataset that is a conglomeration of multiple tables joined together in QuickSight. This large dataset should have about at least 100 million rows, but for some reason, only about 1.3 million rows are imported. I have turned all joins into full joins too. Do I need to purchase more storage? I believe that’s an automatic process if my data requires more storage.
Hello @zijingxu
Welcome to Quicksight Community and thank you for posting your question.
Could you please check if Auto-purchase capacity is turned on in your account ?
Manage Account → SPICE capacity
Data source quotas - Data source quotas - Amazon QuickSight
Please let me know if that helps
Thank you,
Shravya
Hi Shravya! Yes, it is turned on. I don’t know if this matters, but all my data in Preview appear to be null. I have also included a screenshot of how my tables are joined together, and they’re from the same PostgreSQL server.
Hi @zijingxu
Your join looks like a cartesian join bringing all data from all tables. Is that what you really want?
Regards,
Giri
I tried sticking with left joins, but data was also missing when I was doing that. I can try reverting them back to see if it fixes the issue, but I doubt it – the scale of missing data is very big.
Hi @zijingxu
You can probably debug by starting a dataset with your transaction table which has all your rows and see whether that brings in all rows.
Then bring in each additional table one at a time to see where things break.
Regards,
Giri
Hi @zijingxu,
It’s been awhile since last communication took place on this thread, did you have any additional questions or were you able to find a work around for this case?
If we do not hear back within the next 3 business days, I’ll close out this topic.
Thank you!
Hi @zijingxu,
Since we have not heard back, I’ll go ahead and close out this topic. However, if you have any additional questions, feel free to create a new post in the community and link this discussion for relevant information if needed.
Thank you!