Hello, I am trying to use QuickSight and Q to set up a prototype LLM for a CMO. The data is a daily dump in a very large CSV. I am trying to figure out the easiest way for QuickSight to read the data - Athena, SPICE, Redshift, or other. I should add that I am pretty new to all of these tools. Thanks.
Hi,
are you already using athena or redshift? Otherwise you have to take a look at the costs of these beforehand.
Our setup is S3 → Athena → QuickSight.
In Quicksight we have the data in Spice.
With SPICE you pay for each reserved GB per month.
If you use direct query with athena, you create a query every time when you interact with the data (refresh, filter, etc). In Athena you pay for read data per TB.
So if the filesize is big it could make sense to load it into Spice. Then you have the cost of one athena query and the monthly cost of SPICE.
I dont have experience with redshift costs, so someone else could tell you something about this.
Then you have the option to load directly from S3 or upload thr file manually to quicksight.
Hi @Vim, welcome to the QuickSight Community. Did this solution work for you? I am marking this reply as, “Solution,” but let us know if this is not resolved. Thanks for posting your questions on the QuickSight Community!