I understand that QuickSight creates the “aws-athena-query-results-{region}-{AWS account number}” S3 bucket. What is stored in it? Are query results from syncing Athena datasets stored there before they are transferred to SPICE?
Hi @Glenvill - Welcome to the community! When QuickSight executes queries for Athena datasets, it writes the query results to an S3 bucket named “aws-athena-query-results-AWSREGION-AWSACCOUNTID”. This is the default behavior for storing Athena query results.
The bucket stores the output of queries that QuickSight executes when refreshing datasets or running any queries for Athena datasets. These query results are saved as CSV files in the bucket.
Please refer to this related community post as well.
1 Like
Does this mean that event if we use SPICE for a dataset the Athena query response as part of the refresh of that dataset will be initially stored n this S3 bucket? So the larger the response from the Athena query the larger the files stored in this bucket and if we have a large number of these datasets being refreshed this will add to the bucket growing in size at a greater rate?
@Glenvill - Thats correct. The query results will be stored in S3 and the size of the response will determine the size of the files in S3. If you are using incremental refresh on the dataset in quicksight, removing these files could potentially impact the refresh process. This community question is related to this ask.