Failed to update the dataset in athena

thais · February 13, 2025, 8:00pm

Hello,

I am using a dataset in the athena database. At first it was updating normally (full), but I noticed that after generating 1M lines it started to become intermittent. For a solution, I created a where to return only 2 days of data (total of 41k rows), and even with few rows compared to 1M the dataset only fails to update. QuickSight does not report a specific error, but rather the standard message below:

Error type:
SQL_EXCEPTION Learn more
This is a general SQL error. It can be caused by query timeouts, resource constraints, unexpected DDL changes before or during a query, and other database errors. Please check your database settings and query and try again.

Error details:
Amazon Athena experienced an internal error while executing this query. Please try submitting the query again and if the issue reoccurs, contact AWS support for further assistance. We apologize for the inconvenience.

EJRD · February 14, 2025, 2:17am

It could be related to your athena limit, maybe another query is running and it has exhausted the resource. Does it complete when you retry?

thais · February 14, 2025, 1:27pm

One query is executed at a time, but my final view is joining with 3 more views. All the others run individually in less than 1 minute (tested), only the last one is failing after trying to run for around 10 minutes. New evidence follows.