Hi QuickSight Community,
I’m working on setting up incremental refresh in QuickSight using Athena, but I’m facing a performance issue where Athena scans all partitions instead of pruning them properly.
My Setup:
• My Athena table is partitioned by year, month, day.
• QuickSight incremental refresh is based on updated_at.
• Issue: When QuickSight generates SQL, it only filters by updated_at and does not apply partition filtering (year, month, day).
• Result: Athena scans all partitions instead of just the relevant ones, making the queries slow and expensive.
The question is: how can I connect updated_at with partitioning to let Athena know to scan just limited partitions?