SPICE (Super-fast, Parallel, In-memory Calculation Engine) is Amazon Quick Sight’s in-memory engine designed for faster performance by preloading data.
SPICE is more efficient for performance because it stores data in memory, resulting in low-latency queries and better scalability for large datasets. It’s cost-effective if your queries are run frequently and you want to avoid paying for every query separately.
Direct Query connects to your data source in real-time, allowing up-to-date access without loading data into SPICE. However, this method can be slower, especially with complex datasets or if the source is under heavy load. Costs can accumulate due to both query execution and potential data transfer charges.
SPICE supports incremental updates, which allow you to append or refresh parts of your dataset without reloading the entire dataset.
- If you need to remove data or handle deletes, you may have to re-import the dataset (full refresh) or apply logic in the dataset transformation stage to exclude unwanted records.
- SPICE does not have an automatic mechanism like a crawler to map schema changes. You need to manually update the schema in Quick Sight dataset.
SPICE is suitable when you have large datasets that are frequently accessed in analysis and dashboards, benefiting from pre-aggregation and faster reporting.
Direct Query is suitable when you have smaller datasets and require real-time reporting where data freshness is critical.
Please refer the below documentation this might be helpful for you.
Quick Sight pricing - Business Intelligence Service – Amazon QuickSight Pricing – AWS