It is possible to generate full non-incremental spice updates less than one hour on a data set pointing to athena

Question & Answer
,
1

It is possible to generate full non-incremental spice updates less than one hour on a data set pointing to athena?

I need to have the most recent data possible. I have a scheme that updates the information every 7 minutes

2

Hi @winlike,
For a non-incremental refresh, currently 1 hour is the shortest time gap that you can setup. To refresh more often, you would need to utilize incremental refreshes or switch from SPICE to Direct Query.

1 Like
3

thx for the answer, In the quest to have information online, my organization will migrate the database to RDS and we will stop relying on a datalake as in this case. If I make a direct query to RDS from a base of approximately 500 GB, what is the performance if the board is fast? I know that the strategy would be the most optimal for the performance of the information. It is my main doubt.

4

Hi @winlike,
I understand as to your doubts based on sizing. It’s hard to predict exactly how the optimization would be though depending on the depth of your dashboard, how many calculated fields you’re utilizing, etc. To help with loading time performance, it may help in your case to transfer calculated fields over to the dataset level as that can sometimes decrease loading times.

5

Hi @winlike,
Following up here to see if you had any additional questions regarding your post?

If we do not hear back within the next 3 business days, I’ll close out this topic.

Thank you!

6

Hi @winlike,
Since we haven’t heard back, I’ll go ahead and close out this topic. However, if you have any additional questions, feel free to create a new post in the community.

Thank you!