I am trying to speed up my dashboards by using SPICE for data younger then 2 months and I’m fine using direct query with Athena for older data. I don’t want to load everything into spice as the data goes back years and would use a lot of SPICE memory.
I managed to create the datasets using custom SQL one for the 60 day data with incremental refresh using SPICE and one for older data with DIRECT QUERY.
Now the issue I’m facing is how i can use both datasets in an analysis so when the customer selects a date smaller then two months he will get the data from SPICE dataset and get instant results but if he selects a longer period of time or older then two months he will query also ATHENA by DIRECT QUERY.
Is there a way to do this?
Thank you in advance for any help.
Domenico
I don’t see any straightforward solution to this problem. I have been thinking about options as well as our data size is growing.
If you try to create a child dataset using your two datasets; since they are different types the Child dataset can only be formed as a SPICE dataset which I guess you don’t want.
One of the options is to duplicate your visuals to work on the two different datasets and dynamically show/hide visuals.
Since we have not heard back from you, I’ll go ahead and close/archive this topic. However, if you have any additional questions, feel free to create a new topic in the community and link this discussion for relevant information.