Joining two direct query datasets always import to spice

Hi,

I’m trying to join two data sets that are direct query one is Athena data source and the second is RDS data source. I’m I understanding correctly that non matter if the data sources are direct query when performing a join the data will be always loaded into spice and the dataset in sue will become a spice dataset? Or there is a way not to import all the data into spice. The reason we are using direct query was not to import data into spice. Also since i have calculated fields and some changes in datasets names i get a refresh error if I try to import into spice that I believe is a known issue.

Thank you in advance,

Domenico

Hi @Dom ,

you are right. To cross join two data sets from different datasources everything will be loaded in SPICE. You can find more information here:

Is it possible to shift the data into only one datasource?

Maybe a cross database join is not necessary? You could try a cross database filter:

Best regards,
Nico

2 Likes

Thanks @Nico for provide the details. Yes, when you are joining two data sets from 2 different data sources, Quick Sight always prepare the final data set in SPICE mode.

Regards,
Sanjeeb