I hope this message finds you well. I’m currently working on a project in Amazon QuickSight where I need to join multiple datasets and create a resultant for further analysis. Here’s a breakdown of what I’ve done and the challenge I’m facing:
Data Joining Process:
I have joined Dataset A with Dataset C in one dataset.
Separately, I joined Dataset B with Dataset C in another dataset.
Finally, I combined these two datasets to analyze the integrated data.
2.Requirement:
I need to replicate this final joined dataset to perform additional analysis and visualization tasks.
Encountered Issue:
However, when attempting to create a replica of the final dataset, I encountered an error stating that “more than 3 levels of child datasets cannot be created.”
Could someone please provide guidance on how to achieve the following in QuickSight?
Effectively joining Dataset A with C and Dataset B with C separately within the same analysis.
Creating a replica of the final joined dataset to facilitate further analysis.
Overcoming limitations such as the “3 levels of child datasets” restriction in QuickSight.
I would greatly appreciate any insights, examples, or references to documentation that could help me resolve this issue and optimize my data analysis workflow.
Hello @Surya_Prakash, welcome to the QuickSight community!
There are a few ways you can try to manage this process so you do not run into the current limitation you are facing. If you are querying data from a datasource like Athena, Redshift, Postgres, etc, then you could utilize custom SQL option to manually run the joins based on your tables in your database. Based on my experience, this is the best way to ensure the joins are managed properly and it makes refreshing the QuickSight dataset the easiest.
Alternatively, you could rebuild the joins starting with a brand new dataset rather than trying to join 2 different datasets that have already been joined. If you start with a new version of dataset A, join that with dataset C, then join dataset B, you may be able to bypass the issue you are currently facing. I still believe custom SQL will be your best option, but starting the joins from scratch may also help resolve the issue you are facing.
Thank you for the warm welcome and your prompt response.
I appreciate your suggestion to use custom SQL for managing the joins. However, in our case, we have a specific challenge: both Datasets A and B contains data and needs to add decrypted data joining Multiple times with diffeerent multiple keys with Dataset C. This decryption process must be handled within QuickSight.
Previously, we followed the approach you suggested, using custom SQL in our database to manage the joins and then importing the combined data into QuickSight. While this worked, It took 8 hours for whole data refresh we are now looking to optimize our solution by performing these joins and decryption steps directly within QuickSight to streamline our data workflow and improve performance.
Could you please provide any insights or alternative solutions that might help us achieve this within the constraints of QuickSight?
Hello @Surya_Prakash, I understand your issue, 8 hours is definitely a long time to run a refresh. Have you tried joining the datasets differently? Rather than joining 2 datasets that are already joined, add them one at a time in a new dataset editor.
If you do that, I believe it should work as expected. I have seen more than 3 datasets joined together in QuickSight, so the limitation might specifically be the way you are joining. Maybe if you could share some screenshots as you build out the joins, I would be able to assist you further.
Did this solution work for you? I am marking this reply as, “Solution,” but let us know if this is not resolved. Thanks for posting your questions on the QuickSight Community!
Hello @Surya_Prakash, since we have not heard back from you with any follow-up information on this topic, I will archive it. If you are not able to join the datasets according to some of the suggestions above and still require assistance with this question, please post a new topic in the community and link to this topic to provide relevant information. That will ensure you are at the top of the priority list for a response from one of our QuickSight experts. Thank you!