Union of Datasets | Full Join of two datasets gives duplicate columns

Q&A
, ,
1

Hello All,

I wanted to do a union of two different datasets which had same column names in them, but the data_source was different (RDS vs Snowflake)

Hence, I did a spice of two datasets and later full-joined both these datasets in a new dataset.
Now, I have a new problem.

There are 2 columns for each column which had same name. (Refer the attached image)
Each of the column has an added table name to it.
Example:

Dataset_1 (col_1, col_2, col_3)
FULL JOIN
Dataset_2 (col_1, col_2, col_3)
gives result as
Dataset_3 (col_1, col_1[Dataset_2], col_2, col_2[Dataset_2], col_3, col_3[Dataset_2])

As a work through, I am creating calculated fields using coalesce(col_1, col_1[Dataset_2])
Need help here

image

2

Hello @ajinkya_ghodake,

Since there is no UNION operator available yet between the dataset, the solution you are using looks like the most reasonable to me and what has been used in other community answers.

At AWS, our roadmap is primarily driven by our customers. Your feedback helps us build a better service. I have tagged this as a feature request.