Load CSV File and Union multiple csv uploaded files

[wilner04]

Hi, I just wanna ask how can I union (all I can see is join option) multiple csv files (given I have more than 1.4 million rows which is the max limit rows for an excel). I don’t have any way to load data other than csv file. Thanks

[andres007]

Hello @wilner04,

Welcome to the QuickSight community, it is great having you here!

Regrettably, it is not possible to do a union all in QuickSight at this moment, we are aware of this requierement for our customer and we have tagged this as a feature request as you can see from this other community question.

Can we concatenate (do UNION all) in quicksight? I ask as I have two datasets from two different sources , which needs to be stacked together?

Hi @shrutisingh - Welcome to AWS QuickSight community and thanks for posting the question. At present QS is not having UNION or UNION ALL capabilities and I believe this is already in feature request. As a work around solution, you need to transfer one source file ( possibly smaller one) to another system and using custom SQL approach you can do the union from one data source. Hi @Xclipse - Can you please check whether this feature ( UNION and UNION ALL) is already in feature request or not. if…

There are many ways to do this if you use a source that can access csv files from S3 like Athena using e.g. Athena views to do the union and then access the view from QuickSight. But as you do not have any other ways to load data than to upload CSVs I think there is no other option than to wait for this feature to be released.

Hope this helps!

Kind regards,
Andres.

[wilner04]

Thank you @andres007
While waiting for this feature, I’m trying to study Snowflake as my warehouse and connect here in Quicksight.

[andres007]

Hello @wilner04,

Is your data sitting currently in AWS or Snowflake? Depending on this, if the data is on AWS, using AWS services, like Athena, or Redshift might be a best fit for you.

Amazon Redshift provisioned clusters - Amazon Redshift