How can we connect multiple csv file in s3 bucket to quicksight. The Manifest I am using contains 2 files URI

Question & Answer
, , , ,
1

{
“fileLocations”: [
{
“URIs”: [
“s3://dummy–quicksight/Customer-Journey.csv”,
“s3://dummy–quicksight/new-file.csv”
]
}
],
“globalUploadSettings”: {
“format”: “CSV”,
“delimiter”: “,”,
“textqualifier”: “"”,
“containsHeader”: “true”
}
}

2

Hello there.

To connect multiple CSV files in an S3 bucket to Amazon QuickSight using a Manifest file, follow these steps:

Upload the Manifest File to S3:
    Take the Manifest file you provided and upload it to an S3 bucket that the QuickSight service has access to.

Create a QuickSight Dataset:
    In the QuickSight console, go to the "Datasets" section and click on "New dataset".
    Select "Athena" as the data source.
    In the "Athena" configuration:
        Select the appropriate AWS Region.
        In the "Database" dropdown, select the database you want to use (or create a new one if needed).
        In the "SQL query" field, enter the following:

        SELECT * FROM "manifest"."${land_manifest}"

        Replace "${land_manifest}" with the name of the Manifest file you uploaded to S3.
    Click "Create dataset" to complete the process.

Validate the Dataset:
    After the dataset is created, you can preview the data to ensure that the two CSV files have been successfully connected.
    Check the "Columns" section to make sure that the column names and data types are correct.

Use the Dataset:
    Now that the dataset is created, you can use it to build visualizations and analyses in Amazon QuickSight.

The key points to note are:

The Manifest file you provided looks correct and should work as expected.
Make sure that the IAM role or user credentials used by QuickSight have the necessary permissions to access the S3 bucket and Athena service.
If you encounter any issues, double-check the Manifest file content and the SQL query used in the dataset creation.

Let me know if you have any further questions or if you need any clarification on the steps.

Ish

3

Hi @Shrey_pandey,
It’s been awhile since we last heard from you. Were you able to try murili’s suggestion and if so, did it work for your scenario?

If we do not hear back from you within the next 3 business days, I’ll go ahead and mark the solution.

Thank you!

4

Hi @Shrey_pandey,
Since we have not heard back from you, I’ll go ahead and mark this as solved. If you have any additional questions, feel free to create a new topic in the community and link this discussion for any relevant information.

Thank you!