Hi! I have a csv file that is stored in a S3 bucket that I would like to create into a dataset. When I create a new dataset and upload, the refresh fails with errors on multiple columns. When I export the error file I notices a lot of fields that are incorrectly placed, ex) an id field should only c…

Hi @ryann.schuessler - Can you please share the error details. CSV should work fine in Quick Sight and by default it took the comma separator. You can change the delimiter of the csv file. If possible, please share sample data with error records to analyze in details ( Please mask PII data if there…

hi @ryann.schuessler , take a look at the options available in manifest file : Supported formats for Amazon S3 manifest files - Amazon QuickSight and reupload the file. Regards, Koushik

Here is the refresh error details [image] This is an example of the output error, in the original csv file all PRD_IDs are numeric. The fields under PRD_ID that are text should be under different columns [image]

This is the manifest file I am currently using { “fileLocations”: [ { “URIs”: [ “ https://example/example.csv ” ] } ], “globalUploadSettings”: { “textqualifier”: “"” } } Do I need to change the text qualifier?

[image] The text qualifier has a forward slash, for some reason when I copied the file text it got removed in the comment

Hi Ryann, Did you manage to solve it? I’m facing the same issue and tried different things but still struggling when import to Spice. Thanks!!

Hello @ryann.schuessler , @Sanjeeb2022 , and @Koushik_Muthanna ! @ryann.schuessler Are you still having trouble with this problem, or were you are able to find a solution? If you were able to find a solution could you post it to help the community? Did you remove that forward slash and were able to…

Hi! I was not able to find a solution. I had three columns with fields that included long JSON strings. I had to remove them from the dataset in order for it to refresh correctly. Those fields weren’t necessary for my analysis, but I’m sure I’ll run into this issue again in the future

Hey @ryann.schuessler ! After reading through the full question, I think that it would be beneficial to create a support ticket with AWS. @Koushik_Muthanna do you have any other suggestions? Here are the steps to open a support case . If your company has someone who manages your AWS account, you mi…

S3 CSV file dataset failures

Q&A

Koushik_Muthanna July 14, 2023, 1:28pm 5

check the manifest file for text qualifier.

QuickSight Only Showing 8 out of 59 Columns from S3 CSV - No Errors Reported

Topic		Replies	Views
Error With Dataset Field When Accessed from S3 but not as upload Q&A data-source , error , quick-sight , Business-Intelligence-Engineer	5	586	January 5, 2024
I overwrote a csv file in s3 bucket(existing), then refreshed SPICE, but it doesn't pickup every records in CSV, why? Q&A data-source , feature-request , quick-sight , s3	4	901	May 10, 2023
QuickSight Only Showing 8 out of 59 Columns from S3 CSV - No Errors Reported Q&A data-source , s3 , Business-Intelligence-Engineer	7	62	January 31, 2026
Unable to load file from S3 to Quick Sight! Parse Erorr Q&A data-source , quick-sight , s3	3	1260	April 21, 2023
When connecting file from S3 There are missing columns Q&A data-source , quick-sight , s3	8	945	August 19, 2023

S3 CSV file dataset failures

Related topics