Data export cuts off before reaching the 500MB or 1 million rows limit

[o.nousseir]

Data export cuts off before reaching the 500MB or 1 million rows limit. Why?

[eperts]

Hi @o.nousseir - As per the documentation

For table charts, Amazon QuickSight supports exporting up to 1 million rows or 500 MB of data, whichever limit is reached first.

For all other visuals, including pivot tables, the limits that apply to exporting are the same limits that apply to the visual type.

Are you exporting from a pivot table?

[o.nousseir]

Yes, this is an export from a table.

[eperts]

Pivot tables support up to 500K rows as per the documentation. The export will respect the limits of the underlying visual.

[o.nousseir]

This is a normal table (not a pivot) and as per documentation it clearly states the limit is either 1 million rows or 500MB, which ever is first. However, my screenshot shows 530000 rows or 407 MB which is neither of those limits.

[eperts]

I believe the 407.54MB is size of the local file that has your data. I wonder if there is a discrepancy between the 500MB data limit in QuickSight and the local file size. Basically, QS has reached its 500MB limit but the resulting file size is less than 500MB.

@Sanjeeb2022 or @Koushik_Muthanna thoughts?

Edit: Ticket will be raised by OP in order for the QuickSight Team to take a closer look.

[Sanjeeb2022]

Hi @o.nousseir - Do you know original data volume of the data sets, @eperts - Yes you are correct, it is a strange symptom. I am suspecting not 100% sure when it is writing it crossed the limit.

@o.nousseir - It will be good to submit a ticket to AWS Customer support team so that they can investigate in detail. To raise the request, please follow the link - Creating support cases and case management - AWS Support

Regards - Sanjeeb

[Koushik_Muthanna]

Export data to Excel

hi @Sebastian_Palacio_Re , The excel limit is 100k or 16,384 columns. So depending upon the number of columns and rows you have in your table , the final number of rows exported can be lesser. Export details when downloading [Screenshot 2023-03-09 at 15.38.41] With 2 dimensions and 1 measure [100k records exported] [Screenshot 2023-03-09 at 15.54.56] With 11 dimensions and 1 measure [80k records exported] [Screenshot 2023-03-09 at 15.55.45] Kind regards, Koushik

[eperts]

@Koushik_Muthanna This seems to be a CSV export judging from the size (530K rows, ~500MB). Is there guidance from the QS Team on why the posted limits (1M rows or 500MB of data) may not match the File Size number in export window?

[Koushik_Muthanna]

got it not entirely sure, would let @o.nousseir raise a support ticket since the file size is 407.54 MB and the limit is 500 MB.

[o.nousseir]

I have raised a support ticket.