Partial data Missing In Quicksight Dataset (didn't match output when execute query in Redshift)

Question & Answer
, , , , , ,
1

Hello,
I have a dashboard in Quicksight , recently I noticed many data do exist in the query when I direct run it in Redshift, but getting lost in Quicksight dataset.

The query in dataset and the query I executed in Redshift is exactly the same

When I change the dataset to SPICE,
the SPICE refresh count is 15765189 rows imported (100% success)
In Redshift the total count of data is 24295209

Which means 8530020 of records do exist in query output but get lost in Quicksight

Because the query in dataset and the query I executed in Redshift is exactly the same, Would you please help on why I’m missing 35% of data in Quicksight?

2

Hi @Chenyang_Ma,
any refresh errors or filter on dataset level?
Are you using the same database environment?
BR

3

Hello @ErikG
Thanks for checking, please see my answer below:
1 any refresh errors or filter on dataset level - No when I switch to spice it shows
“Status Completed 15765189 rows imported (100% success)”

2 Are you using the same database environment - Yes I just checked it’s the same database environment we have in QS and DBeaver

4

And you still have enough SPICE capacity?

5

yes just checked my account have sufficient capacity in Spice (more than 10TB available)

6

Issue resolved, there are filters added to dataset (not inquery or visuals) so didn’t noticed these

7

Great. As I ask in the first question. :wink:
Could you solve the topic please?