Latitude and Longitude 'Null' in Analysis when connecting BigQuery as data source with more than 39,999 entries

Question & Answer
,
1

Hi,

We run into the following problem: When we connect a table with data about places with latitude and longitude from BigQuery to a Dataset (Query mode SPICE), latitude and longitude get sometimes wrong values in the analysis but correct values are shown in the dataset view. In BigQuery they are stored as float. We tried to cast them in the dataset as float, numeric and rounded numeric but this doesn’t help.

When we use a table with only 39,999 entries, we get it to work. If there are 40,000 entries, latitude and longitude become ‘null’ in the analysis, but are still correct in the dataset preview.

Then cutoff of 40,000 entries remains the same even if we change the the ordering, so it doesn’t seem to hinge on specific entries.

This problem only seems to occur if we use SPICE.

This seems to be a QuickSight bug or a certain limit. Or is there any way to fix this?

2

Hi @DanielH,
I can’t seem to find any quota restrictions listed anywhere in relation to lat/long fields but it certainly sounds like there is one if you’ve tried changing the ordering and the various field types.
As this seems to be a set limitation, I will leave this marked as a feature request to promote visibility to the support team.

While this may not be an ideal work around, if you don’t need all points on the map to coincide with each other, maybe try and split up the rows into separate datasets and then incorporate each of them to your analysis. That way you can still utilize more than 40,000 rows, just not in one visual.

1 Like