Dataset Join stops after so many rows

Question & Answer
, ,
1

I am joining a dataset that has a list of Location names in the original ~15000 row dataset with a reference list of ~1800 location names and additional info.

The join works fine for the first 1000 rows and then stops.

I created a second upload with the data cut at 1000 and flipped, top to bottom, and the first 1000 rows work to fill in the missing information and stops at the new 1000 row data. But this creates 2 columns to try and reference and makes updating the info much more difficult.

Is this a formal limitation of dataset joins?

Thanks!

2

Hi @TheJeff

as I know there is only a limit for the right table in a join at 1 GB. That should not be reached with 1000 rows.

Best regards,
Nico

3

I forgot to update this!

I was determining where a data gap was happening on the preview data view in the dataset. It was the wrong place for me to look, I discovered the data was actually joining in the dataset.

It seems the preview tab only joins the first 1000 rows of a joined dataset, which is why when I flipped the data the preview showed the two 1000 row smaller datasets joined.

I thought the preview was showing the first 1000 rows of the fully joined dataset.