Good morning, in my dataset the are two columns (“T040” and “T041”) that contains temperature values. I would like to remove all the rows where T040 and T041 are equals to the previous row. I need something like this: Original dataset TimeStamp T040 T041 16:15:00 28.3 27.8 16:15:01 28…

Hello @egobbo . You can also create calculated fields at the dataset level and then create a filter at the dataset level as well. This way you can filter the data directly there and make sure that all the analyses that use it received the filtered data. However remember that it is the best practi…

You can do a lag function and a first value function for both columns T040 & T041 Here is how it would work for t040 (you would also do this for t041: is_duplicate_t040 = ifelse(lead({t040},[{timestamp} ASC],1)=firstValue({t040]},[{timestamp} ASC],[{timestamp}]),‘Duplicate’,‘Keep’) Then you would…

Thanks for the reply, but I have already tried your idea without luck. I don’t need a filter on the dashboard, I need less data in the dataset. Let me be more detailed. I create a calculate fields like this vibrationMaxValue = maxOver({l3dspmaxvalue},[{t042}],PRE_FILTER) In this way vibrationMa…

@EnriqueS thank you very much!! As first step I will setup filters in a not-so-best-practice way, in the meantime I will study Glue and use it as soon as I will be ready. The Glue way is absolutelly the correct one, and I think I will use it a lot in the future. Thanks Enrico

Do you launch this code in quicksight or do you do it in sql? is_duplicate_t040 = ifelse(lead({t040},[{timestamp} ASC],1)=firstValue({t040]},[{timestamp} ASC],[{timestamp}]),‘Duplicate’,‘Keep’)

@Raulsc in Quick Sight Regards, Koushik

HOW? I tried it and I got unavailable in that column created Thanks you!

please create a new post with your question and post the details :slight_smile:

[image] Delete duplicate with Incrementally refreshing a dataset Question & Answer Hi I need delete de duplicate value when i ncrementally refreshing a dataset and i have duplicate. I try create a calculated field with this code so that when it detects the same pk, it gi…

Hi Can you help me with this formula? For instance: I have these columns id start id length country 1 12 2 IN 1 12 2 IN 1 12 2 IN 2 15 2 Mexico 3 10 2 US 4 25 …

To remove the duplicate records in Quicksight Dataset you can use Distinct keyword in custom query if you are fetching view through custom query. [Remove Duplicate in Dataset]

Remove duplicate rows from dataset

Q&A

Raulsc March 2, 2023, 4:24pm 10

here! please

Topic		Replies	Views
Delete duplicate with Incrementally refreshing a dataset Q&A data-source , analysis , parameters , formatting , error , quick-sight , calculations	13	1763	March 2, 2023
How do I remove duplicates from the dataset when uploaded to quicksight? Q&A quick-sight , Business-Intelligence-Engineer	4	594	March 15, 2024
Remove duplicates on quicksight Q&A developer , quick-sight , dashboard-embed	1	106	October 11, 2024
How to Remove Duplicate Rows by Event ID in a Dataset Q&A quick-sight , dataset , Business-Intelligence-Engineer	3	109	September 23, 2024
Quicksight table visual skipping excluding rows Q&A analysis , formatting , quick-sight	12	643	June 27, 2023

Remove duplicate rows from dataset

Related topics