Filter the value from the dataset before using it in the widgets from analysis

Question & Answer
, , ,
1

I have the dataset at seconds level granularity. Each record will be considered as one event. I need to filter the widget at the event level and then do the aggregation on the widgets based on the group by what i have.
Eg. widget is having latitude, longitude as group by
value is having duration,events_count

I am giving the duration filter value as 2 mins. The data should filter at event level first and bring the duration value greater than 2 mins and then group by(sum) the values with same lat and long.

I am trying to use PRE_FILTER as calculated field but it is always breaking the table widget at event level and it is not grouping.

2

Hello @Sharmili, are you able to provide some more detail or any screenshots for the visuals you are trying to create and the calculated fields you are building?

It sounds like you may be wanting to use a sumOver() function to get the sum of the value if the lat and long match. You could try using PRE_AGG instead of PRE_FILTER and maybe that would give you the value you are looking for.

It might look something like this: sumOver({value}, [{lat}, {long}], PRE_AGG)

If that doesn’t work, the information I requested above should be enough to help you resolve this issue.

1 Like
3

I need to filter the values before the aggregation.
Eg. I have the widget group by as below

image
image1353×462 28 KB

Data is as below,

lat lon duration events
-37.51881 175.17172 0.3 1
-37.51881 175.17172 0.018 1
-37.5188 175.17171 0.3 1

Expected output:
Filter Duration: 0.2 (if user enters the duration, it should exclude the values below 0.2, if not it should sum up and show)
case 1: duration:0

lat lon duration events
-37.51881 175.17172 0.318 2
-37.5188 175.17171 0.3 1

case 2: duration:0.2

lat lon duration events
-37.51881 175.17172 0.3 1
-37.5188 175.17171 0.3 1

Calculated field: sample ref.
calc_filter_duration:
ifelse(${duration}=0,sum({speed_duration_minutes}),sumOver({speed_duration_minutes},[latitude,longitude],PRE_AGG))

4

Hello @Sharmili, if you want the aggregation to occur after the filter, then I would remove PRE_AGG and leave it empty. Then it will default to POST_AGG_FILTER which may give you the solution you are looking for.

1 Like