Load data according to a date parameter entered by a user

Q&A
, ,
1

Hello,

My issue is that we have millions of files data stored in S3 buckets, and my user wants to investigate the raw data of a specific date each time. It’s too expensive to load all the data each day…
Is it possible to load a dataset according to a specific date parameter entered by the user?

2

You could use dataset parameters

Hope this helps!

3

Thanks, where does the end-user that uses the analysis dashboard set the parameter value?

4

Juat create a pramater in the dashboard and pass this as the value for the date you want the data to be filtered with in the cuatom SQL query.

5

Now I see that it doesn’t work with SPICE so it’s not relevant anyway.

Thanks.

6

indeed, the idea is not to load all the data into SPICE but only get the relevant data from a direct query to the source.