How to dynamically update the dahboard whenever the data is updated in s3 data source? I want it to be dynamically updated in the dashboard

Q&A
,
1

How to dynamically update the dahboard whenever the data is updated in s3 data source? I want it to be dynamically updated in the dashboard

2

Hello @SakethKesari , welcome to the Quicksight community!

It sounds like you want to query the data to refresh every time a user accesses the dashboard in which case I would suggest moving your dataset to Direct Query in the data prep layer.

You could also try using incremental refresh in SPICE. For this to work you will need to go from S3 to Athena then ingest to Quicksight.

Let me know if this is what you were looking for!

3

I want the dashboard to refresh whenever a new file is uploaded in s3 bucket immediately. Actually I tried it through quicksight API also, but the challenge I have here is it is schedule based not event based.

4

How often are you going to see new data? I can see in boto3 documentation that you can refresh it 32 times in 24hours period for enterprise edition.

You can achieve this by following this >Tutorial: Using an Amazon S3 trigger to invoke a Lambda function - AWS Lambda

https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/quicksight/client/create_ingestion.html

Let me know if this helps

1 Like
5

Hello @SakethKesari !

Were you able to try @EJRD’s suggestion? If it worked could you mark their comment as a solution to help the community?