Is there a way to keep track of dataset refreshes? Could I see at any given moment which datasets are currently refreshing, recently refreshed, etc.?

Hi @ineedqshelp - There are 3 ways you can do it. Option - 1: Lambda function - You can write your lambda function using boto3 and create the functions and extract the details and create an report in S3 and sent it via SES. However lambda has timeout of 15 mins, if your code need more time, it will…

I believe it comes back in CloudTrail logs. [image] Run usage analytics on Amazon QuickSight using AWS CloudTrail | Amazon Web... Amazon QuickSight is a cloud-native BI service that allows end users to create and publish dashboards in minutes, without provisioning any servers or requiri…

You can also use the API to get the ingestion status (e.g. running, completed, scheduled, queued, etc). ListIngestions - Amazon QuickSight Lists the history of SPICE ingestions for a dataset.

This lists only one dataset though, is there a way for me to view the status of all my datasets at once?

hi @ineedqshelp - Thanks for posting this question. David’s suggestion is good one, you can write a custom code using boto 3 quicksight API with below steps. Extract all data sets . Check the status Create a custom report which will have data set name and other refresh details. If you will requir…

Thanks @Max . This is a lengthy process and lots of integration needs to be implement. It will be a good read for sure for all us. Thanks for sharing it. Regards -San

@David_Wong @Sanjeeb2022 Where would I write and implement the code? As a lambda function in the AWS console or are you referring to somewhere else?

@Sanjeeb2022 @David_Wong @Max Do you have any resources I can use to get started? How would I write API calls and such in a lambda function? I haven’t done this before.

Hi @ineedqshelp - For intro to lambda, please have a look on some materials first and comfortable with approach how you can call boto3 api’s in lambda ( python script). Some samples can be found from the below link. GitHub - grantcooksey/aws-lambda-python-examples: Lessons and examples to get star…

Hi @ineedqshelp - If the information or details are useful, can you marked the post as Solution for now. I know it will take some time for you to understand lambda, and develop python scripts for Lambda with boto3 API. Regards - San

Keeping track of dataset refreshees

Q&A

David_Wong April 5, 2023, 7:47pm 5

No, I think you’ll have to write code to get a list of all your dataset IDs and iterate through all them to get the ingestion status for each.

Data refresh track

Topic		Replies	Views
Refresh Quicksight Dataset-Lambda Q&A data-source , quick-sight	4	1214	July 11, 2023
How to use cli command to do an incremental refresh? Q&A admin , quick-sight	1	163	April 3, 2024
View list of datasets being refreshed Q&A feature-request , quick-sight , data-preparation	3	641	October 26, 2022
Trigger dataset refresh Q&A quick-sight , dataset	3	2464	August 25, 2023
Triggering Dataset Refreshes via API Q&A quick-sight , dataset , Business-Intelligence-Engineer	4	253	August 9, 2024

Keeping track of dataset refreshees

Related topics