Last data refresh complete timestamp

[Rishita_Chebrolu]

Is it possible to get the Data Last Refresh timestamp on the dashboard?
I have tried creating a calculated field (NOW()) at the dataset level and used it in insights visual. But it gives the timestamp of when the data refresh begins, I would need the timestamp of when the refresh completes.

[shravya]

Hi @Rishita_Chebrolu

There are some posts on this problem - Please do check out and let me know if these didn’t help you.

Post 1 -

Time Stamp

Hi @nitishpala - Can you please follow the below steps. Step -1 : At data set level, add a calculated field and paste now() for the value. See the screen shots below. Step -2: At Analysis level, Add insight, select the date field in the dimension, edit the narrative and put t your narrative. and save it. Edit the title and sub-title. See the screenshot. [image] [image] [image] hope this is what you are looking for. Regards - Sanjeeb

Post 2 -

Adding Last data refresh timestamp in the Dashboard

Hi Mounika, I’ve also encountered this question and I’ve also successfully used the above recommendation, but it doesn’t cover all my use cases. For example, when your SPICE dataset refreshes it doesn’t mean your data is current. I found that one of my redshift tables had a 18 hour lag due to other dependencies. When I used now(), it confused my customers who saw the hourly refresh time assuming all data was current as of that date & time when it only tells you how long ago the refresh was trig…

Post 3 -

How to display the refresh time from the dataset on the dashboard as a narrative?

A similar question was asked here: Adding Last data refresh timestamp in the Dashboard - #4 by Kashgar. Please let me know if this answers your question.

Thank you,
Shravya

[Rishita_Chebrolu]

Hi, Yes I have seen those posts. But adding a calculated now() field at dataset level gives me the timestamp when the scheduled refresh starts not when it ends.
For ex- If my dataset has a refresh schedule of hourly and starts at 12 AM and the refresh takes 8 mins, I need to display 12:08 AM as the last refresh timestamp not the time when refresh is triggered i.e. 12 AM.

[shravya]

@Rishita_Chebrolu

Okay, but as far as I know its not possible to get the refresh complete time.

There is another alternative but not sure if you prefer this -

1. Using a Date Column from Your Data Source - If your data source has a column that tracks the most recent update or transaction timestamp (e.g., updated_at, processed_date, or refresh_date), you can: Use the max() function on that column to find the latest timestamp in your dataset.

Tagging experts here to update if there is any other workaround or a new feature - @DylanM @Sanjeeb2022 @agmayan @Ying_Wang @David_Wong

Thank you,
Shravya

[Biswajit_1993]

Hi @Rishita_Chebrolu,

Just follow these simple steps to achieve this.

First of all, it depends on your dataset, whether you are using full refresh or incremental refresh time.

If your dataset uses Full Refresh:

Go to your dataset and create a calculated field called “Last Refreshed Time” with the now() function.

If your dataset uses Incremental Refresh:

In this case, you need to create two calculated fields:

1. The first one uses the now() function (as shown above).

2. The second one calculates the maximum of the “Last Refreshed Time” field.

Please follow these steps, and you should achieve your desired results.

*Note: Please create these two calculated fields in the QuickSight dataset level, not at the analysis level.

Please do the testing and confirm.

Thanks & Regards
Biswajit Dash

[ArunSanthosh]

Hi Rishita @Rishita_Chebrolu ,

Currently, the only way to precisely get the refresh end time is via list-ingestion/describe-ingestion API. You have the start time and ingestion time in seconds there which can be used to derive the completion time. Bring this to the dashboard will involve getting the info via API, writing it to a data source and triggering refresh on a ‘metadata’ dataset to pull this in. While this can be done programmatically, I do acknowledge that this is too much work to get this info.
Using now(), sysdate from DB etc gets you close enough without this hassle.

We do have a Product Feature Request in our list to make this info available as dataset metadata that you can directly use in analysis. Please have your AWS account TAM/SA file a customer influence at this internal link.
If you don’t have a dedicated AWS contact, send me your org details and I will file the customer influence on your behalf (Use message option from user tile)

Regards,
Arun Santhosh
Pr QuickSight SA