Create ingestion and notify if done

[alltej]

Is there a way to push an event/notification when the created ingestion is done? Currently creating the ingestions but I have to run the cli at certain time to check status. Just wondering if the backend can notify(eg. event bridge) that the ingestion is done.

[apjvinod]

Hi @alltej

Currently dataset ingestion completion event is not pushed to event bridge , will mark it as feature request .

In the mean time you may consider using Step functions to orchestrate the dataset ingestion with dependency . Please refer to this post for additional details.

Updating Existing Dataset with aws Step Functions (UpdateDataSet)

I have a dataset that contains only one table imported from aws athena, the table is the result from a Glue ETL job and it is listed on the aws glue data catalogue, in parquet format in s3. On the other hand, I am creating a state machine in step function that will update the ETL job, and then refresh the dataset in QS so that we always have the most up-to-date dashboard. I can see there is a Amazon Quicksight API called UpdateDataSet and it seems to be what I need. However, I am not sure what …

Thanks for posting your questions on the QuickSight Community Q&A Forum!

Thanks
Vinod

[Sanjeeb2022]

Thanks @apjvinod . The work around approach is good one , the only bottleneck is there will be too many API calls for a single ingestion ( if ingestion will take 10 mins also, it will take around 120 API call per min ). Imagine we have many data sets, we may exhausted the limit. Hope the feature request to intimate eventbridge for create ingestion api will make the life easy.

Regards - Sanjeeb

[alltej]

This is what I am trying to avoid about the API calls because it can get excessive.