I have a dataset that incrementally loads every 15 mins from Snowflake. However recently it keeps getting stuck on ‘Running’. I have been able to cancel the ingestion, however how am I to ensure this doesn’t happen in the future?
Thank you
Hi @hcooper95
did you check Snowflake why the query was getting stuck?
BR
Hi Erik,
Thanks for the reply.
I have looked at the query history and it looks like it successfully ran the query in snowflake. However the time when I cancelled the ingestion pretty quickly there was nothing. Not sure if that helps.
Thanks,
Harry
For example, yesterday the 10.20pm incremental load got stuck in ‘Running’ for 9 hours, 53 minutes, 33 seconds. However I can see the query in Snowflake only took 7m 32s.
Hi @hcooper95,
but it finished succesfully, right?
Looks for me like a “compute” issue on QS/AWS.
BR
Oh sorry it failed actually (QUERY_TIMEOUT), the next incremental load took 9 hours, 53 minutes, 33 seconds. I guess because it was waiting for the 10.20 to finish?
Is there a way I can prevent this from occuring again?
I honestly don’t know how.
Certainly not via the UI.
I don’t know if you can query the status of a refresh via the API, or even start a refresh
Thank you for letting us know. I would recommend filing a case with AWS Support where we can dive into the details so that we can help you further. Here are the steps to open a support case. If your company has someone who manages your AWS account, you might not have direct access to AWS Support and will need to raise an internal ticket to your IT team or whomever manages your AWS account. They should be able to open an AWS Support case on your behalf. Hope this helps!