Sharing a process we have put in place to help with monitoring SPICE Ingestion jobs throughout the day. We are taking CloudWatch logs from Quicksight/SPICE into S3 and created this dashboard to monitor success, duration, and rows across all our jobs. We also have a tab that focuses on overlap of jobs, errors, and overall SPICE usage.
Brett
2
Hi @dougsallas,
Thanks so much for sharing this; I’ll mark as solution so that this message will stay in the library and accessible to other users!
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| SPICE capacity Consumed by User Role | 2 | 453 | December 22, 2022 | |
| Amazon Quick Sight now supports monitoring of SPICE consumption by sending metrics to Amazon CloudWatch | 0 | 515 | November 9, 2022 | |
| How to systematically manage SPICE logs, especially error? | 1 | 767 | May 19, 2022 | |
| Granular Spice Monitoring | 3 | 489 | January 2, 2024 | |
| SPICE Usage Analytics (Dataset Sizes by User/Group/Namespace, Permissions, etc) | 4 | 3674 | September 2, 2024 |