I use terraform, the common problems I faced is about the insufficient permissions. It always took me multiple iterations to sort it out. So I wonder whether we have tools that can show us all the permissions we need to define by inputting all the AWS services we use for a project.
Otherwise, I would highly appreciate any best-practices advice to avoid this permission error loops every time.
TIA
Hey @pizofreude
Is this what you’re looking for?:
Yes, since I faced multiple difficulties when creating data engineering pipeline i.e. Using EC2 for Kestra as workflow orchestrator that must have access to all deployed aws services. My current workflow is just iteratively add whatever permissions required mentioned in the terraform error logs.
For example the “# Consolidated IAM Policy for Kestra EC2 Instance” in this project: insightflow-retail-economic-pipeline/terraform/prod/02_compute/main.tf at main · pizofreude/insightflow-retail-economic-pipeline · GitHub
So, I just wish if there is EC2 IAM policy consolidation generator that we can simply tick all the services that dependent on each others.