Read the EPIC (AWS cost decrease)
As per a reminder from Jesse Glick (:hearth:)in the parent EPIC, we could decrease the cost of agent by using Spot instances on the AWS EKS worker pools.
Supported by the EKS terraform module (https://registry.terraform.io/modules/terraform-aws-modules/eks/aws/latest) that we use: https://github.com/terraform-aws-modules/terraform-aws-eks/blob/master/docs/spot-instances.md
- Read https://aws.amazon.com/ec2/spot/?cards.sort-by=item.additionalFields.startDateTime&cards.sort-order=asc to undertsnad the challenge
- Check the cluster terraform definition in https://github.com/jenkins-infra/aws/blob/main/eks-cluster.tf
- Update EKS worker pools to use Spot
- Eventually define a tiny static worker pool (1-2 machines max) and a secondary with spot instances and autoscaling