New version of AutoSpotting with lots of improvements

Hacker News

Share card

New version of AutoSpotting with lots of improvements

These are the main changes in this new stable release. Some were previously available in the Open Source trunk code, while others were built over the last couple of weeks: - Added support for recently launched EC2 instance types, including up to R6a, released in July 2022. - Significantly lower Spot interruption rates in the default configuration by 1.switching to the EC2 Fleet API in instant mode with the capacity-optimized-prioritized allocation strategy so that we now avoid instance types with a large likelihood of interruption. 2.increasing instance type diversification by relaxing the instance type selection logic. Previously we enforced instance types with at least as much EBS bandwidth, but this is now off by default. 3.Disabling the handling of Rebalancing recommendation events in the default configuration, which have been seen to significantly increase interruption rates. - Add support for biasing instance types selection to newer instance generations such as C7g, which offer significant performance improvements but with a slight cost increase. This is now turned on by default but can be turned off if lowest cost needs to be prioritised. The way this works is by penalising older generations when doing cost comparisons by 10% of the Spot price for each older generation, while the current generation isn't penalised at all. - Lower AutoSpotting costs, by considering the on demand price of the initial instance type configured on the group instead of the on-demand price of the Spot instance type that was launched to replace it. - Fixed handling of Allowed/Disallowed InstanceTypes in the default configuration, which was previously allowing all instance types and ignoring the list of Disallowed instance types. - Add support AutoScaling Group-based CodeDeploy deployment groups by triggering CodeDeploy deployments on new Spot instance launches so we no longer depends on tag-based deployment groups. This is a major release and I recommend anyone using AutoSpotting to give it a try. For now this is only available from the AWS Marketplace, but I plan to eventually release this functionality to the Open Source code.