Questions tagged [spot-instances]
The spot-instances tag has no usage guidance.
spot-instances
55
questions
1
vote
0
answers
60
views
Performance Degradation in Aws Spot Instances while running the same process on multiple cores
Problem : I am observing a performance degradation of over 100 % when I am running the same program on all the cores of Aws spot instance by pinning them on separate cores in comparison to running a ...
0
votes
0
answers
129
views
AWS EKS Node Affinity Conflict with Spot Instances
I'm running some Flink jobs on my EKS cluster in AWS. I am using spot instances to run these jobs, but am running into a problem with a PVC (EBS volume). I am fairly certain the issue is that the EBS ...
- 11
0
votes
0
answers
174
views
Understanding AWS EMR Behavior with Spot Instances and Failed Queries Despite 'Completed' Status
I run KPI aggregation queries every morning using AWS EMR. Since I am using spot instances, there are times when the servers are forcibly terminated due to resource shortages. In such cases, the EMR ...
1
vote
1
answer
286
views
In what task state can AWS Fargate spot interruption happen?
I couldn't find a documentation on, in which task state does AWS interrupt a Fargate spot task ?
Can interruption happen during "provisioning", "pending" and "deprovisioning&...
- 374
0
votes
3
answers
241
views
Not able to provision specific spot instances
I get an error "Instance Launch Failed. Max spot instance count exceeded" When I try to provision g3.16xlarge or g3.8xlarge. However I can provision g3s.xlarge and g3.4xlarge instance. The ...
- 71
1
vote
1
answer
656
views
Is it possible to use ECS spot till it's unavailable and switch to On demand and back?
I'm reading about the ECS spot (Fargate) and the capacity provider. In the examples, I see they always create an on-demand capacity provider e.g. 1 running task, and then a spot provider with a ...
- 14.7k
0
votes
1
answer
422
views
Check for ec2 spot interruption notice from Lambda function
I'm currently building an application that requires quite a lot of compute resources, making me use multiple EC2s. I am trying to reduce costs by using spot instances. What I would like to do is have ...
- 192
0
votes
1
answer
226
views
Preventing an auto-terminated spot instances from restarting
Imagine I have a persistent spot request of size 1. If I manually stop this instance, it will not restart until I start it again.
However, if the instance is interrupted by AWS because of a lack of ...
- 63.7k
1
vote
1
answer
544
views
How to avoid ECS Spot instance termination while processing user requests?
I'm planning to run an ECS cluster with an ALB in front of spot instances.
As an example: A user's request enters a container that is running on spot, but before getting the response, the spot ...
- 539
0
votes
1
answer
407
views
Is there data for AWS spot interruption rate over time?
We are running an EMR cluster with spot instances as task nodes. The EMR cluster is executing spark jobs which sometimes run for several hours. Interruptions of spot instances can cause the failure of ...
- 2,846
0
votes
1
answer
196
views
Configure Amazon maximum percentage of OnDemand price (spot instances)
I'm playing a little with spot instances, and for example, in Databricks, I can ask for a spot instance with a minimum of % savings over On-Demand instances.
My question is, if I set 90% off the On-...
- 563
0
votes
1
answer
738
views
Is gcp removed terminated vm logs?
Is GCP Vm logs are deleted after termination of vm?
I was running a GCE sopt vm with MIG(Managed Instance Group). My VM instance terminated. When i check logs
of terminated Vm. I am not able to see ...
0
votes
0
answers
190
views
AWS - Use AMI from other account
I want to use AMI which is located in another account to create spot instance with Terraform. AMI is shared with my account but EBS inside of it is created with custom KMS.
When I tried to use the AMI,...
- 23
0
votes
1
answer
233
views
When creating an AWS Auto-Scaling Launch Configuration & using spot instances - How can I set a maximum price based on unit type?
I regularly am seeing the following througout various AWS documentation:
If you set TargetCapacityUnitType to vcpu or memory-mib , the price
protection threshold is applied based on the per-vCPU or ...
- 6,344
0
votes
1
answer
98
views
Is SageMaker multi-node Spot-enabled GPU training an anti-pattern?
Is it an anti-pattern to do multi-node Spot-enabled distributed GPU training on SageMaker?
I'm afraid that several issues will slow things down or even make them infeasible:
the interruption ...
- 6,197