Skip to content

Instantly share code, notes, and snippets.

@bernadinm
Created August 31, 2017 17:50
Show Gist options
  • Save bernadinm/61bebfcbb8cca140c4cca3560bac852a to your computer and use it in GitHub Desktop.
Save bernadinm/61bebfcbb8cca140c4cca3560bac852a to your computer and use it in GitHub Desktop.
Terraform believe that the resource group is destroyed and when asked to create it again, the Azure api errors.
mesospheres-MacBook-Pro-8:repro mbernadin$ terraform destroy --force
azurerm_resource_group.mb: Refreshing state... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme)
azurerm_public_ip.lb: Refreshing state... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...rosoft.Network/publicIPAddresses/lb-ip)
azurerm_resource_group.mb: Destroying... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme)
azurerm_resource_group.mb: Still destroying... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme, 10s elapsed)
azurerm_resource_group.mb: Still destroying... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme, 20s elapsed)
azurerm_resource_group.mb: Still destroying... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme, 30s elapsed)
azurerm_resource_group.mb: Still destroying... (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme, 40s elapsed)
azurerm_resource_group.mb: Destruction complete
Destroy complete! Resources: 1 destroyed.
mesospheres-MacBook-Pro-8:repro mbernadin$ terraform apply
azurerm_resource_group.mb: Creating...
location: "" => "westus"
name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_resource_group.mb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme)
azurerm_public_ip.node_load_balancer_public_ip: Creating...
domain_name_label: "" => "test-rand102390120830"
fqdn: "" => "<computed>"
ip_address: "" => "<computed>"
location: "" => "westus"
name: "" => "lb-ip"
public_ip_address_allocation: "" => "dynamic"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_availability_set.node_av_set: Creating...
location: "" => "westus"
managed: "" => "true"
name: "" => "test-avset"
platform_fault_domain_count: "" => "3"
platform_update_domain_count: "" => "1"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_public_ip.lb: Creating...
domain_name_label: "" => "mylb"
fqdn: "" => "<computed>"
ip_address: "" => "<computed>"
location: "" => "westus"
name: "" => "lb-ip"
public_ip_address_allocation: "" => "dynamic"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_virtual_network.vnet: Creating...
address_space.#: "" => "1"
address_space.0: "" => "10.0.0.0/16"
location: "" => "westus"
name: "" => "vnet"
resource_group_name: "" => "deleteme"
subnet.#: "" => "<computed>"
tags.%: "" => "<computed>"
azurerm_availability_set.mb: Creating...
location: "" => "westus"
managed: "" => "false"
name: "" => "mb-availability-set"
platform_fault_domain_count: "" => "3"
platform_update_domain_count: "" => "5"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_public_ip.node_public_ip.2: Creating...
domain_name_label: "" => "a987654321-node-3"
fqdn: "" => "<computed>"
ip_address: "" => "<computed>"
location: "" => "westus"
name: "" => "node-pub-ip-3"
public_ip_address_allocation: "" => "dynamic"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_public_ip.node_public_ip.0: Creating...
domain_name_label: "" => "a987654321-node-1"
fqdn: "" => "<computed>"
ip_address: "" => "<computed>"
location: "" => "westus"
name: "" => "node-pub-ip-1"
public_ip_address_allocation: "" => "dynamic"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_public_ip.node_public_ip.1: Creating...
domain_name_label: "" => "a987654321-node-2"
fqdn: "" => "<computed>"
ip_address: "" => "<computed>"
location: "" => "westus"
name: "" => "node-pub-ip-2"
public_ip_address_allocation: "" => "dynamic"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_availability_set.node_av_set: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...ft.Compute/availabilitySets/test-avset)
azurerm_availability_set.mb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...e/availabilitySets/mb-availability-set)
azurerm_virtual_network.vnet: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...Microsoft.Network/virtualNetworks/vnet)
azurerm_subnet.public: Creating...
address_prefix: "" => "10.0.0.0/22"
ip_configurations.#: "" => "<computed>"
name: "" => "public"
network_security_group_id: "" => "<computed>"
resource_group_name: "" => "deleteme"
route_table_id: "" => "<computed>"
virtual_network_name: "" => "vnet"
azurerm_subnet.private: Creating...
address_prefix: "" => "10.0.4.0/22"
ip_configurations.#: "" => "<computed>"
name: "" => "private"
network_security_group_id: "" => "<computed>"
resource_group_name: "" => "deleteme"
route_table_id: "" => "<computed>"
virtual_network_name: "" => "vnet"
azurerm_public_ip.node_public_ip.0: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...etwork/publicIPAddresses/node-pub-ip-1)
azurerm_public_ip.node_public_ip.1: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...etwork/publicIPAddresses/node-pub-ip-2)
azurerm_public_ip.lb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...rosoft.Network/publicIPAddresses/lb-ip)
azurerm_lb.mb: Creating...
frontend_ip_configuration.#: "" => "1"
frontend_ip_configuration.0.inbound_nat_rules.#: "" => "<computed>"
frontend_ip_configuration.0.load_balancer_rules.#: "" => "<computed>"
frontend_ip_configuration.0.name: "" => "default"
frontend_ip_configuration.0.private_ip_address: "" => "<computed>"
frontend_ip_configuration.0.private_ip_address_allocation: "" => "dynamic"
frontend_ip_configuration.0.public_ip_address_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/publicIPAddresses/lb-ip"
frontend_ip_configuration.0.subnet_id: "" => "<computed>"
location: "" => "westus"
name: "" => "mb-lb"
private_ip_address: "" => "<computed>"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_public_ip.node_public_ip.2: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...etwork/publicIPAddresses/node-pub-ip-3)
azurerm_lb.mb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-.../Microsoft.Network/loadBalancers/mb-lb)
azurerm_lb_backend_address_pool.mb: Creating...
backend_ip_configurations.#: "" => "<computed>"
load_balancing_rules.#: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-pool"
resource_group_name: "" => "deleteme"
azurerm_lb_probe.mb: Creating...
interval_in_seconds: "" => "15"
load_balancer_rules.#: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-probe-80-up"
number_of_probes: "" => "2"
port: "" => "80"
protocol: "" => "http"
request_path: "" => "/"
resource_group_name: "" => "deleteme"
azurerm_subnet.private: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...k/virtualNetworks/vnet/subnets/private)
azurerm_lb.node_internal_load_balancer: Creating...
frontend_ip_configuration.#: "" => "1"
frontend_ip_configuration.0.inbound_nat_rules.#: "" => "<computed>"
frontend_ip_configuration.0.load_balancer_rules.#: "" => "<computed>"
frontend_ip_configuration.0.name: "" => "private-ip-config"
frontend_ip_configuration.0.private_ip_address: "" => "<computed>"
frontend_ip_configuration.0.private_ip_address_allocation: "" => "dynamic"
frontend_ip_configuration.0.public_ip_address_id: "" => "<computed>"
frontend_ip_configuration.0.subnet_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/virtualNetworks/vnet/subnets/private"
location: "" => "westus"
name: "" => "int-node-elb"
private_ip_address: "" => "<computed>"
resource_group_name: "" => "deleteme"
tags.%: "" => "<computed>"
azurerm_lb_backend_address_pool.mb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...s/mb-lb/backendAddressPools/mb-lb-pool)
azurerm_lb.node_internal_load_balancer: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...oft.Network/loadBalancers/int-node-elb)
azurerm_lb_backend_address_pool.private_node_backend_pool: Creating...
backend_ip_configurations.#: "" => "<computed>"
load_balancing_rules.#: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/int-node-elb"
name: "" => "internal_backend_address_pool"
resource_group_name: "" => "deleteme"
azurerm_lb_probe.mb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lancers/mb-lb/probes/mb-lb-probe-80-up)
azurerm_lb_rule.mb4: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "84"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "84"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-84-84"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb5: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "85"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "85"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-85-85"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb6: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "86"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "86"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-86-86"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb7: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "87"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "87"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-87-87"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb1: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "81"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "81"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-81-81"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "80"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "80"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-80-80"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb3: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "83"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "83"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-83-83"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_rule.mb2: Creating...
backend_address_pool_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/backendAddressPools/mb-lb-pool"
backend_port: "" => "82"
enable_floating_ip: "" => "false"
frontend_ip_configuration_id: "" => "<computed>"
frontend_ip_configuration_name: "" => "default"
frontend_port: "" => "82"
idle_timeout_in_minutes: "" => "<computed>"
load_distribution: "" => "<computed>"
loadbalancer_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb"
name: "" => "mb-lb-rule-82-82"
probe_id: "" => "/subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/loadBalancers/mb-lb/probes/mb-lb-probe-80-up"
protocol: "" => "tcp"
resource_group_name: "" => "deleteme"
azurerm_lb_backend_address_pool.private_node_backend_pool: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...essPools/internal_backend_address_pool)
azurerm_lb_rule.mb4: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-84-84)
azurerm_lb_rule.mb6: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-86-86)
default = "3"
azurerm_subnet.public: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...rk/virtualNetworks/vnet/subnets/public)
azurerm_lb_rule.mb5: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-85-85)
azurerm_lb_rule.mb7: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-87-87)
azurerm_lb_rule.mb1: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-81-81)
azurerm_lb_rule.mb: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-80-80)
azurerm_lb_rule.mb3: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-83-83)
azurerm_lb_rule.mb2: Creation complete (ID: /subscriptions/134r282f-ceda-41d5-a0a8-...lb/loadBalancingRules/mb-lb-rule-82-82)
Error applying plan:
1 error(s) occurred:
* azurerm_public_ip.node_load_balancer_public_ip: 1 error(s) occurred:
* azurerm_public_ip.node_load_balancer_public_ip: network.PublicIPAddressesClient#CreateOrUpdate: Failure responding to request: StatusCode=429 -- Original Error: autorest/azure: Service returned an error. Status=429 Code="RetryableError" Message="A retryable error occurred." Details=[{"code":"RetryableErrorDueToAnotherOperation","message":"Operation PutPublicIpAddressOperation (6bfdb84d-f2a1-405f-94d9-15f64aba1111) is updating resource /subscriptions/134r282f-ceda-41d5-a0a8-1251255340c2/resourceGroups/deleteme/providers/Microsoft.Network/publicIPAddresses/lb-ip. The call can be retried in 13 seconds."}]
Terraform does not automatically rollback in the face of errors.
Instead, your Terraform state file has been partially updated with
any resources that successfully completed. Please address the error
above and apply again to incrementally change your infrastructure.
mesospheres-MacBook-Pro-8:repro mbernadin$ terraform destroy --force
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment