Skip to content

Instantly share code, notes, and snippets.

@yaremchuk3
Created December 23, 2021 12:34
Show Gist options
  • Save yaremchuk3/a514fe67dc406a7e405643ba9f7e188a to your computer and use it in GitHub Desktop.
Save yaremchuk3/a514fe67dc406a7e405643ba9f7e188a to your computer and use it in GitHub Desktop.
Initializing modules...
Initializing the backend...
Successfully configured the backend "s3"! Terraform will automatically
use this backend unless the backend configuration changes.
Initializing provider plugins...
- terraform.io/builtin/terraform is built in to Terraform
- Finding hashicorp/aws versions matching ">= 2.33.*"...
- Finding hashicorp/template versions matching ">= 2.1.2"...
- Installing hashicorp/aws v3.67.0...
- Installed hashicorp/aws v3.67.0 (unauthenticated)
- Installing hashicorp/template v2.1.2...
- Installed hashicorp/template v2.1.2 (unauthenticated)
Terraform 0.11 and earlier required all non-constant expressions to be
provided via interpolation syntax, but this pattern is now deprecated. To
silence this warning, remove the "${ sequence from the start and the }"
sequence from the end of this expression, leaving just the inner expression.
Template interpolation syntax is still used to construct strings from
expressions when the template includes multiple interpolation sequences or a
mixture of literal strings and interpolations. This deprecation applies only
to templates that consist entirely of a single interpolation sequence.
(and one more similar warning elsewhere)
Terraform has been successfully initialized!
You may now begin working with Terraform. Try running "terraform plan" to see
any changes that are required for your infrastructure. All Terraform commands
should now work.
If you ever set or change modules or backend configuration for Terraform,
rerun this command to reinitialize your working directory. If you forget, other
commands will detect it and remind you to do so if necessary.
data.terraform_remote_state.pre_requisite: Refreshing state...
data.terraform_remote_state.vpc: Refreshing state...
module.cluster.module.shared.data.aws_iam_policy_document.r53_assume_role_policy: Refreshing state... [id=4158822762]
module.cluster.module.shared.data.aws_partition.which: Refreshing state... [id=aws-cn]
module.cluster.module.shared.data.aws_caller_identity.current: Refreshing state... [id=897775818260]
module.cluster.module.shared.aws_security_group.restricted-elb: Refreshing state... [id=sg-0c1e7afa45a9cf4df]
module.cluster.module.shared.aws_security_group.nodes: Refreshing state... [id=sg-089482d790d0b8898]
module.cluster.module.shared.aws_security_group.restricted-rfc1918: Refreshing state... [id=sg-0249d386216513e3e]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Refreshing state... [id=Z02456591M16DHVMZ3XXX]
module.cluster.module.shared.aws_security_group.dummy-sg: Refreshing state... [id=sg-0520ae1a3ead8e507]
module.cluster.module.shared.aws_security_group.shared-elb: Refreshing state... [id=sg-01cb94329dc5ba812]
module.cluster.module.bastion.aws_security_group.bastion[0]: Refreshing state... [id=sg-049f1decbc26c2b60]
module.cluster.module.shared.aws_security_group.restricted-elb-customer[0]: Refreshing state... [id=sg-04efdc4ab7987cc64]
module.cluster.module.shared.aws_security_group.calico: Refreshing state... [id=sg-06d776e45d262de4b]
data.aws_ami.here_instance-storage-test_ami: Refreshing state... [id=ami-0a2234375e54eac3f]
data.aws_ami.here_default_ami: Refreshing state... [id=ami-0a2234375e54eac3f]
module.cluster.module.shared.aws_ebs_volume.etcd[1]: Refreshing state... [id=vol-00fadf5a80dbc0f77]
module.cluster.module.shared.aws_ebs_volume.etcd[0]: Refreshing state... [id=vol-092b93e073a81bbe0]
module.cluster.module.shared.aws_ebs_volume.etcd[2]: Refreshing state... [id=vol-0d29440ed35f65e1c]
module.cluster.module.shared.aws_security_group.apilb: Refreshing state... [id=sg-061992f7cba3364d6]
module.cluster.module.shared.aws_iam_policy.cloudwatch_exporter_lb_policy: Refreshing state... [id=arn:aws-cn:iam::897775818260:policy/Loadbalancer.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_ebs_volume.etcd-events[2]: Refreshing state... [id=vol-0877c1c63cb8b70a6]
module.cluster.module.shared.aws_security_group.etcds[0]: Refreshing state... [id=sg-011a6b6d6200b1a45]
aws_key_pair.ec2_public_key: Refreshing state... [id=phoenix-aws-cn-north-1]
data.aws_ami.control_plane_ami: Refreshing state... [id=ami-03053028c94cde0a1]
module.cluster.module.shared.aws_s3_bucket.logging[0]: Refreshing state... [id=fluentd.phoenix-aws-cn-north-1.k8s.hereolp.cn]
data.aws_ami.here_instance-storage-scale-test_ami: Refreshing state... [id=ami-0a2234375e54eac3f]
module.cluster.module.shared.aws_security_group.masters: Refreshing state... [id=sg-087f53a29b4961c0c]
module.cluster.module.shared.aws_iam_policy.cloudwatch_exporter_policy: Refreshing state... [id=arn:aws-cn:iam::897775818260:policy/EBS-Volumes.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.nodes: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.etcds[0]: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_sqs_queue.logging[0]: Refreshing state... [id=https://sqs.cn-north-1.amazonaws.com.cn/897775818260/logging-phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_ebs_volume.etcd-events[0]: Refreshing state... [id=vol-0bcaad47e8b9fe401]
module.cluster.module.shared.aws_ebs_volume.etcd-events[1]: Refreshing state... [id=vol-0f943b8367c7bf934]
module.cluster.module.shared.aws_iam_role.masters: Refreshing state... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.data.aws_iam_policy_document.node_group_specific_policy_doc: Refreshing state... [id=1555862065]
module.cluster.module.shared.aws_iam_role.restricted: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.shared-elb-egress: Refreshing state... [id=sgrule-3820660822]
module.cluster.module.shared.aws_security_group_rule.shared-elb-ingress: Refreshing state... [id=sgrule-15297853]
module.cluster.module.shared.aws_security_group_rule.nodes-elb-tcp: Refreshing state... [id=sgrule-2290762303]
module.cluster.module.shared.aws_security_group_rule.nodes-elb-udp: Refreshing state... [id=sgrule-1053106776]
module.cluster.module.shared.aws_security_group_rule.hostports_16xx: Refreshing state... [id=sgrule-3832749890]
module.cluster.module.shared.aws_security_group_rule.nodes-egress: Refreshing state... [id=sgrule-2909813764]
module.cluster.module.shared.aws_security_group_rule.restricted-nlb-egress-rfc1918: Refreshing state... [id=sgrule-1401739965]
module.cluster.module.shared.aws_security_group_rule.nodes-to-nodes-kubelet: Refreshing state... [id=sgrule-973265362]
module.cluster.module.shared.aws_security_group_rule.nodes-ssh: Refreshing state... [id=sgrule-86952200]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-egress: Refreshing state... [id=sgrule-519680750]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-ingress-here[0]: Refreshing state... [id=sgrule-2526748608]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-natgw[0]: Refreshing state... [id=sgrule-4027432780]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-ingress-vpc-nat: Refreshing state... [id=sgrule-69812145]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-egress[0]: Refreshing state... [id=sgrule-3391240074]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-customer[0]: Refreshing state... [id=sgrule-1521887495]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-53: Refreshing state... [id=sgrule-1773567973]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-kafka: Refreshing state... [id=sgrule-3314570809]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-here[0]: Refreshing state... [id=sgrule-742588062]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-ssh: Refreshing state... [id=sgrule-778270723]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-53-udp: Refreshing state... [id=sgrule-1090201050]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-magic-subnet: Refreshing state... [id=sgrule-241855020]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-https: Refreshing state... [id=sgrule-3555382131]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-all-but-rfc1918: Refreshing state... [id=sgrule-2527211431]
module.cluster.module.bastion.aws_security_group_rule.bastion-ssh[0]: Refreshing state... [id=sgrule-3098844871]
module.cluster.module.bastion.aws_security_group_rule.bastion-egress[0]: Refreshing state... [id=sgrule-4139672610]
module.cluster.module.shared.aws_security_group_rule.dummy-sg-egress: Refreshing state... [id=sgrule-88934366]
module.cluster.module.shared.aws_security_group_rule.dummy-sg-ingress: Refreshing state... [id=sgrule-3849015715]
module.cluster.module.shared.aws_security_group_rule.calico-ipip: Refreshing state... [id=sgrule-3669907327]
module.cluster.module.shared.aws_security_group_rule.calico-typha-egress: Refreshing state... [id=sgrule-376544681]
module.cluster.module.shared.aws_security_group_rule.calico-bird: Refreshing state... [id=sgrule-3406515621]
module.cluster.module.shared.aws_security_group_rule.calico-bird-egress: Refreshing state... [id=sgrule-1276499607]
module.cluster.module.shared.aws_security_group_rule.calico-typha: Refreshing state... [id=sgrule-170931269]
module.cluster.module.shared.aws_security_group_rule.calico-ipip-egress: Refreshing state... [id=sgrule-4161032268]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-nodes-https: Refreshing state... [id=sgrule-3256090243]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-masters-public-restricted[0]: Refreshing state... [id=sgrule-1388523125]
module.cluster.module.shared.aws_elb.api: Refreshing state... [id=tf-lb-20211222165226171500000006]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-admin-https: Refreshing state... [id=sgrule-1403450883]
module.cluster.module.shared.aws_security_group_rule.etcds-ssh[0]: Refreshing state... [id=sgrule-3103690879]
module.cluster.module.shared.aws_security_group_rule.etcds-to-etcds[0]: Refreshing state... [id=sgrule-690139451]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-natgw-https[0]: Refreshing state... [id=sgrule-3183966749]
module.cluster.module.shared.aws_security_group_rule.etcd-egress[0]: Refreshing state... [id=sgrule-852721119]
module.cluster.module.shared.aws_security_group_rule.nodes-to-etcds-kubelet: Refreshing state... [id=sgrule-671099809]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-to-masters: Refreshing state... [id=sgrule-1019771742]
module.cluster.module.shared.aws_security_group_rule.master-to-etcds[0]: Refreshing state... [id=sgrule-2775321540]
module.cluster.module.shared.aws_security_group_rule.master-https-apilb: Refreshing state... [id=sgrule-2569154720]
module.cluster.module.shared.aws_security_group_rule.apilb-egress-masters-https: Refreshing state... [id=sgrule-3283424205]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-nodes-felix-to-master-typha: Refreshing state... [id=sgrule-418690945]
module.cluster.module.shared.aws_security_group_rule.master-to-nodes: Refreshing state... [id=sgrule-414995123]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-controller-manager: Refreshing state... [id=sgrule-3888397713]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-scheduler: Refreshing state... [id=sgrule-659052818]
module.cluster.module.shared.aws_security_group_rule.master-ssh: Refreshing state... [id=sgrule-2066597395]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-masters-https: Refreshing state... [id=sgrule-1510497326]
module.cluster.module.shared.aws_security_group_rule.master-to-restricted-rfc1918-nodes: Refreshing state... [id=sgrule-871490488]
module.cluster.module.shared.aws_security_group_rule.master-https: Refreshing state... [id=sgrule-2715954932]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-kubelet: Refreshing state... [id=sgrule-1782222064]
module.cluster.module.shared.aws_security_group_rule.master-egress: Refreshing state... [id=sgrule-3139827215]
module.cluster.module.shared.aws_security_group_rule.all-master-to-master: Refreshing state... [id=sgrule-1723817384]
module.cluster.module.shared.aws_iam_role_policy_attachment.masters_cloudwatch_agent_policy: Refreshing state... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165209472300000003]
module.cluster.module.shared.aws_iam_role_policy.masters_lambda: Refreshing state... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.r53_controller: Refreshing state... [id=r53_controller.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.masters_kms[0]: Refreshing state... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_instance_profile.masters: Refreshing state... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.dp_cluster_aws_ebs_csi_driver: Refreshing state... [id=dp_cluster_aws_ebs_csi_driver.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role_policy_attachment.etcds_cloudwatch_agent_policy: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165218551500000005]
module.cluster.module.shared.aws_iam_role_policy.etcds_s3[0]: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_instance_profile.etcds[0]: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.etcds_lambda: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.etcds_kms[0]: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.cloudwatch_exporter_role: Refreshing state... [id=cloudwatch_exporter.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_cluster_here_custom_node_exporter: Refreshing state... [id=dp_here_custom_node_exporter.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role_policy.node_group_specific: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:nodes_groups_phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.nodes_kms[0]: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.dp_cluster_awslimits_exporter: Refreshing state... [id=dp_cluster_awslimits_exporter.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_resource_controller_shortname: Refreshing state... [id=dp_resource_controller.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_cluster_cloudwatch: Refreshing state... [id=dp_cluster_cloudwatch.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_instance_profile.nodes: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.nodes_lambda: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.nodes_s3: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy_attachment.nodes_cloudwatch_agent_policy: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165209852900000004]
module.cluster.module.shared.aws_iam_role_policy.nodes: Refreshing state... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.cluster_autoscaler: Refreshing state... [id=cluster_autoscaler.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.testrole: Refreshing state... [id=testrole.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy_attachment.restricted_cloudwatch_agent_policy: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165209271400000002]
module.cluster.module.shared.aws_iam_role_policy.restricted_lambda: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_instance_profile.restricted: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.restricted: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.logging[0]: Refreshing state... [id=logging.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.restricted_s3: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.restricted_kms[0]: Refreshing state... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.r53_controller[0]: Refreshing state... [id=r53_controller.phoenix-aws-cn-north-1.k8s.hereolp.cn:r53_controller.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_route53_record.public-api-cname[0]: Refreshing state... [id=Z0889688C2MG68R7E8MA_api_CNAME]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_aws_ebs_csi_driver_policy: Refreshing state... [id=dp_cluster_aws_ebs_csi_driver.phoenix-aws-cn-north-1:aws-ebs-csi-driver]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-ebs_metrics-attach: Refreshing state... [id=cloudwatch_exporter.phoenix-aws-cn-north-1-20211222165228378200000009]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-lb_metrics-attach: Refreshing state... [id=cloudwatch_exporter.phoenix-aws-cn-north-1-20211222165228303900000007]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-cloudwatch_readonly-attach: Refreshing state... [id=cloudwatch_exporter.phoenix-aws-cn-north-1-20211222165228343800000008]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_here_custom_node_exporter_policy: Refreshing state... [id=dp_here_custom_node_exporter.phoenix-aws-cn-north-1:here_custom_node_exporter]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_cloudwatch_policy: Refreshing state... [id=dp_cluster_cloudwatch.phoenix-aws-cn-north-1:grafana]
module.cluster.module.bastion.aws_instance.bastion[0]: Refreshing state... [id=i-02eff4703a66a2890]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_awslimits_exporter_policy: Refreshing state... [id=dp_cluster_awslimits_exporter.phoenix-aws-cn-north-1:awslimits-exporter]
module.cluster.module.shared.aws_iam_role_policy.dp_resource_controller_shortname: Refreshing state... [id=dp_resource_controller.phoenix-aws-cn-north-1:dp_resource_controller.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role_policy.testrole: Refreshing state... [id=testrole.phoenix-aws-cn-north-1.k8s.hereolp.cn:testrole.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.cluster_autoscaler: Refreshing state... [id=cluster_autoscaler.phoenix-aws-cn-north-1.k8s.hereolp.cn:cluster_autoscaler.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[0]: Refreshing state... [id=lt-09bc7169cf6d4eb59]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[2]: Refreshing state... [id=lt-068ac5edf706eab51]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[1]: Refreshing state... [id=lt-07dc2a379a47a34fb]
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[1]: Refreshing state... [id=lt-0574a677e564c4fdd]
module.cluster.module.master.aws_launch_template.master[0]: Refreshing state... [id=lt-08f689b6397d9e6e6]
module.cluster.module.master.aws_launch_template.master[2]: Refreshing state... [id=lt-071f4f46c602b9d4c]
module.cluster.module.master.aws_launch_template.master[1]: Refreshing state... [id=lt-05db9e0bf65325164]
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[2]: Refreshing state... [id=lt-0c1e02d0b4f42fdc5]
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[0]: Refreshing state... [id=lt-0ff004bca5f8ecae0]
module.cluster.module.etcd.aws_launch_template.etcd[0]: Refreshing state... [id=lt-0561c3c489e21de92]
module.cluster.module.etcd.aws_launch_template.etcd[1]: Refreshing state... [id=lt-0c0e70595a562ec8d]
module.cluster.module.etcd.aws_launch_template.etcd[2]: Refreshing state... [id=lt-0992d0c65aa21f49c]
module.nodes_default.aws_launch_template.nodes: Refreshing state... [id=lt-0e6d1e5f2cf9963d8]
module.nodes_default.aws_launch_template.nodes-local-ephemeral: Refreshing state... [id=lt-01a3e4ac794198817]
module.nodes_instance-storage-scale-test.aws_launch_template.nodes: Refreshing state... [id=lt-023b1f2379bbec459]
module.nodes_instance-storage-scale-test.aws_launch_template.nodes-local-ephemeral: Refreshing state... [id=lt-0d2f2a1fa95a3a804]
module.cluster.module.shared.aws_iam_role_policy.logging_sqs[0]: Refreshing state... [id=logging.phoenix-aws-cn-north-1.k8s.hereolp.cn:sqs.logging.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.logging[0]: Refreshing state... [id=logging.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.logging.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-test.aws_launch_template.nodes: Refreshing state... [id=lt-0320c7e50daa09a10]
module.nodes_instance-storage-test.aws_launch_template.nodes-local-ephemeral: Refreshing state... [id=lt-0a416263fb2d71727]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Refreshing state... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Refreshing state... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.master.aws_autoscaling_group.master[0]: Refreshing state... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.master.aws_autoscaling_group.master[2]: Refreshing state... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.master.aws_autoscaling_group.master[1]: Refreshing state... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_default.aws_autoscaling_group.nodes[0]: Refreshing state... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_default.aws_autoscaling_group.nodes[1]: Refreshing state... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Refreshing state... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-scale-test.aws_autoscaling_group.nodes[1]: Refreshing state... [id=1.instance-storage-scale-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-scale-test.aws_autoscaling_group.nodes[0]: Refreshing state... [id=0.instance-storage-scale-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Refreshing state... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.masters: Refreshing state... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn:masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Refreshing state... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.etcds[0]: Refreshing state... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.bastion.aws_eip.bastion[0]: Refreshing state... [id=eipalloc-07172068f49b54f80]
module.cluster.module.bastion.aws_route53_record.bastion-alias[0]: Refreshing state... [id=Z0889688C2MG68R7E8MA_bastion_A]
module.cluster.module.shared.aws_iam_role_policy.restricted: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-nodes-https: Destroying... [id=sgrule-3256090243]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-to-masters: Destroying... [id=sgrule-1019771742]
module.cluster.module.shared.aws_iam_role_policy.logging_sqs[0]: Destroying... [id=logging.phoenix-aws-cn-north-1.k8s.hereolp.cn:sqs.logging.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.master-https: Destroying... [id=sgrule-2715954932]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-53: Destroying... [id=sgrule-1773567973]
module.cluster.module.shared.aws_iam_role_policy.testrole: Destroying... [id=testrole.phoenix-aws-cn-north-1.k8s.hereolp.cn:testrole.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.apilb-egress-masters-https: Destroying... [id=sgrule-3283424205]
module.cluster.module.bastion.aws_security_group_rule.bastion-ssh[0]: Destroying... [id=sgrule-3098844871]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-kafka: Destroying... [id=sgrule-3314570809]
module.cluster.module.shared.aws_iam_role_policy.testrole: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.restricted: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.nodes-elb-udp: Destroying... [id=sgrule-1053106776]
module.cluster.module.shared.aws_security_group_rule.master-https-apilb: Destroying... [id=sgrule-2569154720]
module.cluster.module.shared.aws_iam_role_policy.logging_sqs[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy_attachment.nodes_cloudwatch_agent_policy: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165209852900000004]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-to-masters: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.etcds_kms[0]: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy_attachment.nodes_cloudwatch_agent_policy: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.nodes-to-nodes-kubelet: Destroying... [id=sgrule-973265362]
module.cluster.module.shared.aws_security_group_rule.master-https: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.calico-typha: Destroying... [id=sgrule-170931269]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-nodes-https: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.all-master-to-master: Destroying... [id=sgrule-1723817384]
module.cluster.module.shared.aws_iam_role_policy.etcds_kms[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.nodes_s3: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.bastion.aws_security_group_rule.bastion-ssh[0]: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.nodes-to-etcds-kubelet: Destroying... [id=sgrule-671099809]
module.cluster.module.shared.aws_iam_role_policy.nodes_s3: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.calico-bird-egress: Destroying... [id=sgrule-1276499607]
module.cluster.module.shared.aws_security_group_rule.nodes-elb-udp: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.logging[0]: Destroying... [id=logging.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.logging.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.nodes-to-etcds-kubelet: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.master-to-etcds[0]: Destroying... [id=sgrule-2775321540]
module.cluster.module.shared.aws_security_group_rule.master-https-apilb: Destruction complete after 1s
module.cluster.module.bastion.aws_security_group_rule.bastion-egress[0]: Destroying... [id=sgrule-4139672610]
module.cluster.module.shared.aws_iam_role_policy.logging[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.restricted_s3: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.calico-typha: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-egress: Destroying... [id=sgrule-519680750]
module.cluster.module.shared.aws_security_group_rule.apilb-egress-masters-https: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-masters-https: Destroying... [id=sgrule-1510497326]
module.cluster.module.shared.aws_iam_role_policy.restricted_s3: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-here[0]: Destroying... [id=sgrule-742588062]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-53: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy_attachment.restricted_cloudwatch_agent_policy: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165209271400000002]
module.cluster.module.shared.aws_iam_role_policy_attachment.restricted_cloudwatch_agent_policy: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.dummy-sg-ingress: Destroying... [id=sgrule-3849015715]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-egress: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.dummy-sg-egress: Destroying... [id=sgrule-88934366]
module.cluster.module.shared.aws_security_group_rule.all-master-to-master: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.master-ssh: Destroying... [id=sgrule-2066597395]
module.cluster.module.shared.aws_security_group_rule.calico-bird-egress: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.masters: Destroying... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn:masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-kafka: Destruction complete after 1s
module.cluster.module.bastion.aws_security_group_rule.bastion-egress[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_here_custom_node_exporter_policy: Destroying... [id=dp_here_custom_node_exporter.phoenix-aws-cn-north-1:here_custom_node_exporter]
module.cluster.module.shared.aws_iam_role_policy.cluster_autoscaler: Destroying... [id=cluster_autoscaler.phoenix-aws-cn-north-1.k8s.hereolp.cn:cluster_autoscaler.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.master-to-etcds[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.node_group_specific: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:nodes_groups_phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.masters: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.nodes-to-nodes-kubelet: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.calico-ipip: Destroying... [id=sgrule-3669907327]
module.cluster.module.shared.aws_security_group_rule.etcds-ssh[0]: Destroying... [id=sgrule-3103690879]
module.cluster.module.shared.aws_iam_role_policy.cluster_autoscaler: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy_attachment.etcds_cloudwatch_agent_policy: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165218551500000005]
module.cluster.module.shared.aws_iam_role_policy.node_group_specific: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.nodes-egress: Destroying... [id=sgrule-2909813764]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_here_custom_node_exporter_policy: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.dp_resource_controller_shortname: Destroying... [id=dp_resource_controller.phoenix-aws-cn-north-1:dp_resource_controller.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role_policy_attachment.etcds_cloudwatch_agent_policy: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_aws_ebs_csi_driver_policy: Destroying... [id=dp_cluster_aws_ebs_csi_driver.phoenix-aws-cn-north-1:aws-ebs-csi-driver]
module.cluster.module.shared.aws_iam_role_policy.dp_resource_controller_shortname: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-ingress-vpc-nat: Destroying... [id=sgrule-69812145]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_aws_ebs_csi_driver_policy: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.r53_controller[0]: Destroying... [id=r53_controller.phoenix-aws-cn-north-1.k8s.hereolp.cn:r53_controller.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-here[0]: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-admin-https: Destroying... [id=sgrule-1403450883]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-masters-https: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.r53_controller[0]: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-kubelet: Destroying... [id=sgrule-1782222064]
module.cluster.module.shared.aws_iam_role_policy.restricted_lambda: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.dummy-sg-ingress: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_awslimits_exporter_policy: Destroying... [id=dp_cluster_awslimits_exporter.phoenix-aws-cn-north-1:awslimits-exporter]
module.cluster.module.shared.aws_iam_role_policy.restricted_lambda: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-natgw-https[0]: Destroying... [id=sgrule-3183966749]
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_awslimits_exporter_policy: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-all-but-rfc1918: Destroying... [id=sgrule-2527211431]
module.cluster.module.shared.aws_security_group_rule.master-ssh: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.etcds[0]: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.etcds[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-ebs_metrics-attach: Destroying... [id=cloudwatch_exporter.phoenix-aws-cn-north-1-20211222165228378200000009]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-ebs_metrics-attach: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.etcds-to-etcds[0]: Destroying... [id=sgrule-690139451]
module.cluster.module.shared.aws_security_group_rule.nodes-egress: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.calico-ipip-egress: Destroying... [id=sgrule-4161032268]
module.cluster.module.shared.aws_security_group_rule.dummy-sg-egress: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-nlb-egress-rfc1918: Destroying... [id=sgrule-1401739965]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-ingress-vpc-nat: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy_attachment.masters_cloudwatch_agent_policy: Destroying... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn-20211222165209472300000003]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-admin-https: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_cloudwatch_policy: Destroying... [id=dp_cluster_cloudwatch.phoenix-aws-cn-north-1:grafana]
module.cluster.module.shared.aws_security_group_rule.calico-ipip: Destruction complete after 1s
module.cluster.module.shared.aws_iam_instance_profile.restricted: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.etcds-ssh[0]: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-masters-public-restricted[0]: Destroying... [id=sgrule-1388523125]
module.cluster.module.shared.aws_iam_role_policy_attachment.masters_cloudwatch_agent_policy: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.dp_cluster_cloudwatch_policy: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.nodes-ssh: Destroying... [id=sgrule-86952200]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_instance_profile.restricted: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.master-to-restricted-rfc1918-nodes: Destroying... [id=sgrule-871490488]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-all-but-rfc1918: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-kubelet: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.restricted_kms[0]: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_s3_bucket.logging[0]: Destroying... [id=fluentd.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.restricted_kms[0]: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.shared-elb-egress: Destroying... [id=sgrule-3820660822]
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-natgw-https[0]: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.calico-ipip-egress: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.shared-elb-ingress: Destroying... [id=sgrule-15297853]
module.nodes_instance-storage-scale-test.aws_autoscaling_group.nodes[0]: Destroying... [id=0.instance-storage-scale-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.etcds-to-etcds[0]: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-customer[0]: Destroying... [id=sgrule-1521887495]
module.cluster.module.shared.aws_security_group_rule.restricted-nlb-egress-rfc1918: Destruction complete after 0s
module.cluster.module.shared.aws_s3_bucket.logging[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.nodes_kms[0]: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.etcds_s3[0]: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:s3.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.etcds_s3[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.nodes_kms[0]: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.etcd-egress[0]: Destroying... [id=sgrule-852721119]
module.cluster.module.shared.aws_security_group_rule.master-egress: Destroying... [id=sgrule-3139827215]
module.cluster.module.shared.aws_security_group_rule.master-to-restricted-rfc1918-nodes: Destruction complete after 0s
module.nodes_instance-storage-scale-test.aws_autoscaling_group.nodes[1]: Destroying... [id=1.instance-storage-scale-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.shared-elb-egress: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.hostports_16xx: Destroying... [id=sgrule-3832749890]
module.cluster.module.shared.aws_security_group_rule.etcd-egress[0]: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-ssh: Destroying... [id=sgrule-778270723]
module.cluster.module.shared.aws_security_group_rule.nodes-ssh: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.masters_lambda: Destroying... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.master-egress: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.masters_lambda: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.apilb-ingress-masters-public-restricted[0]: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-customer[0]: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role_policy.masters_kms[0]: Destroying... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn:kms.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-controller-manager: Destroying... [id=sgrule-3888397713]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-53-udp: Destroying... [id=sgrule-1090201050]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-lb_metrics-attach: Destroying... [id=cloudwatch_exporter.phoenix-aws-cn-north-1-20211222165228303900000007]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-lb_metrics-attach: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.masters_kms[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.etcds_lambda: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-scheduler: Destroying... [id=sgrule-659052818]
module.cluster.module.shared.aws_security_group_rule.shared-elb-ingress: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-magic-subnet: Destroying... [id=sgrule-241855020]
module.cluster.module.shared.aws_iam_role_policy.etcds_lambda: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.master-to-nodes: Destroying... [id=sgrule-414995123]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-ssh: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-egress[0]: Destroying... [id=sgrule-3391240074]
module.cluster.module.shared.aws_security_group_rule.hostports_16xx: Destruction complete after 1s
module.cluster.module.bastion.aws_route53_record.bastion-alias[0]: Destroying... [id=Z0889688C2MG68R7E8MA_bastion_A]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-controller-manager: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-cloudwatch_readonly-attach: Destroying... [id=cloudwatch_exporter.phoenix-aws-cn-north-1-20211222165228343800000008]
module.cluster.module.shared.aws_iam_role_policy_attachment.cloudwatch_exporter-cloudwatch_readonly-attach: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.nodes: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.nodes: Destruction complete after 0s
module.nodes_default.aws_autoscaling_group.nodes[1]: Destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.master-to-nodes: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.calico-bird: Destroying... [id=sgrule-3406515621]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-53-udp: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.nodes-elb-tcp: Destroying... [id=sgrule-2290762303]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-egress[0]: Destruction complete after 0s
module.cluster.module.shared.aws_route53_record.public-api-cname[0]: Destroying... [id=Z0889688C2MG68R7E8MA_api_CNAME]
module.cluster.module.shared.aws_security_group_rule.nodes-to-masters-scheduler: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-https: Destroying... [id=sgrule-3555382131]
module.cluster.module.shared.aws_security_group_rule.nodes-elb-tcp: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-magic-subnet: Destruction complete after 1s
module.nodes_default.aws_autoscaling_group.nodes[0]: Destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group_rule.calico-bird: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-natgw[0]: Destroying... [id=sgrule-4027432780]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-customer-ingress-natgw[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role_policy.nodes_lambda: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn:lambda.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role_policy.nodes_lambda: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.calico-typha-egress: Destroying... [id=sgrule-376544681]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-egress-port-https: Destruction complete after 1s
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-nodes-felix-to-master-typha: Destroying... [id=sgrule-418690945]
module.cluster.module.shared.aws_security_group_rule.calico-typha-egress: Destruction complete after 0s
module.cluster.module.shared.aws_security_group_rule.restricted-elb-ingress-here[0]: Destroying... [id=sgrule-2526748608]
module.cluster.module.shared.aws_security_group_rule.restricted-rfc1918-nodes-felix-to-master-typha: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.testrole: Destroying... [id=testrole.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.testrole: Destruction complete after 0s
module.cluster.module.shared.aws_sqs_queue.logging[0]: Destroying... [id=https://sqs.cn-north-1.amazonaws.com.cn/897775818260/logging-phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_security_group_rule.restricted-elb-ingress-here[0]: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role.logging[0]: Destroying... [id=logging.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.logging[0]: Destruction complete after 0s
module.cluster.module.master.aws_autoscaling_group.master[0]: Destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_sqs_queue.logging[0]: Destruction complete after 1s
module.cluster.module.master.aws_autoscaling_group.master[2]: Destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-scale-test.aws_autoscaling_group.nodes[0]: Destruction complete after 4s
module.cluster.module.master.aws_autoscaling_group.master[1]: Destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-scale-test.aws_autoscaling_group.nodes[1]: Destruction complete after 4s
module.cluster.module.shared.aws_iam_role.cluster_autoscaler: Destroying... [id=cluster_autoscaler.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.cluster_autoscaler: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role.dp_cluster_here_custom_node_exporter: Destroying... [id=dp_here_custom_node_exporter.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_cluster_here_custom_node_exporter: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.dp_resource_controller_shortname: Destroying... [id=dp_resource_controller.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_resource_controller_shortname: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.dp_cluster_aws_ebs_csi_driver: Destroying... [id=dp_cluster_aws_ebs_csi_driver.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_cluster_aws_ebs_csi_driver: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.r53_controller: Destroying... [id=r53_controller.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.r53_controller: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.dp_cluster_awslimits_exporter: Destroying... [id=dp_cluster_awslimits_exporter.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_cluster_awslimits_exporter: Destruction complete after 0s
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.bastion.aws_route53_record.bastion-alias[0]: Still destroying... [id=Z0889688C2MG68R7E8MA_bastion_A, 10s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.shared.aws_route53_record.public-api-cname[0]: Still destroying... [id=Z0889688C2MG68R7E8MA_api_CNAME, 10s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.shared.aws_route53_record.public-api-cname[0]: Destruction complete after 18s
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.bastion.aws_route53_record.bastion-alias[0]: Still destroying... [id=Z0889688C2MG68R7E8MA_bastion_A, 20s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.bastion.aws_route53_record.bastion-alias[0]: Destruction complete after 22s
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Still destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Still destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 10s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Still destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Still destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 20s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Still destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Still destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 30s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Still destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[0]: Destruction complete after 1m1s
module.cluster.module.shared.aws_iam_policy.cloudwatch_exporter_policy: Destroying... [id=arn:aws-cn:iam::897775818260:policy/EBS-Volumes.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_policy.cloudwatch_exporter_policy: Destruction complete after 0s
module.cluster.module.shared.aws_security_group.dummy-sg: Destroying... [id=sg-0520ae1a3ead8e507]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.cluster.module.shared.aws_security_group.dummy-sg: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.dp_cluster_cloudwatch: Destroying... [id=dp_cluster_cloudwatch.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_role.dp_cluster_cloudwatch: Destruction complete after 0s
module.cluster.module.shared.aws_iam_policy.cloudwatch_exporter_lb_policy: Destroying... [id=arn:aws-cn:iam::897775818260:policy/Loadbalancer.phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_policy.cloudwatch_exporter_lb_policy: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.cloudwatch_exporter_role: Destroying... [id=cloudwatch_exporter.phoenix-aws-cn-north-1]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.cluster.module.shared.aws_iam_role.cloudwatch_exporter_role: Destruction complete after 1s
module.cluster.module.shared.aws_security_group.restricted-elb-customer[0]: Destroying... [id=sg-04efdc4ab7987cc64]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.cluster.module.shared.aws_security_group.restricted-elb-customer[0]: Destruction complete after 0s
module.cluster.module.shared.aws_security_group.restricted-rfc1918: Destroying... [id=sg-0249d386216513e3e]
module.cluster.module.shared.aws_security_group.restricted-rfc1918: Destruction complete after 0s
module.cluster.module.shared.aws_security_group.restricted-elb: Destroying... [id=sg-0c1e7afa45a9cf4df]
module.cluster.module.shared.aws_security_group.restricted-elb: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role.restricted: Destroying... [id=restricted.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.restricted: Destruction complete after 0s
module.nodes_instance-storage-scale-test.aws_launch_template.nodes: Destroying... [id=lt-023b1f2379bbec459]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.nodes_instance-storage-scale-test.aws_launch_template.nodes: Destruction complete after 0s
module.nodes_instance-storage-scale-test.aws_launch_template.nodes-local-ephemeral: Destroying... [id=lt-0d2f2a1fa95a3a804]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.nodes_instance-storage-scale-test.aws_launch_template.nodes-local-ephemeral: Destruction complete after 0s
module.cluster.module.bastion.aws_eip.bastion[0]: Destroying... [id=eipalloc-07172068f49b54f80]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Still destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 40s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.cluster.module.bastion.aws_eip.bastion[0]: Destruction complete after 1s
module.cluster.module.bastion.aws_instance.bastion[0]: Destroying... [id=i-02eff4703a66a2890]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Still destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Still destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 50s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.cluster.module.bastion.aws_instance.bastion[0]: Still destroying... [id=i-02eff4703a66a2890, 10s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m10s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Still destroying... [id=c.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[0]: Still destroying... [id=0.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[2]: Destruction complete after 1m3s
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Still destroying... [id=a.cn-north-1a.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m0s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.cluster.module.bastion.aws_instance.bastion[0]: Still destroying... [id=i-02eff4703a66a2890, 20s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m20s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[0]: Destruction complete after 1m3s
module.nodes_default.aws_autoscaling_group.nodes[0]: Destruction complete after 1m25s
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m30s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m30s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m30s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Still destroying... [id=c.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m30s elapsed]
module.cluster.module.bastion.aws_instance.bastion[0]: Destruction complete after 30s
module.cluster.module.bastion.aws_security_group.bastion[0]: Destroying... [id=sg-049f1decbc26c2b60]
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m30s elapsed]
module.cluster.module.bastion.aws_security_group.bastion[0]: Destruction complete after 0s
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m30s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[2]: Destruction complete after 1m35s
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m40s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.instance-storage-test.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m40s elapsed]
module.nodes_instance-storage-test.aws_autoscaling_group.nodes[1]: Destruction complete after 1m41s
module.nodes_instance-storage-test.aws_launch_template.nodes: Destroying... [id=lt-0320c7e50daa09a10]
module.nodes_instance-storage-test.aws_launch_template.nodes-local-ephemeral: Destroying... [id=lt-0a416263fb2d71727]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m40s elapsed]
module.nodes_instance-storage-test.aws_launch_template.nodes: Destruction complete after 0s
module.nodes_instance-storage-test.aws_launch_template.nodes-local-ephemeral: Destruction complete after 0s
module.cluster.module.master.aws_autoscaling_group.master[1]: Still destroying... [id=b.cn-north-1b.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m40s elapsed]
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Still destroying... [id=b.cn-north-1b.etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m40s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[1]: Destruction complete after 1m46s
module.cluster.module.etcd.aws_autoscaling_group.etcd[1]: Destruction complete after 1m46s
module.cluster.module.etcd.aws_launch_template.etcd[0]: Destroying... [id=lt-0561c3c489e21de92]
module.cluster.module.etcd.aws_launch_template.etcd[1]: Destroying... [id=lt-0c0e70595a562ec8d]
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[1]: Destroying... [id=lt-0574a677e564c4fdd]
module.cluster.module.etcd.aws_launch_template.etcd[2]: Destroying... [id=lt-0992d0c65aa21f49c]
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[2]: Destroying... [id=lt-0c1e02d0b4f42fdc5]
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[0]: Destroying... [id=lt-0ff004bca5f8ecae0]
module.cluster.module.etcd.aws_launch_template.etcd[0]: Destruction complete after 0s
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[1]: Destruction complete after 0s
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[2]: Destruction complete after 0s
module.cluster.module.etcd.aws_launch_template.etcd-local-ephemeral[0]: Destruction complete after 0s
module.cluster.module.etcd.aws_launch_template.etcd[1]: Destruction complete after 0s
module.cluster.module.etcd.aws_launch_template.etcd[2]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_instance_profile.etcds[0]: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group.etcds[0]: Destroying... [id=sg-011a6b6d6200b1a45]
module.cluster.module.shared.aws_iam_instance_profile.etcds[0]: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.etcds[0]: Destroying... [id=etcds.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_iam_role.etcds[0]: Destruction complete after 0s
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m50s elapsed]
module.cluster.module.shared.aws_security_group.etcds[0]: Destruction complete after 0s
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 1m50s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m0s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Still destroying... [id=a.cn-north-1a.masters.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m0s elapsed]
module.cluster.module.master.aws_autoscaling_group.master[0]: Destruction complete after 2m4s
module.cluster.module.master.aws_launch_template.master[1]: Destroying... [id=lt-05db9e0bf65325164]
module.cluster.module.master.aws_launch_template.master[2]: Destroying... [id=lt-071f4f46c602b9d4c]
module.cluster.module.shared.aws_elb.api: Destroying... [id=tf-lb-20211222165226171500000006]
module.cluster.module.master.aws_launch_template.master[0]: Destroying... [id=lt-08f689b6397d9e6e6]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[1]: Destroying... [id=lt-07dc2a379a47a34fb]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[0]: Destroying... [id=lt-09bc7169cf6d4eb59]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[2]: Destroying... [id=lt-068ac5edf706eab51]
module.cluster.module.master.aws_launch_template.master-local-ephemeral[0]: Destruction complete after 0s
module.cluster.module.master.aws_launch_template.master[2]: Destruction complete after 0s
module.cluster.module.master.aws_launch_template.master-local-ephemeral[1]: Destruction complete after 0s
module.cluster.module.master.aws_launch_template.master[1]: Destruction complete after 0s
module.cluster.module.master.aws_launch_template.master-local-ephemeral[2]: Destruction complete after 0s
module.cluster.module.master.aws_launch_template.master[0]: Destruction complete after 0s
module.cluster.module.shared.aws_ebs_volume.etcd-events[0]: Destroying... [id=vol-0bcaad47e8b9fe401]
module.cluster.module.shared.aws_security_group.shared-elb: Destroying... [id=sg-01cb94329dc5ba812]
module.cluster.module.shared.aws_ebs_volume.etcd[1]: Destroying... [id=vol-00fadf5a80dbc0f77]
module.cluster.module.shared.aws_ebs_volume.etcd-events[2]: Destroying... [id=vol-0877c1c63cb8b70a6]
module.cluster.module.shared.aws_ebs_volume.etcd-events[1]: Destroying... [id=vol-0f943b8367c7bf934]
module.cluster.module.shared.aws_ebs_volume.etcd[0]: Destroying... [id=vol-092b93e073a81bbe0]
module.cluster.module.shared.aws_iam_instance_profile.masters: Destroying... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group.masters: Destroying... [id=sg-087f53a29b4961c0c]
module.cluster.module.shared.aws_iam_instance_profile.masters: Destruction complete after 0s
module.cluster.module.shared.aws_ebs_volume.etcd[2]: Destroying... [id=vol-0d29440ed35f65e1c]
module.cluster.module.shared.aws_security_group.masters: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.masters: Destroying... [id=masters.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group.shared-elb: Destruction complete after 0s
module.cluster.module.shared.aws_iam_role.masters: Destruction complete after 0s
module.cluster.module.shared.aws_elb.api: Destruction complete after 1s
module.cluster.module.shared.aws_security_group.apilb: Destroying... [id=sg-061992f7cba3364d6]
module.cluster.module.shared.aws_ebs_volume.etcd-events[1]: Destruction complete after 1s
module.cluster.module.shared.aws_ebs_volume.etcd-events[0]: Destruction complete after 1s
module.cluster.module.shared.aws_ebs_volume.etcd[0]: Destruction complete after 1s
module.cluster.module.shared.aws_ebs_volume.etcd[1]: Destruction complete after 1s
module.cluster.module.shared.aws_ebs_volume.etcd-events[2]: Destruction complete after 1s
module.cluster.module.shared.aws_ebs_volume.etcd[2]: Destruction complete after 1s
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m10s elapsed]
module.cluster.module.shared.aws_security_group.apilb: Still destroying... [id=sg-061992f7cba3364d6, 10s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m20s elapsed]
module.cluster.module.shared.aws_security_group.apilb: Still destroying... [id=sg-061992f7cba3364d6, 20s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m30s elapsed]
module.cluster.module.shared.aws_security_group.apilb: Destruction complete after 27s
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m40s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Still destroying... [id=1.default.nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn, 2m50s elapsed]
module.nodes_default.aws_autoscaling_group.nodes[1]: Destruction complete after 2m54s
module.nodes_default.aws_launch_template.nodes-local-ephemeral: Destroying... [id=lt-01a3e4ac794198817]
module.nodes_default.aws_launch_template.nodes: Destroying... [id=lt-0e6d1e5f2cf9963d8]
module.nodes_default.aws_launch_template.nodes: Destruction complete after 0s
module.nodes_default.aws_launch_template.nodes-local-ephemeral: Destruction complete after 0s
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Destroying... [id=Z02456591M16DHVMZ3XXX]
module.cluster.module.shared.aws_security_group.calico: Destroying... [id=sg-06d776e45d262de4b]
aws_key_pair.ec2_public_key: Destroying... [id=phoenix-aws-cn-north-1]
module.cluster.module.shared.aws_iam_instance_profile.nodes: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group.nodes: Destroying... [id=sg-089482d790d0b8898]
aws_key_pair.ec2_public_key: Destruction complete after 1s
module.cluster.module.shared.aws_iam_instance_profile.nodes: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role.nodes: Destroying... [id=nodes.phoenix-aws-cn-north-1.k8s.hereolp.cn]
module.cluster.module.shared.aws_security_group.nodes: Destruction complete after 1s
module.cluster.module.shared.aws_security_group.calico: Destruction complete after 1s
module.cluster.module.shared.aws_iam_role.nodes: Destruction complete after 0s
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 10s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 20s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 30s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 40s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 50s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 1m0s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 1m10s elapsed]
module.cluster.module.shared.aws_route53_zone.k8s_local[0]: Still destroying... [id=Z02456591M16DHVMZ3XXX, 1m20s elapsed]
Terraform 0.11 and earlier required all non-constant expressions to be
provided via interpolation syntax, but this pattern is now deprecated. To
silence this warning, remove the "${ sequence from the start and the }"
sequence from the end of this expression, leaving just the inner expression.
Template interpolation syntax is still used to construct strings from
expressions when the template includes multiple interpolation sequences or a
mixture of literal strings and interpolations. This deprecation applies only
to templates that consist entirely of a single interpolation sequence.
(and one more similar warning elsewhere)
Error: error while force deleting Route53 Hosted Zone (Z02456591M16DHVMZ3XXX), disabling DNSSEC: could not get DNS SEC status for hosted zone (Z02456591M16DHVMZ3XXX): AccessDenied: The operation GetDNSSEC is not available for the current AWS account 897775818260.
status code: 403, request id: 893b9ef3-0049-4e06-93d2-a858dbafd17e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment