improve cost efficiency around staging clusters #143

enekofb · 2023-10-10T08:35:21Z

We spend around 850 USD on staging kube clusters

This ticket to review and apply actions we could take to reduce costs.

enekofb · 2023-10-10T08:54:53Z

i guess that some very basic approach based on the factors in the picture:

Reduce kubernetes engine costs by:

delete unused clusters
merge used clusters

Reduce compute engine costs by:

downsize used clusters
schedule active hours for compute

Networking:

identify paid networking flows
move them to free of charge or
delete the ones that we dont need

enekofb · 2023-10-13T08:47:50Z

Suggested actions:

Around pipeline leaf clusters:

merge them into one
delete unused clusters: leaf-02
downsize it to the smallest possible

Suggested future actions: move them to vclusters

enekofb · 2023-10-13T16:04:58Z

had to apply this to allow communication between control plane and capi open-telemetry/opentelemetry-operator#1009


resource "google_compute_firewall" "shadow_allow_master" {
  count = var.add_shadow_firewall_rules ? 1 : 0

  name        = "gke-shadow-${substr(var.name, 0, min(25, length(var.name)))}-master"
  description = "Managed by terraform GKE module: A shadow firewall rule to match the default rule allowing worker nodes communication."
  project     = local.network_project_id
  network     = var.network
  priority    = var.shadow_firewall_rules_priority
  direction   = "INGRESS"

  source_ranges = [local.cluster_endpoint_for_nodes]
  target_tags   = [local.cluster_network_tag]

  allow {
    protocol = "tcp"
    ports    = ["10250", "443", "9443"]
  }

  log_config {
    metadata = "INCLUDE_ALL_METADATA"
  }
}

enekofb · 2023-10-13T17:33:21Z

Created leaf clusters in vcluster

enekofb · 2023-10-13T17:53:20Z

we have pipelines created using vcluster leaf-cluster

enekofb · 2023-10-13T18:08:06Z

leaf clusters

stopped nodes -> see whether there is any scream

Monday to delete them

flip pipelines to use clusters

#148

enekofb · 2023-10-13T18:08:56Z

gke-europe-west1

➜  kubectl top node                                                                                                                                                                                                                                                                  NAME                                                  CPU(cores)   CPU%   MEMORY(bytes)   MEMORY%
gke-europe-west1-gke-europe-west1-gke-0e0b70ce-5742   90m          9%     919Mi           32%
gke-europe-west1-gke-europe-west1-gke-0e0b70ce-ax0y   141m         15%    1087Mi          38%
gke-europe-west1-gke-europe-west1-gke-0e0b70ce-ctcc   83m          8%     1072Mi          38%
gke-europe-west1-gke-europe-west1-gke-0e0b70ce-pv49   105m         11%    1073Mi          38%
gke-europe-west1-gke-europe-west1-gke-0e0b70ce-t5wy   90m          9%     984Mi           35%

5 nodes for running weave gitops tried to reduce to 2 but then went pods not being scheduled .... to look monday

enekofb · 2023-10-16T08:14:59Z

PR https://github.com/weaveworks/weave-gitops-clusters/pull/149/files#diff-20743b60707c0200cea4235621f58f9d83bfa95f9a7edb1b6ef2722f417baa70

destroy leaf-02 output

➜  gke-cluster git:(delete-leaf-clusters) ✗ make ENV=leaf-02 tf-destroy                                                                                                          <aws:sts>
terraform destroy -var-file=vars/leaf-02.tfvars
module.gke.random_string.cluster_service_account_suffix: Refreshing state... [id=o28r]
module.gke.data.google_container_engine_versions.region: Reading...
google_service_account.enterprise-capi: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com]
data.google_dns_managed_zone.wego-gke: Reading...
module.gke.data.google_compute_zones.available: Reading...
module.gcp-network.module.vpc.google_compute_network.network: Refreshing state... [id=projects/weave-gitops-clusters/global/networks/leaf-02-gke]
module.gke.google_service_account.cluster_service_account[0]: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]
google_service_account.external-dns: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/[email protected]]
google_service_account.image-reflector-controller: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.data.google_container_engine_versions.region: Read complete after 0s [id=2023-10-16 08:12:45.392958 +0000 UTC]
data.google_dns_managed_zone.wego-gke: Read complete after 0s [id=projects/weave-gitops-clusters/managedZones/weave-gitops-clusters]
google_dns_managed_zone.delegated: Refreshing state... [id=projects/weave-gitops-clusters/managedZones/leaf-02-gke]
module.cloud_router_nat.google_compute_router.router: Refreshing state... [id=projects/weave-gitops-clusters/regions/europe-west1/routers/leaf-02-gke]
module.gcp-network.module.subnets.google_compute_subnetwork.subnetwork["europe-west1/leaf-02-gke"]: Refreshing state... [id=projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-02-gke]
google_compute_firewall.istio: Refreshing state... [id=projects/weave-gitops-clusters/global/firewalls/gke-leaf-02-gke-istio]
module.gke.data.google_compute_zones.available: Read complete after 1s [id=projects/weave-gitops-clusters/regions/europe-west1]
module.gke.data.google_container_engine_versions.zone: Reading...
module.gke.random_shuffle.available_zones: Refreshing state... [id=-]
module.cloud_router_nat.google_compute_router_nat.nats["leaf-02-gke"]: Refreshing state... [id=weave-gitops-clusters/europe-west1/leaf-02-gke/leaf-02-gke]
google_dns_record_set.delegated: Refreshing state... [id=projects/weave-gitops-clusters/managedZones/weave-gitops-clusters/rrsets/leaf-02.wego-gke.weave.works./NS]
google_project_iam_member.enterprise-capi-role: Refreshing state... [id=weave-gitops-clusters/roles/container.clusterViewer/serviceAccount:ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com]
google_service_account_key.enterprise-capi: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com/keys/9d71875af6f61a480a8f6dcbb895b1a4cc2c0284]
google_service_account_iam_member.external-dns-workload-identity-user: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/[email protected]/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[kube-system/external-dns]]
google_project_iam_member.external-dns-admin: Refreshing state... [id=weave-gitops-clusters/roles/dns.admin/serviceAccount:[email protected]]
module.gke.data.google_container_engine_versions.zone: Read complete after 0s [id=2023-10-16 08:12:45.783008 +0000 UTC]
module.gke.google_project_iam_member.cluster_service_account-log_writer[0]: Refreshing state... [id=weave-gitops-clusters/roles/logging.logWriter/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-artifact-registry["weave-gitops-clusters"]: Refreshing state... [id=weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-gcr["weave-gitops-clusters"]: Refreshing state... [id=weave-gitops-clusters/roles/storage.objectViewer/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]
google_project_iam_member.image-reflector-controller-artifact-registry: Refreshing state... [id=weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com]
google_service_account_iam_member.image-reflector-controller-workload-identity-user: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[flux-system/image-reflector-controller]]
local_file.enterprise-capi-creds: Refreshing state... [id=b7582712cad73f7c29d7065c4d97a6852044a8d0]
module.gke.google_container_cluster.primary: Refreshing state... [id=projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-02-gke]
module.gke.google_container_node_pool.pools["leaf-02-gke-pool"]: Refreshing state... [id=projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-02-gke/nodePools/leaf-02-gke-pool]
module.gke.google_project_iam_member.cluster_service_account-metric_writer[0]: Refreshing state... [id=weave-gitops-clusters/roles/monitoring.metricWriter/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-monitoring_viewer[0]: Refreshing state... [id=weave-gitops-clusters/roles/monitoring.viewer/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0]: Refreshing state... [id=weave-gitops-clusters/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  - destroy

Terraform will perform the following actions:

  # google_compute_firewall.istio will be destroyed
  - resource "google_compute_firewall" "istio" {
      - creation_timestamp      = "2022-09-16T06:11:27.611-07:00" -> null
      - description             = "Allow Istio Pilot discovery validation webhook" -> null
      - destination_ranges      = [] -> null
      - direction               = "INGRESS" -> null
      - disabled                = false -> null
      - id                      = "projects/weave-gitops-clusters/global/firewalls/gke-leaf-02-gke-istio" -> null
      - name                    = "gke-leaf-02-gke-istio" -> null
      - network                 = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-02-gke" -> null
      - priority                = 1000 -> null
      - project                 = "weave-gitops-clusters" -> null
      - self_link               = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/firewalls/gke-leaf-02-gke-istio" -> null
      - source_ranges           = [
          - "10.3.0.0/28",
        ] -> null
      - source_service_accounts = [] -> null
      - source_tags             = [] -> null
      - target_service_accounts = [] -> null
      - target_tags             = [] -> null

      - allow {
          - ports    = [
              - "15017",
            ] -> null
          - protocol = "tcp" -> null
        }
    }

  # google_dns_managed_zone.delegated will be destroyed
  - resource "google_dns_managed_zone" "delegated" {
      - creation_time   = "2022-09-16T13:11:05.223Z" -> null
      - description     = "Delegated zone for the leaf-02-gke cluster. Managed by Terraform." -> null
      - dns_name        = "leaf-02.wego-gke.weave.works." -> null
      - force_destroy   = false -> null
      - id              = "projects/weave-gitops-clusters/managedZones/leaf-02-gke" -> null
      - labels          = {} -> null
      - managed_zone_id = 4746437555232268000 -> null
      - name            = "leaf-02-gke" -> null
      - name_servers    = [
          - "ns-cloud-b1.googledomains.com.",
          - "ns-cloud-b2.googledomains.com.",
          - "ns-cloud-b3.googledomains.com.",
          - "ns-cloud-b4.googledomains.com.",
        ] -> null
      - project         = "weave-gitops-clusters" -> null
      - visibility      = "public" -> null
    }

  # google_dns_record_set.delegated will be destroyed
  - resource "google_dns_record_set" "delegated" {
      - id           = "projects/weave-gitops-clusters/managedZones/weave-gitops-clusters/rrsets/leaf-02.wego-gke.weave.works./NS" -> null
      - managed_zone = "weave-gitops-clusters" -> null
      - name         = "leaf-02.wego-gke.weave.works." -> null
      - project      = "weave-gitops-clusters" -> null
      - rrdatas      = [
          - "ns-cloud-b1.googledomains.com.",
          - "ns-cloud-b2.googledomains.com.",
          - "ns-cloud-b3.googledomains.com.",
          - "ns-cloud-b4.googledomains.com.",
        ] -> null
      - ttl          = 300 -> null
      - type         = "NS" -> null
    }

  # google_project_iam_member.enterprise-capi-role will be destroyed
  - resource "google_project_iam_member" "enterprise-capi-role" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/container.clusterViewer/serviceAccount:ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/container.clusterViewer" -> null
    }

  # google_project_iam_member.external-dns-admin will be destroyed
  - resource "google_project_iam_member" "external-dns-admin" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/dns.admin/serviceAccount:[email protected]" -> null
      - member  = "serviceAccount:[email protected]" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/dns.admin" -> null
    }

  # google_project_iam_member.image-reflector-controller-artifact-registry will be destroyed
  - resource "google_project_iam_member" "image-reflector-controller-artifact-registry" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/artifactregistry.reader" -> null
    }

  # google_service_account.enterprise-capi will be destroyed
  - resource "google_service_account" "enterprise-capi" {
      - account_id   = "ent-capi-leaf-02-gke" -> null
      - disabled     = false -> null
      - display_name = "Used by enterprise for CAPI ops in leaf-02-gke. Managed by terraform." -> null
      - email        = "ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "102978405144336382334" -> null
    }

  # google_service_account.external-dns will be destroyed
  - resource "google_service_account" "external-dns" {
      - account_id   = "dns-leaf-02-gke" -> null
      - disabled     = false -> null
      - display_name = "External DNS controller in cluster leaf-02-gke. Managed by terraform." -> null
      - email        = "[email protected]" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/[email protected]" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/[email protected]" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "107066094269644697581" -> null
    }

  # google_service_account.image-reflector-controller will be destroyed
  - resource "google_service_account" "image-reflector-controller" {
      - account_id   = "image-rc-leaf-02-gke" -> null
      - disabled     = false -> null
      - display_name = "Image reflector controller in cluster leaf-02-gke. Managed by terraform." -> null
      - email        = "image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "102765718817109511911" -> null
    }

  # google_service_account_iam_member.external-dns-workload-identity-user will be destroyed
  - resource "google_service_account_iam_member" "external-dns-workload-identity-user" {
      - etag               = "BwXoyxhO74M=" -> null
      - id                 = "projects/weave-gitops-clusters/serviceAccounts/[email protected]/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[kube-system/external-dns]" -> null
      - member             = "serviceAccount:weave-gitops-clusters.svc.id.goog[kube-system/external-dns]" -> null
      - role               = "roles/iam.workloadIdentityUser" -> null
      - service_account_id = "projects/weave-gitops-clusters/serviceAccounts/[email protected]" -> null
    }

  # google_service_account_iam_member.image-reflector-controller-workload-identity-user will be destroyed
  - resource "google_service_account_iam_member" "image-reflector-controller-workload-identity-user" {
      - etag               = "BwXoyxhcqOM=" -> null
      - id                 = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[flux-system/image-reflector-controller]" -> null
      - member             = "serviceAccount:weave-gitops-clusters.svc.id.goog[flux-system/image-reflector-controller]" -> null
      - role               = "roles/iam.workloadIdentityUser" -> null
      - service_account_id = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
    }

  # google_service_account_key.enterprise-capi will be destroyed
  - resource "google_service_account_key" "enterprise-capi" {
      - id                 = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com/keys/9d71875af6f61a480a8f6dcbb895b1a4cc2c0284" -> null
      - key_algorithm      = "KEY_ALG_RSA_2048" -> null
      - name               = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com/keys/9d71875af6f61a480a8f6dcbb895b1a4cc2c0284" -> null
      - private_key        = (sensitive value) -> null
      - private_key_type   = "TYPE_GOOGLE_CREDENTIALS_FILE" -> null
      - public_key         = "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvRENDQWVTZ0F3SUJBZ0lJWW1tNm5GQllFTFV3RFFZSktvWklodmNOQVFFRkJRQXdJREVlTUJ3R0ExVUUKQXhNVk1UQXlPVGM0TkRBMU1UUTBNek0yTXpneU16TTBNQ0FYRFRJeU1Ea3hOakV6TVRFd05sb1lEems1T1RreApNak14TWpNMU9UVTVXakFnTVI0d0hBWURWUVFERXhVeE1ESTVOemcwTURVeE5EUXpNell6T0RJek16UXdnZ0VpCk1BMEdDU3FHU0liM0RRRUJBUVVBQTRJQkR3QXdnZ0VLQW9JQkFRQzdJSEd3N1IxSGRVWFdKZjdndFdONXR3YngKU0haSXpVYWpkeTRVZkE3QldsV0gwRnJFcWFZZHNMMjlGVGZSLzhIWUZwaDIzNG1TMldqWUhKZUZGZjZrck9GeQphbjgxZG8zZVZXSDRVaWtqU2FSMnNWVWQ3WlVCRDlNRjBEOVV4RzBvUFZzdVk3U3VSSTN5YUlUdUduUGtLNUJICjBycFJ4SnVCT3l3TEVqZlNZV0c0YTcvVXpvS2JWQm96em4wczVIY2RjOVdGNGh6WDBwYW5sUDdZSUpCaUlVUkYKQm50dGtzdnlyQVp1UmhXazFQd0tsekFGTDd6S1JkSkNRWDF6RSs0VysyWG5BVU1TTFY4Q2lER1pMVEpNZVFVZwpPVFkyZTYxT05kRWVTc1ZoVHJYQTR2d3hQZUZKOHNZcVFybFl6aXZub1IyNXlWdFpqc211aTZ0U2lTZjVBZ01CCkFBR2pPREEyTUF3R0ExVWRFd0VCL3dRQ01BQXdEZ1lEVlIwUEFRSC9CQVFEQWdlQU1CWUdBMVVkSlFFQi93UU0KTUFvR0NDc0dBUVVGQndNQ01BMEdDU3FHU0liM0RRRUJCUVVBQTRJQkFRQ2VYcmM5cnlxc0FLeUVGMW9aQm1hbwpJSXNzVDF2UXVGTmpDVXNUSGhJVHdJRzNNZWNJMGZySk05VnowbG91WDdQVStpcVBNdEZBUVc1NHdiRTl3bisrCjFDZ04zNGR6QzdhUnZXMVpXK2p1UGkzM1Y1Z29pS1BlalNUb0VWOFJVRnhrRWM1SG5POGFSZ2VjZUJLQThMM2oKYWltY3RnZnpYM1VoRldETU9vcGdGYVVOYnFqRXQ4SGtkbFFOelpKRjVJdWM3bXlMbGZneGlOQXJReUJBYXRRbApZNTNraldpdE8zTXpRSXdSVG9jUzJrS2RHNW1HTmp0VzJRN0tBbkR6SW4veFYzYWNhQ1NHSTk1VVdsb1JMellBCjM4SnJGWEhNVUpkUG5XSU5vbzZUK1VEdGxHc1ZianlUTEwyRGlsZEN0b2hkT3dacmhZVFdzYWphVVV5WGREaHkKLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=" -> null
      - public_key_type    = "TYPE_X509_PEM_FILE" -> null
      - service_account_id = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - valid_after        = "2022-09-16T13:11:06Z" -> null
      - valid_before       = "9999-12-31T23:59:59Z" -> null
    }

  # module.cloud_router_nat.google_compute_router.router will be destroyed
  - resource "google_compute_router" "router" {
      - creation_timestamp            = "2022-09-16T06:11:27.923-07:00" -> null
      - encrypted_interconnect_router = false -> null
      - id                            = "projects/weave-gitops-clusters/regions/europe-west1/routers/leaf-02-gke" -> null
      - name                          = "leaf-02-gke" -> null
      - network                       = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-02-gke" -> null
      - project                       = "weave-gitops-clusters" -> null
      - region                        = "europe-west1" -> null
      - self_link                     = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/regions/europe-west1/routers/leaf-02-gke" -> null
    }

  # module.cloud_router_nat.google_compute_router_nat.nats["leaf-02-gke"] will be destroyed
  - resource "google_compute_router_nat" "nats" {
      - drain_nat_ips                       = [] -> null
      - enable_dynamic_port_allocation      = false -> null
      - enable_endpoint_independent_mapping = true -> null
      - icmp_idle_timeout_sec               = 30 -> null
      - id                                  = "weave-gitops-clusters/europe-west1/leaf-02-gke/leaf-02-gke" -> null
      - max_ports_per_vm                    = 0 -> null
      - min_ports_per_vm                    = 0 -> null
      - name                                = "leaf-02-gke" -> null
      - nat_ip_allocate_option              = "AUTO_ONLY" -> null
      - nat_ips                             = [] -> null
      - project                             = "weave-gitops-clusters" -> null
      - region                              = "europe-west1" -> null
      - router                              = "leaf-02-gke" -> null
      - source_subnetwork_ip_ranges_to_nat  = "ALL_SUBNETWORKS_ALL_IP_RANGES" -> null
      - tcp_established_idle_timeout_sec    = 1200 -> null
      - tcp_transitory_idle_timeout_sec     = 30 -> null
      - udp_idle_timeout_sec                = 30 -> null

      - log_config {
          - enable = true -> null
          - filter = "ALL" -> null
        }
    }

  # module.gke.google_container_cluster.primary will be destroyed
  - resource "google_container_cluster" "primary" {
      - cluster_ipv4_cidr           = "10.1.0.0/16" -> null
      - default_max_pods_per_node   = 110 -> null
      - enable_autopilot            = false -> null
      - enable_binary_authorization = false -> null
      - enable_intranode_visibility = false -> null
      - enable_kubernetes_alpha     = false -> null
      - enable_legacy_abac          = false -> null
      - enable_shielded_nodes       = true -> null
      - enable_tpu                  = false -> null
      - endpoint                    = "34.76.27.156" -> null
      - id                          = "projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-02-gke" -> null
      - initial_node_count          = 0 -> null
      - label_fingerprint           = "a9dc16a7" -> null
      - location                    = "europe-west1-b" -> null
      - logging_service             = "logging.googleapis.com/kubernetes" -> null
      - master_version              = "1.27.4-gke.900" -> null
      - min_master_version          = "1.24.3-gke.2100" -> null
      - monitoring_service          = "monitoring.googleapis.com/kubernetes" -> null
      - name                        = "leaf-02-gke" -> null
      - network                     = "projects/weave-gitops-clusters/global/networks/leaf-02-gke" -> null
      - networking_mode             = "VPC_NATIVE" -> null
      - node_locations              = [] -> null
      - node_version                = "1.27.4-gke.900" -> null
      - project                     = "weave-gitops-clusters" -> null
      - remove_default_node_pool    = false -> null
      - resource_labels             = {} -> null
      - self_link                   = "https://container.googleapis.com/v1/projects/weave-gitops-clusters/zones/europe-west1-b/clusters/leaf-02-gke" -> null
      - services_ipv4_cidr          = "10.2.0.0/16" -> null
      - subnetwork                  = "projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-02-gke" -> null

      - addons_config {
          - dns_cache_config {
              - enabled = false -> null
            }
          - gce_persistent_disk_csi_driver_config {
              - enabled = true -> null
            }
          - gcp_filestore_csi_driver_config {
              - enabled = false -> null
            }
          - horizontal_pod_autoscaling {
              - disabled = false -> null
            }
          - http_load_balancing {
              - disabled = false -> null
            }
          - network_policy_config {
              - disabled = true -> null
            }
        }

      - binary_authorization {
          - enabled = false -> null
        }

      - cluster_autoscaling {
          - enabled = false -> null
        }

      - database_encryption {
          - state = "DECRYPTED" -> null
        }

      - default_snat_status {
          - disabled = false -> null
        }

      - ip_allocation_policy {
          - cluster_ipv4_cidr_block       = "10.1.0.0/16" -> null
          - cluster_secondary_range_name  = "ip-range-pods" -> null
          - services_ipv4_cidr_block      = "10.2.0.0/16" -> null
          - services_secondary_range_name = "ip-range-services" -> null
        }

      - logging_config {
          - enable_components = [
              - "SYSTEM_COMPONENTS",
              - "WORKLOADS",
            ] -> null
        }

      - maintenance_policy {
          - daily_maintenance_window {
              - duration   = "PT4H0M0S" -> null
              - start_time = "05:00" -> null
            }
        }

      - master_auth {
          - cluster_ca_certificate = "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUVMRENDQXBTZ0F3SUJBZ0lRRmlaWmcydE14R0VOOVowMlQxQ3lvREFOQmdrcWhraUc5dzBCQVFzRkFEQXYKTVMwd0t3WURWUVFERXlSak16WXhNbVJtTUMxbFpXWmpMVFJoTlRVdE9HSTJaUzFtTmpaak1EVXpZakExTldVdwpJQmNOTWpJd09URTJNVEl4TWpBd1doZ1BNakExTWpBNU1EZ3hNekV5TURCYU1DOHhMVEFyQmdOVkJBTVRKR016Ck5qRXlaR1l3TFdWbFptTXROR0UxTlMwNFlqWmxMV1kyTm1Nd05UTmlNRFUxWlRDQ0FhSXdEUVlKS29aSWh2Y04KQVFFQkJRQURnZ0dQQURDQ0FZb0NnZ0dCQU1sd01FNGpkeGtDVlFMckV1c1dpMDFiTU16d1FnWFNHYStOTjhRSApRQmdDZEpxd3Z6SllqQWdmSHpMNFRTU2RhTVFLcXVzeWlid1dVQTBIS2dUR01qVVl5V1QxemNMV0gwMncwMGxXCm8wa0gydy9VWHRBaXR1aXhtdmRVS2d2Z28rSU1sVE9WWlJSSm9uT1FnYjVqQXJkV3lNeTN6VmlJQzdVcjUyOEgKV201MUYyODIrQW5neWdFY2psN2ZYR1hRejJyOEFTaHZaYldEUUlUc2g4bWJ0R2thMTBMOGwydE9tMGIxNkRmZAp2eXJrZFpicnJ1WHdpRGk1RVZuNXFwWW9ZUlY4TEJEZ0VjbFZZdFlZVUd5alFNblVxUkMyM2N2NSszWTNCOG14CnV0ZHB1RGdMQVZMRHM3aG5NMWZwZWlHUmZLbi9tT1pxUElQTDA1SUtCeUxNdWZId3JwbmNEQyt6dVNlVEVqL1gKbW1IajJqaHRCYjIrOFhRc1NoMWdqYk03TGF5SFRieVFKRWpBQkVTbkFKYmxjZ0VyVE9yYjljWGhOVWR6OEdmawpmOEZhOGZZUEw1UVFoS3p2QzNHc2o0UTZGNzVQYmc5dlJvMkw2K3Vob3gwTTFlS0J6NFV5c2laOUk4RTdrek4vCmIyaGNkZmxjc09RcmVXZ0xFREx2Rlpudm13SURBUUFCbzBJd1FEQU9CZ05WSFE4QkFmOEVCQU1DQWdRd0R3WUQKVlIwVEFRSC9CQVV3QXdFQi96QWRCZ05WSFE0RUZnUVUxKzltRFZGc05ibnQxQWNvQkdUR1MvRGVxN3d3RFFZSgpLb1pJaHZjTkFRRUxCUUFEZ2dHQkFEV2VtZVprVUkySW1ud3I4M2UzZzBEYTI3R0RFYmpDd09BNE8vb0Jyemo4ClVxMjV5ckpRSEwyQU0wZzl3N3Mzem94ZlNVMTZQeHhMbTR1bUN3bi9YcVBCY2QxVUVZVVI2QmlRQ2dRbFY3WloKbUJMK2hScWFUMjUvQ0l6TERlNGxpbzBYc0dBYmh1UmkxUjJsYXJUYnRydGJYWTg1NzlSYVJndVUxbE5HVTdVaApYdkdYZXhCbkkxblduVUNoVTVjSHErRTJxa3ozaFRxckVIbTdKeWtMNkU3Q25Qc0Vha1RxSjZwYmFTVE16V1pHCktZSmJHQWtPanJpV1VlOFA1RW9rdmlVTGhISlZNcmtjSjhzWXUyYldXMU90Ui9JV3ZSUExkZm45UkF3NkRBVmwKY2Zmd0NGZmd5am9HMmZXYng5V04vK2haajBOZmJlVm5Jdk1RUExZNFpZd0dWUktGQk05T0tzSkRnQjhRb0sxSApncFdvU3BZVDVkQU5kZzZITmtrTWxEQlp6ZncwOFdvcWlkVnZlNHEraU9BTmdYVWo4S0hPNk8zS3BtbTdxd2NzCjRENThqUUc0SW1SdHNUWnQ1ZDZJTWc1bHRwTDlJdXhTUnlPc2JRSG1kMHZ0RkUweXYyejRRdllBN2lXZWtBbFkKbTB5dFR4TmlleXJJNE9QWXQxekhIQT09Ci0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K" -> null

          - client_certificate_config {
              - issue_client_certificate = false -> null
            }
        }

      - monitoring_config {
          - enable_components = [
              - "SYSTEM_COMPONENTS",
            ] -> null
        }

      - network_policy {
          - enabled  = false -> null
          - provider = "PROVIDER_UNSPECIFIED" -> null
        }

      - node_config {
          - disk_size_gb      = 100 -> null
          - disk_type         = "pd-balanced" -> null
          - guest_accelerator = [] -> null
          - image_type        = "COS_CONTAINERD" -> null
          - labels            = {} -> null
          - local_ssd_count   = 0 -> null
          - machine_type      = "e2-standard-2" -> null
          - metadata          = {
              - "disable-legacy-endpoints" = "true"
            } -> null
          - oauth_scopes      = [
              - "https://www.googleapis.com/auth/logging.write",
              - "https://www.googleapis.com/auth/monitoring",
            ] -> null
          - preemptible       = false -> null
          - service_account   = "tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
          - spot              = false -> null
          - tags              = [
              - "gke-leaf-02-gke",
              - "gke-leaf-02-gke-default-pool",
            ] -> null
          - taint             = [] -> null

          - shielded_instance_config {
              - enable_integrity_monitoring = true -> null
              - enable_secure_boot          = false -> null
            }

          - workload_metadata_config {
              - mode = "GKE_METADATA" -> null
            }
        }

      - node_pool {
          - initial_node_count          = 0 -> null
          - instance_group_urls         = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroupManagers/gke-leaf-02-gke-default-pool-22b3e19b-grp",
            ] -> null
          - managed_instance_group_urls = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroups/gke-leaf-02-gke-default-pool-22b3e19b-grp",
            ] -> null
          - max_pods_per_node           = 110 -> null
          - name                        = "default-pool" -> null
          - node_count                  = 0 -> null
          - node_locations              = [
              - "europe-west1-b",
            ] -> null
          - version                     = "1.27.4-gke.900" -> null

          - management {
              - auto_repair  = true -> null
              - auto_upgrade = true -> null
            }

          - node_config {
              - disk_size_gb      = 100 -> null
              - disk_type         = "pd-balanced" -> null
              - guest_accelerator = [] -> null
              - image_type        = "COS_CONTAINERD" -> null
              - labels            = {} -> null
              - local_ssd_count   = 0 -> null
              - machine_type      = "e2-standard-2" -> null
              - metadata          = {
                  - "disable-legacy-endpoints" = "true"
                } -> null
              - oauth_scopes      = [
                  - "https://www.googleapis.com/auth/logging.write",
                  - "https://www.googleapis.com/auth/monitoring",
                ] -> null
              - preemptible       = false -> null
              - service_account   = "tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
              - spot              = false -> null
              - tags              = [
                  - "gke-leaf-02-gke",
                  - "gke-leaf-02-gke-default-pool",
                ] -> null
              - taint             = [] -> null

              - shielded_instance_config {
                  - enable_integrity_monitoring = true -> null
                  - enable_secure_boot          = false -> null
                }

              - workload_metadata_config {
                  - mode = "GKE_METADATA" -> null
                }
            }

          - upgrade_settings {
              - max_surge       = 1 -> null
              - max_unavailable = 0 -> null
            }
        }
      - node_pool {
          - initial_node_count          = 0 -> null
          - instance_group_urls         = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroupManagers/gke-leaf-02-gke-leaf-02-gke-pool-8f22bc21-grp",
            ] -> null
          - managed_instance_group_urls = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroups/gke-leaf-02-gke-leaf-02-gke-pool-8f22bc21-grp",
            ] -> null
          - max_pods_per_node           = 110 -> null
          - name                        = "leaf-02-gke-pool" -> null
          - node_count                  = 0 -> null
          - node_locations              = [
              - "europe-west1-b",
            ] -> null
          - version                     = "1.27.4-gke.900" -> null

          - management {
              - auto_repair  = true -> null
              - auto_upgrade = false -> null
            }

          - node_config {
              - disk_size_gb      = 30 -> null
              - disk_type         = "pd-standard" -> null
              - guest_accelerator = [] -> null
              - image_type        = "COS_CONTAINERD" -> null
              - labels            = {
                  - "cluster_name" = "leaf-02-gke"
                  - "node_pool"    = "leaf-02-gke-pool"
                } -> null
              - local_ssd_count   = 0 -> null
              - machine_type      = "e2-standard-2" -> null
              - metadata          = {
                  - "cluster_name"             = "leaf-02-gke"
                  - "disable-legacy-endpoints" = "true"
                  - "node_pool"                = "leaf-02-gke-pool"
                } -> null
              - oauth_scopes      = [
                  - "https://www.googleapis.com/auth/cloud-platform",
                ] -> null
              - preemptible       = false -> null
              - service_account   = "tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
              - spot              = false -> null
              - tags              = [
                  - "gke-leaf-02-gke",
                  - "gke-leaf-02-gke-leaf-02-gke-pool",
                ] -> null
              - taint             = [] -> null

              - shielded_instance_config {
                  - enable_integrity_monitoring = true -> null
                  - enable_secure_boot          = false -> null
                }

              - workload_metadata_config {
                  - mode = "GKE_METADATA" -> null
                }
            }

          - upgrade_settings {
              - max_surge       = 1 -> null
              - max_unavailable = 0 -> null
            }
        }

      - notification_config {
          - pubsub {
              - enabled = false -> null
            }
        }

      - private_cluster_config {
          - enable_private_endpoint = false -> null
          - enable_private_nodes    = true -> null
          - master_ipv4_cidr_block  = "10.3.0.0/28" -> null
          - peering_name            = "gke-n97e539b03f7beae7e71-d8ad-0c7c-peer" -> null
          - private_endpoint        = "10.3.0.2" -> null
          - public_endpoint         = "34.76.27.156" -> null

          - master_global_access_config {
              - enabled = false -> null
            }
        }

      - release_channel {
          - channel = "UNSPECIFIED" -> null
        }

      - timeouts {
          - create = "45m" -> null
          - delete = "45m" -> null
          - update = "45m" -> null
        }

      - vertical_pod_autoscaling {
          - enabled = false -> null
        }

      - workload_identity_config {
          - workload_pool = "weave-gitops-clusters.svc.id.goog" -> null
        }
    }

  # module.gke.google_container_node_pool.pools["leaf-02-gke-pool"] will be destroyed
  - resource "google_container_node_pool" "pools" {
      - cluster                     = "leaf-02-gke" -> null
      - id                          = "projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-02-gke/nodePools/leaf-02-gke-pool" -> null
      - initial_node_count          = 0 -> null
      - instance_group_urls         = [
          - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroupManagers/gke-leaf-02-gke-leaf-02-gke-pool-8f22bc21-grp",
        ] -> null
      - location                    = "europe-west1-b" -> null
      - managed_instance_group_urls = [
          - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroups/gke-leaf-02-gke-leaf-02-gke-pool-8f22bc21-grp",
        ] -> null
      - max_pods_per_node           = 110 -> null
      - name                        = "leaf-02-gke-pool" -> null
      - node_count                  = 0 -> null
      - node_locations              = [
          - "europe-west1-b",
        ] -> null
      - project                     = "weave-gitops-clusters" -> null
      - version                     = "1.27.4-gke.900" -> null

      - management {
          - auto_repair  = true -> null
          - auto_upgrade = false -> null
        }

      - node_config {
          - disk_size_gb      = 30 -> null
          - disk_type         = "pd-standard" -> null
          - guest_accelerator = [] -> null
          - image_type        = "COS_CONTAINERD" -> null
          - labels            = {
              - "cluster_name" = "leaf-02-gke"
              - "node_pool"    = "leaf-02-gke-pool"
            } -> null
          - local_ssd_count   = 0 -> null
          - machine_type      = "e2-standard-2" -> null
          - metadata          = {
              - "cluster_name"             = "leaf-02-gke"
              - "disable-legacy-endpoints" = "true"
              - "node_pool"                = "leaf-02-gke-pool"
            } -> null
          - oauth_scopes      = [
              - "https://www.googleapis.com/auth/cloud-platform",
            ] -> null
          - preemptible       = false -> null
          - service_account   = "tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
          - spot              = false -> null
          - tags              = [
              - "gke-leaf-02-gke",
              - "gke-leaf-02-gke-leaf-02-gke-pool",
            ] -> null
          - taint             = [] -> null

          - shielded_instance_config {
              - enable_integrity_monitoring = true -> null
              - enable_secure_boot          = false -> null
            }

          - workload_metadata_config {
              - mode = "GKE_METADATA" -> null
            }
        }

      - timeouts {
          - create = "45m" -> null
          - delete = "45m" -> null
          - update = "45m" -> null
        }

      - upgrade_settings {
          - max_surge       = 1 -> null
          - max_unavailable = 0 -> null
        }
    }

  # module.gke.google_project_iam_member.cluster_service_account-artifact-registry["weave-gitops-clusters"] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-artifact-registry" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/artifactregistry.reader" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-gcr["weave-gitops-clusters"] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-gcr" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/storage.objectViewer/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/storage.objectViewer" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-log_writer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-log_writer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/logging.logWriter/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/logging.logWriter" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-metric_writer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-metric_writer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/monitoring.metricWriter/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/monitoring.metricWriter" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-monitoring_viewer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-monitoring_viewer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/monitoring.viewer/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/monitoring.viewer" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-resourceMetadata-writer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/stackdriver.resourceMetadata.writer" -> null
    }

  # module.gke.google_service_account.cluster_service_account[0] will be destroyed
  - resource "google_service_account" "cluster_service_account" {
      - account_id   = "tf-gke-leaf-02-gke-o28r" -> null
      - disabled     = false -> null
      - display_name = "Terraform-managed service account for cluster leaf-02-gke" -> null
      - email        = "tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/tf-gke-leaf-02-gke-o28r@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "100055255330924982950" -> null
    }

  # module.gke.random_shuffle.available_zones will be destroyed
  - resource "random_shuffle" "available_zones" {
      - id           = "-" -> null
      - input        = [
          - "europe-west1-b",
          - "europe-west1-c",
          - "europe-west1-d",
        ] -> null
      - result       = [
          - "europe-west1-d",
          - "europe-west1-c",
          - "europe-west1-b",
        ] -> null
      - result_count = 3 -> null
    }

  # module.gke.random_string.cluster_service_account_suffix will be destroyed
  - resource "random_string" "cluster_service_account_suffix" {
      - id          = "o28r" -> null
      - length      = 4 -> null
      - lower       = true -> null
      - min_lower   = 0 -> null
      - min_numeric = 0 -> null
      - min_special = 0 -> null
      - min_upper   = 0 -> null
      - number      = true -> null
      - numeric     = true -> null
      - result      = "o28r" -> null
      - special     = false -> null
      - upper       = false -> null
    }

  # module.gcp-network.module.subnets.google_compute_subnetwork.subnetwork["europe-west1/leaf-02-gke"] will be destroyed
  - resource "google_compute_subnetwork" "subnetwork" {
      - creation_timestamp         = "2022-09-16T06:11:28.413-07:00" -> null
      - gateway_address            = "10.0.0.1" -> null
      - id                         = "projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-02-gke" -> null
      - ip_cidr_range              = "10.0.0.0/16" -> null
      - name                       = "leaf-02-gke" -> null
      - network                    = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-02-gke" -> null
      - private_ip_google_access   = true -> null
      - private_ipv6_google_access = "DISABLE_GOOGLE_ACCESS" -> null
      - project                    = "weave-gitops-clusters" -> null
      - purpose                    = "PRIVATE" -> null
      - region                     = "europe-west1" -> null
      - secondary_ip_range         = [
          - {
              - ip_cidr_range = "10.1.0.0/16"
              - range_name    = "ip-range-pods"
            },
          - {
              - ip_cidr_range = "10.2.0.0/16"
              - range_name    = "ip-range-services"
            },
        ] -> null
      - self_link                  = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-02-gke" -> null
      - stack_type                 = "IPV4_ONLY" -> null
    }

  # module.gcp-network.module.vpc.google_compute_network.network will be destroyed
  - resource "google_compute_network" "network" {
      - auto_create_subnetworks         = false -> null
      - delete_default_routes_on_create = false -> null
      - enable_ula_internal_ipv6        = false -> null
      - id                              = "projects/weave-gitops-clusters/global/networks/leaf-02-gke" -> null
      - mtu                             = 0 -> null
      - name                            = "leaf-02-gke" -> null
      - project                         = "weave-gitops-clusters" -> null
      - routing_mode                    = "GLOBAL" -> null
      - self_link                       = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-02-gke" -> null
    }

Plan: 0 to add, 0 to change, 27 to destroy.

Changes to Outputs:
  - external-dns-sa-account-name               = "[email protected]" -> null
  - image-reflector-controller-sa-account-name = "image-rc-leaf-02-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null

enekofb · 2023-10-16T08:26:43Z

leaf-01 destroy output

➜  gke-cluster git:(delete-leaf-clusters) make ENV=leaf-01 tf-destroy                                                                                                            <aws:sts>
terraform workspace select leaf-01
Switched to workspace "leaf-01".
touch .terraform/leaf-01.env
terraform destroy -var-file=vars/leaf-01.tfvars
module.gke.random_string.cluster_service_account_suffix: Refreshing state... [id=8zun]
module.gke.data.google_container_engine_versions.region: Reading...
data.google_dns_managed_zone.wego-gke: Reading...
google_service_account.enterprise-capi: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.data.google_compute_zones.available: Reading...
google_service_account.external-dns: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/[email protected]]
google_service_account.image-reflector-controller: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_service_account.cluster_service_account[0]: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]
module.gcp-network.module.vpc.google_compute_network.network: Refreshing state... [id=projects/weave-gitops-clusters/global/networks/leaf-01-gke]
google_service_account_iam_member.external-dns-workload-identity-user: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/[email protected]/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[kube-system/external-dns]]
google_project_iam_member.external-dns-admin: Refreshing state... [id=weave-gitops-clusters/roles/dns.admin/serviceAccount:[email protected]]
module.gke.data.google_container_engine_versions.region: Read complete after 0s [id=2023-10-16 08:25:44.949293 +0000 UTC]
google_project_iam_member.enterprise-capi-role: Refreshing state... [id=weave-gitops-clusters/roles/container.clusterViewer/serviceAccount:ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com]
google_service_account_key.enterprise-capi: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com/keys/6d0659c63928f0ad499ab083833dc7a88edd18b2]
data.google_dns_managed_zone.wego-gke: Read complete after 0s [id=projects/weave-gitops-clusters/managedZones/weave-gitops-clusters]
google_dns_managed_zone.delegated: Refreshing state... [id=projects/weave-gitops-clusters/managedZones/leaf-01-gke]
module.gke.google_project_iam_member.cluster_service_account-log_writer[0]: Refreshing state... [id=weave-gitops-clusters/roles/logging.logWriter/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-artifact-registry["weave-gitops-clusters"]: Refreshing state... [id=weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-gcr["weave-gitops-clusters"]: Refreshing state... [id=weave-gitops-clusters/roles/storage.objectViewer/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]
google_project_iam_member.image-reflector-controller-artifact-registry: Refreshing state... [id=weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.data.google_compute_zones.available: Read complete after 0s [id=projects/weave-gitops-clusters/regions/europe-west1]
google_service_account_iam_member.image-reflector-controller-workload-identity-user: Refreshing state... [id=projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[flux-system/image-reflector-controller]]
module.gke.random_shuffle.available_zones: Refreshing state... [id=-]
module.gke.data.google_container_engine_versions.zone: Reading...
google_dns_record_set.delegated: Refreshing state... [id=projects/weave-gitops-clusters/managedZones/weave-gitops-clusters/rrsets/leaf-01.wego-gke.weave.works./NS]
module.gke.data.google_container_engine_versions.zone: Read complete after 0s [id=2023-10-16 08:25:45.320418 +0000 UTC]
google_compute_firewall.istio: Refreshing state... [id=projects/weave-gitops-clusters/global/firewalls/gke-leaf-01-gke-istio]
module.gcp-network.module.subnets.google_compute_subnetwork.subnetwork["europe-west1/leaf-01-gke"]: Refreshing state... [id=projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-01-gke]
local_file.enterprise-capi-creds: Refreshing state... [id=192e577a08802438b3a4ef7456c79c6d2e558947]
module.cloud_router_nat.google_compute_router.router: Refreshing state... [id=projects/weave-gitops-clusters/regions/europe-west1/routers/leaf-01-gke]
module.gke.google_container_cluster.primary: Refreshing state... [id=projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-01-gke]
module.cloud_router_nat.google_compute_router_nat.nats["leaf-01-gke"]: Refreshing state... [id=weave-gitops-clusters/europe-west1/leaf-01-gke/leaf-01-gke]
module.gke.google_container_node_pool.pools["leaf-01-gke-pool"]: Refreshing state... [id=projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-01-gke/nodePools/leaf-01-gke-pool]
module.gke.google_project_iam_member.cluster_service_account-metric_writer[0]: Refreshing state... [id=weave-gitops-clusters/roles/monitoring.metricWriter/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-monitoring_viewer[0]: Refreshing state... [id=weave-gitops-clusters/roles/monitoring.viewer/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]
module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0]: Refreshing state... [id=weave-gitops-clusters/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  - destroy

Terraform will perform the following actions:

  # google_compute_firewall.istio will be destroyed
  - resource "google_compute_firewall" "istio" {
      - creation_timestamp      = "2022-09-18T09:10:17.119-07:00" -> null
      - description             = "Allow Istio Pilot discovery validation webhook" -> null
      - destination_ranges      = [] -> null
      - direction               = "INGRESS" -> null
      - disabled                = false -> null
      - id                      = "projects/weave-gitops-clusters/global/firewalls/gke-leaf-01-gke-istio" -> null
      - name                    = "gke-leaf-01-gke-istio" -> null
      - network                 = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-01-gke" -> null
      - priority                = 1000 -> null
      - project                 = "weave-gitops-clusters" -> null
      - self_link               = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/firewalls/gke-leaf-01-gke-istio" -> null
      - source_ranges           = [
          - "10.3.0.0/28",
        ] -> null
      - source_service_accounts = [] -> null
      - source_tags             = [] -> null
      - target_service_accounts = [] -> null
      - target_tags             = [] -> null

      - allow {
          - ports    = [
              - "15017",
            ] -> null
          - protocol = "tcp" -> null
        }
    }

  # google_dns_managed_zone.delegated will be destroyed
  - resource "google_dns_managed_zone" "delegated" {
      - creation_time   = "2022-09-18T16:10:05.244Z" -> null
      - description     = "Delegated zone for the leaf-01-gke cluster. Managed by Terraform." -> null
      - dns_name        = "leaf-01.wego-gke.weave.works." -> null
      - force_destroy   = false -> null
      - id              = "projects/weave-gitops-clusters/managedZones/leaf-01-gke" -> null
      - labels          = {} -> null
      - managed_zone_id = 6081130878312608000 -> null
      - name            = "leaf-01-gke" -> null
      - name_servers    = [
          - "ns-cloud-b1.googledomains.com.",
          - "ns-cloud-b2.googledomains.com.",
          - "ns-cloud-b3.googledomains.com.",
          - "ns-cloud-b4.googledomains.com.",
        ] -> null
      - project         = "weave-gitops-clusters" -> null
      - visibility      = "public" -> null
    }

  # google_dns_record_set.delegated will be destroyed
  - resource "google_dns_record_set" "delegated" {
      - id           = "projects/weave-gitops-clusters/managedZones/weave-gitops-clusters/rrsets/leaf-01.wego-gke.weave.works./NS" -> null
      - managed_zone = "weave-gitops-clusters" -> null
      - name         = "leaf-01.wego-gke.weave.works." -> null
      - project      = "weave-gitops-clusters" -> null
      - rrdatas      = [
          - "ns-cloud-b1.googledomains.com.",
          - "ns-cloud-b2.googledomains.com.",
          - "ns-cloud-b3.googledomains.com.",
          - "ns-cloud-b4.googledomains.com.",
        ] -> null
      - ttl          = 300 -> null
      - type         = "NS" -> null
    }

  # google_project_iam_member.enterprise-capi-role will be destroyed
  - resource "google_project_iam_member" "enterprise-capi-role" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/container.clusterViewer/serviceAccount:ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/container.clusterViewer" -> null
    }

  # google_project_iam_member.external-dns-admin will be destroyed
  - resource "google_project_iam_member" "external-dns-admin" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/dns.admin/serviceAccount:[email protected]" -> null
      - member  = "serviceAccount:[email protected]" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/dns.admin" -> null
    }

  # google_project_iam_member.image-reflector-controller-artifact-registry will be destroyed
  - resource "google_project_iam_member" "image-reflector-controller-artifact-registry" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/artifactregistry.reader" -> null
    }

  # google_service_account.enterprise-capi will be destroyed
  - resource "google_service_account" "enterprise-capi" {
      - account_id   = "ent-capi-leaf-01-gke" -> null
      - disabled     = false -> null
      - display_name = "Used by enterprise for CAPI ops in leaf-01-gke. Managed by terraform." -> null
      - email        = "ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "108846389628708951471" -> null
    }

  # google_service_account.external-dns will be destroyed
  - resource "google_service_account" "external-dns" {
      - account_id   = "dns-leaf-01-gke" -> null
      - disabled     = false -> null
      - display_name = "External DNS controller in cluster leaf-01-gke. Managed by terraform." -> null
      - email        = "[email protected]" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/[email protected]" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/[email protected]" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "109425850652433850933" -> null
    }

  # google_service_account.image-reflector-controller will be destroyed
  - resource "google_service_account" "image-reflector-controller" {
      - account_id   = "image-rc-leaf-01-gke" -> null
      - disabled     = false -> null
      - display_name = "Image reflector controller in cluster leaf-01-gke. Managed by terraform." -> null
      - email        = "image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "115270539035228653444" -> null
    }

  # google_service_account_iam_member.external-dns-workload-identity-user will be destroyed
  - resource "google_service_account_iam_member" "external-dns-workload-identity-user" {
      - etag               = "BwXo9dQhmi4=" -> null
      - id                 = "projects/weave-gitops-clusters/serviceAccounts/[email protected]/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[kube-system/external-dns]" -> null
      - member             = "serviceAccount:weave-gitops-clusters.svc.id.goog[kube-system/external-dns]" -> null
      - role               = "roles/iam.workloadIdentityUser" -> null
      - service_account_id = "projects/weave-gitops-clusters/serviceAccounts/[email protected]" -> null
    }

  # google_service_account_iam_member.image-reflector-controller-workload-identity-user will be destroyed
  - resource "google_service_account_iam_member" "image-reflector-controller-workload-identity-user" {
      - etag               = "BwXo9dQhl7g=" -> null
      - id                 = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com/roles/iam.workloadIdentityUser/serviceAccount:weave-gitops-clusters.svc.id.goog[flux-system/image-reflector-controller]" -> null
      - member             = "serviceAccount:weave-gitops-clusters.svc.id.goog[flux-system/image-reflector-controller]" -> null
      - role               = "roles/iam.workloadIdentityUser" -> null
      - service_account_id = "projects/weave-gitops-clusters/serviceAccounts/image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
    }

  # google_service_account_key.enterprise-capi will be destroyed
  - resource "google_service_account_key" "enterprise-capi" {
      - id                 = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com/keys/6d0659c63928f0ad499ab083833dc7a88edd18b2" -> null
      - key_algorithm      = "KEY_ALG_RSA_2048" -> null
      - name               = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com/keys/6d0659c63928f0ad499ab083833dc7a88edd18b2" -> null
      - private_key        = (sensitive value) -> null
      - private_key_type   = "TYPE_GOOGLE_CREDENTIALS_FILE" -> null
      - public_key         = "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvRENDQWVTZ0F3SUJBZ0lJQk1FTTRxWjB2UXN3RFFZSktvWklodmNOQVFFRkJRQXdJREVlTUJ3R0ExVUUKQXhNVk1UQTRPRFEyTXpnNU5qSTROekE0T1RVeE5EY3hNQ0FYRFRJeU1Ea3hPREUyTVRBd05sb1lEems1T1RreApNak14TWpNMU9UVTVXakFnTVI0d0hBWURWUVFERXhVeE1EZzRORFl6T0RrMk1qZzNNRGc1TlRFME56RXdnZ0VpCk1BMEdDU3FHU0liM0RRRUJBUVVBQTRJQkR3QXdnZ0VLQW9JQkFRQzg4Z2xlb0h4aHo0VURDaWR4Y29UKy9VTnAKakMwTnlhS2ttWUp4OENUNEJGWEh0aXh0VUtoMUpXRGNwZExvWVFIcW5GbDBISXNjZmhacXhIb3IyczluL2lpSgpQR1BlaWgzRXNKOHlEblkwb3hOZ2pDWmxBSjh1b1BUeVprSGRKbkd2ZEZpeU5rZEZOdmhwSUhGQzNnUjlBMitOCng0MnhyUTdwcXc5TmhscEY1M3N3STFtNVpMYkFoRHFwSXNxZ2Jpb2kzT0dQMGdMVW0xVEpXRGZvYUdveS91T1AKbHE3ckRmdTdvbFZ3cnFOYjNDMUwrT0dYUTRPT3BIRmMzanFCWjFMS2RXRUtwampMNmFGQXp3NEpzRlZPTWVGdQpGR3B5eXV4alc5cDFxR1J6bFJ5dmFOMzBuTVIrdWxMb0s5aDZEaW9YYndiOXN0ZXBsWCtqNEprdG91bEhBZ01CCkFBR2pPREEyTUF3R0ExVWRFd0VCL3dRQ01BQXdEZ1lEVlIwUEFRSC9CQVFEQWdlQU1CWUdBMVVkSlFFQi93UU0KTUFvR0NDc0dBUVVGQndNQ01BMEdDU3FHU0liM0RRRUJCUVVBQTRJQkFRQ0k3SXI1ajlvVlJFOHdyRW0wOUNSNApwUmxYemxLdTR0M3dNdktYNDJyZEErbU4zbThlL0NLTVRYNE00elNXbVVWbGFKb0tFT2l1dGlmb3JyWXBwNzZ5Cmx4L1lVQjRORDVVanV5SUtvV1pBVmZOVVpYa2VNWUo5U0g2aHFFcmt1bDZJdU1PUWpJTUkrRTgwZ2NIRDZ0VVMKRkhoZk01Rzc1c0pKNng0M3ZydzlHRGxERUdSejdCcnNmNW9JWG5ybEI0NVBKT0ZURW8xYnJLdmV1MzIzcjZ2cQpWQjlLVHBzL1dleXdBOFRMRjJMNkRmdlNHNGs0UFRyb0Jhenl1WHFsVmFEWjdrVy9uN3ZoUzU4OXF6NVRmUTFRCm1DT3lRVXRLQXM5S1ptOTB6d3NNT3RPU0pmazZEZmtZNjE2NzNtcDR0N1ZVay9qV3AzSmp3NjU0RmRmWDlORXYKLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=" -> null
      - public_key_type    = "TYPE_X509_PEM_FILE" -> null
      - service_account_id = "projects/weave-gitops-clusters/serviceAccounts/ent-capi-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - valid_after        = "2022-09-18T16:10:06Z" -> null
      - valid_before       = "9999-12-31T23:59:59Z" -> null
    }

  # module.cloud_router_nat.google_compute_router.router will be destroyed
  - resource "google_compute_router" "router" {
      - creation_timestamp            = "2022-09-18T09:10:17.422-07:00" -> null
      - encrypted_interconnect_router = false -> null
      - id                            = "projects/weave-gitops-clusters/regions/europe-west1/routers/leaf-01-gke" -> null
      - name                          = "leaf-01-gke" -> null
      - network                       = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-01-gke" -> null
      - project                       = "weave-gitops-clusters" -> null
      - region                        = "europe-west1" -> null
      - self_link                     = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/regions/europe-west1/routers/leaf-01-gke" -> null
    }

  # module.cloud_router_nat.google_compute_router_nat.nats["leaf-01-gke"] will be destroyed
  - resource "google_compute_router_nat" "nats" {
      - drain_nat_ips                       = [] -> null
      - enable_dynamic_port_allocation      = false -> null
      - enable_endpoint_independent_mapping = true -> null
      - icmp_idle_timeout_sec               = 30 -> null
      - id                                  = "weave-gitops-clusters/europe-west1/leaf-01-gke/leaf-01-gke" -> null
      - max_ports_per_vm                    = 0 -> null
      - min_ports_per_vm                    = 0 -> null
      - name                                = "leaf-01-gke" -> null
      - nat_ip_allocate_option              = "AUTO_ONLY" -> null
      - nat_ips                             = [] -> null
      - project                             = "weave-gitops-clusters" -> null
      - region                              = "europe-west1" -> null
      - router                              = "leaf-01-gke" -> null
      - source_subnetwork_ip_ranges_to_nat  = "ALL_SUBNETWORKS_ALL_IP_RANGES" -> null
      - tcp_established_idle_timeout_sec    = 1200 -> null
      - tcp_transitory_idle_timeout_sec     = 30 -> null
      - udp_idle_timeout_sec                = 30 -> null

      - log_config {
          - enable = true -> null
          - filter = "ALL" -> null
        }
    }

  # module.gke.google_container_cluster.primary will be destroyed
  - resource "google_container_cluster" "primary" {
      - cluster_ipv4_cidr           = "10.1.0.0/16" -> null
      - default_max_pods_per_node   = 110 -> null
      - enable_autopilot            = false -> null
      - enable_binary_authorization = false -> null
      - enable_intranode_visibility = false -> null
      - enable_kubernetes_alpha     = false -> null
      - enable_legacy_abac          = false -> null
      - enable_shielded_nodes       = true -> null
      - enable_tpu                  = false -> null
      - endpoint                    = "34.78.151.94" -> null
      - id                          = "projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-01-gke" -> null
      - initial_node_count          = 0 -> null
      - label_fingerprint           = "a9dc16a7" -> null
      - location                    = "europe-west1-b" -> null
      - logging_service             = "logging.googleapis.com/kubernetes" -> null
      - master_version              = "1.27.4-gke.900" -> null
      - min_master_version          = "1.24.3-gke.2100" -> null
      - monitoring_service          = "monitoring.googleapis.com/kubernetes" -> null
      - name                        = "leaf-01-gke" -> null
      - network                     = "projects/weave-gitops-clusters/global/networks/leaf-01-gke" -> null
      - networking_mode             = "VPC_NATIVE" -> null
      - node_locations              = [] -> null
      - node_version                = "1.27.4-gke.900" -> null
      - project                     = "weave-gitops-clusters" -> null
      - remove_default_node_pool    = false -> null
      - resource_labels             = {} -> null
      - self_link                   = "https://container.googleapis.com/v1/projects/weave-gitops-clusters/zones/europe-west1-b/clusters/leaf-01-gke" -> null
      - services_ipv4_cidr          = "10.2.0.0/16" -> null
      - subnetwork                  = "projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-01-gke" -> null

      - addons_config {
          - dns_cache_config {
              - enabled = false -> null
            }
          - gce_persistent_disk_csi_driver_config {
              - enabled = true -> null
            }
          - gcp_filestore_csi_driver_config {
              - enabled = false -> null
            }
          - horizontal_pod_autoscaling {
              - disabled = false -> null
            }
          - http_load_balancing {
              - disabled = false -> null
            }
          - network_policy_config {
              - disabled = true -> null
            }
        }

      - binary_authorization {
          - enabled = false -> null
        }

      - cluster_autoscaling {
          - enabled = false -> null
        }

      - database_encryption {
          - state = "DECRYPTED" -> null
        }

      - default_snat_status {
          - disabled = false -> null
        }

      - ip_allocation_policy {
          - cluster_ipv4_cidr_block       = "10.1.0.0/16" -> null
          - cluster_secondary_range_name  = "ip-range-pods" -> null
          - services_ipv4_cidr_block      = "10.2.0.0/16" -> null
          - services_secondary_range_name = "ip-range-services" -> null
        }

      - logging_config {
          - enable_components = [
              - "SYSTEM_COMPONENTS",
              - "WORKLOADS",
            ] -> null
        }

      - maintenance_policy {
          - daily_maintenance_window {
              - duration   = "PT4H0M0S" -> null
              - start_time = "05:00" -> null
            }
        }

      - master_auth {
          - cluster_ca_certificate = "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUVMRENDQXBTZ0F3SUJBZ0lRSUxvZnhKQmFRSlhxc2x2SWJZc2RjVEFOQmdrcWhraUc5dzBCQVFzRkFEQXYKTVMwd0t3WURWUVFERXlRMVpUZzBPV1JtWmkxbU1tVTVMVFE0WVdZdFltUTBaaTB6TldNNFlqSmhZMlV3TWpVdwpJQmNOTWpJd09URTRNVFV4TURRNVdoZ1BNakExTWpBNU1UQXhOakV3TkRsYU1DOHhMVEFyQmdOVkJBTVRKRFZsCk9EUTVaR1ptTFdZeVpUa3RORGhoWmkxaVpEUm1MVE0xWXpoaU1tRmpaVEF5TlRDQ0FhSXdEUVlKS29aSWh2Y04KQVFFQkJRQURnZ0dQQURDQ0FZb0NnZ0dCQUljWGRabVc3UjloaCtEbWZXWjhpby94Rm5XMXFaa3U3VFc2TVVHVwpndXlaRmxQS0pWMHNaSXR2c1Q5T3h6d3hXZXZZZnRPQlFYWE9PVWI2V1pOZzByS3hUZzZsNldKRFlqekRKYjQvCmZveWhkVTBxN3UwQU50Q2hxLzFRSm5jaTlRWkFkUnBUTDV0R1U1QVVKZ0t4NVVSeHA2Y1ZuTFI0R0U0cXVnRFEKckNPcVV2T2h6NXROQWM4dFNXcTBaRUpFQlQ4RlorbUJmS0dOV0tRNlNGOUFaNjV0SU1XTHlBOHB2NWVCS29WSQpUKzVYMGYyM21GdW8yeTV1eFpvWFc2R0Y0VmxORFVPelE3dXVua3JoQXBGUEJRV1NFQ29HUU9DSUp3dUIzaExKClRsYVZCZHlqSU51YW5EQUZLV2JvWDNGNHpRUWZqVUFOSllCQkhOeVhleC9pM3JZRUxQVkxjRVQ3N2YvdkEzUDEKWWtRM25KODMvWXgwTlN0Z0FJcm02N2QzdEJTeEIxSzRQUXcwMXQwYkhuRXlCeDI5SjFGdS9PN2M1bm5hU1lUSQplZkpNaTQrY2U0dFAzbmRjUW51cWV6R1AyaGY5aTRTYlFiWEJrT2oxM0RTQTQ2WmhrdXl3NW9NOHNhcTRuRFliCjlvK01Sc0I5dllIWE83bGk1U1dqeTN2Q3ZRSURBUUFCbzBJd1FEQU9CZ05WSFE4QkFmOEVCQU1DQWdRd0R3WUQKVlIwVEFRSC9CQVV3QXdFQi96QWRCZ05WSFE0RUZnUVU5dkJsTVExbnZYb1JxdWM0SythOWZRcEs3bWd3RFFZSgpLb1pJaHZjTkFRRUxCUUFEZ2dHQkFEM2NHUmE1OWRpK3cxUUJ5UkcyRWVocmJwNHhpTmlyOW1xUUZxTGw0eTViCkxTNkgrdGxkU25kc1I1dzdtakxqWHowZmtmRzV5NmVucll1TlJTZXorc0pmdmxtcG9aQVVOWW1RVE1BTlNZTE4KVHRUTDZUdDJxazdKMk1ycm5BdHFxcURiUHEzS1Rqc3V0Nmxyc1B3ZTdCRXpHNVZwMnZYM2hMYkJKbjZvY2hxawpucG52N2FYcytjV3kvSmQzSVpSNUpaaU8vWDBIQXVBUk1Mc3pKVEVtSE9tandqaVpIaHZaWkNWTnhJVERSODFnClBFK1RtR3dHTnVFZ2VzcGtoVXFUWFFSbS9ybS8xcTFjRkk0RmU2VU85eU5hN0QwcnhqOXltVTdWWXY5VnVMWUkKNGJwTXovS2RjK1h1cHRIK2hEWU4zZEx2U0ZkbHVrUk1YVDhtTzNNdDBMVzR2dXR3MDVRcjVpZE1sQVdjRkpVUwpVSFBZZ2Z4TkNPamNvRFc5MEhvMGdQc3BVR0gwVjNxejgrS1dFSm9HT0RMcDZuOEd2Sld1Tk1zY0NUTWF1bGxTCktEOTB2c0Zvc1E5WXFVWVdtNTl5SGN2ellWOUcvVm1HWkYrL3puckZOT2hIdXRQc3hTQ2ZMSjgvbDNHTEUxTjEKZm0xMm9YOHh0U1dhWjBiL0dWeWVOQT09Ci0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K" -> null

          - client_certificate_config {
              - issue_client_certificate = false -> null
            }
        }

      - monitoring_config {
          - enable_components = [
              - "SYSTEM_COMPONENTS",
            ] -> null
        }

      - network_policy {
          - enabled  = false -> null
          - provider = "PROVIDER_UNSPECIFIED" -> null
        }

      - node_config {
          - disk_size_gb      = 100 -> null
          - disk_type         = "pd-balanced" -> null
          - guest_accelerator = [] -> null
          - image_type        = "COS_CONTAINERD" -> null
          - labels            = {} -> null
          - local_ssd_count   = 0 -> null
          - machine_type      = "e2-standard-2" -> null
          - metadata          = {
              - "disable-legacy-endpoints" = "true"
            } -> null
          - oauth_scopes      = [
              - "https://www.googleapis.com/auth/logging.write",
              - "https://www.googleapis.com/auth/monitoring",
            ] -> null
          - preemptible       = false -> null
          - service_account   = "tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
          - spot              = false -> null
          - tags              = [
              - "gke-leaf-01-gke",
              - "gke-leaf-01-gke-default-pool",
            ] -> null
          - taint             = [] -> null

          - shielded_instance_config {
              - enable_integrity_monitoring = true -> null
              - enable_secure_boot          = false -> null
            }

          - workload_metadata_config {
              - mode = "GKE_METADATA" -> null
            }
        }

      - node_pool {
          - initial_node_count          = 0 -> null
          - instance_group_urls         = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroupManagers/gke-leaf-01-gke-default-pool-8eb29b87-grp",
            ] -> null
          - managed_instance_group_urls = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroups/gke-leaf-01-gke-default-pool-8eb29b87-grp",
            ] -> null
          - max_pods_per_node           = 110 -> null
          - name                        = "default-pool" -> null
          - node_count                  = 0 -> null
          - node_locations              = [
              - "europe-west1-b",
            ] -> null
          - version                     = "1.27.4-gke.900" -> null

          - management {
              - auto_repair  = true -> null
              - auto_upgrade = true -> null
            }

          - node_config {
              - disk_size_gb      = 100 -> null
              - disk_type         = "pd-balanced" -> null
              - guest_accelerator = [] -> null
              - image_type        = "COS_CONTAINERD" -> null
              - labels            = {} -> null
              - local_ssd_count   = 0 -> null
              - machine_type      = "e2-standard-2" -> null
              - metadata          = {
                  - "disable-legacy-endpoints" = "true"
                } -> null
              - oauth_scopes      = [
                  - "https://www.googleapis.com/auth/logging.write",
                  - "https://www.googleapis.com/auth/monitoring",
                ] -> null
              - preemptible       = false -> null
              - service_account   = "tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
              - spot              = false -> null
              - tags              = [
                  - "gke-leaf-01-gke",
                  - "gke-leaf-01-gke-default-pool",
                ] -> null
              - taint             = [] -> null

              - shielded_instance_config {
                  - enable_integrity_monitoring = true -> null
                  - enable_secure_boot          = false -> null
                }

              - workload_metadata_config {
                  - mode = "GKE_METADATA" -> null
                }
            }

          - upgrade_settings {
              - max_surge       = 1 -> null
              - max_unavailable = 0 -> null
            }
        }
      - node_pool {
          - initial_node_count          = 0 -> null
          - instance_group_urls         = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroupManagers/gke-leaf-01-gke-leaf-01-gke-pool-74abbbcc-grp",
            ] -> null
          - managed_instance_group_urls = [
              - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroups/gke-leaf-01-gke-leaf-01-gke-pool-74abbbcc-grp",
            ] -> null
          - max_pods_per_node           = 110 -> null
          - name                        = "leaf-01-gke-pool" -> null
          - node_count                  = 0 -> null
          - node_locations              = [
              - "europe-west1-b",
            ] -> null
          - version                     = "1.27.4-gke.900" -> null

          - management {
              - auto_repair  = true -> null
              - auto_upgrade = false -> null
            }

          - node_config {
              - disk_size_gb      = 30 -> null
              - disk_type         = "pd-standard" -> null
              - guest_accelerator = [] -> null
              - image_type        = "COS_CONTAINERD" -> null
              - labels            = {
                  - "cluster_name" = "leaf-01-gke"
                  - "node_pool"    = "leaf-01-gke-pool"
                } -> null
              - local_ssd_count   = 0 -> null
              - machine_type      = "e2-standard-2" -> null
              - metadata          = {
                  - "cluster_name"             = "leaf-01-gke"
                  - "disable-legacy-endpoints" = "true"
                  - "node_pool"                = "leaf-01-gke-pool"
                } -> null
              - oauth_scopes      = [
                  - "https://www.googleapis.com/auth/cloud-platform",
                ] -> null
              - preemptible       = false -> null
              - service_account   = "tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
              - spot              = false -> null
              - tags              = [
                  - "gke-leaf-01-gke",
                  - "gke-leaf-01-gke-leaf-01-gke-pool",
                ] -> null
              - taint             = [] -> null

              - shielded_instance_config {
                  - enable_integrity_monitoring = true -> null
                  - enable_secure_boot          = false -> null
                }

              - workload_metadata_config {
                  - mode = "GKE_METADATA" -> null
                }
            }

          - upgrade_settings {
              - max_surge       = 1 -> null
              - max_unavailable = 0 -> null
            }
        }

      - notification_config {
          - pubsub {
              - enabled = false -> null
            }
        }

      - private_cluster_config {
          - enable_private_endpoint = false -> null
          - enable_private_nodes    = true -> null
          - master_ipv4_cidr_block  = "10.3.0.0/28" -> null
          - peering_name            = "gke-n3edec1530d64352b180-b1d1-714d-peer" -> null
          - private_endpoint        = "10.3.0.2" -> null
          - public_endpoint         = "34.78.151.94" -> null

          - master_global_access_config {
              - enabled = false -> null
            }
        }

      - release_channel {
          - channel = "UNSPECIFIED" -> null
        }

      - timeouts {
          - create = "45m" -> null
          - delete = "45m" -> null
          - update = "45m" -> null
        }

      - vertical_pod_autoscaling {
          - enabled = false -> null
        }

      - workload_identity_config {
          - workload_pool = "weave-gitops-clusters.svc.id.goog" -> null
        }
    }

  # module.gke.google_container_node_pool.pools["leaf-01-gke-pool"] will be destroyed
  - resource "google_container_node_pool" "pools" {
      - cluster                     = "leaf-01-gke" -> null
      - id                          = "projects/weave-gitops-clusters/locations/europe-west1-b/clusters/leaf-01-gke/nodePools/leaf-01-gke-pool" -> null
      - initial_node_count          = 0 -> null
      - instance_group_urls         = [
          - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroupManagers/gke-leaf-01-gke-leaf-01-gke-pool-74abbbcc-grp",
        ] -> null
      - location                    = "europe-west1-b" -> null
      - managed_instance_group_urls = [
          - "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/zones/europe-west1-b/instanceGroups/gke-leaf-01-gke-leaf-01-gke-pool-74abbbcc-grp",
        ] -> null
      - max_pods_per_node           = 110 -> null
      - name                        = "leaf-01-gke-pool" -> null
      - node_count                  = 0 -> null
      - node_locations              = [
          - "europe-west1-b",
        ] -> null
      - project                     = "weave-gitops-clusters" -> null
      - version                     = "1.27.4-gke.900" -> null

      - management {
          - auto_repair  = true -> null
          - auto_upgrade = false -> null
        }

      - node_config {
          - disk_size_gb      = 30 -> null
          - disk_type         = "pd-standard" -> null
          - guest_accelerator = [] -> null
          - image_type        = "COS_CONTAINERD" -> null
          - labels            = {
              - "cluster_name" = "leaf-01-gke"
              - "node_pool"    = "leaf-01-gke-pool"
            } -> null
          - local_ssd_count   = 0 -> null
          - machine_type      = "e2-standard-2" -> null
          - metadata          = {
              - "cluster_name"             = "leaf-01-gke"
              - "disable-legacy-endpoints" = "true"
              - "node_pool"                = "leaf-01-gke-pool"
            } -> null
          - oauth_scopes      = [
              - "https://www.googleapis.com/auth/cloud-platform",
            ] -> null
          - preemptible       = false -> null
          - service_account   = "tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
          - spot              = false -> null
          - tags              = [
              - "gke-leaf-01-gke",
              - "gke-leaf-01-gke-leaf-01-gke-pool",
            ] -> null
          - taint             = [] -> null

          - shielded_instance_config {
              - enable_integrity_monitoring = true -> null
              - enable_secure_boot          = false -> null
            }

          - workload_metadata_config {
              - mode = "GKE_METADATA" -> null
            }
        }

      - timeouts {
          - create = "45m" -> null
          - delete = "45m" -> null
          - update = "45m" -> null
        }

      - upgrade_settings {
          - max_surge       = 1 -> null
          - max_unavailable = 0 -> null
        }
    }

  # module.gke.google_project_iam_member.cluster_service_account-artifact-registry["weave-gitops-clusters"] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-artifact-registry" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/artifactregistry.reader/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/artifactregistry.reader" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-gcr["weave-gitops-clusters"] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-gcr" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/storage.objectViewer/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/storage.objectViewer" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-log_writer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-log_writer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/logging.logWriter/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/logging.logWriter" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-metric_writer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-metric_writer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/monitoring.metricWriter/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/monitoring.metricWriter" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-monitoring_viewer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-monitoring_viewer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/monitoring.viewer/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/monitoring.viewer" -> null
    }

  # module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0] will be destroyed
  - resource "google_project_iam_member" "cluster_service_account-resourceMetadata-writer" {
      - etag    = "BwYDrBf5Kfg=" -> null
      - id      = "weave-gitops-clusters/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - member  = "serviceAccount:tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project = "weave-gitops-clusters" -> null
      - role    = "roles/stackdriver.resourceMetadata.writer" -> null
    }

  # module.gke.google_service_account.cluster_service_account[0] will be destroyed
  - resource "google_service_account" "cluster_service_account" {
      - account_id   = "tf-gke-leaf-01-gke-8zun" -> null
      - disabled     = false -> null
      - display_name = "Terraform-managed service account for cluster leaf-01-gke" -> null
      - email        = "tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - id           = "projects/weave-gitops-clusters/serviceAccounts/tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - name         = "projects/weave-gitops-clusters/serviceAccounts/tf-gke-leaf-01-gke-8zun@weave-gitops-clusters.iam.gserviceaccount.com" -> null
      - project      = "weave-gitops-clusters" -> null
      - unique_id    = "108717836968553913444" -> null
    }

  # module.gke.random_shuffle.available_zones will be destroyed
  - resource "random_shuffle" "available_zones" {
      - id           = "-" -> null
      - input        = [
          - "europe-west1-b",
          - "europe-west1-c",
          - "europe-west1-d",
        ] -> null
      - result       = [
          - "europe-west1-c",
          - "europe-west1-d",
          - "europe-west1-b",
        ] -> null
      - result_count = 3 -> null
    }

  # module.gke.random_string.cluster_service_account_suffix will be destroyed
  - resource "random_string" "cluster_service_account_suffix" {
      - id          = "8zun" -> null
      - length      = 4 -> null
      - lower       = true -> null
      - min_lower   = 0 -> null
      - min_numeric = 0 -> null
      - min_special = 0 -> null
      - min_upper   = 0 -> null
      - number      = true -> null
      - numeric     = true -> null
      - result      = "8zun" -> null
      - special     = false -> null
      - upper       = false -> null
    }

  # module.gcp-network.module.subnets.google_compute_subnetwork.subnetwork["europe-west1/leaf-01-gke"] will be destroyed
  - resource "google_compute_subnetwork" "subnetwork" {
      - creation_timestamp         = "2022-09-18T09:10:17.886-07:00" -> null
      - gateway_address            = "10.0.0.1" -> null
      - id                         = "projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-01-gke" -> null
      - ip_cidr_range              = "10.0.0.0/16" -> null
      - name                       = "leaf-01-gke" -> null
      - network                    = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-01-gke" -> null
      - private_ip_google_access   = true -> null
      - private_ipv6_google_access = "DISABLE_GOOGLE_ACCESS" -> null
      - project                    = "weave-gitops-clusters" -> null
      - purpose                    = "PRIVATE" -> null
      - region                     = "europe-west1" -> null
      - secondary_ip_range         = [
          - {
              - ip_cidr_range = "10.1.0.0/16"
              - range_name    = "ip-range-pods"
            },
          - {
              - ip_cidr_range = "10.2.0.0/16"
              - range_name    = "ip-range-services"
            },
        ] -> null
      - self_link                  = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/regions/europe-west1/subnetworks/leaf-01-gke" -> null
      - stack_type                 = "IPV4_ONLY" -> null
    }

  # module.gcp-network.module.vpc.google_compute_network.network will be destroyed
  - resource "google_compute_network" "network" {
      - auto_create_subnetworks         = false -> null
      - delete_default_routes_on_create = false -> null
      - enable_ula_internal_ipv6        = false -> null
      - id                              = "projects/weave-gitops-clusters/global/networks/leaf-01-gke" -> null
      - mtu                             = 0 -> null
      - name                            = "leaf-01-gke" -> null
      - project                         = "weave-gitops-clusters" -> null
      - routing_mode                    = "GLOBAL" -> null
      - self_link                       = "https://www.googleapis.com/compute/v1/projects/weave-gitops-clusters/global/networks/leaf-01-gke" -> null
    }

Plan: 0 to add, 0 to change, 27 to destroy.

Changes to Outputs:
  - external-dns-sa-account-name               = "[email protected]" -> null
  - image-reflector-controller-sa-account-name = "image-rc-leaf-01-gke@weave-gitops-clusters.iam.gserviceaccount.com" -> null

enekofb self-assigned this Oct 10, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

improve cost efficiency around staging clusters #143

improve cost efficiency around staging clusters #143

enekofb commented Oct 10, 2023

enekofb commented Oct 10, 2023

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 13, 2023

enekofb commented Oct 13, 2023

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 16, 2023 •

edited

Loading

enekofb commented Oct 16, 2023

improve cost efficiency around staging clusters #143

improve cost efficiency around staging clusters #143

Comments

enekofb commented Oct 10, 2023

enekofb commented Oct 10, 2023

enekofb commented Oct 13, 2023 • edited Loading

enekofb commented Oct 13, 2023 • edited Loading

enekofb commented Oct 13, 2023

enekofb commented Oct 13, 2023

enekofb commented Oct 13, 2023 • edited Loading

enekofb commented Oct 13, 2023 • edited Loading

enekofb commented Oct 16, 2023 • edited Loading

enekofb commented Oct 16, 2023

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 13, 2023 •

edited

Loading

enekofb commented Oct 16, 2023 •

edited

Loading