Skip to content

Instantly share code, notes, and snippets.

@mahsoud
Created January 26, 2022 20:52
Show Gist options
  • Save mahsoud/8effeedac4d68b62cb947d0bb80fcfad to your computer and use it in GitHub Desktop.
Save mahsoud/8effeedac4d68b62cb947d0bb80fcfad to your computer and use it in GitHub Desktop.
2022-01-26T22:42:14.104+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=53883
2022-01-26T22:42:14.108+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:42:14.121+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:42:14.121+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:14.121+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:42:14.121+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:14.121+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:42:14.121+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:14.123+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:42:14.123+0200
address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin146656126 network=unix timestamp=2022-01-26T22:42:14.159+0200
path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=53883
2022-01-26T22:42:14.537+0200 [DEBUG] ProviderTransformer: "databricks_mount.this" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:42:14.538+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW local.aws_prefix (expand) var.CLUSTER_ID var.DATABRICKS_INSTANCE_PROFILE]
2022-01-26T22:42:14.538+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/databrickslabs/databricks\"]" references: [var.DATABRICKS_HOST var.DATABRICKS_TOKEN]
2022-01-26T22:42:14.576+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=53887
2022-01-26T22:42:14.582+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:42:14.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:42:14.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:14.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:42:14.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:14.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:42:14.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:14.596+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:42:14.596+0200
address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin391568234 network=unix timestamp=2022-01-26T22:42:14.631+0200
path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=53887
2022-01-26T22:42:15.096+0200 [DEBUG] ProviderTransformer: "databricks_mount.this (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:42:15.096+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/databrickslabs/databricks\"]" references: [var.DATABRICKS_HOST var.DATABRICKS_TOKEN]
2022-01-26T22:42:15.096+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this (expand)" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW var.CLUSTER_ID local.aws_prefix (expand) var.DATABRICKS_INSTANCE_PROFILE]
2022-01-26T22:42:15.350+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=53899
2022-01-26T22:42:15.356+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:42:15.368+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:42:15.368+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:15.368+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:42:15.368+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:15.368+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:42:15.368+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:42:15.372+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:42:15.372+0200
address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin603737222 network=unix timestamp=2022-01-26T22:42:15.411+0200
2022-01-26T22:42:15.472+0200 [WARN] ValidateProviderConfig from "provider[\"registry.terraform.io/databrickslabs/databricks\"]" changed the config value, but that value is unused
2022-01-26T22:42:15.473+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Explicit and implicit attributes: host, token: timestamp=2022-01-26T22:42:15.473+0200
2022-01-26T22:42:15.473+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this[\"excorp-datalake.tst\"]" references: []
databricks_mount.this["excorp-datalake.tst"]: Refreshing state... [id=dev-sbx-excorp-datalake.tst]
2022-01-26T22:42:15.476+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Using directly configured PAT authentication: timestamp=2022-01-26T22:42:15.476+0200
2022-01-26T22:42:15.476+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Configured pat auth: host=https://dbc-89a9311b-4cf2.cloud.databricks.com, token=***REDACTED***: timestamp=2022-01-26T22:42:15.476+0200
2022-01-26T22:42:15.476+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:42:15.476+0200
2022-01-26T22:42:16.427+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"creator_user_name": "databricks-admins@excorp.com",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
2022-01-26T22:42:16.427+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:42:16.427+0200
2022-01-26T22:42:16.552+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:16.552+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:42:16.552+0200
2022-01-26T22:42:16.980+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:16.982+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list: timestamp=2022-01-26T22:42:16.982+0200
2022-01-26T22:42:17.135+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
2022-01-26T22:42:17.136+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Found reusable cluster 'terraform-mount-tst-sbx-databricks-instance-profile': timestamp=2022-01-26T22:42:17.136+0200
2022-01-26T22:42:17.136+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:42:17.136+0200
2022-01-26T22:42:17.231+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"creator_user_name": "databricks-admins@excorp.com",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
2022-01-26T22:42:17.232+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:42:17.231+0200
2022-01-26T22:42:17.363+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"creator_user_name": "databricks-admins@excorp.com",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
2022-01-26T22:42:17.363+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Executing python command on 0124-131107-wp72cg3w:
2022-01-26T22:42:17.363+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/create {
2022-01-26T22:42:18.018+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:18.018+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:42:18.018+0200
2022-01-26T22:42:18.018+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:42:18.018+0200
2022-01-26T22:42:18.155+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:18.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:42:18.660+0200
2022-01-26T22:42:18.805+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:19.806+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:42:19.806+0200
2022-01-26T22:42:20.115+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:20.115+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/commands/execute {
2022-01-26T22:42:20.512+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:20.512+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:42:20.512+0200
2022-01-26T22:42:20.512+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:20.512+0200
2022-01-26T22:42:21.165+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:21.165+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:42:21.165+0200
2022-01-26T22:42:21.666+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:21.666+0200
2022-01-26T22:42:22.276+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:22.276+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:42:22.276+0200
2022-01-26T22:42:23.278+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:23.277+0200
2022-01-26T22:42:23.897+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:23.897+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:42:23.897+0200
2022-01-26T22:42:25.900+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:25.900+0200
2022-01-26T22:42:26.574+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:26.574+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:42:26.574+0200
2022-01-26T22:42:30.578+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:30.577+0200
2022-01-26T22:42:31.650+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:31.650+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:42:31.650+0200
2022-01-26T22:42:39.653+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:39.652+0200
2022-01-26T22:42:40.513+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:40.513+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:42:40.513+0200
2022-01-26T22:42:50.518+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:50.518+0200
2022-01-26T22:42:50.799+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:50.799+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:42:50.799+0200
2022-01-26T22:42:50.925+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
2022-01-26T22:42:50.925+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/destroy {
2022-01-26T22:42:51.024+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=53899
 # databricks_mount.this["excorp-datalake.tst"] must be replaced
-/+ resource "databricks_mount" "this" {
2022-01-26T22:46:55.619+0200 [DEBUG] Adding temp file log sink: /var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/terraform-log883027311
2022-01-26T22:46:55.620+0200 [INFO] Terraform version: 1.0.11
2022-01-26T22:46:55.620+0200 [INFO] Go runtime version: go1.16.4
2022-01-26T22:46:55.620+0200 [INFO] CLI args: []string{"/usr/local/bin/terraform", "apply", "-auto-approve"}
2022-01-26T22:46:55.620+0200 [DEBUG] Attempting to open CLI config file: /Users/mahsoudbadalbaev/.terraformrc
2022-01-26T22:46:55.620+0200 [DEBUG] File doesn't exist, but doesn't need to. Ignoring.
2022-01-26T22:46:55.621+0200 [INFO] Loading CLI configuration from /Users/mahsoudbadalbaev/.terraform.d/credentials.tfrc.json
2022-01-26T22:46:55.623+0200 [DEBUG] checking for credentials in "/Users/mahsoudbadalbaev/.terraform.d/plugins"
2022-01-26T22:46:55.624+0200 [DEBUG] ignoring non-existing provider search directory terraform.d/plugins
2022-01-26T22:46:55.624+0200 [DEBUG] will search for provider plugins in /Users/mahsoudbadalbaev/.terraform.d/plugins
2022-01-26T22:46:55.624+0200 [DEBUG] ignoring non-existing provider search directory /Users/mahsoudbadalbaev/Library/Application Support/io.terraform/plugins
2022-01-26T22:46:55.624+0200 [DEBUG] ignoring non-existing provider search directory /Library/Application Support/io.terraform/plugins
2022-01-26T22:46:55.625+0200 [INFO] CLI command args: []string{"apply", "-auto-approve"}
2022-01-26T22:46:55.641+0200 [DEBUG] New state was assigned lineage "459b3846-9283-99e6-d61c-36d37c9b4049"
2022-01-26T22:46:56.607+0200 [DEBUG] checking for provisioner in "."
2022-01-26T22:46:56.625+0200 [DEBUG] checking for provisioner in "/usr/local/bin"
2022-01-26T22:46:56.625+0200 [DEBUG] checking for provisioner in "/Users/mahsoudbadalbaev/.terraform.d/plugins"
2022-01-26T22:46:56.626+0200 [INFO] Failed to read plugin lock file .terraform/plugins/darwin_amd64/lock.json: open .terraform/plugins/darwin_amd64/lock.json: no such file or directory
2022-01-26T22:46:56.629+0200 [INFO] backend/local: starting Apply operation
2022-01-26T22:46:56.643+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:46:56.644+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:46:56.690+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
2022-01-26T22:46:56.696+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54620
2022-01-26T22:46:56.696+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:46:56.712+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:46:56.712+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:56.712+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:46:56.712+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:56.712+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:46:56.713+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:56.715+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:46:56.715+0200
2022-01-26T22:46:56.748+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin194490915 network=unix timestamp=2022-01-26T22:46:56.748+0200
2022-01-26T22:46:56.749+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:46:56.828+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:46:56.830+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54620
2022-01-26T22:46:56.830+0200 [DEBUG] provider: plugin exited
2022-01-26T22:46:56.830+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:46:56.830+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:46:56.862+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5]
2022-01-26T22:46:56.883+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 pid=54621
2022-01-26T22:46:56.883+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5
2022-01-26T22:46:56.934+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: configuring server automatic mTLS: timestamp=2022-01-26T22:46:56.933+0200
2022-01-26T22:46:56.977+0200 [DEBUG] provider.terraform-provider-aws_v3.73.0_x5: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin156711432 network=unix timestamp=2022-01-26T22:46:56.977+0200
2022-01-26T22:46:56.977+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:46:57.150+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:46:57.155+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 pid=54621
2022-01-26T22:46:57.156+0200 [DEBUG] provider: plugin exited
2022-01-26T22:46:57.158+0200 [INFO] terraform: building graph: GraphTypeValidate
2022-01-26T22:46:57.161+0200 [DEBUG] ProviderTransformer: "aws_iam_policy.bucket_rw" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:46:57.162+0200 [DEBUG] ProviderTransformer: "aws_iam_role_policy_attachment.bucket_rw" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:46:57.162+0200 [DEBUG] ProviderTransformer: "databricks_mount.this" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:46:57.162+0200 [DEBUG] ProviderTransformer: "data.aws_iam_policy_document.bucket_rw" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:46:57.166+0200 [DEBUG] ReferenceTransformer: "data.aws_iam_policy_document.bucket_rw" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW var.AWS_BUCKETS_RW var.AWS_BUCKETS_RW]
2022-01-26T22:46:57.166+0200 [DEBUG] ReferenceTransformer: "var.AWS_BUCKETS_RW" references: []
2022-01-26T22:46:57.166+0200 [DEBUG] ReferenceTransformer: "var.AWS_COMMON_PREFIX" references: []
2022-01-26T22:46:57.166+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_TOKEN" references: []
2022-01-26T22:46:57.166+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/aws\"]" references: [var.AWS_REGION]
2022-01-26T22:46:57.166+0200 [INFO] ReferenceTransformer: reference not found: "count.index"
2022-01-26T22:46:57.166+0200 [DEBUG] ReferenceTransformer: "aws_iam_role_policy_attachment.bucket_rw" references: [var.MODULE_ENABLED aws_iam_policy.bucket_rw var.AWS_EC2_ROLE]
2022-01-26T22:46:57.167+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:46:57.167+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW local.aws_prefix (expand) var.CLUSTER_ID var.DATABRICKS_INSTANCE_PROFILE]
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_HOST" references: []
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "local.aws_prefix (expand)" references: [var.AWS_COMMON_PREFIX var.DATABRICKS_WORKSPACE_NAME]
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_INSTANCE_PROFILE" references: []
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.TAGS" references: []
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/databrickslabs/databricks\"]" references: [var.DATABRICKS_TOKEN var.DATABRICKS_HOST]
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_WORKSPACE_NAME" references: []
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.AWS_REGION" references: []
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.AWS_EC2_ROLE" references: []
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.MODULE_ENABLED" references: []
2022-01-26T22:46:57.167+0200 [INFO] ReferenceTransformer: reference not found: "count.index"
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "aws_iam_policy.bucket_rw" references: [var.MODULE_ENABLED var.TAGS data.aws_iam_policy_document.bucket_rw local.aws_prefix (expand)]
2022-01-26T22:46:57.167+0200 [DEBUG] ReferenceTransformer: "var.CLUSTER_ID" references: []
2022-01-26T22:46:57.168+0200 [DEBUG] Starting graph walk: walkValidate
2022-01-26T22:46:57.171+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:46:57.171+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:46:57.206+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5]
2022-01-26T22:46:57.234+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 pid=54623
2022-01-26T22:46:57.235+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5
2022-01-26T22:46:57.298+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: configuring server automatic mTLS: timestamp=2022-01-26T22:46:57.298+0200
2022-01-26T22:46:57.346+0200 [DEBUG] provider.terraform-provider-aws_v3.73.0_x5: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin813327378 network=unix timestamp=2022-01-26T22:46:57.346+0200
2022-01-26T22:46:57.347+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:46:57.393+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:46:57.393+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:46:57.432+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
2022-01-26T22:46:57.437+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54627
2022-01-26T22:46:57.438+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:46:57.452+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:46:57.452+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:57.452+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:46:57.452+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:57.452+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:46:57.452+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:57.455+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:46:57.454+0200
2022-01-26T22:46:57.491+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin134954910 network=unix timestamp=2022-01-26T22:46:57.491+0200
2022-01-26T22:46:57.491+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:46:57.557+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:46:57.559+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54627
2022-01-26T22:46:57.559+0200 [DEBUG] provider: plugin exited
2022-01-26T22:46:57.749+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:46:57.754+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 pid=54623
2022-01-26T22:46:57.754+0200 [DEBUG] provider: plugin exited
2022-01-26T22:46:57.755+0200 [INFO] backend/local: apply calling Plan
2022-01-26T22:46:57.755+0200 [INFO] terraform: building graph: GraphTypePlan
2022-01-26T22:46:57.761+0200 [DEBUG] ProviderTransformer: "databricks_mount.this (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:46:57.761+0200 [DEBUG] ProviderTransformer: "data.aws_iam_policy_document.bucket_rw (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:46:57.761+0200 [DEBUG] ProviderTransformer: "aws_iam_policy.bucket_rw (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:46:57.761+0200 [DEBUG] ProviderTransformer: "aws_iam_role_policy_attachment.bucket_rw (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:46:57.762+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:46:57.762+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this (expand)" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW var.CLUSTER_ID local.aws_prefix (expand) var.DATABRICKS_INSTANCE_PROFILE]
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "data.aws_iam_policy_document.bucket_rw (expand)" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW var.AWS_BUCKETS_RW var.AWS_BUCKETS_RW]
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.TAGS" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_TOKEN" references: []
2022-01-26T22:46:57.762+0200 [INFO] ReferenceTransformer: reference not found: "count.index"
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "aws_iam_policy.bucket_rw (expand)" references: [var.MODULE_ENABLED local.aws_prefix (expand) var.TAGS data.aws_iam_policy_document.bucket_rw (expand)]
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_WORKSPACE_NAME" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_INSTANCE_PROFILE" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.AWS_BUCKETS_RW" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_HOST" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.AWS_REGION" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.AWS_EC2_ROLE" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.CLUSTER_ID" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "local.aws_prefix (expand)" references: [var.AWS_COMMON_PREFIX var.DATABRICKS_WORKSPACE_NAME]
2022-01-26T22:46:57.762+0200 [INFO] ReferenceTransformer: reference not found: "count.index"
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "aws_iam_role_policy_attachment.bucket_rw (expand)" references: [var.MODULE_ENABLED aws_iam_policy.bucket_rw (expand) var.AWS_EC2_ROLE]
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.MODULE_ENABLED" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "var.AWS_COMMON_PREFIX" references: []
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/databrickslabs/databricks\"]" references: [var.DATABRICKS_HOST var.DATABRICKS_TOKEN]
2022-01-26T22:46:57.762+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/aws\"]" references: [var.AWS_REGION]
2022-01-26T22:46:57.763+0200 [DEBUG] Starting graph walk: walkPlan
2022-01-26T22:46:57.764+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:46:57.764+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:46:57.801+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
2022-01-26T22:46:57.806+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54628
2022-01-26T22:46:57.806+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:46:57.819+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:46:57.819+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:57.819+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:46:57.819+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:57.820+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:46:57.820+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:46:57.822+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:46:57.822+0200
2022-01-26T22:46:57.860+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:46:57.860+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin555057859 network=unix timestamp=2022-01-26T22:46:57.859+0200
2022-01-26T22:46:57.909+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:46:57.909+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:46:57.924+0200 [WARN] ValidateProviderConfig from "provider[\"registry.terraform.io/databrickslabs/databricks\"]" changed the config value, but that value is unused
2022-01-26T22:46:57.949+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5]
2022-01-26T22:46:57.974+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 pid=54629
2022-01-26T22:46:57.975+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5
2022-01-26T22:46:58.035+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: configuring server automatic mTLS: timestamp=2022-01-26T22:46:58.035+0200
2022-01-26T22:46:58.077+0200 [DEBUG] provider.terraform-provider-aws_v3.73.0_x5: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin833583504 network=unix timestamp=2022-01-26T22:46:58.076+0200
2022-01-26T22:46:58.077+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:46:58.124+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Explicit and implicit attributes: host, token: timestamp=2022-01-26T22:46:58.124+0200
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "var.MODULE_ENABLED"
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "var.AWS_BUCKETS_RW"
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "var.CLUSTER_ID"
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "local.aws_prefix"
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:46:58.125+0200 [INFO] ReferenceTransformer: reference not found: "var.DATABRICKS_INSTANCE_PROFILE"
2022-01-26T22:46:58.125+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this[\"excorp-datalake.tst\"]" references: []
databricks_mount.this["excorp-datalake.tst"]: Refreshing state... [id=dev-sbx-excorp-datalake.tst]
2022-01-26T22:46:58.136+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Using directly configured PAT authentication: timestamp=2022-01-26T22:46:58.136+0200
2022-01-26T22:46:58.136+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Configured pat auth: host=https://dbc-89a9311b-4cf2.cloud.databricks.com, token=***REDACTED***: timestamp=2022-01-26T22:46:58.136+0200
2022-01-26T22:46:58.136+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:46:58.136+0200
2022-01-26T22:46:58.338+0200 [WARN] ValidateProviderConfig from "provider[\"registry.terraform.io/hashicorp/aws\"]" changed the config value, but that value is unused
2022-01-26T22:46:58.341+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:58 [INFO] AWS Auth provider used: "SharedCredentialsProvider": timestamp=2022-01-26T22:46:58.341+0200
2022-01-26T22:46:58.342+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:58 [DEBUG] Trying to get account information via sts:GetCallerIdentity: timestamp=2022-01-26T22:46:58.342+0200
2022-01-26T22:46:58.342+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:58 [DEBUG] [aws-sdk-go] DEBUG: Request sts/GetCallerIdentity Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: sts.amazonaws.com
User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.0.11 (+https://www.terraform.io) terraform-provider-aws/3.73.0 (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go/1.42.34 (go1.16; darwin; amd64)
Content-Length: 43
Authorization: AWS4-HMAC-SHA256 Credential=AKIA3OLMORF65Y5E6BNC/20220126/us-east-1/sts/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=49767756411911821727ce1a9ea257afca627494af64383409deea0b42310937
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20220126T204658Z
Accept-Encoding: gzip
Action=GetCallerIdentity&Version=2011-06-15
-----------------------------------------------------: timestamp=2022-01-26T22:46:58.342+0200
2022-01-26T22:46:58.960+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:46:58.960+0200
2022-01-26T22:46:58.961+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:46:58.960+0200
2022-01-26T22:46:59.085+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"versions": [
{
"key": "6.4.x-esr-scala2.11",
"name": "6.4 Extended Support (includes Apache Spark 2.4.5, Scala 2.11)"
},
{
"key": "7.3.x-cpu-ml-scala2.12",
"name": "7.3 LTS ML (includes Apache Spark 3.0.1, Scala 2.12)"
},
{
"key": "7.3.x-hls-scala2.12",
"name": "7.3 LTS Genomics (includes Apache Spark 3.0.1, Scala 2.12)"
},
{
"key": "10.2.x-gpu-ml-scala2.12",
"name": "10.2 ML (includes Apache Spark 3.2.0, GPU, Scala 2.12)"
},
{
"key": "7.3.x-gpu-ml-scala2.12",
"name": "7.3 LTS ML (includes Apache Spark 3.0.1, GPU, Scala 2.12)"
},
{
"key": "10.1.x-photon-scala2.12",
"name": "10.1 Photon (includes Apache Spark 3.2.0, Scala 2.12)"
},
{
"key": "9.1.x-photon-scala2.12",
"name": "9.1 LTS Photon (includes Apache Spark 3.1.2, Scala 2.12)"
},
{
"key": "10.2.x-photon-scala2.12",
"name": "10.2 Photon (includes Apache Spark 3.2.0, Scala 2.12)"
},
{
... (2252 more bytes) <- GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:46:59.085+0200
2022-01-26T22:46:59.086+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:46:59.086+0200
2022-01-26T22:46:59.362+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"node_types": [
{
"category": "Memory Optimized",
"description": "r3.xlarge (deprecated)",
"display_order": 1,
"instance_type_id": "r3.xlarge",
"is_deprecated": false,
"is_encrypted_in_transit": false,
"is_graviton": false,
"is_hidden": false,
"is_io_cache_enabled": false,
"memory_mb": 31232,
"node_instance_type": {
"instance_family": "EC2 r3 Family vCPUs",
"instance_type_id": "r3.xlarge",
"is_encrypted_in_transit": false,
"is_graviton": false,
"local_disk_size_gb": 80,
"local_disks": 1,
"swap_size": "10g"
},
"node_type_id": "r3.xlarge",
"num_cores": 4,
"num_gpus": 0,
"photon_driver_capable": false,
"photon_worker_capable": false,
"support_cluster_tags": true,
"support_ebs_volumes": true,
"support_port_forwarding": true
},
{
"category": "Memory Optimized",
"description": "r3.2xlarge (deprecated)",
"disp... (166640 more bytes) <- GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:46:59.362+0200
2022-01-26T22:46:59.365+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list: timestamp=2022-01-26T22:46:59.365+0200
2022-01-26T22:46:59.381+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:59 [DEBUG] [aws-sdk-go] DEBUG: Response sts/GetCallerIdentity Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200
Connection: close
Content-Length: 407
Content-Type: text/xml
Date: Wed, 26 Jan 2022 20:46:58 GMT
Keep-Alive: timeout=5
X-Amzn-Requestid: 4631f7d8-0813-443c-8572-9d0d4ffd01ea
-----------------------------------------------------: timestamp=2022-01-26T22:46:59.381+0200
2022-01-26T22:46:59.382+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:59 [DEBUG] [aws-sdk-go] <GetCallerIdentityResponse xmlns="https://sts.amazonaws.com/doc/2011-06-15/">
<GetCallerIdentityResult>
<Arn>arn:aws:iam::786743331197:user/mbadalbaev</Arn>
<UserId>AIDAJXBDWKF235C3GKZCS</UserId>
<Account>786743331197</Account>
</GetCallerIdentityResult>
<ResponseMetadata>
<RequestId>4631f7d8-0813-443c-8572-9d0d4ffd01ea</RequestId>
</ResponseMetadata>
</GetCallerIdentityResponse>: timestamp=2022-01-26T22:46:59.381+0200
2022-01-26T22:46:59.382+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:59 [DEBUG] Trying to get account information via sts:GetCallerIdentity: timestamp=2022-01-26T22:46:59.382+0200
2022-01-26T22:46:59.382+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:46:59 [DEBUG] [aws-sdk-go] DEBUG: Request sts/GetCallerIdentity Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: sts.amazonaws.com
User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.0.11 (+https://www.terraform.io) terraform-provider-aws/3.73.0 (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go/1.42.34 (go1.16; darwin; amd64)
Content-Length: 43
Authorization: AWS4-HMAC-SHA256 Credential=AKIA3OLMORF65Y5E6BNC/20220126/us-east-1/sts/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=00b773ef5119872960ec79dccc31a8a7ec811c99ffb7452cc01189c18f3fce21
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20220126T204659Z
Accept-Encoding: gzip
Action=GetCallerIdentity&Version=2011-06-15
-----------------------------------------------------: timestamp=2022-01-26T22:46:59.382+0200
2022-01-26T22:46:59.492+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"clusters": [
{
"autotermination_minutes": 30,
"aws_attributes": {
"availability": "SPOT",
"ebs_volume_count": 1,
"ebs_volume_size": 100,
"ebs_volume_type": "GENERAL_PURPOSE_SSD",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 4,
"cluster_id": "0121-111938-7x6qcfmx",
"cluster_memory_mb": 16384,
"cluster_name": "vpismarev-dev",
"cluster_source": "UI",
"creator_user_name": "vitaly.pismarev@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0121-111938-7x6qcfmx",
"ClusterName": "vpismarev-dev",
"Creator": "vitaly.pismarev@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {
"disk_count": 1,
"disk_size": ... (78069 more bytes) <- GET /api/2.0/clusters/list: timestamp=2022-01-26T22:46:59.492+0200
2022-01-26T22:46:59.494+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Found reusable cluster 'terraform-mount-tst-sbx-databricks-instance-profile': timestamp=2022-01-26T22:46:59.494+0200
2022-01-26T22:46:59.494+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:46:59.494+0200
2022-01-26T22:46:59.609+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:46:59.609+0200
2022-01-26T22:46:59.609+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:46:59.609+0200
2022-01-26T22:46:59.725+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:46:59.725+0200
2022-01-26T22:46:59.725+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Executing python command on 0124-131107-wp72cg3w:
dbutils.fs.refreshMounts()
for mount in dbutils.fs.mounts():
if mount.mountPoint == "/mnt/dev-sbx-excorp-datalake.tst":
dbutils.notebook.exit(mount.source)
raise Exception("Mount not found"): timestamp=2022-01-26T22:46:59.725+0200
2022-01-26T22:46:59.725+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/create {
"clusterId": "0124-131107-wp72cg3w",
"language": "python"
}: timestamp=2022-01-26T22:46:59.725+0200
2022-01-26T22:46:59.923+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "2510168826642950665"
} <- POST /api/1.2/contexts/create: timestamp=2022-01-26T22:46:59.923+0200
2022-01-26T22:46:59.923+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:46:59.923+0200
2022-01-26T22:46:59.923+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:46:59.923+0200
2022-01-26T22:47:00.047+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "2510168826642950665",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:00.047+0200
2022-01-26T22:47:00.190+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] [aws-sdk-go] DEBUG: Response sts/GetCallerIdentity Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200
Connection: close
Content-Length: 407
Content-Type: text/xml
Date: Wed, 26 Jan 2022 20:46:59 GMT
Keep-Alive: timeout=5
X-Amzn-Requestid: aef3277d-96a3-45d8-a25b-755ed5bc6e7a
-----------------------------------------------------: timestamp=2022-01-26T22:47:00.190+0200
2022-01-26T22:47:00.190+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] [aws-sdk-go] <GetCallerIdentityResponse xmlns="https://sts.amazonaws.com/doc/2011-06-15/">
<GetCallerIdentityResult>
<Arn>arn:aws:iam::786743331197:user/mbadalbaev</Arn>
<UserId>AIDAJXBDWKF235C3GKZCS</UserId>
<Account>786743331197</Account>
</GetCallerIdentityResult>
<ResponseMetadata>
<RequestId>aef3277d-96a3-45d8-a25b-755ed5bc6e7a</RequestId>
</ResponseMetadata>
</GetCallerIdentityResponse>: timestamp=2022-01-26T22:47:00.190+0200
2022-01-26T22:47:00.195+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] [aws-sdk-go] DEBUG: Request ec2/DescribeAccountAttributes Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: ec2.eu-central-1.amazonaws.com
User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.0.11 (+https://www.terraform.io) terraform-provider-aws/3.73.0 (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go/1.42.34 (go1.16; darwin; amd64)
Content-Length: 87
Authorization: AWS4-HMAC-SHA256 Credential=AKIA3OLMORF65Y5E6BNC/20220126/eu-central-1/ec2/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=dd246787a205c32b0b8ce6d6e179c4508684cf75799574c1bb67d96b1279958c
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20220126T204700Z
Accept-Encoding: gzip
Action=DescribeAccountAttributes&AttributeName.1=supported-platforms&Version=2016-11-15
-----------------------------------------------------: timestamp=2022-01-26T22:47:00.195+0200
2022-01-26T22:47:00.549+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:00.549+0200
2022-01-26T22:47:00.669+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "2510168826642950665",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:00.668+0200
2022-01-26T22:47:00.857+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] [aws-sdk-go] DEBUG: Response ec2/DescribeAccountAttributes Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Content-Length: 540
Cache-Control: no-cache, no-store
Content-Type: text/xml;charset=UTF-8
Date: Wed, 26 Jan 2022 20:47:00 GMT
Keep-Alive: timeout=20
Server: AmazonEC2
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Amzn-Requestid: 49ef7703-f746-4f15-bd62-318a9f11f300
-----------------------------------------------------: timestamp=2022-01-26T22:47:00.857+0200
2022-01-26T22:47:00.857+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] [aws-sdk-go] <?xml version="1.0" encoding="UTF-8"?>
<DescribeAccountAttributesResponse xmlns="http://ec2.amazonaws.com/doc/2016-11-15/">
<requestId>49ef7703-f746-4f15-bd62-318a9f11f300</requestId>
<accountAttributeSet>
<item>
<attributeName>supported-platforms</attributeName>
<attributeValueSet>
<item>
<attributeValue>VPC</attributeValue>
</item>
</attributeValueSet>
</item>
</accountAttributeSet>
</DescribeAccountAttributesResponse>: timestamp=2022-01-26T22:47:00.857+0200
2022-01-26T22:47:00.858+0200 [INFO] ReferenceTransformer: reference not found: "var.MODULE_ENABLED"
2022-01-26T22:47:00.858+0200 [INFO] ReferenceTransformer: reference not found: "var.AWS_BUCKETS_RW"
2022-01-26T22:47:00.858+0200 [INFO] ReferenceTransformer: reference not found: "var.AWS_BUCKETS_RW"
2022-01-26T22:47:00.858+0200 [INFO] ReferenceTransformer: reference not found: "var.AWS_BUCKETS_RW"
2022-01-26T22:47:00.858+0200 [DEBUG] ReferenceTransformer: "data.aws_iam_policy_document.bucket_rw[0]" references: []
2022-01-26T22:47:00.868+0200 [WARN] Provider "provider[\"registry.terraform.io/hashicorp/aws\"]" produced an unexpected new value for data.aws_iam_policy_document.bucket_rw[0].
- .version: was null, but now cty.StringVal("2012-10-17")
- .statement[0].not_actions: was null, but now cty.SetValEmpty(cty.String)
- .statement[0].not_resources: was null, but now cty.SetValEmpty(cty.String)
- .statement[0].effect: was null, but now cty.StringVal("Allow")
- .statement[1].not_resources: was null, but now cty.SetValEmpty(cty.String)
- .statement[1].sid: was null, but now cty.StringVal("")
- .statement[1].effect: was null, but now cty.StringVal("Allow")
- .statement[1].not_actions: was null, but now cty.SetValEmpty(cty.String)
- .statement[2].effect: was null, but now cty.StringVal("Allow")
- .statement[2].not_actions: was null, but now cty.SetValEmpty(cty.String)
- .statement[2].not_resources: was null, but now cty.SetValEmpty(cty.String)
- .statement[2].sid: was null, but now cty.StringVal("")
2022-01-26T22:47:00.869+0200 [INFO] ReferenceTransformer: reference not found: "var.MODULE_ENABLED"
2022-01-26T22:47:00.869+0200 [INFO] ReferenceTransformer: reference not found: "var.TAGS"
2022-01-26T22:47:00.869+0200 [INFO] ReferenceTransformer: reference not found: "data.aws_iam_policy_document.bucket_rw"
2022-01-26T22:47:00.869+0200 [INFO] ReferenceTransformer: reference not found: "count.index"
2022-01-26T22:47:00.869+0200 [INFO] ReferenceTransformer: reference not found: "local.aws_prefix"
2022-01-26T22:47:00.869+0200 [DEBUG] ReferenceTransformer: "aws_iam_policy.bucket_rw[0]" references: []
aws_iam_policy.bucket_rw[0]: Refreshing state... [id=arn:aws:iam::786743331197:policy/dev-sbx-datalake-ec2-access-s3-rw]
2022-01-26T22:47:00.872+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] Waiting for state to become: [success]: timestamp=2022-01-26T22:47:00.872+0200
2022-01-26T22:47:00.872+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:00 [DEBUG] [aws-sdk-go] DEBUG: Request iam/GetPolicy Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: iam.amazonaws.com
User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.0.11 (+https://www.terraform.io) terraform-provider-aws/3.73.0 (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go/1.42.34 (go1.16; darwin; amd64)
Content-Length: 124
Authorization: AWS4-HMAC-SHA256 Credential=AKIA3OLMORF65Y5E6BNC/20220126/us-east-1/iam/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=43f39c533eb5a49831887bb188fac0e239f83c6390ceff4568526779df318dfa
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20220126T204700Z
Accept-Encoding: gzip
Action=GetPolicy&PolicyArn=arn%3Aaws%3Aiam%3A%3A786743331197%3Apolicy%2Fdev-sbx-datalake-ec2-access-s3-rw&Version=2010-05-08
-----------------------------------------------------: timestamp=2022-01-26T22:47:00.872+0200
2022-01-26T22:47:01.674+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:01.674+0200
2022-01-26T22:47:01.796+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:01 [DEBUG] [aws-sdk-go] DEBUG: Response iam/GetPolicy Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Content-Length: 803
Content-Type: text/xml
Date: Wed, 26 Jan 2022 20:47:01 GMT
X-Amzn-Requestid: bc3f9805-5b42-4dd5-810f-605846b5fdb4
-----------------------------------------------------: timestamp=2022-01-26T22:47:01.795+0200
2022-01-26T22:47:01.796+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:01 [DEBUG] [aws-sdk-go] <GetPolicyResponse xmlns="https://iam.amazonaws.com/doc/2010-05-08/">
<GetPolicyResult>
<Policy>
<PermissionsBoundaryUsageCount>0</PermissionsBoundaryUsageCount>
<Path>/</Path>
<UpdateDate>2022-01-26T20:32:16Z</UpdateDate>
<DefaultVersionId>v1</DefaultVersionId>
<PolicyId>ANPA3OLMORF6SGFHLNT2I</PolicyId>
<IsAttachable>true</IsAttachable>
<PolicyName>dev-sbx-datalake-ec2-access-s3-rw</PolicyName>
<AttachmentCount>1</AttachmentCount>
<Arn>arn:aws:iam::786743331197:policy/dev-sbx-datalake-ec2-access-s3-rw</Arn>
<CreateDate>2022-01-26T20:32:16Z</CreateDate>
<Tags/>
</Policy>
</GetPolicyResult>
<ResponseMetadata>
<RequestId>bc3f9805-5b42-4dd5-810f-605846b5fdb4</RequestId>
</ResponseMetadata>
</GetPolicyResponse>: timestamp=2022-01-26T22:47:01.796+0200
2022-01-26T22:47:01.796+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:01 [DEBUG] Waiting for state to become: [success]: timestamp=2022-01-26T22:47:01.796+0200
2022-01-26T22:47:01.796+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:01 [DEBUG] [aws-sdk-go] DEBUG: Request iam/GetPolicyVersion Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: iam.amazonaws.com
User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.0.11 (+https://www.terraform.io) terraform-provider-aws/3.73.0 (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go/1.42.34 (go1.16; darwin; amd64)
Content-Length: 144
Authorization: AWS4-HMAC-SHA256 Credential=AKIA3OLMORF65Y5E6BNC/20220126/us-east-1/iam/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=c27a1b1bc061be8b4f4745a67d5606671d2081fe09706c8e67688464e69c9564
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20220126T204701Z
Accept-Encoding: gzip
Action=GetPolicyVersion&PolicyArn=arn%3Aaws%3Aiam%3A%3A786743331197%3Apolicy%2Fdev-sbx-datalake-ec2-access-s3-rw&Version=2010-05-08&VersionId=v1
-----------------------------------------------------: timestamp=2022-01-26T22:47:01.796+0200
2022-01-26T22:47:01.861+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "2510168826642950665",
"status": "Running"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:01.861+0200
2022-01-26T22:47:01.861+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/commands/execute {
"clusterId": "0124-131107-wp72cg3w",
"command": "dbutils.fs.refreshMounts()\nfor mount in dbutils.fs.mounts():\n if mount.mountPoint == \"/mnt/de... (107 more bytes)",
"contextId": "2510168826642950665",
"language": "python"
}: timestamp=2022-01-26T22:47:01.861+0200
2022-01-26T22:47:02.023+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1"
} <- POST /api/1.2/commands/execute: timestamp=2022-01-26T22:47:02.023+0200
2022-01-26T22:47:02.023+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:47:02.023+0200
2022-01-26T22:47:02.023+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:02.023+0200
2022-01-26T22:47:02.630+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:02 [DEBUG] [aws-sdk-go] DEBUG: Response iam/GetPolicyVersion Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Content-Length: 1103
Content-Type: text/xml
Date: Wed, 26 Jan 2022 20:47:01 GMT
X-Amzn-Requestid: 3748c5b4-95b8-4e7b-82ff-1760305c792e
-----------------------------------------------------: timestamp=2022-01-26T22:47:02.630+0200
2022-01-26T22:47:02.630+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:02 [DEBUG] [aws-sdk-go] <GetPolicyVersionResponse xmlns="https://iam.amazonaws.com/doc/2010-05-08/">
<GetPolicyVersionResult>
<PolicyVersion>
<VersionId>v1</VersionId>
<IsDefaultVersion>true</IsDefaultVersion>
<Document>%7B%22Statement%22%3A%5B%7B%22Action%22%3A%5B%22s3%3AListAllMyBuckets%22%2C%22s3%3AGetBucketLocation%22%5D%2C%22Effect%22%3A%22Allow%22%2C%22Resource%22%3A%22arn%3Aaws%3As3%3A%3A%3A%2A%22%2C%22Sid%22%3A%221%22%7D%2C%7B%22Action%22%3A%22s3%3AListBucket%22%2C%22Effect%22%3A%22Allow%22%2C%22Resource%22%3A%22arn%3Aaws%3As3%3A%3A%3Aexcorp-datalake.tst%22%2C%22Sid%22%3A%22%22%7D%2C%7B%22Action%22%3A%22s3%3A%2A%22%2C%22Effect%22%3A%22Allow%22%2C%22Resource%22%3A%5B%22arn%3Aaws%3As3%3A%3A%3Aexcorp-datalake.tst%2F%2A%22%2C%22arn%3Aaws%3As3%3A%3A%3Aexcorp-datalake.tst%22%5D%2C%22Sid%22%3A%22%22%7D%5D%2C%22Version%22%3A%222012-10-17%22%7D</Document>
<CreateDate>2022-01-26T20:32:16Z</CreateDate>
</PolicyVersion>
</GetPolicyVersionResult>
<ResponseMetadata>
<RequestId>3748c5b4-95b8-4e7b-82ff-1760305c792e</RequestId>
</ResponseMetadata>
</GetPolicyVersionResponse>: timestamp=2022-01-26T22:47:02.630+0200
2022-01-26T22:47:02.631+0200 [WARN] Provider "registry.terraform.io/hashicorp/aws" produced an unexpected new value for aws_iam_policy.bucket_rw[0] during refresh.
- .tags: was null, but now cty.MapValEmpty(cty.String)
2022-01-26T22:47:02.642+0200 [WARN] Provider "registry.terraform.io/hashicorp/aws" produced an invalid plan for aws_iam_policy.bucket_rw[0], but we are tolerating it because it is using the legacy plugin SDK.
The following problems may be the cause of any confusing errors from downstream operations:
- .description: planned value cty.StringVal("") for a non-computed attribute
- .path: planned value cty.StringVal("/") for a non-computed attribute
2022-01-26T22:47:02.642+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:02.642+0200
2022-01-26T22:47:02.642+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:02.642+0200
2022-01-26T22:47:02.643+0200 [INFO] ReferenceTransformer: reference not found: "var.MODULE_ENABLED"
2022-01-26T22:47:02.643+0200 [INFO] ReferenceTransformer: reference not found: "aws_iam_policy.bucket_rw"
2022-01-26T22:47:02.643+0200 [INFO] ReferenceTransformer: reference not found: "count.index"
2022-01-26T22:47:02.643+0200 [INFO] ReferenceTransformer: reference not found: "var.AWS_EC2_ROLE"
2022-01-26T22:47:02.643+0200 [DEBUG] ReferenceTransformer: "aws_iam_role_policy_attachment.bucket_rw[0]" references: []
aws_iam_role_policy_attachment.bucket_rw[0]: Refreshing state... [id=tst-sbx-datalake-role-for-ec2-20220126203218733100000001]
2022-01-26T22:47:02.644+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:02 [DEBUG] Waiting for state to become: [success]: timestamp=2022-01-26T22:47:02.644+0200
2022-01-26T22:47:02.645+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:02 [DEBUG] [aws-sdk-go] DEBUG: Request iam/ListAttachedRolePolicies Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: iam.amazonaws.com
User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.0.11 (+https://www.terraform.io) terraform-provider-aws/3.73.0 (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go/1.42.34 (go1.16; darwin; amd64)
Content-Length: 89
Authorization: AWS4-HMAC-SHA256 Credential=AKIA3OLMORF65Y5E6BNC/20220126/us-east-1/iam/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=2ae1f48773fbf65e017f54497dae1f717aa96bf2448da75022379e1888cc2ed9
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20220126T204702Z
Accept-Encoding: gzip
Action=ListAttachedRolePolicies&RoleName=tst-sbx-datalake-role-for-ec2&Version=2010-05-08
-----------------------------------------------------: timestamp=2022-01-26T22:47:02.644+0200
2022-01-26T22:47:03.147+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:03.146+0200
2022-01-26T22:47:03.457+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:03 [DEBUG] [aws-sdk-go] DEBUG: Response iam/ListAttachedRolePolicies Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Content-Length: 969
Content-Type: text/xml
Date: Wed, 26 Jan 2022 20:47:03 GMT
X-Amzn-Requestid: c80988d0-a57d-4ab4-b82c-71c05afafe9d
-----------------------------------------------------: timestamp=2022-01-26T22:47:03.457+0200
2022-01-26T22:47:03.457+0200 [INFO] provider.terraform-provider-aws_v3.73.0_x5: 2022/01/26 22:47:03 [DEBUG] [aws-sdk-go] <ListAttachedRolePoliciesResponse xmlns="https://iam.amazonaws.com/doc/2010-05-08/">
<ListAttachedRolePoliciesResult>
<IsTruncated>false</IsTruncated>
<AttachedPolicies>
<member>
<PolicyArn>arn:aws:iam::786743331197:policy/tst-sbx-datalake-ec2-access-s3-rw</PolicyArn>
<PolicyName>tst-sbx-datalake-ec2-access-s3-rw</PolicyName>
</member>
<member>
<PolicyArn>arn:aws:iam::786743331197:policy/tst-sbx-datalake-ec2-access-glue</PolicyArn>
<PolicyName>tst-sbx-datalake-ec2-access-glue</PolicyName>
</member>
<member>
<PolicyArn>arn:aws:iam::786743331197:policy/dev-sbx-datalake-ec2-access-s3-rw</PolicyArn>
<PolicyName>dev-sbx-datalake-ec2-access-s3-rw</PolicyName>
</member>
</AttachedPolicies>
</ListAttachedRolePoliciesResult>
<ResponseMetadata>
<RequestId>c80988d0-a57d-4ab4-b82c-71c05afafe9d</RequestId>
</ResponseMetadata>
</ListAttachedRolePoliciesResponse>: timestamp=2022-01-26T22:47:03.457+0200
2022-01-26T22:47:03.461+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:47:03.469+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/aws/3.73.0/darwin_amd64/terraform-provider-aws_v3.73.0_x5 pid=54629
2022-01-26T22:47:03.469+0200 [DEBUG] provider: plugin exited
2022-01-26T22:47:03.754+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:03.754+0200
2022-01-26T22:47:03.754+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:03.754+0200
2022-01-26T22:47:04.759+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:04.759+0200
2022-01-26T22:47:05.630+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:05.630+0200
2022-01-26T22:47:05.630+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:05.630+0200
2022-01-26T22:47:07.644+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:07.643+0200
2022-01-26T22:47:08.282+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:08.282+0200
2022-01-26T22:47:08.282+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:08.282+0200
2022-01-26T22:47:12.285+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:12.285+0200
2022-01-26T22:47:12.978+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:12.978+0200
2022-01-26T22:47:12.978+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:12.978+0200
2022-01-26T22:47:20.980+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:20.980+0200
2022-01-26T22:47:21.595+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:21.595+0200
2022-01-26T22:47:21.595+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:21.595+0200
2022-01-26T22:47:31.599+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:31.599+0200
2022-01-26T22:47:32.357+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": {
"data": "s3a://excorp-datalake.tst",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:32.357+0200
2022-01-26T22:47:32.357+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:32.357+0200
2022-01-26T22:47:32.478+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "9184a8a5-6a1e-4451-a0b0-7bc88f52abf1",
"results": {
"data": "s3a://excorp-datalake.tst",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:32.478+0200
2022-01-26T22:47:32.479+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/destroy {
"clusterId": "0124-131107-wp72cg3w",
"contextId": "2510168826642950665"
}: timestamp=2022-01-26T22:47:32.478+0200
2022-01-26T22:47:32.578+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "2510168826642950665"
} <- POST /api/1.2/contexts/destroy: timestamp=2022-01-26T22:47:32.578+0200
2022-01-26T22:47:32.585+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:47:32.587+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54628
2022-01-26T22:47:32.587+0200 [DEBUG] provider: plugin exited

Note: Objects have changed outside of Terraform
Terraform detected the following changes made outside of Terraform since the
last "terraform apply":
 # aws_iam_policy.bucket_rw[0] has been changed
 ~ resource "aws_iam_policy" "bucket_rw" {
id = "arn:aws:iam::786743331197:policy/dev-sbx-datalake-ec2-access-s3-rw"
name = "dev-sbx-datalake-ec2-access-s3-rw"
+ tags = {}
# (5 unchanged attributes hidden)
}
Unless you have made equivalent changes to your configuration, or ignored the
relevant attributes using ignore_changes, the following plan may include
actions to undo or respond to these changes.

─────────────────────────────────────────────────────────────────────────────
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
-/+ destroy and then create replacement

Terraform will perform the following actions:
 # databricks_mount.this["excorp-datalake.tst"] must be replaced
-/+ resource "databricks_mount" "this" {
~ cluster_id = "0124-131107-wp72cg3w" -> "0124-111617-wk902x94" # forces replacement
~ id = "dev-sbx-excorp-datalake.tst" -> (known after apply)
name = "dev-sbx-excorp-datalake.tst"
~ source = "s3a://excorp-datalake.tst" -> (known after apply)
# (1 unchanged block hidden)
}
Plan: 1 to add, 0 to change, 1 to destroy.
2022-01-26T22:47:32.598+0200 [INFO] backend/local: apply calling Apply
2022-01-26T22:47:32.598+0200 [INFO] terraform: building graph: GraphTypeApply
2022-01-26T22:47:32.599+0200 [DEBUG] ProviderTransformer: "databricks_mount.this[\"excorp-datalake.tst\"]" (*terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:47:32.599+0200 [DEBUG] ProviderTransformer: "databricks_mount.this[\"excorp-datalake.tst\"] (destroy)" (*terraform.NodeDestroyResourceInstance) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:47:32.599+0200 [DEBUG] ProviderTransformer: "data.aws_iam_policy_document.bucket_rw (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:47:32.599+0200 [DEBUG] ProviderTransformer: "aws_iam_role_policy_attachment.bucket_rw (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:47:32.599+0200 [DEBUG] ProviderTransformer: "databricks_mount.this (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/databrickslabs/databricks"]
2022-01-26T22:47:32.600+0200 [DEBUG] ProviderTransformer: "aws_iam_policy.bucket_rw (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"]
2022-01-26T22:47:32.600+0200 [DEBUG] ReferenceTransformer: "var.MODULE_ENABLED" references: []
2022-01-26T22:47:32.600+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:47:32.600+0200 [INFO] ReferenceTransformer: reference not found: "each.key"
2022-01-26T22:47:32.600+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this[\"excorp-datalake.tst\"]" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW var.CLUSTER_ID local.aws_prefix (expand) var.DATABRICKS_INSTANCE_PROFILE]
2022-01-26T22:47:32.600+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/databrickslabs/databricks\"]" references: [var.DATABRICKS_HOST var.DATABRICKS_TOKEN]
2022-01-26T22:47:32.600+0200 [DEBUG] ReferenceTransformer: "data.aws_iam_policy_document.bucket_rw (expand)" references: [var.MODULE_ENABLED]
2022-01-26T22:47:32.600+0200 [DEBUG] ReferenceTransformer: "var.CLUSTER_ID" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.AWS_COMMON_PREFIX" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.AWS_BUCKETS_RW" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_HOST" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_WORKSPACE_NAME" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.AWS_REGION" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "local.aws_prefix (expand)" references: [var.AWS_COMMON_PREFIX var.DATABRICKS_WORKSPACE_NAME]
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/aws\"]" references: [var.AWS_REGION]
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "aws_iam_role_policy_attachment.bucket_rw (expand)" references: [var.MODULE_ENABLED]
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "databricks_mount.this (expand)" references: [var.MODULE_ENABLED var.AWS_BUCKETS_RW]
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_INSTANCE_PROFILE" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.TAGS" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "aws_iam_policy.bucket_rw (expand)" references: [var.MODULE_ENABLED]
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.DATABRICKS_TOKEN" references: []
2022-01-26T22:47:32.601+0200 [DEBUG] ReferenceTransformer: "var.AWS_EC2_ROLE" references: []
2022-01-26T22:47:32.602+0200 [DEBUG] pruneUnusedNodes: aws_iam_policy.bucket_rw (expand) is no longer needed, removing
2022-01-26T22:47:32.602+0200 [DEBUG] pruneUnusedNodes: data.aws_iam_policy_document.bucket_rw (expand) is no longer needed, removing
2022-01-26T22:47:32.602+0200 [DEBUG] pruneUnusedNodes: aws_iam_role_policy_attachment.bucket_rw (expand) is no longer needed, removing
2022-01-26T22:47:32.602+0200 [DEBUG] pruneUnusedNodes: provider["registry.terraform.io/hashicorp/aws"] is no longer needed, removing
2022-01-26T22:47:32.602+0200 [DEBUG] Starting graph walk: walkApply
2022-01-26T22:47:32.603+0200 [DEBUG] created provider logger: level=debug
2022-01-26T22:47:32.603+0200 [INFO] provider: configuring client automatic mTLS
2022-01-26T22:47:32.643+0200 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 args=[.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6]
2022-01-26T22:47:32.648+0200 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54694
2022-01-26T22:47:32.648+0200 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6
2022-01-26T22:47:32.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Databricks Terraform Provider (experimental)
2022-01-26T22:47:32.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:47:32.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Version 0.4.6
2022-01-26T22:47:32.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:47:32.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs
2022-01-26T22:47:32.660+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6:
2022-01-26T22:47:32.663+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: configuring server automatic mTLS: timestamp=2022-01-26T22:47:32.662+0200
2022-01-26T22:47:32.698+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: plugin address: address=/var/folders/ld/_mfgdwc96hnf2xglhvvjkc_80000gn/T/plugin495849101 network=unix timestamp=2022-01-26T22:47:32.698+0200
2022-01-26T22:47:32.698+0200 [DEBUG] provider: using plugin: version=5
2022-01-26T22:47:32.758+0200 [WARN] ValidateProviderConfig from "provider[\"registry.terraform.io/databrickslabs/databricks\"]" changed the config value, but that value is unused
2022-01-26T22:47:32.759+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Explicit and implicit attributes: host, token: timestamp=2022-01-26T22:47:32.759+0200
databricks_mount.this["excorp-datalake.tst"]: Destroying... [id=dev-sbx-excorp-datalake.tst]
2022-01-26T22:47:32.765+0200 [INFO] Starting apply for databricks_mount.this["excorp-datalake.tst"]
2022-01-26T22:47:32.765+0200 [DEBUG] databricks_mount.this["excorp-datalake.tst"]: applying the planned Delete change
2022-01-26T22:47:32.766+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Using directly configured PAT authentication: timestamp=2022-01-26T22:47:32.766+0200
2022-01-26T22:47:32.766+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Configured pat auth: host=https://dbc-89a9311b-4cf2.cloud.databricks.com, token=***REDACTED***: timestamp=2022-01-26T22:47:32.766+0200
2022-01-26T22:47:32.766+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:47:32.766+0200
2022-01-26T22:47:33.616+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:47:33.615+0200
2022-01-26T22:47:33.627+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:47:33.623+0200
2022-01-26T22:47:33.761+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"versions": [
{
"key": "6.4.x-esr-scala2.11",
"name": "6.4 Extended Support (includes Apache Spark 2.4.5, Scala 2.11)"
},
{
"key": "7.3.x-cpu-ml-scala2.12",
"name": "7.3 LTS ML (includes Apache Spark 3.0.1, Scala 2.12)"
},
{
"key": "7.3.x-hls-scala2.12",
"name": "7.3 LTS Genomics (includes Apache Spark 3.0.1, Scala 2.12)"
},
{
"key": "10.2.x-gpu-ml-scala2.12",
"name": "10.2 ML (includes Apache Spark 3.2.0, GPU, Scala 2.12)"
},
{
"key": "7.3.x-gpu-ml-scala2.12",
"name": "7.3 LTS ML (includes Apache Spark 3.0.1, GPU, Scala 2.12)"
},
{
"key": "10.1.x-photon-scala2.12",
"name": "10.1 Photon (includes Apache Spark 3.2.0, Scala 2.12)"
},
{
"key": "9.1.x-photon-scala2.12",
"name": "9.1 LTS Photon (includes Apache Spark 3.1.2, Scala 2.12)"
},
{
"key": "10.2.x-photon-scala2.12",
"name": "10.2 Photon (includes Apache Spark 3.2.0, Scala 2.12)"
},
{
... (2252 more bytes) <- GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:47:33.761+0200
2022-01-26T22:47:33.761+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:47:33.761+0200
2022-01-26T22:47:34.039+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"node_types": [
{
"category": "Memory Optimized",
"description": "r3.xlarge (deprecated)",
"display_order": 1,
"instance_type_id": "r3.xlarge",
"is_deprecated": false,
"is_encrypted_in_transit": false,
"is_graviton": false,
"is_hidden": false,
"is_io_cache_enabled": false,
"memory_mb": 31232,
"node_instance_type": {
"instance_family": "EC2 r3 Family vCPUs",
"instance_type_id": "r3.xlarge",
"is_encrypted_in_transit": false,
"is_graviton": false,
"local_disk_size_gb": 80,
"local_disks": 1,
"swap_size": "10g"
},
"node_type_id": "r3.xlarge",
"num_cores": 4,
"num_gpus": 0,
"photon_driver_capable": false,
"photon_worker_capable": false,
"support_cluster_tags": true,
"support_ebs_volumes": true,
"support_port_forwarding": true
},
{
"category": "Memory Optimized",
"description": "r3.2xlarge (deprecated)",
"disp... (166640 more bytes) <- GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:47:34.039+0200
2022-01-26T22:47:34.041+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list: timestamp=2022-01-26T22:47:34.041+0200
2022-01-26T22:47:34.156+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"clusters": [
{
"autotermination_minutes": 30,
"aws_attributes": {
"availability": "SPOT",
"ebs_volume_count": 1,
"ebs_volume_size": 100,
"ebs_volume_type": "GENERAL_PURPOSE_SSD",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 4,
"cluster_id": "0121-111938-7x6qcfmx",
"cluster_memory_mb": 16384,
"cluster_name": "vpismarev-dev",
"cluster_source": "UI",
"creator_user_name": "vitaly.pismarev@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0121-111938-7x6qcfmx",
"ClusterName": "vpismarev-dev",
"Creator": "vitaly.pismarev@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {
"disk_count": 1,
"disk_size": ... (78069 more bytes) <- GET /api/2.0/clusters/list: timestamp=2022-01-26T22:47:34.155+0200
2022-01-26T22:47:34.158+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Found reusable cluster 'terraform-mount-tst-sbx-databricks-instance-profile': timestamp=2022-01-26T22:47:34.158+0200
2022-01-26T22:47:34.158+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:47:34.158+0200
2022-01-26T22:47:34.252+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:47:34.252+0200
2022-01-26T22:47:34.252+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Unmounting /mnt/dev-sbx-excorp-datalake.tst: timestamp=2022-01-26T22:47:34.252+0200
2022-01-26T22:47:34.252+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:47:34.252+0200
2022-01-26T22:47:34.351+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:47:34.351+0200
2022-01-26T22:47:34.351+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Executing python command on 0124-131107-wp72cg3w:
found = False
mount_point = "/mnt/dev-sbx-excorp-datalake.tst"
dbutils.fs.refreshMounts()
for mount in dbutils.fs.mounts():
if mount.mountPoint == mount_point:
found = True
if not found:
dbutils.notebook.exit("success")
dbutils.fs.unmount(mount_point)
dbutils.fs.refreshMounts()
for mount in dbutils.fs.mounts():
if mount.mountPoint == mount_point:
raise Exception("Failed to unmount")
dbutils.notebook.exit("success"): timestamp=2022-01-26T22:47:34.351+0200
2022-01-26T22:47:34.351+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/create {
"clusterId": "0124-131107-wp72cg3w",
"language": "python"
}: timestamp=2022-01-26T22:47:34.351+0200
2022-01-26T22:47:34.524+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "1798542110304753456"
} <- POST /api/1.2/contexts/create: timestamp=2022-01-26T22:47:34.524+0200
2022-01-26T22:47:34.524+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:47:34.524+0200
2022-01-26T22:47:34.524+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:34.524+0200
2022-01-26T22:47:34.644+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "1798542110304753456",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:34.644+0200
2022-01-26T22:47:35.144+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:35.144+0200
2022-01-26T22:47:35.426+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "1798542110304753456",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:35.426+0200
2022-01-26T22:47:36.427+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:36.427+0200
2022-01-26T22:47:36.560+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "1798542110304753456",
"status": "Running"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:47:36.560+0200
2022-01-26T22:47:36.560+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/commands/execute {
"clusterId": "0124-131107-wp72cg3w",
"command": "found = False\nmount_point = \"/mnt/dev-sbx-excorp-datalake.tst\"\ndbutils.fs.refreshMounts()\nfor mo... (351 more bytes)",
"contextId": "1798542110304753456",
"language": "python"
}: timestamp=2022-01-26T22:47:36.560+0200
2022-01-26T22:47:36.669+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79"
} <- POST /api/1.2/commands/execute: timestamp=2022-01-26T22:47:36.669+0200
2022-01-26T22:47:36.669+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:47:36.669+0200
2022-01-26T22:47:36.669+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:36.669+0200
2022-01-26T22:47:37.305+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:37.305+0200
2022-01-26T22:47:37.306+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:37.305+0200
2022-01-26T22:47:37.806+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:37.806+0200
2022-01-26T22:47:38.423+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:38.423+0200
2022-01-26T22:47:38.423+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:38.423+0200
2022-01-26T22:47:39.423+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:39.423+0200
2022-01-26T22:47:40.146+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:40.146+0200
2022-01-26T22:47:40.146+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:40.146+0200
2022-01-26T22:47:42.151+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:42.150+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 10s elapsed]
2022-01-26T22:47:42.800+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:42.800+0200
2022-01-26T22:47:42.800+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:42.800+0200
2022-01-26T22:47:46.805+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:46.805+0200
2022-01-26T22:47:47.440+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:47.440+0200
2022-01-26T22:47:47.440+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:47.440+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 20s elapsed]
2022-01-26T22:47:55.443+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:55.442+0200
2022-01-26T22:47:56.056+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:47:56.055+0200
2022-01-26T22:47:56.056+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:47:56.055+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 30s elapsed]
2022-01-26T22:48:06.060+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:06.060+0200
2022-01-26T22:48:07.071+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:07.071+0200
2022-01-26T22:48:07.071+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:07.071+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 40s elapsed]
2022-01-26T22:48:17.075+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:17.075+0200
2022-01-26T22:48:17.821+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:17.821+0200
2022-01-26T22:48:17.821+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:17.821+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 50s elapsed]
2022-01-26T22:48:27.825+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:27.825+0200
2022-01-26T22:48:28.884+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:28.884+0200
2022-01-26T22:48:28.884+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:28.884+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 1m0s elapsed]
2022-01-26T22:48:38.888+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:38.888+0200
2022-01-26T22:48:39.636+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:39.635+0200
2022-01-26T22:48:39.636+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:39.636+0200
databricks_mount.this["excorp-datalake.tst"]: Still destroying... [id=dev-sbx-excorp-datalake.tst, 1m10s elapsed]
2022-01-26T22:48:49.641+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:49.641+0200
2022-01-26T22:48:49.748+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": {
"data": "success",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:49.747+0200
2022-01-26T22:48:49.748+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:49.748+0200
2022-01-26T22:48:49.873+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "7d61cd21-5dd6-4981-8fec-b834c9b53d79",
"results": {
"data": "success",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:49.873+0200
2022-01-26T22:48:49.874+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/destroy {
"clusterId": "0124-131107-wp72cg3w",
"contextId": "1798542110304753456"
}: timestamp=2022-01-26T22:48:49.873+0200
2022-01-26T22:48:49.963+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "1798542110304753456"
} <- POST /api/1.2/contexts/destroy: timestamp=2022-01-26T22:48:49.963+0200
databricks_mount.this["excorp-datalake.tst"]: Destruction complete after 1m17s
databricks_mount.this["excorp-datalake.tst"]: Creating...
2022-01-26T22:48:49.991+0200 [INFO] Starting apply for databricks_mount.this["excorp-datalake.tst"]
2022-01-26T22:48:49.991+0200 [DEBUG] databricks_mount.this["excorp-datalake.tst"]: applying the planned Create change
2022-01-26T22:48:49.992+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:48:49.992+0200
2022-01-26T22:48:50.099+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autoscale": {
"max_workers": 10,
"min_workers": 1
},
"autotermination_minutes": 20,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 1,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_id": "0124-111617-wk902x94",
"cluster_log_conf": {
"s3": {
"canned_acl": "bucket-owner-full-control",
"destination": "s3://dev-liquiditydatastorage-ext-mo-logs/databricks/tst-sbx-shared",
"region": "eu-central-1"
}
},
"cluster_log_status": {
"last_attempted": 1643028184592
},
"cluster_name": "tst-sbx-shared",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"application id": "excorp-datalake",
"env": "tst",
"managedBy": "Terraform",
"owner": "vitaly.pismarev@excorp.com",
"project": "pricing",
"sourceCode": "git.excorp.io/middleoffice... (1210 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:48:50.099+0200
2022-01-26T22:48:50.099+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:48:50.099+0200
2022-01-26T22:48:50.206+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"versions": [
{
"key": "6.4.x-esr-scala2.11",
"name": "6.4 Extended Support (includes Apache Spark 2.4.5, Scala 2.11)"
},
{
"key": "7.3.x-cpu-ml-scala2.12",
"name": "7.3 LTS ML (includes Apache Spark 3.0.1, Scala 2.12)"
},
{
"key": "7.3.x-hls-scala2.12",
"name": "7.3 LTS Genomics (includes Apache Spark 3.0.1, Scala 2.12)"
},
{
"key": "10.2.x-gpu-ml-scala2.12",
"name": "10.2 ML (includes Apache Spark 3.2.0, GPU, Scala 2.12)"
},
{
"key": "7.3.x-gpu-ml-scala2.12",
"name": "7.3 LTS ML (includes Apache Spark 3.0.1, GPU, Scala 2.12)"
},
{
"key": "10.1.x-photon-scala2.12",
"name": "10.1 Photon (includes Apache Spark 3.2.0, Scala 2.12)"
},
{
"key": "9.1.x-photon-scala2.12",
"name": "9.1 LTS Photon (includes Apache Spark 3.1.2, Scala 2.12)"
},
{
"key": "10.2.x-photon-scala2.12",
"name": "10.2 Photon (includes Apache Spark 3.2.0, Scala 2.12)"
},
{
... (2252 more bytes) <- GET /api/2.0/clusters/spark-versions: timestamp=2022-01-26T22:48:50.205+0200
2022-01-26T22:48:50.206+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:48:50.206+0200
2022-01-26T22:48:50.702+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"node_types": [
{
"category": "Memory Optimized",
"description": "r3.xlarge (deprecated)",
"display_order": 1,
"instance_type_id": "r3.xlarge",
"is_deprecated": false,
"is_encrypted_in_transit": false,
"is_graviton": false,
"is_hidden": false,
"is_io_cache_enabled": false,
"memory_mb": 31232,
"node_instance_type": {
"instance_family": "EC2 r3 Family vCPUs",
"instance_type_id": "r3.xlarge",
"is_encrypted_in_transit": false,
"is_graviton": false,
"local_disk_size_gb": 80,
"local_disks": 1,
"swap_size": "10g"
},
"node_type_id": "r3.xlarge",
"num_cores": 4,
"num_gpus": 0,
"photon_driver_capable": false,
"photon_worker_capable": false,
"support_cluster_tags": true,
"support_ebs_volumes": true,
"support_port_forwarding": true
},
{
"category": "Memory Optimized",
"description": "r3.2xlarge (deprecated)",
"disp... (166640 more bytes) <- GET /api/2.0/clusters/list-node-types: timestamp=2022-01-26T22:48:50.701+0200
2022-01-26T22:48:50.703+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/list: timestamp=2022-01-26T22:48:50.703+0200
2022-01-26T22:48:50.857+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"clusters": [
{
"autotermination_minutes": 30,
"aws_attributes": {
"availability": "SPOT",
"ebs_volume_count": 1,
"ebs_volume_size": 100,
"ebs_volume_type": "GENERAL_PURPOSE_SSD",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 4,
"cluster_id": "0121-111938-7x6qcfmx",
"cluster_memory_mb": 16384,
"cluster_name": "vpismarev-dev",
"cluster_source": "UI",
"creator_user_name": "vitaly.pismarev@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0121-111938-7x6qcfmx",
"ClusterName": "vpismarev-dev",
"Creator": "vitaly.pismarev@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {
"disk_count": 1,
"disk_size": ... (78069 more bytes) <- GET /api/2.0/clusters/list: timestamp=2022-01-26T22:48:50.857+0200
2022-01-26T22:48:50.859+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Found reusable cluster 'terraform-mount-tst-sbx-databricks-instance-profile': timestamp=2022-01-26T22:48:50.859+0200
2022-01-26T22:48:50.859+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:48:50.859+0200
2022-01-26T22:48:50.978+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:48:50.978+0200
2022-01-26T22:48:50.979+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Mounting s3a://excorp-datalake.tst at /mnt/dev-sbx-excorp-datalake.tst: timestamp=2022-01-26T22:48:50.978+0200
2022-01-26T22:48:50.979+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:48:50.979+0200
2022-01-26T22:48:51.089+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:48:51.089+0200
2022-01-26T22:48:51.089+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Executing python command on 0124-131107-wp72cg3w:
def safe_mount(mount_point, mount_source, configs, encryptionType):
for mount in dbutils.fs.mounts():
if mount.mountPoint == mount_point and mount.source == mount_source:
return
try:
dbutils.fs.mount(mount_source, mount_point, extra_configs=configs, encryption_type=encryptionType)
dbutils.fs.refreshMounts()
dbutils.fs.ls(mount_point)
return mount_source
except Exception as e:
try:
dbutils.fs.unmount(mount_point)
except Exception as e2:
print("Failed to unmount", e2)
raise e
mount_source = safe_mount("/mnt/dev-sbx-excorp-datalake.tst", "s3a://excorp-datalake.tst", {}, "")
dbutils.notebook.exit(mount_source): timestamp=2022-01-26T22:48:51.089+0200
2022-01-26T22:48:51.089+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/create {
"clusterId": "0124-131107-wp72cg3w",
"language": "python"
}: timestamp=2022-01-26T22:48:51.089+0200
2022-01-26T22:48:51.222+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "474029759960120544"
} <- POST /api/1.2/contexts/create: timestamp=2022-01-26T22:48:51.221+0200
2022-01-26T22:48:51.222+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:48:51.221+0200
2022-01-26T22:48:51.222+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:48:51.222+0200
2022-01-26T22:48:51.338+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "474029759960120544",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:48:51.338+0200
2022-01-26T22:48:51.842+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:48:51.842+0200
2022-01-26T22:48:51.964+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "474029759960120544",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:48:51.964+0200
2022-01-26T22:48:52.966+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:48:52.966+0200
2022-01-26T22:48:53.156+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "474029759960120544",
"status": "Running"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:48:53.156+0200
2022-01-26T22:48:53.156+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/commands/execute {
"clusterId": "0124-131107-wp72cg3w",
"command": "def safe_mount(mount_point, mount_source, configs, encryptionType):\n for mount in dbutils.fs.... (630 more bytes)",
"contextId": "474029759960120544",
"language": "python"
}: timestamp=2022-01-26T22:48:53.156+0200
2022-01-26T22:48:53.323+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e"
} <- POST /api/1.2/commands/execute: timestamp=2022-01-26T22:48:53.323+0200
2022-01-26T22:48:53.323+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:48:53.323+0200
2022-01-26T22:48:53.323+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:53.323+0200
2022-01-26T22:48:54.075+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:54.075+0200
2022-01-26T22:48:54.075+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:54.075+0200
2022-01-26T22:48:54.578+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:54.577+0200
2022-01-26T22:48:55.189+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:55.189+0200
2022-01-26T22:48:55.189+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:55.189+0200
2022-01-26T22:48:56.191+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:56.191+0200
2022-01-26T22:48:56.885+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:56.885+0200
2022-01-26T22:48:56.885+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:56.885+0200
2022-01-26T22:48:58.886+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:58.886+0200
2022-01-26T22:48:59.907+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:48:59.906+0200
2022-01-26T22:48:59.907+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:48:59.907+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [10s elapsed]
2022-01-26T22:49:03.908+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:03.908+0200
2022-01-26T22:49:04.539+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:04.538+0200
2022-01-26T22:49:04.539+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:04.538+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [20s elapsed]
2022-01-26T22:49:12.543+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:12.543+0200
2022-01-26T22:49:13.174+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:13.174+0200
2022-01-26T22:49:13.175+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:13.174+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [30s elapsed]
2022-01-26T22:49:23.178+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:23.178+0200
2022-01-26T22:49:23.870+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:23.870+0200
2022-01-26T22:49:23.870+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:23.870+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [40s elapsed]
2022-01-26T22:49:33.876+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:33.875+0200
2022-01-26T22:49:34.645+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:34.645+0200
2022-01-26T22:49:34.645+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:34.645+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [50s elapsed]
2022-01-26T22:49:44.649+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:44.649+0200
2022-01-26T22:49:44.777+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": {
"data": "s3a://excorp-datalake.tst",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:44.777+0200
2022-01-26T22:49:44.777+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:44.777+0200
2022-01-26T22:49:44.903+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "d6da4897-da46-4016-b472-6f414a2bb23e",
"results": {
"data": "s3a://excorp-datalake.tst",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:44.903+0200
2022-01-26T22:49:44.903+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/destroy {
"clusterId": "0124-131107-wp72cg3w",
"contextId": "474029759960120544"
}: timestamp=2022-01-26T22:49:44.903+0200
2022-01-26T22:49:45.065+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "474029759960120544"
} <- POST /api/1.2/contexts/destroy: timestamp=2022-01-26T22:49:45.065+0200
2022-01-26T22:49:45.065+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/2.0/clusters/get: timestamp=2022-01-26T22:49:45.065+0200
2022-01-26T22:49:45.168+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"autotermination_minutes": 10,
"aws_attributes": {
"availability": "SPOT",
"first_on_demand": 0,
"instance_profile_arn": "arn:aws:iam::786743331197:instance-profile/tst-sbx-databricks-instance-profile",
"spot_bid_price_percent": 100,
"zone_id": "eu-central-1a"
},
"cluster_cores": 2,
"cluster_id": "0124-131107-wp72cg3w",
"cluster_memory_mb": 8192,
"cluster_name": "terraform-mount-tst-sbx-databricks-instance-profile",
"cluster_source": "API",
"creator_user_name": "databricks-admins@excorp.com",
"custom_tags": {
"ResourceClass": "SingleNode"
},
"default_tags": {
"ClusterId": "0124-131107-wp72cg3w",
"ClusterName": "terraform-mount-tst-sbx-databricks-instance-profile",
"Creator": "databricks-admins@excorp.com",
"Vendor": "Databricks"
},
"disk_spec": {},
"driver": {
"host_private_ip": "10.124.36.236",
"instance_id": "i-0015f7d07ff5ff7f6",
"node_aws_attributes": {
"is_spot": true
},
"node_id": "2447cb6688114d86b98ed4aa1... (815 more bytes) <- GET /api/2.0/clusters/get: timestamp=2022-01-26T22:49:45.167+0200
2022-01-26T22:49:45.168+0200 [INFO] provider.terraform-provider-databricks_v0.4.6: Executing python command on 0124-131107-wp72cg3w:
dbutils.fs.refreshMounts()
for mount in dbutils.fs.mounts():
if mount.mountPoint == "/mnt/dev-sbx-excorp-datalake.tst":
dbutils.notebook.exit(mount.source)
raise Exception("Mount not found"): timestamp=2022-01-26T22:49:45.168+0200
2022-01-26T22:49:45.168+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/create {
"clusterId": "0124-131107-wp72cg3w",
"language": "python"
}: timestamp=2022-01-26T22:49:45.168+0200
2022-01-26T22:49:45.305+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "376144934921395427"
} <- POST /api/1.2/contexts/create: timestamp=2022-01-26T22:49:45.305+0200
2022-01-26T22:49:45.305+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:49:45.305+0200
2022-01-26T22:49:45.305+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:49:45.305+0200
2022-01-26T22:49:45.437+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "376144934921395427",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:49:45.437+0200
2022-01-26T22:49:45.937+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:49:45.937+0200
2022-01-26T22:49:46.073+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "376144934921395427",
"status": "Pending"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:49:46.073+0200
2022-01-26T22:49:47.077+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/contexts/status: timestamp=2022-01-26T22:49:47.077+0200
2022-01-26T22:49:47.182+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "376144934921395427",
"status": "Running"
} <- GET /api/1.2/contexts/status: timestamp=2022-01-26T22:49:47.181+0200
2022-01-26T22:49:47.182+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/commands/execute {
"clusterId": "0124-131107-wp72cg3w",
"command": "dbutils.fs.refreshMounts()\nfor mount in dbutils.fs.mounts():\n if mount.mountPoint == \"/mnt/de... (107 more bytes)",
"contextId": "376144934921395427",
"language": "python"
}: timestamp=2022-01-26T22:49:47.182+0200
2022-01-26T22:49:47.321+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7"
} <- POST /api/1.2/commands/execute: timestamp=2022-01-26T22:49:47.321+0200
2022-01-26T22:49:47.322+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Waiting for state to become: [success]: timestamp=2022-01-26T22:49:47.321+0200
2022-01-26T22:49:47.322+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:47.321+0200
2022-01-26T22:49:47.957+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:47.957+0200
2022-01-26T22:49:47.957+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:47.957+0200
2022-01-26T22:49:48.460+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:48.460+0200
2022-01-26T22:49:49.066+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:49.066+0200
2022-01-26T22:49:49.066+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:49.066+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [1m0s elapsed]
2022-01-26T22:49:50.071+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:50.071+0200
2022-01-26T22:49:50.706+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:50.706+0200
2022-01-26T22:49:50.706+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:50.706+0200
2022-01-26T22:49:52.712+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:52.711+0200
2022-01-26T22:49:53.334+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:53.334+0200
2022-01-26T22:49:53.334+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:53.334+0200
2022-01-26T22:49:57.338+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:57.338+0200
2022-01-26T22:49:57.978+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:49:57.978+0200
2022-01-26T22:49:57.978+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:49:57.978+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [1m10s elapsed]
2022-01-26T22:50:05.982+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:50:05.982+0200
2022-01-26T22:50:06.594+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": null,
"status": "Running"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:50:06.594+0200
2022-01-26T22:50:06.595+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: Command is in Running state: timestamp=2022-01-26T22:50:06.594+0200
databricks_mount.this["excorp-datalake.tst"]: Still creating... [1m20s elapsed]
2022-01-26T22:50:16.617+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:50:16.617+0200
2022-01-26T22:50:16.756+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": {
"data": "s3a://excorp-datalake.tst",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:50:16.755+0200
2022-01-26T22:50:16.756+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: GET /api/1.2/commands/status: timestamp=2022-01-26T22:50:16.756+0200
2022-01-26T22:50:16.919+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "92966b64-8540-43ad-9639-74f7235e91b7",
"results": {
"data": "s3a://excorp-datalake.tst",
"resultType": "text"
},
"status": "Finished"
} <- GET /api/1.2/commands/status: timestamp=2022-01-26T22:50:16.919+0200
2022-01-26T22:50:16.919+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: POST /api/1.2/contexts/destroy {
"clusterId": "0124-131107-wp72cg3w",
"contextId": "376144934921395427"
}: timestamp=2022-01-26T22:50:16.919+0200
2022-01-26T22:50:17.022+0200 [DEBUG] provider.terraform-provider-databricks_v0.4.6: 200 OK {
"id": "376144934921395427"
} <- POST /api/1.2/contexts/destroy: timestamp=2022-01-26T22:50:17.022+0200
2022-01-26T22:50:17.029+0200 [WARN] Provider "provider[\"registry.terraform.io/databrickslabs/databricks\"]" produced an unexpected new value for databricks_mount.this["excorp-datalake.tst"], but we are tolerating it because it is using the legacy plugin SDK.
The following problems may be the cause of any confusing errors from downstream operations:
- .cluster_id: was cty.StringVal("0124-111617-wk902x94"), but now cty.StringVal("0124-131107-wp72cg3w")
databricks_mount.this["excorp-datalake.tst"]: Creation complete after 1m27s [id=dev-sbx-excorp-datalake.tst]
2022-01-26T22:50:17.038+0200 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-01-26T22:50:17.041+0200 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/databrickslabs/databricks/0.4.6/darwin_amd64/terraform-provider-databricks_v0.4.6 pid=54694
2022-01-26T22:50:17.041+0200 [DEBUG] provider: plugin exited

Apply complete! Resources: 1 added, 0 changed, 1 destroyed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment