plugin error 1: open /Users/me/.terraform.d/plugins/darwin_amd64: no such file or directory [Terraform Version v0.13.0]

[jjorissen52]

I am seeing the same issue as indicated in #184 when using terraformer with plugins initiated by terraform v0.13.0

0. brew uninstall terraformer && brew install terraformer (version 0.8.8 installed)
1. Make directory, cd
2. init.tf:

provider "google" {
  version = "~> 3.35"
  project_id = "credible-torus-262216"
}

3. terraform init
4. terraformer import google ...

2020/08/22 00:32:34 google importing... 
2020/08/22 00:32:35 open /Users/me/.terraform.d/plugins/darwin_amd64: no such file or directory

Terraform version:

Terraform v0.13.0
+ provider registry.terraform.io/hashicorp/google v3.35.0

Note that this error does not occur for previous versions of terraform, e.g.

Terraform v0.12.10
+ provider.google v3.35.0

[chenrui333]

@jjorissen52 give brew uninstall terraformer and brew install --HEAD terraformer a shot, I fixed the head build recently.

[maxim-clc]

Similar issue on Linux (Ubuntu 20.04) with direct install from GitHub.

Error:
2020/08/26 13:32:10 aws importing default region
2020-08-26T13:32:10.601-0700 [INFO] plugin: configuring client automatic mTLS
2020-08-26T13:32:10.661-0700 [DEBUG] plugin: starting plugin: path= args=[]
2020/08/26 13:32:10 fork/exec : no such file or directory

Layout:
drwxrwxr-x 4 user user 4096 Aug 26 13:33 .
drwxrwxr-x 4 user user 4096 Aug 26 13:26 ..]
-rw-rw-r-- 1 user user 18 Aug 26 13:27 init.tf
drwxr-xr-x 3 user user 4096 Aug 26 13:27 .terraform
drwxr-xr-x 3 user user 4096 Aug 26 13:27 .terraform.d

[ Yes, I did created two redundant dirs out of despair - still "terraformer" can't find what is looking for. ]

strace result:
strace -f -t -e trace=file,open,read terraformer import aws --resources=route53,vpc,subnet -v 2>&1

strace ---------- START ------------

[pid 2198941] 13:38:04 readlinkat(AT_FDCWD, "/proc/self/exe", "/usr/local/bin/terraformer", 128) = 26
[pid 2198941] 13:38:04 openat(AT_FDCWD, "/usr/local/bin/terraformer", O_RDONLY|O_CLOEXEC) = 3
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198944] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198945] 13:38:04 read(5, "\0", 16) = 1
[pid 2198941] 13:38:04 openat(AT_FDCWD, "/etc/localtime", O_RDONLY) = 3
[pid 2198941] 13:38:04 read(3, "TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\5\0\0\0\5\0\0\0\0"..., 4096) = 2836
[pid 2198941] 13:38:04 read(3, "", 4096) = 0
2020/08/26 13:38:04 aws importing default region
[pid 2198941] 13:38:04 openat(AT_FDCWD, ".terraform/plugins/linux_amd64", O_RDONLY|O_CLOEXEC) = 3
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/ns1", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/vultr", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/keycloak", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/cloudflare", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/commercetools", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/yandex", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/heroku", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/alicloud", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/aws", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/datadog", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/rabbitmq", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/octopusdeploy", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/openstack", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/azure", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/kubernetes", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/gcp", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/mikrotik", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/linode", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/newrelic", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/logzio", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/github", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/fastly", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/digitalocean", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
[pid 2198941] 13:38:04 newfstatat(AT_FDCWD, ".terraform/plugins/linux_amd64/gmailfilter", {st_mode=S_IFDIR|0775, st_size=4096, ...}, AT_SYMLINK_NOFOLLOW) = 0
2020-08-26T13:38:04.726-0700 [INFO] plugin: configuring client automatic mTLS
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198946] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198946] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198946] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198946] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198945] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198945] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198945] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198943] 13:38:04 read(5, "\0", 16) = 1
[pid 2198945] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198945] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198944] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198941] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198943] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198943] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198943] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198943] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198943] 13:38:04 read(5, "\0", 16) = 1
2020-08-26T13:38:04.790-0700 [DEBUG] plugin: starting plugin: path= args=[]
strace: Process 2198948 attached
[pid 2198948] 13:38:04 execve("", [""], 0xc0000bc5a0 /* 32 vars */) = -1 ENOENT (No such file or directory)
[pid 2198948] 13:38:04 +++ exited with 253 +++
[pid 2198946] 13:38:04 --- SIGURG {si_signo=SIGURG, si_code=SI_TKILL, si_pid=2198941, si_uid=1000} ---
[pid 2198941] 13:38:04 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=2198948, si_uid=1000, si_status=253, si_utime=0, si_stime=0} ---
[pid 2198946] 13:38:04 read(10, "\2\0\0\0\0\0\0\0", 8) = 8
2020/08/26 13:38:04 fork/exec : no such file or directory
[pid 2198947] 13:38:04 +++ exited with 1 +++
[pid 2198946] 13:38:04 +++ exited with 1 +++
[pid 2198945] 13:38:04 +++ exited with 1 +++
[pid 2198944] 13:38:04 +++ exited with 1 +++
[pid 2198943] 13:38:04 +++ exited with 1 +++
[pid 2198942] 13:38:04 +++ exited with 1 +++
13:38:04 +++ exited with 1 +++

strace ------ END ------

However, the directory exists:

ls -lh .terraform/plugins/linux_amd64/aws/{vpc,subnet,route53}.go
total 392K
-rwxrwxr-x 1 user user 4551 Aug 25 12:11 .terraform/plugins/linux_amd64/aws/route53.go*
-rwxrwxr-x 1 user user 1881 Aug 25 12:11 .terraform/plugins/linux_amd64/aws/subnet.go*
-rwxrwxr-x 1 user user 1726 Aug 25 12:11 .terraform/plugins/linux_amd64/aws/vpc.go*
......

It would help to have clear indication by the app where "terraformer" really expects for plugins dir to exist and not just fail in esoteric - fork/exec - way. Is it /home/user dir? Is it local dir where execution takes place? Elsewhere?

[jjorissen52]

I believe that the issue stems from the fact that Terrafrom 0.13+ installs plugins to a different path than Terraform < 0.13.

[ThomasGHenry]

Moving back to terraform 0.12 resolved this for me.

[maxim-clc]

Appreciate feedback. Confirming that this is indeed the case. Moving Terraform to latest 0.12.29 changed the terraformer behavior. Good as a work around, however, probably this issue needs attention in a future.

[yashshah]

Is there any way to get this plugin working with Terraform v0.13?

[alexjmoore]

The issue might be here:

terraformer/terraformutils/providerwrapper/provider.go

Line 244 in 8be92a9

pluginPath := defaultDataDir + string(os.PathSeparator) + "plugins" + string(os.PathSeparator) + runtime.GOOS + "_" + runtime.GOARCH

This seems to assume to search in a flat structure here:

.terraform/plugins/darwin_amd64

But in reality in 0.13 this should now be searching through a registry structure, so now the provider appears here (using azurerm as an example):

.terraform/plugins/registry.terraform.io/hashicorp/azurerm/2.20.0/darwin_amd64

So this code just needs to be updated to account for this new registry/version structure I believe.

More details here:

https://www.terraform.io/upgrade-guides/0-13.html#new-filesystem-layout-for-local-copies-of-providers

[patrykorwat]

To ensure backwards compatibility, the tool should check two paths. Thanks for the feedback!

Yesterday I found out Terraform changed how they define version definition in 0.13 - https://www.terraform.io/docs/configuration/provider-requirements.html
Started working on the change.

[v1bh0r]

Here's what I had to do in order to get it working.

1. Created the path ~/.terraform.d/plugins/darwin_amd64
2. Downloaded https://releases.hashicorp.com/terraform-provider-google/, extracted the package, copied the file in ~/.terraform.d/plugins/darwin_amd64 as terraform-provider-google.
3. chmod +x ~/.terraform.d/plugins/darwin_amd64/terraform-provider-google
4. I had to manually open the executable manually once in order to get rid of the Mac malicious executable warning.