"error while writing out vendor tree" on dep init for aws-sdk-go

[torbjornvatn]

What version of dep are you using (dep version)?

dep:
 version     : devel
 build date  :
 git hash    :
 go version  : go1.9
 go compiler : gc
 platform    : darwin/amd64

Since this is blank I checked the the homebrew folder and it's: /usr/local/Cellar/dep/0.3.1

What dep command did you run?

> dep init -v

Getting direct dependencies...
Checked 33 directories for packages.
Found 19 direct dependencies.
^[^[Root project is "github.com/unacast/shipit"
 22 transitively valid internal packages
 29 external packages imported from 19 projects
(0)   ✓ select (root)
(1)	? attempt github.com/codeship/go-retro with 1 pkgs; 1 versions to try
(1)	    try github.com/codeship/go-retro@master
(1)	✓ select github.com/codeship/go-retro@master w/1 pkgs
(2)	? attempt github.com/unacast/migrations with 1 pkgs; 1 versions to try
(2)	    try github.com/unacast/migrations@master
(2)	✓ select github.com/unacast/migrations@master w/1 pkgs
(3)	? attempt github.com/unacast/feeds with 1 pkgs; 1 versions to try
(3)	    try github.com/unacast/feeds@master
(3)	✓ select github.com/unacast/feeds@master w/1 pkgs
(4)	? attempt golang.org/x/crypto with 1 pkgs; 1 versions to try
(4)	    try golang.org/x/crypto@master
(4)	✓ select golang.org/x/crypto@master w/4 pkgs
(5)	? attempt github.com/fatih/structs with 1 pkgs; 3 versions to try
(5)	    try github.com/fatih/structs@v1.0
(5)	✓ select github.com/fatih/structs@v1.0 w/1 pkgs
(6)	? attempt github.com/getsentry/raven-go with 1 pkgs; 2 versions to try
(6)	    try github.com/getsentry/raven-go@master
(6)	✓ select github.com/getsentry/raven-go@master w/1 pkgs
(7)	? attempt github.com/unacast/logger with 1 pkgs; 2 versions to try
(7)	    try github.com/unacast/logger@master
(7)	✓ select github.com/unacast/logger@master w/1 pkgs
(8)	? attempt github.com/aiquestion/cronexpr with 1 pkgs; 3 versions to try
(8)	    try github.com/aiquestion/cronexpr@1.0.0
(8)	✓ select github.com/aiquestion/cronexpr@1.0.0 w/1 pkgs
(9)	? attempt golang.org/x/oauth2 with 1 pkgs; 1 versions to try
(9)	    try golang.org/x/oauth2@master
(9)	✓ select golang.org/x/oauth2@master w/5 pkgs
(10)  ? attempt google.golang.org/appengine with 2 pkgs; 2 versions to try
(10)      try google.golang.org/appengine@v1.0.0
(10)  ✓ select google.golang.org/appengine@v1.0.0 w/10 pkgs
(11)  ? attempt github.com/golang/protobuf with 1 pkgs; 1 versions to try
(11)      try github.com/golang/protobuf@master
(11)  ✓ select github.com/golang/protobuf@master w/1 pkgs
(12)  ? attempt golang.org/x/net with 1 pkgs; 5 versions to try
(12)      try golang.org/x/net@master
(12)  ✓ select golang.org/x/net@master w/1 pkgs
(13)  ? attempt github.com/GoogleCloudPlatform/cloudsql-proxy with 1 pkgs; 7 versions to try
(13)      try github.com/GoogleCloudPlatform/cloudsql-proxy@1.10
(13)  ✓ select github.com/GoogleCloudPlatform/cloudsql-proxy@1.10 w/5 pkgs
(14)  ? attempt github.com/mgutz/logxi with 1 pkgs; 7 versions to try
(14)      try github.com/mgutz/logxi@v1
(14)  ✓ select github.com/mgutz/logxi@v1 w/1 pkgs
(15)  ? attempt github.com/mgutz/ansi with 1 pkgs; 1 versions to try
(15)      try github.com/mgutz/ansi@master
(15)  ✓ select github.com/mgutz/ansi@master w/1 pkgs
(16)  ? revisit golang.org/x/net to add 1 pkgs
(16)    ✓ include 2 more pkgs from golang.org/x/net@master
(16)  ? attempt github.com/aws/aws-sdk-go with 5 pkgs; 274 versions to try
(17)      try github.com/aws/aws-sdk-go@v1.10.49
(17)  ✓ select github.com/aws/aws-sdk-go@v1.10.49 w/25 pkgs
(17)  ? attempt github.com/kr/pretty with 1 pkgs; 36 versions to try
(18)      try github.com/kr/pretty@master
(18)  ✓ select github.com/kr/pretty@master w/1 pkgs
(18)  ? attempt google.golang.org/api with 3 pkgs; 2 versions to try
(19)      try google.golang.org/api@master
(19)  ✓ select google.golang.org/api@master w/5 pkgs
(19)  ? attempt github.com/certifi/gocertifi with 1 pkgs; 10 versions to try
(20)      try github.com/certifi/gocertifi@2017.07.27
(20)  ✓ select github.com/certifi/gocertifi@2017.07.27 w/1 pkgs
(20)  ? attempt github.com/gima/govalid with 1 pkgs; 2 versions to try
(21)      try github.com/gima/govalid@master
(21)  ✓ select github.com/gima/govalid@master w/2 pkgs
(21)  ? attempt github.com/pkg/errors with 1 pkgs; 11 versions to try
(22)      try github.com/pkg/errors@v0.8.0
(22)  ✓ select github.com/pkg/errors@v0.8.0 w/1 pkgs
(22)  ? attempt github.com/go-sql-driver/mysql with 1 pkgs; 18 versions to try
(23)      try github.com/go-sql-driver/mysql@v1.3
(23)  ✓ select github.com/go-sql-driver/mysql@v1.3 w/1 pkgs
(23)  ? attempt github.com/jmespath/go-jmespath with 1 pkgs; 15 versions to try
(24)      try github.com/jmespath/go-jmespath@0.2.2
(24)  ✓ select github.com/jmespath/go-jmespath@0.2.2 w/1 pkgs
(24)  ? attempt github.com/kr/text with 1 pkgs; 4 versions to try
(25)      try github.com/kr/text@master
(25)  ✓ select github.com/kr/text@master w/1 pkgs
(25)  ? revisit google.golang.org/api to add 1 pkgs
(26)    ✓ include 4 more pkgs from google.golang.org/api@master
(25)  ? attempt github.com/mattn/go-colorable with 1 pkgs; 12 versions to try
(27)      try github.com/mattn/go-colorable@v0.0.9
(27)  ✓ select github.com/mattn/go-colorable@v0.0.9 w/1 pkgs
(26)  ? attempt github.com/goadesign/goa with 5 pkgs; 14 versions to try
(28)      try github.com/goadesign/goa@v1.3.0
(28)  ✓ select github.com/goadesign/goa@v1.3.0 w/8 pkgs
(27)  ? revisit golang.org/x/net to add 1 pkgs
(29)    ✓ include 1 more pkgs from golang.org/x/net@master
(27)  ? attempt github.com/armon/go-metrics with 1 pkgs; 1 versions to try
(30)      try github.com/armon/go-metrics@master
(30)  ✓ select github.com/armon/go-metrics@master w/1 pkgs
(28)  ? attempt github.com/hashicorp/go-immutable-radix with 1 pkgs; 2 versions to try
(31)      try github.com/hashicorp/go-immutable-radix@master
(31)  ✓ select github.com/hashicorp/go-immutable-radix@master w/1 pkgs
(29)  ? attempt github.com/dimfeld/httppath with 1 pkgs; 4 versions to try
(32)      try github.com/dimfeld/httppath@master
(32)  ✓ select github.com/dimfeld/httppath@master w/1 pkgs
(30)  ? attempt github.com/manveru/faker with 1 pkgs; 1 versions to try
(33)      try github.com/manveru/faker@master
(33)  ✓ select github.com/manveru/faker@master w/1 pkgs
(31)  ? attempt cloud.google.com/go with 1 pkgs; 18 versions to try
(34)      try cloud.google.com/go@v0.13.0
(34)  ✓ select cloud.google.com/go@v0.13.0 w/1 pkgs
(32)  ? attempt github.com/satori/go.uuid with 1 pkgs; 3 versions to try
(35)      try github.com/satori/go.uuid@v1.1.0
(35)  ✓ select github.com/satori/go.uuid@v1.1.0 w/1 pkgs
(33)  ? attempt github.com/hashicorp/golang-lru with 1 pkgs; 2 versions to try
(36)      try github.com/hashicorp/golang-lru@master
(36)  ✓ select github.com/hashicorp/golang-lru@master w/1 pkgs
(34)  ? attempt github.com/mattn/go-isatty with 1 pkgs; 4 versions to try
(37)      try github.com/mattn/go-isatty@v0.0.2
(37)  ✓ select github.com/mattn/go-isatty@v0.0.2 w/1 pkgs
(35)  ? attempt github.com/go-ini/ini with 1 pkgs; 41 versions to try
(38)      try github.com/go-ini/ini@v1.28.2
(38)  ✓ select github.com/go-ini/ini@v1.28.2 w/1 pkgs
(36)  ? attempt github.com/zach-klippenstein/goregen with 1 pkgs; 1 versions to try
(39)      try github.com/zach-klippenstein/goregen@master
(39)  ✓ select github.com/zach-klippenstein/goregen@master w/1 pkgs
(37)  ? attempt github.com/dimfeld/httptreemux with 1 pkgs; 28 versions to try
(40)      try github.com/dimfeld/httptreemux@v4.0.1
(40)  ✓ select github.com/dimfeld/httptreemux@v4.0.1 w/1 pkgs
(38)  ? attempt github.com/pkg/sftp with 1 pkgs; 7 versions to try
(41)      try github.com/pkg/sftp@1.0.0
(41)  ✓ select github.com/pkg/sftp@1.0.0 w/1 pkgs
(39)  ? attempt github.com/kr/fs with 1 pkgs; 1 versions to try
(42)      try github.com/kr/fs@master
(42)  ✓ select github.com/kr/fs@master w/1 pkgs
(40)  ? attempt golang.org/x/sys with 1 pkgs; 1 versions to try
(43)      try golang.org/x/sys@master
(43)  ✓ select golang.org/x/sys@master w/1 pkgs
  ✓ found solution with 99 packages from 40 projects

Solver wall times by segment:
     b-list-versions: 33.170175739s
         b-list-pkgs:  6.662225742s
              b-gmal:  5.724332059s
     b-source-exists:   3.16761878s
  b-deduce-proj-root:  1.143250866s
             satisfy:   29.548852ms
         select-atom:   23.701232ms
         select-root:    2.371582ms
            new-atom:    1.134761ms
               other:     162.568µs
            add-atom:      24.226µs

  TOTAL: 49.924546407s

  Using master as constraint for direct dep github.com/getsentry/raven-go
  Locking in master (1452f63) for direct dep github.com/getsentry/raven-go
  Locking in 2017.07.27 (3fd9e1a) for transitive dep github.com/certifi/gocertifi
  Locking in master (8aac270) for transitive dep github.com/hashicorp/go-immutable-radix
  Locking in master (2788f0d) for transitive dep github.com/kr/fs
  Using master as constraint for direct dep github.com/codeship/go-retro
  Locking in master (9ef97e8) for direct dep github.com/codeship/go-retro
  Locking in master (130e6b0) for transitive dep github.com/golang/protobuf
  Using ^1.3.0 as constraint for direct dep github.com/go-sql-driver/mysql
  Locking in v1.3 (a0583e0) for direct dep github.com/go-sql-driver/mysql
  Using ^1.3.0 as constraint for direct dep github.com/goadesign/goa
  Locking in v1.3.0 (5646a43) for direct dep github.com/goadesign/goa
  Locking in v0.0.2 (fc9e8d8) for transitive dep github.com/mattn/go-isatty
  Locking in v1.28.2 (20b96f6) for transitive dep github.com/go-ini/ini
  Using master as constraint for direct dep github.com/kr/pretty
  Locking in master (cfb55aa) for direct dep github.com/kr/pretty
  Using ^0.8.0 as constraint for direct dep github.com/pkg/errors
  Locking in v0.8.0 (645ef00) for direct dep github.com/pkg/errors
  Locking in 0.2.2 (3433f3e) for transitive dep github.com/jmespath/go-jmespath
  Locking in v0.13.0 (5a9e19d) for transitive dep cloud.google.com/go
  Locking in v4.0.1 (90654bd) for transitive dep github.com/dimfeld/httptreemux
  Locking in master (2320a9c) for transitive dep golang.org/x/sys
  Using master as constraint for direct dep golang.org/x/net
  Locking in master (b60f3a9) for direct dep golang.org/x/net
  Locking in v1 (aebf8a7) for transitive dep github.com/mgutz/logxi
  Using ^1.10.49 as constraint for direct dep github.com/aws/aws-sdk-go
  Locking in v1.10.49 (599f09b) for direct dep github.com/aws/aws-sdk-go
  Using master as constraint for direct dep github.com/gima/govalid
  Locking in master (5e91832) for direct dep github.com/gima/govalid
  Locking in master (ee938bf) for transitive dep github.com/dimfeld/httppath
  Locking in master (717f7cf) for transitive dep github.com/manveru/faker
  Using master as constraint for direct dep golang.org/x/crypto
  Locking in master (7d9177d) for direct dep golang.org/x/crypto
  Using master as constraint for direct dep github.com/unacast/logger
  Locking in master (4829d91) for direct dep github.com/unacast/logger
  Using ^1.10.0 as constraint for direct dep github.com/GoogleCloudPlatform/cloudsql-proxy
  Locking in 1.10 (571947b) for direct dep github.com/GoogleCloudPlatform/cloudsql-proxy
  Locking in master (0a025b7) for transitive dep github.com/hashicorp/golang-lru
  Using ^1.0.0 as constraint for direct dep github.com/pkg/sftp
  Locking in 1.0.0 (98203f5) for direct dep github.com/pkg/sftp
  Using master as constraint for direct dep github.com/unacast/migrations
  Locking in master (fcdc147) for direct dep github.com/unacast/migrations
  Using master as constraint for direct dep github.com/unacast/feeds
  Locking in master (942f3e6) for direct dep github.com/unacast/feeds
  Using master as constraint for direct dep golang.org/x/oauth2
  Locking in master (13449ad) for direct dep golang.org/x/oauth2
  Locking in master (7cafcd8) for transitive dep github.com/kr/text
  Locking in v0.0.9 (167de6b) for transitive dep github.com/mattn/go-colorable
  Locking in master (0a12dc6) for transitive dep github.com/armon/go-metrics
  Using ^1.0.0 as constraint for direct dep github.com/aiquestion/cronexpr
  Locking in 1.0.0 (a557574) for direct dep github.com/aiquestion/cronexpr
  Locking in v1.0.0 (150dc57) for transitive dep google.golang.org/appengine
  Locking in v1.1.0 (879c588) for transitive dep github.com/satori/go.uuid
  Using ^1.0.0 as constraint for direct dep github.com/fatih/structs
  Locking in v1.0 (a720dfa) for direct dep github.com/fatih/structs
  Locking in master (9520e82) for transitive dep github.com/mgutz/ansi
  Using master as constraint for direct dep google.golang.org/api
  Locking in master (586095a) for direct dep google.golang.org/api
  Locking in master (795b5e3) for transitive dep github.com/zach-klippenstein/goregen
(1/40) Wrote github.com/armon/go-metrics@master
(2/40) Wrote github.com/getsentry/raven-go@master
(3/40) Wrote github.com/dimfeld/httptreemux@v4.0.1
(4/40) Wrote github.com/aiquestion/cronexpr@1.0.0
(5/40) Wrote github.com/codeship/go-retro@master
(6/40) Wrote github.com/go-sql-driver/mysql@v1.3
(7/40) Wrote github.com/fatih/structs@v1.0
(8/40) Wrote github.com/dimfeld/httppath@master
(9/40) Wrote github.com/pkg/errors@v0.8.0
(10/40) Wrote github.com/hashicorp/go-immutable-radix@master
(11/40) Wrote github.com/mgutz/ansi@master
(12/40) Wrote github.com/mgutz/logxi@v1
(13/40) Wrote github.com/gima/govalid@master
(14/40) Wrote github.com/GoogleCloudPlatform/cloudsql-proxy@1.10
(15/40) Wrote github.com/manveru/faker@master
(16/40) Wrote google.golang.org/appengine@v1.0.0
(17/40) Wrote github.com/kr/text@master
(18/40) Wrote github.com/go-ini/ini@v1.28.2
(19/40) Wrote github.com/kr/pretty@master
(20/40) Wrote github.com/hashicorp/golang-lru@master
(21/40) Wrote github.com/golang/protobuf@master
(22/40) Wrote github.com/satori/go.uuid@v1.1.0
(23/40) Wrote github.com/unacast/feeds@master
(24/40) Wrote github.com/mattn/go-colorable@v0.0.9
(25/40) Wrote github.com/unacast/logger@master
(26/40) Wrote github.com/zach-klippenstein/goregen@master
(27/40) Wrote github.com/pkg/sftp@1.0.0
(28/40) Wrote github.com/kr/fs@master
(29/40) Wrote github.com/goadesign/goa@v1.3.0
(30/40) Wrote github.com/mattn/go-isatty@v0.0.2
(31/40) Wrote github.com/certifi/gocertifi@2017.07.27
(32/40) Wrote github.com/unacast/migrations@master
(33/40) Wrote golang.org/x/oauth2@master
(34/40) Wrote cloud.google.com/go@v0.13.0
(35/40) Wrote github.com/jmespath/go-jmespath@0.2.2
(36/40) Wrote golang.org/x/crypto@master
(37/40) Wrote golang.org/x/sys@master
(38/40) Wrote golang.org/x/net@master
(39/40) Wrote google.golang.org/api@master
(40/40) Failed to write github.com/aws/aws-sdk-go@v1.10.49
safe write of manifest and lock: error while writing out vendor tree: failed to write dep tree: failed to export github.com/aws/aws-sdk-go: /var/folders/cc/hbpdq7fd06n87nf2zm_g3bfr0000gn/T/dep777762181/vendor/github.com/aws/aws-sdk-go/models/apis/greengrass/2017-06-07/api-2.json already exists, no checkout
/var/folders/cc/hbpdq7fd06n87nf2zm_g3bfr0000gn/T/dep777762181/vendor/github.com/aws/aws-sdk-go/models/apis/greengrass/2017-06-07/docs-2.json already exists, no checkout
: exit status 128

What did you expect to see?

That all the deps were installed

What did you see instead?

An error while writing out vendor tree error message that says that github.com/aws/aws-sdk-go/models/apis/greengrass/2017-06-07/api-2.json already exists in a /var/folders/... folder

[sdboyer]

hiya! yeah, this one's an upstream problem, somebody committed directories that vary only by case name. nothing dep can actually do about it. upstream issue is here: aws/aws-sdk-go#1540 - seems like it should be fixed soon. in the meantime, you may have an easier time if you check out github.com/aws/aws-sdk-go to a commit that works on your GOPATH, and init using dep init -gopath. that may help, but it's a fairly big sledgehammer, so i can't promise it won't have other effects.

(closing as this is out of our scope of responsiblity)

[brikis98]

It looks like this is happening again with the latest AWS Go SDK. I filed aws/aws-sdk-go#1688 for it.

[sdboyer]

@brikis98 thanks for doing that. i think someone else is filing a new issue on our side, too.

[ronnylt]

It's happening again: aws/aws-sdk-go#1755