Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Go get takes a long time #80

Open
cuminandpaprika opened this issue Jun 26, 2020 · 1 comment
Open

Go get takes a long time #80

cuminandpaprika opened this issue Jun 26, 2020 · 1 comment

Comments

@cuminandpaprika
Copy link
Contributor

In a fresh install, go get seems to take 6 minutes to get all dependencies

Replicate:

  • docker run -it golang:alpine3.11 /bin/sh
  • apk add --no-cache git
  • cd ..
  • go get -u -v github.com/anz-bank/sysl-catalog

Notably, the modules that take the longest seem to be

  • github.com/anz-bank/sysl-catalog
  • github.com/go-openapi/swag
  • github.com/gohugoio/hugo

Looking in the commit history, perhaps we can reduce the repo size of sysl-catalog.
In addition, we could look at replacing the github.com/gohugoio/hugo import with something smaller

@cuminandpaprika
Copy link
Contributor Author

Running goweight https://github.com/jondot/goweight produces the following output, which is quite enlightening and gives a list of targets to trim down

31 MB github.com/anz-bank/sysl/pkg/grammar
  4.4 MB github.com/antlr/antlr4/runtime/Go/antlr
  4.0 MB net/http
  3.9 MB runtime
  3.4 MB google.golang.org/protobuf/internal/impl
  2.8 MB github.com/anz-bank/sysl/pkg/parse
  2.3 MB github.com/chromedp/cdproto/page
  2.0 MB github.com/yuin/goldmark/util
  2.0 MB github.com/chromedp/cdproto/network
  1.9 MB github.com/chromedp/cdproto/dom
  1.8 MB crypto/tls
  1.8 MB net
  1.6 MB gopkg.in/alecthomas/kingpin.v2
  1.5 MB github.com/chromedp/cdproto/debugger
  1.4 MB github.com/chromedp/cdproto/css
  1.4 MB reflect
  1.4 MB github.com/chromedp/cdproto/runtime
  1.4 MB github.com/anz-bank/sysl/pkg/sysl
  1.2 MB gopkg.in/yaml.v3
  1.2 MB google.golang.org/protobuf/internal/filedesc
  1.2 MB github.com/yuin/goldmark/parser
  1.1 MB gopkg.in/yaml.v2
  1.1 MB github.com/getkin/kin-openapi/openapi3
  1.1 MB github.com/anz-bank/mermaid-go/mermaid
  1.0 MB math/big
  1.0 MB golang.org/x/sys/unix
  913 kB github.com/stretchr/objx
  901 kB github.com/yuin/goldmark/ast
  895 kB github.com/chromedp/chromedp
  881 kB github.com/yuin/goldmark/extension
  880 kB crypto/x509
  869 kB syscall
  813 kB github.com/chromedp/cdproto/emulation
  802 kB github.com/stretchr/testify/assert
  797 kB github.com/alecthomas/template
  756 kB github.com/spf13/afero
  739 kB github.com/anz-bank/sysl-catalog/pkg/catalog
  737 kB github.com/chromedp/cdproto/overlay
  721 kB github.com/golang/protobuf/proto
  718 kB github.com/chromedp/cdproto/target
  717 kB github.com/chromedp/cdproto/profiler
  705 kB text/template
  705 kB text/template/parse
  690 kB golang.org/x/net/html
  681 kB github.com/chromedp/cdproto/browser
  677 kB github.com/anz-bank/sysl/pkg/cmdutils
  671 kB encoding/xml
  670 kB encoding/json
  650 kB github.com/anz-bank/sysl/pkg/importer
  638 kB github.com/alecthomas/template/parse
  633 kB go/ast
  621 kB vendor/golang.org/x/net/dns/dnsmessage
  617 kB google.golang.org/protobuf/reflect/protoreflect
  615 kB github.com/gorilla/websocket
  614 kB github.com/chromedp/cdproto/input
  612 kB google.golang.org/protobuf/proto
  606 kB google.golang.org/protobuf/encoding/protojson
  591 kB html/template
  561 kB github.com/go-openapi/swag
  555 kB github.com/chromedp/cdproto/audits
  545 kB vendor/golang.org/x/text/unicode/norm
  539 kB github.com/chromedp/cdproto/webaudio
  538 kB github.com/chromedp/cdproto/heapprofiler
  533 kB golang.org/x/text/unicode/norm
  524 kB github.com/chromedp/cdproto/layertree
  523 kB github.com/yuin/goldmark/extension/ast
  513 kB github.com/chromedp/cdproto/domsnapshot
  509 kB time
  507 kB github.com/chromedp/cdproto/indexeddb
  503 kB github.com/stretchr/testify/require
  497 kB github.com/Masterminds/sprig
  492 kB github.com/sirupsen/logrus
  490 kB google.golang.org/protobuf/encoding/prototext
  483 kB golang.org/x/text/internal/language
  478 kB github.com/chromedp/cdproto
  477 kB github.com/gobwas/ws
  476 kB github.com/chromedp/cdproto/fetch
  469 kB fmt
  466 kB testing
  461 kB github.com/chromedp/cdproto/serviceworker
  459 kB regexp/syntax
  456 kB go/doc
  446 kB github.com/chromedp/cdproto/animation
  432 kB github.com/yuin/goldmark/renderer/html
  429 kB aqwari.net/xml/xsd
  425 kB internal/reflectlite
  425 kB golang.org/x/text/language
  422 kB github.com/anz-bank/sysl/pkg/syslutil
  422 kB regexp
  414 kB os
  400 kB github.com/anz-bank/sysl/pkg/integrationdiagram
  395 kB github.com/chromedp/cdproto/webauthn
  392 kB github.com/chromedp/cdproto/storage
  383 kB github.com/sergi/go-diff/diffmatchpatch
  381 kB github.com/chromedp/cdproto/accessibility
  381 kB github.com/chromedp/cdproto/memory
  372 kB github.com/chromedp/cdproto/tracing
  368 kB github.com/anz-bank/sysl/pkg/datamodeldiagram
  368 kB compress/flate
  356 kB github.com/cheggaaa/pb/v3
  344 kB github.com/chromedp/cdproto/cdp
  343 kB github.com/go-chi/chi
  334 kB github.com/anz-bank/sysl/pkg/syslwrapper
  330 kB github.com/gobwas/ws/wsutil
  327 kB crypto/elliptic
  324 kB github.com/chromedp/cdproto/cachestorage
  317 kB aqwari.net/xml/xmltree
  317 kB github.com/chromedp/cdproto/domdebugger
  315 kB github.com/chromedp/cdproto/systeminfo
  311 kB vendor/golang.org/x/crypto/cryptobyte
  310 kB encoding/asn1
  296 kB github.com/chromedp/cdproto/security
  292 kB strings
  291 kB vendor/golang.org/x/text/unicode/bidi
  290 kB strconv
  286 kB github.com/hashicorp/go-retryablehttp
  282 kB google.golang.org/protobuf/internal/encoding/text
  280 kB github.com/alecthomas/assert
  272 kB github.com/chromedp/cdproto/media
  271 kB golang.org/x/text/encoding/traditionalchinese
  271 kB github.com/stretchr/testify/mock
  270 kB github.com/davecgh/go-spew/spew
  268 kB github.com/chromedp/cdproto/applicationcache
  267 kB github.com/chromedp/cdproto/domstorage
  263 kB github.com/gobwas/httphead
  262 kB os/exec
  257 kB github.com/getkin/kin-openapi/openapi2conv
  254 kB github.com/anz-bank/sysl-catalog/pkg/catalogdiagrams
  238 kB vendor/golang.org/x/net/idna
  235 kB github.com/chromedp/cdproto/log
  234 kB mime
  233 kB math
  227 kB unicode
  223 kB flag
  219 kB internal/poll
  218 kB bytes
  216 kB github.com/chromedp/cdproto/backgroundservice
  216 kB github.com/mailru/easyjson/jlexer
  207 kB encoding/binary
  205 kB github.com/chromedp/cdproto/database
  202 kB vendor/golang.org/x/net/http2/hpack
  200 kB google.golang.org/protobuf/reflect/protoregistry
  198 kB google.golang.org/protobuf/internal/encoding/json
  197 kB crypto/rsa
  197 kB github.com/anz-bank/sysl/pkg/sequencediagram
  196 kB net/http/httptest
  189 kB vendor/golang.org/x/net/route
  185 kB net/url
  184 kB database/sql/driver
  184 kB crypto/ed25519/internal/edwards25519
  183 kB bufio
  182 kB net/textproto
  182 kB html
  180 kB google.golang.org/protobuf/internal/filetype
  180 kB github.com/huandu/xstrings
  178 kB github.com/radovskyb/watcher
  178 kB mime/multipart
  177 kB golang.org/x/text/encoding/simplifiedchinese
  171 kB github.com/chromedp/cdproto/cast
  170 kB golang.org/x/text/encoding/japanese
  168 kB github.com/yuin/goldmark/text
  166 kB github.com/anz-bank/sysl/pkg/loader
  165 kB github.com/chromedp/cdproto/headlessexperimental
  163 kB sync
  159 kB github.com/chromedp/cdproto/performance
  155 kB github.com/pmezard/go-difflib/difflib
  155 kB github.com/anz-bank/protoc-gen-sysl/newsysl
  154 kB github.com/cornelk/hashmap
  150 kB github.com/Masterminds/semver
  149 kB golang.org/x/text/encoding/charmap
  149 kB github.com/ghodss/yaml
  148 kB crypto/cipher
  147 kB github.com/getkin/kin-openapi/jsoninfo
  146 kB golang.org/x/text/internal/language/compact
  144 kB golang.org/x/text/encoding/korean
  142 kB github.com/imdario/mergo
  142 kB go/scanner
  136 kB github.com/anz-bank/sysl/pkg/mermaid/integrationdiagram
  136 kB github.com/spf13/afero/mem
  136 kB io
  132 kB github.com/fatih/color
  131 kB github.com/anz-bank/sysl/pkg/mermaid/sequencediagram
  128 kB github.com/google/uuid
  126 kB vendor/golang.org/x/crypto/chacha20poly1305
  126 kB github.com/anz-bank/sysl/pkg/mod
  125 kB go/token
  125 kB github.com/chromedp/cdproto/io
  125 kB github.com/anz-bank/sysl/pkg/mermaid/datamodeldiagram
  124 kB github.com/mitchellh/copystructure
  120 kB sort
  120 kB google.golang.org/protobuf/internal/descfmt
  119 kB github.com/getkin/kin-openapi/openapi2
  118 kB vendor/golang.org/x/text/transform
  118 kB golang.org/x/text/runes
  117 kB github.com/chromedp/cdproto/inspector
  116 kB golang.org/x/text/transform
  116 kB github.com/anz-bank/sysl/pkg/diagrams
  116 kB github.com/chromedp/chromedp/kb
  112 kB golang.org/x/text/encoding
  111 kB math/rand
  111 kB crypto/aes
  111 kB github.com/anz-bank/sysl/pkg/mermaid/endpointanalysisdiagram
  110 kB github.com/gohugoio/hugo/livereload
  110 kB golang.org/x/text/encoding/unicode
  108 kB path/filepath
  108 kB context
  106 kB crypto/ecdsa
  106 kB github.com/alecthomas/repr
  103 kB vendor/golang.org/x/crypto/curve25519
   94 kB github.com/mailru/easyjson/jwriter
   87 kB github.com/pkg/errors
   84 kB crypto/sha512
   82 kB github.com/Masterminds/goutils
   80 kB github.com/mailru/easyjson
   79 kB encoding/base64
   79 kB crypto/x509/pkix
   78 kB compress/gzip
   78 kB vendor/golang.org/x/net/http/httpproxy
   78 kB google.golang.org/protobuf/runtime/protoimpl
   76 kB hash/fnv
   76 kB github.com/yuin/goldmark
   75 kB github.com/alecthomas/colour
   75 kB github.com/mitchellh/reflectwalk
   74 kB crypto/sha256
   74 kB io/ioutil
   74 kB github.com/hashicorp/go-cleanhttp
   74 kB github.com/chromedp/cdproto/tethering
   70 kB vendor/golang.org/x/crypto/chacha20
   70 kB google.golang.org/protobuf/internal/encoding/tag
   69 kB crypto/sha1
   69 kB github.com/mattn/go-runewidth
   68 kB net/http/internal
   66 kB crypto/rand
   66 kB vendor/golang.org/x/crypto/poly1305
   66 kB golang.org/x/text/encoding/htmlindex
   65 kB github.com/yuin/goldmark/renderer
   64 kB encoding/base32
   63 kB net/http/httptrace
   63 kB google.golang.org/protobuf/internal/encoding/messageset
   63 kB github.com/chromedp/cdproto/deviceorientation
   63 kB log
   63 kB golang.org/x/net/html/charset
   60 kB google.golang.org/protobuf/internal/strs
   60 kB hash/crc32
   59 kB container/list
   58 kB encoding/pem
   57 kB google.golang.org/protobuf/runtime/protoiface
   54 kB crypto/des
   54 kB internal/fmtsort
   52 kB google.golang.org/protobuf/encoding/protowire
   52 kB compress/zlib
   52 kB os/signal
   51 kB google.golang.org/protobuf/internal/encoding/defval
   51 kB crypto/md5
   48 kB mime/quotedprintable
   48 kB encoding/hex
   48 kB crypto/dsa
   47 kB golang.org/x/net/html/atom
   45 kB github.com/anz-bank/sysl/pkg/msg
   45 kB github.com/mailru/easyjson/buffer
   44 kB github.com/alecthomas/units
   43 kB vendor/golang.org/x/text/secure/bidirule
   42 kB math/bits
   42 kB runtime/debug
   42 kB github.com/chromedp/chromedp/device
   40 kB runtime/cgo
   39 kB github.com/gobwas/pool/pbufio
   39 kB crypto/ed25519
   37 kB vendor/golang.org/x/sys/cpu
   36 kB runtime/trace
   36 kB golang.org/x/text/encoding/internal
   36 kB path
   36 kB github.com/gobwas/pool
   35 kB internal/cpu
   35 kB internal/lazyregexp
   34 kB vendor/golang.org/x/net/http/httpguts
   31 kB github.com/dchest/siphash
   31 kB golang.org/x/crypto/scrypt
   31 kB google.golang.org/protobuf/internal/errors
   30 kB github.com/cheggaaa/pb/v3/termutil
   29 kB internal/singleflight
   29 kB golang.org/x/text/encoding/internal/identifier
   28 kB errors
   28 kB unicode/utf8
   28 kB github.com/iancoleman/strcase
   26 kB github.com/mattn/go-colorable
   26 kB google.golang.org/protobuf/internal/fieldnum
   26 kB google.golang.org/protobuf/internal/mapsort
   26 kB crypto
   24 kB aqwari.net/xml/internal/dependency
   24 kB github.com/gobwas/pool/pbytes
   22 kB hash/adler32
   21 kB sync/atomic
   19 kB runtime/internal/sys
   19 kB golang.org/x/text/internal/tag
   18 kB google.golang.org/protobuf/internal/set
   17 kB internal/bytealg
   16 kB github.com/VividCortex/ewma
   16 kB runtime/internal/atomic
   16 kB github.com/anz-bank/sysl-catalog/pkg/watcher
   16 kB crypto/rc4
   16 kB internal/testlog
   15 kB hash
   15 kB vendor/golang.org/x/crypto/hkdf
   14 kB github.com/knq/sysutil
   14 kB crypto/hmac
   13 kB google.golang.org/protobuf/internal/descopts
   13 kB google.golang.org/protobuf/internal/detrand
   13 kB google.golang.org/protobuf/internal/fieldsort
   12 kB google.golang.org/protobuf/internal/detectknown
  9.5 kB crypto/internal/randutil
  9.0 kB github.com/gobwas/pool/internal/pmath
  8.8 kB unicode/utf16
  8.8 kB golang.org/x/crypto/pbkdf2
  8.0 kB vendor/golang.org/x/crypto/cryptobyte/asn1
  7.4 kB internal/syscall/unix
  7.2 kB encoding
  6.7 kB crypto/subtle
  6.6 kB github.com/anz-bank/sysl/pkg/mermaid
  6.1 kB google.golang.org/protobuf/internal/pragma
  5.6 kB google.golang.org/protobuf/internal/version
  4.6 kB internal/nettrace
  4.6 kB internal/race
  4.5 kB golang.org/x/text/internal/utf8internal
  3.8 kB vendor/golang.org/x/crypto/internal/subtle
  3.7 kB github.com/mattn/go-isatty
  3.5 kB crypto/internal/subtle
  2.8 kB internal/oserror
  2.7 kB internal/syscall/execenv
  2.3 kB golang.org/x/sys/internal/unsafeheader
  1.8 kB runtime/internal/math
  1.1 kB google.golang.org/protobuf/internal/genname
   830 B google.golang.org/protobuf/internal/flags

anzopensource pushed a commit that referenced this issue Nov 10, 2020
* Add workdir to dockerfile

* Remove unused build targets

* Remove unused docker-compose
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant