Improve: make docker release 10 times faster #5803

Mmx233 · 2024-01-03T12:23:53Z

Compiling Golang in QEMU is not very efficient, and parallel compilation can lead to insufficient memory, resulting in extensive use of swap. Using Golang's cross-compilation to directly compile binaries for various architectures not only avoids the aforementioned issues but also eliminates the need for multiple downloads of dependencies.

This is a test of the action's execution status. In this CI run, in addition to the content of the current pull request, ffmpeg was also installed, resulting in a total duration of 7 minutes and 4 seconds: https://github.com/Mmx233/alist/actions/runs/7396976799/job/20123220627

welcome · 2024-01-03T12:23:56Z

Thanks for opening this pull request! Please check out our contributing guidelines.

xhofe · 2024-01-04T13:16:33Z

This doesn't seem to have cgo enabled?

Mmx233 · 2024-01-04T13:32:16Z

This doesn't seem to have cgo enabled?

CGO not support cross-compilation in default. If there is no function require CGO enabled, then keep it disabled is better. I have tested the image in linux/amd64 environment, it's running normally. And I simultaneously built Docker images for both the original configuration and the new configuration, with the new image being slightly smaller than the previous one.

xhofe · 2024-01-04T13:33:57Z

But CGO is required for sqlite3

Mmx233 · 2024-01-04T14:47:12Z

Cross-compilation has been switched to use musl gcc in cgo.

Mmx233 · 2024-01-04T14:50:05Z

The new build method for releasing docker image takes approximately 12 minutes.
https://github.com/Mmx233/alist/actions/runs/7410639734

welcome · 2024-01-05T07:52:33Z

Congrats on merging your first pull request! We here at behavior bot are proud of you!

… renovate (#17024) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [xhofe/alist](https://togithub.com/alist-org/alist) | minor | `v3.29.1` -> `v3.30.0` | --- > [!WARNING] > Some dependencies could not be looked up. Check the Dependency Dashboard for more information. --- ### Release Notes <details> <summary>alist-org/alist (xhofe/alist)</summary> ### [`v3.30.0`](https://togithub.com/alist-org/alist/releases/tag/v3.30.0) [Compare Source](https://togithub.com/alist-org/alist/compare/v3.29.1...v3.30.0) ##### 🚨 Breaking Changes - Replace regex package - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5755 [<samp>(47847)</samp>](https://togithub.com/alist-org/alist/commit/478470f) ##### 🚀 Features - Enabled `sign_all` by default - by [@xhofe](https://togithub.com/xhofe) [<samp>(54e75)</samp>](https://togithub.com/alist-org/alist/commit/54e75d7) - Add task info to resp of add task api - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5579 [<samp>(026e9)</samp>](https://togithub.com/alist-org/alist/commit/026e944) - Add support for client-side discoverable WebAuthn login - by [@huiyifyj](https://togithub.com/huiyifyj) in [alist-org/alist#5722 [<samp>(3eca3)</samp>](https://togithub.com/alist-org/alist/commit/3eca38e) - Add ldap login support - by [@JeremieCHN](https://togithub.com/JeremieCHN) in [alist-org/alist#5706 [<samp>(697a0)</samp>](https://togithub.com/alist-org/alist/commit/697a0ed) - Add `ILanzou` driver ([#5810](https://togithub.com/alist-org/alist/issues/5810) close [#5715](https://togithub.com/alist-org/alist/issues/5715)) - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5810 and [alist-org/alist#5715 [<samp>(9d5fb)</samp>](https://togithub.com/alist-org/alist/commit/9d5fb7f) - **115**: Support 302 redirect - by [@foxxorcat](https://togithub.com/foxxorcat) in [alist-org/alist#5733 [<samp>(299bf)</samp>](https://togithub.com/alist-org/alist/commit/299bfb4) - **139**: Support new personal cloud api - by [@linepro6](https://togithub.com/linepro6) and [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5690 [<samp>(de56f)</samp>](https://togithub.com/alist-org/alist/commit/de56f92) - **alipan**: Replace domain ([#5751](https://togithub.com/alist-org/alist/issues/5751) close [#5747](https://togithub.com/alist-org/alist/issues/5747)) - by [@xiaozhou26](https://togithub.com/xiaozhou26) in [alist-org/alist#5751 and [alist-org/alist#5747 [<samp>(6b8f3)</samp>](https://togithub.com/alist-org/alist/commit/6b8f35e) ##### 🐞 Bug Fixes - Add error handling for webdav mkcol according to RFC 4918 - by [@Kuingsmile](https://togithub.com/Kuingsmile) in [alist-org/alist#5581 [<samp>(f4dcf)</samp>](https://togithub.com/alist-org/alist/commit/f4dcf45) - Incorrect go-version on auto-lang - by [@xhofe](https://togithub.com/xhofe) [<samp>(f475e)</samp>](https://togithub.com/alist-org/alist/commit/f475eb4) - Task cannot be retried manually - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5599 [<samp>(66b7f)</samp>](https://togithub.com/alist-org/alist/commit/66b7fe1) - Incorrect key of oidc username - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5670 [<samp>(296be)</samp>](https://togithub.com/alist-org/alist/commit/296be88) - Retry multipart file reset ([#5693](https://togithub.com/alist-org/alist/issues/5693) close [#5628](https://togithub.com/alist-org/alist/issues/5628)) - by [@foxxorcat](https://togithub.com/foxxorcat) in [alist-org/alist#5693 and [alist-org/alist#5628 [<samp>(74b20)</samp>](https://togithub.com/alist-org/alist/commit/74b20de) - Some missing regexp lib modified - by [@xhofe](https://togithub.com/xhofe) [<samp>(57bac)</samp>](https://togithub.com/alist-org/alist/commit/57bac9e) - Panic due to send on closed channel - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5729 [<samp>(8020d)</samp>](https://togithub.com/alist-org/alist/commit/8020d42) - **115**: - Support null `UserAgent` - by [@foxxorcat](https://togithub.com/foxxorcat) in [alist-org/alist#5787 [<samp>(b5cc9)</samp>](https://togithub.com/alist-org/alist/commit/b5cc90c) - **123**: - Api sign error ([#5689](https://togithub.com/alist-org/alist/issues/5689) close [#5083](https://togithub.com/alist-org/alist/issues/5083)) - by [@tonsr](https://togithub.com/tonsr), **tangminghao** and [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5689 and [alist-org/alist#5083 [<samp>(54f7b)</samp>](https://togithub.com/alist-org/alist/commit/54f7b21) - **alist_v3**: - Timeout on upload - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5465 [<samp>(e91c4)</samp>](https://togithub.com/alist-org/alist/commit/e91c42c) - **deps**: - Update module github.com/gorilla/websocket to v1.5.1 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] and [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5770 [<samp>(182aa)</samp>](https://togithub.com/alist-org/alist/commit/182aacd) - Update golang.org/x/exp digest to [`02704c9`](https://togithub.com/alist-org/alist/commit/02704c9) \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] and [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5769 [<samp>(977b3)</samp>](https://togithub.com/alist-org/alist/commit/977b3cf) - Update module golang.org/x/crypto to v0.17.0 \[security] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5768 [<samp>(be5d9)</samp>](https://togithub.com/alist-org/alist/commit/be5d94c) - Update module google.golang.org/appengine to v1.6.8 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5772 [<samp>(a006f)</samp>](https://togithub.com/alist-org/alist/commit/a006f57) - Update module github.com/djherbis/times to v1.6.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5422 [<samp>(2c8d0)</samp>](https://togithub.com/alist-org/alist/commit/2c8d003) - Update module github.com/aws/aws-sdk-go to v1.49.13 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5774 [<samp>(bdf7a)</samp>](https://togithub.com/alist-org/alist/commit/bdf7abe) - Update module github.com/maruel/natural to v1.1.1 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5771 [<samp>(e2434)</samp>](https://togithub.com/alist-org/alist/commit/e243402) - Update module github.com/aliyun/aliyun-oss-go-sdk to v2.2.10+incompatible - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5447 [<samp>(5afd6)</samp>](https://togithub.com/alist-org/alist/commit/5afd65b) - Update module github.com/gin-contrib/cors to v1.5.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5779 [<samp>(2c153)</samp>](https://togithub.com/alist-org/alist/commit/2c15349) - Update module github.com/deckarep/golang-set/v2 to v2.6.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5778 [<samp>(8531b)</samp>](https://togithub.com/alist-org/alist/commit/8531b23) - Update module github.com/charmbracelet/bubbletea to v0.25.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5776 [<samp>(a4a96)</samp>](https://togithub.com/alist-org/alist/commit/a4a9675) - Update module github.com/charmbracelet/bubbles to v0.17.1 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5775 [<samp>(45b1f)</samp>](https://togithub.com/alist-org/alist/commit/45b1ff4) - Update module github.com/go-resty/resty/v2 to v2.11.0 - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5781 [<samp>(c3664)</samp>](https://togithub.com/alist-org/alist/commit/c36644a) - Update module github.com/go-webauthn/webauthn to v0.10.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5782 [<samp>(8a427)</samp>](https://togithub.com/alist-org/alist/commit/8a427dd) - Update module golang.org/x/time to v0.5.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5786 [<samp>(7db27)</samp>](https://togithub.com/alist-org/alist/commit/7db27e6) - Update module github.com/spf13/cobra to v1.8.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5783 [<samp>(207c7)</samp>](https://togithub.com/alist-org/alist/commit/207c7e0) - Update module golang.org/x/image to v0.14.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5784 [<samp>(b97c9)</samp>](https://togithub.com/alist-org/alist/commit/b97c917) - Update module golang.org/x/oauth2 to v0.15.0 \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5785 [<samp>(88831)</samp>](https://togithub.com/alist-org/alist/commit/88831b5) - Update golang.org/x/exp digest to [`be819d1`](https://togithub.com/alist-org/alist/commit/be819d1) \[skip ci] - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5807 [<samp>(fd96a)</samp>](https://togithub.com/alist-org/alist/commit/fd96a7c) - Update module github.com/aws/aws-sdk-go to v1.49.15 - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5816 [<samp>(fb729)</samp>](https://togithub.com/alist-org/alist/commit/fb729c1) - Update module golang.org/x/image to v0.15.0 - by [@renovate](https://togithub.com/renovate)\[bot] in[alist-org/alist#5825 [<samp>(28bb3)</samp>](https://togithub.com/alist-org/alist/commit/28bb3f6) - **net**: - Buf use Mutex - by [@rammiah](https://togithub.com/rammiah) and [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5823 [<samp>(4448e)</samp>](https://togithub.com/alist-org/alist/commit/4448e08) - **offline_download**: - Don't wait for transfer task - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5595 [<samp>(8bdfc)</samp>](https://togithub.com/alist-org/alist/commit/8bdfc7a) - **onedrive**: - Rename object in root folder - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5468 [<samp>(ab216)</samp>](https://togithub.com/alist-org/alist/commit/ab216ed) - **qbit**: - Seed time doesn't take effect - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5663 [<samp>(83c22)</samp>](https://togithub.com/alist-org/alist/commit/83c2269) - **teambition**: - International upload - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5360 [<samp>(b99e7)</samp>](https://togithub.com/alist-org/alist/commit/b99e709) - **vtencent**: - Only show 50 files - by [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5805 [<samp>(126cf)</samp>](https://togithub.com/alist-org/alist/commit/126cfe9) ##### 🏎 Performance - Make docker release 10 times faster - by [@Mmx233](https://togithub.com/Mmx233) and [@xhofe](https://togithub.com/xhofe) in [alist-org/alist#5803 [<samp>(e6e2d)</samp>](https://togithub.com/alist-org/alist/commit/e6e2d03) ##### [View changes on GitHub](https://togithub.com/alist-org/alist/compare/v3.29.1...v3.30.0) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "before 10pm on monday" in timezone Europe/Amsterdam, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://togithub.com/renovatebot/renovate).

* build: improve multistage docker build * build: add dockerfile for ci * build: add BuildDockerMultiplatform function in build.sh for ci * ci: change build method * build: add missing mod download command to the Dockerfile * build: revert changes made ffmpeg installed * build: use musl build for docker release * ci: apply to dev version * fix: don't login on pr * fix: don't build_docker_with_aria2 on pr --------- Co-authored-by: Andy Hsu <i@nn.ci>

Mmx233 added 4 commits January 3, 2024 20:14

build: improve multistage docker build

ca895b2

build: add dockerfile for ci

0b9cfb0

build: add BuildDockerMultiplatform function in build.sh for ci

a592b0a

ci: change build method

03ea23e

pull-request-size bot added the size/M label Jan 3, 2024

Mmx233 added 2 commits January 3, 2024 20:28

build: add missing mod download command to the Dockerfile

c8a8db4

build: revert changes made ffmpeg installed

7a3c907

build: use musl build for docker release

078d1bb

xhofe approved these changes Jan 5, 2024

View reviewed changes

ci: apply to dev version

b29c143

pull-request-size bot added size/L and removed size/M labels Jan 5, 2024

xhofe added 3 commits January 5, 2024 14:29

Merge branch 'main' into improve/docker-release

c15cacc

fix: don't login on pr

33a68d4

fix: don't build_docker_with_aria2 on pr

ad8d75a

xhofe merged commit e6e2d03 into alist-org:main Jan 5, 2024
3 checks passed

Mmx233 deleted the improve/docker-release branch January 6, 2024 08:07

ivaquero mentioned this pull request Jan 12, 2024

alist-cli 3.30.0 Brewforge/homebrew-chinese#52

Merged

Oscaner mentioned this pull request Jan 12, 2024

alist-cli 3.30.0 Brewforge/homebrew-chinese#55

Closed

This was referenced Jan 13, 2024

alist-cli 3.30.0 Brewforge/homebrew-chinese#57

Closed

alist-cli 3.30.0 Brewforge/homebrew-chinese#58

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Improve: make docker release 10 times faster #5803

Improve: make docker release 10 times faster #5803

Mmx233 commented Jan 3, 2024

welcome bot commented Jan 3, 2024

xhofe commented Jan 4, 2024

Mmx233 commented Jan 4, 2024

xhofe commented Jan 4, 2024

Mmx233 commented Jan 4, 2024

Mmx233 commented Jan 4, 2024 •

edited

welcome bot commented Jan 5, 2024

Improve: make docker release 10 times faster #5803

Improve: make docker release 10 times faster #5803

Conversation

Mmx233 commented Jan 3, 2024

welcome bot commented Jan 3, 2024

xhofe commented Jan 4, 2024

Mmx233 commented Jan 4, 2024

xhofe commented Jan 4, 2024

Mmx233 commented Jan 4, 2024

Mmx233 commented Jan 4, 2024 • edited

welcome bot commented Jan 5, 2024

Mmx233 commented Jan 4, 2024 •

edited