Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

optimize and cleanup bootstrap source #115514

Merged
merged 3 commits into from
Sep 17, 2023

Conversation

onur-ozkan
Copy link
Member

@onur-ozkan onur-ozkan commented Sep 3, 2023

I suggest reviewing this commit by commit.

@rustbot
Copy link
Collaborator

rustbot commented Sep 3, 2023

r? @albertlarsan68

(rustbot has picked a reviewer for you, use r? to override)

@rustbot rustbot added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. T-bootstrap Relevant to the bootstrap subteam: Rust's build system (x.py and src/bootstrap) labels Sep 3, 2023
@onur-ozkan
Copy link
Member Author

@rustbot author

@rustbot rustbot added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 3, 2023
@onur-ozkan onur-ozkan changed the title [WIP] refactor/redesign bootstrap [WIP] refactor/redesign bootstrap codebase Sep 3, 2023
@onur-ozkan onur-ozkan force-pushed the bootstrap-codebase-improvements branch 2 times, most recently from 65cc2d6 to 2818a4f Compare September 12, 2023 09:34
@onur-ozkan onur-ozkan changed the title [WIP] refactor/redesign bootstrap codebase [WIP] refactor/redesign and cleanup bootstrap codebase Sep 12, 2023
@onur-ozkan onur-ozkan changed the title [WIP] refactor/redesign and cleanup bootstrap codebase [WIP] refactor/redesign and cleanup bootstrap source Sep 12, 2023
@onur-ozkan onur-ozkan changed the title [WIP] refactor/redesign and cleanup bootstrap source optimize and cleanup bootstrap source Sep 14, 2023
@onur-ozkan onur-ozkan marked this pull request as ready for review September 14, 2023 18:14
@rustbot
Copy link
Collaborator

rustbot commented Sep 14, 2023

This PR changes how LLVM is built. Consider updating src/bootstrap/download-ci-llvm-stamp.

@onur-ozkan
Copy link
Member Author

Architectural changes will be done in a separate PR to avoid complicating the review process for this PR.

@rustbot ready

@rustbot rustbot added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Sep 14, 2023
@albertlarsan68
Copy link
Member

@bors r+ rollup=iffy (changes things in the build machinery)

@bors
Copy link
Contributor

bors commented Sep 16, 2023

📌 Commit 5eaecac has been approved by albertlarsan68

It is now in the queue for this repository.

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 16, 2023
src/bootstrap/CHANGELOG.md Outdated Show resolved Hide resolved
@onur-ozkan
Copy link
Member Author

I introduced dylib_util.rs to reduce compilation time by avoiding linking of libbootstrap and all it's dependencies when compiling the auxiliary helper executables.

Whill check it.

If you are deleting the changelog, maybe also delete the changelog-seen key in config.toml? This key and the changelog was used when we made significant changes to the defaults of bootstrap affecting everyone's workflows.

It's still useful, but can make more sense if we find better name and use the PR links instead of versions(similar to llvm).

@bors r-

@bors bors added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Sep 16, 2023
Signed-off-by: onur-ozkan <work@onurozkan.dev>
@onur-ozkan onur-ozkan force-pushed the bootstrap-codebase-improvements branch from 5eaecac to c6bcfaa Compare September 16, 2023 11:35
@onur-ozkan
Copy link
Member Author

onur-ozkan commented Sep 16, 2023

Changelog related commits will be cherry-picked to another PR that I am planning to refactor this changelog-seen key as it's not really functioning as expected(e.g., we did many changes on the build flows, but never updated the key or the Changelog files).

Until then, @rustbot blocked

@rustbot rustbot added S-blocked Status: Marked as blocked ❌ on something else such as an RFC or other implementation work. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Sep 16, 2023
Signed-off-by: onur-ozkan <work@onurozkan.dev>
Overall optimizations for bootstrap on conditions, assertions,
trait implementations, etc.

Signed-off-by: onur-ozkan <work@onurozkan.dev>
@onur-ozkan onur-ozkan force-pushed the bootstrap-codebase-improvements branch from c6bcfaa to 9971008 Compare September 17, 2023 04:50
@onur-ozkan
Copy link
Member Author

Changelog related commits have been moved to #115898.

No changes since the r+ from @albertlarsan68, just reduced some commits. @bors r=albertlarsan68

@bors
Copy link
Contributor

bors commented Sep 17, 2023

📌 Commit 9971008 has been approved by albertlarsan68

It is now in the queue for this repository.

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-blocked Status: Marked as blocked ❌ on something else such as an RFC or other implementation work. labels Sep 17, 2023
@bors
Copy link
Contributor

bors commented Sep 17, 2023

⌛ Testing commit 9971008 with merge c3b58c1...

bors added a commit to rust-lang-ci/rust that referenced this pull request Sep 17, 2023
…ements, r=albertlarsan68

optimize and cleanup bootstrap source

I suggest reviewing this commit by commit.
@rust-log-analyzer
Copy link
Collaborator

A job failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot)

@bors
Copy link
Contributor

bors commented Sep 17, 2023

💔 Test failed - checks-actions

@bors bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Sep 17, 2023
@albertlarsan68
Copy link
Member

@bors retry (seems like a builder crashed, no logs available)

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 17, 2023
@bors
Copy link
Contributor

bors commented Sep 17, 2023

⌛ Testing commit 9971008 with merge cdd182c...

@bors
Copy link
Contributor

bors commented Sep 17, 2023

☀️ Test successful - checks-actions
Approved by: albertlarsan68
Pushing cdd182c to master...

@bors bors added the merged-by-bors This PR was explicitly merged by bors. label Sep 17, 2023
@bors bors merged commit cdd182c into rust-lang:master Sep 17, 2023
12 checks passed
@rustbot rustbot added this to the 1.74.0 milestone Sep 17, 2023
@rust-timer
Copy link
Collaborator

Finished benchmarking commit (cdd182c): comparison URL.

Overall result: no relevant changes - no action needed

@rustbot label: -perf-regression

Instruction count

This benchmark run did not return any relevant results for this metric.

Max RSS (memory usage)

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean range count
Regressions ❌
(primary)
2.5% [2.5%, 2.5%] 1
Regressions ❌
(secondary)
3.6% [3.1%, 4.0%] 2
Improvements ✅
(primary)
- - 0
Improvements ✅
(secondary)
- - 0
All ❌✅ (primary) 2.5% [2.5%, 2.5%] 1

Cycles

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean range count
Regressions ❌
(primary)
- - 0
Regressions ❌
(secondary)
- - 0
Improvements ✅
(primary)
- - 0
Improvements ✅
(secondary)
-2.7% [-2.7%, -2.7%] 1
All ❌✅ (primary) - - 0

Binary size

This benchmark run did not return any relevant results for this metric.

Bootstrap: 635.641s -> 636.485s (0.13%)
Artifact size: 318.45 MiB -> 318.24 MiB (-0.06%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
merged-by-bors This PR was explicitly merged by bors. S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. T-bootstrap Relevant to the bootstrap subteam: Rust's build system (x.py and src/bootstrap)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants