Skip to content

Conversation

@hanwen-cluster
Copy link
Contributor

@hanwen-cluster hanwen-cluster commented Jul 9, 2025

Description of changes

Berkshelf is a dependency manager for Chef cookbooks. With it, you can depend on community cookbooks and include them in your workflow. Berkshelf is not useful when all cookbooks are local. ParallelCluster cookbook has all third party cookbooks ready locally.

Reducing software we depend on improves stability of the product. (e.g we have one known issue related to berkshelf https://github.com/aws/aws-parallelcluster/wiki/(3.8.0-%E2%80%90-3.9.3)-ParallelCluster-Build-Image-Failing-during-Installation-of-Minitar-Ruby-Gem-Dependency)

Tests

  • Build image on all OSes, kitchen test on AL2, spec unit tests have been passed
  • Creating a cluster with custom cookbook has passed

This must be merged with aws/aws-parallelcluster-cookbook#2989

References

  • Link to impacted open issues.
  • Link to related PRs in other packages (i.e. cookbook, node).
  • Link to documentation useful to understand the changes.

Checklist

  • Make sure you are pointing to the right branch.
  • If you're creating a patch for a branch other than develop add the branch name as prefix in the PR title (e.g. [release-3.6]).
  • Check all commits' messages are clear, describing what and why vs how.
  • Make sure to have added unit tests or integration tests to cover the new/modified code.
  • Check if documentation is impacted by this change.

Please review the guidelines for contributing and Pull Request Instructions.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Comment on lines 313 to 314
curl --retry 3 -L -o gems.tgz https://${AWS::Region}-aws-parallelcluster.s3.${AWS::Region}.${AWS::URLSuffix}/archives/dependencies/ruby/gems.tgz
tar -xf gems.tgz
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hgreebe Should I remove this too?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed

hgreebe
hgreebe previously approved these changes Jul 9, 2025
Berkshelf is a dependency manager for Chef cookbooks. With it, you can depend on community cookbooks and include them in your workflow. Berkshelf is not useful when all cookbooks are local. ParallelCluster cookbook has all third party cookbooks ready locally.

Reducing software we depend on improves stability of the product. (e.g we have one known issue related to berkshelf https://github.com/aws/aws-parallelcluster/wiki/(3.8.0-%E2%80%90-3.9.3)-ParallelCluster-Build-Image-Failing-during-Installation-of-Minitar-Ruby-Gem-Dependency)
@hanwen-cluster hanwen-cluster merged commit 91442e2 into aws:develop Jul 9, 2025
24 checks passed
hanwen-cluster added a commit to hanwen-cluster/aws-parallelcluster that referenced this pull request Jul 24, 2025
This is a bug from aws#6909. In the PR, I tested custom cookbook setting didn't produce errors, but didn't test it was actually used.

The custom cookbook was extracted wrongly to /tmp/cookbooks instead of /etc/chef.

The new command is copied from the command in build-image process https://github.com/aws/aws-parallelcluster/blob/develop/cli/src/pcluster/resources/imagebuilder/parallelcluster.yaml#L200
hanwen-cluster added a commit that referenced this pull request Jul 24, 2025
This is a bug from #6909. In the PR, I tested custom cookbook setting didn't produce errors, but didn't test it was actually used.

The custom cookbook was extracted wrongly to /tmp/cookbooks instead of /etc/chef.

The new command is copied from the command in build-image process https://github.com/aws/aws-parallelcluster/blob/develop/cli/src/pcluster/resources/imagebuilder/parallelcluster.yaml#L200
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants