Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Your bundle is locked to mimemagic (0.3.5), but that version could not be found #476

Closed
tjyang opened this issue Apr 4, 2021 · 15 comments
Closed
Assignees
Labels

Comments

@tjyang
Copy link

tjyang commented Apr 4, 2021

Hi

My last successful build was long time ago.
Can you advise where I did wrong ?
I don't know how to fix gem file as pointed out in R1

[me@centos8t01 manageiq-appliance-build]$ cat /etc/redhat-release CentOS Linux release 8.3.2011 [me@centos8t01 manageiq-appliance-build]$ ls bin CHANGELOG.md config kickstarts lib LICENSE.txt OPTIONS Rakefile README.md rpm_cache scripts [me@centos8t01 manageiq-appliance-build]$ bin/rpm-build.sh -t release -r jansa-3 +++ readlink -f bin/rpm-build.sh ++ dirname /build/home/me/github/manageiq-appliance-build/bin/rpm-build.sh + BUILD_DIR=/build/home/me/github/manageiq-appliance-build/bin/.. + CONFIG_OPTION=/build/home/me/github/manageiq-appliance-build/bin/../OPTIONS + RPM_BUILD_IMAGE=manageiq/rpm_build + RPM_CACHE_DIR=/build/home/me/github/manageiq-appliance-build/bin/../rpm_cache + getopts t:r:h opt + case $opt in + BUILD_TYPE=release + getopts t:r:h opt + case $opt in + REF=jansa-3 + getopts t:r:h opt + '[' release '!=' nightly ']' + '[' release '!=' release ']' + '[' -z jansa-3 ']' + '[' jansa-3 = master ']' + tag=latest-jansa + RPM_BUILD_IMAGE=manageiq/rpm_build:latest-jansa + cmd='build --build-type release --git-ref jansa-3 --update-rpm-repo' + docker pull manageiq/rpm_build:latest-jansa latest-jansa: Pulling from manageiq/rpm_build Digest: sha256:94adaccec8d7d6d14666de2953f34695095f28ccf771ed1518f98931c5835245 Status: Image is up to date for manageiq/rpm_build:latest-jansa docker.io/manageiq/rpm_build:latest-jansa + docker run --rm -v /build/home/me/github/manageiq-appliance-build/bin/../OPTIONS:/root/OPTIONS:Z -v /build/home/me/github/manageiq-appliance-build/bin/../rpm_cache:/root/rpm_cache:Z manageiq/rpm_build:latest-jansa build --build-type release --git-ref jansa-3 --update-rpm-repo Don't run Bundler as root. Bundler can ask for sudo if it is needed, and installing your bundle as root will break this application for all non-root users on this machine. Fetching gem metadata from https://rubygems.org/......... Resolving dependencies... Fetching rake 13.0.3 Installing rake 13.0.3

Fetching ruby2_keywords 0.0.4
Installing ruby2_keywords 0.0.4
Fetching faraday 1.3.0
Installing faraday 1.3.0
Fetching kartograph 0.2.8
Installing kartograph 0.2.8
Fetching resource_kit 0.1.7
Installing resource_kit 0.1.7
Fetching equalizer 0.0.11
Installing equalizer 0.0.11
Fetching virtus 1.0.5
Installing virtus 1.0.5
Fetching droplet_kit 3.13.0
Installing droplet_kit 3.13.0
Using sync 0.5.0
Fetching more_core_extensions 4.3.0
Installing more_core_extensions 4.3.0
Fetching optimist 3.0.1
Installing optimist 3.0.1

Installed plugin bundler-inject
Fetching source index from https://rubygems.manageiq.org/
Fetching gem metadata from https://rubygems.org/......
Your bundle is locked to mimemagic (0.3.5), but that version could not be found
in any of the sources listed in your Gemfile. If you haven't changed sources,
that means the author of mimemagic (0.3.5) has removed it. You'll need to update
your bundle to a version other than mimemagic (0.3.5) that hasn't been removed
in order to install.
[me@centos8t01 manageiq-appliance-build]$

@tjyang tjyang changed the title bin/rpm-build.sh -t release -r jansa-3 failed: bin/rpm-build.sh -t release -r jansa-3 Apr 4, 2021
@tjyang tjyang changed the title failed: bin/rpm-build.sh -t release -r jansa-3 Your bundle is locked to mimemagic (0.3.5), but that version could not be found Apr 4, 2021
@Fryguy
Copy link
Member

Fryguy commented Apr 9, 2021

This is due to the major Rails breakage with the mimemagic gem. To fix this, you would have to unlock rails in the Gemfile.lock and upgrade it to at least 5.2.5. Are you using the https://github.com/ManageIQ/manageiq/blob/jansa/Gemfile.lock.release file? If so, that would need to be updated.

cc @bdunne - looks like we need to upgrade rails on a few of the old versions.

@Fryguy Fryguy transferred this issue from ManageIQ/manageiq-appliance Apr 9, 2021
@Fryguy
Copy link
Member

Fryguy commented Apr 9, 2021

See also ManageIQ/manageiq-rpm_build#143

@tjyang
Copy link
Author

tjyang commented Apr 10, 2021

@Fryguy , Thanks for looking at this issue.

  • Kasparov-1 has same error message in my test box.
[me@centos8t01 manageiq-appliance-build]$ bin/rpm-build.sh  -t  release -r kasparov-1
  • Following steps are able to kick off a long build and rpms were created.
[me@centos8t01 manageiq-appliance-build]$ docker run -it manageiq:jansa

[root@72f30b8b1f43 build_scripts]# bin/build.rb

Processing files: manageiq-ui-10.3.0-1.20210410123004.el8.x86_64
Provides: config(manageiq-ui) = 10.3.0-1.20210410123004.el8 manageiq-ui = 10.3.0-1.20210410123004.el8 manageiq-ui(x86-64) = 10.3.0-1.20210410123004.el8
Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(FileDigests) <= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1
Checking for unpackaged file(s): /usr/lib/rpm/check-files /root/rpmbuild/BUILDROOT/manageiq-10.3.0-1.20210410123004.el8.x86_64
Wrote: /root/BUILD/rpms/x86_64/manageiq-appliance-10.3.0-1.20210410123004.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-appliance-tools-10.3.0-1.20210410123004.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-core-10.3.0-1.20210410123004.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-gemset-10.3.0-1.20210410123004.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-pods-10.3.0-1.20210410123004.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-system-10.3.0-1.20210410123004.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-ui-10.3.0-1.20210410123004.el8.x86_64.rpm
Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.1lrjAD

  • umask 022
  • cd /root/rpmbuild/BUILD
  • cd manageiq-manifest-10.3.0
  • rm -rf /root/rpmbuild/BUILDROOT/manageiq-10.3.0-1.20210410123004.el8.x86_64
  • exit 0

RPM BUILT SUCCESSFULLY
[root@f2a44231e293 build_scripts]# date
Sat Apr 10 14:01:33 UTC 2021
[root@f2a44231e293 build_scripts]#

@Fryguy
Copy link
Member

Fryguy commented May 6, 2021

@tjyang Now that the dust has settled on the mime-magic thing are you still seeing problems?

@tjyang
Copy link
Author

tjyang commented May 10, 2021

@Fryguy , Thanks for the follow-up

[me@centos8t01 manageiq-appliance-build]$ date Thu Apr 29 04:03:28 EDT 2021 [me@centos8t01 manageiq-appliance-build]$ cat /etc/redhat-release CentOS Linux release 8.3.2011 [me@centos8t01 manageiq-appliance-build]$ [me@centos8t01 manageiq-appliance-build]$ git log -1 commit 9ae48a5 (HEAD -> kasparov, origin/kasparov) Merge: cd04ba3 1ad1c25 Author: Jason Frey Date: Thu Mar 25 15:20:44 2021 -0400
Merge pull request #472 from bdunne/kasparov_backport_467

[KASPAROV] Kasparov backport #467

[me@centos8t01 manageiq-appliance-build]$ git branch

  • kasparov
    master
    [me@centos8t01 manageiq-appliance-build]$ bin/rpm-build.sh -t release -r kasparov-1
    +++ readlink -f bin/rpm-build.sh
    ++ dirname /home/me/github/manageiq-appliance-build/bin/rpm-build.sh
  • BUILD_DIR=/home/me/github/manageiq-appliance-build/bin/..
  • CONFIG_OPTION=/home/me/github/manageiq-appliance-build/bin/../OPTIONS
  • RPM_BUILD_IMAGE=manageiq/rpm_build
  • RPM_CACHE_DIR=/home/me/github/manageiq-appliance-build/bin/../rpm_cache
  • getopts t:r:h opt
  • case $opt in
  • BUILD_TYPE=release
  • getopts t:r:h opt
  • case $opt in
  • REF=kasparov-1
  • getopts t:r:h opt
  • '[' release '!=' nightly ']'
  • '[' release '!=' release ']'
  • '[' -z kasparov-1 ']'
  • '[' kasparov-1 = master ']'
  • tag=latest-kasparov
  • RPM_BUILD_IMAGE=manageiq/rpm_build:latest-kasparov
  • cmd='build --build-type release --git-ref kasparov-1 --update-rpm-repo'
  • docker pull manageiq/rpm_build:latest-kasparov
    latest-kasparov: Pulling from manageiq/rpm_build
    Digest: sha256:64a29d86d3577061ea53430e2021449500fa3025d291acf187fb5f23f4298729
    Status: Image is up to date for manageiq/rpm_build:latest-kasparov
    docker.io/manageiq/rpm_build:latest-kasparov
  • docker run --rm -v /home/me/github/manageiq-appliance-build/bin/../OPTIONS:/root/OPTIONS:Z -v /home/me/github/manageiq-appliance-build/bin/../rpm_cache:/root/rpm_cache:Z manageiq/rpm_build:latest-kasparov build --build-type release --git-ref kasparov-1 --update-rpm-repo
    Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
    installing your bundle as root will break this application for all non-root
    users on this machine.
    Fetching gem metadata from https://rubygems.org/.........
    Resolving dependencies...
    Fetching rake 13.0.3
    Installing rake 13.0.3
    Fetching concurrent-ruby 1.1.8
    Installing concurrent-ruby 1.1.8
    Fetching i18n 1.8.10
    Installing i18n 1.8.10
    Fetching minitest 5.14.4
    Installing minitest 5.14.4
    Fetching tzinfo 2.0.4
    Installing tzinfo 2.0.4
    Fetching zeitwerk 2.4.2
    Installing zeitwerk 2.4.2
    Fetching activesupport 6.1.3.2
    Installing activesupport 6.1.3.2
    Fetching public_suffix 4.0.6
    Installing public_suffix 4.0.6
    Fetching addressable 2.7.0
    Installing addressable 2.7.0
    Fetching ast 2.4.2
    Installing ast 2.4.2
    Fetching awesome_spawn 1.5.0
    Installing awesome_spawn 1.5.0
    Fetching aws-eventstream 1.1.1
    Installing aws-eventstream 1.1.1
    Fetching aws-partitions 1.452.0
    Installing aws-partitions 1.452.0
    Fetching aws-sigv4 1.2.3
    Installing aws-sigv4 1.2.3
    Fetching jmespath 1.4.0
    Installing jmespath 1.4.0
    Fetching aws-sdk-core 3.114.0
    Installing aws-sdk-core 3.114.0
    Fetching aws-sdk-kms 1.43.0
    Installing aws-sdk-kms 1.43.0
    Fetching aws-sdk-s3 1.94.1
    Installing aws-sdk-s3 1.94.1
    Fetching thread_safe 0.3.6
    Installing thread_safe 0.3.6
    Fetching descendants_tracker 0.0.4
    Installing descendants_tracker 0.0.4
    Fetching ice_nine 0.11.2
    Installing ice_nine 0.11.2
    Fetching axiom-types 0.1.1
    Installing axiom-types 0.1.1
    Using bundler 1.17.2
    Fetching coercible 1.0.0
    Installing coercible 1.0.0
    Fetching deep_merge 1.2.1
    Installing deep_merge 1.2.1
    Fetching dry-core 0.5.0
    Installing dry-core 0.5.0
    Fetching dry-configurable 0.12.1
    Installing dry-configurable 0.12.1
    Fetching dry-container 0.7.2
    Installing dry-container 0.7.2
    Fetching dry-equalizer 0.3.0
    Installing dry-equalizer 0.3.0
    Fetching dry-initializer 3.0.4
    Installing dry-initializer 3.0.4
    Fetching dry-logic 1.2.0
    Installing dry-logic 1.2.0
    Fetching dry-inflector 0.2.0
    Installing dry-inflector 0.2.0
    Fetching dry-types 1.5.1
    Installing dry-types 1.5.1
    Fetching dry-schema 1.6.2
    Installing dry-schema 1.6.2
    Fetching dry-validation 1.6.0
    Installing dry-validation 1.6.0
    Fetching config 3.1.0
    Installing config 3.1.0
    Fetching faraday-excon 1.1.0
    Installing faraday-excon 1.1.0
    Fetching faraday-net_http 1.0.1
    Installing faraday-net_http 1.0.1
    Fetching faraday-net_http_persistent 1.1.0
    Installing faraday-net_http_persistent 1.1.0
    Fetching multipart-post 2.1.1
    Installing multipart-post 2.1.1
    Fetching ruby2_keywords 0.0.4
    Installing ruby2_keywords 0.0.4
    Fetching faraday 1.4.1
    Installing faraday 1.4.1
    Fetching kartograph 0.2.8
    Installing kartograph 0.2.8
    Fetching resource_kit 0.1.7
    Installing resource_kit 0.1.7
    Fetching equalizer 0.0.11
    Installing equalizer 0.0.11
    Fetching virtus 1.0.5
    Installing virtus 1.0.5
    Fetching droplet_kit 3.13.1
    Installing droplet_kit 3.13.1
    Using sync 0.5.0
    Fetching more_core_extensions 4.3.0
    Installing more_core_extensions 4.3.0
    Fetching optimist 3.0.1
    Installing optimist 3.0.1
    Fetching parallel 1.20.1
    Installing parallel 1.20.1
    Fetching parser 3.0.1.1
    Installing parser 3.0.1.1
    Fetching rainbow 3.0.0
    Installing rainbow 3.0.0
    Fetching regexp_parser 2.1.1
    Installing regexp_parser 2.1.1
    Fetching rexml 3.2.5
    Installing rexml 3.2.5
    Fetching rubocop-ast 1.5.0
    Installing rubocop-ast 1.5.0
    Fetching ruby-progressbar 1.11.0
    Installing ruby-progressbar 1.11.0
    Fetching unicode-display_width 2.0.0
    Installing unicode-display_width 2.0.0
    Fetching rubocop 1.14.0
    Installing rubocop 1.14.0
    Fetching rubocop-performance 1.11.3
    Installing rubocop-performance 1.11.3
    Fetching rack 2.2.3
    Installing rack 2.2.3
    Fetching rubocop-rails 2.10.1
    Installing rubocop-rails 2.10.1
    Fetching manageiq-style 1.3.0
    Installing manageiq-style 1.3.0
    Fetching tins 1.29.0
    Installing tins 1.29.0
    Fetching term-ansicolor 1.7.1
    Installing term-ansicolor 1.7.1
    Bundle complete! 9 Gemfile dependencies, 65 gems now installed.
    Use bundle info [gemname] to see where a bundled gem is installed.
    Post-install message from config:

Thanks for installing Config
Please consider donating to our open collective to help us maintain this project.

Donate: https://opencollective.com/rubyconfig/donate

---> ManageIQ::RPMBuild::SetupSourceRepos#initialize

---> ManageIQ::RPMBuild::SetupSourceRepos#populate

---> ManageIQ::RPMBuild::SetupSourceRepos#clean_build_dir

---> ManageIQ::RPMBuild::SetupSourceRepos#setup_rpm_spec_repo

---> ManageIQ::RPMBuild::SetupSourceRepos#setup_source_repo

---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-appliance.git manageiq-appliance
Cloning into 'manageiq-appliance'...
Note: switching to 'c24a43df77dbdae923f8d851151ca2dd7a1865de'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

git switch -c

Or undo this operation with:

git switch -

Turn off this advice by setting config variable advice.detachedHead to false

---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq.git manageiq
Cloning into 'manageiq'...
Note: switching to '15acbea8c6384c2cebcc07040ece2a760811a920'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

git switch -c

Or undo this operation with:

git switch -

Turn off this advice by setting config variable advice.detachedHead to false

---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-ui-service.git manageiq-ui-service
Cloning into 'manageiq-ui-service'...
Note: switching to '99982fe1b62cacfdc36fa2eec92864362d66f4a9'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

git switch -c

Or undo this operation with:

git switch -

Turn off this advice by setting config variable advice.detachedHead to false

---> ManageIQ::RPMBuild::GenerateGemSet#initialize

---> ManageIQ::RPMBuild::GenerateGemSet#backup_environment_variables

---> ManageIQ::RPMBuild::GenerateGemSet#set_environment_variables

---> gem env
RubyGems Environment:

  • RUBYGEMS VERSION: 3.0.3
  • RUBY VERSION: 2.6.3 (2019-04-16 patchlevel 62) [x86_64-linux]
  • INSTALLATION DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0
  • USER INSTALLATION DIRECTORY: /root/.gem/ruby
  • RUBY EXECUTABLE: /usr/bin/ruby
  • GIT EXECUTABLE: /bin/git
  • EXECUTABLE DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0/bin
  • SPEC CACHE DIRECTORY: /root/.gem/specs
  • SYSTEM CONFIGURATION DIRECTORY: /etc
  • RUBYGEMS PLATFORMS:
    • ruby
    • x86_64-linux
  • GEM PATHS:
    • /root/BUILD/manageiq-gemset-11.1.0
    • /usr/share/gems
    • /usr/local/share/gems
  • GEM CONFIGURATION:
    • :update_sources => true
    • :verbose => true
    • :backtrace => false
    • :bulk_threshold => 1000
    • "gem" => "--no-ri --no-rdoc --no-document"
  • REMOTE SOURCES:
  • SHELL PATH:
    • /root/BUILD/manageiq-gemset-11.1.0/bin
    • /usr/local/bin
    • /usr/local/sbin
    • /bin
    • /sbin
    • /usr/bin
    • /usr/sbin
    • /root/bin
    • ~/bin

---> echo -e "${PATH}\n"
/root/BUILD/manageiq-gemset-11.1.0/bin:/usr/local/bin:/usr/local/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/root/bin:~/bin

---> gem install bundler -v 2.1.4
Successfully installed bundler-2.1.4
1 gem installed

---> ManageIQ::RPMBuild::GenerateGemSet#populate_gem_home

---> gem env
RubyGems Environment:

  • RUBYGEMS VERSION: 3.0.3
  • RUBY VERSION: 2.6.3 (2019-04-16 patchlevel 62) [x86_64-linux]
  • INSTALLATION DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0
  • USER INSTALLATION DIRECTORY: /root/.gem/ruby
  • RUBY EXECUTABLE: /usr/bin/ruby
  • GIT EXECUTABLE: /bin/git
  • EXECUTABLE DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0/bin
  • SPEC CACHE DIRECTORY: /root/.gem/specs
  • SYSTEM CONFIGURATION DIRECTORY: /etc
  • RUBYGEMS PLATFORMS:
    • ruby
    • x86_64-linux
  • GEM PATHS:
    • /root/BUILD/manageiq-gemset-11.1.0
    • /usr/share/gems
    • /usr/local/share/gems
  • GEM CONFIGURATION:
    • :update_sources => true
    • :verbose => true
    • :backtrace => false
    • :bulk_threshold => 1000
    • "gem" => "--no-ri --no-rdoc --no-document"
  • REMOTE SOURCES:
  • SHELL PATH:
    • /root/BUILD/manageiq-gemset-11.1.0/bin
    • /usr/local/bin
    • /usr/local/sbin
    • /bin
    • /sbin
    • /usr/bin
    • /usr/sbin
    • /root/bin
    • ~/bin

---> gem install mime-types -v 2.6.1
Successfully installed mime-types-2.6.1
1 gem installed

---> bundle config set --local with qpid_proton systemd

---> bundle 2.1.4 install --jobs 4 --retry 3
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Fetching gem metadata from https://rubygems.org/.
Resolving dependencies...
Using bundler 2.1.4
Fetching bundler-inject 1.1.0
Installing bundler-inject 1.1.0
Installed plugin bundler-inject
Fetching source index from https://rubygems.manageiq.org/
Retrying fetcher due to error (2/4): Bundler::Fetcher::CertificateFailureError Could not verify the SSL certificate for https://rubygems.manageiq.org/.
There is a chance you are experiencing a man-in-the-middle attack, but most likely your system doesn't have the CA certificates needed for verification. For information about OpenSSL certificates, see http://bit.ly/ruby-ssl. To connect without using SSL, edit your Gemfile sources and change 'https' to 'http'.

Retrying fetcher due to error (3/4): Bundler::Fetcher::CertificateFailureError Could not verify the SSL certificate for https://rubygems.manageiq.org/.
There is a chance you are experiencing a man-in-the-middle attack, but most likely your system doesn't have the CA certificates needed for verification. For information about OpenSSL certificates, see http://bit.ly/ruby-ssl. To connect without using SSL, edit your Gemfile sources and change 'https' to 'http'.

Retrying fetcher due to error (4/4): Bundler::Fetcher::CertificateFailureError Could not verify the SSL certificate for https://rubygems.manageiq.org/.
There is a chance you are experiencing a man-in-the-middle attack, but most likely your system doesn't have the CA certificates needed for verification. For information about OpenSSL certificates, see http://bit.ly/ruby-ssl. To connect without using SSL, edit your Gemfile sources and change 'https' to 'http'.

Could not verify the SSL certificate for https://rubygems.manageiq.org/.
There is a chance you are experiencing a man-in-the-middle attack, but most
likely your system doesn't have the CA certificates needed for verification. For
information about OpenSSL certificates, see http://bit.ly/ruby-ssl. To connect
without using SSL, edit your Gemfile sources and change 'https' to 'http'.
[me@centos8t01 manageiq-appliance-build]$

@kbrock kbrock self-assigned this May 10, 2021
@kbrock
Copy link
Member

kbrock commented May 10, 2021

I'm getting similar output but master is still giving me mimemagic issues.

I pruned the output on [...]. I am on master. kasperov branch had the same results. The /opt/OPTIONS directory is empty (having a yml file in there started going in another direction)

[master] manageiq-appliance-build $ date
Mon May 10 11:35:44 EDT 2021
[master] manageiq-appliance-build $ uname -a
Darwin kbrock-ibm 20.3.0 Darwin Kernel Version 20.3.0: Thu Jan 21 00:07:06 PST 2021; root:xnu-7195.81.3~1/RELEASE_X86_64 x86_64
[master] manageiq-appliance-build $ git log -1
commit 8f5b3d77e32c8310a6c4211f361ae472d17303b8 (HEAD -> master, upstream/master, origin/master, origin/HEAD)
Merge: 9159060 1c699a4
Author: Keenan Brock <keenan@thebrocks.net>
Date:   Tue Apr 20 14:00:27 2021 -0400

    Merge pull request #478 from bdunne/fix_log_names

    Fix log file names for release build script
[master] manageiq-appliance-build $ git branch
* master
  watchdog
[master] manageiq-appliance-build $ CONFIG_OPTION=/opt/OPTIONS RPM_CACHE_DIR=/opt/rpm_cache/ ./bin/rpm-build.sh  -t  release -r kasparov-1
[...]
latest-kasparov: Pulling from manageiq/rpm_build
Digest: sha256:64a29d86d3577061ea53430e2021449500fa3025d291acf187fb5f23f4298729
Status: Image is up to date for manageiq/rpm_build:latest-kasparov
[...]
 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-appliance.git manageiq-appliance
Cloning into 'manageiq-appliance'...
Note: switching to 'c24a43df77dbdae923f8d851151ca2dd7a1865de'.
[...]
 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq.git manageiq
Cloning into 'manageiq'...
Note: switching to '15acbea8c6384c2cebcc07040ece2a760811a920'.
[...]
 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-ui-service.git manageiq-ui-service
Cloning into 'manageiq-ui-service'...
Note: switching to '99982fe1b62cacfdc36fa2eec92864362d66f4a9'.
 ---> gem install mime-types -v 2.6.1
Successfully installed mime-types-2.6.1
1 gem installed

 ---> bundle config set --local with qpid_proton systemd

 ---> bundle _2.1.4_ install --jobs 8 --retry 3
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Fetching gem metadata from https://rubygems.org/.
Resolving dependencies...
Using bundler 2.1.4
Fetching bundler-inject 1.1.0
Installing bundler-inject 1.1.0
Installed plugin bundler-inject
Fetching source index from https://rubygems.manageiq.org/
Fetching gem metadata from https://rubygems.org/......
Your bundle is locked to mimemagic (0.3.5), but that version could not be found
in any of the sources listed in your Gemfile. If you haven't changed sources,
that means the author of mimemagic (0.3.5) has removed it. You'll need to update
your bundle to a version other than mimemagic (0.3.5) that hasn't been removed
in order to install.

I'm not sure how my bundle could be locked, will try and track that down and see where it can go from here

@Fryguy
Copy link
Member

Fryguy commented May 11, 2021

@tjyang That error seems unrelated to our build (external problem with rubygems) - can you try again now that that seems fixed?

@tjyang
Copy link
Author

tjyang commented May 12, 2021

  • Here is another build log by "bin/rpm-build.sh -t release -r kasparov-1", back to " mimemagic (0.3.5)" issue.
[me@centos8t01 manageiq-appliance-build]$ bin/rpm-build.sh -t release -r kasparov-1
+++ readlink -f bin/rpm-build.sh
++ dirname /home/me/github/manageiq-appliance-build/bin/rpm-build.sh
+ BUILD_DIR=/home/me/github/manageiq-appliance-build/bin/..
+ CONFIG_OPTION=/home/me/github/manageiq-appliance-build/bin/../OPTIONS
+ RPM_BUILD_IMAGE=manageiq/rpm_build
+ RPM_CACHE_DIR=/home/me/github/manageiq-appliance-build/bin/../rpm_cache
+ getopts t:r:h opt
+ case $opt in
+ BUILD_TYPE=release
+ getopts t:r:h opt
+ case $opt in
+ REF=kasparov-1
+ getopts t:r:h opt
+ '[' release '!=' nightly ']'
+ '[' release '!=' release ']'
+ '[' -z kasparov-1 ']'
+ '[' kasparov-1 = master ']'
+ tag=latest-kasparov
+ RPM_BUILD_IMAGE=manageiq/rpm_build:latest-kasparov
+ cmd='build --build-type release --git-ref kasparov-1 --update-rpm-repo'
+ docker pull manageiq/rpm_build:latest-kasparov
latest-kasparov: Pulling from manageiq/rpm_build
4b21dcdd136d: Pull complete
55eda7743468: Pull complete
4c026a6f9493: Pull complete
cb993f82ab0b: Pull complete
8609ee898db6: Pull complete
40be858e0815: Pull complete
2a7ead8600d8: Pull complete
affa0b4fbb88: Pull complete
Digest: sha256:cb4eddacab18f5a92241392bf4fe903b50d985bf654a5931ae1e7c410abdc7aa
Status: Downloaded newer image for manageiq/rpm_build:latest-kasparov
docker.io/manageiq/rpm_build:latest-kasparov
+ docker run --rm -v /home/me/github/manageiq-appliance-build/bin/../OPTIONS:/root/OPTIONS:Z -v /home/me/github/manageiq-appliance-build/bin/../rpm_cache:/root/rpm_cache:Z manageiq/rpm_build:latest-kasparov build --build-type release --git-ref kasparov-1 --update-rpm-repo
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Fetching gem metadata from https://rubygems.org/.........
Resolving dependencies...
Fetching rake 13.0.3
Installing rake 13.0.3
Fetching concurrent-ruby 1.1.8
Installing concurrent-ruby 1.1.8
Fetching i18n 1.8.10
Installing i18n 1.8.10
Fetching minitest 5.14.4
Installing minitest 5.14.4
Fetching tzinfo 2.0.4
Installing tzinfo 2.0.4
Fetching zeitwerk 2.4.2
Installing zeitwerk 2.4.2
Fetching activesupport 6.1.3.2
Installing activesupport 6.1.3.2
Fetching public_suffix 4.0.6
Installing public_suffix 4.0.6
Fetching addressable 2.7.0
Installing addressable 2.7.0
Fetching ast 2.4.2
Installing ast 2.4.2
Fetching awesome_spawn 1.5.0
Installing awesome_spawn 1.5.0
Fetching aws-eventstream 1.1.1
Installing aws-eventstream 1.1.1
Fetching aws-partitions 1.454.0
Installing aws-partitions 1.454.0
Fetching aws-sigv4 1.2.3
Installing aws-sigv4 1.2.3
Fetching jmespath 1.4.0
Installing jmespath 1.4.0
Fetching aws-sdk-core 3.114.0
Installing aws-sdk-core 3.114.0
Fetching aws-sdk-kms 1.43.0
Installing aws-sdk-kms 1.43.0
Fetching aws-sdk-s3 1.94.1
Installing aws-sdk-s3 1.94.1
Fetching thread_safe 0.3.6
Installing thread_safe 0.3.6
Fetching descendants_tracker 0.0.4
Installing descendants_tracker 0.0.4
Fetching ice_nine 0.11.2
Installing ice_nine 0.11.2
Fetching axiom-types 0.1.1
Installing axiom-types 0.1.1
Using bundler 1.17.2
Fetching coercible 1.0.0
Installing coercible 1.0.0
Fetching deep_merge 1.2.1
Installing deep_merge 1.2.1
Fetching dry-core 0.5.0
Installing dry-core 0.5.0
Fetching dry-configurable 0.12.1
Installing dry-configurable 0.12.1
Fetching dry-container 0.7.2
Installing dry-container 0.7.2
Fetching dry-equalizer 0.3.0
Installing dry-equalizer 0.3.0
Fetching dry-initializer 3.0.4
Installing dry-initializer 3.0.4
Fetching dry-logic 1.2.0
Installing dry-logic 1.2.0
Fetching dry-inflector 0.2.0
Installing dry-inflector 0.2.0
Fetching dry-types 1.5.1
Installing dry-types 1.5.1
Fetching dry-schema 1.6.2
Installing dry-schema 1.6.2
Fetching dry-validation 1.6.0
Installing dry-validation 1.6.0
Fetching config 3.1.0
Installing config 3.1.0
Fetching faraday-excon 1.1.0
Installing faraday-excon 1.1.0
Fetching faraday-net_http 1.0.1
Installing faraday-net_http 1.0.1
Fetching faraday-net_http_persistent 1.1.0
Installing faraday-net_http_persistent 1.1.0
Fetching multipart-post 2.1.1
Installing multipart-post 2.1.1
Fetching ruby2_keywords 0.0.4
Installing ruby2_keywords 0.0.4
Fetching faraday 1.4.1
Installing faraday 1.4.1
Fetching kartograph 0.2.8
Installing kartograph 0.2.8
Fetching resource_kit 0.1.7
Installing resource_kit 0.1.7
Fetching equalizer 0.0.11
Installing equalizer 0.0.11
Fetching virtus 1.0.5
Installing virtus 1.0.5
Fetching droplet_kit 3.13.1
Installing droplet_kit 3.13.1
Using sync 0.5.0
Fetching more_core_extensions 4.3.0
Installing more_core_extensions 4.3.0
Fetching optimist 3.0.1
Installing optimist 3.0.1
Fetching parallel 1.20.1
Installing parallel 1.20.1
Fetching parser 3.0.1.1
Installing parser 3.0.1.1
Fetching rainbow 3.0.0
Installing rainbow 3.0.0
Fetching regexp_parser 2.1.1
Installing regexp_parser 2.1.1
Fetching rexml 3.2.5
Installing rexml 3.2.5
Fetching rubocop-ast 1.5.0
Installing rubocop-ast 1.5.0
Fetching ruby-progressbar 1.11.0
Installing ruby-progressbar 1.11.0
Fetching unicode-display_width 2.0.0
Installing unicode-display_width 2.0.0
Fetching rubocop 1.14.0
Installing rubocop 1.14.0
Fetching rubocop-performance 1.11.3
Installing rubocop-performance 1.11.3
Fetching rack 2.2.3
Installing rack 2.2.3
Fetching rubocop-rails 2.10.1
Installing rubocop-rails 2.10.1
Fetching manageiq-style 1.3.0
Installing manageiq-style 1.3.0
Fetching tins 1.29.0
Installing tins 1.29.0
Fetching term-ansicolor 1.7.1
Installing term-ansicolor 1.7.1
Bundle complete! 9 Gemfile dependencies, 65 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Post-install message from config:

Thanks for installing Config
Please consider donating to our open collective to help us maintain this project.


Donate: https://opencollective.com/rubyconfig/donate

 ---> ManageIQ::RPMBuild::SetupSourceRepos#initialize

 ---> ManageIQ::RPMBuild::SetupSourceRepos#populate

 ---> ManageIQ::RPMBuild::SetupSourceRepos#clean_build_dir

 ---> ManageIQ::RPMBuild::SetupSourceRepos#setup_rpm_spec_repo

 ---> ManageIQ::RPMBuild::SetupSourceRepos#setup_source_repo

 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-appliance.git manageiq-appliance
Cloning into 'manageiq-appliance'...
Note: switching to 'c24a43df77dbdae923f8d851151ca2dd7a1865de'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false


 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq.git manageiq
Cloning into 'manageiq'...
Note: switching to '15acbea8c6384c2cebcc07040ece2a760811a920'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false


 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-ui-service.git manageiq-ui-service
Cloning into 'manageiq-ui-service'...
Note: switching to '99982fe1b62cacfdc36fa2eec92864362d66f4a9'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false


 ---> ManageIQ::RPMBuild::GenerateGemSet#initialize

 ---> ManageIQ::RPMBuild::GenerateGemSet#backup_environment_variables

 ---> ManageIQ::RPMBuild::GenerateGemSet#set_environment_variables

 ---> gem env
RubyGems Environment:
  - RUBYGEMS VERSION: 3.0.3
  - RUBY VERSION: 2.6.3 (2019-04-16 patchlevel 62) [x86_64-linux]
  - INSTALLATION DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0
  - USER INSTALLATION DIRECTORY: /root/.gem/ruby
  - RUBY EXECUTABLE: /usr/bin/ruby
  - GIT EXECUTABLE: /bin/git
  - EXECUTABLE DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0/bin
  - SPEC CACHE DIRECTORY: /root/.gem/specs
  - SYSTEM CONFIGURATION DIRECTORY: /etc
  - RUBYGEMS PLATFORMS:
    - ruby
    - x86_64-linux
  - GEM PATHS:
     - /root/BUILD/manageiq-gemset-11.1.0
     - /usr/share/gems
     - /usr/local/share/gems
  - GEM CONFIGURATION:
     - :update_sources => true
     - :verbose => true
     - :backtrace => false
     - :bulk_threshold => 1000
     - "gem" => "--no-ri --no-rdoc --no-document"
  - REMOTE SOURCES:
     - https://rubygems.org/
  - SHELL PATH:
     - /root/BUILD/manageiq-gemset-11.1.0/bin
     - /usr/local/bin
     - /usr/local/sbin
     - /bin
     - /sbin
     - /usr/bin
     - /usr/sbin
     - /root/bin
     - ~/bin

 ---> echo -e "${PATH}\n"
/root/BUILD/manageiq-gemset-11.1.0/bin:/usr/local/bin:/usr/local/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/root/bin:~/bin


 ---> gem install bundler -v 2.1.4
Successfully installed bundler-2.1.4
1 gem installed

 ---> ManageIQ::RPMBuild::GenerateGemSet#populate_gem_home

 ---> gem env
RubyGems Environment:
  - RUBYGEMS VERSION: 3.0.3
  - RUBY VERSION: 2.6.3 (2019-04-16 patchlevel 62) [x86_64-linux]
  - INSTALLATION DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0
  - USER INSTALLATION DIRECTORY: /root/.gem/ruby
  - RUBY EXECUTABLE: /usr/bin/ruby
  - GIT EXECUTABLE: /bin/git
  - EXECUTABLE DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0/bin
  - SPEC CACHE DIRECTORY: /root/.gem/specs
  - SYSTEM CONFIGURATION DIRECTORY: /etc
  - RUBYGEMS PLATFORMS:
    - ruby
    - x86_64-linux
  - GEM PATHS:
     - /root/BUILD/manageiq-gemset-11.1.0
     - /usr/share/gems
     - /usr/local/share/gems
  - GEM CONFIGURATION:
     - :update_sources => true
     - :verbose => true
     - :backtrace => false
     - :bulk_threshold => 1000
     - "gem" => "--no-ri --no-rdoc --no-document"
  - REMOTE SOURCES:
     - https://rubygems.org/
  - SHELL PATH:
     - /root/BUILD/manageiq-gemset-11.1.0/bin
     - /usr/local/bin
     - /usr/local/sbin
     - /bin
     - /sbin
     - /usr/bin
     - /usr/sbin
     - /root/bin
     - ~/bin

 ---> gem install mime-types -v 2.6.1
Successfully installed mime-types-2.6.1
1 gem installed

 ---> bundle config set --local with qpid_proton systemd

 ---> bundle _2.1.4_ install --jobs 4 --retry 3
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Fetching gem metadata from https://rubygems.org/.
Resolving dependencies...
Using bundler 2.1.4
Fetching bundler-inject 1.1.0
Installing bundler-inject 1.1.0
Installed plugin bundler-inject
Fetching source index from https://rubygems.manageiq.org/
Fetching gem metadata from https://rubygems.org/......
Your bundle is locked to mimemagic (0.3.5), but that version could not be found
in any of the sources listed in your Gemfile. If you haven't changed sources,
that means the author of mimemagic (0.3.5) has removed it. You'll need to update
your bundle to a version other than mimemagic (0.3.5) that hasn't been removed
in order to install.
[me@centos8t01 manageiq-appliance-build]$

<details>
[me@centos8t01 manageiq-appliance-build]$ git log -1
commit 9ae48a51ff55af9893152586c486357fb4302c5f (HEAD -> kasparov, origin/kasparov)
Merge: cd04ba3 1ad1c25
Author: Jason Frey <fryguy9@gmail.com>
Date:   Thu Mar 25 15:20:44 2021 -0400

    Merge pull request #472 from bdunne/kasparov_backport_467

    [KASPAROV] Kasparov backport #467
[me@centos8t01 manageiq-appliance-build]$ git log -1;date
commit 9ae48a51ff55af9893152586c486357fb4302c5f (HEAD -> kasparov, origin/kasparov)
Merge: cd04ba3 1ad1c25
Author: Jason Frey <fryguy9@gmail.com>
Date:   Thu Mar 25 15:20:44 2021 -0400

    Merge pull request #472 from bdunne/kasparov_backport_467

    [KASPAROV] Kasparov backport #467
Tue May 11 16:50:57 EDT 2021
[me@centos8t01 manageiq-appliance-build]$ git branch
* kasparov
  master
[me@centos8t01 manageiq-appliance-build]$ bin/rpm-build.sh -t release -r kasparov-1
+++ readlink -f bin/rpm-build.sh
++ dirname /home/me/github/manageiq-appliance-build/bin/rpm-build.sh
+ BUILD_DIR=/home/me/github/manageiq-appliance-build/bin/..
+ CONFIG_OPTION=/home/me/github/manageiq-appliance-build/bin/../OPTIONS
+ RPM_BUILD_IMAGE=manageiq/rpm_build
+ RPM_CACHE_DIR=/home/me/github/manageiq-appliance-build/bin/../rpm_cache
+ getopts t:r:h opt
+ case $opt in
+ BUILD_TYPE=release
+ getopts t:r:h opt
+ case $opt in
+ REF=kasparov-1
+ getopts t:r:h opt
+ '[' release '!=' nightly ']'
+ '[' release '!=' release ']'
+ '[' -z kasparov-1 ']'
+ '[' kasparov-1 = master ']'
+ tag=latest-kasparov
+ RPM_BUILD_IMAGE=manageiq/rpm_build:latest-kasparov
+ cmd='build --build-type release --git-ref kasparov-1 --update-rpm-repo'
+ docker pull manageiq/rpm_build:latest-kasparov
latest-kasparov: Pulling from manageiq/rpm_build
4b21dcdd136d: Pull complete
55eda7743468: Pull complete
4c026a6f9493: Pull complete
cb993f82ab0b: Pull complete
8609ee898db6: Pull complete
40be858e0815: Pull complete
2a7ead8600d8: Pull complete
affa0b4fbb88: Pull complete
Digest: sha256:cb4eddacab18f5a92241392bf4fe903b50d985bf654a5931ae1e7c410abdc7aa
Status: Downloaded newer image for manageiq/rpm_build:latest-kasparov
docker.io/manageiq/rpm_build:latest-kasparov
+ docker run --rm -v /home/me/github/manageiq-appliance-build/bin/../OPTIONS:/root/OPTIONS:Z -v /home/me/github/manageiq-appliance-build/bin/../rpm_cache:/root/rpm_cache:Z manageiq/rpm_build:latest-kasparov build --build-type release --git-ref kasparov-1 --update-rpm-repo
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Fetching gem metadata from https://rubygems.org/.........
Resolving dependencies...
Fetching rake 13.0.3
Installing rake 13.0.3
Fetching concurrent-ruby 1.1.8
Installing concurrent-ruby 1.1.8
Fetching i18n 1.8.10
Installing i18n 1.8.10
Fetching minitest 5.14.4
Installing minitest 5.14.4
Fetching tzinfo 2.0.4
Installing tzinfo 2.0.4
Fetching zeitwerk 2.4.2
Installing zeitwerk 2.4.2
Fetching activesupport 6.1.3.2
Installing activesupport 6.1.3.2
Fetching public_suffix 4.0.6
Installing public_suffix 4.0.6
Fetching addressable 2.7.0
Installing addressable 2.7.0
Fetching ast 2.4.2
Installing ast 2.4.2
Fetching awesome_spawn 1.5.0
Installing awesome_spawn 1.5.0
Fetching aws-eventstream 1.1.1
Installing aws-eventstream 1.1.1
Fetching aws-partitions 1.454.0
Installing aws-partitions 1.454.0
Fetching aws-sigv4 1.2.3
Installing aws-sigv4 1.2.3
Fetching jmespath 1.4.0
Installing jmespath 1.4.0
Fetching aws-sdk-core 3.114.0
Installing aws-sdk-core 3.114.0
Fetching aws-sdk-kms 1.43.0
Installing aws-sdk-kms 1.43.0
Fetching aws-sdk-s3 1.94.1
Installing aws-sdk-s3 1.94.1
Fetching thread_safe 0.3.6
Installing thread_safe 0.3.6
Fetching descendants_tracker 0.0.4
Installing descendants_tracker 0.0.4
Fetching ice_nine 0.11.2
Installing ice_nine 0.11.2
Fetching axiom-types 0.1.1
Installing axiom-types 0.1.1
Using bundler 1.17.2
Fetching coercible 1.0.0
Installing coercible 1.0.0
Fetching deep_merge 1.2.1
Installing deep_merge 1.2.1
Fetching dry-core 0.5.0
Installing dry-core 0.5.0
Fetching dry-configurable 0.12.1
Installing dry-configurable 0.12.1
Fetching dry-container 0.7.2
Installing dry-container 0.7.2
Fetching dry-equalizer 0.3.0
Installing dry-equalizer 0.3.0
Fetching dry-initializer 3.0.4
Installing dry-initializer 3.0.4
Fetching dry-logic 1.2.0
Installing dry-logic 1.2.0
Fetching dry-inflector 0.2.0
Installing dry-inflector 0.2.0
Fetching dry-types 1.5.1
Installing dry-types 1.5.1
Fetching dry-schema 1.6.2
Installing dry-schema 1.6.2
Fetching dry-validation 1.6.0
Installing dry-validation 1.6.0
Fetching config 3.1.0
Installing config 3.1.0
Fetching faraday-excon 1.1.0
Installing faraday-excon 1.1.0
Fetching faraday-net_http 1.0.1
Installing faraday-net_http 1.0.1
Fetching faraday-net_http_persistent 1.1.0
Installing faraday-net_http_persistent 1.1.0
Fetching multipart-post 2.1.1
Installing multipart-post 2.1.1
Fetching ruby2_keywords 0.0.4
Installing ruby2_keywords 0.0.4
Fetching faraday 1.4.1
Installing faraday 1.4.1
Fetching kartograph 0.2.8
Installing kartograph 0.2.8
Fetching resource_kit 0.1.7
Installing resource_kit 0.1.7
Fetching equalizer 0.0.11
Installing equalizer 0.0.11
Fetching virtus 1.0.5
Installing virtus 1.0.5
Fetching droplet_kit 3.13.1
Installing droplet_kit 3.13.1
Using sync 0.5.0
Fetching more_core_extensions 4.3.0
Installing more_core_extensions 4.3.0
Fetching optimist 3.0.1
Installing optimist 3.0.1
Fetching parallel 1.20.1
Installing parallel 1.20.1
Fetching parser 3.0.1.1
Installing parser 3.0.1.1
Fetching rainbow 3.0.0
Installing rainbow 3.0.0
Fetching regexp_parser 2.1.1
Installing regexp_parser 2.1.1
Fetching rexml 3.2.5
Installing rexml 3.2.5
Fetching rubocop-ast 1.5.0
Installing rubocop-ast 1.5.0
Fetching ruby-progressbar 1.11.0
Installing ruby-progressbar 1.11.0
Fetching unicode-display_width 2.0.0
Installing unicode-display_width 2.0.0
Fetching rubocop 1.14.0
Installing rubocop 1.14.0
Fetching rubocop-performance 1.11.3
Installing rubocop-performance 1.11.3
Fetching rack 2.2.3
Installing rack 2.2.3
Fetching rubocop-rails 2.10.1
Installing rubocop-rails 2.10.1
Fetching manageiq-style 1.3.0
Installing manageiq-style 1.3.0
Fetching tins 1.29.0
Installing tins 1.29.0
Fetching term-ansicolor 1.7.1
Installing term-ansicolor 1.7.1
Bundle complete! 9 Gemfile dependencies, 65 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Post-install message from config:

Thanks for installing Config
Please consider donating to our open collective to help us maintain this project.


Donate: https://opencollective.com/rubyconfig/donate

 ---> ManageIQ::RPMBuild::SetupSourceRepos#initialize

 ---> ManageIQ::RPMBuild::SetupSourceRepos#populate

 ---> ManageIQ::RPMBuild::SetupSourceRepos#clean_build_dir

 ---> ManageIQ::RPMBuild::SetupSourceRepos#setup_rpm_spec_repo

 ---> ManageIQ::RPMBuild::SetupSourceRepos#setup_source_repo

 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-appliance.git manageiq-appliance
Cloning into 'manageiq-appliance'...
Note: switching to 'c24a43df77dbdae923f8d851151ca2dd7a1865de'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false


 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq.git manageiq
Cloning into 'manageiq'...
Note: switching to '15acbea8c6384c2cebcc07040ece2a760811a920'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false


 ---> git clone --depth 1 -b kasparov-1 https://github.com/ManageIQ/manageiq-ui-service.git manageiq-ui-service
Cloning into 'manageiq-ui-service'...
Note: switching to '99982fe1b62cacfdc36fa2eec92864362d66f4a9'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false


 ---> ManageIQ::RPMBuild::GenerateGemSet#initialize

 ---> ManageIQ::RPMBuild::GenerateGemSet#backup_environment_variables

 ---> ManageIQ::RPMBuild::GenerateGemSet#set_environment_variables

 ---> gem env
RubyGems Environment:
  - RUBYGEMS VERSION: 3.0.3
  - RUBY VERSION: 2.6.3 (2019-04-16 patchlevel 62) [x86_64-linux]
  - INSTALLATION DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0
  - USER INSTALLATION DIRECTORY: /root/.gem/ruby
  - RUBY EXECUTABLE: /usr/bin/ruby
  - GIT EXECUTABLE: /bin/git
  - EXECUTABLE DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0/bin
  - SPEC CACHE DIRECTORY: /root/.gem/specs
  - SYSTEM CONFIGURATION DIRECTORY: /etc
  - RUBYGEMS PLATFORMS:
    - ruby
    - x86_64-linux
  - GEM PATHS:
     - /root/BUILD/manageiq-gemset-11.1.0
     - /usr/share/gems
     - /usr/local/share/gems
  - GEM CONFIGURATION:
     - :update_sources => true
     - :verbose => true
     - :backtrace => false
     - :bulk_threshold => 1000
     - "gem" => "--no-ri --no-rdoc --no-document"
  - REMOTE SOURCES:
     - https://rubygems.org/
  - SHELL PATH:
     - /root/BUILD/manageiq-gemset-11.1.0/bin
     - /usr/local/bin
     - /usr/local/sbin
     - /bin
     - /sbin
     - /usr/bin
     - /usr/sbin
     - /root/bin
     - ~/bin

 ---> echo -e "${PATH}\n"
/root/BUILD/manageiq-gemset-11.1.0/bin:/usr/local/bin:/usr/local/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/root/bin:~/bin


 ---> gem install bundler -v 2.1.4
Successfully installed bundler-2.1.4
1 gem installed

 ---> ManageIQ::RPMBuild::GenerateGemSet#populate_gem_home

 ---> gem env
RubyGems Environment:
  - RUBYGEMS VERSION: 3.0.3
  - RUBY VERSION: 2.6.3 (2019-04-16 patchlevel 62) [x86_64-linux]
  - INSTALLATION DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0
  - USER INSTALLATION DIRECTORY: /root/.gem/ruby
  - RUBY EXECUTABLE: /usr/bin/ruby
  - GIT EXECUTABLE: /bin/git
  - EXECUTABLE DIRECTORY: /root/BUILD/manageiq-gemset-11.1.0/bin
  - SPEC CACHE DIRECTORY: /root/.gem/specs
  - SYSTEM CONFIGURATION DIRECTORY: /etc
  - RUBYGEMS PLATFORMS:
    - ruby
    - x86_64-linux
  - GEM PATHS:
     - /root/BUILD/manageiq-gemset-11.1.0
     - /usr/share/gems
     - /usr/local/share/gems
  - GEM CONFIGURATION:
     - :update_sources => true
     - :verbose => true
     - :backtrace => false
     - :bulk_threshold => 1000
     - "gem" => "--no-ri --no-rdoc --no-document"
  - REMOTE SOURCES:
     - https://rubygems.org/
  - SHELL PATH:
     - /root/BUILD/manageiq-gemset-11.1.0/bin
     - /usr/local/bin
     - /usr/local/sbin
     - /bin
     - /sbin
     - /usr/bin
     - /usr/sbin
     - /root/bin
     - ~/bin

 ---> gem install mime-types -v 2.6.1
Successfully installed mime-types-2.6.1
1 gem installed

 ---> bundle config set --local with qpid_proton systemd

 ---> bundle _2.1.4_ install --jobs 4 --retry 3
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Fetching gem metadata from https://rubygems.org/.
Resolving dependencies...
Using bundler 2.1.4
Fetching bundler-inject 1.1.0
Installing bundler-inject 1.1.0
Installed plugin bundler-inject
Fetching source index from https://rubygems.manageiq.org/
Fetching gem metadata from https://rubygems.org/......
Your bundle is locked to mimemagic (0.3.5), but that version could not be found
in any of the sources listed in your Gemfile. If you haven't changed sources,
that means the author of mimemagic (0.3.5) has removed it. You'll need to update
your bundle to a version other than mimemagic (0.3.5) that hasn't been removed
in order to install.
[me@centos8t01 manageiq-appliance-build]$

@bdunne
Copy link
Member

bdunne commented May 12, 2021

@tjyang Can you docker pull manageiq/rpm_build:latest-kasparov? I manually triggered a rebuild of those images yesterday and it worked on the builds that ran last night

@tjyang
Copy link
Author

tjyang commented May 12, 2021

@bdunne
Thanks for your pointer above, here are the steps I got the build to generate RPMs.

  • remove existing all docker images
  • docker pull manageiq/rpm_build:latest-kasparov
  • bin/rpm-build.sh -t nightly -r kasparov-1
  • This is the generated RPMs

Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(FileDigests) <= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1
Checking for unpackaged file(s): /usr/lib/rpm/check-files /root/rpmbuild/BUILDROOT/manageiq-11.1.0-1.20210512121312.el8.x86_64
Wrote: /root/BUILD/rpms/x86_64/manageiq-appliance-11.1.0-1.20210512121312.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-appliance-tools-11.1.0-1.20210512121312.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-core-11.1.0-1.20210512121312.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-gemset-11.1.0-1.20210512121312.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-pods-11.1.0-1.20210512121312.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-system-11.1.0-1.20210512121312.el8.x86_64.rpm
Wrote: /root/BUILD/rpms/x86_64/manageiq-ui-11.1.0-1.20210512121312.el8.x86_64.rpm
Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.gkEFqF

@bdunne
Copy link
Member

bdunne commented May 12, 2021

@tjyang Great! Anything else to resolve before we close this issue?

@tjyang
Copy link
Author

tjyang commented May 12, 2021

@bdunne

Should we wait for ManageIQ/manageiq#21215 to be closed ?
So that following command works again.

bin/rpm-build.sh -t release -r kasparov-1

@kbrock
Copy link
Member

kbrock commented Jul 22, 2021

The build is working

can we close this?

@tjyang
Copy link
Author

tjyang commented Jul 23, 2021

@kbrock

I tried to build kasparov-1 and kasparov-2 , both were able to generated RPMs.

[me@centos8t01 manageiq-appliance-build]$ time bin/rpm-build.sh -t nightly -r kasparov-1 Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(FileDigests) <= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1 Checking for unpackaged file(s): /usr/lib/rpm/check-files /root/rpmbuild/BUILDROOT/manageiq-11.2.0-1.20210723064612.el8.x86_64 Wrote: /root/BUILD/rpms/x86_64/manageiq-appliance-11.2.0-1.20210723064612.el8.x86_64.rpm Wrote: /root/BUILD/rpms/x86_64/manageiq-appliance-tools-11.2.0-1.20210723064612.el8.x86_64.rpm Wrote: /root/BUILD/rpms/x86_64/manageiq-core-11.2.0-1.20210723064612.el8.x86_64.rpm Wrote: /root/BUILD/rpms/x86_64/manageiq-gemset-11.2.0-1.20210723064612.el8.x86_64.rpm Wrote: /root/BUILD/rpms/x86_64/manageiq-pods-11.2.0-1.20210723064612.el8.x86_64.rpm Wrote: /root/BUILD/rpms/x86_64/manageiq-system-11.2.0-1.20210723064612.el8.x86_64.rpm Wrote: /root/BUILD/rpms/x86_64/manageiq-ui-11.2.0-1.20210723064612.el8.x86_64.rpm Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.L8KXGC + umask 022 + cd /root/rpmbuild/BUILD + cd manageiq-manifest-11.2.0 + rm -rf /root/rpmbuild/BUILDROOT/manageiq-11.2.0-1.20210723064612.el8.x86_64 + exit 0 /root/.gem/ruby/gems/aws-sigv4-1.2.4/lib/aws-sigv4/signer.rb:621:in `extract_credentials_provider': missing credentials, provide credentials with one of the following options: (Aws::Sigv4::Errors::MissingCredentialsError) - :access_key_id and :secret_access_key - :credentials - :credentials_provider from /root/.gem/ruby/gems/aws-sigv4-1.2.4/lib/aws-sigv4/signer.rb:124:in `initialize' from /root/.gem/ruby/gems/aws-sdk-s3-1.96.2/lib/aws-sdk-s3/plugins/s3_signer.rb:215:in `new' from /root/.gem/ruby/gems/aws-sdk-s3-1.96.2/lib/aws-sdk-s3/plugins/s3_signer.rb:215:in `build_v4_signer' from /root/.gem/ruby/gems/aws-sdk-s3-1.96.2/lib/aws-sdk-s3/plugins/s3_signer.rb:14:in `block in ' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:72:in `call' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:215:in `block in resolve_defaults' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:59:in `each' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:59:in `each' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:214:in `resolve_defaults' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:207:in `value_at' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:191:in `block in resolve' from /usr/share/ruby/set.rb:338:in `each_key' from /usr/share/ruby/set.rb:338:in `each' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:191:in `resolve' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:179:in `apply_defaults' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/configuration.rb:152:in `build!' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/base.rb:65:in `build_config' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/base.rb:22:in `initialize' from /root/.gem/ruby/gems/aws-sdk-s3-1.96.2/lib/aws-sdk-s3/client.rb:408:in `initialize' from /root/.gem/ruby/gems/aws-sdk-core-3.117.0/lib/seahorse/client/base.rb:102:in `new' from /build_scripts/lib/manageiq/rpm_build/s3_common.rb:9:in `client' from /build_scripts/lib/manageiq/rpm_build/rpm_repo.rb:25:in `block (3 levels) in update' from /root/.gem/ruby/gems/config-3.1.0/lib/config/options.rb:87:in `each' from /root/.gem/ruby/gems/config-3.1.0/lib/config/options.rb:87:in `each' from /build_scripts/lib/manageiq/rpm_build/rpm_repo.rb:24:in `block (2 levels) in update' from /root/.gem/ruby/gems/config-3.1.0/lib/config/options.rb:87:in `each' from /root/.gem/ruby/gems/config-3.1.0/lib/config/options.rb:87:in `each' from /build_scripts/lib/manageiq/rpm_build/rpm_repo.rb:23:in `block in update' from /usr/share/ruby/tmpdir.rb:93:in `mktmpdir' from /build_scripts/lib/manageiq/rpm_build/rpm_repo.rb:9:in `update' from bin/build.rb:52:in `' Downloading required RPMs...

real 40m46.597s
user 0m0.324s
sys 0m1.348s
[me@centos8t01 manageiq-appliance-build]$ date
Fri Jul 23 03:29:23 EDT 2021
[me@centos8t01 manageiq-appliance-build]$

@tjyang tjyang closed this as completed Jul 23, 2021
@bdunne
Copy link
Member

bdunne commented Jul 26, 2021

Kasparov fixed by: ManageIQ/manageiq#21330

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants