Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Registry and router image version mangled during upgrade #1072

Closed
sdodson opened this issue Dec 16, 2015 · 9 comments
Closed

Registry and router image version mangled during upgrade #1072

sdodson opened this issue Dec 16, 2015 · 9 comments

Comments

@sdodson
Copy link
Member

sdodson commented Dec 16, 2015

Seems like two different folks have run into this.

First case
Error: image openshift3/ose-docker-registry:vmanager 3.1.0.4 not found
Error: image openshift3/ose-haproxy-router:vmanager 3.1.0.4 not found

Second case from @cooktheryan yielded
Error: image openshift3/ose-docker-registry:vsystem 3.1.0.4 not found
@sdodson
Copy link
Member Author

sdodson commented Dec 16, 2015

@cooktheryan The upgrade scripts do some version checking of packages that are currently installed and those that are available. grep openshift /var/log/yum.log would be helpful in debugging what those values were at the time of upgrade. Also can you confirm which playbook you ran?

@cooktheryan
Copy link
Contributor

The update was ran on the system pre-openshift-ansible

Jun 29 19:09:27 Installed: openshift-3.0.0.0-0.git.25.235b0e7.el7ose.x86_64
Jun 29 19:09:27 Installed: openshift-master-3.0.0.0-0.git.25.235b0e7.el7ose.x86_64
Jun 29 19:12:54 Installed: tuned-profiles-openshift-node-3.0.0.0-0.git.25.235b0e7.el7ose.x86_64
Jun 29 19:12:54 Installed: openshift-node-3.0.0.0-0.git.25.235b0e7.el7ose.x86_64
Jun 29 19:13:12 Installed: openshift-sdn-ovs-3.0.0.0-0.git.25.235b0e7.el7ose.x86_64
Aug 09 11:31:38 Updated: openshift-3.0.1.0-1.git.525.eddc479.el7ose.x86_64
Aug 09 11:31:39 Updated: tuned-profiles-openshift-node-3.0.1.0-1.git.525.eddc479.el7ose.x86_64
Aug 09 11:31:41 Updated: openshift-node-3.0.1.0-1.git.525.eddc479.el7ose.x86_64
Aug 09 11:31:41 Updated: openshift-sdn-ovs-3.0.1.0-1.git.525.eddc479.el7ose.x86_64
Aug 09 11:31:41 Updated: openshift-master-3.0.1.0-1.git.525.eddc479.el7ose.x86_64
Oct 14 12:12:47 Updated: openshift-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 12:12:48 Updated: tuned-profiles-openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 12:12:48 Updated: openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 12:12:48 Updated: openshift-sdn-ovs-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 12:12:48 Updated: openshift-master-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Nov 24 15:56:25 Installed: tuned-profiles-atomic-openshift-node-3.1.0.4-1.git.4.b6c7cd2.el7aos.x86_64
Nov 24 15:56:27 Installed: atomic-openshift-clients-3.1.0.4-1.git.4.b6c7cd2.el7aos.x86_64
Nov 24 15:56:29 Installed: atomic-openshift-3.1.0.4-1.git.4.b6c7cd2.el7aos.x86_64
Nov 24 15:56:46 Installed: atomic-openshift-node-3.1.0.4-1.git.4.b6c7cd2.el7aos.x86_64
Nov 24 15:56:46 Installed: atomic-openshift-sdn-ovs-3.1.0.4-1.git.4.b6c7cd2.el7aos.x86_64
Nov 24 15:56:46 Installed: atomic-openshift-master-3.1.0.4-1.git.4.b6c7cd2.el7aos.x86_64
Nov 24 15:56:46 Erased: openshift-sdn-ovs-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Nov 24 15:56:46 Erased: openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Nov 24 15:56:46 Erased: openshift-master-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Nov 24 15:56:48 Erased: tuned-profiles-openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Nov 24 15:56:49 Erased: openshift-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Dec 16 12:26:53 Updated: atomic-openshift-clients-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 12:27:00 Updated: atomic-openshift-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 12:27:34 Updated: tuned-profiles-atomic-openshift-node-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 12:27:39 Updated: atomic-openshift-node-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 12:27:56 Updated: atomic-openshift-sdn-ovs-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 12:27:59 Updated: atomic-openshift-master-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64

Script ran was /home/rcook/git/openshift-ansible/playbooks/byo/openshift-cluster/upgrades/v3_0_to_v3_1/upgrade.yml

Running on a clean cluster without yum update being ran first. Will post output once completed

@cooktheryan
Copy link
Contributor

Registry started correctly this time. Registry version openshift3/ose-docker-registry:v3.1.0.4

yum output
Sep 07 16:31:03 Installed: openshift-3.0.1.0-1.git.529.dcab62c.el7ose.x86_64
Sep 07 17:03:04 Installed: openshift-master-3.0.1.0-1.git.529.dcab62c.el7ose.x86_64
Sep 07 18:31:56 Installed: tuned-profiles-openshift-node-3.0.1.0-1.git.529.dcab62c.el7ose.x86_64
Sep 07 18:31:58 Installed: openshift-node-3.0.1.0-1.git.529.dcab62c.el7ose.x86_64
Sep 07 18:32:29 Installed: openshift-sdn-ovs-3.0.1.0-1.git.529.dcab62c.el7ose.x86_64
Oct 14 15:13:40 Updated: openshift-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 15:13:41 Updated: tuned-profiles-openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 15:13:41 Updated: openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 15:13:41 Updated: openshift-sdn-ovs-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Oct 14 15:13:41 Updated: openshift-master-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Dec 16 13:25:57 Installed: tuned-profiles-atomic-openshift-node-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 13:26:00 Installed: atomic-openshift-clients-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 13:26:02 Installed: atomic-openshift-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 13:26:02 Installed: atomic-openshift-node-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 13:26:02 Installed: atomic-openshift-sdn-ovs-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 13:26:03 Installed: atomic-openshift-master-3.1.0.4-1.git.15.5e061c3.el7aos.x86_64
Dec 16 13:26:03 Erased: openshift-sdn-ovs-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Dec 16 13:26:03 Erased: openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Dec 16 13:26:03 Erased: openshift-master-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Dec 16 13:26:04 Erased: tuned-profiles-openshift-node-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64
Dec 16 13:26:05 Erased: openshift-3.0.2.0-0.git.16.4d626fe.el7ose.x86_64

@abutcher
Copy link
Member 

TASK: [debug var=g_new_version] ***********************************************
ok: [osemaster0] => {
    "var": {
        "g_new_version": "system 3.1.0.4"
    }
}
ok: [oseintnode0] => {
    "var": {
        "g_new_version": "system 3.1.0.4"
    }
}
ok: [oseintnode1] => {
    "var": {
        "g_new_version": "system 3.1.0.4"
    }
}

[root@osemaster0 ~]# yum list installed "atomic-openshift" 2>&1 | tail -n +2 | grep -v 'Installed Packages' | grep -v 'Red Hat Subscription Management'
This system is receiving updates from RHN Classic or Red Hat Satellite.
atomic-openshift.x86_64 3.1.0.4-1.git.15.5e061c3.el7aos @rhel-7-server-ose-3.1-rpms

@sdodson @cooktheryan

@abutcher
Copy link
Member

Simplest fix might be to just add a | grep -v 'system' | grep -v 'manager' | to the versions script or we can rework the logic. I have a feeling we'll see other lines we didn't expect if we stick with this method.

@detiber
Copy link
Contributor

detiber commented Dec 16, 2015

@abutcher agreed, we should probably use the yum/dnf api for gathering the info rather than attempting to parse the output of yum list.

That said, a quick workaround for | grep -v 'system' | grep -v 'manager' | is probably a good idea.

@sdodson
Copy link
Member Author

sdodson commented Dec 16, 2015

-e 0 seems to clean things up quite a bit PR incoming

@abutcher abutcher mentioned this issue Dec 16, 2015
Closed
@abutcher
Copy link
Member

@sdodson I'll close #1075 in favor of yours if you have some extra sauce.

@sdodson sdodson mentioned this issue Dec 16, 2015
Merged
@tbielawa
Copy link
Contributor

We've made many advances in version detection recently so I am going to close this issue.

Please update and reopen this issue if this is still a priority you would like to see action on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@tbielawa @abutcher @sdodson @detiber @cooktheryan