Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to K8s v1.8.3 and use native Openstack Neutron networking #8

merged 28 commits into from Mar 13, 2018


Copy link

@zioproto zioproto commented Nov 15, 2017

the biggest change is the use of Neutron networking. We pass the router UUID to the k8s master and drop weavenet. Each pod has a /24 network, and the neutron router is configured dynamically by the k8s master with routes to send the traffic for the pods to the right vm. This is an example for the router show after my deployment.

$ openstack router show b11216cb-a725-4006-9a55-7853d66e5894
| Field                   | Value                                                                                                                                                                                                                                                                                 |
| admin_state_up          | UP                                                                                                                                                                                                                                                                                    |
| availability_zone_hints |                                                                                                                                                                                                                                                                                       |
| availability_zones      | nova                                                                                                                                                                                                                                                                                  |
| created_at              | 2017-06-21T06:54:20Z                                                                                                                                                                                                                                                                  |
| description             |                                                                                                                                                                                                                                                                                       |
| distributed             | False                                                                                                                                                                                                                                                                                 |
| flavor_id               | None                                                                                                                                                                                                                                                                                  |
| ha                      | False                                                                                                                                                                                                                                                                                 |
| id                      | b11216cb-a725-4006-9a55-7853d66e5894                                                                                                                                                                                                                                                  |
| name                    | k8s                                                                                                                                                                                                                                                                                   |
| project_id              | 8fcf0992e82943089de7dabe728b78fa                                                                                                                                                                                                                                                      |
| revision_number         | None                                                                                                                                                                                                                                                                                  |
| routes                  | destination='', gateway=''                                                                                                                                                                                                                                       |
|                         | destination='', gateway=''                                                                                                                                                                                                                                       |
|                         | destination='', gateway=''                                                                                                                                                                                                                                      |
|                         | destination='', gateway=''                                                                                                                                                                                                                                      |
| status                  | ACTIVE                                                                                                                                                                                                                                                                                |
| updated_at              | 2017-11-15T08:08:30Z                                                                                                                                                                                                                                                                  |

Because of a bug in the gopher cloud version embedded in K8s, we need at least k8s version v1.8.0 for the neutron intergration to work correctly. The fix landed in K8s with commit 74a3d89ad4ff1508a16bacb0c333a1f795c31470. Because of this I had to upgrade the K8s version to use this networking feature.

This is a big change to the playbook. I understand if you dont want to merge and keep weavenet :) But I like better without overlay so the Pods have MTU 1500 :)

Saverio Proto and others added 18 commits Jun 15, 2017
If you are running the playbook from an IPv6 host and the Openstack instances
have IPv6 addresses the playbook will fail if you dont open IPv6.
…working with Kubenet networking"

This reverts commit cf9e665.
fix copy ca.crt to nodes fails in non-default cluster name
quote password in cloud-config
update docker version to 1.13.1
remove obsolete 1.7.0 workaround
Copy link

@ctrlaltdel ctrlaltdel commented Dec 12, 2017

Thanks for the code, I'll give it a try and will merge it.

@zioproto zioproto force-pushed the zioproto:master branch from 80fad98 to 17a43d3 Feb 2, 2018
@zioproto zioproto force-pushed the zioproto:master branch from 17a43d3 to f69bda7 Feb 2, 2018
@ctrlaltdel ctrlaltdel merged commit 0b26da1 into infraly:master Mar 13, 2018
Copy link

@ctrlaltdel ctrlaltdel commented Mar 14, 2018

Thanks for the contribution! And sorry for taking so long to merge it, I was waiting for some testing infrastructure to become ready... The plan now is to setup a public CI instead based on Travis.

Copy link
Contributor Author

@zioproto zioproto commented Mar 14, 2018

Sure, I will soon upgrade to v1.9.4 where there is a patch I contributed that fixes an IPv6 problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

3 participants
You can’t perform that action at this time.