openstack-base: can't reach instance's floating ip

[samantha-jian]

conjure-up 2.1.0 rev103, canonical classic

0. All nodes have 2 NIC ports connected to the same switch, there is no VLAN configurations on the switch. Keep the neutron-gateway default configuration and make sure the eth1 on the physical node is connected to the switch.
1. Select openstack-base to deploy on a MAAS cloud and run all the post deployment steps to configure the cloud.
2. Log in to horizon and launch two 16.04 instances on the ubuntu-net, then assign floating IP to each. Instances are launched successfully.
3. On the conjure-up node, add an interface , which is connected to the same switch, to conjureup0 (10.99.0.1). sudo brctl addif conjureup0 eno2.
4. On the conjure-up node, can't ping or ssh to the instance via floating ip address.

conjure-up interfaces info:
ubuntu@conjure-up:~$ brctl show
bridge name	bridge id		STP enabled	interfaces
conjureup0		8000.0cc47a6b4e9d	no		eno2
lxdbr0		8000.000000000000	no		
ubuntu@conjure-up:~$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 0c:c4:7a:6b:4e:9c brd ff:ff:ff:ff:ff:ff
    inet 10.14.15.254/20 brd 10.14.15.255 scope global eno1
       valid_lft forever preferred_lft forever
    inet6 fe80::ec4:7aff:fe6b:4e9c/64 scope link 
       valid_lft forever preferred_lft forever
3: eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master conjureup0 state UP group default qlen 1000
    link/ether 0c:c4:7a:6b:4e:9d brd ff:ff:ff:ff:ff:ff
    inet6 fe80::ec4:7aff:fe6b:4e9d/64 scope link 
       valid_lft forever preferred_lft forever
4: ens2f0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:bc:b6:92 brd ff:ff:ff:ff:ff:ff
5: ens2f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:bc:b6:93 brd ff:ff:ff:ff:ff:ff
6: conjureup0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 0c:c4:7a:6b:4e:9d brd ff:ff:ff:ff:ff:ff
    inet 10.99.0.1/24 scope global conjureup0
       valid_lft forever preferred_lft forever
    inet6 fe80::20df:abff:fefd:dfe4/64 scope link 
       valid_lft forever preferred_lft forever
7: lxdbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 6e:a1:01:33:7d:ee brd ff:ff:ff:ff:ff:ff
    inet 10.0.8.1/24 scope global lxdbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::6ca1:1ff:fe33:7dee/64 scope link 
       valid_lft forever preferred_lft forever
ubuntu@conjure-up:~$

neutron-gateway/0: 
ubuntu@node21:~$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master br-eth0 state UP group default qlen 1000
    link/ether 0c:c4:7a:3a:6e:94 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000
    link/ether 0c:c4:7a:3a:6e:95 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::ec4:7aff:fe3a:6e95/64 scope link 
       valid_lft forever preferred_lft forever
4: enp1s0f2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:3a:6e:96 brd ff:ff:ff:ff:ff:ff
5: enp1s0f3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:3a:6e:97 brd ff:ff:ff:ff:ff:ff
6: enp129s0f0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:b7:40:d8 brd ff:ff:ff:ff:ff:ff
7: enp129s0f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:b7:40:d9 brd ff:ff:ff:ff:ff:ff
8: enp130s0f0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:b7:41:48 brd ff:ff:ff:ff:ff:ff
9: enp130s0f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 0c:c4:7a:b7:41:49 brd ff:ff:ff:ff:ff:ff
11: lxdbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 6e:14:c8:4a:10:cc brd ff:ff:ff:ff:ff:ff
    inet 10.0.0.1/24 scope global lxdbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::6c14:c8ff:fe4a:10cc/64 scope link 
       valid_lft forever preferred_lft forever
12: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1
    link/ether a2:2b:4a:e3:61:66 brd ff:ff:ff:ff:ff:ff
13: br-int: <BROADCAST,MULTICAST> mtu 1458 qdisc noop state DOWN group default qlen 1
    link/ether 9a:d6:85:68:49:43 brd ff:ff:ff:ff:ff:ff
14: br-ex: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1
    link/ether 0c:c4:7a:3a:6e:95 brd ff:ff:ff:ff:ff:ff
15: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1
    link/ether 06:be:e1:a3:8e:4e brd ff:ff:ff:ff:ff:ff
16: br-eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 0c:c4:7a:3a:6e:94 brd ff:ff:ff:ff:ff:ff
    inet 10.14.0.27/20 brd 10.14.15.255 scope global br-eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::ec4:7aff:fe3a:6e94/64 scope link 
       valid_lft forever preferred_lft forever
18: vethXG39MP@if17: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-eth0 state UP group default qlen 1000
    link/ether fe:7c:d1:d6:a1:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet6 fe80::fc7c:d1ff:fed6:a1f6/64 scope link 
       valid_lft forever preferred_lft forever
20: vethMAPQ45@if19: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-eth0 state UP group default qlen 1000
    link/ether fe:69:4a:25:79:34 brd ff:ff:ff:ff:ff:ff link-netnsid 1
    inet6 fe80::fc69:4aff:fe25:7934/64 scope link 
       valid_lft forever preferred_lft forever
22: vethJY3JB0@if21: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-eth0 state UP group default qlen 1000
    link/ether fe:9c:83:c1:1a:f3 brd ff:ff:ff:ff:ff:ff link-netnsid 2
    inet6 fe80::fc9c:83ff:fec1:1af3/64 scope link 
       valid_lft forever preferred_lft forever
23: tap84dcbb34-e6@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc noqueue master ovs-system state UP group default qlen 1000
    link/ether 86:8e:67:13:ee:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 3
24: tapc0e1a086-f7@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc noqueue master ovs-system state UP group default qlen 1000
    link/ether 5a:84:d2:2a:f4:a4 brd ff:ff:ff:ff:ff:ff link-netnsid 4
25: tap602efb79-8c@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc noqueue master ovs-system state UP group default qlen 1000
    link/ether 5a:b4:5f:53:fe:2f brd ff:ff:ff:ff:ff:ff link-netnsid 4
26: gre0@NONE: <NOARP> mtu 1476 qdisc noop state DOWN group default qlen 1
    link/gre 0.0.0.0 brd 0.0.0.0
27: gretap0@NONE: <BROADCAST,MULTICAST> mtu 1462 qdisc noop state DOWN group default qlen 1000
    link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
28: gre_sys@NONE: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65490 qdisc pfifo_fast master ovs-system state UNKNOWN group default qlen 1000
    link/ether 62:3f:5c:1e:ab:a2 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::603f:5cff:fe1e:aba2/64 scope link 
       valid_lft forever preferred_lft forever
ubuntu@node21:~$ sudo ovs-vsctl show
bf02bbf8-1ace-4572-845d-fd5c933ec0d9
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-ex
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port "eth1"
            Interface "eth1"
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port "tap602efb79-8c"
            tag: 2
            Interface "tap602efb79-8c"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port "tap84dcbb34-e6"
            tag: 1
            Interface "tap84dcbb34-e6"
        Port "tapc0e1a086-f7"
            tag: 1
            Interface "tapc0e1a086-f7"
    Bridge br-tun
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port "gre-0a0e001a"
            Interface "gre-0a0e001a"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.14.0.27", out_key=flow, remote_ip="10.14.0.26"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a0e0018"
            Interface "gre-0a0e0018"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.14.0.27", out_key=flow, remote_ip="10.14.0.24"}
        Port br-tun
            Interface br-tun
                type: internal
    ovs_version: "2.6.0"
ubuntu@node21:~$