Can't access VM after successfully created

[vuquangchien]

Hi all,
I followed the guide posted here https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/blob/OVS_MultiNode/OpenStack_Grizzly_Install_Guide.rst, and successfully created my instance from the Horizon dashboard.

However, I can't access the vm (ping/ssh) from the network node directly

vuquangchien@network:~$ ping 50.50.1.1
connect: Network is unreachable
vuquangchien@network:~$ ping 50.50.1.2
connect: Network is unreachable

I also try to follow the pinging method from the official OpenStack documentation - Basic Installation Guide for Ubuntu 12.04 (LTS) and Debian Wheezy: Section 3. Create Your First VM; Procedure 3.4. To SSH into the launched instance.
This time I was able to ping the interface, but not the VM itself

vuquangchien@network:~$ ip netns
qrouter-26f355ef-cad2-4ccd-a69e-233aabe66393
qdhcp-404bcb04-842b-499e-ba7a-72780e45edec
vuquangchien@network:~$ sudo ip netns exec qdhcp-404bcb04-842b-499e-ba7a-72780e45edec ping 50.50.1.1
PING 50.50.1.1 (50.50.1.1) 56(84) bytes of data.
64 bytes from 50.50.1.1: icmp_req=1 ttl=64 time=0.099 ms
64 bytes from 50.50.1.1: icmp_req=2 ttl=64 time=0.078 ms
vuquangchien@network:~$ sudo ip netns exec qdhcp-404bcb04-842b-499e-ba7a-72780e45edec ping 50.50.1.2
PING 50.50.1.2 (50.50.1.2) 56(84) bytes of data.
From 50.50.1.3 icmp_seq=1 Destination Host Unreachable
From 50.50.1.3 icmp_seq=2 Destination Host Unreachable
From 50.50.1.3 icmp_seq=3 Destination Host Unreachable

So my thought the VM doesn't get a valid IP. I also follow this thread #127 (Can't ping virtual machine. Virtual Machine doesn't get IP).
My symtons are exactly the same as described in the thread:

• At first the openvswitch version was 1.4.0: I updated it to 1.4.2
• I also had the permission error, and then I granted the quantum user with sudo access. It seems to go away

However, after that point, I still couldn't ping my vm from the network node. While the questioner(llastra) got the issue fixed and move on to the next part.

Any help will be appreciated as I've been try for weeks to connect to my vm ( I previously used the official guide from OpenStack website but it seems to be buggy and is not as detailed as this one).
I include some information as below for diagnostics. Many thanks,
Chien

1. ifconfig from compute node

eth0      Link encap:Ethernet  HWaddr 6c:3b:e5:1f:c0:3c
          inet addr:10.20.20.11  Bcast:10.20.20.255  Mask:255.255.255.0
          inet6 addr: fe80::6e3b:e5ff:fe1f:c03c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:468 (468.0 B)

eth1      Link encap:Ethernet  HWaddr 00:e0:4c:3d:3b:e9
          inet addr:10.10.10.11  Bcast:10.10.10.255  Mask:255.255.255.0
          inet6 addr: fe80::2e0:4cff:fe3d:3be9/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:15617 errors:0 dropped:0 overruns:0 frame:0
          TX packets:22506 errors:0 dropped:0 overruns:3 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:3889999 (3.8 MB)  TX bytes:7155221 (7.1 MB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:8 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:672 (672.0 B)  TX bytes:672 (672.0 B)

qbrfa30b22d-45 Link encap:Ethernet  HWaddr fe:16:3e:4b:6a:e3
          inet6 addr: fe80::a085:1dff:fe72:ea75/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:11 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1448 (1.4 KB)  TX bytes:468 (468.0 B)

qvbfa30b22d-45 Link encap:Ethernet  HWaddr fe:cd:85:8a:f6:d1
          inet6 addr: fe80::fccd:85ff:fe8a:f6d1/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:6 errors:0 dropped:0 overruns:0 frame:0
          TX packets:17 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:468 (468.0 B)  TX bytes:2070 (2.0 KB)

qvofa30b22d-45 Link encap:Ethernet  HWaddr e2:11:19:0a:e1:86
          inet6 addr: fe80::e011:19ff:fe0a:e186/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:17 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2070 (2.0 KB)  TX bytes:468 (468.0 B)

tapfa30b22d-45 Link encap:Ethernet  HWaddr fe:16:3e:4b:6a:e3
          inet6 addr: fe80::fc16:3eff:fe4b:6ae3/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:6 errors:0 dropped:0 overruns:0 frame:0
          TX packets:22 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:1224 (1.2 KB)  TX bytes:2448 (2.4 KB)

ifconfig from network node

eth0      Link encap:Ethernet  HWaddr 00:e0:4c:70:6b:eb
          inet addr:10.10.10.9  Bcast:10.10.10.255  Mask:255.255.255.0
          inet6 addr: fe80::2e0:4cff:fe70:6beb/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:19533 errors:0 dropped:0 overruns:0 frame:0
          TX packets:30018 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1485777 (1.4 MB)  TX bytes:5185797 (5.1 MB)

eth1      Link encap:Ethernet  HWaddr 00:e0:4c:a7:31:85
          inet addr:10.20.20.9  Bcast:10.20.20.255  Mask:255.255.255.0
          inet6 addr: fe80::2e0:4cff:fea7:3185/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:468 (468.0 B)

eth2      Link encap:Ethernet  HWaddr 00:19:d1:57:1b:32
          inet6 addr: fe80::219:d1ff:fe57:1b32/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:309814 errors:0 dropped:7 overruns:0 frame:0
          TX packets:132 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:23635415 (23.6 MB)  TX bytes:5920 (5.9 KB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

2. ovs-vsctl show from compute node

9c912d03-e082-45b7-ad6f-5f57ae2931cc
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
        Port "qvofa30b22d-45"
            Interface "qvofa30b22d-45"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "qvoca1810fd-30"
            Interface "qvoca1810fd-30"
    ovs_version: "1.4.2"

3. grep ovs /var/log/syslog from compute node

Oct  4 17:32:58 c02 ovs-vsctl: 00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port br-int qvo686014ac-4e
Oct  4 17:33:18 c02 ovs-vsctl: 00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-int qvofa30b22d-45 -- set Interface qvofa30b22d-45 external-ids:iface-id=fa30b22d-4575-4b22-aa9d-b38120cb3e94 external-ids:iface-status=active external-ids:attached-mac=fa:16:3e:4b:6a:e3 external-ids:vm-uuid=e3fd45d1-412b-4f34-a5da-43bdbd535df4

4. grep dns /var/log/syslog from compute node

Oct  4 15:20:34 c02 kernel: [    0.512870] Key type dns_resolver registered
Oct  4 15:21:56 c02 kernel: [    0.512997] Key type dns_resolver registered
Oct  4 15:43:30 c02 kernel: [    0.535288] Key type dns_resolver registered
Oct  4 15:48:21 c02 kernel: [    0.518136] Key type dns_resolver registered
Oct  4 16:20:49 c02 kernel: [    0.518039] Key type dns_resolver registered
Oct  4 16:23:50 c02 kernel: [    0.518407] Key type dns_resolver registered
Oct  4 16:27:45 c02 kernel: [    0.473536] Key type dns_resolver registered
Oct  4 17:06:00 c02 kernel: [    0.506125] Key type dns_resolver registered
Oct  4 17:29:38 c02 kernel: [    0.516364] Key type dns_resolver registered

5. dnsmasq --version from compute node

Dnsmasq version 2.59  Copyright (c) 2000-2011 Simon Kelley
Compile time options IPv6 GNU-getopt DBus i18n DHCP TFTP conntrack IDN

This software comes with ABSOLUTELY NO WARRANTY.
Dnsmasq is free software, and you are welcome to redistribute it
under the terms of the GNU General Public License, version 2 or 3.

6. vm creation log

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.2.0-37-virtual (buildd@allspice) (gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) ) #58-Ubuntu SMP Thu Jan 24 15:48:03 UTC 2013 (Ubuntu 3.2.0-37.58-virtual 3.2.35)
[    0.000000] Command line: LABEL=cirros-rootfs ro console=tty1 console=ttyS0
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009dc00 (usable)
[    0.000000]  BIOS-e820: 000000000009dc00 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 000000001fffd000 (usable)
[    0.000000]  BIOS-e820: 000000001fffd000 - 0000000020000000 (reserved)
[    0.000000]  BIOS-e820: 00000000feffc000 - 00000000ff000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] DMI 2.4 present.
[    0.000000] No AGP bridge found
[    0.000000] last_pfn = 0x1fffd max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x70406, new 0x7010600070106
[    0.000000] found SMP MP-table at [ffff8800000fdaf0] fdaf0
[    0.000000] init_memory_mapping: 0000000000000000-000000001fffd000
[    0.000000] RAMDISK: 1fc95000 - 1ffed000
[    0.000000] ACPI: RSDP 00000000000fd950 00014 (v00 BOCHS )
[    0.000000] ACPI: RSDT 000000001fffd7b0 00034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: FACP 000000001fffff80 00074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[    0.000000] ACPI: DSDT 000000001fffd9b0 02589 (v01   BXPC   BXDSDT 00000001 INTL 20100528)
[    0.000000] ACPI: FACS 000000001fffff40 00040
[    0.000000] ACPI: SSDT 000000001fffd910 0009E (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: APIC 000000001fffd830 00072 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[    0.000000] ACPI: HPET 000000001fffd7f0 00038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at 0000000000000000-000000001fffd000
[    0.000000] Initmem setup node 0 0000000000000000-000000001fffd000
[    0.000000]   NODE_DATA [000000001fff5000 - 000000001fff9fff]
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 0:1cf7681, boot clock
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000010 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   empty
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000010 -> 0x0000009d
[    0.000000]     0: 0x00000100 -> 0x0001fffd
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: 000000000009d000 - 000000000009e000
[    0.000000] PM: Registered nosave memory: 000000000009e000 - 00000000000a0000
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
[    0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 20000000 (gap: 20000000:deffc000)
[    0.000000] Booting paravirtualized kernel on KVM
[    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 28 pages/cpu @ffff88001fa00000 s82880 r8192 d23616 u2097152
[    0.000000] kvm-clock: cpu 0, msr 0:1fa13681, primary cpu clock
[    0.000000] KVM setup async PF for cpu 0
[    0.000000] kvm-stealtime: cpu 0, msr 1fa0dd40
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 128901
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: LABEL=cirros-rootfs ro console=tty1 console=ttyS0
[    0.000000] PID hash table entries: 2048 (order: 2, 16384 bytes)
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] Memory: 496316k/524276k available (6541k kernel code, 460k absent, 27500k reserved, 6652k data, 924k init)
[    0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000] NR_IRQS:4352 nr_irqs:256 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty1] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 4194304 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Detected 3192.746 MHz processor.
[    0.008000] Calibrating delay loop (skipped) preset value.. 6385.49 BogoMIPS (lpj=12770984)
[    0.008000] pid_max: default: 32768 minimum: 301
[    0.008000] Security Framework initialized
[    0.008000] AppArmor: AppArmor initialized
[    0.008000] Yama: becoming mindful.
[    0.008000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.008288] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.009126] Mount-cache hash table entries: 256
[    0.009789] Initializing cgroup subsys cpuacct
[    0.010363] Initializing cgroup subsys memory
[    0.010930] Initializing cgroup subsys devices
[    0.012005] Initializing cgroup subsys freezer
[    0.012584] Initializing cgroup subsys blkio
[    0.013132] Initializing cgroup subsys perf_event
[    0.013770] CPU: CPU feature xsave disabled, no CPUID level 0xd
[    0.014477] mce: CPU supports 10 MCE banks
[    0.015184] SMP alternatives: switching to UP code
[    0.031993] Freeing SMP alternatives: 24k freed
[    0.032012] ACPI: Core revision 20110623
[    0.033149] ftrace: allocating 27027 entries in 106 pages
[    0.036204] Enabling x2apic
[    0.036621] Enabled x2apic
[    0.037131] Switched APIC routing to physical x2apic.
[    0.040381] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.041111] CPU0: Intel(R) Core(TM)2 Duo CPU     T7700  @ 2.40GHz stepping 0b
[    0.044002] Performance Events: unsupported p6 CPU model 15 no PMU driver, software events only.
[    0.044002] NMI watchdog disabled (cpu0): hardware events not enabled
[    0.044002] Brought up 1 CPUs
[    0.044002] Total of 1 processors activated (6385.49 BogoMIPS).
[    0.044002] devtmpfs: initialized
[    0.044378] EVM: security.selinux
[    0.044858] EVM: security.SMACK64
[    0.045303] EVM: security.capability
[    0.046331] print_constraints: dummy: 
[    0.046877] RTC time: 10:33:21, date: 10/04/13
[    0.047471] NET: Registered protocol family 16
[    0.048093] ACPI: bus type pci registered
[    0.048707] PCI: Using configuration type 1 for base access
[    0.049890] bio: create slab <bio-0> at 0
[    0.050499] ACPI: Added _OSI(Module Device)
[    0.051032] ACPI: Added _OSI(Processor Device)
[    0.051586] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.052006] ACPI: Added _OSI(Processor Aggregator Device)
[    0.053851] ACPI: Interpreter enabled
[    0.054342] ACPI: (supports S0 S3 S4 S5)
[    0.055073] ACPI: Using IOAPIC for interrupt routing
[    0.058091] ACPI: No dock devices found.
[    0.058604] HEST: Table not found.
[    0.059098] PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
[    0.060017] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.062334] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.063238] pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB
[    0.069061]  pci0000:00: Unable to request _OSC control (_OSC support mask: 0x1e)
[    0.072138] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.073140] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.074119] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.075100] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.076053] ACPI: PCI Interrupt Link [LNKS] (IRQs 9) *0
[    0.077107] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.078096] vgaarb: loaded
[    0.078492] vgaarb: bridge control possible 0000:00:02.0
[    0.079220] i2c-core: driver [aat2870] using legacy suspend method
[    0.079942] i2c-core: driver [aat2870] using legacy resume method
[    0.080105] SCSI subsystem initialized
[    0.080757] usbcore: registered new interface driver usbfs
[    0.081435] usbcore: registered new interface driver hub
[    0.082113] usbcore: registered new device driver usb
[    0.082823] PCI: Using ACPI for IRQ routing
[    0.084231] NetLabel: Initializing
[    0.084706] NetLabel:  domain hash size = 128
[    0.085261] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.085877] NetLabel:  unlabeled traffic allowed by default
[    0.086592] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.087404] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.088242] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.092080] Switching to clocksource kvm-clock
[    0.097579] AppArmor: AppArmor Filesystem Enabled
[    0.098189] pnp: PnP ACPI init
[    0.098630] ACPI: bus type pnp registered
[    0.099679] pnp: PnP ACPI: found 8 devices
[    0.100225] ACPI: ACPI bus type pnp unregistered
[    0.106561] NET: Registered protocol family 2
[    0.107165] IP route cache hash table entries: 4096 (order: 3, 32768 bytes)
[    0.108126] TCP established hash table entries: 16384 (order: 6, 262144 bytes)
[    0.109161] TCP bind hash table entries: 16384 (order: 6, 262144 bytes)
[    0.110030] TCP: Hash tables configured (established 16384 bind 16384)
[    0.110790] TCP reno registered
[    0.111234] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    0.111930] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    0.112724] NET: Registered protocol family 1
[    0.113292] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.113994] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.114687] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.115487] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[    0.119633] pci 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[    0.120676] pci 0000:00:01.2: PCI INT D disabled
[    0.121529] Trying to unpack rootfs image as initramfs...
[    0.128230] audit: initializing netlink socket (disabled)
[    0.128894] type=2000 audit(1380882803.124:1): initialized
[    0.160074] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.168118] VFS: Disk quotas dquot_6.5.2
[    0.168675] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.169740] fuse init (API version 7.17)
[    0.170322] msgmni has been set to 969
[    0.184055] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    0.185014] io scheduler noop registered
[    0.185525] io scheduler deadline registered (default)
[    0.186172] io scheduler cfq registered
[    0.186747] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.187426] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.188312] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    0.189235] ACPI: Power Button [PWRF]
[    0.192667] Freeing initrd memory: 3424k freed
[    0.194013] ERST: Table is not found!
[    0.194504] GHES: HEST is not enabled!
[    0.195115] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
[    0.195811] virtio-pci 0000:00:03.0: PCI INT A -> Link[LNKC] -> GSI 10 (level, high) -> IRQ 10
[    0.196983] virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[    0.198174] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[    0.198854] virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10
[    0.199980] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.221599] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    0.243265] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    0.265406] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    0.286957] 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    0.287758] Linux agpgart interface v0.103
[    0.289144] brd: module loaded
[    0.290024] loop: module loaded
[    0.294179]  vda: vda1
[    0.295069] scsi0 : ata_piix
[    0.295553] scsi1 : ata_piix
[    0.296030] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0a0 irq 14
[    0.297009] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0a8 irq 15
[    0.298198] Fixed MDIO Bus: probed
[    0.298789] tun: Universal TUN/TAP device driver, 1.6
[    0.299545] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    0.308239] PPP generic driver version 2.4.2
[    0.309199] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.310141] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.311054] uhci_hcd: USB Universal Host Controller Interface driver
[    0.311994] uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[    0.314058] uhci_hcd 0000:00:01.2: UHCI Host Controller
[    0.315383] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
[    0.317388] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c040
[    0.318997] hub 1-0:1.0: USB hub found
[    0.320119] hub 1-0:1.0: 2 ports detected
[    0.320750] usbcore: registered new interface driver libusual
[    0.322434] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    0.325622] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.327057] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.328671] mousedev: PS/2 mouse device common for all mice
[    0.330646] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    0.332773] rtc_cmos 00:01: RTC can wake from S4
[    0.333491] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    0.334270] rtc0: alarms up to one day, 114 bytes nvram, hpet irqs
[    0.335070] device-mapper: uevent: version 1.0.3
[    0.335694] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com
[    0.336759] cpuidle: using governor ladder
[    0.337300] cpuidle: using governor menu
[    0.337798] EFI Variables Facility v0.08 2004-May-17
[    0.338562] TCP cubic registered
[    0.339087] NET: Registered protocol family 10
[    0.339977] NET: Registered protocol family 17
[    0.340559] Registering the dns_resolver key type
[    0.341240] registered taskstats version 1
[    0.343480]   Magic number: 1:413:577
[    0.344037] rtc_cmos 00:01: setting system clock to 2013-10-04 10:33:22 UTC (1380882802)
[    0.345057] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    0.345756] EDD information not available.
[    0.466158] Freeing unused kernel memory: 924k freed
[    0.468042] Write protecting the kernel read-only data: 12288k
[    0.475709] Freeing unused kernel memory: 1632k freed
[    0.479063] Freeing unused kernel memory: 1200k freed

info: initramfs: up at 0.48
NOCHANGE: partition 1 is size 64260. it cannot be grown
info: initramfs loading root from /dev/vda1
info: /etc/init.d/rc.sysinit: up at 0.62
Starting logging: OK
Initializing random number generator... done.
Starting acpid: OK
cirros-ds 'local' up at 0.72
no results found for mode=local. up 0.79. searched: nocloud configdrive ec2
Starting network...
udhcpc (v1.20.1) started
Sending discover...
Sending discover...
Sending discover...
No lease, failing
WARN: /etc/rc3.d/S40-network failed
cirros-ds 'net' up at 181.00
checking http://169.254.169.254/2009-04-04/instance-id
failed 1/20: up 181.01. request failed
failed 2/20: up 183.18. request failed
failed 3/20: up 185.18. request failed
failed 4/20: up 187.19. request failed
failed 5/20: up 189.20. request failed
failed 6/20: up 191.21. request failed
failed 7/20: up 193.21. request failed
failed 8/20: up 195.22. request failed
failed 9/20: up 197.23. request failed
failed 10/20: up 199.24. request failed
failed 11/20: up 201.24. request failed
failed 12/20: up 203.25. request failed
failed 13/20: up 205.26. request failed
failed 14/20: up 207.27. request failed
failed 15/20: up 209.28. request failed
failed 16/20: up 211.28. request failed
failed 17/20: up 213.29. request failed
failed 18/20: up 215.30. request failed
failed 19/20: up 217.30. request failed
failed 20/20: up 219.31. request failed
failed to read iid from metadata. tried 20
no results found for mode=net. up 221.32. searched: nocloud configdrive ec2
failed to get instance-id of datasource
Starting dropbear sshd: generating rsa key... generating dsa key... OK
=== network info ===
if-info: lo,up,127.0.0.1,8,::1
if-info: eth0,up,,8,fe80::f816:3eff:fe4b:6ae3
=== datasource: None None ===
=== cirros: current=0.3.1 uptime=221.51 ===
route: fscanf
=== pinging gateway failed, debugging connection ===
############ debug start ##############
### /etc/init.d/sshd start
Starting dropbear sshd: OK
route: fscanf
### ifconfig -a
eth0      Link encap:Ethernet  HWaddr FA:16:3E:4B:6A:E3  
          inet6 addr: fe80::f816:3eff:fe4b:6ae3/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:22 errors:0 dropped:0 overruns:0 frame:0
          TX packets:5 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:2448 (2.3 KiB)  TX bytes:902 (902.0 B)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

### route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
route: fscanf
### cat /etc/resolv.conf
cat: can't open '/etc/resolv.conf': No such file or directory
### gateway not found
/sbin/cirros-status: line 1: can't open /etc/resolv.conf: no such file
### pinging nameservers
### uname -a
Linux cirros 3.2.0-37-virtual #58-Ubuntu SMP Thu Jan 24 15:48:03 UTC 2013 x86_64 GNU/Linux
### lsmod
Module                  Size  Used by    Not tainted
nls_iso8859_1          12713  0 
nls_cp437              16991  0 
vfat                   17585  0 
fat                    61512  1 vfat
isofs                  40257  0 
ip_tables              27473  0 
x_tables               29891  1 ip_tables
pcnet32                42119  0 
8139cp                 27409  0 
ne2k_pci               13691  0 
8390                   18856  1 ne2k_pci
e1000                 108589  0 
acpiphp                24231  0 
### dmesg | tail
[    0.673659] acpiphp: Slot [30] registered
[    0.673669] acpiphp: Slot [31] registered
[    0.678819] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI
[    0.678822] e1000: Copyright (c) 1999-2006 Intel Corporation.
[    0.682931] ne2k-pci.c:v1.03 9/22/2003 D. Becker/P. Gortmaker
[    0.685061] 8139cp: 8139cp: 10/100 PCI Ethernet driver v1.3 (Mar 22, 2004)
[    0.687440] pcnet32: pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de
[    0.692500] ip_tables: (C) 2000-2006 Netfilter Core Team
[    1.108253] eth0: IPv6 duplicate address fe80::f816:3eff:fe4b:6ae3 detected!
[    1.120114] Refined TSC clocksource calibration: 3192.791 MHz.
### tail -n 25 /var/log/messages
Oct  4 04:33:22 cirros kern.info kernel: [    0.000000]   Intel GenuineIntel
Oct  4 04:33:22 cirros kern.info kernel: [    0.000000]   AMD AuthenticAMD
Oct  4 04:33:22 cirros kern.info kernel: [    0.000000]   Centaur CentaurHauls
Oct  4 04:33:22 cirros kern.info kernel: [    0.000000] BIOS-provided physical RAM map:
Oct  4 04:33:22 cirros kern.info kernel: [    0.000000]  BIOS-e820: 0000000000000000 - 000000000009dc00 (usable)
Oct  4 04:33:22 cirros kern.info kernel: [    0.673330] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
Oct  4 04:33:22 cirros kern.info kernel: [    0.673387] acpiphp: Slot [1] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673397] acpiphp: Slot [2] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673407] acpiphp: Slot [3] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673417] acpiphp: Slot [4] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673426] acpiphp: Slot [5] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673435] acpiphp: Slot [6] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673445] acpiphp: Slot [7] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673454] acpiphp: Slot [8] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673463] acpiphp: Slot [9] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.673473] acpiphp: Slot [10] registered
Oct  4 04:33:22 cirros kern.info kernel: [    0.678819] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI
Oct  4 04:33:22 cirros kern.info kernel: [    0.678822] e1000: Copyright (c) 1999-2006 Intel Corporation.
Oct  4 04:33:22 cirros kern.info kernel: [    0.682931] ne2k-pci.c:v1.03 9/22/2003 D. Becker/P. Gortmaker
Oct  4 04:33:22 cirros kern.info kernel: [    0.685061] 8139cp: 8139cp: 10/100 PCI Ethernet driver v1.3 (Mar 22, 2004)
Oct  4 04:33:22 cirros kern.info kernel: [    0.687440] pcnet32: pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de
Oct  4 04:33:22 cirros kern.info kernel: [    0.692500] ip_tables: (C) 2000-2006 Netfilter Core Team
Oct  4 04:33:23 cirros kern.info kernel: [    1.108253] eth0: IPv6 duplicate address fe80::f816:3eff:fe4b:6ae3 detected!
Oct  4 04:33:23 cirros kern.info kernel: [    1.120114] Refined TSC clocksource calibration: 3192.791 MHz.
Oct  4 04:37:03 cirros authpriv.info dropbear[289]: Running in background
############ debug end   ##############
  ____               ____  ____
 / __/ __ ____ ____ / __ \/ __/
/ /__ / // __// __// /_/ /\ \ 
\___//_//_/  /_/   \____/___/ 
   http://cirros-cloud.net


login as 'cirros' user. default password: 'cubswin:)'. use 'sudo' for root.
cirros login: 

[kojiwell]

I'm having the same issue. Has anyone resolved this?

[wnoguchi]

I have same issue too...

[dnepangue]

Having issue also with this. But in a Single Node https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/blob/OVS_SingleNode/OpenStack_Grizzly_Install_Guide.rst

Hi vuquangchien, have you found any solution regarding this issue?

[vuquangchien]

No, I haven't. I tried to clear everything and re-install the OS, and then OpenStack but no use. I got the same problem :<

[moss2k13]

Hello,
I've noticed few things - after spawning an instance I have one additional line from syslog's ovs:

root@compute:~# grep ovs /var/log/syslog
Oct 25 14:25:37 compute ovs-vsctl: 00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-int qvoab320d8d-54 -- set Interface qvoab320d8d-54 external-ids:iface-id=ab320d8d-548c-4c2a-b4a6-97d887b92c29 external-ids:iface-status=active external-ids:attached-mac=fa:16:3e:44:d6:68 external-ids:vm-uuid=04c26806-bc5f-4184-bb59-2536bdbb7596
Oct 25 14:25:38 compute ovs-vsctl: 00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl --timeout=2 set Port qvoab320d8d-54 tag=9

Also I have gre interfaces present in ovs-vsctl show:

root@compute:~# ovs-vsctl show
dd1ef9ba-cb9f-4c16-8f85-2f6085568188
    Bridge br-int
        Port "qvoab320d8d-54"
            tag: 9
            Interface "qvoab320d8d-54"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
    Bridge br-tun
        Port "gre-1"
            Interface "gre-1"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="10.x.x.93"}
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-2"
            Interface "gre-2"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="10.x.x.89"}
    ovs_version: "1.4.2"

I remember that ovs 1.4.2 reported errors when installed on higher kernel than 3.2.0-23-generic:

root@compute:~# grep -i ERROR /var/log/quantum/openvswitch-agent.log
ERROR [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Failed to create OVS patch port. Cannot have tunneling enabled on this agent, since this version of OVS does not support tunnels or patch ports. Agent terminated!

Check your openvswitch log, downgrade to 3.2.0-23-generic if needed, rebuild ovs installation and post the results.

BR,
Peter

[mtasic85]

On ubuntu 12.04.3, to upgrade kernel to 3.8 and OVS to 1.9.0, follow #143 (comment)