[Bug 1713490] Re: error migrating blocked on virtio-net-pci.rom
We just upgraded an OpenStack compute from 16.04.4 to 16.04.5 and live migration is broken for VMs running on a 16.04.4 host to a 16.04.5 host. We see these error messages in nova-compute.log on a 16.04.4 host: 2019-01-08 07:43:56.117 100671 ERROR nova.virt.libvirt.driver [-] [instance: 3ac1a38d-b3fa-4d02-a94e-b71136bcf07f] Migration operation has aborted 2019-01-08 07:43:56.230 100671 INFO nova.compute.manager [-] [instance: 3ac1a38d-b3fa-4d02-a94e-b71136bcf07f] Swapping old allocation on 61c651ad-62e7-4137-ab35-924cd204ebb9 held by migration 1368009a-67aa-4574-9ed5-4fb7a513d06e for instance 2019-01-08 07:43:56.311 100671 ERROR nova.virt.libvirt.driver [-] [instance: 3ac1a38d-b3fa-4d02-a94e-b71136bcf07f] Live Migration failure: internal error: qemu unexpectedly closed the monitor : 2019-01-08T07:43:55.658574Z qemu-system-x86_64: -drive file=rbd:volumes_hdd/volume-08bf868c-23a9-43c5-b00f-91e3dc7e4220:id=cinder:auth_supported=cephx\;none:mon_host=172.16.0.144\:6789\;172 .16.0.145\:6789\;172.16.0.149\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=08bf868c-23a9-43c5-b00f-91e3dc7e4220,cache=writeback,discard=unma p: 'serial' is deprecated, please use the corresponding option of '-device' instead 2019-01-08T07:43:55.951328Z qemu-system-x86_64: Length mismatch: :00:03.0/virtio-net-pci.rom: 0x4 in != 0x8: Invalid argument 2019-01-08T07:43:55.951350Z qemu-system-x86_64: error while loading state for instance 0x0 of device 'ram' 2019-01-08T07:43:55.951499Z qemu-system-x86_64: load of migration failed: Invalid argument: libvirtError: internal error: qemu unexpectedly closed the monitor: 2019-01-08T07:43:55.658574Z qem u-system-x86_64: -drive file=rbd:volumes_hdd/volume-08bf868c-23a9-43c5-b00f-91e3dc7e4220:id=cinder:auth_supported=cephx\;none:mon_host=172.16.0.144\:6789\;172.16.0.145\:6789\;172.16.0.149\:67 89,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,serial=08bf868c-23a9-43c5-b00f-91e3dc7e4220,cache=writeback,discard=unmap: 'serial' is deprecated, please use the corresponding option of '-device' instead During the update the package ipxe-qemu was installed in version 1.0.0+git-20180124.fbe8c52d-0ubuntu2.1~cloud0. As suggested in comment #1 downgrading to 1.0.0+git-20150424.a25a16d- 1ubuntu1.2 fixed the problem for us. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1713490 Title: error migrating blocked on virtio-net-pci.rom To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ipxe/+bug/1713490/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1713490] Re: error migrating blocked on virtio-net-pci.rom
@Christian E. qemu version stayed the same: ii qemu 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64fast processor emulator ii qemu-block-extra:amd64 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64extra block backend modules for qemu-system and qemu-utils ii qemu-kvm 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU Full virtualization on x86 hardware ii qemu-slof20151103+dfsg-1ubuntu1.1 all Slimline Open Firmware -- QEMU PowerPC version ii qemu-system 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries ii qemu-system-arm 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (arm) ii qemu-system-common 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (common files) ii qemu-system-mips 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (mips) ii qemu-system-misc 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (miscellaneous) ii qemu-system-ppc 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (ppc) ii qemu-system-s390x1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (s390x) ii qemu-system-sparc1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (sparc) ii qemu-system-x86 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU full system emulation binaries (x86) ii qemu-user1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU user mode emulation binaries ii qemu-user-binfmt 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU user mode binfmt registration for qemu-user ii qemu-utils 1:2.11+dfsg-1ubuntu7.5~cloud0 amd64QEMU utilities -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1713490 Title: error migrating blocked on virtio-net-pci.rom To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ipxe/+bug/1713490/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1713490] Re: error migrating blocked on virtio-net-pci.rom
And this is the virsh dump: http://paste.openstack.org/show/740502/ -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1713490 Title: error migrating blocked on virtio-net-pci.rom To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ipxe/+bug/1713490/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1685136] [NEW] MySQL fresh install failes with ext4 data partition on Ubuntu 16.04
Public bug reported: Ubuntu Version: # lsb_release -rd Description:Ubuntu 16.04 LTS Release:16.04 MySQL Package Version: # apt-cache policy mysql-server mysql-server: Installed: 5.7.17-0ubuntu0.16.04.2 Candidate: 5.7.17-0ubuntu0.16.04.2 Version table: *** 5.7.17-0ubuntu0.16.04.2 500 500 http://Cluster_C.clouds.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages 100 /var/lib/dpkg/status 5.7.17-0ubuntu0.16.04.1 500 500 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages 5.7.11-0ubuntu6 500 500 http://Cluster_C.clouds.archive.ubuntu.com/ubuntu xenial/main amd64 Packages On a fresh Ubuntu 16.04 I tried to install mysql-server with an extra ext4 volume mounted at /var/lib/mysql, but the installation failed: # apt install mysql-server Reading package lists... Done Building dependency tree Reading state information... Done The following additional packages will be installed: libaio1 libcgi-fast-perl libcgi-pm-perl libencode-locale-perl libevent-core-2.0-5 libfcgi-perl libhtml-parser-perl libhtml-tagset-perl libhtml-template-perl libhttp-date-perl libhttp-message-perl libio-html-perl liblwp-mediatypes-perl libtimedate-perl liburi-perl mysql-client-5.7 mysql-client-core-5.7 mysql-common mysql-server-5.7 mysql-server-core-5.7 Suggested packages: libdata-dump-perl libipc-sharedcache-perl libwww-perl mailx tinyca The following NEW packages will be installed: libaio1 libcgi-fast-perl libcgi-pm-perl libencode-locale-perl libevent-core-2.0-5 libfcgi-perl libhtml-parser-perl libhtml-tagset-perl libhtml-template-perl libhttp-date-perl libhttp-message-perl libio-html-perl liblwp-mediatypes-perl libtimedate-perl liburi-perl mysql-client-5.7 mysql-client-core-5.7 mysql-common mysql-server mysql-server-5.7 mysql-server-core-5.7 0 upgraded, 21 newly installed, 0 to remove and 181 not upgraded. Need to get 19.0 MB of archives. After this operation, 162 MB of additional disk space will be used. Do you want to continue? [Y/n] ... Setting up libhttp-message-perl (6.11-1) ... No apport report written because the error message indicates its a followup error from a previous failure. dpkg: dependency problems prevent configuration of mysql-server: mysql-server depends on mysql-server-5.7; however: Package mysql-server-5.7 is not configured yet. dpkg: error processing package mysql-server (--configure): dependency problems - leaving unconfigured Processing triggers for libc-bin (2.23-0ubuntu3) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for systemd (229-4ubuntu4) ... Errors were encountered while processing: mysql-server-5.7 mysql-server E: Sub-process /usr/bin/dpkg returned an error code (1) Taking a look at /var/log/syslog, it suggests this: Apr 21 06:46:27 cloudcentric-base-image-ubuntu-16 systemd[1]: Starting MySQL Community Server... Apr 21 06:46:27 cloudcentric-base-image-ubuntu-16 mysql-systemd-start[13362]: MySQL system database not found in /var/lib/mysql. Please run mysqld --initialize. Apr 21 06:46:27 cloudcentric-base-image-ubuntu-16 systemd[1]: mysql.service: Control process exited, code=exited status=1 Apr 21 06:46:27 cloudcentric-base-image-ubuntu-16 systemd[1]: Failed to start MySQL Community Server. Executing the suggested command shows this # mysqld --initialize 2017-04-21T06:53:53.584517Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details). 2017-04-21T06:53:53.587467Z 0 [ERROR] --initialize specified but the data directory has files in it. Aborting. 2017-04-21T06:53:53.587746Z 0 [ERROR] Aborting At this time the only files in /var/lib/mysql are: # ll /var/lib/mysql total 24 drwx-- 3 mysql mysql 4096 Apr 21 06:46 ./ drwxr-xr-x 46 root root 4096 Apr 21 06:46 ../ -rw-r--r-- 1 root root 0 Apr 21 06:46 debian-5.7.flag drwx-- 2 mysql mysql 16384 Apr 21 06:44 lost+found/ Removing debian-5.7.flag doesn't change anything. Removing everything from the directory works. mysqld --initialize finishes without error. Removing the mysql packages and executing apt install mysql-server again on an empty /var/lib/mysql works fine. Searching the web, their are already bug reports present, like: https://bugs.mysql.com/bug.php?id=22615 These suggest to fix this issue with --ignore-db-dir=lost+found ** Affects: mysql-5.7 (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1685136 Title: MySQL fresh install failes with ext4 data partition on Ubuntu 16.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/mysql-5.7/+bug/1685136/+subscriptions
[Bug 1535134] Re: Can't run tests in liberty cloudarchive environment
Had the same problem trying to run the neutron test suite on Ubuntu 15.10. A new pip version fixed it for me. Ubuntu ships with pip 1.5.6. But according to the pip docs, you need at least version 6 to parse one of the openstack requirements.txt https://pip.pypa.io/en/stable/reference/pip_install/#requirement-specifiers -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535134 Title: Can't run tests in liberty cloudarchive environment To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-openstack-compute/+bug/1535134/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
