[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-02-04 Thread Launchpad Bug Tracker
This bug was fixed in the package libvirt - 1.2.8-0ubuntu11.3 --- libvirt (1.2.8-0ubuntu11.3) utopic-proposed; urgency=medium * apparmor libvirt-qemu template: allow reading charm-specific ceph config and allow reading under /tmp and /var/tmp (for SRU only) (LP: #1403648) * m

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-14 Thread Don Bowman
tried 1.2.8-0ubuntu11.3. seems to resolve. ** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Title: libvirt-bin crashes / r

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-07 Thread Chris J Arges
Hello Don, or anyone else affected, Accepted libvirt into utopic-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/libvirt/1.2.8-0ubuntu11.3 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wi

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-06 Thread Serge Hallyn
** No longer affects: libvirt (Ubuntu Trusty) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Title: libvirt-bin crashes / refuses to restart if cgmanager is restarted To manage notifications

Re: [Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-05 Thread Serge Hallyn
> Any change that this patch will make it into Utopic anytime soon? I will get this into utopic-proposed this week. Once accepted it should sit there for about a week before going into utopic-updates (if the fix is verified) -- You received this bug notification because you are a member of Ubun

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-03 Thread Don Bowman
I added the ppa: $ cat /etc/apt/sources.list.d/serge-hallyn-ubuntu-virt-utopic.list deb http://ppa.launchpad.net/serge-hallyn/virt/ubuntu utopic main whilst the sru process presumably continues. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-03 Thread Tony Link
Any change that this patch will make it into Utopic anytime soon? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Title: libvirt-bin crashes / refuses to restart if cgmanager is restarted To

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-02 Thread Launchpad Bug Tracker
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: libvirt (Ubuntu Utopic) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Titl

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2015-01-02 Thread Launchpad Bug Tracker
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: libvirt (Ubuntu Trusty) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Titl

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-18 Thread Launchpad Bug Tracker
This bug was fixed in the package libvirt - 1.2.8-0ubuntu18 --- libvirt (1.2.8-0ubuntu18) vivid; urgency=medium * mutex cgmanager actions (Thanks to Don Bowman for finding the cause) (LP: #1397130) (LP: #1367702) -- Serge HallynThu, 18 Dec 2014 13:28:03 -0600 ** Changed in

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-18 Thread Serge Hallyn
** Description changed: + + Impact: libvirt hangs + Fix: mutex libvirt's access to cgmanager + Test case: see script in #14 + Regression potential: if this is done wrongly, it could cause a deadlock. No non-cgmanager codepaths are affected. + +

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-18 Thread Serge Hallyn
** Changed in: libvirt (Ubuntu) Status: Incomplete => In Progress ** Also affects: libvirt (Ubuntu Utopic) Importance: Undecided Status: New ** Also affects: libvirt (Ubuntu Trusty) Importance: Undecided Status: New ** Changed in: libvirt (Ubuntu Trusty) Importance:

Re: [Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-18 Thread Serge Hallyn
Thanks Don, and thanks very much for nailing down the cause! I'll get a fix out for v today and start the SRU process. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Title: libvirt-bin crash

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-17 Thread Don Bowman
i ran the ppa image on 10 blades for a day in my production. its cycled through ~10K instances. so far so good, it appears to have solved this issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/13971

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-16 Thread Ubuntu Foundations Team Bug Bot
The attachment "don-cgm.patch" seems to be a patch. If it isn't, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are a member of the ~ubuntu-reviewers, unsubscribe the team. [This is an automated message performed by a Launchpad user owned by ~brian-murray,

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-16 Thread Don Bowman
I just tried, it did not immediately reproduce, will let it run for a bit. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Title: libvirt-bin crashes / refuses to restart if cgmanager is resta

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-16 Thread Serge Hallyn
Thanks for the reproducer script. Note that I had to tweak it to sleep a second before the last virsh list, else it always failed bc libvirt simply hadn't finished starting up yet. I can reproduce the bug with stock utopic. With the libvirt package in ppa:~serge-hallyn/virt, i cannot. Could you

Re: [Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-16 Thread Serge Hallyn
Hi Don, indeed the underlying libs (mainly the libnih-dbus ones) are not thread-safe. We've had to serialize access to cgmanager-client in lxc for the same reason. The cgm_dbus_connect() happens once on every cgmanager action, not once at libvirt startup. So doing pthread_once() is not going to

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-16 Thread Don Bowman
this patch to libvirt gets it going. ** Patch added: "don-cgm.patch" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1397130/+attachment/4282322/+files/don-cgm.patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-16 Thread Don Bowman
so part of the issue is cgm_* is not thread safe, but is called from various threads. e.g. if u start libvirtd w/ several instances already running, it will call cgm_dbus_connect from each. there is a pair of global variable: static NihDBusProxy *cgroup_manager = NULL; bool cgm_running = false;

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-15 Thread Don Bowman
script to reproduce (as attachment) ** Attachment added: "script to reproduce" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1397130/+attachment/4281789/+files/repro -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https:/

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-15 Thread Don Bowman
the attached script will reproduce this on utopic. I did it on a virtual machine running under kvm, but it will also do it bare-metal. #!/bin/bash apt-get -qy install virtinst libvirt-bin die() { echo "$*" exit 1 } dir=$(mktemp -d "/tmp/repro.XX") echo "rep files in $dir" cd "$dir"

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-15 Thread Don Bowman
the attached script will reproduce this on utopic. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1397130 Title: libvirt-bin crashes / refuses to restart if cgmanager is restarted To manage notifica

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-11 Thread Don Bowman
reproduced with requested steps attached ** Attachment removed: "ubuntu-virt.txt" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1397130/+attachment/4279216/+files/ubuntu-virt.txt ** Attachment added: "ubuntu-virt.txt" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1397130

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-11 Thread Don Bowman
another way to reproduce this is to start new instances quickly (e.g. create back to back), and then restart libvirt-bin. and sometimes, just start new instances quickly (w/o restart libvirt- bin) for example, for host X, if the sleep are commented out, it will normally crash libvirt if this is r

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-11 Thread Don Bowman
the latest repro shows this stack trace if it helps. Linux nubo-9 3.16.0-28-generic #37-Ubuntu SMP Mon Dec 8 17:15:28 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux root@nubo-9:/var/crash# dpkg -l |grep cgm ii cgmanager 0.33-2 amd64Central

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-11 Thread Don Bowman
attached. it didn't happen the first time [w/ 0 instances running]. i then started 1, and virsh hung [after my earlier restart?] its now dead. this is a different blade, a 2x E5-2640 0 @ 2.50GHz ** Attachment added: "ubuntu-virt.txt" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/139

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-11 Thread Don Bowman
463.169884] init: cgmanager main process (510) killed by TERM signal [ 468.885143] show_signal_msg: 1 callbacks suppressed [ 468.885149] libvirtd[44515]: segfault at 0 ip 7fb39575b90f sp 7fb38241b8e0 error 4 in libvirt.so.0.1002.8[7fb3956f+2b3000][ 469.049895] init: libvirt-bin mai

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-12-11 Thread Serge Hallyn
Thanks for reporting this bug. I can't seem to reproduce this on my utopic laptop. However, in your example you have > 30 instances running. Do you still get this when you have no instances running when restart cgmanager and libvirtd? Can you show the following info both before and after the re

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-11-27 Thread Don Bowman
(gdb) bt #0 0x7f9fd650ad27 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #1 0x7f9fd650c418 in __GI_abort () at abort.c:89 #2 0x7f9fd448f538 in cgmanager_get_pid_cgroup_sync () from /lib/x86_64-linux-gnu/libcgmanager.so.0 #3 0x7f9fd6b2302b in cgm

[Bug 1397130] Re: libvirt-bin crashes / refuses to restart if cgmanager is restarted

2014-11-27 Thread Don Bowman
[Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `libvirtd -v'. Program terminated with signal SIGABRT, Aborted. #0 0x7fa266277d27 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/r