I've figured out how to remove the subvolumes: root@R510-LXD4-DMZ:~# btrfs subvolume list /storage ID 257 gen 83 top level 5 path lxd/common/lxd/storage-pools/Pool-1 ID 258 gen 165 top level 257 path lxd/common/lxd/storage-pools/Pool-1/containers ID 259 gen 81 top level 257 path lxd/common/lxd/storage-pools/Pool-1/snapshots ID 260 gen 165 top level 257 path lxd/common/lxd/storage-pools/Pool-1/images ID 261 gen 83 top level 257 path lxd/common/lxd/storage-pools/Pool-1/custom ID 264 gen 165 top level 260 path lxd/common/lxd/storage-pools/Pool-1/images/ca0613ce3f58111feb09a4775216fad94046360a00586738f8f80c2fb20b5bc7 ID 265 gen 4527 top level 258 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud ID 497 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/3398c42dda6ee295d52d593a0e5334dd51a172826e5881ec9dff84bc37315c8d ID 498 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/b9677d2c91cd0ccc00f8b557b56c103390c777b3e2574aee3a35595224665d75 ID 499 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/b62a1c869c9e9b7dbc8693b7b97c14cb7ccf09b3bf52e0d6a7656cc3bb50c312 ID 500 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/5a7b74cc5a0e14d161d5ea942001b83812021260722e64da27cb315a52d6fa70 ID 501 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/37b4ed38bb85b4140ab416ff74317968e4e18fd2ffadb74236cfb4b4254f785b ID 502 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/76ecc26b9fd080267c4e937f80b0993ce0e637847240f36dd3c434eae01fbb37 ID 503 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/44474f3511f76cda0cb0f4227c59981e8a830fc90f17a2e9376e0f6b35842590 ID 505 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/e3db5dcb5a3e25caae66eed98976d46ec46f17a0a3e3e94e0985635fc614ec54 ID 508 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/6b359e6c6a5714c0e227a444601c7d4c4ab281079ebecf712b772c553e52f65f ID 511 gen 4285 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/77e3c37a5af37ff8e66fe58349afac618882ac684de3231ffe12a163e9c7211f ID 513 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/97c0031787223910a30eaf207b51f49bf29636b78c91b4ff863ade3b2712ebf2 ID 514 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/5a5c9a877cb45167eafadc4d495d2d6f426fbcc3ca621ca8486ab89380aa7abb ID 515 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/6da41daadc16030e047af3a9a568266a29ee6ea109df16361b998f59c7da0d4f ID 516 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/2dea1f6a2751b66441e632e60e6b5ca56a4cdb02bcf85e1d7685ccd30e10d266 ID 517 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/ffc00c903c2df58df0c7fad14dfe15436410170647da8117d0f098ab9897afc5 ID 518 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/0a59b1c82fe9afa60af6ec774f1563b85cc8badd4020422c6985eed6df02f4a3 ID 519 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/05e65121f1be1ff23ed768f287a2c98520c48bc245c46f1f334be0e8ee8950a4 ID 520 gen 4508 top level 265 path lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/e72e4f68d906b2cd8713241dc752f7111133f79dae88939d8248946234ce180d
root@R510-LXD4-DMZ:~# btrfs subvolume delete /storage/lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/3398c42dda6ee295d52d593a0e5334dd51a172826e5881ec9dff84bc37315c8d Delete subvolume (no-commit): '/storage/lxd/common/lxd/storage-pools/Pool-1/containers/nextcloud/rootfs/var/lib/docker/btrfs/subvolumes/3398c42dda6ee295d52d593a0e5334dd51a172826e5881ec9dff84bc37315c8d' I still haven't figured out how to properly run docker in LXD/LXC. I've [ https://stackoverflow.com/posts/25885682/revisions | seen this ] but I'm not sure how to properly/securely do this with LXD. Thanks! Lai From: "Lai Wei-Hwa" <[email protected]> To: "lxc-users" <[email protected]> Sent: Thursday, December 7, 2017 4:35:41 PM Subject: [lxc-users] Problem with a docker pull & deleting btrfs subvolumes in a container Howdy all, Host: Xenial 16.04 LXD: Snappy 2.20 When I try to pull and extract code for a docker container, I get: root@nextcloud:~# sudo docker pull collabora/code Using default tag: latest latest: Pulling from collabora/code bd97b43c27e3: Pull complete 6960dc1aba18: Pull complete 2b61829b0db5: Pull complete 1f88dc826b14: Pull complete 73b3859b1e43: Pull complete 0f0e2d01915e: Pull complete 2458b914d686: Pull complete a3e2abb56fa4: Extracting [==================================================>] 972.1 MB/972.1 MB failed to register layer: ApplyLayer exit status 1 stdout: stderr: operation not permitted Additionally, when I went to delete the btrfs subvolumes created by docker (maybe related to [ https://lists.linuxcontainers.org/pipermail/lxc-users/2015-February/008494.html | this issue ] ?): root@nextcloud:/var/lib/docker/btrfs/subvolumes# rm -rf * rm: cannot remove '3398c42dda6ee295d52d593a0e5334dd51a172826e5881ec9dff84bc37315c8d': Operation not permitted rm: cannot remove '37b4ed38bb85b4140ab416ff74317968e4e18fd2ffadb74236cfb4b4254f785b': Operation not permitted rm: cannot remove '44474f3511f76cda0cb0f4227c59981e8a830fc90f17a2e9376e0f6b35842590': Operation not permitted rm: cannot remove '5a7b74cc5a0e14d161d5ea942001b83812021260722e64da27cb315a52d6fa70': Operation not permitted rm: cannot remove '6b359e6c6a5714c0e227a444601c7d4c4ab281079ebecf712b772c553e52f65f': Operation not permitted rm: cannot remove '76ecc26b9fd080267c4e937f80b0993ce0e637847240f36dd3c434eae01fbb37': Operation not permitted rm: cannot remove '77e3c37a5af37ff8e66fe58349afac618882ac684de3231ffe12a163e9c7211f': Operation not permitted rm: cannot remove 'b62a1c869c9e9b7dbc8693b7b97c14cb7ccf09b3bf52e0d6a7656cc3bb50c312': Operation not permitted rm: cannot remove 'b9677d2c91cd0ccc00f8b557b56c103390c777b3e2574aee3a35595224665d75': Operation not permitted rm: cannot remove 'e3db5dcb5a3e25caae66eed98976d46ec46f17a0a3e3e94e0985635fc614ec54': Operation not permitted Which I'm assuming is the same issue causing: r oot@nextcloud:/var/lib/docker/btrfs/subvolumes# sudo apt remove --purge docker.io Reading package lists... Done Building dependency tree Reading state information... Done The following packages were automatically installed and are no longer required: at-spi2-core bridge-utils cgroupfs-mount containerd gconf-service gconf-service-backend gconf2 gconf2-common libatk-bridge2.0-0 libatk-wrapper-java libatk-wrapper-java-jni libatspi2.0-0 libavahi-glib1 libbonobo2-0 libbonobo2-common libcanberra0 libfontenc1 libgconf-2-4 libgnome-2-0 libgnome2-common libgnomevfs2-0 libgnomevfs2-common libice6 liborbit-2-0 libsm6 libtdb1 libvorbisfile3 libxaw7 libxcb-shape0 libxft2 libxmu6 libxt6 libxv1 libxxf86dga1 runc sound-theme-freedesktop ubuntu-fan x11-utils Use 'sudo apt autoremove' to remove them. The following packages will be REMOVED: docker.io* 0 upgraded, 0 newly installed, 1 to remove and 11 not upgraded. After this operation, 62.7 MB disk space will be freed. Do you want to continue? [Y/n] y (Reading database ... 34706 files and directories currently installed.) Removing docker.io (1.13.1-0ubuntu1~16.04.2) ... '/usr/share/docker.io/contrib/nuke-graph-directory.sh' -> '/var/lib/docker/nuke-graph-directory.sh' Purging configuration files for docker.io (1.13.1-0ubuntu1~16.04.2) ... Nuking /var/lib/docker ... (if this is wrong, press Ctrl+C NOW!) + sleep 10 + umount -f /var/lib/docker/btrfs umount: /var/lib/docker/btrfs: block devices are not permitted on filesystem dpkg: error processing package docker.io (--purge): subprocess installed post-removal script returned error exit status 32 Processing triggers for man-db (2.7.5-1) ... Errors were encountered while processing: docker.io E: Sub-process /usr/bin/dpkg returned an error code (1) Question 1: How can I get past the docker pull issue? Question 2: Does the btrfs subvolume issue mean that any subvolume in a container can't be removed? If it can, what's the proper way to remove them? Best Regards, Lai Wei-Hwa IT Administrator T. (514) 367-2252 ext 6308 C. (514) 218-7400 [ mailto:[email protected] | [email protected] ] Montreal - Toronto - Edmonton [ https://www.robco.com/ | www.robco.com ] ISO 9001 / 14001 _______________________________________________ lxc-users mailing list [email protected] http://lists.linuxcontainers.org/listinfo/lxc-users
_______________________________________________ lxc-users mailing list [email protected] http://lists.linuxcontainers.org/listinfo/lxc-users
