{"action":"closed","issue":{"url":"https://api.github.com/repos/lxc/lxc/issues/2286","repository_url":"https://api.github.com/repos/lxc/lxc","labels_url":"https://api.github.com/repos/lxc/lxc/issues/2286/labels{/name}","comments_url":"https://api.github.com/repos/lxc/lxc/issues/2286/comments","events_url":"https://api.github.com/repos/lxc/lxc/issues/2286/events","html_url":"https://github.com/lxc/lxc/issues/2286","id":316521112,"number":2286,"title":"Ubuntu LXC  no longer starts under LXC 2.0.9 and Kernel 4.16.1 (OpenSUSE)","user":{"login":"toeserve","id":13458708,"avatar_url":"https://avatars1.githubusercontent.com/u/13458708?v=4","gravatar_id":"","url":"https://api.github.com/users/toeserve","html_url":"https://github.com/toeserve","followers_url":"https://api.github.com/users/toeserve/followers","following_url":"https://api.github.com/users/toeserve/following{/other_user}","gists_url":"https://api.github.com/users/toeserve/gists{/gist_id}","starred_url":"https://api.github.com/users/toeserve/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/toeserve/subscriptions","organizations_url":"https://api.github.com/users/toeserve/orgs","repos_url":"https://api.github.com/users/toeserve/repos","events_url":"https://api.github.com/users/toeserve/events{/privacy}","received_events_url":"https://api.github.com/users/toeserve/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-04-21T20:02:33Z","updated_at":"2018-05-29T10:35:17Z","closed_at":"2018-05-29T10:35:17Z","author_association":"NONE","body":"An ubuntu LXC container no longer starts up, we get errors relating to not being able to mount rootfs (see below).\r\n\r\n# Required information\r\n\r\n * Distribution: OpenSUSE\r\n * Distribution version: Tumbleweed  \r\n * The output of\r\n   * `lxc-start --version`  2.0.9\r\n\r\n   * `lxc-checkconfig`\r\n--- Namespaces ---\r\nNamespaces: enabled\r\nUtsname namespace: enabled\r\nIpc namespace: enabled\r\nPid namespace: enabled\r\nUser namespace: enabled\r\nNetwork namespace: enabled\r\n\r\n--- Control groups ---\r\nCgroups: enabled\r\n\r\nCgroup v1 mount points: \r\n/sys/fs/cgroup/systemd\r\n/sys/fs/cgroup/net_cls,net_prio\r\n/sys/fs/cgroup/memory\r\n/sys/fs/cgroup/cpuset\r\n/sys/fs/cgroup/cpu,cpuacct\r\n/sys/fs/cgroup/devices\r\n/sys/fs/cgroup/perf_event\r\n/sys/fs/cgroup/freezer\r\n/sys/fs/cgroup/blkio\r\n/sys/fs/cgroup/rdma\r\n/sys/fs/cgroup/pids\r\n/sys/fs/cgroup/hugetlb\r\n\r\nCgroup v2 mount points: \r\n/sys/fs/cgroup/unified\r\n\r\nCgroup v1 clone_children flag: enabled\r\nCgroup device: enabled\r\nCgroup sched: enabled\r\nCgroup cpu account: enabled\r\nCgroup memory controller: enabled\r\nCgroup cpuset: enabled\r\n\r\n--- Misc ---\r\nVeth pair device: enabled, not loaded\r\nMacvlan: enabled, not loaded\r\nVlan: enabled, not loaded\r\nBridges: enabled, not loaded\r\nAdvanced netfilter: enabled, not loaded\r\nCONFIG_NF_NAT_IPV4: enabled, not loaded\r\nCONFIG_NF_NAT_IPV6: enabled, not loaded\r\nCONFIG_IP_NF_TARGET_MASQUERADE: enabled, not loaded\r\nCONFIG_IP6_NF_TARGET_MASQUERADE: enabled, not loaded\r\nCONFIG_NETFILTER_XT_TARGET_CHECKSUM: enabled, not loadedCONFIG_NETFILTER_XT_MATCH_COMMENT: enabled, loaded\r\nFUSE (for use with lxcfs): enabled, loaded\r\n\r\n--- Checkpoint/Restore ---\r\ncheckpoint restore: enabled\r\nCONFIG_FHANDLE: enabled\r\nCONFIG_EVENTFD: enabled\r\nCONFIG_EPOLL: enabled\r\nCONFIG_UNIX_DIAG: enabled\r\nCONFIG_INET_DIAG: enabled\r\nCONFIG_PACKET_DIAG: enabled\r\nCONFIG_NETLINK_DIAG: enabled\r\nFile capabilities: enabled\r\n\r\nNote : Before booting a new kernel, you can check its configuration\r\n\r\nusage : CONFIG=/path/to/config /usr/bin/lxc-checkconfig\r\n\r\n\r\n\r\n   * `uname -a`Linux localhost 4.16.1-1-default #1 SMP PREEMPT Mon Apr 9 06:27:59 UTC 2018 (fc6541a) x86_64 x86_64 x86_64 GNU/Linux\r\n\r\n   * `cat /proc/self/cgroup`\r\ncat /proc/self/cgroup\r\n12:hugetlb:/\r\n11:pids:/user.slice/user-1002.slice/session-4.scope\r\n10:rdma:/\r\n9:blkio:/user.slice\r\n8:freezer:/\r\n7:perf_event:/\r\n6:devices:/user.slice\r\n5:cpu,cpuacct:/user.slice\r\n4:cpuset:/\r\n3:memory:/user.slice\r\n2:net_cls,net_prio:/\r\n1:name=systemd:/user.slice/user-1002.slice/session-4.scope\r\n0::/user.slice/user-1002.slice/session-4.scope\r\n\r\n   * `cat /proc/1/mounts`\r\n cat /proc/1/mounts\r\nsysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0\r\nproc /proc proc rw,nosuid,nodev,noexec,relatime 0 0\r\ndevtmpfs /dev devtmpfs rw,nosuid,size=2011744k,nr_inodes=502936,mode=755 0 0\r\nsecurityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0\r\ntmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0\r\ndevpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0\r\ntmpfs /run tmpfs rw,nosuid,nodev,mode=755 0 0\r\ntmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0\r\ncgroup /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0\r\ncgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0\r\npstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0\r\ncgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0\r\ncgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0\r\ncgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0\r\ncgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0\r\ncgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0\r\ncgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0\r\ncgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0\r\ncgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0\r\ncgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0\r\ncgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0\r\ncgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0\r\n/dev/mapper/system-root / btrfs rw,relatime,space_cache,subvolid=259,subvol=/@/.snapshots/1/snapshot 0 0\r\nsystemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14592 0 0\r\ndebugfs /sys/kernel/debug debugfs rw,relatime 0 0\r\nhugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0\r\nmqueue /dev/mqueue mqueue rw,relatime 0 0\r\n/dev/mapper/system-root /var/log btrfs rw,relatime,space_cache,subvolid=276,subvol=/@/var/log 0 0\r\n/dev/mapper/system-root /.snapshots btrfs rw,relatime,space_cache,subvolid=258,subvol=/@/.snapshots 0 0\r\n/dev/mapper/system-root /var/lib/libvirt/images btrfs rw,relatime,space_cache,subvolid=269,subvol=/@/var/lib/libvirt/images 0 0\r\n/dev/mapper/system-root /var/lib/mysql btrfs rw,relatime,space_cache,subvolid=273,subvol=/@/var/lib/mysql 0 0\r\n/dev/mapper/system-root /var/lib/mailman btrfs rw,relatime,space_cache,subvolid=271,subvol=/@/var/lib/mailman 0 0\r\n/dev/mapper/system-root /boot/grub2/x86_64-efi btrfs rw,relatime,space_cache,subvolid=261,subvol=/@/boot/grub2/x86_64-efi 0 0\r\n/dev/mapper/system-root /var/lib/machines btrfs rw,relatime,space_cache,subvolid=270,subvol=/@/var/lib/machines 0 0\r\n/dev/mapper/system-root /boot/grub2/i386-pc btrfs rw,relatime,space_cache,subvolid=260,subvol=/@/boot/grub2/i386-pc 0 0\r\n/dev/mapper/system-root /usr/local btrfs rw,relatime,space_cache,subvolid=266,subvol=/@/usr/local 0 0\r\n/dev/mapper/system-root /var/lib/named btrfs rw,relatime,space_cache,subvolid=274,subvol=/@/var/lib/named 0 0\r\n/dev/mapper/system-root /var/lib/mariadb btrfs rw,relatime,space_cache,subvolid=272,subvol=/@/var/lib/mariadb 0 0\r\n/dev/mapper/system-root /var/lib/pgsql btrfs rw,relatime,space_cache,subvolid=275,subvol=/@/var/lib/pgsql 0 0\r\n/dev/mapper/system-root /srv btrfs rw,relatime,space_cache,subvolid=264,subvol=/@/srv 0 0\r\n/dev/mapper/system-root /var/crash btrfs rw,relatime,space_cache,subvolid=268,subvol=/@/var/crash 0 0\r\n/dev/mapper/system-root /var/opt btrfs rw,relatime,space_cache,subvolid=277,subvol=/@/var/opt 0 0\r\n/dev/mapper/system-root /opt btrfs rw,relatime,space_cache,subvolid=263,subvol=/@/opt 0 0\r\n/dev/mapper/system-root /var/tmp btrfs rw,relatime,space_cache,subvolid=279,subvol=/@/var/tmp 0 0\r\n/dev/mapper/system-root /tmp btrfs rw,relatime,space_cache,subvolid=265,subvol=/@/tmp 0 0\r\n/dev/mapper/system-root /var/cache btrfs rw,relatime,space_cache,subvolid=267,subvol=/@/var/cache 0 0\r\n/dev/mapper/system-root /home btrfs rw,relatime,space_cache,subvolid=262,subvol=/@/home 0 0\r\n/dev/mapper/system-root /var/spool btrfs rw,relatime,space_cache,subvolid=278,subvol=/@/var/spool 0 0\r\ntmpfs /run/user/1001 tmpfs rw,nosuid,nodev,relatime,size=404176k,mode=700,uid=1001,gid=100 0 0\r\ntracefs /sys/kernel/debug/tracing tracefs rw,relatime 0 0\r\nfusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0\r\ngvfsd-fuse /run/user/1001/gvfs fuse.gvfsd-fuse rw,nosuid,nodev,relatime,user_id=1001,group_id=100 0 0\r\ntmpfs /run/user/1002 tmpfs rw,nosuid,nodev,relatime,size=404176k,mode=700,uid=1002,gid=100 0 0\r\ngvfsd-fuse /home/user2/.gvfs fuse.gvfsd-fuse rw,nosuid,nodev,relatime,user_id=1003,group_id=100 0 0\r\n\r\n\r\n# Issue description\r\n\r\nStarting LXC fails, command: lxc-start -F -l DEBUG --logfile lxclog -n ubuntu-c1\r\n\r\n\r\n# Information to attach\r\n\r\n - [ ] any relevant kernel output (`dmesg`)\r\n - [ ] container log (The <log> file from running `lxc-start -n <c> -l <log> -o DEBUG`)\r\nt \r\n      lxc-start 20180421184557.399 INFO     lxc_start_ui - tools/lxc_start.c:main:277 - using rcfile /var/lib/lxc/ubuntu-c1/config\r\n      lxc-start 20180421184557.399 WARN     lxc_confile - confile.c:set_config_pivotdir:2262 - lxc.pivotdir is ignored.  It will soon become an error.\r\n      lxc-start 20180421184557.401 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver AppArmor\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended.\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for reject_force_umount action 0(kill).\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for reject_force_umount action 0(kill).\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .[all].\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .kexec_load errno 1.\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for kexec_load action 327681(errno).\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for kexec_load action 327681(errno).\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .open_by_handle_at errno 1.\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for open_by_handle_at action 327681(errno).\r\n      lxc-start 20180421184557.401 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for open_by_handle_at action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .init_module errno 1.\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for init_module action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for init_module action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .finit_module errno 1.\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for finit_module action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for finit_module action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .delete_module errno 1.\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for delete_module action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for delete_module action 327681(errno).\r\n      lxc-start 20180421184557.402 INFO     lxc_seccomp - seccomp.c:parse_config_v2:624 - Merging in the compat Seccomp ctx into the main one.\r\n      lxc-start 20180421184557.403 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.403 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.403 DEBUG    lxc_start - start.c:setup_signal_fd:288 - Set SIGCHLD handler with file descriptor: 5.\r\n      lxc-start 20180421184557.404 DEBUG    console - console.c:lxc_console_peer_default:459 - using \"/dev/tty\" as peer tty device\r\n      lxc-start 20180421184557.404 DEBUG    console - console.c:lxc_console_sigwinch_init:151 - process 4757 created signal fd 9 to handle SIGWINCH events\r\n      lxc-start 20180421184557.404 DEBUG    console - console.c:lxc_console_winsz:71 - set winsz dstfd:6 cols:171 rows:14\r\n      lxc-start 20180421184557.404 INFO     lxc_start - start.c:lxc_init:677 - container \"ubuntu-c1\" is initialized\r\n      lxc-start 20180421184557.405 DEBUG    lxc_start - start.c:__lxc_start:1501 - Not dropping CAP_SYS_BOOT or watching utmp.\r\n      lxc-start 20180421184557.405 INFO     lxc_cgroup - cgroups/cgroup.c:cgroup_init:67 - cgroup driver cgroupfs-ng initing for ubuntu-c1\r\n      lxc-start 20180421184557.406 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:filter_and_set_cpus:456 - No isolated cpus detected.\r\n      lxc-start 20180421184557.406 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:handle_cpuset_hierarchy:627 - \"cgroup.clone_children\" was already set to \"1\".\r\n      lxc-start 20180421184557.449 INFO     lxc_start - start.c:lxc_spawn:1324 - Cloned CLONE_NEWNS.\r\n      lxc-start 20180421184557.449 INFO     lxc_start - start.c:lxc_spawn:1324 - Cloned CLONE_NEWPID.\r\n      lxc-start 20180421184557.449 INFO     lxc_start - start.c:lxc_spawn:1324 - Cloned CLONE_NEWUTS.\r\n      lxc-start 20180421184557.449 INFO     lxc_start - start.c:lxc_spawn:1324 - Cloned CLONE_NEWIPC.\r\n      lxc-start 20180421184557.449 INFO     lxc_start - start.c:lxc_spawn:1324 - Cloned CLONE_NEWNET.\r\n      lxc-start 20180421184557.449 INFO     lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:1976 - cgroup has been setup\r\n      lxc-start 20180421184557.450 INFO     lxc_start - start.c:do_start:1001 - Unshared CLONE_NEWCGROUP.\r\n      lxc-start 20180421184557.459 DEBUG    storage - storage/storage.c:storage_query:233 - Detected rootfs type \"dir\"\r\n      lxc-start 20180421184557.459 ERROR    lxc_conf - conf.c:lxc_setup_rootfs:1254 - Failed to mount rootfs \"/var/lib/lxc/ubuntu-c1/rootfs\" onto \"/usr/lib64/lxc/rootfs\" with options \"(null)\".\r\n      lxc-start 20180421184557.459 ERROR    lxc_conf - conf.c:do_rootfs_setup:3044 - failed to setup rootfs for 'ubuntu-c1'\r\n      lxc-start 20180421184557.459 ERROR    lxc_conf - conf.c:lxc_setup:3085 - Error setting up rootfs mount after spawn\r\n      lxc-start 20180421184557.459 ERROR    lxc_start - start.c:do_start:1020 - Failed to setup container \"ubuntu-c1\".\r\n      lxc-start 20180421184557.460 ERROR    lxc_sync - sync.c:__sync_wait:57 - An error occurred in another process (expected sequence number 5)\r\n      lxc-start 20180421184557.460 DEBUG    lxc_network - network.c:lxc_delete_network:3096 - Deleted network devices\r\n      lxc-start 20180421184557.460 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.460 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.460 ERROR    lxc_start - start.c:__lxc_start:1530 - Failed to spawn container \"ubuntu-c1\".\r\n      lxc-start 20180421184557.460 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.460 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.468 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.468 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.\r\n      lxc-start 20180421184557.468 INFO     lxc_conf - conf.c:run_script_argv:398 - Executing script \"/usr/share/lxcfs/lxc.reboot.hook\" for container \"ubuntu-c1\", config section \"lxc\".\r\n      lxc-start 20180421184558.275 ERROR    lxc_start_ui - tools/lxc_start.c:main:368 - The container failed to start.\r\n      \r\n\r\n - [ ] the containers configuration file\r\ncat config\r\n# Template used to create this container: /usr/share/lxc/templates/lxc-download\r\n# Parameters passed to the template: -d ubuntu -r artful -a amd64\r\n# For additional config options, please look at lxc.container.conf(5)\r\n\r\n# Uncomment the following line to support nesting containers:\r\n#lxc.include = /usr/share/lxc/config/nesting.conf\r\n# (Be aware this has security implications)\r\n\r\n\r\n# Distribution configuration\r\nlxc.include = /usr/share/lxc/config/ubuntu.common.conf\r\nlxc.arch = x86_64\r\n\r\n# Container specific configuration\r\nlxc.rootfs = /var/lib/lxc/ubuntu-c1/rootfs\r\nlxc.rootfs.backend = dir\r\nlxc.utsname = ubuntu-c1\r\n\r\n# Network configuration\r\nlxc.network.type = empty\r\n"}}
{"actor":{"display_login":"brauner"}}