Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Reboot/shutdown blocked by firewalld and umount /oldroot

Hi.

I'm a new Fedora user and a fairly green Linux user, so please bear with me.

I'm on a completely fresh Fedora 29 Workstation install. Literally the only steps i've taken since installation is dropping a firmware in /lib/firmware/brcm to get my wifi working, and running 'sudo dnf --distro-sync'.

When rebooting/shutting down the process stalls in two places: -First with 'A stop job is running for firewalld - dynamic firewall daemon (some-elapsed-time/sometimes up to 6 minutes) -Then it stalls again at 'Starting Reboot' - This can take upwards of 5 minutes before i get this output:

dracut Warning: Killing all remaining processes
dracut Warning: Cannot umount /oldroot
/shutdown: line 79: warning: command substitution: ignored null byte in input
dracut Warning: Blocking umount of /oldroot [3537] /sbin/rmmodnf_conntrack
dracut Warning: lrwxrwxrwx. 1 root root 0 Nov 20 14:48 /proc/3537/exe -> /oldroot/usr/bin/kmod
dracut Warning: total 0
dracut Warning: lr-x------. root root 64 Nov 20 14:42 0 -> pipe:[69368]
dracut Warning: l-wx------. root root 64 Nov 20 14:42 1 -> pipe:[69369]
dracut Warning: l-wx------. root root 64 Nov 20 14:42 2 -> pipe:[69369]
...

... and some more output that i didn't manage to capture on my photo (yes i transcribed that s**t because i don't know where to find a log xD).

An additional behaviour that might mean something. If I boot the system, and shut down/reboot before actually doing anything, it happens almost instantly. But just opening e.g. Firefox, going to a page, then shutting down i get this 10 minute wait.

I really don't know how to debug this, where to look for logs etc. so any help would be greatly appreciated.

Reboot/shutdown blocked by firewalld and umount /oldroot

Hi.

I'm a new Fedora user and a fairly green Linux user, so please bear with me.

I'm on a completely fresh Fedora 29 Workstation install. Literally the only steps i've taken since installation is dropping a firmware in /lib/firmware/brcm to get my wifi working, and running 'sudo dnf --distro-sync'.

When rebooting/shutting down the process stalls in two places: -First with 'A stop job is running for firewalld - dynamic firewall daemon (some-elapsed-time/sometimes up to 6 minutes) -Then it stalls again at 'Starting Reboot' - This can take upwards of 5 minutes before i get this output:

dracut Warning: Killing all remaining processes
dracut Warning: Cannot umount /oldroot
/shutdown: line 79: warning: command substitution: ignored null byte in input
dracut Warning: Blocking umount of /oldroot [3537] /sbin/rmmodnf_conntrack
dracut Warning: lrwxrwxrwx. 1 root root 0 Nov 20 14:48 /proc/3537/exe -> /oldroot/usr/bin/kmod
dracut Warning: total 0
dracut Warning: lr-x------. root root 64 Nov 20 14:42 0 -> pipe:[69368]
dracut Warning: l-wx------. root root 64 Nov 20 14:42 1 -> pipe:[69369]
dracut Warning: l-wx------. root root 64 Nov 20 14:42 2 -> pipe:[69369]
...

... and some more output that i didn't manage to capture on my photo (yes i transcribed that s**t because i don't know where to find a log xD).

An additional behaviour that might mean something. If I boot the system, and shut down/reboot before actually doing anything, it happens almost instantly. But just opening e.g. Firefox, going to a page, then shutting down i get this 10 minute wait.

I really don't know how to debug this, where to look for logs etc. so any help would be greatly appreciated.

Edit: I tried following the instructions here for getting a verbose shutdown log. No mention of oldroot in the log. I get this regarding firewalld:

[  282.320466] systemd[1]: firewalld.service: State 'stop-sigterm' timed out. Killing.
[  282.320634] systemd[1]: firewalld.service: Killing process 1090 (firewalld) with signal SIGKILL.
[  282.320968] systemd[1]: firewalld.service: Killing process 3061 (rmmod) with signal SIGKILL.
[  282.321141] systemd[1]: firewalld.service: Killing process 1442 (gmain) with signal SIGKILL.
[  282.321176] systemd[1]: firewalld.service: Changed stop-sigterm -> stop-sigkill
[  282.321328] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321433] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321469] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321496] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321521] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.325478] systemd[1]: Received SIGCHLD from PID 1090 (firewalld).
[  282.325495] systemd[1]: Child 1090 (firewalld) died (code=killed, status=9/KILL)
[  282.325521] systemd[1]: firewalld.service: Child 1090 belongs to firewalld.service.
[  282.325539] systemd[1]: firewalld.service: Main process exited, code=killed, status=9/KILL
[  282.325571] systemd[1]: firewalld.service: Killing process 3061 (rmmod) with signal SIGKILL.
[  282.325607] systemd[1]: firewalld.service: Changed stop-sigkill -> final-sigkill
[  282.325714] systemd[1]: Got message type=signal sender=org.freedesktop.DBus destination=n/a path=/org/freedesktop/DBus interface=org.freedesktop.DBus member=NameOwnerChanged cookie=879 reply_cookie=0 signature=sss error-name=n/a error-message=n/a
[  282.325724] systemd[1]: firewalld.service: D-Bus name org.fedoraproject.FirewallD1 no longer registered by :1.16
[  282.326333] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326382] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326411] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326436] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326460] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326487] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326511] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326534] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  316.571041] systemd-journald[903]: Sent WATCHDOG=1 notification.
[  316.571104] systemd[1]: systemd-journald.service: Got notification message from PID 903 (WATCHDOG=1)
[  316.571815] systemd[1]: systemd-udevd.service: Got notification message from PID 926 (WATCHDOG=1)
[  316.571897] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  316.571967] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  372.571902] systemd[1]: firewalld.service: Processes still around after final SIGKILL. Entering failed mode.
[  372.571905] systemd[1]: firewalld.service: Failed with result 'timeout'.
[  372.571909] systemd[1]: firewalld.service: Changed final-sigkill -> failed
[  372.571978] systemd[1]: firewalld.service: Failed to destroy cgroup /system.slice/firewalld.service, ignoring: Device or resource busy
[  372.571986] systemd[1]: firewalld.service: Job firewalld.service/stop finished, result=done
[  372.571989] systemd[1]: Stopped firewalld - dynamic firewall daemon.
[  372.572025] systemd[1]: firewalld.service: Unit entered failed state.

Additional info per request:

[esben@localhost ~]$ sudo grep oldroot /etc/mtab
... no output

[esben@localhost ~]$ df | grep oldroot
... no output

[esben@localhost ~]$ grep oldroot /proc/mounts
... no output

[esben@localhost ~]$ cat /proc/mdstat 
Personalities : 
unused devices: <none>

Reboot/shutdown blocked by firewalld and umount /oldroot

Hi.

I'm a new Fedora user and a fairly green Linux user, so please bear with me.

I'm on a completely fresh Fedora 29 Workstation install. Literally the only steps i've taken since installation is dropping a firmware in /lib/firmware/brcm to get my wifi working, and running 'sudo dnf --distro-sync'.

When rebooting/shutting down the process stalls in two places: -First with 'A stop job is running for firewalld - dynamic firewall daemon (some-elapsed-time/sometimes up to 6 minutes) -Then it stalls again at 'Starting Reboot' - This can take upwards of 5 minutes before i get this output:

dracut Warning: Killing all remaining processes
dracut Warning: Cannot umount /oldroot
/shutdown: line 79: warning: command substitution: ignored null byte in input
dracut Warning: Blocking umount of /oldroot [3537] /sbin/rmmodnf_conntrack
dracut Warning: lrwxrwxrwx. 1 root root 0 Nov 20 14:48 /proc/3537/exe -> /oldroot/usr/bin/kmod
dracut Warning: total 0
dracut Warning: lr-x------. root root 64 Nov 20 14:42 0 -> pipe:[69368]
dracut Warning: l-wx------. root root 64 Nov 20 14:42 1 -> pipe:[69369]
dracut Warning: l-wx------. root root 64 Nov 20 14:42 2 -> pipe:[69369]
...
device-mapper: remove ioctl on fedora-root failed: Device or resource busy
Command failed.
device-mapper: remove ioctl on fedora-root-real failed: Device or resource busy
Command failed.
device-mapper: remove ioctl on luks-f4c635c0-ed8e-4920-9fa1-b077e4b4b0d6 failed: Device or resource busy
Command failed
device-mapper: remove ioctl on fedora-root failed: Device or resource busy
Command failed
device-mapper: remove ioctl on fedora-root-real failed: Device or resource busy
Command failed
device-mapper: remove ioctl on fedora-root failed: Device or resource busy
Command failed
Rebooting.
[22587.809487] reboot: Restarting system

... and some more EDIT: I managed to grab the final bits of output that i didn't manage before the machine finally reboots. I've added it to capture the above. Something fishy is going on my photo (yes i transcribed that s**t because i don't know where to find a log xD).with LVM or luks.

An additional behaviour that might mean something. If I boot the system, and shut down/reboot before actually doing anything, it happens almost instantly. But just opening e.g. Firefox, going to a page, then shutting down i get this 10 minute wait.

I really don't know how to debug this, where to look for logs etc. so any help would be greatly appreciated.

Edit: I tried following the instructions here for getting a verbose shutdown log. No mention of oldroot in the log. I get this regarding firewalld:

[  282.320466] systemd[1]: firewalld.service: State 'stop-sigterm' timed out. Killing.
[  282.320634] systemd[1]: firewalld.service: Killing process 1090 (firewalld) with signal SIGKILL.
[  282.320968] systemd[1]: firewalld.service: Killing process 3061 (rmmod) with signal SIGKILL.
[  282.321141] systemd[1]: firewalld.service: Killing process 1442 (gmain) with signal SIGKILL.
[  282.321176] systemd[1]: firewalld.service: Changed stop-sigterm -> stop-sigkill
[  282.321328] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321433] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321469] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321496] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.321521] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.325478] systemd[1]: Received SIGCHLD from PID 1090 (firewalld).
[  282.325495] systemd[1]: Child 1090 (firewalld) died (code=killed, status=9/KILL)
[  282.325521] systemd[1]: firewalld.service: Child 1090 belongs to firewalld.service.
[  282.325539] systemd[1]: firewalld.service: Main process exited, code=killed, status=9/KILL
[  282.325571] systemd[1]: firewalld.service: Killing process 3061 (rmmod) with signal SIGKILL.
[  282.325607] systemd[1]: firewalld.service: Changed stop-sigkill -> final-sigkill
[  282.325714] systemd[1]: Got message type=signal sender=org.freedesktop.DBus destination=n/a path=/org/freedesktop/DBus interface=org.freedesktop.DBus member=NameOwnerChanged cookie=879 reply_cookie=0 signature=sss error-name=n/a error-message=n/a
[  282.325724] systemd[1]: firewalld.service: D-Bus name org.fedoraproject.FirewallD1 no longer registered by :1.16
[  282.326333] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326382] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326411] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326436] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326460] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326487] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326511] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  282.326534] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  316.571041] systemd-journald[903]: Sent WATCHDOG=1 notification.
[  316.571104] systemd[1]: systemd-journald.service: Got notification message from PID 903 (WATCHDOG=1)
[  316.571815] systemd[1]: systemd-udevd.service: Got notification message from PID 926 (WATCHDOG=1)
[  316.571897] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  316.571967] systemd-journald[903]: Journal effective settings seal=no compress=yes compress_threshold_bytes=512B
[  372.571902] systemd[1]: firewalld.service: Processes still around after final SIGKILL. Entering failed mode.
[  372.571905] systemd[1]: firewalld.service: Failed with result 'timeout'.
[  372.571909] systemd[1]: firewalld.service: Changed final-sigkill -> failed
[  372.571978] systemd[1]: firewalld.service: Failed to destroy cgroup /system.slice/firewalld.service, ignoring: Device or resource busy
[  372.571986] systemd[1]: firewalld.service: Job firewalld.service/stop finished, result=done
[  372.571989] systemd[1]: Stopped firewalld - dynamic firewall daemon.
[  372.572025] systemd[1]: firewalld.service: Unit entered failed state.

Additional info per request:

[esben@localhost ~]$ sudo grep oldroot /etc/mtab
... no output

[esben@localhost ~]$ df | grep oldroot
... no output

[esben@localhost ~]$ grep oldroot /proc/mounts
... no output

[esben@localhost ~]$ cat /proc/mdstat 
Personalities : 
unused devices: <none>