docker mount volume filewatcher detect changes

br-069ee8939c9c: port 1(veth13a279e) entered blocking state IPv6: ADDRCONF(NETDEV_UP): veth13a279e: link is not ready I doubt I will be able to notice the issue faster. I think I am already too late with running dmesg at this point. systemd-journald: Failed to write entry (21 items, 858 bytes), ignoring: Read-only file system Note that this is just a small portion, dmesg returns a lot of these, but they're all the same format Read-only file system format. The output of dmesg somewhat a minute after the corruption occurs. I obviously can't keep doing this as I need to remove all broken files and redeploy all docker images. I follow this up by running sudo docker image rm gitlab/gitlab-ee -f for all affected images. dev/mapper/ubuntu-vg-ubuntu-lv: ***** REBOOT SYSTEM ***** dev/mapper/ubuntu-vg-ubuntu-lv: ***** FILE SYSTEM WAS MODIFIED ***** Inode 395236 was part of the orphaned inode list. Inodes that were part of a corrupted orphan linked list found. Pass 1: Checking inodes, blocks, and sizes dev/mapper/ubuntu-vg-ubuntu-lv contains a file system with errors, check forced. Journal checksum error found in /dev/mapper/ubuntu-vg-ubuntu-lv JBD2: Invalid checksum recovering block 5769164 in log JBD2: Invalid checksum recovering block 5767200 in log

JBD2: Invalid checksum recovering block 6294682 in log dev/mapper/ubuntu-vg-ubuntu-lv: recovering journal Shortened output of the command: fsck from util-linux 2.31.1 I can run fsck /dev/mapper/ubuntu-vg-ubuntu-lv which ends up reporting and fixing a lot of errors in /var/lib/docker/overlay2/. I have very little experience investigating these types of issues.Įvery few weeks I will try to access one of the services hosted on the server and notice they don't respond.įrom experience I know this means the /dev/mapper/ubuntu-vg-ubuntu-lv volume went read only. Recently the server enters a read only state on the main LVM volume, this is the volume where Ubuntu is installed. I have a small home server where I host a few services I like.

Docker mount volume filewatcher detect changes