Past Incidents

We will update GitLab Runner to version 19.2.2.

Reference: #121

Start maintenance window: 17/08/2026 23:00
Stop maintenance window: 18/08/2026 02:00

We will update Collabora to version 26.04.3.1.1.

Reference: #1625

Start maintenance window: 17/08/2026 23:00
Stop maintenance window: 18/08/2026 02:00

We will update CoTurn to version 4.17.2.

Reference: #19

Start maintenance window: 17/08/2026 23:00
Stop maintenance window: 18/08/2026 02:00

We will update soft- and firmware throughout our cluster. During the update, a higher disk i/o latency is to be expected.

Start maintenance window: 17/08/2026 23:00
Stop maintenance window: 18/08/2026 02:00

We have noticed that delegating from one zone to another zone is currently not working. This occurs when both zones are hosted by us. Example:

# zone: exampe.com
sub.example.com NS <nameserver>

# zone: sub.example.com
sub.example.com A <ip>

We are currently in discussions with the supplier to resolve the issue. Meanwhile, the only solution is to remove the delegation and integrate everything into the main zone.

Progress:

• 13.08.2026 18:10: We are able to reliably reproduce the problem
• 13.08.2026 18:25: Currently, we think it's related to #17881, but this hasn't been confirmed yet
• 13.08.2026 18:56: We are in contact with our supplier
• 14.08.2026 10:29: Our supplier has identified the cause and working on resolving the issue
• 14.08.2026 13:05: It's working again to some extent. We're monitoring the situation
• 14.08.2026 15:45: The issue was resolved around midday. However, some public resolvers are still caching incorrect entries. This will resolve itself over time
• 17.08.2026 12:00: We continue to monitor the situation
• 18.08.2026 13:00: The issue has been resolved. No new issues have occurred inside our monitoring period

We will update Kibana to version 8.19.20.

Start maintenance window: 12/08/2026 23:00
Stop maintenance window: 13/08/2026 01:00

We will update Elasticsearch to version 8.19.20.

Start maintenance window: 12/08/2026 23:00
Stop maintenance window: 13/08/2026 01:00

We will update the following packages to the latest version.

• openjdk-21-jre-headless/stable-security 21.0.12+8-1~deb13u1 amd64 [upgradable from: 21.0.11+10-1~deb13u2]
• openjdk-21-jre/stable-security 21.0.12+8-1~deb13u1 amd64 [upgradable from: 21.0.11+10-1~deb13u2]

Start maintenance window: 11/08/2026 23:00
Stop maintenance window: 12/08/2026 02:00

• Updates for Various Minor Dependencies

We will update the following packages to the latest version.

• bind9-dnsutils/oldstable-security 1:9.18.49-1~deb12u2 amd64 [upgradable from: 1:9.18.49-1~deb12u1]
• bind9-host/oldstable-security 1:9.18.49-1~deb12u2 amd64 [upgradable from: 1:9.18.49-1~deb12u1]
• bind9-libs/oldstable-security 1:9.18.49-1~deb12u2 amd64 [upgradable from: 1:9.18.49-1~deb12u1]
• ca-certificates/oldstable-security 20250419~deb12u1 all [upgradable from: 20230311+deb12u1]
• chromium-common/oldstable-security 151.0.7922.108-1~deb12u1 amd64 [upgradable from: 151.0.7922.71-1~deb12u1]
• chromium/oldstable-security 151.0.7922.108-1~deb12u1 amd64 [upgradable from: 151.0.7922.71-1~deb12u1]
• chromium-sandbox/oldstable-security 151.0.7922.108-1~deb12u1 amd64 [upgradable from: 151.0.7922.71-1~deb12u1]
• containerd.io/bookworm 2.3.3-1~debian.12~bookworm amd64 [upgradable from: 2.2.6-1~debian.12~bookworm]
• dnsutils/oldstable-security 1:9.18.49-1~deb12u2 all [upgradable from: 1:9.18.49-1~deb12u1]
• docker-buildx-plugin/bookworm 0.36.1-1~debian.12~bookworm amd64 [upgradable from: 0.36.0-1~debian.12~bookworm]
• docker-ce/bookworm 5:29.7.2-1~debian.12~bookworm amd64 [upgradable from: 5:29.7.1-1~debian.12~bookworm]
• docker-ce-cli/bookworm 5:29.7.2-1~debian.12~bookworm amd64 [upgradable from: 5:29.7.1-1~debian.12~bookworm]
• docker-ce-rootless-extras/bookworm 5:29.7.2-1~debian.12~bookworm amd64 [upgradable from: 5:29.7.1-1~debian.12~bookworm]
• docker-compose-plugin/bookworm 5.4.0-1~debian.12~bookworm amd64 [upgradable from: 5.3.1-1~debian.12~bookworm]
• redis/oldstable-security 5:7.0.15-1~deb12u9 all [upgradable from: 5:7.0.15-1~deb12u8]
• redis-server/oldstable-security 5:7.0.15-1~deb12u9 amd64 [upgradable from: 5:7.0.15-1~deb12u8]
• redis-tools/oldstable-security 5:7.0.15-1~deb12u9 amd64 [upgradable from: 5:7.0.15-1~deb12u8]

Start maintenance window: 10/08/2026 23:00
Stop maintenance window: 11/08/2026 02:00

We will update the following packages to the latest version.

• bind9-dnsutils/oldoldstable-security 1:9.16.50-1~deb11u6 amd64 [upgradable from: 1:9.16.50-1~deb11u5]
• bind9-host/oldoldstable-security 1:9.16.50-1~deb11u6 amd64 [upgradable from: 1:9.16.50-1~deb11u5]
• bind9-libs/oldoldstable-security 1:9.16.50-1~deb11u6 amd64 [upgradable from: 1:9.16.50-1~deb11u5]
• blackfire/any 3:2026.8.0 amd64 [upgradable from: 3:2026.7.0]
• ca-certificates/oldoldstable-security 20250419~deb12u1~deb11u1 all [upgradable from: 20230311+deb12u1~deb11u1]
• containerd.io/bullseye 2.3.3-1~debian.11~bullseye amd64 [upgradable from: 2.2.6-1~debian.11~bullseye]
• dnsutils/oldoldstable-security 1:9.16.50-1~deb11u6 all [upgradable from: 1:9.16.50-1~deb11u5]
• docker-ce/bullseye 5:29.7.2-1~debian.11~bullseye amd64 [upgradable from: 5:29.7.1-1~debian.11~bullseye]
• docker-ce-cli/bullseye 5:29.7.2-1~debian.11~bullseye amd64 [upgradable from: 5:29.7.1-1~debian.11~bullseye]
• docker-ce-rootless-extras/bullseye 5:29.7.2-1~debian.11~bullseye amd64 [upgradable from: 5:29.7.1-1~debian.11~bullseye]
• docker-compose-plugin/bullseye 5.4.0-1~debian.11~bullseye amd64 [upgradable from: 5.3.1-1~debian.11~bullseye]
• libruby2.7/oldoldstable-security 2.7.4-1+deb11u6 amd64 [upgradable from: 2.7.4-1+deb11u5]
• redis-server/oldoldstable-security 5:6.0.16-1+deb11u9 amd64 [upgradable from: 5:6.0.16-1+deb11u8]
• redis-tools/oldoldstable-security 5:6.0.16-1+deb11u9 amd64 [upgradable from: 5:6.0.16-1+deb11u8]
• ruby2.7/oldoldstable-security 2.7.4-1+deb11u6 amd64 [upgradable from: 2.7.4-1+deb11u5]

Start maintenance window: 10/08/2026 23:00
Stop maintenance window: 11/08/2026 02:00

We will update Mailpit to version 1.30.7.

Reference: #54

Start maintenance window: 10/08/2026 23:00
Stop maintenance window: 11/08/2026 02:00

We will update Gotenberg to version 8.35.0.

Reference: #39

Start maintenance window: 10/08/2026 23:00
Stop maintenance window: 11/08/2026 02:00

We will update Roundcube to version 1.7.3.

Start maintenance window: 10/08/2026 23:00
Stop maintenance window: 11/08/2026 01:00

We will migrate an internal management system during this maintenance window.

During the migration, changes made in the Cockpit might not immediately get applied to the managed servers. We expect this limitation to last only for about 15-20 minutes.

Please plan your changes to be done before the maintenance window to make sure they run through. Changes made during the migration won't be lost and will be executed with a delay, as soon as the connectivity between the involved systems is restored.

Start maintenance window: 10/08/2026 21:00
Stop maintenance window: 10/08/2026 23:00

We will update the following packages to the latest version.

• linux-image-amd64/stable-security 6.12.101-1 amd64 [upgradable from: 6.12.100-1]
• linux-libc-dev/stable-security 6.12.101-1 all [upgradable from: 6.12.100-1]

Start maintenance window: 07/08/2026 23:00
Stop maintenance window: 08/08/2026 02:00

We will update the following packages to the latest version.

• linux-compiler-gcc-12-x86/oldstable-security 6.1.180-1 amd64 [upgradable from: 6.1.177-1]
• linux-headers-amd64/oldstable-security 6.1.180-1 amd64 [upgradable from: 6.1.177-1]
• linux-image-amd64/oldstable-security 6.1.180-1 amd64 [upgradable from: 6.1.177-1]
• linux-kbuild-6.1/oldstable-security 6.1.180-1 amd64 [upgradable from: 6.1.177-1]
• linux-libc-dev/oldstable-security 6.1.180-1 amd64 [upgradable from: 6.1.177-1]

Start maintenance window: 07/08/2026 23:00
Stop maintenance window: 08/08/2026 02:00

We will update the following packages to the latest version.

• linux-image-amd64/oldoldstable-security 5.10.262-1 amd64 [upgradable from: 5.10.259-1]
• linux-libc-dev/oldoldstable-security 5.10.262-1 amd64 [upgradable from: 5.10.259-1]

Start maintenance window: 07/08/2026 23:00
Stop maintenance window: 08/08/2026 02:00