Cats on a Keyboard

Sign in Subscribe

Infrastructure

Dropping Matrix

Dropping Matrix

TL;DR: All Fyra Matrix rooms will be deleted and unbridged. Discord will become our sole communication medium from now on. We can't justify the maintenance burden and infrastructure cost to support a platform relatively few people used, built in an ecosystem veering towards unsustainability. (it's

Incident Report: Cascading failure on KeyDB server

Incident Report: Cascading failure on KeyDB server

An issue with KeyDB logging caused our infrastructure to briefly crash. All services are now working.

Introducing: Chisel Operator for Kubernetes (Alpha)

Introducing: Chisel Operator for Kubernetes (Alpha)

We tech enthusiasts love self-hosting. And the most of us have one tiny issue that prevents us from achieving it: CGNAT. Today we're running out of IPv4 addresses, and the reason is due to a a mathematical error and a lack of foresight of our forefathers. We never

Incident Report: Full Networking failure on April 9, 2023

Incident Report: Full Networking failure on April 9, 2023

On around 2AM ICT, we have detected some unusual CPU utilization on one of our cluster nodes, presumed to be some kind of CRI bug related to containerd and runc which is an upstream issue, throttling all other services and causing them to fail. We have decided to do a

Full Sail: Migrating our Infrastructure to Kubernetes

A story of migration, corner cutting, and elaborate hacks in an attempt to achieve high availbility and observability