Postmortems
- A dying PoE port corrupts packets and crashes my storage A decayed PoE port on a Ubiquiti USW Flex Mini corrupted large packets toward the NAS for three days, dropping storage sessions every 12 hours, while every network status light stayed green.
- An NVMe failure corrupts Postgres and app volumes over iSCSI One NVMe SSD died and dropped iSCSI write sessions mid-flight, leaving several XFS volumes unmountable. Every filesystem was repaired with no data loss.
- An SSD failure takes down my homelab production server The single SSD backing the Proxmox LVM thin pool failed and took down all ten VMs. No RAID, no backups: what survived was carried out of the disk images manually.