Blog · Topic

SRE

32 analyses tagged SRE
Cloud Platform Engineering

API Gateway WebSocket Failover: Keep Sessions Across Regions

API Gateway WebSocket failover breaks every live connection. AWS's multi-Region pattern restores sessions using a canary, Route 53 and Global Tables.

Cloud Platform Engineering

Google SRE Book Second Edition: What Changed in 10 Years

Google's SRE book second edition is a full rewrite for AI and platform engineering. What changed in SLOs, observability and team models, and who should read it.

Cloud Platform Engineering

Amazon ECS GPU Auto Repair: How It Replaces Failing GPUs

Amazon ECS Managed Instances now swap out failing NVIDIA GPU hosts automatically. How the DCGM checks, Xid codes, and 20% drain cap shape AWS GPU reliability.

Cloud Platform Engineering

Beyond the 30-Minute AZ Test: Running Multi-Day AWS Availability Zone Evacuation Drills

Multi-day AWS AZ evacuation drills expose failures short tests miss: capacity drift, DNS TTLs, pool exhaustion. A runbook for 72-hour ARC zonal shift drills.

Cloud Platform Engineering

How to Implement Predictive Autoscaling for GPU Workloads on Kubernetes

Reactive autoscaling can't keep up with GPU provisioning delays. This framework uses a Bi-LSTM predictor, burst detection, and a graduated scaler to close the gap.

Cloud Platform Engineering

How to Migrate AWS Organizations Without Breaking RAM Shares and Lake Formation

When accounts leave AWS Organizations, RAM shares silently break—halting Terraform deployments mid-migration. The bridge-share pattern preserved permissions across 382 accounts.

Cloud Platform Engineering

The 5-Step Framework for Automated Root Cause Analysis at Cloud-Native Scale

Atlassian's published approach to multi-signal correlation shows how to correlate metrics, traces, and logs to generate ranked RCA hypotheses automatically — narrowing a 200-service search to tens of services within minutes of an incident.

Cloud Platform Engineering

Three AWS Strategies for Disaster Recovery Under Data Residency Requirements

Meeting data residency regulations while maintaining disaster recovery capability forces a choice between three architecturally distinct approaches. AWS's framework maps the tradeoffs clearly — here's how to navigate them.

Cloud Platform Engineering

Adobe Firefly Cut GPU Metric Query Times 28x by Moving to Amazon Managed Prometheus

Adobe moved 2 million GPU time-series metrics from self-hosted Prometheus to Amazon's managed service. 24-hour queries that took 2 minutes now complete in 10 seconds — and the team got there without replacing their existing stack.

Cloud Platform Engineering

Platform Engineering ROI: The Real Cost of Building Your Own Internal Platform

A DIY internal developer platform runs $7.5M/year at enterprise scale. The ROI is real but requires 50+ engineers to capture. Here's how to read the math before committing.

Cloud Platform Engineering

AWS DevOps Agent + Wiz: Same Alert, Three Different Incidents

AWS DevOps Agent now queries Wiz over MCP mid-investigation, turning an ambiguous CPU spike into a confirmed security incident, an operational fix, or a coverage gap.

Cloud Platform Engineering

The Framework for Zero-Downtime Kubernetes When a Whole Cluster Dies

Linkerd's multicluster extension turns cluster failure from a runbook into an automatic rebalance — three federation modes, chaos-tested, for $10-15/day.

Cloud Platform Engineering

CloudFormation's Custom Resources Have No Failover Story. AWS Just Wrote One.

AWS's reference architecture for multi-region CloudFormation custom resources solves duplicate execution and failover gaps native CloudFormation was never built to handle.

Cloud Platform Engineering

The Quorum Math Behind Multi-Cluster Kubernetes Databases

CNCF's architecture guide shows multi-cluster Kubernetes databases survive regional failure on vote count, not node count: an odd, cross-cluster quorum design.

Cloud Platform Engineering

How 121 Million gRPC Connections Exposed a Fatal DNS Assumption

Bitdrift's T20 World Cup incident: a single DNS routing policy caused 80% errors when 121M devices connected at once. The fix required zero code changes.

Cloud Platform Engineering

AWS DevOps Agent + Kiro CLI: The Incident Remediation Loop That Fixes Itself

AWS has published a production blueprint where DevOps Agent investigates incidents and Kiro CLI applies the fix — reducing MTTR by 75% with a single human touchpoint: PR approval.

Cloud Platform Engineering

Amazon SQS at 20: How a Simple Queue Became the Backbone of Cloud Infrastructure

Launched July 13, 2006 alongside EC2 and S3, Amazon SQS turns 20 with 70,000 TPS throughput and 1 MiB payloads. What two decades of iteration reveals about distributed systems design.

Cloud Platform Engineering

What Running Kubernetes at Million-Cluster Scale Taught AWS About Zonal Failures

AWS operates hundreds of thousands of EKS clusters across 30+ regions. The core lesson from that scale: most availability problems don't come from components failing — they come from components reacting in ways that make failures worse. Here's what static stability means in practice.

Cloud Platform Engineering

How S&P Global Hit 15-Minute RTO on Capital IQ Using Amazon FSx and NetApp ONTAP

S&P Global's Capital IQ platform now achieves sub-15-minute read-only failover using Amazon FSx SnapMirror and FlexClone pre-provisioning. The design turns disaster recovery into a traffic redirect.

Cloud Platform Engineering

The 4-Body Problem of SRE: Why Autonomous Operations Require Unified Context

Autonomous SRE operations don't fail because models aren't good enough. They fail because the four bodies of operational knowledge — code, infrastructure, signals, and tribal wisdom — stay fragmented.

Cloud Platform Engineering

AWS EKS Kubernetes Version Rollbacks: Upgrading Is No Longer a One-Way Door

Amazon EKS now lets teams reverse a Kubernetes version upgrade within 7 days. Here's how rollback works, what the limits are, and what it changes for platform engineers.

Cloud Platform Engineering

50% of Your Metrics Are Never Queried: The Case for Sustainable Observability

CNCF's telemetry panel found that half of collected metrics are never acted on. Here's the framework for designing observability pipelines that produce signal, not storage overhead.

Cloud Platform Engineering

88% of Enterprises Had AI Agent Security Incidents — Because They Can't See Inside Their Agents

New data shows 88% of enterprises experienced AI agent security incidents in the past year, with only 21% having runtime visibility into agent behavior. The missing layer isn't logging — it's decision traceability.

Cloud Platform Engineering

Claude Fable Cost $9 in One Coding Test. GPT-5.5 Cost $1.50. Model Triage Is Now a Platform Engineering Skill.

When the same coding task costs 6x more on one frontier model than another, model selection stops being a preference and becomes infrastructure. How platform engineers are building routing policies before AI spend compounds into a budget crisis.

Cloud Platform Engineering

Why Verifying AI Agents Is a Runtime Problem, Not a Build-Time One

Static testing and pre-deployment checks were built for synchronous, deterministic software. Async AI agents in cloud-native environments require a fundamentally different verification model — one that operates at runtime.

Cloud Platform Engineering

82% of Observability Alerts Are Never Acted On. The Data Shows Why.

PagerDuty data shows 82% of enterprise alerts are noise—while 41% of SREs have considered leaving over alert volume. The problem isn't more observability.

Cloud Platform Engineering

How Google SRE Is Using Agentic AI to Improve Operations

Google SRE deployed agentic AI across reliability design, anomaly detection, incident management, and autonomous mitigation — with governance principles for production-safe deployment.

Cloud Platform Engineering

AWS Resilience Hub's Next Generation Brings AI-Powered Failure Mode Analysis to SRE

AWS Resilience Hub now uses generative AI to automatically identify failure modes against defined policies. Here's what changed and why it matters for platform engineering teams managing production resilience at scale.

Cloud Platform Engineering

Migrating From ingress-nginx to Envoy Gateway Without Dropping a Single Request

How weighted Route 53 DNS records enable zero-downtime Kubernetes ingress migration from ingress-nginx to Envoy Gateway — and where the naive approach fails.

Cloud Platform Engineering

Kubernetes v1.36 Declarative Validation: Retiring 18,000 Lines of Code

Kubernetes API validation graduated to GA — a code generator now replaces 18K lines of handwritten Go. What platform teams gain from the shift to marker-based validation.

Cloud Platform Engineering

Only 37% of Developers Trust AI for Incident Response. The Gap Is Solvable.

PagerDuty's State of AI-First Operations survey reveals a 22-point trust gap between IT leaders and developers on AI in incident response — while $300K/hour outages fuel developer burnout at 42% of organizations.

Cloud Platform Engineering

AWS DevOps Agent: Autonomous Incident Response in Under 5 Minutes

AWS DevOps Agent uses agentic AI on Bedrock AgentCore to resolve incidents autonomously — from alarm to root cause analysis in under 5 minutes.

Newsletter coming soon.

Curated digests across AI, biohacking, photography, travel, and more. Be the first to know when we launch.