P0 INCIDENTWebhook Delivery Failure (Event Ordering)#ENG-WAR-035StripeShopify
Mid~25 min15:00
API CPU Usage99.2%↑ 42%
P99 Latency2450 ms↑ 400%
5xx Error Rate12.4%↑ 12%
DB Connections14,492↑ 800%
bastion-prod-1.internal — bash
[SYSTEM] War-Room terminal initialised. Bastion host connection established.
[SYSTEM] Active incident: Webhook Delivery Failure (Event Ordering)
[SYSTEM] Type "help" for a list of investigation commands.
user@bastion:~$
Execute Remediation⚠ PROD
Your order management system processes Stripe webhooks. Orders are getting stuck in a "pending payment" state even after customers are successfully charged. Logs show: payment.succeeded webhook processed at 14:00:02, but payment.created webhook processed at 14:00:05 (3 seconds later). Your handler for payment.succeeded tries to update order status, but fails because the order doesn't exist yet — payment.created hadn't been processed yet.

What is your first action?