Marketplace ops cut false churn alerts by half
A United Kingdom marketplace team joined Observatory Team after AI alerts kept flagging “churn spikes” that were actually delayed webhook deliveries. Through the instrumentation-without-noise exercises and the weekly signal review ritual, they rewired event timing and added a human confirmation step before escalation.
Three months later, on-call pages related to retention anomalies dropped, and product reviews started with a single annotated narrative instead of twelve slides.