TLDR Tech / Data
Your Pipeline Succeeded. Your Data Didn't
A BigQuery-native anomaly detection system can catch silent data loss by monitoring ingestion volume across hundreds of tables using only built-in features like INFORMATION_SCHEMA logs and AI.DETECT_ANOMALIES. Implemented as a single dbt model, it detects abnormal drops in data volume without external tooling or per-table rules, helping teams identify partial pipeline failures that traditional pipeline success checks miss.
Read the full story