Real-time observability for data pipelines that catches bad data and failed runs before anyone downstream notices.
- Engineered a data-quality monitoring platform with FastAPI, PostgreSQL, Airflow, and dbt on a bronze → silver → gold medallion design, handling 10,000+ events per day at sub-200ms latency.
- Automated quality checks flag and catch bad data before it propagates downstream; a live Next.js dashboard streams pipeline health over WebSockets with anomaly alerting.
- Containerized with Docker and shipped through Kubernetes with GitHub Actions CI/CD, cutting failure detection from hours to under 10 seconds.
